You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by aw...@apache.org on 2017/09/01 02:08:18 UTC
[01/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Repository: hadoop
Updated Branches:
refs/heads/trunk 91cc070d6 -> 190410085
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.5.0/RELEASENOTES.2.5.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.5.0/RELEASENOTES.2.5.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.5.0/RELEASENOTES.2.5.0.md
index 43fb3fa..4534a7f 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.5.0/RELEASENOTES.2.5.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.5.0/RELEASENOTES.2.5.0.md
@@ -23,14 +23,23 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-10568](https://issues.apache.org/jira/browse/HADOOP-10568) | *Major* | **Add s3 server-side encryption**
+* [HADOOP-10342](https://issues.apache.org/jira/browse/HADOOP-10342) | *Major* | **Extend UserGroupInformation to return a UGI given a preauthenticated kerberos Subject**
-s3 server-side encryption is now supported.
+Add getUGIFromSubject to leverage an external kerberos authentication
-To enable this feature, specify the following in your client-side configuration:
-name: fs.s3n.server-side-encryption-algorithm
-value: AES256
+---
+
+* [HDFS-6164](https://issues.apache.org/jira/browse/HDFS-6164) | *Major* | **Remove lsr in OfflineImageViewer**
+
+The offlineimageviewer no longer generates lsr-style outputs. The functionality has been superseded by a tool that takes the fsimage and exposes WebHDFS-like API for user queries.
+
+
+---
+
+* [HDFS-6168](https://issues.apache.org/jira/browse/HDFS-6168) | *Major* | **Remove deprecated methods in DistributedFileSystem**
+
+**WARNING: No release note provided for this change.**
---
@@ -45,9 +54,9 @@ Map\<String, String\> sasl\_props = saslPropsResolver.getDefaultProperties();
---
-* [HADOOP-10342](https://issues.apache.org/jira/browse/HADOOP-10342) | *Major* | **Extend UserGroupInformation to return a UGI given a preauthenticated kerberos Subject**
+* [HDFS-6153](https://issues.apache.org/jira/browse/HDFS-6153) | *Minor* | **Document "fileId" and "childrenNum" fields in the FileStatus Json schema**
-Add getUGIFromSubject to leverage an external kerberos authentication
+**WARNING: No release note provided for this change.**
---
@@ -59,13 +68,6 @@ Remove MRv1 settings from hadoop-metrics2.properties, add YARN settings instead.
---
-* [HDFS-6293](https://issues.apache.org/jira/browse/HDFS-6293) | *Blocker* | **Issues with OIV processing PB-based fsimages**
-
-Set "dfs.namenode.legacy-oiv-image.dir" to an appropriate directory to make standby name node or secondary name node save its file system state in the old fsimage format during checkpointing. This image can be used for offline analysis using the OfflineImageViewer. Use the "hdfs oiv\_legacy" command to process the old fsimage format.
-
-
----
-
* [HDFS-6273](https://issues.apache.org/jira/browse/HDFS-6273) | *Major* | **Config options to allow wildcard endpoints for namenode HTTP and HTTPS servers**
HDFS-6273 introduces two new HDFS configuration keys:
@@ -83,23 +85,21 @@ These keys complement the existing NameNode options:
---
-* [HDFS-6168](https://issues.apache.org/jira/browse/HDFS-6168) | *Major* | **Remove deprecated methods in DistributedFileSystem**
-
-**WARNING: No release note provided for this incompatible change.**
-
+* [HADOOP-10568](https://issues.apache.org/jira/browse/HADOOP-10568) | *Major* | **Add s3 server-side encryption**
----
+s3 server-side encryption is now supported.
-* [HDFS-6164](https://issues.apache.org/jira/browse/HDFS-6164) | *Major* | **Remove lsr in OfflineImageViewer**
+To enable this feature, specify the following in your client-side configuration:
-The offlineimageviewer no longer generates lsr-style outputs. The functionality has been superseded by a tool that takes the fsimage and exposes WebHDFS-like API for user queries.
+name: fs.s3n.server-side-encryption-algorithm
+value: AES256
---
-* [HDFS-6153](https://issues.apache.org/jira/browse/HDFS-6153) | *Minor* | **Document "fileId" and "childrenNum" fields in the FileStatus Json schema**
+* [HDFS-6293](https://issues.apache.org/jira/browse/HDFS-6293) | *Blocker* | **Issues with OIV processing PB-based fsimages**
-**WARNING: No release note provided for this incompatible change.**
+Set "dfs.namenode.legacy-oiv-image.dir" to an appropriate directory to make standby name node or secondary name node save its file system state in the old fsimage format during checkpointing. This image can be used for offline analysis using the OfflineImageViewer. Use the "hdfs oiv\_legacy" command to process the old fsimage format.
---
@@ -114,16 +114,16 @@ dfs.datanode.slow.io.warning.threshold.ms (Default 300ms)
---
-* [MAPREDUCE-5777](https://issues.apache.org/jira/browse/MAPREDUCE-5777) | *Major* | **Support utf-8 text with BOM (byte order marker)**
+* [YARN-2107](https://issues.apache.org/jira/browse/YARN-2107) | *Major* | **Refactor timeline classes into server.timeline package**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-2107](https://issues.apache.org/jira/browse/YARN-2107) | *Major* | **Refactor timeline classes into server.timeline package**
+* [MAPREDUCE-5777](https://issues.apache.org/jira/browse/MAPREDUCE-5777) | *Major* | **Support utf-8 text with BOM (byte order marker)**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[48/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.0/CHANGES.0.15.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.0/CHANGES.0.15.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.0/CHANGES.0.15.0.md
index cb85716..f511ccf 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.0/CHANGES.0.15.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.0/CHANGES.0.15.0.md
@@ -20,31 +20,21 @@
## Release 0.15.0 - 2007-10-19
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1963](https://issues.apache.org/jira/browse/HADOOP-1963) | Code contribution of Kosmos Filesystem implementation of Hadoop Filesystem interface | Major | fs | Sriram Rao | Sriram Rao |
-| [HADOOP-1914](https://issues.apache.org/jira/browse/HADOOP-1914) | HDFS should have a NamenodeProtocol to allow secondary namenodes and rebalancing processes to communicate with a primary namenode | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1894](https://issues.apache.org/jira/browse/HADOOP-1894) | Add fancy graphs for mapred task statuses | Major | . | Enis Soztutar | Enis Soztutar |
+| [HADOOP-1727](https://issues.apache.org/jira/browse/HADOOP-1727) | Make ...hbase.io.MapWritable more generic so that it can be included in ...hadoop.io | Minor | io | Jim Kellerman | Jim Kellerman |
+| [HADOOP-1351](https://issues.apache.org/jira/browse/HADOOP-1351) | Want to kill a particular task or attempt | Major | . | Owen O'Malley | Enis Soztutar |
| [HADOOP-1880](https://issues.apache.org/jira/browse/HADOOP-1880) | SleepJob | Major | . | Enis Soztutar | Enis Soztutar |
+| [HADOOP-1809](https://issues.apache.org/jira/browse/HADOOP-1809) | Add link to irc channel #hadoop | Major | . | Enis Soztutar | Enis Soztutar |
+| [HADOOP-1894](https://issues.apache.org/jira/browse/HADOOP-1894) | Add fancy graphs for mapred task statuses | Major | . | Enis Soztutar | Enis Soztutar |
+| [HADOOP-1914](https://issues.apache.org/jira/browse/HADOOP-1914) | HDFS should have a NamenodeProtocol to allow secondary namenodes and rebalancing processes to communicate with a primary namenode | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-1851](https://issues.apache.org/jira/browse/HADOOP-1851) | Map output compression codec cannot be set independently of job output compression codec | Major | . | Riccardo Boscolo | Arun C Murthy |
+| [HADOOP-1963](https://issues.apache.org/jira/browse/HADOOP-1963) | Code contribution of Kosmos Filesystem implementation of Hadoop Filesystem interface | Major | fs | Sriram Rao | Sriram Rao |
| [HADOOP-1822](https://issues.apache.org/jira/browse/HADOOP-1822) | Allow SOCKS proxy configuration to remotely access the DFS and submit Jobs | Minor | ipc | Christophe Taton | Christophe Taton |
-| [HADOOP-1809](https://issues.apache.org/jira/browse/HADOOP-1809) | Add link to irc channel #hadoop | Major | . | Enis Soztutar | Enis Soztutar |
-| [HADOOP-1727](https://issues.apache.org/jira/browse/HADOOP-1727) | Make ...hbase.io.MapWritable more generic so that it can be included in ...hadoop.io | Minor | io | Jim Kellerman | Jim Kellerman |
-| [HADOOP-1351](https://issues.apache.org/jira/browse/HADOOP-1351) | Want to kill a particular task or attempt | Major | . | Owen O'Malley | Enis Soztutar |
| [HADOOP-789](https://issues.apache.org/jira/browse/HADOOP-789) | DFS shell should return a list of nodes for a file saying that where the blocks for these files are located. | Minor | . | Mahadev konar | Mahadev konar |
@@ -52,155 +42,143 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-2046](https://issues.apache.org/jira/browse/HADOOP-2046) | Documentation: improve mapred javadocs | Blocker | documentation | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1971](https://issues.apache.org/jira/browse/HADOOP-1971) | Constructing a JobConf without a class leads to a very misleading error message. | Minor | . | Ted Dunning | Enis Soztutar |
-| [HADOOP-1968](https://issues.apache.org/jira/browse/HADOOP-1968) | Wildcard input syntax (glob) should support {} | Major | fs | eric baldeschwieler | Hairong Kuang |
-| [HADOOP-1942](https://issues.apache.org/jira/browse/HADOOP-1942) | Increase the concurrency of transaction logging to edits log | Blocker | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1933](https://issues.apache.org/jira/browse/HADOOP-1933) | Consider include/exclude files while listing datanodes. | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1926](https://issues.apache.org/jira/browse/HADOOP-1926) | Design/implement a set of compression benchmarks for the map-reduce framework | Major | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1921](https://issues.apache.org/jira/browse/HADOOP-1921) | Save the configuration of completed/failed jobs and make them available via the web-ui. | Major | . | Arun C Murthy | Amar Kamat |
-| [HADOOP-1908](https://issues.apache.org/jira/browse/HADOOP-1908) | Restructure data node code so that block sending/receiving is seperated from data transfer header handling | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1906](https://issues.apache.org/jira/browse/HADOOP-1906) | JobConf should warn about the existance of obsolete mapred-default.xml. | Major | conf | Owen O'Malley | Arun C Murthy |
-| [HADOOP-1881](https://issues.apache.org/jira/browse/HADOOP-1881) | Update documentation for hadoop's configuration post HADOOP-785 | Major | documentation | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1878](https://issues.apache.org/jira/browse/HADOOP-1878) | Change priority feature in the job details JSP page misses spaces between each priority link | Trivial | . | Thomas Friol | Thomas Friol |
-| [HADOOP-1803](https://issues.apache.org/jira/browse/HADOOP-1803) | Generalize making contrib bin content executable in ant package target | Minor | build | stack | stack |
-| [HADOOP-1779](https://issues.apache.org/jira/browse/HADOOP-1779) | Small INodeDirectory enhancement to get all existing INodes components on a path | Trivial | . | Christophe Taton | Christophe Taton |
-| [HADOOP-1777](https://issues.apache.org/jira/browse/HADOOP-1777) | Typo issue in the job details JSP page | Trivial | . | Thomas Friol | Thomas Friol |
-| [HADOOP-1774](https://issues.apache.org/jira/browse/HADOOP-1774) | Remove use of INode.parent in Block CRC upgrade | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1767](https://issues.apache.org/jira/browse/HADOOP-1767) | JobClient CLI cleanup and improvement | Minor | . | Christophe Taton | Christophe Taton |
-| [HADOOP-1766](https://issues.apache.org/jira/browse/HADOOP-1766) | Merging Block and BlockInfo classes on name-node. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1762](https://issues.apache.org/jira/browse/HADOOP-1762) | Namenode does not need to store storageID and datanodeID persistently | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1759](https://issues.apache.org/jira/browse/HADOOP-1759) | File name should be represented by a byte array instead of a String | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1756](https://issues.apache.org/jira/browse/HADOOP-1756) | Add toString() methods to some Writable types | Major | io | Andrzej Bialecki | Andrzej Bialecki |
-| [HADOOP-1750](https://issues.apache.org/jira/browse/HADOOP-1750) | We should log better if something goes wrong with the process fork | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1744](https://issues.apache.org/jira/browse/HADOOP-1744) | Small cleanup of DistributedFileSystem and DFSClient (next) | Trivial | . | Christophe Taton | Christophe Taton |
-| [HADOOP-1743](https://issues.apache.org/jira/browse/HADOOP-1743) | INode refactoring | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1731](https://issues.apache.org/jira/browse/HADOOP-1731) | contrib jar file names should include hadoop version number | Major | . | Doug Cutting | Doug Cutting |
-| [HADOOP-1718](https://issues.apache.org/jira/browse/HADOOP-1718) | Test coverage target in build files using clover | Major | build | Nigel Daley | Nigel Daley |
-| [HADOOP-1703](https://issues.apache.org/jira/browse/HADOOP-1703) | Small cleanup of DistributedFileSystem and DFSClient | Trivial | . | Christophe Taton | Christophe Taton |
-| [HADOOP-1693](https://issues.apache.org/jira/browse/HADOOP-1693) | Remove LOG members from PendingReplicationBlocks and ReplicationTargetChooser. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1687](https://issues.apache.org/jira/browse/HADOOP-1687) | Name-node memory size estimates and optimization proposal. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
| [HADOOP-1667](https://issues.apache.org/jira/browse/HADOOP-1667) | organize CHANGES.txt messages into sections for future releases | Major | documentation | Doug Cutting | Doug Cutting |
-| [HADOOP-1654](https://issues.apache.org/jira/browse/HADOOP-1654) | IOUtils class | Major | io | Enis Soztutar | Enis Soztutar |
-| [HADOOP-1626](https://issues.apache.org/jira/browse/HADOOP-1626) | DFSAdmin. Help messages are missing for -finalizeUpgrade and -metasave. | Blocker | . | Konstantin Shvachko | Lohit Vijayarenu |
-| [HADOOP-1621](https://issues.apache.org/jira/browse/HADOOP-1621) | Make FileStatus a concrete class | Major | fs | Chris Douglas | Chris Douglas |
| [HADOOP-1610](https://issues.apache.org/jira/browse/HADOOP-1610) | Add metrics for failed tasks | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-1621](https://issues.apache.org/jira/browse/HADOOP-1621) | Make FileStatus a concrete class | Major | fs | Chris Douglas | Chris Douglas |
| [HADOOP-1595](https://issues.apache.org/jira/browse/HADOOP-1595) | Add an option to setReplication method to wait for completion of replication | Major | . | Christian Kunz | Tsz Wo Nicholas Sze |
-| [HADOOP-1592](https://issues.apache.org/jira/browse/HADOOP-1592) | Print the diagnostic error messages for FAILED task-attempts to the user console via TaskCompletionEvents | Major | . | Arun C Murthy | Amar Kamat |
-| [HADOOP-1500](https://issues.apache.org/jira/browse/HADOOP-1500) | typo's in dfs webui | Trivial | . | Nigel Daley | Nigel Daley |
+| [HADOOP-1693](https://issues.apache.org/jira/browse/HADOOP-1693) | Remove LOG members from PendingReplicationBlocks and ReplicationTargetChooser. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1231](https://issues.apache.org/jira/browse/HADOOP-1231) | Add generics to Mapper and Reducer interfaces | Major | . | Owen O'Malley | Tom White |
| [HADOOP-1436](https://issues.apache.org/jira/browse/HADOOP-1436) | Redesign Tool and ToolBase API and releted functionality | Major | util | Enis Soztutar | Enis Soztutar |
+| [HADOOP-1703](https://issues.apache.org/jira/browse/HADOOP-1703) | Small cleanup of DistributedFileSystem and DFSClient | Trivial | . | Christophe Taton | Christophe Taton |
+| [HADOOP-1743](https://issues.apache.org/jira/browse/HADOOP-1743) | INode refactoring | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1731](https://issues.apache.org/jira/browse/HADOOP-1731) | contrib jar file names should include hadoop version number | Major | . | Doug Cutting | Doug Cutting |
+| [HADOOP-1756](https://issues.apache.org/jira/browse/HADOOP-1756) | Add toString() methods to some Writable types | Major | io | Andrzej Bialecki | Andrzej Bialecki |
+| [HADOOP-1744](https://issues.apache.org/jira/browse/HADOOP-1744) | Small cleanup of DistributedFileSystem and DFSClient (next) | Trivial | . | Christophe Taton | Christophe Taton |
+| [HADOOP-1654](https://issues.apache.org/jira/browse/HADOOP-1654) | IOUtils class | Major | io | Enis Soztutar | Enis Soztutar |
+| [HADOOP-1759](https://issues.apache.org/jira/browse/HADOOP-1759) | File name should be represented by a byte array instead of a String | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1766](https://issues.apache.org/jira/browse/HADOOP-1766) | Merging Block and BlockInfo classes on name-node. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1158](https://issues.apache.org/jira/browse/HADOOP-1158) | JobTracker should collect statistics of failed map output fetches, and take decisions to reexecute map tasks and/or restart the (possibly faulty) Jetty server on the TaskTracker | Major | . | Devaraj Das | Arun C Murthy |
+| [HADOOP-1777](https://issues.apache.org/jira/browse/HADOOP-1777) | Typo issue in the job details JSP page | Trivial | . | Thomas Friol | Thomas Friol |
+| [HADOOP-1767](https://issues.apache.org/jira/browse/HADOOP-1767) | JobClient CLI cleanup and improvement | Minor | . | Christophe Taton | Christophe Taton |
+| [HADOOP-1750](https://issues.apache.org/jira/browse/HADOOP-1750) | We should log better if something goes wrong with the process fork | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1803](https://issues.apache.org/jira/browse/HADOOP-1803) | Generalize making contrib bin content executable in ant package target | Minor | build | stack | stack |
+| [HADOOP-1779](https://issues.apache.org/jira/browse/HADOOP-1779) | Small INodeDirectory enhancement to get all existing INodes components on a path | Trivial | . | Christophe Taton | Christophe Taton |
| [HADOOP-1425](https://issues.apache.org/jira/browse/HADOOP-1425) | Rework the various programs in 'examples' to extend ToolBase | Minor | . | Arun C Murthy | Enis Soztutar |
+| [HADOOP-1687](https://issues.apache.org/jira/browse/HADOOP-1687) | Name-node memory size estimates and optimization proposal. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
| [HADOOP-1266](https://issues.apache.org/jira/browse/HADOOP-1266) | Remove DatanodeDescriptor dependency from NetworkTopology | Major | . | Konstantin Shvachko | Hairong Kuang |
-| [HADOOP-1231](https://issues.apache.org/jira/browse/HADOOP-1231) | Add generics to Mapper and Reducer interfaces | Major | . | Owen O'Malley | Tom White |
-| [HADOOP-1158](https://issues.apache.org/jira/browse/HADOOP-1158) | JobTracker should collect statistics of failed map output fetches, and take decisions to reexecute map tasks and/or restart the (possibly faulty) Jetty server on the TaskTracker | Major | . | Devaraj Das | Arun C Murthy |
| [HADOOP-785](https://issues.apache.org/jira/browse/HADOOP-785) | Divide the server and client configurations | Major | conf | Owen O'Malley | Arun C Murthy |
+| [HADOOP-1718](https://issues.apache.org/jira/browse/HADOOP-1718) | Test coverage target in build files using clover | Major | build | Nigel Daley | Nigel Daley |
+| [HADOOP-1774](https://issues.apache.org/jira/browse/HADOOP-1774) | Remove use of INode.parent in Block CRC upgrade | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1592](https://issues.apache.org/jira/browse/HADOOP-1592) | Print the diagnostic error messages for FAILED task-attempts to the user console via TaskCompletionEvents | Major | . | Arun C Murthy | Amar Kamat |
+| [HADOOP-1878](https://issues.apache.org/jira/browse/HADOOP-1878) | Change priority feature in the job details JSP page misses spaces between each priority link | Trivial | . | Thomas Friol | Thomas Friol |
+| [HADOOP-1762](https://issues.apache.org/jira/browse/HADOOP-1762) | Namenode does not need to store storageID and datanodeID persistently | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1500](https://issues.apache.org/jira/browse/HADOOP-1500) | typo's in dfs webui | Trivial | . | Nigel Daley | Nigel Daley |
+| [HADOOP-1921](https://issues.apache.org/jira/browse/HADOOP-1921) | Save the configuration of completed/failed jobs and make them available via the web-ui. | Major | . | Arun C Murthy | Amar Kamat |
+| [HADOOP-1908](https://issues.apache.org/jira/browse/HADOOP-1908) | Restructure data node code so that block sending/receiving is seperated from data transfer header handling | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1933](https://issues.apache.org/jira/browse/HADOOP-1933) | Consider include/exclude files while listing datanodes. | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1926](https://issues.apache.org/jira/browse/HADOOP-1926) | Design/implement a set of compression benchmarks for the map-reduce framework | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-1626](https://issues.apache.org/jira/browse/HADOOP-1626) | DFSAdmin. Help messages are missing for -finalizeUpgrade and -metasave. | Blocker | . | Konstantin Shvachko | Lohit Vijayarenu |
+| [HADOOP-1968](https://issues.apache.org/jira/browse/HADOOP-1968) | Wildcard input syntax (glob) should support {} | Major | fs | eric baldeschwieler | Hairong Kuang |
+| [HADOOP-1906](https://issues.apache.org/jira/browse/HADOOP-1906) | JobConf should warn about the existance of obsolete mapred-default.xml. | Major | conf | Owen O'Malley | Arun C Murthy |
+| [HADOOP-1971](https://issues.apache.org/jira/browse/HADOOP-1971) | Constructing a JobConf without a class leads to a very misleading error message. | Minor | . | Ted Dunning | Enis Soztutar |
+| [HADOOP-1942](https://issues.apache.org/jira/browse/HADOOP-1942) | Increase the concurrency of transaction logging to edits log | Blocker | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-2046](https://issues.apache.org/jira/browse/HADOOP-2046) | Documentation: improve mapred javadocs | Blocker | documentation | Arun C Murthy | Arun C Murthy |
+| [HADOOP-1881](https://issues.apache.org/jira/browse/HADOOP-1881) | Update documentation for hadoop's configuration post HADOOP-785 | Major | documentation | Arun C Murthy | Arun C Murthy |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-2103](https://issues.apache.org/jira/browse/HADOOP-2103) | HADOOP-2046 caused some javadoc anomalies | Major | documentation | Nigel Daley | Nigel Daley |
-| [HADOOP-2102](https://issues.apache.org/jira/browse/HADOOP-2102) | ToolBase doesn't keep configuration | Blocker | util | Dennis Kubes | Dennis Kubes |
-| [HADOOP-2080](https://issues.apache.org/jira/browse/HADOOP-2080) | ChecksumFileSystem checksum file size incorrect. | Blocker | fs | Richard Lee | Owen O'Malley |
-| [HADOOP-2073](https://issues.apache.org/jira/browse/HADOOP-2073) | Datanode corruption if machine dies while writing VERSION file | Blocker | . | Michael Bieniosek | Konstantin Shvachko |
-| [HADOOP-2072](https://issues.apache.org/jira/browse/HADOOP-2072) | RawLocalFileStatus is causing Path problems | Major | fs | Dennis Kubes | |
-| [HADOOP-2070](https://issues.apache.org/jira/browse/HADOOP-2070) | Test org.apache.hadoop.mapred.pipes.TestPipes.unknown failed | Blocker | . | Mukund Madhugiri | Owen O'Malley |
-| [HADOOP-2051](https://issues.apache.org/jira/browse/HADOOP-2051) | JobTracker's TaskCommitQueue is vulnerable to non-IOExceptions | Blocker | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-2048](https://issues.apache.org/jira/browse/HADOOP-2048) | DISTCP mapper should report progress more often | Blocker | . | Runping Qi | Chris Douglas |
-| [HADOOP-2044](https://issues.apache.org/jira/browse/HADOOP-2044) | Namenode encounters ClassCastException exceptions for INodeFileUnderConstruction | Blocker | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-2033](https://issues.apache.org/jira/browse/HADOOP-2033) | In SequenceFile sync doesn't work unless the file is compressed (block or record) | Blocker | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-2031](https://issues.apache.org/jira/browse/HADOOP-2031) | Lost tasktracker not handled properly leading to tips wrongly being kept as completed, and hence not rescheduled | Blocker | . | Devaraj Das | Devaraj Das |
-| [HADOOP-2028](https://issues.apache.org/jira/browse/HADOOP-2028) | distcp fails if log dir not specified and destination not present | Blocker | util | Chris Douglas | Chris Douglas |
-| [HADOOP-2026](https://issues.apache.org/jira/browse/HADOOP-2026) | Namenode prints out too many log lines for "Number of transactions" | Blocker | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-2023](https://issues.apache.org/jira/browse/HADOOP-2023) | TestLocalDirAllocator fails on Windows | Blocker | fs | Mukund Madhugiri | Hairong Kuang |
-| [HADOOP-2022](https://issues.apache.org/jira/browse/HADOOP-2022) | Task times are not saved correctly (bug in hadoop-1874) | Blocker | . | Devaraj Das | Amar Kamat |
-| [HADOOP-2018](https://issues.apache.org/jira/browse/HADOOP-2018) | Broken pipe SocketException in DataNode$DataXceiver | Blocker | . | Konstantin Shvachko | Hairong Kuang |
-| [HADOOP-2016](https://issues.apache.org/jira/browse/HADOOP-2016) | Race condition in removing a KILLED task from tasktracker | Blocker | . | Devaraj Das | Arun C Murthy |
-| [HADOOP-1997](https://issues.apache.org/jira/browse/HADOOP-1997) | TestCheckpoint fails on Windows | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1992](https://issues.apache.org/jira/browse/HADOOP-1992) | Sort validation is taking considerably longer than before | Blocker | . | Mukund Madhugiri | Arun C Murthy |
-| [HADOOP-1983](https://issues.apache.org/jira/browse/HADOOP-1983) | jobs using pipes interface with tasks not using java output format have a good chance of not updating progress and timing out | Major | . | Christian Kunz | Owen O'Malley |
-| [HADOOP-1978](https://issues.apache.org/jira/browse/HADOOP-1978) | Name-node should remove edits.new during startup rather than renaming it to edits. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1973](https://issues.apache.org/jira/browse/HADOOP-1973) | NPE at JobTracker startup.. | Blocker | . | Gautam Kowshik | Amareshwari Sriramadasu |
-| [HADOOP-1961](https://issues.apache.org/jira/browse/HADOOP-1961) | -get, -copyToLocal fail when single filename is passed | Blocker | . | Koji Noguchi | Raghu Angadi |
-| [HADOOP-1959](https://issues.apache.org/jira/browse/HADOOP-1959) | Use of File.separator in StatusHttpServer prevents running Junit tests inside eclipse on Windows | Minor | . | Jim Kellerman | Jim Kellerman |
-| [HADOOP-1955](https://issues.apache.org/jira/browse/HADOOP-1955) | Corrupted block replication retries for ever | Blocker | . | Koji Noguchi | Raghu Angadi |
-| [HADOOP-1953](https://issues.apache.org/jira/browse/HADOOP-1953) | the job tracker should wait beteween calls to try and delete the system directory | Blocker | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1948](https://issues.apache.org/jira/browse/HADOOP-1948) | Spurious error message during block crc upgrade. | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1946](https://issues.apache.org/jira/browse/HADOOP-1946) | du should be not called on every heartbeat | Blocker | . | Konstantin Shvachko | Hairong Kuang |
-| [HADOOP-1944](https://issues.apache.org/jira/browse/HADOOP-1944) | Maps which ran on trackers declared 'lost' are being marked as FAILED rather than KILLED | Blocker | . | Arun C Murthy | Devaraj Das |
-| [HADOOP-1940](https://issues.apache.org/jira/browse/HADOOP-1940) | TestDFSUpgradeFromImage doesn't shut down its MiniDFSCluster | Major | test | Chris Douglas | Chris Douglas |
-| [HADOOP-1935](https://issues.apache.org/jira/browse/HADOOP-1935) | NullPointerException in internalReleaseCreate | Blocker | . | Konstantin Shvachko | dhruba borthakur |
-| [HADOOP-1934](https://issues.apache.org/jira/browse/HADOOP-1934) | the os.name string on Mac OS contains spaces, which causes the c++ compilation to fail | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1932](https://issues.apache.org/jira/browse/HADOOP-1932) | Test dfs.TestFileCreation.testFileCreation failed on Windows | Blocker | test | Mukund Madhugiri | dhruba borthakur |
-| [HADOOP-1930](https://issues.apache.org/jira/browse/HADOOP-1930) | Too many fetch-failures issue | Blocker | . | Christian Kunz | Arun C Murthy |
-| [HADOOP-1925](https://issues.apache.org/jira/browse/HADOOP-1925) | Hadoop Pipes doesn't compile on solaris | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1910](https://issues.apache.org/jira/browse/HADOOP-1910) | Extra checks in DFS.create() are not necessary. | Minor | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1907](https://issues.apache.org/jira/browse/HADOOP-1907) | JobClient.runJob kills the job for failed tasks with no diagnostics | Major | . | Christian Kunz | Christian Kunz |
-| [HADOOP-1904](https://issues.apache.org/jira/browse/HADOOP-1904) | ArrayIndexOutOfBoundException in BlocksMap | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1897](https://issues.apache.org/jira/browse/HADOOP-1897) | about.html page is there but not linked. | Major | . | Enis Soztutar | Enis Soztutar |
-| [HADOOP-1892](https://issues.apache.org/jira/browse/HADOOP-1892) | In the Job UI, some links don't work | Major | . | Devaraj Das | Amar Kamat |
-| [HADOOP-1890](https://issues.apache.org/jira/browse/HADOOP-1890) | Revert a debug patch. | Trivial | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1889](https://issues.apache.org/jira/browse/HADOOP-1889) | Fix path in EC2 scripts for building your own AMI | Major | contrib/cloud | Tom White | Tom White |
-| [HADOOP-1887](https://issues.apache.org/jira/browse/HADOOP-1887) | ArrayIndexOutOfBoundsException with trunk | Major | . | Raghu Angadi | dhruba borthakur |
-| [HADOOP-1885](https://issues.apache.org/jira/browse/HADOOP-1885) | Race condition in MiniDFSCluster shutdown | Major | test | Chris Douglas | Chris Douglas |
-| [HADOOP-1882](https://issues.apache.org/jira/browse/HADOOP-1882) | Remove extra '\*'s from FsShell.limitDecimal() | Minor | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1875](https://issues.apache.org/jira/browse/HADOOP-1875) | multiple dfs.client.buffer.dir directories are not treated as alternatives | Blocker | fs | Christian Kunz | Hairong Kuang |
-| [HADOOP-1874](https://issues.apache.org/jira/browse/HADOOP-1874) | lost task trackers -- jobs hang | Blocker | . | Christian Kunz | Devaraj Das |
-| [HADOOP-1846](https://issues.apache.org/jira/browse/HADOOP-1846) | DatanodeReport should distinguish live datanodes from dead datanodes | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1840](https://issues.apache.org/jira/browse/HADOOP-1840) | Task's diagnostic messages are lost sometimes | Critical | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1838](https://issues.apache.org/jira/browse/HADOOP-1838) | Files created with an pre-0.15 gets blocksize as zero, causing performance degradation | Blocker | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1832](https://issues.apache.org/jira/browse/HADOOP-1832) | listTables() returns duplicate tables | Major | . | Andrew Hitchcock | Jim Kellerman |
-| [HADOOP-1825](https://issues.apache.org/jira/browse/HADOOP-1825) | hadoop-daemon.sh script fails if HADOOP\_PID\_DIR doesn't exist | Minor | scripts | Michael Bieniosek | Michael Bieniosek |
-| [HADOOP-1819](https://issues.apache.org/jira/browse/HADOOP-1819) | The JobTracker should ensure that it is running on the right host. | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1818](https://issues.apache.org/jira/browse/HADOOP-1818) | MutliFileInputFormat returns "empty" MultiFileSplit when number of paths \< number of splits | Major | . | Thomas Friol | Thomas Friol |
-| [HADOOP-1817](https://issues.apache.org/jira/browse/HADOOP-1817) | MultiFileSplit does not write and read the total length | Major | . | Thomas Friol | Thomas Friol |
-| [HADOOP-1812](https://issues.apache.org/jira/browse/HADOOP-1812) | TestIPC and TestRPC should use dynamically allocated ports | Major | ipc | Doug Cutting | Doug Cutting |
-| [HADOOP-1810](https://issues.apache.org/jira/browse/HADOOP-1810) | Incorrect Value type in MRBench (SmallJobs) | Blocker | . | Devaraj Das | Devaraj Das |
-| [HADOOP-1806](https://issues.apache.org/jira/browse/HADOOP-1806) | DfsTask no longer compiles | Major | build | Chris Douglas | Chris Douglas |
-| [HADOOP-1795](https://issues.apache.org/jira/browse/HADOOP-1795) | Task.moveTaskOutputs is escaping special characters in output filenames | Critical | . | Frédéric Bertin | Frédéric Bertin |
-| [HADOOP-1792](https://issues.apache.org/jira/browse/HADOOP-1792) | df command doesn't exist under windows | Major | fs | Benjamin Francisoud | Mahadev konar |
-| [HADOOP-1788](https://issues.apache.org/jira/browse/HADOOP-1788) | Increase the buffer size of pipes from 1k to 128k | Blocker | . | Owen O'Malley | Amareshwari Sriramadasu |
-| [HADOOP-1783](https://issues.apache.org/jira/browse/HADOOP-1783) | keyToPath in Jets3tFileSystemStore needs to return absolute path | Major | fs/s3 | Ahad Rana | Tom White |
-| [HADOOP-1775](https://issues.apache.org/jira/browse/HADOOP-1775) | MapWritable and SortedMapWritable - Writable problems | Major | io | Jim Kellerman | Jim Kellerman |
+| [HADOOP-1636](https://issues.apache.org/jira/browse/HADOOP-1636) | constant should be user-configurable: MAX\_COMPLETE\_USER\_JOBS\_IN\_MEMORY | Major | . | Michael Bieniosek | Michael Bieniosek |
+| [HADOOP-1463](https://issues.apache.org/jira/browse/HADOOP-1463) | dfs.datanode.du.reserved semantics being violated | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-999](https://issues.apache.org/jira/browse/HADOOP-999) | DFS Client should create file when the user creates the file | Major | . | Owen O'Malley | Tsz Wo Nicholas Sze |
+| [HADOOP-1565](https://issues.apache.org/jira/browse/HADOOP-1565) | DFSScalability: reduce memory usage of namenode | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1651](https://issues.apache.org/jira/browse/HADOOP-1651) | Some improvements in progress reporting | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-932](https://issues.apache.org/jira/browse/HADOOP-932) | File locking interface and implementation should be remvoed. | Minor | fs | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1692](https://issues.apache.org/jira/browse/HADOOP-1692) | DfsTask cache interferes with operation | Minor | util | Chris Douglas | Chris Douglas |
+| [HADOOP-1689](https://issues.apache.org/jira/browse/HADOOP-1689) | .sh scripts do not work on Solaris | Minor | scripts | David Biesack | Doug Cutting |
| [HADOOP-1772](https://issues.apache.org/jira/browse/HADOOP-1772) | Hadoop does not run in Cygwin in Windows | Critical | scripts | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-1771](https://issues.apache.org/jira/browse/HADOOP-1771) | streaming hang when IOException in MROutputThread. (NPE) | Blocker | . | Koji Noguchi | Lohit Vijayarenu |
-| [HADOOP-1758](https://issues.apache.org/jira/browse/HADOOP-1758) | processing escapes in a jute record is quadratic | Blocker | record | Dick King | Vivek Ratan |
| [HADOOP-1749](https://issues.apache.org/jira/browse/HADOOP-1749) | TestDFSUpgrade some times fails with an assert | Major | . | Raghu Angadi | Enis Soztutar |
+| [HADOOP-1601](https://issues.apache.org/jira/browse/HADOOP-1601) | GenericWritable should use ReflectionUtils.newInstance to avoid problems with classloaders | Major | io | Owen O'Malley | Enis Soztutar |
| [HADOOP-1748](https://issues.apache.org/jira/browse/HADOOP-1748) | Task Trackers fail to launch tasks when they have relative log directories configured | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1739](https://issues.apache.org/jira/browse/HADOOP-1739) | ConnectException in TaskTracker Child | Major | . | Srikanth Kakani | Doug Cutting |
-| [HADOOP-1708](https://issues.apache.org/jira/browse/HADOOP-1708) | make files visible in the namespace as soon as they are created | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1695](https://issues.apache.org/jira/browse/HADOOP-1695) | Secondary Namenode halt when SocketTimeoutException at startup | Blocker | . | Koji Noguchi | dhruba borthakur |
-| [HADOOP-1692](https://issues.apache.org/jira/browse/HADOOP-1692) | DfsTask cache interferes with operation | Minor | util | Chris Douglas | Chris Douglas |
-| [HADOOP-1689](https://issues.apache.org/jira/browse/HADOOP-1689) | .sh scripts do not work on Solaris | Minor | scripts | David Biesack | Doug Cutting |
+| [HADOOP-1775](https://issues.apache.org/jira/browse/HADOOP-1775) | MapWritable and SortedMapWritable - Writable problems | Major | io | Jim Kellerman | Jim Kellerman |
| [HADOOP-1656](https://issues.apache.org/jira/browse/HADOOP-1656) | HDFS does not record the blocksize for a file | Major | . | Sameer Paranjpye | dhruba borthakur |
-| [HADOOP-1651](https://issues.apache.org/jira/browse/HADOOP-1651) | Some improvements in progress reporting | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-1636](https://issues.apache.org/jira/browse/HADOOP-1636) | constant should be user-configurable: MAX\_COMPLETE\_USER\_JOBS\_IN\_MEMORY | Major | . | Michael Bieniosek | Michael Bieniosek |
-| [HADOOP-1601](https://issues.apache.org/jira/browse/HADOOP-1601) | GenericWritable should use ReflectionUtils.newInstance to avoid problems with classloaders | Major | io | Owen O'Malley | Enis Soztutar |
-| [HADOOP-1573](https://issues.apache.org/jira/browse/HADOOP-1573) | Support for 0 reducers in PIPES | Major | . | Christian Kunz | Owen O'Malley |
+| [HADOOP-1739](https://issues.apache.org/jira/browse/HADOOP-1739) | ConnectException in TaskTracker Child | Major | . | Srikanth Kakani | Doug Cutting |
+| [HADOOP-1795](https://issues.apache.org/jira/browse/HADOOP-1795) | Task.moveTaskOutputs is escaping special characters in output filenames | Critical | . | Frédéric Bertin | Frédéric Bertin |
+| [HADOOP-1812](https://issues.apache.org/jira/browse/HADOOP-1812) | TestIPC and TestRPC should use dynamically allocated ports | Major | ipc | Doug Cutting | Doug Cutting |
+| [HADOOP-1810](https://issues.apache.org/jira/browse/HADOOP-1810) | Incorrect Value type in MRBench (SmallJobs) | Blocker | . | Devaraj Das | Devaraj Das |
+| [HADOOP-1832](https://issues.apache.org/jira/browse/HADOOP-1832) | listTables() returns duplicate tables | Major | . | Andrew Hitchcock | Jim Kellerman |
+| [HADOOP-1806](https://issues.apache.org/jira/browse/HADOOP-1806) | DfsTask no longer compiles | Major | build | Chris Douglas | Chris Douglas |
+| [HADOOP-1758](https://issues.apache.org/jira/browse/HADOOP-1758) | processing escapes in a jute record is quadratic | Blocker | record | Dick King | Vivek Ratan |
| [HADOOP-1569](https://issues.apache.org/jira/browse/HADOOP-1569) | distcp should use the Path -\> FileSystem interface like the rest of Hadoop | Major | util | Owen O'Malley | Chris Douglas |
-| [HADOOP-1565](https://issues.apache.org/jira/browse/HADOOP-1565) | DFSScalability: reduce memory usage of namenode | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1463](https://issues.apache.org/jira/browse/HADOOP-1463) | dfs.datanode.du.reserved semantics being violated | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1316](https://issues.apache.org/jira/browse/HADOOP-1316) | "Go to parent directory" does not work on windows. | Minor | . | Konstantin Shvachko | Mahadev konar |
-| [HADOOP-1076](https://issues.apache.org/jira/browse/HADOOP-1076) | Periodic checkpointing cannot resume if the secondary name-node fails. | Major | . | Konstantin Shvachko | dhruba borthakur |
+| [HADOOP-1817](https://issues.apache.org/jira/browse/HADOOP-1817) | MultiFileSplit does not write and read the total length | Major | . | Thomas Friol | Thomas Friol |
+| [HADOOP-1838](https://issues.apache.org/jira/browse/HADOOP-1838) | Files created with an pre-0.15 gets blocksize as zero, causing performance degradation | Blocker | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-1018](https://issues.apache.org/jira/browse/HADOOP-1018) | Single lost heartbeat leads to a "Lost task tracker" | Major | . | Andrzej Bialecki | Arun C Murthy |
-| [HADOOP-999](https://issues.apache.org/jira/browse/HADOOP-999) | DFS Client should create file when the user creates the file | Major | . | Owen O'Malley | Tsz Wo Nicholas Sze |
-| [HADOOP-932](https://issues.apache.org/jira/browse/HADOOP-932) | File locking interface and implementation should be remvoed. | Minor | fs | Raghu Angadi | Raghu Angadi |
-| [HADOOP-795](https://issues.apache.org/jira/browse/HADOOP-795) | hdfs -cp /a/b/c /x/y acts like hdfs -cp /a/b/c/\* /x/y | Minor | . | arkady borkovsky | Mahadev konar |
+| [HADOOP-1818](https://issues.apache.org/jira/browse/HADOOP-1818) | MutliFileInputFormat returns "empty" MultiFileSplit when number of paths \< number of splits | Major | . | Thomas Friol | Thomas Friol |
+| [HADOOP-1840](https://issues.apache.org/jira/browse/HADOOP-1840) | Task's diagnostic messages are lost sometimes | Critical | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-1846](https://issues.apache.org/jira/browse/HADOOP-1846) | DatanodeReport should distinguish live datanodes from dead datanodes | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1885](https://issues.apache.org/jira/browse/HADOOP-1885) | Race condition in MiniDFSCluster shutdown | Major | test | Chris Douglas | Chris Douglas |
+| [HADOOP-1708](https://issues.apache.org/jira/browse/HADOOP-1708) | make files visible in the namespace as soon as they are created | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1819](https://issues.apache.org/jira/browse/HADOOP-1819) | The JobTracker should ensure that it is running on the right host. | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1890](https://issues.apache.org/jira/browse/HADOOP-1890) | Revert a debug patch. | Trivial | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1889](https://issues.apache.org/jira/browse/HADOOP-1889) | Fix path in EC2 scripts for building your own AMI | Major | contrib/cloud | Tom White | Tom White |
+| [HADOOP-1892](https://issues.apache.org/jira/browse/HADOOP-1892) | In the Job UI, some links don't work | Major | . | Devaraj Das | Amar Kamat |
| [HADOOP-120](https://issues.apache.org/jira/browse/HADOOP-120) | Reading an ArrayWriter does not work because valueClass does not get initialized | Major | io | Dick King | Cameron Pope |
+| [HADOOP-1907](https://issues.apache.org/jira/browse/HADOOP-1907) | JobClient.runJob kills the job for failed tasks with no diagnostics | Major | . | Christian Kunz | Christian Kunz |
+| [HADOOP-1904](https://issues.apache.org/jira/browse/HADOOP-1904) | ArrayIndexOutOfBoundException in BlocksMap | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1887](https://issues.apache.org/jira/browse/HADOOP-1887) | ArrayIndexOutOfBoundsException with trunk | Major | . | Raghu Angadi | dhruba borthakur |
| [HADOOP-89](https://issues.apache.org/jira/browse/HADOOP-89) | files are not visible until they are closed | Critical | . | Yoram Arnon | dhruba borthakur |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-1882](https://issues.apache.org/jira/browse/HADOOP-1882) | Remove extra '\*'s from FsShell.limitDecimal() | Minor | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1573](https://issues.apache.org/jira/browse/HADOOP-1573) | Support for 0 reducers in PIPES | Major | . | Christian Kunz | Owen O'Malley |
+| [HADOOP-1783](https://issues.apache.org/jira/browse/HADOOP-1783) | keyToPath in Jets3tFileSystemStore needs to return absolute path | Major | fs/s3 | Ahad Rana | Tom White |
+| [HADOOP-1925](https://issues.apache.org/jira/browse/HADOOP-1925) | Hadoop Pipes doesn't compile on solaris | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1076](https://issues.apache.org/jira/browse/HADOOP-1076) | Periodic checkpointing cannot resume if the secondary name-node fails. | Major | . | Konstantin Shvachko | dhruba borthakur |
+| [HADOOP-1932](https://issues.apache.org/jira/browse/HADOOP-1932) | Test dfs.TestFileCreation.testFileCreation failed on Windows | Blocker | test | Mukund Madhugiri | dhruba borthakur |
+| [HADOOP-1940](https://issues.apache.org/jira/browse/HADOOP-1940) | TestDFSUpgradeFromImage doesn't shut down its MiniDFSCluster | Major | test | Chris Douglas | Chris Douglas |
+| [HADOOP-1930](https://issues.apache.org/jira/browse/HADOOP-1930) | Too many fetch-failures issue | Blocker | . | Christian Kunz | Arun C Murthy |
+| [HADOOP-1910](https://issues.apache.org/jira/browse/HADOOP-1910) | Extra checks in DFS.create() are not necessary. | Minor | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1897](https://issues.apache.org/jira/browse/HADOOP-1897) | about.html page is there but not linked. | Major | . | Enis Soztutar | Enis Soztutar |
+| [HADOOP-1953](https://issues.apache.org/jira/browse/HADOOP-1953) | the job tracker should wait beteween calls to try and delete the system directory | Blocker | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1935](https://issues.apache.org/jira/browse/HADOOP-1935) | NullPointerException in internalReleaseCreate | Blocker | . | Konstantin Shvachko | dhruba borthakur |
+| [HADOOP-1946](https://issues.apache.org/jira/browse/HADOOP-1946) | du should be not called on every heartbeat | Blocker | . | Konstantin Shvachko | Hairong Kuang |
+| [HADOOP-1948](https://issues.apache.org/jira/browse/HADOOP-1948) | Spurious error message during block crc upgrade. | Blocker | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1934](https://issues.apache.org/jira/browse/HADOOP-1934) | the os.name string on Mac OS contains spaces, which causes the c++ compilation to fail | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1959](https://issues.apache.org/jira/browse/HADOOP-1959) | Use of File.separator in StatusHttpServer prevents running Junit tests inside eclipse on Windows | Minor | . | Jim Kellerman | Jim Kellerman |
+| [HADOOP-1978](https://issues.apache.org/jira/browse/HADOOP-1978) | Name-node should remove edits.new during startup rather than renaming it to edits. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1695](https://issues.apache.org/jira/browse/HADOOP-1695) | Secondary Namenode halt when SocketTimeoutException at startup | Blocker | . | Koji Noguchi | dhruba borthakur |
+| [HADOOP-1955](https://issues.apache.org/jira/browse/HADOOP-1955) | Corrupted block replication retries for ever | Blocker | . | Koji Noguchi | Raghu Angadi |
+| [HADOOP-1961](https://issues.apache.org/jira/browse/HADOOP-1961) | -get, -copyToLocal fail when single filename is passed | Blocker | . | Koji Noguchi | Raghu Angadi |
+| [HADOOP-1997](https://issues.apache.org/jira/browse/HADOOP-1997) | TestCheckpoint fails on Windows | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1983](https://issues.apache.org/jira/browse/HADOOP-1983) | jobs using pipes interface with tasks not using java output format have a good chance of not updating progress and timing out | Major | . | Christian Kunz | Owen O'Malley |
+| [HADOOP-1875](https://issues.apache.org/jira/browse/HADOOP-1875) | multiple dfs.client.buffer.dir directories are not treated as alternatives | Blocker | fs | Christian Kunz | Hairong Kuang |
+| [HADOOP-1992](https://issues.apache.org/jira/browse/HADOOP-1992) | Sort validation is taking considerably longer than before | Blocker | . | Mukund Madhugiri | Arun C Murthy |
+| [HADOOP-1874](https://issues.apache.org/jira/browse/HADOOP-1874) | lost task trackers -- jobs hang | Blocker | . | Christian Kunz | Devaraj Das |
+| [HADOOP-1944](https://issues.apache.org/jira/browse/HADOOP-1944) | Maps which ran on trackers declared 'lost' are being marked as FAILED rather than KILLED | Blocker | . | Arun C Murthy | Devaraj Das |
+| [HADOOP-2026](https://issues.apache.org/jira/browse/HADOOP-2026) | Namenode prints out too many log lines for "Number of transactions" | Blocker | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-2022](https://issues.apache.org/jira/browse/HADOOP-2022) | Task times are not saved correctly (bug in hadoop-1874) | Blocker | . | Devaraj Das | Amar Kamat |
+| [HADOOP-2031](https://issues.apache.org/jira/browse/HADOOP-2031) | Lost tasktracker not handled properly leading to tips wrongly being kept as completed, and hence not rescheduled | Blocker | . | Devaraj Das | Devaraj Das |
+| [HADOOP-2018](https://issues.apache.org/jira/browse/HADOOP-2018) | Broken pipe SocketException in DataNode$DataXceiver | Blocker | . | Konstantin Shvachko | Hairong Kuang |
+| [HADOOP-2023](https://issues.apache.org/jira/browse/HADOOP-2023) | TestLocalDirAllocator fails on Windows | Blocker | fs | Mukund Madhugiri | Hairong Kuang |
+| [HADOOP-2016](https://issues.apache.org/jira/browse/HADOOP-2016) | Race condition in removing a KILLED task from tasktracker | Blocker | . | Devaraj Das | Arun C Murthy |
+| [HADOOP-1771](https://issues.apache.org/jira/browse/HADOOP-1771) | streaming hang when IOException in MROutputThread. (NPE) | Blocker | . | Koji Noguchi | Lohit Vijayarenu |
+| [HADOOP-2028](https://issues.apache.org/jira/browse/HADOOP-2028) | distcp fails if log dir not specified and destination not present | Blocker | util | Chris Douglas | Chris Douglas |
+| [HADOOP-1788](https://issues.apache.org/jira/browse/HADOOP-1788) | Increase the buffer size of pipes from 1k to 128k | Blocker | . | Owen O'Malley | Amareshwari Sriramadasu |
+| [HADOOP-2051](https://issues.apache.org/jira/browse/HADOOP-2051) | JobTracker's TaskCommitQueue is vulnerable to non-IOExceptions | Blocker | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-1973](https://issues.apache.org/jira/browse/HADOOP-1973) | NPE at JobTracker startup.. | Blocker | . | Gautam Kowshik | Amareshwari Sriramadasu |
+| [HADOOP-2044](https://issues.apache.org/jira/browse/HADOOP-2044) | Namenode encounters ClassCastException exceptions for INodeFileUnderConstruction | Blocker | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-2033](https://issues.apache.org/jira/browse/HADOOP-2033) | In SequenceFile sync doesn't work unless the file is compressed (block or record) | Blocker | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-2072](https://issues.apache.org/jira/browse/HADOOP-2072) | RawLocalFileStatus is causing Path problems | Major | fs | Dennis Kubes | |
+| [HADOOP-2070](https://issues.apache.org/jira/browse/HADOOP-2070) | Test org.apache.hadoop.mapred.pipes.TestPipes.unknown failed | Blocker | . | Mukund Madhugiri | Owen O'Malley |
+| [HADOOP-2080](https://issues.apache.org/jira/browse/HADOOP-2080) | ChecksumFileSystem checksum file size incorrect. | Blocker | fs | Richard Lee | Owen O'Malley |
+| [HADOOP-2048](https://issues.apache.org/jira/browse/HADOOP-2048) | DISTCP mapper should report progress more often | Blocker | . | Runping Qi | Chris Douglas |
+| [HADOOP-2073](https://issues.apache.org/jira/browse/HADOOP-2073) | Datanode corruption if machine dies while writing VERSION file | Blocker | . | Michael Bieniosek | Konstantin Shvachko |
+| [HADOOP-1825](https://issues.apache.org/jira/browse/HADOOP-1825) | hadoop-daemon.sh script fails if HADOOP\_PID\_DIR doesn't exist | Minor | scripts | Michael Bieniosek | Michael Bieniosek |
+| [HADOOP-2103](https://issues.apache.org/jira/browse/HADOOP-2103) | HADOOP-2046 caused some javadoc anomalies | Major | documentation | Nigel Daley | Nigel Daley |
+| [HADOOP-2102](https://issues.apache.org/jira/browse/HADOOP-2102) | ToolBase doesn't keep configuration | Blocker | util | Dennis Kubes | Dennis Kubes |
+| [HADOOP-795](https://issues.apache.org/jira/browse/HADOOP-795) | hdfs -cp /a/b/c /x/y acts like hdfs -cp /a/b/c/\* /x/y | Minor | . | arkady borkovsky | Mahadev konar |
+| [HADOOP-1316](https://issues.apache.org/jira/browse/HADOOP-1316) | "Go to parent directory" does not work on windows. | Minor | . | Konstantin Shvachko | Mahadev konar |
+| [HADOOP-1792](https://issues.apache.org/jira/browse/HADOOP-1792) | df command doesn't exist under windows | Major | fs | Benjamin Francisoud | Mahadev konar |
### OTHER:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.1/CHANGES.0.15.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.1/CHANGES.0.15.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.1/CHANGES.0.15.1.md
index acadf7d..073d92e 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.1/CHANGES.0.15.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.1/CHANGES.0.15.1.md
@@ -20,22 +20,6 @@
## Release 0.15.1 - 2007-11-27
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### IMPROVEMENTS:
@@ -50,22 +34,10 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-2205](https://issues.apache.org/jira/browse/HADOOP-2205) | Regenerate entire hadoop website since site.xml was changed by HADOOP-1917 | Blocker | documentation | Arun C Murthy | Arun C Murthy |
| [HADOOP-2174](https://issues.apache.org/jira/browse/HADOOP-2174) | distcp throws a NullPointerException in the close() method of mapper class due to the Reporter becoming invalid | Critical | util | Riccardo Boscolo | Chris Douglas |
-| [HADOOP-2172](https://issues.apache.org/jira/browse/HADOOP-2172) | PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance | Blocker | fs | Johan Oskarsson | Doug Cutting |
| [HADOOP-2169](https://issues.apache.org/jira/browse/HADOOP-2169) | libhdfs makefile wrongly sets up DT\_SONAME field of libhdfs.so | Critical | . | Arun C Murthy | Arun C Murthy |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-2172](https://issues.apache.org/jira/browse/HADOOP-2172) | PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance | Blocker | fs | Johan Oskarsson | Doug Cutting |
+| [HADOOP-2205](https://issues.apache.org/jira/browse/HADOOP-2205) | Regenerate entire hadoop website since site.xml was changed by HADOOP-1917 | Blocker | documentation | Arun C Murthy | Arun C Murthy |
### OTHER:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.2/CHANGES.0.15.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.2/CHANGES.0.15.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.2/CHANGES.0.15.2.md
index c046da1..850d5e9 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.2/CHANGES.0.15.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.2/CHANGES.0.15.2.md
@@ -20,66 +20,32 @@
## Release 0.15.2 - 2008-01-08
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-2382](https://issues.apache.org/jira/browse/HADOOP-2382) | include hadoop-default.html in subversion | Minor | documentation | Doug Cutting | |
| [HADOOP-2160](https://issues.apache.org/jira/browse/HADOOP-2160) | separate website from user documentation | Major | documentation | Doug Cutting | Doug Cutting |
| [HADOOP-1327](https://issues.apache.org/jira/browse/HADOOP-1327) | Doc on Streaming | Major | documentation | Runping Qi | Rob Weltman |
+| [HADOOP-2382](https://issues.apache.org/jira/browse/HADOOP-2382) | include hadoop-default.html in subversion | Minor | documentation | Doug Cutting | |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-2486](https://issues.apache.org/jira/browse/HADOOP-2486) | Dropping records at reducer. InMemoryFileSystem NPE. | Blocker | . | Koji Noguchi | Devaraj Das |
-| [HADOOP-2460](https://issues.apache.org/jira/browse/HADOOP-2460) | NameNode could delete wrong edits file when there is an error | Major | . | Raghu Angadi | dhruba borthakur |
-| [HADOOP-2456](https://issues.apache.org/jira/browse/HADOOP-2456) | German locale makes NameNode web interface crash | Minor | . | Matthias Friedrich | Matthias Friedrich |
-| [HADOOP-2437](https://issues.apache.org/jira/browse/HADOOP-2437) | final map output not evenly distributed across multiple disks | Blocker | . | Christian Kunz | Arun C Murthy |
-| [HADOOP-2422](https://issues.apache.org/jira/browse/HADOOP-2422) | dfs -cat multiple files fail with 'Unable to write to output stream.' | Blocker | . | Koji Noguchi | Raghu Angadi |
-| [HADOOP-2378](https://issues.apache.org/jira/browse/HADOOP-2378) | last TaskCompletionEvent gets added to the job after the job is marked as completed | Blocker | . | Alejandro Abdelnur | Devaraj Das |
| [HADOOP-2246](https://issues.apache.org/jira/browse/HADOOP-2246) | In CHANGES.txt, move HADOOP-1851 & HADOOP-1231 to INCOMPATIBLE CHANGES section | Blocker | documentation | Devaraj Das | Arun C Murthy |
| [HADOOP-2238](https://issues.apache.org/jira/browse/HADOOP-2238) | TaskGraphServlet does not set Content-Type | Major | . | Paul Saab | |
+| [HADOOP-2129](https://issues.apache.org/jira/browse/HADOOP-2129) | distcp between two clusters does not work if it is run on the target cluster | Critical | util | Murtaza A. Basrai | Doug Cutting |
+| [HADOOP-2158](https://issues.apache.org/jira/browse/HADOOP-2158) | hdfsListDirectory in libhdfs does not scale | Blocker | . | Christian Kunz | Christian Kunz |
+| [HADOOP-2378](https://issues.apache.org/jira/browse/HADOOP-2378) | last TaskCompletionEvent gets added to the job after the job is marked as completed | Blocker | . | Alejandro Abdelnur | Devaraj Das |
| [HADOOP-2228](https://issues.apache.org/jira/browse/HADOOP-2228) | Jobs fail because job.xml exists | Major | . | Johan Oskarsson | Johan Oskarsson |
+| [HADOOP-2422](https://issues.apache.org/jira/browse/HADOOP-2422) | dfs -cat multiple files fail with 'Unable to write to output stream.' | Blocker | . | Koji Noguchi | Raghu Angadi |
+| [HADOOP-2460](https://issues.apache.org/jira/browse/HADOOP-2460) | NameNode could delete wrong edits file when there is an error | Major | . | Raghu Angadi | dhruba borthakur |
| [HADOOP-2227](https://issues.apache.org/jira/browse/HADOOP-2227) | wrong usage of mapred.local.dir.minspacestart | Critical | . | Christian Kunz | Amareshwari Sriramadasu |
-| [HADOOP-2158](https://issues.apache.org/jira/browse/HADOOP-2158) | hdfsListDirectory in libhdfs does not scale | Blocker | . | Christian Kunz | Christian Kunz |
-| [HADOOP-2129](https://issues.apache.org/jira/browse/HADOOP-2129) | distcp between two clusters does not work if it is run on the target cluster | Critical | util | Murtaza A. Basrai | Doug Cutting |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-2437](https://issues.apache.org/jira/browse/HADOOP-2437) | final map output not evenly distributed across multiple disks | Blocker | . | Christian Kunz | Arun C Murthy |
+| [HADOOP-2486](https://issues.apache.org/jira/browse/HADOOP-2486) | Dropping records at reducer. InMemoryFileSystem NPE. | Blocker | . | Koji Noguchi | Devaraj Das |
+| [HADOOP-2456](https://issues.apache.org/jira/browse/HADOOP-2456) | German locale makes NameNode web interface crash | Minor | . | Matthias Friedrich | Matthias Friedrich |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.3/CHANGES.0.15.3.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.3/CHANGES.0.15.3.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.3/CHANGES.0.15.3.md
index 4967b9f8..a1661e2 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.3/CHANGES.0.15.3.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.3/CHANGES.0.15.3.md
@@ -20,56 +20,16 @@
## Release 0.15.3 - 2008-01-21
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-2574](https://issues.apache.org/jira/browse/HADOOP-2574) | bugs in mapred tutorial | Major | documentation | Doug Cutting | Arun C Murthy |
-| [HADOOP-2570](https://issues.apache.org/jira/browse/HADOOP-2570) | streaming jobs fail after HADOOP-2227 | Blocker | . | Lohit Vijayarenu | Amareshwari Sriramadasu |
| [HADOOP-2562](https://issues.apache.org/jira/browse/HADOOP-2562) | globPaths does not support {ab,cd} as it claims to | Blocker | fs | Hairong Kuang | Hairong Kuang |
| [HADOOP-2540](https://issues.apache.org/jira/browse/HADOOP-2540) | Empty blocks make fsck report corrupt, even when it isn't | Blocker | . | Allen Wittenauer | dhruba borthakur |
+| [HADOOP-2570](https://issues.apache.org/jira/browse/HADOOP-2570) | streaming jobs fail after HADOOP-2227 | Blocker | . | Lohit Vijayarenu | Amareshwari Sriramadasu |
+| [HADOOP-2574](https://issues.apache.org/jira/browse/HADOOP-2574) | bugs in mapred tutorial | Major | documentation | Doug Cutting | Arun C Murthy |
| [HADOOP-650](https://issues.apache.org/jira/browse/HADOOP-650) | bin/hadoop dfs -lsr / is broken | Minor | . | Mahadev konar | Mahadev konar |
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.4/CHANGES.0.15.4.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.4/CHANGES.0.15.4.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.4/CHANGES.0.15.4.md
index 8cd3160..f059f17 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.4/CHANGES.0.15.4.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.15.4/CHANGES.0.15.4.md
@@ -18,30 +18,8 @@
-->
# Apache Hadoop Changelog
-## Release 0.15.4 - Unreleased (as of 2016-03-04)
+## Release 0.15.4 - Unreleased (as of 2017-08-28)
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
@@ -51,21 +29,3 @@
| [HADOOP-2647](https://issues.apache.org/jira/browse/HADOOP-2647) | dfs -put hangs | Major | . | Lohit Vijayarenu | Raghu Angadi |
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[43/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.0/RELEASENOTES.0.18.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.0/RELEASENOTES.0.18.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.0/RELEASENOTES.0.18.0.md
index f57c602..32e3c01 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.0/RELEASENOTES.0.18.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.0/RELEASENOTES.0.18.0.md
@@ -23,523 +23,523 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-3837](https://issues.apache.org/jira/browse/HADOOP-3837) | *Major* | **hadop streaming does not use progress reporting to detect hung tasks**
+* [HADOOP-2585](https://issues.apache.org/jira/browse/HADOOP-2585) | *Major* | **Automatic namespace recovery from the secondary image.**
-Changed streaming tasks to adhere to task timeout value specified in the job configuration.
+Improved management of replicas of the name space image. If all replicas on the Name Node are lost, the latest check point can be loaded from the secondary Name Node. Use parameter "-importCheckpoint" and specify the location with "fs.checkpoint.dir." The directory structure on the secondary Name Node has changed to match the primary Name Node.
---
-* [HADOOP-3808](https://issues.apache.org/jira/browse/HADOOP-3808) | *Blocker* | **[HOD] Include job tracker RPC in notes attribute after job submission**
+* [HADOOP-2703](https://issues.apache.org/jira/browse/HADOOP-2703) | *Minor* | **New files under lease (before close) still shows up as MISSING files/blocks in fsck**
-Modified HOD to include the RPC port of the JobTracker in the 'notes' attribute of the resource manager. The RPC port is included as the string 'Mapred RPC Port:\<port number\>'. Tools that depend on the value of the notes attribute must change to parse this new value.
+Changed fsck to ignore files opened for writing. Introduced new option "-openforwrite" to explicitly show open files.
---
-* [HADOOP-3703](https://issues.apache.org/jira/browse/HADOOP-3703) | *Blocker* | **[HOD] logcondense needs to use the new pattern of output in hadoop dfs -lsr**
+* [HADOOP-2865](https://issues.apache.org/jira/browse/HADOOP-2865) | *Major* | **FsShell.ls() should print file attributes first then the path name.**
-Modified logcondense.py to use the new format of hadoop dfs -lsr output. This version of logcondense would not work with previous versions of Hadoop and hence is incompatible.
+Changed the output of the "fs -ls" command to more closely match familiar Linux format. Additional changes were made by HADOOP-3459. Applications that parse the command output should be reviewed.
---
-* [HADOOP-3683](https://issues.apache.org/jira/browse/HADOOP-3683) | *Major* | **Hadoop dfs metric FilesListed shows number of files listed instead of operations**
+* [HADOOP-3061](https://issues.apache.org/jira/browse/HADOOP-3061) | *Major* | **Writable for single byte and double**
-Change FileListed to getNumGetListingOps and add CreateFileOps, DeleteFileOps and AddBlockOps metrics.
+Introduced ByteWritable and DoubleWritable (implementing WritableComparable) implementations for Byte and Double.
---
-* [HADOOP-3677](https://issues.apache.org/jira/browse/HADOOP-3677) | *Blocker* | **Problems with generation stamp upgrade**
+* [HADOOP-3164](https://issues.apache.org/jira/browse/HADOOP-3164) | *Major* | **Use FileChannel.transferTo() when data is read from DataNode.**
-Simplify generation stamp upgrade by making is a local upgrade on datandodes. Deleted distributed upgrade.
+Changed data node to use FileChannel.tranferTo() to transfer block data.
---
-* [HADOOP-3665](https://issues.apache.org/jira/browse/HADOOP-3665) | *Minor* | **WritableComparator newKey() fails for NullWritable**
+* [HADOOP-3283](https://issues.apache.org/jira/browse/HADOOP-3283) | *Major* | **Need a mechanism for data nodes to update generation stamps.**
-**WARNING: No release note provided for this incompatible change.**
+Added an IPC server in DataNode and a new IPC protocol InterDatanodeProtocol. Added conf properties dfs.datanode.ipc.address and dfs.datanode.handler.count with defaults "0.0.0.0:50020" and 3, respectively.
+Changed the serialization in DatanodeRegistration and DatanodeInfo, and therefore, updated the versionID in ClientProtocol, DatanodeProtocol, NamenodeProtocol.
---
-* [HADOOP-3610](https://issues.apache.org/jira/browse/HADOOP-3610) | *Blocker* | **[HOD] HOD does not automatically create a cluster directory for the script option**
+* [HADOOP-2797](https://issues.apache.org/jira/browse/HADOOP-2797) | *Critical* | **Withdraw CRC upgrade from HDFS**
-Modified HOD to automatically create a cluster directory if the one specified with the script command does not exist.
+Withdrew the upgrade-to-CRC facility. HDFS will no longer support upgrades from versions without CRCs for block data. Users upgrading from version 0.13 or earlier must first upgrade to an intermediate (0.14, 0.15, 0.16, 0.17) version before doing upgrade to version 0.18 or later.
---
-* [HADOOP-3598](https://issues.apache.org/jira/browse/HADOOP-3598) | *Blocker* | **Map-Reduce framework needlessly creates temporary \_${taskid} directories for Maps**
+* [HADOOP-544](https://issues.apache.org/jira/browse/HADOOP-544) | *Major* | **Replace the job, tip and task ids with objects.**
-Changed Map-Reduce framework to no longer create temporary task output directories for staging outputs if staging outputs isn't necessary. ${mapred.out.dir}/\_temporary/\_${taskid}
+Introduced new classes JobID, TaskID and TaskAttemptID, which should be used instead of their string counterparts. Deprecated functions in JobClient, TaskReport, RunningJob, jobcontrol.Job and TaskCompletionEvent that use string arguments. Applications can use xxxID.toString() and xxxID.forName() methods to convert/restore objects to/from strings.
---
-* [HADOOP-3569](https://issues.apache.org/jira/browse/HADOOP-3569) | *Minor* | **KFS input stream read() returns 4 bytes instead of 1**
+* [HADOOP-2188](https://issues.apache.org/jira/browse/HADOOP-2188) | *Major* | **RPC should send a ping rather than use client timeouts**
-Fixed KFS to have read() read and return 1 byte instead of 4.
+Replaced timeouts with pings to check that client connection is alive. Removed the property ipc.client.timeout from the default Hadoop configuration. Removed the metric RpcOpsDiscardedOPsNum.
---
-* [HADOOP-3564](https://issues.apache.org/jira/browse/HADOOP-3564) | *Blocker* | **Sometime after successful hod allocation datanode fails to come up with java.net.BindException for dfs.datanode.ipc.address**
+* [HADOOP-2181](https://issues.apache.org/jira/browse/HADOOP-2181) | *Minor* | **Input Split details for maps should be logged**
-Modifed HOD to generate the dfs.datanode.ipc.address parameter in the hadoop-site.xml of datanodes that it launches.
+Added logging for input splits in job tracker log and job history log. Added web UI for viewing input splits in the job UI and history UI.
---
-* [HADOOP-3512](https://issues.apache.org/jira/browse/HADOOP-3512) | *Major* | **Split map/reduce tools into separate jars**
+* [HADOOP-3317](https://issues.apache.org/jira/browse/HADOOP-3317) | *Minor* | **add default port for hdfs namenode**
-Separated Distcp, Logalyzer and Archiver into a tools jar.
+Changed the default port for "hdfs:" URIs to be 8020, so that one may simply use URIs of the form "hdfs://example.com/dir/file".
---
-* [HADOOP-3486](https://issues.apache.org/jira/browse/HADOOP-3486) | *Major* | **Change default for initial block report to 0 sec and document it in hadoop-defaults.xml**
+* [HADOOP-2019](https://issues.apache.org/jira/browse/HADOOP-2019) | *Major* | **DistributedFileCache should support .tgz files in addition to jars and zip files**
-Changed the default value of dfs.blockreport.initialDelay to be 0 seconds.
+Added support for .tar, .tgz and .tar.gz files in DistributedCache. File sizes are limited to 2GB.
---
-* [HADOOP-3483](https://issues.apache.org/jira/browse/HADOOP-3483) | *Major* | **[HOD] Improvements with cluster directory handling**
+* [HADOOP-3058](https://issues.apache.org/jira/browse/HADOOP-3058) | *Minor* | **Hadoop DFS to report more replication metrics**
-Modified HOD to create a cluster directory if one does not exist and to auto-deallocate a cluster while reallocating it, if it is already dead.
+Added FSNamesystem status metrics.
---
-* [HADOOP-3464](https://issues.apache.org/jira/browse/HADOOP-3464) | *Major* | **[HOD] HOD can improve error messages by reporting failures on compute nodes back to hod client**
+* [HADOOP-3226](https://issues.apache.org/jira/browse/HADOOP-3226) | *Major* | **Run combiner when merging spills from map output**
-Implemented a mechanism to transfer HOD errors that occur on compute nodes to the submit node running the HOD client, so users have good feedback on why an allocation failed.
+Changed policy for running combiner. The combiner may be run multiple times as the map's output is sorted and merged. Additionally, it may be run on the reduce side as data is merged. The old semantics are available in Hadoop 0.18 if the user calls:
+job.setCombineOnlyOnce(true);
---
-* [HADOOP-3460](https://issues.apache.org/jira/browse/HADOOP-3460) | *Minor* | **SequenceFileAsBinaryOutputFormat**
+* [HADOOP-3299](https://issues.apache.org/jira/browse/HADOOP-3299) | *Major* | **org.apache.hadoop.mapred.join.CompositeInputFormat does not initialize TextInput format files with the configuration resulting in an NullPointerException**
-Created SequenceFileAsBinaryOutputFormat to write raw bytes as keys and values to a SequenceFile.
+Changed the TextInputFormat and KeyValueTextInput classes to initialize the compressionCodecs member variable before dereferencing it.
---
-* [HADOOP-3459](https://issues.apache.org/jira/browse/HADOOP-3459) | *Major* | **Change dfs -ls listing to closely match format on Linux**
+* [HADOOP-3329](https://issues.apache.org/jira/browse/HADOOP-3329) | *Major* | **DatanodeDescriptor objects stored in FSImage may be out dated.**
-Changed the output of the "fs -ls" command to more closely match familiar Linux format. Applications that parse the command output should be reviewed.
+Changed format of file system image to not store locations of last block.
---
-* [HADOOP-3452](https://issues.apache.org/jira/browse/HADOOP-3452) | *Minor* | **fsck exit code would be better if non-zero when FS corrupt**
+* [HADOOP-2065](https://issues.apache.org/jira/browse/HADOOP-2065) | *Major* | **Replication policy for corrupted block**
-Changed exit status of fsck to report whether the files system is healthy or corrupt.
+Added "corrupt" flag to LocatedBlock to indicate that all replicas of the block thought to be corrupt.
---
-* [HADOOP-3429](https://issues.apache.org/jira/browse/HADOOP-3429) | *Major* | **Increase the buffersize for the streaming parent java process's streams**
+* [HADOOP-1702](https://issues.apache.org/jira/browse/HADOOP-1702) | *Major* | **Reduce buffer copies when data is written to DFS**
-Increased the size of the buffer used in the communication between the Java task and the Streaming process to 128KB.
+Reduced buffer copies as data is written to HDFS. The order of sending data bytes and control information has changed, but this will not be observed by client applications.
---
-* [HADOOP-3427](https://issues.apache.org/jira/browse/HADOOP-3427) | *Major* | **In ReduceTask::fetchOutputs, wait for result can be improved slightly**
+* [HADOOP-2656](https://issues.apache.org/jira/browse/HADOOP-2656) | *Major* | **Support for upgrading existing cluster to facilitate appends to HDFS files**
-Changed shuffle scheduler policy to wait for notifications from shuffle threads before scheduling more.
+Associated a generation stamp with each block. On data nodes, the generation stamp is stored as part of the file name of the block's meta-data file.
---
-* [HADOOP-3417](https://issues.apache.org/jira/browse/HADOOP-3417) | *Major* | **JobClient should not have a static configuration for cli parsing**
+* [HADOOP-3355](https://issues.apache.org/jira/browse/HADOOP-3355) | *Major* | **Configuration should accept decimal and hexadecimal values**
-Removed the public class org.apache.hadoop.mapred.JobShell.
-Command line options -libjars, -files and -archives are moved to GenericCommands. Thus applications have to implement org.apache.hadoop.util.Tool to use the options.
+Added support for hexadecimal values in Configuration
---
-* [HADOOP-3405](https://issues.apache.org/jira/browse/HADOOP-3405) | *Major* | **Make mapred internal classes package-local**
+* [HADOOP-3390](https://issues.apache.org/jira/browse/HADOOP-3390) | *Major* | **Remove deprecated ClientProtocol.abandonFileInProgress()**
-Refactored previously public classes MapTaskStatus, ReduceTaskStatus, JobSubmissionProtocol, CompletedJobStatusStore to be package local.
+Removed deprecated ClientProtocol.abandonFileInProgress().
---
-* [HADOOP-3390](https://issues.apache.org/jira/browse/HADOOP-3390) | *Major* | **Remove deprecated ClientProtocol.abandonFileInProgress()**
+* [HADOOP-3221](https://issues.apache.org/jira/browse/HADOOP-3221) | *Major* | **Need a "LineBasedTextInputFormat"**
-Removed deprecated ClientProtocol.abandonFileInProgress().
+Added org.apache.hadoop.mapred.lib.NLineInputFormat ,which splits N lines of input as one split. N can be specified by configuration property "mapred.line.input.format.linespermap", which defaults to 1.
---
-* [HADOOP-3379](https://issues.apache.org/jira/browse/HADOOP-3379) | *Blocker* | **Document the "stream.non.zero.exit.status.is.failure" knob for streaming**
+* [HADOOP-3013](https://issues.apache.org/jira/browse/HADOOP-3013) | *Major* | **fsck to show (checksum) corrupted files**
-Set default value for configuration property "stream.non.zero.exit.status.is.failure" to be "true".
+fsck reports corrupt blocks in the system.
---
-* [HADOOP-3376](https://issues.apache.org/jira/browse/HADOOP-3376) | *Major* | **[HOD] HOD should have a way to detect and deal with clusters that violate/exceed resource manager limits**
+* [HADOOP-3336](https://issues.apache.org/jira/browse/HADOOP-3336) | *Major* | **Direct a subset of namenode RPC events for audit logging**
-Modified HOD client to look for specific messages related to resource limit overruns and take appropriate actions - such as either failing to allocate the cluster, or issuing a warning to the user. A tool is provided, specific to Maui and Torque, that will set these specific messages.
+Added a log4j appender that emits events from FSNamesystem for audit logging
---
-* [HADOOP-3366](https://issues.apache.org/jira/browse/HADOOP-3366) | *Major* | **Shuffle/Merge improvements**
+* [HADOOP-3339](https://issues.apache.org/jira/browse/HADOOP-3339) | *Major* | **DFS Write pipeline does not detect defective datanode correctly if it times out.**
-Improved shuffle so that all fetched map-outputs are kept in-memory before being merged by stalling the shuffle so that the in-memory merge executes and frees up memory for the shuffle.
+Improved failure handling of last Data Node in write pipeline.
---
-* [HADOOP-3355](https://issues.apache.org/jira/browse/HADOOP-3355) | *Major* | **Configuration should accept decimal and hexadecimal values**
+* [HADOOP-2867](https://issues.apache.org/jira/browse/HADOOP-2867) | *Major* | **Add a task's cwd to it's LD\_LIBRARY\_PATH**
-Added support for hexadecimal values in Configuration
+Added task's cwd to its LD\_LIBRARY\_PATH.
---
-* [HADOOP-3339](https://issues.apache.org/jira/browse/HADOOP-3339) | *Major* | **DFS Write pipeline does not detect defective datanode correctly if it times out.**
+* [HADOOP-1915](https://issues.apache.org/jira/browse/HADOOP-1915) | *Minor* | **adding counters methods using String (as opposed to Enum)**
-Improved failure handling of last Data Node in write pipeline.
+Provided a new method to update counters. "incrCounter(String group, String counter, long amount)"
---
-* [HADOOP-3336](https://issues.apache.org/jira/browse/HADOOP-3336) | *Major* | **Direct a subset of namenode RPC events for audit logging**
+* [HADOOP-3405](https://issues.apache.org/jira/browse/HADOOP-3405) | *Major* | **Make mapred internal classes package-local**
-Added a log4j appender that emits events from FSNamesystem for audit logging
+Refactored previously public classes MapTaskStatus, ReduceTaskStatus, JobSubmissionProtocol, CompletedJobStatusStore to be package local.
---
-* [HADOOP-3329](https://issues.apache.org/jira/browse/HADOOP-3329) | *Major* | **DatanodeDescriptor objects stored in FSImage may be out dated.**
+* [HADOOP-3232](https://issues.apache.org/jira/browse/HADOOP-3232) | *Critical* | **Datanodes time out**
-Changed format of file system image to not store locations of last block.
+Changed 'du' command to run in a seperate thread so that it does not block user.
---
-* [HADOOP-3326](https://issues.apache.org/jira/browse/HADOOP-3326) | *Major* | **ReduceTask should not sleep for 200 ms while waiting for merge to finish**
+* [HADOOP-3035](https://issues.apache.org/jira/browse/HADOOP-3035) | *Major* | **Data nodes should inform the name-node about block crc errors.**
-Changed fetchOutputs() so that LocalFSMerger and InMemFSMergeThread threads are spawned only once. The thread gets notified when something is ready for merge. The merge happens when thresholds are met.
+Changed protocol for transferring blocks between data nodes to report corrupt blocks to data node for re-replication from a good replica.
---
-* [HADOOP-3317](https://issues.apache.org/jira/browse/HADOOP-3317) | *Minor* | **add default port for hdfs namenode**
+* [HADOOP-3265](https://issues.apache.org/jira/browse/HADOOP-3265) | *Major* | **Remove deprecated API getFileCacheHints**
-Changed the default port for "hdfs:" URIs to be 8020, so that one may simply use URIs of the form "hdfs\://example.com/dir/file".
+Removed deprecated API getFileCacheHints
---
-* [HADOOP-3310](https://issues.apache.org/jira/browse/HADOOP-3310) | *Major* | **Lease recovery for append**
+* [HADOOP-4](https://issues.apache.org/jira/browse/HADOOP-4) | *Major* | **tool to mount dfs on linux**
-Implemented Lease Recovery to sync the last bock of a file. Added ClientDatanodeProtocol for client trigging block recovery. Changed DatanodeProtocol to support block synchronization. Changed InterDatanodeProtocol to support block update.
+Introduced FUSE module for HDFS. Module allows mount of HDFS as a Unix filesystem, and optionally the export of that mount point to other machines. Writes are disabled. rmdir, mv, mkdir, rm are supported, but not cp, touch, and the like. Usage information is attached to the Jira record.
---
-* [HADOOP-3307](https://issues.apache.org/jira/browse/HADOOP-3307) | *Major* | **Archives in Hadoop.**
+* [HADOOP-3246](https://issues.apache.org/jira/browse/HADOOP-3246) | *Major* | **FTP client over HDFS**
-Introduced archive feature to Hadoop. A Map/Reduce job can be run to create an archive with indexes. A FileSystem abstraction is provided over the archive.
+Introduced an FTPFileSystem backed by Apache Commons FTPClient to directly store data into HDFS.
---
-* [HADOOP-3299](https://issues.apache.org/jira/browse/HADOOP-3299) | *Major* | **org.apache.hadoop.mapred.join.CompositeInputFormat does not initialize TextInput format files with the configuration resulting in an NullPointerException**
+* [HADOOP-3310](https://issues.apache.org/jira/browse/HADOOP-3310) | *Major* | **Lease recovery for append**
-Changed the TextInputFormat and KeyValueTextInput classes to initialize the compressionCodecs member variable before dereferencing it.
+Implemented Lease Recovery to sync the last bock of a file. Added ClientDatanodeProtocol for client trigging block recovery. Changed DatanodeProtocol to support block synchronization. Changed InterDatanodeProtocol to support block update.
---
-* [HADOOP-3283](https://issues.apache.org/jira/browse/HADOOP-3283) | *Major* | **Need a mechanism for data nodes to update generation stamps.**
+* [HADOOP-3376](https://issues.apache.org/jira/browse/HADOOP-3376) | *Major* | **[HOD] HOD should have a way to detect and deal with clusters that violate/exceed resource manager limits**
-Added an IPC server in DataNode and a new IPC protocol InterDatanodeProtocol. Added conf properties dfs.datanode.ipc.address and dfs.datanode.handler.count with defaults "0.0.0.0:50020" and 3, respectively.
-Changed the serialization in DatanodeRegistration and DatanodeInfo, and therefore, updated the versionID in ClientProtocol, DatanodeProtocol, NamenodeProtocol.
+Modified HOD client to look for specific messages related to resource limit overruns and take appropriate actions - such as either failing to allocate the cluster, or issuing a warning to the user. A tool is provided, specific to Maui and Torque, that will set these specific messages.
---
-* [HADOOP-3265](https://issues.apache.org/jira/browse/HADOOP-3265) | *Major* | **Remove deprecated API getFileCacheHints**
+* [HADOOP-3429](https://issues.apache.org/jira/browse/HADOOP-3429) | *Major* | **Increase the buffersize for the streaming parent java process's streams**
-Removed deprecated API getFileCacheHints
+Increased the size of the buffer used in the communication between the Java task and the Streaming process to 128KB.
---
-* [HADOOP-3246](https://issues.apache.org/jira/browse/HADOOP-3246) | *Major* | **FTP client over HDFS**
+* [HADOOP-3417](https://issues.apache.org/jira/browse/HADOOP-3417) | *Major* | **JobClient should not have a static configuration for cli parsing**
-Introduced an FTPFileSystem backed by Apache Commons FTPClient to directly store data into HDFS.
+Removed the public class org.apache.hadoop.mapred.JobShell.
+Command line options -libjars, -files and -archives are moved to GenericCommands. Thus applications have to implement org.apache.hadoop.util.Tool to use the options.
---
-* [HADOOP-3232](https://issues.apache.org/jira/browse/HADOOP-3232) | *Critical* | **Datanodes time out**
+* [HADOOP-2132](https://issues.apache.org/jira/browse/HADOOP-2132) | *Critical* | **Killing successfully completed jobs moves them to failed**
-Changed 'du' command to run in a seperate thread so that it does not block user.
+Change "job -kill" to only allow a job that is in the RUNNING or PREP state to be killed.
---
-* [HADOOP-3230](https://issues.apache.org/jira/browse/HADOOP-3230) | *Major* | **Add command line access to named counters**
+* [HADOOP-2909](https://issues.apache.org/jira/browse/HADOOP-2909) | *Major* | **Improve IPC idle connection management**
-Added command line tool "job -counter \<job-id\> \<group-name\> \<counter-name\>" to access counters.
+Removed property ipc.client.maxidletime from the default configuration. The allowed idle time is twice ipc.client.connection.maxidletime.
---
-* [HADOOP-3226](https://issues.apache.org/jira/browse/HADOOP-3226) | *Major* | **Run combiner when merging spills from map output**
+* [HADOOP-3486](https://issues.apache.org/jira/browse/HADOOP-3486) | *Major* | **Change default for initial block report to 0 sec and document it in hadoop-defaults.xml**
-Changed policy for running combiner. The combiner may be run multiple times as the map's output is sorted and merged. Additionally, it may be run on the reduce side as data is merged. The old semantics are available in Hadoop 0.18 if the user calls:
-job.setCombineOnlyOnce(true);
+Changed the default value of dfs.blockreport.initialDelay to be 0 seconds.
---
-* [HADOOP-3221](https://issues.apache.org/jira/browse/HADOOP-3221) | *Major* | **Need a "LineBasedTextInputFormat"**
+* [HADOOP-3459](https://issues.apache.org/jira/browse/HADOOP-3459) | *Major* | **Change dfs -ls listing to closely match format on Linux**
-Added org.apache.hadoop.mapred.lib.NLineInputFormat ,which splits N lines of input as one split. N can be specified by configuration property "mapred.line.input.format.linespermap", which defaults to 1.
+Changed the output of the "fs -ls" command to more closely match familiar Linux format. Applications that parse the command output should be reviewed.
---
-* [HADOOP-3193](https://issues.apache.org/jira/browse/HADOOP-3193) | *Minor* | **Discovery of corrupt block reported in name node log**
+* [HADOOP-3177](https://issues.apache.org/jira/browse/HADOOP-3177) | *Major* | **Expose DFSOutputStream.fsync API though the FileSystem interface**
-Added reporter to FSNamesystem stateChangeLog, and a new metric to track the number of corrupted replicas.
+Added a new public interface Syncable which declares the sync() operation. FSDataOutputStream implements Syncable. If the wrappedStream in FSDataOutputStream is Syncalbe, calling FSDataOutputStream.sync() is equivalent to call wrappedStream.sync(). Otherwise, FSDataOutputStream.sync() is a no-op. Both DistributedFileSystem and LocalFileSystem support the sync() operation.
---
-* [HADOOP-3187](https://issues.apache.org/jira/browse/HADOOP-3187) | *Major* | **Quotas for name space management**
+* [HADOOP-3113](https://issues.apache.org/jira/browse/HADOOP-3113) | *Major* | **DFSOututStream.flush() should flush data to real block file on DataNode.**
-Introduced directory quota as hard limits on the number of names in the tree rooted at that directory. An administrator may set quotas on individual directories explicitly. Newly created directories have no associated quota. File/directory creations fault if the quota would be exceeded. The attempt to set a quota faults if the directory would be in violation of the new quota.
+Added sync() method to FSDataOutputStream to really, really persist data in HDFS. InterDatanodeProtocol to implement this feature.
---
-* [HADOOP-3184](https://issues.apache.org/jira/browse/HADOOP-3184) | *Major* | **HOD gracefully exclude "bad" nodes during ring formation**
+* [HADOOP-3464](https://issues.apache.org/jira/browse/HADOOP-3464) | *Major* | **[HOD] HOD can improve error messages by reporting failures on compute nodes back to hod client**
-Modified HOD to handle master (NameNode or JobTracker) failures on bad nodes by trying to bring them up on another node in the ring. Introduced new property ringmaster.max-master-failures to specify the maximum number of times a master is allowed to fail.
+Implemented a mechanism to transfer HOD errors that occur on compute nodes to the submit node running the HOD client, so users have good feedback on why an allocation failed.
---
-* [HADOOP-3177](https://issues.apache.org/jira/browse/HADOOP-3177) | *Major* | **Expose DFSOutputStream.fsync API though the FileSystem interface**
+* [HADOOP-3452](https://issues.apache.org/jira/browse/HADOOP-3452) | *Minor* | **fsck exit code would be better if non-zero when FS corrupt**
-Added a new public interface Syncable which declares the sync() operation. FSDataOutputStream implements Syncable. If the wrappedStream in FSDataOutputStream is Syncalbe, calling FSDataOutputStream.sync() is equivalent to call wrappedStream.sync(). Otherwise, FSDataOutputStream.sync() is a no-op. Both DistributedFileSystem and LocalFileSystem support the sync() operation.
+Changed exit status of fsck to report whether the files system is healthy or corrupt.
---
-* [HADOOP-3164](https://issues.apache.org/jira/browse/HADOOP-3164) | *Major* | **Use FileChannel.transferTo() when data is read from DataNode.**
+* [HADOOP-1328](https://issues.apache.org/jira/browse/HADOOP-1328) | *Major* | **Hadoop Streaming needs to provide a way for the stream plugin to update global counters**
-Changed data node to use FileChannel.tranferTo() to transfer block data.
+Introduced a way for a streaming process to update global counters and status using stderr stream to emit information. Use "reporter:counter:\<group\>,\<counter\>,\<amount\> " to update a counter. Use "reporter:status:\<message\>" to update status.
---
-* [HADOOP-3135](https://issues.apache.org/jira/browse/HADOOP-3135) | *Critical* | **if the 'mapred.system.dir' in the client jobconf is different from the JobTracker's value job submission fails**
+* [HADOOP-3095](https://issues.apache.org/jira/browse/HADOOP-3095) | *Major* | **Validating input paths and creating splits is slow on S3**
-Changed job submission protocol to not allow submission if the client's value of mapred.system.dir does not match the job tracker's. Deprecated JobConf.getSystemDir(); use JobClient.getSystemDir().
+Added overloaded method getFileBlockLocations(FileStatus, long, long). This is an incompatible change for FileSystem implementations which override getFileBlockLocations(Path, long, long). They should have the signature of this method changed to getFileBlockLocations(FileStatus, long, long) to work correctly.
---
-* [HADOOP-3113](https://issues.apache.org/jira/browse/HADOOP-3113) | *Major* | **DFSOututStream.flush() should flush data to real block file on DataNode.**
+* [HADOOP-2095](https://issues.apache.org/jira/browse/HADOOP-2095) | *Major* | **Reducer failed due to Out ofMemory**
-Added sync() method to FSDataOutputStream to really, really persist data in HDFS. InterDatanodeProtocol to implement this feature.
+Reduced in-memory copies of keys and values as they flow through the Map-Reduce framework. Changed the storage of intermediate map outputs to use new IFile instead of SequenceFile for better compression.
---
-* [HADOOP-3095](https://issues.apache.org/jira/browse/HADOOP-3095) | *Major* | **Validating input paths and creating splits is slow on S3**
+* [HADOOP-2427](https://issues.apache.org/jira/browse/HADOOP-2427) | *Major* | **Cleanup of mapred.local.dir after maptask is complete**
-Added overloaded method getFileBlockLocations(FileStatus, long, long). This is an incompatible change for FileSystem implementations which override getFileBlockLocations(Path, long, long). They should have the signature of this method changed to getFileBlockLocations(FileStatus, long, long) to work correctly.
+The current working directory of a task, i.e. ${mapred.local.dir}/taskTracker/jobcache/\<jobid\>/\<task\_dir\>/work is cleanedup, as soon as the task is finished.
---
-* [HADOOP-3061](https://issues.apache.org/jira/browse/HADOOP-3061) | *Major* | **Writable for single byte and double**
+* [HADOOP-3187](https://issues.apache.org/jira/browse/HADOOP-3187) | *Major* | **Quotas for name space management**
-Introduced ByteWritable and DoubleWritable (implementing WritableComparable) implementations for Byte and Double.
+Introduced directory quota as hard limits on the number of names in the tree rooted at that directory. An administrator may set quotas on individual directories explicitly. Newly created directories have no associated quota. File/directory creations fault if the quota would be exceeded. The attempt to set a quota faults if the directory would be in violation of the new quota.
---
-* [HADOOP-3058](https://issues.apache.org/jira/browse/HADOOP-3058) | *Minor* | **Hadoop DFS to report more replication metrics**
+* [HADOOP-3307](https://issues.apache.org/jira/browse/HADOOP-3307) | *Major* | **Archives in Hadoop.**
-Added FSNamesystem status metrics.
+Introduced archive feature to Hadoop. A Map/Reduce job can be run to create an archive with indexes. A FileSystem abstraction is provided over the archive.
---
-* [HADOOP-3035](https://issues.apache.org/jira/browse/HADOOP-3035) | *Major* | **Data nodes should inform the name-node about block crc errors.**
+* [HADOOP-3326](https://issues.apache.org/jira/browse/HADOOP-3326) | *Major* | **ReduceTask should not sleep for 200 ms while waiting for merge to finish**
-Changed protocol for transferring blocks between data nodes to report corrupt blocks to data node for re-replication from a good replica.
+Changed fetchOutputs() so that LocalFSMerger and InMemFSMergeThread threads are spawned only once. The thread gets notified when something is ready for merge. The merge happens when thresholds are met.
---
-* [HADOOP-3013](https://issues.apache.org/jira/browse/HADOOP-3013) | *Major* | **fsck to show (checksum) corrupted files**
+* [HADOOP-3483](https://issues.apache.org/jira/browse/HADOOP-3483) | *Major* | **[HOD] Improvements with cluster directory handling**
-fsck reports corrupt blocks in the system.
+Modified HOD to create a cluster directory if one does not exist and to auto-deallocate a cluster while reallocating it, if it is already dead.
---
-* [HADOOP-2909](https://issues.apache.org/jira/browse/HADOOP-2909) | *Major* | **Improve IPC idle connection management**
+* [HADOOP-236](https://issues.apache.org/jira/browse/HADOOP-236) | *Major* | **job tracker should refuse connection from a task tracker with a different version number**
-Removed property ipc.client.maxidletime from the default configuration. The allowed idle time is twice ipc.client.connection.maxidletime.
+Changed connection protocol job tracker and task tracker so that task tracker will not connect to a job tracker with a different build version.
---
-* [HADOOP-2867](https://issues.apache.org/jira/browse/HADOOP-2867) | *Major* | **Add a task's cwd to it's LD\_LIBRARY\_PATH**
+* [HADOOP-3427](https://issues.apache.org/jira/browse/HADOOP-3427) | *Major* | **In ReduceTask::fetchOutputs, wait for result can be improved slightly**
-Added task's cwd to its LD\_LIBRARY\_PATH.
+Changed shuffle scheduler policy to wait for notifications from shuffle threads before scheduling more.
---
-* [HADOOP-2865](https://issues.apache.org/jira/browse/HADOOP-2865) | *Major* | **FsShell.ls() should print file attributes first then the path name.**
+* [HADOOP-3184](https://issues.apache.org/jira/browse/HADOOP-3184) | *Major* | **HOD gracefully exclude "bad" nodes during ring formation**
-Changed the output of the "fs -ls" command to more closely match familiar Linux format. Additional changes were made by HADOOP-3459. Applications that parse the command output should be reviewed.
+Modified HOD to handle master (NameNode or JobTracker) failures on bad nodes by trying to bring them up on another node in the ring. Introduced new property ringmaster.max-master-failures to specify the maximum number of times a master is allowed to fail.
---
-* [HADOOP-2797](https://issues.apache.org/jira/browse/HADOOP-2797) | *Critical* | **Withdraw CRC upgrade from HDFS**
+* [HADOOP-3135](https://issues.apache.org/jira/browse/HADOOP-3135) | *Critical* | **if the 'mapred.system.dir' in the client jobconf is different from the JobTracker's value job submission fails**
-Withdrew the upgrade-to-CRC facility. HDFS will no longer support upgrades from versions without CRCs for block data. Users upgrading from version 0.13 or earlier must first upgrade to an intermediate (0.14, 0.15, 0.16, 0.17) version before doing upgrade to version 0.18 or later.
+Changed job submission protocol to not allow submission if the client's value of mapred.system.dir does not match the job tracker's. Deprecated JobConf.getSystemDir(); use JobClient.getSystemDir().
---
-* [HADOOP-2703](https://issues.apache.org/jira/browse/HADOOP-2703) | *Minor* | **New files under lease (before close) still shows up as MISSING files/blocks in fsck**
+* [HADOOP-3460](https://issues.apache.org/jira/browse/HADOOP-3460) | *Minor* | **SequenceFileAsBinaryOutputFormat**
-Changed fsck to ignore files opened for writing. Introduced new option "-openforwrite" to explicitly show open files.
+Created SequenceFileAsBinaryOutputFormat to write raw bytes as keys and values to a SequenceFile.
---
-* [HADOOP-2656](https://issues.apache.org/jira/browse/HADOOP-2656) | *Major* | **Support for upgrading existing cluster to facilitate appends to HDFS files**
+* [HADOOP-3230](https://issues.apache.org/jira/browse/HADOOP-3230) | *Major* | **Add command line access to named counters**
-Associated a generation stamp with each block. On data nodes, the generation stamp is stored as part of the file name of the block's meta-data file.
+Added command line tool "job -counter \<job-id\> \<group-name\> \<counter-name\>" to access counters.
---
-* [HADOOP-2585](https://issues.apache.org/jira/browse/HADOOP-2585) | *Major* | **Automatic namespace recovery from the secondary image.**
+* [HADOOP-930](https://issues.apache.org/jira/browse/HADOOP-930) | *Major* | **Add support for reading regular (non-block-based) files from S3 in S3FileSystem**
-Improved management of replicas of the name space image. If all replicas on the Name Node are lost, the latest check point can be loaded from the secondary Name Node. Use parameter "-importCheckpoint" and specify the location with "fs.checkpoint.dir." The directory structure on the secondary Name Node has changed to match the primary Name Node.
+Added support for reading and writing native S3 files. Native S3 files are referenced using s3n URIs. See http://wiki.apache.org/hadoop/AmazonS3 for more details.
---
-* [HADOOP-2427](https://issues.apache.org/jira/browse/HADOOP-2427) | *Major* | **Cleanup of mapred.local.dir after maptask is complete**
+* [HADOOP-3193](https://issues.apache.org/jira/browse/HADOOP-3193) | *Minor* | **Discovery of corrupt block reported in name node log**
-The current working directory of a task, i.e. ${mapred.local.dir}/taskTracker/jobcache/\<jobid\>/\<task\_dir\>/work is cleanedup, as soon as the task is finished.
+Added reporter to FSNamesystem stateChangeLog, and a new metric to track the number of corrupted replicas.
---
-* [HADOOP-2188](https://issues.apache.org/jira/browse/HADOOP-2188) | *Major* | **RPC should send a ping rather than use client timeouts**
+* [HADOOP-3366](https://issues.apache.org/jira/browse/HADOOP-3366) | *Major* | **Shuffle/Merge improvements**
-Replaced timeouts with pings to check that client connection is alive. Removed the property ipc.client.timeout from the default Hadoop configuration. Removed the metric RpcOpsDiscardedOPsNum.
+Improved shuffle so that all fetched map-outputs are kept in-memory before being merged by stalling the shuffle so that the in-memory merge executes and frees up memory for the shuffle.
---
-* [HADOOP-2181](https://issues.apache.org/jira/browse/HADOOP-2181) | *Minor* | **Input Split details for maps should be logged**
+* [HADOOP-3512](https://issues.apache.org/jira/browse/HADOOP-3512) | *Major* | **Split map/reduce tools into separate jars**
-Added logging for input splits in job tracker log and job history log. Added web UI for viewing input splits in the job UI and history UI.
+Separated Distcp, Logalyzer and Archiver into a tools jar.
---
-* [HADOOP-2132](https://issues.apache.org/jira/browse/HADOOP-2132) | *Critical* | **Killing successfully completed jobs moves them to failed**
+* [HADOOP-3379](https://issues.apache.org/jira/browse/HADOOP-3379) | *Blocker* | **Document the "stream.non.zero.exit.status.is.failure" knob for streaming**
-Change "job -kill" to only allow a job that is in the RUNNING or PREP state to be killed.
+Set default value for configuration property "stream.non.zero.exit.status.is.failure" to be "true".
---
-* [HADOOP-2095](https://issues.apache.org/jira/browse/HADOOP-2095) | *Major* | **Reducer failed due to Out ofMemory**
+* [HADOOP-3564](https://issues.apache.org/jira/browse/HADOOP-3564) | *Blocker* | **Sometime after successful hod allocation datanode fails to come up with java.net.BindException for dfs.datanode.ipc.address**
-Reduced in-memory copies of keys and values as they flow through the Map-Reduce framework. Changed the storage of intermediate map outputs to use new IFile instead of SequenceFile for better compression.
+Modifed HOD to generate the dfs.datanode.ipc.address parameter in the hadoop-site.xml of datanodes that it launches.
---
-* [HADOOP-2065](https://issues.apache.org/jira/browse/HADOOP-2065) | *Major* | **Replication policy for corrupted block**
+* [HADOOP-3569](https://issues.apache.org/jira/browse/HADOOP-3569) | *Minor* | **KFS input stream read() returns 4 bytes instead of 1**
-Added "corrupt" flag to LocatedBlock to indicate that all replicas of the block thought to be corrupt.
+Fixed KFS to have read() read and return 1 byte instead of 4.
---
-* [HADOOP-2019](https://issues.apache.org/jira/browse/HADOOP-2019) | *Major* | **DistributedFileCache should support .tgz files in addition to jars and zip files**
+* [HADOOP-3598](https://issues.apache.org/jira/browse/HADOOP-3598) | *Blocker* | **Map-Reduce framework needlessly creates temporary \_${taskid} directories for Maps**
-Added support for .tar, .tgz and .tar.gz files in DistributedCache. File sizes are limited to 2GB.
+Changed Map-Reduce framework to no longer create temporary task output directories for staging outputs if staging outputs isn't necessary. ${mapred.out.dir}/\_temporary/\_${taskid}
---
-* [HADOOP-1915](https://issues.apache.org/jira/browse/HADOOP-1915) | *Minor* | **adding counters methods using String (as opposed to Enum)**
+* [HADOOP-3610](https://issues.apache.org/jira/browse/HADOOP-3610) | *Blocker* | **[HOD] HOD does not automatically create a cluster directory for the script option**
-Provided a new method to update counters. "incrCounter(String group, String counter, long amount)"
+Modified HOD to automatically create a cluster directory if the one specified with the script command does not exist.
---
-* [HADOOP-1702](https://issues.apache.org/jira/browse/HADOOP-1702) | *Major* | **Reduce buffer copies when data is written to DFS**
+* [HADOOP-3665](https://issues.apache.org/jira/browse/HADOOP-3665) | *Minor* | **WritableComparator newKey() fails for NullWritable**
-Reduced buffer copies as data is written to HDFS. The order of sending data bytes and control information has changed, but this will not be observed by client applications.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-1328](https://issues.apache.org/jira/browse/HADOOP-1328) | *Major* | **Hadoop Streaming needs to provide a way for the stream plugin to update global counters**
+* [HADOOP-3683](https://issues.apache.org/jira/browse/HADOOP-3683) | *Major* | **Hadoop dfs metric FilesListed shows number of files listed instead of operations**
-Introduced a way for a streaming process to update global counters and status using stderr stream to emit information. Use "reporter:counter:\<group\>,\<counter\>,\<amount\> " to update a counter. Use "reporter:status:\<message\>" to update status.
+Change FileListed to getNumGetListingOps and add CreateFileOps, DeleteFileOps and AddBlockOps metrics.
---
-* [HADOOP-930](https://issues.apache.org/jira/browse/HADOOP-930) | *Major* | **Add support for reading regular (non-block-based) files from S3 in S3FileSystem**
+* [HADOOP-3703](https://issues.apache.org/jira/browse/HADOOP-3703) | *Blocker* | **[HOD] logcondense needs to use the new pattern of output in hadoop dfs -lsr**
-Added support for reading and writing native S3 files. Native S3 files are referenced using s3n URIs. See http://wiki.apache.org/hadoop/AmazonS3 for more details.
+Modified logcondense.py to use the new format of hadoop dfs -lsr output. This version of logcondense would not work with previous versions of Hadoop and hence is incompatible.
---
-* [HADOOP-544](https://issues.apache.org/jira/browse/HADOOP-544) | *Major* | **Replace the job, tip and task ids with objects.**
+* [HADOOP-3677](https://issues.apache.org/jira/browse/HADOOP-3677) | *Blocker* | **Problems with generation stamp upgrade**
-Introduced new classes JobID, TaskID and TaskAttemptID, which should be used instead of their string counterparts. Deprecated functions in JobClient, TaskReport, RunningJob, jobcontrol.Job and TaskCompletionEvent that use string arguments. Applications can use xxxID.toString() and xxxID.forName() methods to convert/restore objects to/from strings.
+Simplify generation stamp upgrade by making is a local upgrade on datandodes. Deleted distributed upgrade.
---
-* [HADOOP-236](https://issues.apache.org/jira/browse/HADOOP-236) | *Major* | **job tracker should refuse connection from a task tracker with a different version number**
+* [HADOOP-3808](https://issues.apache.org/jira/browse/HADOOP-3808) | *Blocker* | **[HOD] Include job tracker RPC in notes attribute after job submission**
-Changed connection protocol job tracker and task tracker so that task tracker will not connect to a job tracker with a different build version.
+Modified HOD to include the RPC port of the JobTracker in the 'notes' attribute of the resource manager. The RPC port is included as the string 'Mapred RPC Port:\<port number\>'. Tools that depend on the value of the notes attribute must change to parse this new value.
---
-* [HADOOP-4](https://issues.apache.org/jira/browse/HADOOP-4) | *Major* | **tool to mount dfs on linux**
+* [HADOOP-3837](https://issues.apache.org/jira/browse/HADOOP-3837) | *Major* | **hadop streaming does not use progress reporting to detect hung tasks**
-Introduced FUSE module for HDFS. Module allows mount of HDFS as a Unix filesystem, and optionally the export of that mount point to other machines. Writes are disabled. rmdir, mv, mkdir, rm are supported, but not cp, touch, and the like. Usage information is attached to the Jira record.
+Changed streaming tasks to adhere to task timeout value specified in the job configuration.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.1/CHANGES.0.18.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.1/CHANGES.0.18.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.1/CHANGES.0.18.1.md
index dec3ae1..87880c1 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.1/CHANGES.0.18.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.1/CHANGES.0.18.1.md
@@ -20,61 +20,27 @@
## Release 0.18.1 - 2008-09-17
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-4145](https://issues.apache.org/jira/browse/HADOOP-4145) | [HOD] Support an accounting plugin script for HOD | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
| [HADOOP-3934](https://issues.apache.org/jira/browse/HADOOP-3934) | Update log4j from 1.2.13 to 1.2.15 | Blocker | . | Don Kim | Owen O'Malley |
+| [HADOOP-4145](https://issues.apache.org/jira/browse/HADOOP-4145) | [HOD] Support an accounting plugin script for HOD | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-4161](https://issues.apache.org/jira/browse/HADOOP-4161) | [HOD] Uncaught exceptions can potentially hang hod-client. | Major | contrib/hod | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [HADOOP-4060](https://issues.apache.org/jira/browse/HADOOP-4060) | [HOD] Make HOD to roll log files on the client | Blocker | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-| [HADOOP-4046](https://issues.apache.org/jira/browse/HADOOP-4046) | WritableComparator's constructor should be protected instead of private | Major | io | Owen O'Malley | Chris Douglas |
-| [HADOOP-4040](https://issues.apache.org/jira/browse/HADOOP-4040) | Remove the hardcoded ipc.client.connection.maxidletime setting from the TaskTracker.Child.main() | Blocker | . | Devaraj Das | Devaraj Das |
-| [HADOOP-4037](https://issues.apache.org/jira/browse/HADOOP-4037) | HadoopQA contrib -1 comments due to inconsistency in eclipse plugin declared jars | Blocker | . | Nigel Daley | Nigel Daley |
-| [HADOOP-3995](https://issues.apache.org/jira/browse/HADOOP-3995) | renameTo(src, dst) does not restore src name in case of quota failure. | Blocker | . | Raghu Angadi | Raghu Angadi |
| [HADOOP-3940](https://issues.apache.org/jira/browse/HADOOP-3940) | Reduce often attempts in memory merge with no work | Minor | . | Chris Douglas | Chris Douglas |
| [HADOOP-3821](https://issues.apache.org/jira/browse/HADOOP-3821) | SequenceFile's Reader.decompressorPool or Writer.decompressorPool gets into an inconsistent state when calling close() more than once | Major | io | Peter Voss | Arun C Murthy |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-3995](https://issues.apache.org/jira/browse/HADOOP-3995) | renameTo(src, dst) does not restore src name in case of quota failure. | Blocker | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-4037](https://issues.apache.org/jira/browse/HADOOP-4037) | HadoopQA contrib -1 comments due to inconsistency in eclipse plugin declared jars | Blocker | . | Nigel Daley | Nigel Daley |
+| [HADOOP-4040](https://issues.apache.org/jira/browse/HADOOP-4040) | Remove the hardcoded ipc.client.connection.maxidletime setting from the TaskTracker.Child.main() | Blocker | . | Devaraj Das | Devaraj Das |
+| [HADOOP-4046](https://issues.apache.org/jira/browse/HADOOP-4046) | WritableComparator's constructor should be protected instead of private | Major | io | Owen O'Malley | Chris Douglas |
+| [HADOOP-4060](https://issues.apache.org/jira/browse/HADOOP-4060) | [HOD] Make HOD to roll log files on the client | Blocker | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-4161](https://issues.apache.org/jira/browse/HADOOP-4161) | [HOD] Uncaught exceptions can potentially hang hod-client. | Major | contrib/hod | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.1/RELEASENOTES.0.18.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.1/RELEASENOTES.0.18.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.1/RELEASENOTES.0.18.1.md
index e9d1c06..4fa1510 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.1/RELEASENOTES.0.18.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.1/RELEASENOTES.0.18.1.md
@@ -23,16 +23,16 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-4060](https://issues.apache.org/jira/browse/HADOOP-4060) | *Blocker* | **[HOD] Make HOD to roll log files on the client**
+* [HADOOP-3995](https://issues.apache.org/jira/browse/HADOOP-3995) | *Blocker* | **renameTo(src, dst) does not restore src name in case of quota failure.**
-HOD client was modified to roll over client logs being written to the cluster directory. A new configuration parameter, hod.log-rollover-count, was introduced to specify how many rollover log files to retain.
+In case of quota failure on HDFS, rename does not restore source filename.
---
-* [HADOOP-3995](https://issues.apache.org/jira/browse/HADOOP-3995) | *Blocker* | **renameTo(src, dst) does not restore src name in case of quota failure.**
+* [HADOOP-4060](https://issues.apache.org/jira/browse/HADOOP-4060) | *Blocker* | **[HOD] Make HOD to roll log files on the client**
-In case of quota failure on HDFS, rename does not restore source filename.
+HOD client was modified to roll over client logs being written to the cluster directory. A new configuration parameter, hod.log-rollover-count, was introduced to specify how many rollover log files to retain.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.2/CHANGES.0.18.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.2/CHANGES.0.18.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.2/CHANGES.0.18.2.md
index d7e6ac7..4460629 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.2/CHANGES.0.18.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.2/CHANGES.0.18.2.md
@@ -27,18 +27,6 @@
| [HADOOP-4228](https://issues.apache.org/jira/browse/HADOOP-4228) | dfs datanode metrics, bytes\_read, bytes\_written overflows due to incorrect type used. | Blocker | metrics | Eric Yang | Eric Yang |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
@@ -50,27 +38,27 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-4533](https://issues.apache.org/jira/browse/HADOOP-4533) | HDFS client of hadoop 0.18.1 and HDFS server 0.18.2 (0.18 branch) not compatible | Blocker | . | Runping Qi | Hairong Kuang |
-| [HADOOP-4526](https://issues.apache.org/jira/browse/HADOOP-4526) | fsck failing with NullPointerException (return value 0) | Major | . | Koji Noguchi | Hairong Kuang |
-| [HADOOP-4517](https://issues.apache.org/jira/browse/HADOOP-4517) | unstable dfs when running jobs on 0.18.1 | Blocker | . | Christian Kunz | Tsz Wo Nicholas Sze |
-| [HADOOP-4483](https://issues.apache.org/jira/browse/HADOOP-4483) | getBlockArray in DatanodeDescriptor does not honor passed in maxblocks value | Critical | . | Ahad Rana | Ahad Rana |
-| [HADOOP-4469](https://issues.apache.org/jira/browse/HADOOP-4469) | ant jar file not being included in tar distribution | Blocker | build | Nigel Daley | Nigel Daley |
-| [HADOOP-4467](https://issues.apache.org/jira/browse/HADOOP-4467) | SerializationFactory should use current context ClassLoader | Blocker | . | Chris K Wensel | Chris K Wensel |
-| [HADOOP-4407](https://issues.apache.org/jira/browse/HADOOP-4407) | HADOOP-4395 should use a Java 1.5 API for 0.18 | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4399](https://issues.apache.org/jira/browse/HADOOP-4399) | fuse-dfs per FD context is not thread safe and can cause segfaults and corruptions | Blocker | . | Pete Wyckoff | Pete Wyckoff |
-| [HADOOP-4395](https://issues.apache.org/jira/browse/HADOOP-4395) | Reloading FSImage and FSEditLog may erase user and group information | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4369](https://issues.apache.org/jira/browse/HADOOP-4369) | Metric Averages are not averages | Blocker | metrics | Brian Bockelman | Brian Bockelman |
-| [HADOOP-4351](https://issues.apache.org/jira/browse/HADOOP-4351) | ArrayIndexOutOfBoundsException during fsck | Blocker | . | Brian Bockelman | Hairong Kuang |
-| [HADOOP-4340](https://issues.apache.org/jira/browse/HADOOP-4340) | "hadoop jar" always returns exit code 0 (success) to the shell when jar throws a fatal exception | Major | . | David Litster | Arun C Murthy |
-| [HADOOP-4326](https://issues.apache.org/jira/browse/HADOOP-4326) | ChecksumFileSystem does not override all create(...) methods | Blocker | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4314](https://issues.apache.org/jira/browse/HADOOP-4314) | TestReplication fails quite often | Blocker | test | Raghu Angadi | Raghu Angadi |
-| [HADOOP-4292](https://issues.apache.org/jira/browse/HADOOP-4292) | append() does not work for LocalFileSystem | Blocker | fs | Raghu Angadi | Hairong Kuang |
| [HADOOP-4277](https://issues.apache.org/jira/browse/HADOOP-4277) | Checksum verification is disabled for LocalFS | Blocker | . | Raghu Angadi | Raghu Angadi |
| [HADOOP-4271](https://issues.apache.org/jira/browse/HADOOP-4271) | Bug in FSInputChecker makes it possible to read from an invalid buffer | Blocker | fs | Ning Li | Ning Li |
-| [HADOOP-3914](https://issues.apache.org/jira/browse/HADOOP-3914) | checksumOk implementation in DFSClient can break applications | Blocker | . | Christian Kunz | Christian Kunz |
-| [HADOOP-3786](https://issues.apache.org/jira/browse/HADOOP-3786) | Changes in HOD documentation | Blocker | documentation | Suman Sehgal | Vinod Kumar Vavilapalli |
| [HADOOP-3614](https://issues.apache.org/jira/browse/HADOOP-3614) | TestLeaseRecovery fails when run with assertions enabled. | Blocker | . | Konstantin Shvachko | Tsz Wo Nicholas Sze |
+| [HADOOP-4314](https://issues.apache.org/jira/browse/HADOOP-4314) | TestReplication fails quite often | Blocker | test | Raghu Angadi | Raghu Angadi |
+| [HADOOP-4326](https://issues.apache.org/jira/browse/HADOOP-4326) | ChecksumFileSystem does not override all create(...) methods | Blocker | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4395](https://issues.apache.org/jira/browse/HADOOP-4395) | Reloading FSImage and FSEditLog may erase user and group information | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4351](https://issues.apache.org/jira/browse/HADOOP-4351) | ArrayIndexOutOfBoundsException during fsck | Blocker | . | Brian Bockelman | Hairong Kuang |
+| [HADOOP-4407](https://issues.apache.org/jira/browse/HADOOP-4407) | HADOOP-4395 should use a Java 1.5 API for 0.18 | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4292](https://issues.apache.org/jira/browse/HADOOP-4292) | append() does not work for LocalFileSystem | Blocker | fs | Raghu Angadi | Hairong Kuang |
| [HADOOP-3217](https://issues.apache.org/jira/browse/HADOOP-3217) | [HOD] Be less agressive when querying job status from resource manager. | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-3786](https://issues.apache.org/jira/browse/HADOOP-3786) | Changes in HOD documentation | Blocker | documentation | Suman Sehgal | Vinod Kumar Vavilapalli |
+| [HADOOP-4399](https://issues.apache.org/jira/browse/HADOOP-4399) | fuse-dfs per FD context is not thread safe and can cause segfaults and corruptions | Blocker | . | Pete Wyckoff | Pete Wyckoff |
+| [HADOOP-4369](https://issues.apache.org/jira/browse/HADOOP-4369) | Metric Averages are not averages | Blocker | metrics | Brian Bockelman | Brian Bockelman |
+| [HADOOP-4469](https://issues.apache.org/jira/browse/HADOOP-4469) | ant jar file not being included in tar distribution | Blocker | build | Nigel Daley | Nigel Daley |
+| [HADOOP-3914](https://issues.apache.org/jira/browse/HADOOP-3914) | checksumOk implementation in DFSClient can break applications | Blocker | . | Christian Kunz | Christian Kunz |
+| [HADOOP-4467](https://issues.apache.org/jira/browse/HADOOP-4467) | SerializationFactory should use current context ClassLoader | Blocker | . | Chris K Wensel | Chris K Wensel |
+| [HADOOP-4517](https://issues.apache.org/jira/browse/HADOOP-4517) | unstable dfs when running jobs on 0.18.1 | Blocker | . | Christian Kunz | Tsz Wo Nicholas Sze |
+| [HADOOP-4526](https://issues.apache.org/jira/browse/HADOOP-4526) | fsck failing with NullPointerException (return value 0) | Major | . | Koji Noguchi | Hairong Kuang |
+| [HADOOP-4533](https://issues.apache.org/jira/browse/HADOOP-4533) | HDFS client of hadoop 0.18.1 and HDFS server 0.18.2 (0.18 branch) not compatible | Blocker | . | Runping Qi | Hairong Kuang |
+| [HADOOP-4483](https://issues.apache.org/jira/browse/HADOOP-4483) | getBlockArray in DatanodeDescriptor does not honor passed in maxblocks value | Critical | . | Ahad Rana | Ahad Rana |
+| [HADOOP-4340](https://issues.apache.org/jira/browse/HADOOP-4340) | "hadoop jar" always returns exit code 0 (success) to the shell when jar throws a fatal exception | Major | . | David Litster | Arun C Murthy |
### TESTS:
@@ -80,15 +68,3 @@
| [HADOOP-4403](https://issues.apache.org/jira/browse/HADOOP-4403) | TestLeaseRecovery.testBlockSynchronization failed on trunk | Blocker | test | Hemanth Yamijala | Tsz Wo Nicholas Sze |
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.2/RELEASENOTES.0.18.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.2/RELEASENOTES.0.18.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.2/RELEASENOTES.0.18.2.md
index e808cd3..e37a3d7 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.2/RELEASENOTES.0.18.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.2/RELEASENOTES.0.18.2.md
@@ -23,37 +23,37 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-4467](https://issues.apache.org/jira/browse/HADOOP-4467) | *Blocker* | **SerializationFactory should use current context ClassLoader**
+* [HADOOP-4277](https://issues.apache.org/jira/browse/HADOOP-4277) | *Blocker* | **Checksum verification is disabled for LocalFS**
-SerializationFactory now uses the current context ClassLoader allowing for user supplied Serialization instances.
+Checksum verification was mistakenly disabled for LocalFileSystem.
---
-* [HADOOP-4314](https://issues.apache.org/jira/browse/HADOOP-4314) | *Blocker* | **TestReplication fails quite often**
+* [HADOOP-4271](https://issues.apache.org/jira/browse/HADOOP-4271) | *Blocker* | **Bug in FSInputChecker makes it possible to read from an invalid buffer**
-Simulated Datanodes should not include blocks that are still being written in their block report.
+Checksum input stream can sometimes return invalid data to the user.
---
-* [HADOOP-4277](https://issues.apache.org/jira/browse/HADOOP-4277) | *Blocker* | **Checksum verification is disabled for LocalFS**
+* [HADOOP-4314](https://issues.apache.org/jira/browse/HADOOP-4314) | *Blocker* | **TestReplication fails quite often**
-Checksum verification was mistakenly disabled for LocalFileSystem.
+Simulated Datanodes should not include blocks that are still being written in their block report.
---
-* [HADOOP-4271](https://issues.apache.org/jira/browse/HADOOP-4271) | *Blocker* | **Bug in FSInputChecker makes it possible to read from an invalid buffer**
+* [HADOOP-4228](https://issues.apache.org/jira/browse/HADOOP-4228) | *Blocker* | **dfs datanode metrics, bytes\_read, bytes\_written overflows due to incorrect type used.**
-Checksum input stream can sometimes return invalid data to the user.
+Changed bytes\_read, bytes\_written to type long to prevent metrics overflow.
---
-* [HADOOP-4228](https://issues.apache.org/jira/browse/HADOOP-4228) | *Blocker* | **dfs datanode metrics, bytes\_read, bytes\_written overflows due to incorrect type used.**
+* [HADOOP-4467](https://issues.apache.org/jira/browse/HADOOP-4467) | *Blocker* | **SerializationFactory should use current context ClassLoader**
-Changed bytes\_read, bytes\_written to type long to prevent metrics overflow.
+SerializationFactory now uses the current context ClassLoader allowing for user supplied Serialization instances.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.3/CHANGES.0.18.3.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.3/CHANGES.0.18.3.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.3/CHANGES.0.18.3.md
index 7c33c5e..62249ef 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.3/CHANGES.0.18.3.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.3/CHANGES.0.18.3.md
@@ -24,21 +24,9 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-4997](https://issues.apache.org/jira/browse/HADOOP-4997) | workaround for tmp file handling on DataNodes in 0.18 (HADOOP-4663) | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-4659](https://issues.apache.org/jira/browse/HADOOP-4659) | Root cause of connection failure is being lost to code that uses it for delaying startup | Blocker | ipc | Steve Loughran | Steve Loughran |
| [HADOOP-4061](https://issues.apache.org/jira/browse/HADOOP-4061) | Large number of decommission freezes the Namenode | Major | . | Koji Noguchi | Tsz Wo Nicholas Sze |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-4659](https://issues.apache.org/jira/browse/HADOOP-4659) | Root cause of connection failure is being lost to code that uses it for delaying startup | Blocker | ipc | Steve Loughran | Steve Loughran |
+| [HADOOP-4997](https://issues.apache.org/jira/browse/HADOOP-4997) | workaround for tmp file handling on DataNodes in 0.18 (HADOOP-4663) | Blocker | . | Raghu Angadi | Raghu Angadi |
### IMPROVEMENTS:
@@ -52,64 +40,58 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-5077](https://issues.apache.org/jira/browse/HADOOP-5077) | JavaDoc errors in 0.18.3 | Blocker | util | Raghu Angadi | Raghu Angadi |
-| [HADOOP-4983](https://issues.apache.org/jira/browse/HADOOP-4983) | Job counters sometimes go down as tasks run without task failures | Critical | . | Owen O'Malley | Amareshwari Sriramadasu |
-| [HADOOP-4971](https://issues.apache.org/jira/browse/HADOOP-4971) | Block report times from datanodes could converge to same time. | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-4961](https://issues.apache.org/jira/browse/HADOOP-4961) | ConcurrentModificationException in lease recovery of empty files. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-4951](https://issues.apache.org/jira/browse/HADOOP-4951) | Lease monitor does not own the LeaseManager lock in changing leases. | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4935](https://issues.apache.org/jira/browse/HADOOP-4935) | Manual leaving of safe mode may lead to data lost | Major | . | Hairong Kuang | Konstantin Shvachko |
-| [HADOOP-4924](https://issues.apache.org/jira/browse/HADOOP-4924) | Race condition in re-init of TaskTracker | Blocker | . | Devaraj Das | Devaraj Das |
-| [HADOOP-4919](https://issues.apache.org/jira/browse/HADOOP-4919) | [HOD] Provide execute access to JT history directory path for group | Major | contrib/hod | Hemanth Yamijala | Peeyush Bishnoi |
-| [HADOOP-4910](https://issues.apache.org/jira/browse/HADOOP-4910) | NameNode should exclude corrupt replicas when choosing excessive replicas to delete | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-4904](https://issues.apache.org/jira/browse/HADOOP-4904) | Deadlock while leaving safe mode. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-4840](https://issues.apache.org/jira/browse/HADOOP-4840) | TestNodeCount sometimes fails with NullPointerException | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-4822](https://issues.apache.org/jira/browse/HADOOP-4822) | 0.18 cannot be compiled in Java 5. | Blocker | util | Tsz Wo Nicholas Sze | |
-| [HADOOP-4810](https://issues.apache.org/jira/browse/HADOOP-4810) | Data lost at cluster startup time | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-4806](https://issues.apache.org/jira/browse/HADOOP-4806) | HDFS rename does not work correctly if src contains Java regular expression special characters | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4797](https://issues.apache.org/jira/browse/HADOOP-4797) | RPC Server can leave a lot of direct buffers | Blocker | ipc | Raghu Angadi | Raghu Angadi |
-| [HADOOP-4795](https://issues.apache.org/jira/browse/HADOOP-4795) | Lease monitor may get into an infinite loop | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4778](https://issues.apache.org/jira/browse/HADOOP-4778) | Check for zero size block meta file when updating a block. | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4746](https://issues.apache.org/jira/browse/HADOOP-4746) | Job output directory should be normalized | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-4742](https://issues.apache.org/jira/browse/HADOOP-4742) | Mistake delete replica in hadoop 0.18.1 | Blocker | . | Wang Xu | Wang Xu |
-| [HADOOP-4734](https://issues.apache.org/jira/browse/HADOOP-4734) | Some lease recovery codes in 0.19 or trunk should also be committed in 0.18. | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4726](https://issues.apache.org/jira/browse/HADOOP-4726) | documentation typos: "the the" | Minor | documentation | Tsz Wo Nicholas Sze | Edward J. Yoon |
-| [HADOOP-4717](https://issues.apache.org/jira/browse/HADOOP-4717) | Removal of default port# in NameNode.getUri() cause a map/reduce job failed to prompt temporay output | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-4714](https://issues.apache.org/jira/browse/HADOOP-4714) | map tasks timing out during merge phase | Major | . | Christian Kunz | Jothi Padmanabhan |
-| [HADOOP-4713](https://issues.apache.org/jira/browse/HADOOP-4713) | librecordio does not scale to large records | Blocker | record | Christian Kunz | Christian Kunz |
+| [HADOOP-4257](https://issues.apache.org/jira/browse/HADOOP-4257) | TestLeaseRecovery2.testBlockSynchronization failing. | Blocker | test | Vinod Kumar Vavilapalli | Tsz Wo Nicholas Sze |
+| [HADOOP-4499](https://issues.apache.org/jira/browse/HADOOP-4499) | DFSClient should invoke checksumOk only once. | Blocker | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-4597](https://issues.apache.org/jira/browse/HADOOP-4597) | Under-replicated blocks are not calculated if the name-node is forced out of safe-mode. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-4610](https://issues.apache.org/jira/browse/HADOOP-4610) | Always calculate mis-replicated blocks when safe-mode is turned off. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-3121](https://issues.apache.org/jira/browse/HADOOP-3121) | dfs -lsr fail with "Could not get listing " | Minor | fs | Koji Noguchi | Tsz Wo Nicholas Sze |
+| [HADOOP-3883](https://issues.apache.org/jira/browse/HADOOP-3883) | TestFileCreation fails once in a while | Blocker | test | Lohit Vijayarenu | Tsz Wo Nicholas Sze |
+| [HADOOP-4556](https://issues.apache.org/jira/browse/HADOOP-4556) | Block went missing | Major | . | Robert Chansler | Hairong Kuang |
+| [HADOOP-4643](https://issues.apache.org/jira/browse/HADOOP-4643) | NameNode should exclude excessive replicas when counting live replicas for a block | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-4703](https://issues.apache.org/jira/browse/HADOOP-4703) | DataNode.createInterDataNodeProtocolProxy should not wait for proxy forever while recovering lease | Major | . | Hairong Kuang | Tsz Wo Nicholas Sze |
-| [HADOOP-4702](https://issues.apache.org/jira/browse/HADOOP-4702) | Failed block replication leaves an incomplete block in receiver's tmp data directory | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-4679](https://issues.apache.org/jira/browse/HADOOP-4679) | Datanode prints tons of log messages: Waiting for threadgroup to exit, active theads is XX | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-4654](https://issues.apache.org/jira/browse/HADOOP-4654) | remove temporary output directory of failed tasks | Major | . | Christian Kunz | Amareshwari Sriramadasu |
| [HADOOP-4647](https://issues.apache.org/jira/browse/HADOOP-4647) | NamenodeFsck creates a new DFSClient but never closes it | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4643](https://issues.apache.org/jira/browse/HADOOP-4643) | NameNode should exclude excessive replicas when counting live replicas for a block | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-4635](https://issues.apache.org/jira/browse/HADOOP-4635) | Memory leak ? | Blocker | . | Marc-Olivier Fleury | Pete Wyckoff |
-| [HADOOP-4620](https://issues.apache.org/jira/browse/HADOOP-4620) | Streaming mapper never completes if the mapper does not write to stdout | Major | . | Runping Qi | Ravi Gummadi |
| [HADOOP-4616](https://issues.apache.org/jira/browse/HADOOP-4616) | assertion makes fuse-dfs exit when reading incomplete data | Blocker | . | Marc-Olivier Fleury | Pete Wyckoff |
| [HADOOP-4614](https://issues.apache.org/jira/browse/HADOOP-4614) | "Too many open files" error while processing a large gzip file | Blocker | . | Abdul Qadeer | Yuri Pradkin |
-| [HADOOP-4613](https://issues.apache.org/jira/browse/HADOOP-4613) | browseBlock.jsp does not generate "genstamp" property. | Major | . | Konstantin Shvachko | Johan Oskarsson |
-| [HADOOP-4610](https://issues.apache.org/jira/browse/HADOOP-4610) | Always calculate mis-replicated blocks when safe-mode is turned off. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-4597](https://issues.apache.org/jira/browse/HADOOP-4597) | Under-replicated blocks are not calculated if the name-node is forced out of safe-mode. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-4556](https://issues.apache.org/jira/browse/HADOOP-4556) | Block went missing | Major | . | Robert Chansler | Hairong Kuang |
| [HADOOP-4542](https://issues.apache.org/jira/browse/HADOOP-4542) | Fault in TestDistributedUpgrade | Minor | test | Robert Chansler | Raghu Angadi |
-| [HADOOP-4499](https://issues.apache.org/jira/browse/HADOOP-4499) | DFSClient should invoke checksumOk only once. | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-4257](https://issues.apache.org/jira/browse/HADOOP-4257) | TestLeaseRecovery2.testBlockSynchronization failing. | Blocker | test | Vinod Kumar Vavilapalli | Tsz Wo Nicholas Sze |
-| [HADOOP-3883](https://issues.apache.org/jira/browse/HADOOP-3883) | TestFileCreation fails once in a while | Blocker | test | Lohit Vijayarenu | Tsz Wo Nicholas Sze |
-| [HADOOP-3121](https://issues.apache.org/jira/browse/HADOOP-3121) | dfs -lsr fail with "Could not get listing " | Minor | fs | Koji Noguchi | Tsz Wo Nicholas Sze |
+| [HADOOP-4713](https://issues.apache.org/jira/browse/HADOOP-4713) | librecordio does not scale to large records | Blocker | record | Christian Kunz | Christian Kunz |
+| [HADOOP-4635](https://issues.apache.org/jira/browse/HADOOP-4635) | Memory leak ? | Blocker | . | Marc-Olivier Fleury | Pete Wyckoff |
+| [HADOOP-4714](https://issues.apache.org/jira/browse/HADOOP-4714) | map tasks timing out during merge phase | Major | . | Christian Kunz | Jothi Padmanabhan |
+| [HADOOP-4726](https://issues.apache.org/jira/browse/HADOOP-4726) | documentation typos: "the the" | Minor | documentation | Tsz Wo Nicholas Sze | Edward J. Yoon |
+| [HADOOP-4679](https://issues.apache.org/jira/browse/HADOOP-4679) | Datanode prints tons of log messages: Waiting for threadgroup to exit, active theads is XX | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-4734](https://issues.apache.org/jira/browse/HADOOP-4734) | Some lease recovery codes in 0.19 or trunk should also be committed in 0.18. | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4746](https://issues.apache.org/jira/browse/HADOOP-4746) | Job output directory should be normalized | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-4654](https://issues.apache.org/jira/browse/HADOOP-4654) | remove temporary output directory of failed tasks | Major | . | Christian Kunz | Amareshwari Sriramadasu |
+| [HADOOP-4717](https://issues.apache.org/jira/browse/HADOOP-4717) | Removal of default port# in NameNode.getUri() cause a map/reduce job failed to prompt temporay output | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-4778](https://issues.apache.org/jira/browse/HADOOP-4778) | Check for zero size block meta file when updating a block. | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4742](https://issues.apache.org/jira/browse/HADOOP-4742) | Mistake delete replica in hadoop 0.18.1 | Blocker | . | Wang Xu | Wang Xu |
+| [HADOOP-4702](https://issues.apache.org/jira/browse/HADOOP-4702) | Failed block replication leaves an incomplete block in receiver's tmp data directory | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-4613](https://issues.apache.org/jira/browse/HADOOP-4613) | browseBlock.jsp does not generate "genstamp" property. | Major | . | Konstantin Shvachko | Johan Oskarsson |
+| [HADOOP-4806](https://issues.apache.org/jira/browse/HADOOP-4806) | HDFS rename does not work correctly if src contains Java regular expression special characters | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4795](https://issues.apache.org/jira/browse/HADOOP-4795) | Lease monitor may get into an infinite loop | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4822](https://issues.apache.org/jira/browse/HADOOP-4822) | 0.18 cannot be compiled in Java 5. | Blocker | util | Tsz Wo Nicholas Sze | |
+| [HADOOP-4620](https://issues.apache.org/jira/browse/HADOOP-4620) | Streaming mapper never completes if the mapper does not write to stdout | Major | . | Runping Qi | Ravi Gummadi |
+| [HADOOP-4810](https://issues.apache.org/jira/browse/HADOOP-4810) | Data lost at cluster startup time | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-4797](https://issues.apache.org/jira/browse/HADOOP-4797) | RPC Server can leave a lot of direct buffers | Blocker | ipc | Raghu Angadi | Raghu Angadi |
+| [HADOOP-4840](https://issues.apache.org/jira/browse/HADOOP-4840) | TestNodeCount sometimes fails with NullPointerException | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-4904](https://issues.apache.org/jira/browse/HADOOP-4904) | Deadlock while leaving safe mode. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-4919](https://issues.apache.org/jira/browse/HADOOP-4919) | [HOD] Provide execute access to JT history directory path for group | Major | contrib/hod | Hemanth Yamijala | Peeyush Bishnoi |
| [HADOOP-1980](https://issues.apache.org/jira/browse/HADOOP-1980) | 'dfsadmin -safemode enter' should prevent the namenode from leaving safemode automatically after startup | Minor | . | Koji Noguchi | Konstantin Shvachko |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-4924](https://issues.apache.org/jira/browse/HADOOP-4924) | Race condition in re-init of TaskTracker | Blocker | . | Devaraj Das | Devaraj Das |
+| [HADOOP-4935](https://issues.apache.org/jira/browse/HADOOP-4935) | Manual leaving of safe mode may lead to data lost | Major | . | Hairong Kuang | Konstantin Shvachko |
+| [HADOOP-4951](https://issues.apache.org/jira/browse/HADOOP-4951) | Lease monitor does not own the LeaseManager lock in changing leases. | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4961](https://issues.apache.org/jira/browse/HADOOP-4961) | ConcurrentModificationException in lease recovery of empty files. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-4971](https://issues.apache.org/jira/browse/HADOOP-4971) | Block report times from datanodes could converge to same time. | Blocker | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-4910](https://issues.apache.org/jira/browse/HADOOP-4910) | NameNode should exclude corrupt replicas when choosing excessive replicas to delete | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5077](https://issues.apache.org/jira/browse/HADOOP-5077) | JavaDoc errors in 0.18.3 | Blocker | util | Raghu Angadi | Raghu Angadi |
+| [HADOOP-4983](https://issues.apache.org/jira/browse/HADOOP-4983) | Job counters sometimes go down as tasks run without task failures | Critical | . | Owen O'Malley | Amareshwari Sriramadasu |
### SUB-TASKS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-4824](https://issues.apache.org/jira/browse/HADOOP-4824) | Should not use File.setWritable(..) in 0.18 | Major | . | Tsz Wo Nicholas Sze | Hairong Kuang |
| [HADOOP-4823](https://issues.apache.org/jira/browse/HADOOP-4823) | Should not use java.util.NavigableMap in 0.18 | Major | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4824](https://issues.apache.org/jira/browse/HADOOP-4824) | Should not use File.setWritable(..) in 0.18 | Major | . | Tsz Wo Nicholas Sze | Hairong Kuang |
### OTHER:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.3/RELEASENOTES.0.18.3.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.3/RELEASENOTES.0.18.3.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.3/RELEASENOTES.0.18.3.md
index 4dd9c06..c371afa 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.3/RELEASENOTES.0.18.3.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.3/RELEASENOTES.0.18.3.md
@@ -23,82 +23,82 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-5077](https://issues.apache.org/jira/browse/HADOOP-5077) | *Blocker* | **JavaDoc errors in 0.18.3**
+* [HADOOP-4150](https://issues.apache.org/jira/browse/HADOOP-4150) | *Blocker* | **Include librecordio as part of the release**
-Fix couple of JavaDoc warnings.
+Included librecordio in release for use by xerces-c (ant -Dlibrecordio=true -Dxercescroot=\<path to the xerces-c root\>)
---
-* [HADOOP-4997](https://issues.apache.org/jira/browse/HADOOP-4997) | *Blocker* | **workaround for tmp file handling on DataNodes in 0.18 (HADOOP-4663)**
+* [HADOOP-4061](https://issues.apache.org/jira/browse/HADOOP-4061) | *Major* | **Large number of decommission freezes the Namenode**
-Revert tmp files handling on DataNodes back to 0.17. sync() introduced in 0.18 has less gaurantees.
+Added a new conf property dfs.namenode.decommission.nodes.per.interval so that NameNode checks decommission status of x nodes for every y seconds, where x is the value of dfs.namenode.decommission.nodes.per.interval and y is the value of dfs.namenode.decommission.interval.
---
-* [HADOOP-4971](https://issues.apache.org/jira/browse/HADOOP-4971) | *Blocker* | **Block report times from datanodes could converge to same time.**
+* [HADOOP-4659](https://issues.apache.org/jira/browse/HADOOP-4659) | *Blocker* | **Root cause of connection failure is being lost to code that uses it for delaying startup**
-A long (unexpected) delay at datanodes could make subsequent block reports from many datanode at the same time.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-4797](https://issues.apache.org/jira/browse/HADOOP-4797) | *Blocker* | **RPC Server can leave a lot of direct buffers**
+* [HADOOP-4542](https://issues.apache.org/jira/browse/HADOOP-4542) | *Minor* | **Fault in TestDistributedUpgrade**
-Improve how RPC server reads and writes large buffers. Avoids soft-leak of direct buffers and excess copies in NIO layer.
+TestDistributedUpgrade used succeed for wrong reasons.
---
-* [HADOOP-4679](https://issues.apache.org/jira/browse/HADOOP-4679) | *Major* | **Datanode prints tons of log messages: Waiting for threadgroup to exit, active theads is XX**
+* [HADOOP-4635](https://issues.apache.org/jira/browse/HADOOP-4635) | *Blocker* | **Memory leak ?**
-1. Only datanode's offerService thread shutdown the datanode to avoid deadlock;
-2. Datanode checks disk in case of failure on creating a block file.
+fix memory leak of user/group information in fuse-dfs
---
-* [HADOOP-4659](https://issues.apache.org/jira/browse/HADOOP-4659) | *Blocker* | **Root cause of connection failure is being lost to code that uses it for delaying startup**
+* [HADOOP-4679](https://issues.apache.org/jira/browse/HADOOP-4679) | *Major* | **Datanode prints tons of log messages: Waiting for threadgroup to exit, active theads is XX**
-**WARNING: No release note provided for this incompatible change.**
+1. Only datanode's offerService thread shutdown the datanode to avoid deadlock;
+2. Datanode checks disk in case of failure on creating a block file.
---
-* [HADOOP-4635](https://issues.apache.org/jira/browse/HADOOP-4635) | *Blocker* | **Memory leak ?**
+* [HADOOP-4620](https://issues.apache.org/jira/browse/HADOOP-4620) | *Major* | **Streaming mapper never completes if the mapper does not write to stdout**
-fix memory leak of user/group information in fuse-dfs
+This patch HADOOP-4620.patch
+(1) solves the hanging problem on map side with empty input and nonempty output — this map task generates output properly to intermediate files similar to other map tasks.
+(2) solves the problem of hanging reducer with empty input to reduce task and nonempty output — this reduce task doesn't generate output if input to reduce task is empty.
---
-* [HADOOP-4620](https://issues.apache.org/jira/browse/HADOOP-4620) | *Major* | **Streaming mapper never completes if the mapper does not write to stdout**
+* [HADOOP-4797](https://issues.apache.org/jira/browse/HADOOP-4797) | *Blocker* | **RPC Server can leave a lot of direct buffers**
-This patch HADOOP-4620.patch
-(1) solves the hanging problem on map side with empty input and nonempty output — this map task generates output properly to intermediate files similar to other map tasks.
-(2) solves the problem of hanging reducer with empty input to reduce task and nonempty output — this reduce task doesn't generate output if input to reduce task is empty.
+Improve how RPC server reads and writes large buffers. Avoids soft-leak of direct buffers and excess copies in NIO layer.
---
-* [HADOOP-4542](https://issues.apache.org/jira/browse/HADOOP-4542) | *Minor* | **Fault in TestDistributedUpgrade**
+* [HADOOP-4971](https://issues.apache.org/jira/browse/HADOOP-4971) | *Blocker* | **Block report times from datanodes could converge to same time.**
-TestDistributedUpgrade used succeed for wrong reasons.
+A long (unexpected) delay at datanodes could make subsequent block reports from many datanode at the same time.
---
-* [HADOOP-4150](https://issues.apache.org/jira/browse/HADOOP-4150) | *Blocker* | **Include librecordio as part of the release**
+* [HADOOP-4997](https://issues.apache.org/jira/browse/HADOOP-4997) | *Blocker* | **workaround for tmp file handling on DataNodes in 0.18 (HADOOP-4663)**
-Included librecordio in release for use by xerces-c (ant -Dlibrecordio=true -Dxercescroot=\<path to the xerces-c root\>)
+Revert tmp files handling on DataNodes back to 0.17. sync() introduced in 0.18 has less gaurantees.
---
-* [HADOOP-4061](https://issues.apache.org/jira/browse/HADOOP-4061) | *Major* | **Large number of decommission freezes the Namenode**
+* [HADOOP-5077](https://issues.apache.org/jira/browse/HADOOP-5077) | *Blocker* | **JavaDoc errors in 0.18.3**
-Added a new conf property dfs.namenode.decommission.nodes.per.interval so that NameNode checks decommission status of x nodes for every y seconds, where x is the value of dfs.namenode.decommission.nodes.per.interval and y is the value of dfs.namenode.decommission.interval.
+Fix couple of JavaDoc warnings.
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[17/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.0/RELEASENOTES.1.2.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.0/RELEASENOTES.1.2.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.0/RELEASENOTES.1.2.0.md
index 3fa573c..e7aad10 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.0/RELEASENOTES.1.2.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.0/RELEASENOTES.1.2.0.md
@@ -23,154 +23,154 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-8971](https://issues.apache.org/jira/browse/HADOOP-8971) | *Major* | **Backport: hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data (HADOOP-8926)**
+* [HDFS-385](https://issues.apache.org/jira/browse/HDFS-385) | *Major* | **Design a pluggable interface to place replicas of blocks in HDFS**
-Backport cache-aware improvements for PureJavaCrc32 from trunk (HADOOP-8926)
+New experimental API BlockPlacementPolicy allows investigating alternate rules for locating block replicas.
---
-* [HADOOP-8817](https://issues.apache.org/jira/browse/HADOOP-8817) | *Major* | **Backport Network Topology Extension for Virtualization (HADOOP-8468) to branch-1**
+* [HADOOP-8164](https://issues.apache.org/jira/browse/HADOOP-8164) | *Major* | **Handle paths using back slash as path separator for windows only**
-A new 4-layer network topology NetworkToplogyWithNodeGroup is available to make Hadoop more robust and efficient in virtualized environment.
+This jira only allows providing paths using back slash as separator on Windows. The back slash on \*nix system will be used as escape character. The support for paths using back slash as path separator will be removed in HADOOP-8139 in release 23.3.
---
-* [HADOOP-8470](https://issues.apache.org/jira/browse/HADOOP-8470) | *Major* | **Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWithNodeGroup)**
+* [MAPREDUCE-4415](https://issues.apache.org/jira/browse/MAPREDUCE-4415) | *Major* | **Backport the Job.getInstance methods from MAPREDUCE-1505 to branch-1**
-This patch should be checked in together (or after) with JIRA Hadoop-8469: https://issues.apache.org/jira/browse/HADOOP-8469
+Backported new APIs to get a Job object to 1.2.0 from 2.0.0. Job API static methods Job.getInstance(), Job.getInstance(Configuration) and Job.getInstance(Configuration, jobName) are now available across both releases to avoid porting pain.
---
-* [HADOOP-8164](https://issues.apache.org/jira/browse/HADOOP-8164) | *Major* | **Handle paths using back slash as path separator for windows only**
+* [HDFS-3697](https://issues.apache.org/jira/browse/HDFS-3697) | *Minor* | **Enable fadvise readahead by default**
-This jira only allows providing paths using back slash as separator on Windows. The back slash on \*nix system will be used as escape character. The support for paths using back slash as path separator will be removed in HADOOP-8139 in release 23.3.
+The datanode now performs 4MB readahead by default when reading data from its disks, if the native libraries are present. This has been shown to improve performance in many workloads. The feature may be disabled by setting dfs.datanode.readahead.bytes to "0".
---
-* [HADOOP-7698](https://issues.apache.org/jira/browse/HADOOP-7698) | *Critical* | **jsvc target fails on x86\_64**
+* [MAPREDUCE-4565](https://issues.apache.org/jira/browse/MAPREDUCE-4565) | *Major* | **Backport MR-2855 to branch-1: ResourceBundle lookup during counter name resolution takes a lot of time**
-The jsvc build target is now supported for Mac OSX and other platforms as well.
+Passing a cached class-loader to ResourceBundle creator to minimize counter names lookup time.
---
-* [HDFS-4519](https://issues.apache.org/jira/browse/HDFS-4519) | *Major* | **Support override of jsvc binary and log file locations when launching secure datanode.**
-
-With this improvement the following options are available in release 1.2.0 and later on 1.x release stream:
-1. jsvc location can be overridden by setting environment variable JSVC\_HOME. Defaults to jsvc binary packaged within the Hadoop distro.
-2. jsvc log output is directed to the file defined by JSVC\_OUTFILE. Defaults to $HADOOP\_LOG\_DIR/jsvc.out.
-3. jsvc error output is directed to the file defined by JSVC\_ERRFILE file. Defaults to $HADOOP\_LOG\_DIR/jsvc.err.
-
-With this improvement the following options are available in release 2.0.4 and later on 2.x release stream:
-1. jsvc log output is directed to the file defined by JSVC\_OUTFILE. Defaults to $HADOOP\_LOG\_DIR/jsvc.out.
-2. jsvc error output is directed to the file defined by JSVC\_ERRFILE file. Defaults to $HADOOP\_LOG\_DIR/jsvc.err.
+* [MAPREDUCE-4629](https://issues.apache.org/jira/browse/MAPREDUCE-4629) | *Major* | **Remove JobHistory.DEBUG\_MODE**
-For overriding jsvc location on 2.x releases, here is the release notes from HDFS-2303:
-To run secure Datanodes users must install jsvc for their platform and set JSVC\_HOME to point to the location of jsvc in their environment.
+**WARNING: No release note provided for this change.**
---
-* [HDFS-4350](https://issues.apache.org/jira/browse/HDFS-4350) | *Major* | **Make enabling of stale marking on read and write paths independent**
-
-This patch makes an incompatible configuration change, as described below:
-In releases 1.1.0 and other point releases 1.1.x, the configuration parameter "dfs.namenode.check.stale.datanode" could be used to turn on checking for the stale nodes. This configuration is no longer supported in release 1.2.0 onwards and is renamed as "dfs.namenode.avoid.read.stale.datanode".
+* [HADOOP-7698](https://issues.apache.org/jira/browse/HADOOP-7698) | *Critical* | **jsvc target fails on x86\_64**
-How feature works and configuring this feature:
-As described in HDFS-3703 release notes, datanode stale period can be configured using parameter "dfs.namenode.stale.datanode.interval" in seconds (default value is 30 seconds). NameNode can be configured to use this staleness information for reads using configuration "dfs.namenode.avoid.read.stale.datanode". When this parameter is set to true, namenode picks a stale datanode as the last target to read from when returning block locations for reads. Using staleness information for writes is as described in the releases notes of HDFS-3912.
+The jsvc build target is now supported for Mac OSX and other platforms as well.
---
-* [HDFS-4337](https://issues.apache.org/jira/browse/HDFS-4337) | *Major* | **Backport HDFS-4240 to branch-1: Make sure nodes are avoided to place replica if some replica are already under the same nodegroup.**
+* [MAPREDUCE-3678](https://issues.apache.org/jira/browse/MAPREDUCE-3678) | *Major* | **The Map tasks logs should have the value of input split it processed**
-Backport HDFS-4240 to branch-1
+A map-task's syslogs now carries basic info on the InputSplit it processed.
---
-* [HDFS-4320](https://issues.apache.org/jira/browse/HDFS-4320) | *Major* | **Add a separate configuration for namenode rpc address instead of only using fs.default.name**
-
-The namenode RPC address is currently identified from configuration "fs.default.name". In some setups where default FS is other than HDFS, the "fs.default.name" cannot be used to get the namenode address. When such a setup co-exists with HDFS, with this change namenode can be identified using a separate configuration parameter "dfs.namenode.rpc-address".
+* [MAPREDUCE-4451](https://issues.apache.org/jira/browse/MAPREDUCE-4451) | *Major* | **fairscheduler fail to init job with kerberos authentication configured**
-"dfs.namenode.rpc-address", when configured, overrides fs.default.name for identifying namenode RPC address.
+Using FairScheduler with security configured, job initialization fails. The problem is that threads in JobInitializer runs as RPC user instead of jobtracker, pre-start all the threads fix this bug
---
-* [HDFS-4122](https://issues.apache.org/jira/browse/HDFS-4122) | *Major* | **Cleanup HDFS logs and reduce the size of logged messages**
+* [HDFS-4071](https://issues.apache.org/jira/browse/HDFS-4071) | *Minor* | **Add number of stale DataNodes to metrics for Branch-1**
-The change from this jira changes the content of some of the log messages. No log message are removed. Only the content of the log messages is changed to reduce the size. If you have a tool that depends on the exact content of the log, please look at the patch and make appropriate updates to the tool.
+This jira adds a new metric with name "StaleDataNodes" under metrics context "dfs" of type Gauge. This tracks the number of DataNodes marked as stale. A DataNode is marked stale when the heartbeat message from the DataNode is not received within the configured time ""dfs.namenode.stale.datanode.interval".
----
+Please see hdfs-default.xml documentation corresponding to "dfs.namenode.stale.datanode.interval" for more details on how to configure this feature. When this feature is not configured, this metrics would return zero.
-* [HDFS-4071](https://issues.apache.org/jira/browse/HDFS-4071) | *Minor* | **Add number of stale DataNodes to metrics for Branch-1**
-This jira adds a new metric with name "StaleDataNodes" under metrics context "dfs" of type Gauge. This tracks the number of DataNodes marked as stale. A DataNode is marked stale when the heartbeat message from the DataNode is not received within the configured time ""dfs.namenode.stale.datanode.interval".
+---
+* [HADOOP-8971](https://issues.apache.org/jira/browse/HADOOP-8971) | *Major* | **Backport: hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data (HADOOP-8926)**
-Please see hdfs-default.xml documentation corresponding to "dfs.namenode.stale.datanode.interval" for more details on how to configure this feature. When this feature is not configured, this metrics would return zero.
+Backport cache-aware improvements for PureJavaCrc32 from trunk (HADOOP-8926)
---
-* [HDFS-3697](https://issues.apache.org/jira/browse/HDFS-3697) | *Minor* | **Enable fadvise readahead by default**
+* [HDFS-4122](https://issues.apache.org/jira/browse/HDFS-4122) | *Major* | **Cleanup HDFS logs and reduce the size of logged messages**
-The datanode now performs 4MB readahead by default when reading data from its disks, if the native libraries are present. This has been shown to improve performance in many workloads. The feature may be disabled by setting dfs.datanode.readahead.bytes to "0".
+The change from this jira changes the content of some of the log messages. No log message are removed. Only the content of the log messages is changed to reduce the size. If you have a tool that depends on the exact content of the log, please look at the patch and make appropriate updates to the tool.
---
-* [HDFS-385](https://issues.apache.org/jira/browse/HDFS-385) | *Major* | **Design a pluggable interface to place replicas of blocks in HDFS**
+* [HDFS-4320](https://issues.apache.org/jira/browse/HDFS-4320) | *Major* | **Add a separate configuration for namenode rpc address instead of only using fs.default.name**
-New experimental API BlockPlacementPolicy allows investigating alternate rules for locating block replicas.
+The namenode RPC address is currently identified from configuration "fs.default.name". In some setups where default FS is other than HDFS, the "fs.default.name" cannot be used to get the namenode address. When such a setup co-exists with HDFS, with this change namenode can be identified using a separate configuration parameter "dfs.namenode.rpc-address".
+
+"dfs.namenode.rpc-address", when configured, overrides fs.default.name for identifying namenode RPC address.
---
-* [MAPREDUCE-4737](https://issues.apache.org/jira/browse/MAPREDUCE-4737) | *Major* | ** Hadoop does not close output file / does not call Mapper.cleanup if exception in map**
+* [HDFS-4337](https://issues.apache.org/jira/browse/HDFS-4337) | *Major* | **Backport HDFS-4240 to branch-1: Make sure nodes are avoided to place replica if some replica are already under the same nodegroup.**
-Ensure that mapreduce APIs are semantically consistent with mapred API w.r.t Mapper.cleanup and Reducer.cleanup; in the sense that cleanup is now called even if there is an error. The old mapred API already ensures that Mapper.close and Reducer.close are invoked during error handling. Note that it is an incompatible change, however end-users can override Mapper.run and Reducer.run to get the old (inconsistent) behaviour.
+Backport HDFS-4240 to branch-1
---
-* [MAPREDUCE-4629](https://issues.apache.org/jira/browse/MAPREDUCE-4629) | *Major* | **Remove JobHistory.DEBUG\_MODE**
+* [HDFS-4350](https://issues.apache.org/jira/browse/HDFS-4350) | *Major* | **Make enabling of stale marking on read and write paths independent**
+
+This patch makes an incompatible configuration change, as described below:
+In releases 1.1.0 and other point releases 1.1.x, the configuration parameter "dfs.namenode.check.stale.datanode" could be used to turn on checking for the stale nodes. This configuration is no longer supported in release 1.2.0 onwards and is renamed as "dfs.namenode.avoid.read.stale.datanode".
-**WARNING: No release note provided for this incompatible change.**
+How feature works and configuring this feature:
+As described in HDFS-3703 release notes, datanode stale period can be configured using parameter "dfs.namenode.stale.datanode.interval" in seconds (default value is 30 seconds). NameNode can be configured to use this staleness information for reads using configuration "dfs.namenode.avoid.read.stale.datanode". When this parameter is set to true, namenode picks a stale datanode as the last target to read from when returning block locations for reads. Using staleness information for writes is as described in the releases notes of HDFS-3912.
---
-* [MAPREDUCE-4565](https://issues.apache.org/jira/browse/MAPREDUCE-4565) | *Major* | **Backport MR-2855 to branch-1: ResourceBundle lookup during counter name resolution takes a lot of time**
+* [HDFS-4519](https://issues.apache.org/jira/browse/HDFS-4519) | *Major* | **Support override of jsvc binary and log file locations when launching secure datanode.**
-Passing a cached class-loader to ResourceBundle creator to minimize counter names lookup time.
+With this improvement the following options are available in release 1.2.0 and later on 1.x release stream:
+1. jsvc location can be overridden by setting environment variable JSVC\_HOME. Defaults to jsvc binary packaged within the Hadoop distro.
+2. jsvc log output is directed to the file defined by JSVC\_OUTFILE. Defaults to $HADOOP\_LOG\_DIR/jsvc.out.
+3. jsvc error output is directed to the file defined by JSVC\_ERRFILE file. Defaults to $HADOOP\_LOG\_DIR/jsvc.err.
+
+With this improvement the following options are available in release 2.0.4 and later on 2.x release stream:
+1. jsvc log output is directed to the file defined by JSVC\_OUTFILE. Defaults to $HADOOP\_LOG\_DIR/jsvc.out.
+2. jsvc error output is directed to the file defined by JSVC\_ERRFILE file. Defaults to $HADOOP\_LOG\_DIR/jsvc.err.
+
+For overriding jsvc location on 2.x releases, here is the release notes from HDFS-2303:
+To run secure Datanodes users must install jsvc for their platform and set JSVC\_HOME to point to the location of jsvc in their environment.
---
-* [MAPREDUCE-4451](https://issues.apache.org/jira/browse/MAPREDUCE-4451) | *Major* | **fairscheduler fail to init job with kerberos authentication configured**
+* [HADOOP-8817](https://issues.apache.org/jira/browse/HADOOP-8817) | *Major* | **Backport Network Topology Extension for Virtualization (HADOOP-8468) to branch-1**
-Using FairScheduler with security configured, job initialization fails. The problem is that threads in JobInitializer runs as RPC user instead of jobtracker, pre-start all the threads fix this bug
+A new 4-layer network topology NetworkToplogyWithNodeGroup is available to make Hadoop more robust and efficient in virtualized environment.
---
-* [MAPREDUCE-4415](https://issues.apache.org/jira/browse/MAPREDUCE-4415) | *Major* | **Backport the Job.getInstance methods from MAPREDUCE-1505 to branch-1**
+* [MAPREDUCE-4737](https://issues.apache.org/jira/browse/MAPREDUCE-4737) | *Major* | ** Hadoop does not close output file / does not call Mapper.cleanup if exception in map**
-Backported new APIs to get a Job object to 1.2.0 from 2.0.0. Job API static methods Job.getInstance(), Job.getInstance(Configuration) and Job.getInstance(Configuration, jobName) are now available across both releases to avoid porting pain.
+Ensure that mapreduce APIs are semantically consistent with mapred API w.r.t Mapper.cleanup and Reducer.cleanup; in the sense that cleanup is now called even if there is an error. The old mapred API already ensures that Mapper.close and Reducer.close are invoked during error handling. Note that it is an incompatible change, however end-users can override Mapper.run and Reducer.run to get the old (inconsistent) behaviour.
---
-* [MAPREDUCE-3678](https://issues.apache.org/jira/browse/MAPREDUCE-3678) | *Major* | **The Map tasks logs should have the value of input split it processed**
+* [HADOOP-8470](https://issues.apache.org/jira/browse/HADOOP-8470) | *Major* | **Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWithNodeGroup)**
-A map-task's syslogs now carries basic info on the InputSplit it processed.
+This patch should be checked in together (or after) with JIRA Hadoop-8469: https://issues.apache.org/jira/browse/HADOOP-8469
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.1/CHANGES.1.2.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.1/CHANGES.1.2.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.1/CHANGES.1.2.1.md
index 603e235..7a58c16 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.1/CHANGES.1.2.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.1/CHANGES.1.2.1.md
@@ -20,65 +20,37 @@
## Release 1.2.1 - 2013-08-01
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [MAPREDUCE-5368](https://issues.apache.org/jira/browse/MAPREDUCE-5368) | Save memory by set capacity, load factor and concurrency level for ConcurrentHashMap in TaskInProgress | Major | mrv1 | zhaoyunjiong | zhaoyunjiong |
| [MAPREDUCE-4838](https://issues.apache.org/jira/browse/MAPREDUCE-4838) | Add extra info to JH files | Major | . | Arun C Murthy | Zhijie Shen |
+| [MAPREDUCE-5368](https://issues.apache.org/jira/browse/MAPREDUCE-5368) | Save memory by set capacity, load factor and concurrency level for ConcurrentHashMap in TaskInProgress | Major | mrv1 | yunjiong zhao | yunjiong zhao |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9730](https://issues.apache.org/jira/browse/HADOOP-9730) | fix hadoop.spec to add task-log4j.properties | Major | build | Giridharan Kesavan | Giridharan Kesavan |
-| [HADOOP-9665](https://issues.apache.org/jira/browse/HADOOP-9665) | BlockDecompressorStream#decompress will throw EOFException instead of return -1 when EOF | Critical | . | Zhijie Shen | Zhijie Shen |
-| [HADOOP-9504](https://issues.apache.org/jira/browse/HADOOP-9504) | MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo | Critical | metrics | Liang Xie | Liang Xie |
-| [HDFS-4880](https://issues.apache.org/jira/browse/HDFS-4880) | Diagnostic logging while loading name/edits files | Major | namenode | Arpit Agarwal | Suresh Srinivas |
-| [HDFS-4699](https://issues.apache.org/jira/browse/HDFS-4699) | TestPipelinesFailover#testPipelineRecoveryStress fails sporadically | Major | test | Chris Nauroth | Chris Nauroth |
| [HDFS-4581](https://issues.apache.org/jira/browse/HDFS-4581) | DataNode#checkDiskError should not be called on network errors | Major | datanode | Rohit Kochar | Rohit Kochar |
+| [HDFS-4699](https://issues.apache.org/jira/browse/HDFS-4699) | TestPipelinesFailover#testPipelineRecoveryStress fails sporadically | Major | test | Chris Nauroth | Chris Nauroth |
+| [MAPREDUCE-5206](https://issues.apache.org/jira/browse/MAPREDUCE-5206) | JT can show the same job multiple times in Retired Jobs section | Minor | . | Arun C Murthy | Arun C Murthy |
+| [MAPREDUCE-5148](https://issues.apache.org/jira/browse/MAPREDUCE-5148) | Syslog missing from Map/Reduce tasks | Major | tasktracker | Yesha Vora | Arun C Murthy |
+| [MAPREDUCE-3859](https://issues.apache.org/jira/browse/MAPREDUCE-3859) | CapacityScheduler incorrectly utilizes extra-resources of queue for high-memory jobs | Major | capacity-sched | Sergey Tryuber | Sergey Tryuber |
| [HDFS-4261](https://issues.apache.org/jira/browse/HDFS-4261) | TestBalancerWithNodeGroup times out | Major | balancer & mover | Tsz Wo Nicholas Sze | Junping Du |
-| [MAPREDUCE-5375](https://issues.apache.org/jira/browse/MAPREDUCE-5375) | Delegation Token renewal exception in jobtracker logs | Critical | . | Venkat Ranganathan | Venkat Ranganathan |
-| [MAPREDUCE-5364](https://issues.apache.org/jira/browse/MAPREDUCE-5364) | Deadlock between RenewalTimerTask methods cancel() and run() | Major | . | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-5351](https://issues.apache.org/jira/browse/MAPREDUCE-5351) | JobTracker memory leak caused by CleanupQueue reopening FileSystem | Critical | jobtracker | Sandy Ryza | Sandy Ryza |
+| [HDFS-4880](https://issues.apache.org/jira/browse/HDFS-4880) | Diagnostic logging while loading name/edits files | Major | namenode | Arpit Agarwal | Suresh Srinivas |
+| [MAPREDUCE-5260](https://issues.apache.org/jira/browse/MAPREDUCE-5260) | Job failed because of JvmManager running into inconsistent state | Major | tasktracker | yunjiong zhao | yunjiong zhao |
| [MAPREDUCE-5318](https://issues.apache.org/jira/browse/MAPREDUCE-5318) | Ampersand in JSPUtil.java is not escaped | Minor | jobtracker | Bohou Li | Bohou Li |
-| [MAPREDUCE-5260](https://issues.apache.org/jira/browse/MAPREDUCE-5260) | Job failed because of JvmManager running into inconsistent state | Major | tasktracker | zhaoyunjiong | zhaoyunjiong |
+| [HADOOP-9665](https://issues.apache.org/jira/browse/HADOOP-9665) | BlockDecompressorStream#decompress will throw EOFException instead of return -1 when EOF | Critical | . | Zhijie Shen | Zhijie Shen |
+| [MAPREDUCE-5375](https://issues.apache.org/jira/browse/MAPREDUCE-5375) | Delegation Token renewal exception in jobtracker logs | Critical | . | Venkat Ranganathan | Venkat Ranganathan |
+| [HADOOP-9504](https://issues.apache.org/jira/browse/HADOOP-9504) | MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo | Critical | metrics | Liang Xie | Liang Xie |
| [MAPREDUCE-5256](https://issues.apache.org/jira/browse/MAPREDUCE-5256) | CombineInputFormat isn't thread safe affecting HiveServer | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-5206](https://issues.apache.org/jira/browse/MAPREDUCE-5206) | JT can show the same job multiple times in Retired Jobs section | Minor | . | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-5148](https://issues.apache.org/jira/browse/MAPREDUCE-5148) | Syslog missing from Map/Reduce tasks | Major | tasktracker | Yesha Vora | Arun C Murthy |
+| [MAPREDUCE-5351](https://issues.apache.org/jira/browse/MAPREDUCE-5351) | JobTracker memory leak caused by CleanupQueue reopening FileSystem | Critical | jobtracker | Sandy Ryza | Sandy Ryza |
+| [MAPREDUCE-5364](https://issues.apache.org/jira/browse/MAPREDUCE-5364) | Deadlock between RenewalTimerTask methods cancel() and run() | Major | . | Karthik Kambatla | Karthik Kambatla |
+| [HADOOP-9730](https://issues.apache.org/jira/browse/HADOOP-9730) | fix hadoop.spec to add task-log4j.properties | Major | build | Giridharan Kesavan | Giridharan Kesavan |
| [MAPREDUCE-4490](https://issues.apache.org/jira/browse/MAPREDUCE-4490) | JVM reuse is incompatible with LinuxTaskController (and therefore incompatible with Security) | Critical | task-controller, tasktracker | George Datskos | sam liu |
-| [MAPREDUCE-3859](https://issues.apache.org/jira/browse/MAPREDUCE-3859) | CapacityScheduler incorrectly utilizes extra-resources of queue for high-memory jobs | Major | capacity-sched | Sergey Tryuber | Sergey Tryuber |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### OTHER:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.1/RELEASENOTES.1.2.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.1/RELEASENOTES.1.2.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.1/RELEASENOTES.1.2.1.md
index 162d153..4fc7ddb 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.1/RELEASENOTES.1.2.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.1/RELEASENOTES.1.2.1.md
@@ -23,16 +23,16 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-10371](https://issues.apache.org/jira/browse/HADOOP-10371) | *Minor* | **The eclipse-plugin cannot work in my environment**
+* [MAPREDUCE-3859](https://issues.apache.org/jira/browse/MAPREDUCE-3859) | *Major* | **CapacityScheduler incorrectly utilizes extra-resources of queue for high-memory jobs**
-fixed
+Fixed wrong CapacityScheduler resource allocation for high memory consumption jobs
---
-* [MAPREDUCE-3859](https://issues.apache.org/jira/browse/MAPREDUCE-3859) | *Major* | **CapacityScheduler incorrectly utilizes extra-resources of queue for high-memory jobs**
+* [HADOOP-10371](https://issues.apache.org/jira/browse/HADOOP-10371) | *Minor* | **The eclipse-plugin cannot work in my environment**
-Fixed wrong CapacityScheduler resource allocation for high memory consumption jobs
+fixed
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.2/CHANGES.1.2.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.2/CHANGES.1.2.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.2/CHANGES.1.2.2.md
index 08cf273..cd67c45 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.2/CHANGES.1.2.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.2/CHANGES.1.2.2.md
@@ -18,55 +18,15 @@
-->
# Apache Hadoop Changelog
-## Release 1.2.2 - Unreleased (as of 2016-03-04)
+## Release 1.2.2 - Unreleased (as of 2017-08-28)
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [MAPREDUCE-6009](https://issues.apache.org/jira/browse/MAPREDUCE-6009) | Map-only job with new-api runs wrong OutputCommitter when cleanup scheduled in a reduce slot | Blocker | client, job submission | Gera Shegalov | Gera Shegalov |
| [MAPREDUCE-5450](https://issues.apache.org/jira/browse/MAPREDUCE-5450) | Unnecessary Configuration instantiation in IFileInputStream slows down merge - Port to branch-1 | Blocker | mrv1 | Stanislav Barton | Stanislav Barton |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [MAPREDUCE-6009](https://issues.apache.org/jira/browse/MAPREDUCE-6009) | Map-only job with new-api runs wrong OutputCommitter when cleanup scheduled in a reduce slot | Blocker | client, job submission | Gera Shegalov | Gera Shegalov |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.3.0/CHANGES.1.3.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.3.0/CHANGES.1.3.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.3.0/CHANGES.1.3.0.md
index 1a12646..f63021f 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.3.0/CHANGES.1.3.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.3.0/CHANGES.1.3.0.md
@@ -18,7 +18,7 @@
-->
# Apache Hadoop Changelog
-## Release 1.3.0 - Unreleased (as of 2016-03-04)
+## Release 1.3.0 - Unreleased (as of 2017-08-28)
### INCOMPATIBLE CHANGES:
@@ -27,111 +27,99 @@
| [MAPREDUCE-5777](https://issues.apache.org/jira/browse/MAPREDUCE-5777) | Support utf-8 text with BOM (byte order marker) | Major | . | bc Wong | zhihai xu |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10614](https://issues.apache.org/jira/browse/HADOOP-10614) | CBZip2InputStream is not threadsafe | Major | . | Xiangrui Meng | Xiangrui Meng |
-| [HADOOP-9855](https://issues.apache.org/jira/browse/HADOOP-9855) | Backport HADOOP-6578 to branch-1 | Major | . | James Kinley | James Kinley |
+| [MAPREDUCE-2351](https://issues.apache.org/jira/browse/MAPREDUCE-2351) | mapred.job.tracker.history.completed.location should support an arbitrary filesystem URI | Major | . | Tom White | Tom White |
| [HADOOP-9450](https://issues.apache.org/jira/browse/HADOOP-9450) | HADOOP\_USER\_CLASSPATH\_FIRST is not honored; CLASSPATH is PREpended instead of APpended | Major | scripts | Mitch Wyle | Harsh J |
-| [HADOOP-8873](https://issues.apache.org/jira/browse/HADOOP-8873) | Port HADOOP-8175 (Add mkdir -p flag) to branch-1 | Major | . | Eli Collins | Akira AJISAKA |
-| [HDFS-7312](https://issues.apache.org/jira/browse/HDFS-7312) | Update DistCp v1 to optionally not use tmp location (branch-1 only) | Minor | tools | Joseph Prosser | Joseph Prosser |
-| [HDFS-5367](https://issues.apache.org/jira/browse/HDFS-5367) | Restoring namenode storage locks namenode due to unnecessary fsimage write | Major | . | zhaoyunjiong | zhaoyunjiong |
-| [HDFS-5038](https://issues.apache.org/jira/browse/HDFS-5038) | Backport several branch-2 APIs to branch-1 | Minor | . | Jing Zhao | Jing Zhao |
-| [HDFS-4963](https://issues.apache.org/jira/browse/HDFS-4963) | Improve multihoming support in namenode | Major | namenode | Arpit Agarwal | Arpit Agarwal |
+| [HDFS-4521](https://issues.apache.org/jira/browse/HDFS-4521) | invalid network topologies should not be cached | Minor | . | Colin P. McCabe | Colin P. McCabe |
+| [HADOOP-8873](https://issues.apache.org/jira/browse/HADOOP-8873) | Port HADOOP-8175 (Add mkdir -p flag) to branch-1 | Major | . | Eli Collins | Akira Ajisaka |
| [HDFS-4903](https://issues.apache.org/jira/browse/HDFS-4903) | Print trash configuration and trash emptier state in namenode log | Minor | namenode | Suresh Srinivas | Arpit Agarwal |
-| [HDFS-4521](https://issues.apache.org/jira/browse/HDFS-4521) | invalid network topologies should not be cached | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [MAPREDUCE-6088](https://issues.apache.org/jira/browse/MAPREDUCE-6088) | TestTokenCache tests should use their own JobConf instances | Major | mrv1, test | zhihai xu | zhihai xu |
-| [MAPREDUCE-5712](https://issues.apache.org/jira/browse/MAPREDUCE-5712) | Backport Fair Scheduler pool placement by secondary group | Major | scheduler | Ted Malaska | Ted Malaska |
-| [MAPREDUCE-5651](https://issues.apache.org/jira/browse/MAPREDUCE-5651) | Backport Fair Scheduler queue placement policies to branch-1 | Major | scheduler | Sandy Ryza | Ted Malaska |
-| [MAPREDUCE-5609](https://issues.apache.org/jira/browse/MAPREDUCE-5609) | Add debug log message when sending job end notification | Major | . | Robert Kanter | Robert Kanter |
-| [MAPREDUCE-5457](https://issues.apache.org/jira/browse/MAPREDUCE-5457) | Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators | Major | . | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5408](https://issues.apache.org/jira/browse/MAPREDUCE-5408) | CLONE - The logging level of the tasks should be configurable by the job | Major | . | Owen O'Malley | Arun C Murthy |
| [MAPREDUCE-5406](https://issues.apache.org/jira/browse/MAPREDUCE-5406) | Improve logging around Task Tracker exiting with JVM manager inconsistent state | Major | tasktracker | Chelsey Chang | Chelsey Chang |
+| [MAPREDUCE-5408](https://issues.apache.org/jira/browse/MAPREDUCE-5408) | CLONE - The logging level of the tasks should be configurable by the job | Major | . | Owen O'Malley | Arun C Murthy |
| [MAPREDUCE-5367](https://issues.apache.org/jira/browse/MAPREDUCE-5367) | Local jobs all use same local working directory | Major | . | Sandy Ryza | Sandy Ryza |
+| [HDFS-4963](https://issues.apache.org/jira/browse/HDFS-4963) | Improve multihoming support in namenode | Major | namenode | Arpit Agarwal | Arpit Agarwal |
+| [HADOOP-9855](https://issues.apache.org/jira/browse/HADOOP-9855) | Backport HADOOP-6578 to branch-1 | Major | . | James Kinley | James Kinley |
+| [HDFS-5038](https://issues.apache.org/jira/browse/HDFS-5038) | Backport several branch-2 APIs to branch-1 | Minor | . | Jing Zhao | Jing Zhao |
+| [HDFS-5367](https://issues.apache.org/jira/browse/HDFS-5367) | Restoring namenode storage locks namenode due to unnecessary fsimage write | Major | . | yunjiong zhao | yunjiong zhao |
+| [MAPREDUCE-5457](https://issues.apache.org/jira/browse/MAPREDUCE-5457) | Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators | Major | . | Sandy Ryza | Sandy Ryza |
+| [MAPREDUCE-5609](https://issues.apache.org/jira/browse/MAPREDUCE-5609) | Add debug log message when sending job end notification | Major | . | Robert Kanter | Robert Kanter |
| [MAPREDUCE-3310](https://issues.apache.org/jira/browse/MAPREDUCE-3310) | Custom grouping comparator cannot be set for Combiners | Major | client | Mathias Herberts | Alejandro Abdelnur |
-| [MAPREDUCE-2351](https://issues.apache.org/jira/browse/MAPREDUCE-2351) | mapred.job.tracker.history.completed.location should support an arbitrary filesystem URI | Major | . | Tom White | Tom White |
+| [MAPREDUCE-5651](https://issues.apache.org/jira/browse/MAPREDUCE-5651) | Backport Fair Scheduler queue placement policies to branch-1 | Major | scheduler | Sandy Ryza | Ted Malaska |
+| [MAPREDUCE-5712](https://issues.apache.org/jira/browse/MAPREDUCE-5712) | Backport Fair Scheduler pool placement by secondary group | Major | scheduler | Theodore michael Malaska | Theodore michael Malaska |
+| [HADOOP-10614](https://issues.apache.org/jira/browse/HADOOP-10614) | CBZip2InputStream is not threadsafe | Major | . | Xiangrui Meng | Xiangrui Meng |
+| [MAPREDUCE-6088](https://issues.apache.org/jira/browse/MAPREDUCE-6088) | TestTokenCache tests should use their own JobConf instances | Major | mrv1, test | zhihai xu | zhihai xu |
+| [HDFS-7312](https://issues.apache.org/jira/browse/HDFS-7312) | Update DistCp v1 to optionally not use tmp location (branch-1 only) | Minor | tools | Joseph Prosser | Joseph Prosser |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-11035](https://issues.apache.org/jira/browse/HADOOP-11035) | distcp on mr1(branch-1) fails with NPE using a short relative source path. | Major | tools | zhihai xu | zhihai xu |
-| [HADOOP-10562](https://issues.apache.org/jira/browse/HADOOP-10562) | Namenode exits on exception without printing stack trace in AbstractDelegationTokenSecretManager | Critical | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-10142](https://issues.apache.org/jira/browse/HADOOP-10142) | Avoid groups lookup for unprivileged users such as "dr.who" | Major | . | Vinayakumar B | Vinayakumar B |
-| [HADOOP-10090](https://issues.apache.org/jira/browse/HADOOP-10090) | Jobtracker metrics not updated properly after execution of a mapreduce job | Major | metrics | Ivan Mitic | Ivan Mitic |
-| [HADOOP-10009](https://issues.apache.org/jira/browse/HADOOP-10009) | Backport HADOOP-7808 to branch-1 | Major | . | Haohui Mai | Haohui Mai |
-| [HADOOP-9801](https://issues.apache.org/jira/browse/HADOOP-9801) | Configuration#writeXml uses platform defaulting encoding, which may mishandle multi-byte characters. | Major | conf | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9768](https://issues.apache.org/jira/browse/HADOOP-9768) | chown and chgrp reject users and groups with spaces on platforms where spaces are otherwise acceptable | Major | fs | Chris Nauroth | Chris Nauroth |
+| [HADOOP-7140](https://issues.apache.org/jira/browse/HADOOP-7140) | IPC Reader threads do not stop when server stops | Critical | . | Todd Lipcon | Todd Lipcon |
+| [HDFS-2264](https://issues.apache.org/jira/browse/HDFS-2264) | NamenodeProtocol has the wrong value for clientPrincipal in KerberosInfo annotation | Major | namenode | Aaron T. Myers | Aaron T. Myers |
+| [MAPREDUCE-5046](https://issues.apache.org/jira/browse/MAPREDUCE-5046) | backport MAPREDUCE-1423 to mapred.lib.CombineFileInputFormat | Major | client | Sangjin Lee | |
+| [MAPREDUCE-5047](https://issues.apache.org/jira/browse/MAPREDUCE-5047) | keep.failed.task.files=true causes job failure on secure clusters | Major | task, tasktracker | Sandy Ryza | Sandy Ryza |
+| [MAPREDUCE-5070](https://issues.apache.org/jira/browse/MAPREDUCE-5070) | TestClusterStatus.testClusterMetrics fails on JDK7 | Major | test | Sandy Ryza | Sandy Ryza |
+| [MAPREDUCE-5072](https://issues.apache.org/jira/browse/MAPREDUCE-5072) | TestDelegationTokenRenewal.testDTRenewal fails in MR1 on jdk7 | Major | test | Sandy Ryza | Sandy Ryza |
+| [MAPREDUCE-5073](https://issues.apache.org/jira/browse/MAPREDUCE-5073) | TestJobStatusPersistency.testPersistency fails on JDK7 | Major | test | Sandy Ryza | Sandy Ryza |
+| [HDFS-4622](https://issues.apache.org/jira/browse/HDFS-4622) | Remove redundant synchronized from FSNamesystem#rollEditLog in branch-1 | Trivial | . | Jing Zhao | Jing Zhao |
+| [MAPREDUCE-2817](https://issues.apache.org/jira/browse/MAPREDUCE-2817) | MiniRMCluster hardcodes 'mapred.local.dir' configuration to 'build/test/mapred/local' | Minor | test | Alejandro Abdelnur | Robert Kanter |
+| [MAPREDUCE-5133](https://issues.apache.org/jira/browse/MAPREDUCE-5133) | TestSubmitJob.testSecureJobExecution is flaky due to job dir deletion race | Major | test | Sandy Ryza | Sandy Ryza |
+| [MAPREDUCE-5218](https://issues.apache.org/jira/browse/MAPREDUCE-5218) | Annotate (comment) internal classes as Private | Minor | . | Karthik Kambatla | Karthik Kambatla |
+| [MAPREDUCE-5217](https://issues.apache.org/jira/browse/MAPREDUCE-5217) | DistCp fails when launched by Oozie in a secure cluster | Major | distcp, security | Venkat Ranganathan | Venkat Ranganathan |
+| [MAPREDUCE-5095](https://issues.apache.org/jira/browse/MAPREDUCE-5095) | TestShuffleExceptionCount#testCheckException fails occasionally with JDK7 | Major | . | Arpit Agarwal | Arpit Agarwal |
+| [MAPREDUCE-5250](https://issues.apache.org/jira/browse/MAPREDUCE-5250) | Searching for ';' in JobTracker History throws ArrayOutOfBoundException | Minor | . | Karthik Kambatla | Karthik Kambatla |
+| [HDFS-4944](https://issues.apache.org/jira/browse/HDFS-4944) | WebHDFS cannot create a file path containing characters that must be URI-encoded, such as space. | Major | webhdfs | Chris Nauroth | Chris Nauroth |
| [HADOOP-9678](https://issues.apache.org/jira/browse/HADOOP-9678) | TestRPC#testStopsAllThreads intermittently fails on Windows | Major | . | Ivan Mitic | Ivan Mitic |
-| [HADOOP-9507](https://issues.apache.org/jira/browse/HADOOP-9507) | LocalFileSystem rename() is broken in some cases when destination exists | Minor | fs | Mostafa Elhemali | Chris Nauroth |
| [HADOOP-9307](https://issues.apache.org/jira/browse/HADOOP-9307) | BufferedFSInputStream.read returns wrong results after certain seeks | Major | fs | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7140](https://issues.apache.org/jira/browse/HADOOP-7140) | IPC Reader threads do not stop when server stops | Critical | . | Todd Lipcon | Todd Lipcon |
-| [HDFS-7503](https://issues.apache.org/jira/browse/HDFS-7503) | Namenode restart after large deletions can cause slow processReport (due to logging) | Major | namenode | Arpit Agarwal | Arpit Agarwal |
-| [HDFS-6822](https://issues.apache.org/jira/browse/HDFS-6822) | In branch-1, Namenode and datanode fails to replace "\_HOST" to hostname for hadoop.http.authentication.kerberos.principal | Major | security | Jing Zhao | Jing Zhao |
-| [HDFS-6649](https://issues.apache.org/jira/browse/HDFS-6649) | Documentation for setrep is wrong | Trivial | documentation | Alexander Fahlke | Akira AJISAKA |
-| [HDFS-6141](https://issues.apache.org/jira/browse/HDFS-6141) | WebHdfsFileSystem#toUrl does not perform character escaping. | Major | webhdfs | Chris Nauroth | Chris Nauroth |
-| [HDFS-5944](https://issues.apache.org/jira/browse/HDFS-5944) | LeaseManager:findLeaseWithPrefixPath can't handle path like /a/b/ right and cause SecondaryNameNode failed do checkpoint | Major | namenode | zhaoyunjiong | zhaoyunjiong |
-| [HDFS-5685](https://issues.apache.org/jira/browse/HDFS-5685) | DistCp will fail to copy with -delete switch | Major | hdfs-client | Yongjun Zhang | Yongjun Zhang |
-| [HDFS-5516](https://issues.apache.org/jira/browse/HDFS-5516) | WebHDFS does not require user name when anonymous http requests are disallowed. | Major | webhdfs | Chris Nauroth | Miodrag Radulovic |
-| [HDFS-5245](https://issues.apache.org/jira/browse/HDFS-5245) | shouldRetry() in WebHDFSFileSystem generates excessive warnings | Minor | webhdfs | Haohui Mai | Haohui Mai |
-| [HDFS-5211](https://issues.apache.org/jira/browse/HDFS-5211) | Race condition between DistributedFileSystem#close and FileSystem#close can cause return of a closed DistributedFileSystem instance from the FileSystem cache. | Major | hdfs-client | Chris Nauroth | Chris Nauroth |
| [HDFS-5003](https://issues.apache.org/jira/browse/HDFS-5003) | TestNNThroughputBenchmark failed caused by existing directories | Minor | test | Xi Fang | Xi Fang |
-| [HDFS-4944](https://issues.apache.org/jira/browse/HDFS-4944) | WebHDFS cannot create a file path containing characters that must be URI-encoded, such as space. | Major | webhdfs | Chris Nauroth | Chris Nauroth |
+| [MAPREDUCE-5405](https://issues.apache.org/jira/browse/MAPREDUCE-5405) | Job recovery can fail if task log directory symlink from prior run still exists | Major | mrv1 | Chris Nauroth | Chris Nauroth |
+| [MAPREDUCE-5288](https://issues.apache.org/jira/browse/MAPREDUCE-5288) | ResourceEstimator#getEstimatedTotalMapOutputSize suffers from divide by zero issues | Major | mrv1 | Harsh J | Karthik Kambatla |
+| [HADOOP-9507](https://issues.apache.org/jira/browse/HADOOP-9507) | LocalFileSystem rename() is broken in some cases when destination exists | Minor | fs | Mostafa Elhemali | Chris Nauroth |
+| [MAPREDUCE-4366](https://issues.apache.org/jira/browse/MAPREDUCE-4366) | mapred metrics shows negative count of waiting maps and reduces | Major | jobtracker | Thomas Graves | Sandy Ryza |
+| [HADOOP-9768](https://issues.apache.org/jira/browse/HADOOP-9768) | chown and chgrp reject users and groups with spaces on platforms where spaces are otherwise acceptable | Major | fs | Chris Nauroth | Chris Nauroth |
+| [HADOOP-9801](https://issues.apache.org/jira/browse/HADOOP-9801) | Configuration#writeXml uses platform defaulting encoding, which may mishandle multi-byte characters. | Major | conf | Chris Nauroth | Chris Nauroth |
| [HDFS-4898](https://issues.apache.org/jira/browse/HDFS-4898) | BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack | Minor | namenode | Eric Sirianni | Tsz Wo Nicholas Sze |
+| [HDFS-5211](https://issues.apache.org/jira/browse/HDFS-5211) | Race condition between DistributedFileSystem#close and FileSystem#close can cause return of a closed DistributedFileSystem instance from the FileSystem cache. | Major | hdfs-client | Chris Nauroth | Chris Nauroth |
+| [MAPREDUCE-5508](https://issues.apache.org/jira/browse/MAPREDUCE-5508) | JobTracker memory leak caused by unreleased FileSystem objects in JobInProgress#cleanupJob | Critical | jobtracker | Xi Fang | Xi Fang |
+| [HDFS-5245](https://issues.apache.org/jira/browse/HDFS-5245) | shouldRetry() in WebHDFSFileSystem generates excessive warnings | Minor | webhdfs | Haohui Mai | Haohui Mai |
+| [HADOOP-10009](https://issues.apache.org/jira/browse/HADOOP-10009) | Backport HADOOP-7808 to branch-1 | Major | . | Haohui Mai | Haohui Mai |
+| [MAPREDUCE-5569](https://issues.apache.org/jira/browse/MAPREDUCE-5569) | FloatSplitter is not generating correct splits | Major | . | Nathan Roberts | Nathan Roberts |
+| [MAPREDUCE-5512](https://issues.apache.org/jira/browse/MAPREDUCE-5512) | TaskTracker hung after failed reconnect to the JobTracker | Major | tasktracker | Ivan Mitic | Ivan Mitic |
| [HDFS-4794](https://issues.apache.org/jira/browse/HDFS-4794) | Browsing filesystem via webui throws kerberos exception when NN service RPC is enabled in a secure cluster | Major | security | Benoy Antony | Benoy Antony |
-| [HDFS-4622](https://issues.apache.org/jira/browse/HDFS-4622) | Remove redundant synchronized from FSNamesystem#rollEditLog in branch-1 | Trivial | . | Jing Zhao | Jing Zhao |
-| [HDFS-2264](https://issues.apache.org/jira/browse/HDFS-2264) | NamenodeProtocol has the wrong value for clientPrincipal in KerberosInfo annotation | Major | namenode | Aaron T. Myers | Aaron T. Myers |
-| [MAPREDUCE-6198](https://issues.apache.org/jira/browse/MAPREDUCE-6198) | NPE from JobTracker#resolveAndAddToTopology in MR1 cause initJob and heartbeat failure. | Major | mrv1 | zhihai xu | zhihai xu |
-| [MAPREDUCE-6196](https://issues.apache.org/jira/browse/MAPREDUCE-6196) | Fix BigDecimal ArithmeticException in PiEstimator | Minor | . | Ray Chiang | Ray Chiang |
-| [MAPREDUCE-6170](https://issues.apache.org/jira/browse/MAPREDUCE-6170) | TestUlimit failure on JDK8 | Major | contrib/streaming | bc Wong | bc Wong |
-| [MAPREDUCE-6147](https://issues.apache.org/jira/browse/MAPREDUCE-6147) | Support mapreduce.input.fileinputformat.split.maxsize | Minor | mrv1 | zhihai xu | zhihai xu |
-| [MAPREDUCE-6076](https://issues.apache.org/jira/browse/MAPREDUCE-6076) | Zero map split input length combine with none zero map split input length may cause MR1 job hung sometimes. | Major | mrv1 | zhihai xu | zhihai xu |
-| [MAPREDUCE-6012](https://issues.apache.org/jira/browse/MAPREDUCE-6012) | DBInputSplit creates invalid ranges on Oracle | Major | . | Julien Serdaru | Wei Yan |
-| [MAPREDUCE-6009](https://issues.apache.org/jira/browse/MAPREDUCE-6009) | Map-only job with new-api runs wrong OutputCommitter when cleanup scheduled in a reduce slot | Blocker | client, job submission | Gera Shegalov | Gera Shegalov |
-| [MAPREDUCE-5979](https://issues.apache.org/jira/browse/MAPREDUCE-5979) | FairScheduler: zero weight can cause sort failures | Major | scheduler | Anubhav Dhoot | Anubhav Dhoot |
-| [MAPREDUCE-5968](https://issues.apache.org/jira/browse/MAPREDUCE-5968) | Work directory is not deleted when downloadCacheObject throws IOException | Major | mrv1 | zhihai xu | zhihai xu |
-| [MAPREDUCE-5966](https://issues.apache.org/jira/browse/MAPREDUCE-5966) | MR1 FairScheduler use of custom weight adjuster is not thread safe for comparisons | Major | scheduler | Anubhav Dhoot | Anubhav Dhoot |
-| [MAPREDUCE-5877](https://issues.apache.org/jira/browse/MAPREDUCE-5877) | Inconsistency between JT/TT for tasks taking a long time to launch | Critical | jobtracker, tasktracker | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-5822](https://issues.apache.org/jira/browse/MAPREDUCE-5822) | FairScheduler does not preempt due to fairshare-starvation when fairshare is 1 | Major | scheduler | Anubhav Dhoot | Anubhav Dhoot |
-| [MAPREDUCE-5808](https://issues.apache.org/jira/browse/MAPREDUCE-5808) | Port output replication factor configurable for terasort to Hadoop 1.x | Minor | examples | Chuan Liu | Chuan Liu |
-| [MAPREDUCE-5710](https://issues.apache.org/jira/browse/MAPREDUCE-5710) | Backport MAPREDUCE-1305 to branch-1 | Major | . | Yongjun Zhang | Yongjun Zhang |
+| [HADOOP-10142](https://issues.apache.org/jira/browse/HADOOP-10142) | Avoid groups lookup for unprivileged users such as "dr.who" | Major | . | Vinayakumar B | Vinayakumar B |
+| [HADOOP-10090](https://issues.apache.org/jira/browse/HADOOP-10090) | Jobtracker metrics not updated properly after execution of a mapreduce job | Major | metrics | Ivan Mitic | Ivan Mitic |
| [MAPREDUCE-5702](https://issues.apache.org/jira/browse/MAPREDUCE-5702) | TaskLogServlet#printTaskLog has spurious HTML closing tags | Trivial | task | Karthik Kambatla | Robert Kanter |
| [MAPREDUCE-5698](https://issues.apache.org/jira/browse/MAPREDUCE-5698) | Backport MAPREDUCE-1285 to branch-1 | Major | . | Yongjun Zhang | Yongjun Zhang |
-| [MAPREDUCE-5660](https://issues.apache.org/jira/browse/MAPREDUCE-5660) | Log info about possible thrashing (when using memory-based scheduling in Capacity Scheduler) is not printed | Trivial | capacity-sched, mrv1, tasktracker | Adam Kawa | Adam Kawa |
-| [MAPREDUCE-5569](https://issues.apache.org/jira/browse/MAPREDUCE-5569) | FloatSplitter is not generating correct splits | Major | . | Nathan Roberts | Nathan Roberts |
-| [MAPREDUCE-5556](https://issues.apache.org/jira/browse/MAPREDUCE-5556) | mapred docs have incorrect classpath | Trivial | . | Allen Wittenauer | Harsh J |
-| [MAPREDUCE-5512](https://issues.apache.org/jira/browse/MAPREDUCE-5512) | TaskTracker hung after failed reconnect to the JobTracker | Major | tasktracker | Ivan Mitic | Ivan Mitic |
-| [MAPREDUCE-5508](https://issues.apache.org/jira/browse/MAPREDUCE-5508) | JobTracker memory leak caused by unreleased FileSystem objects in JobInProgress#cleanupJob | Critical | jobtracker | Xi Fang | Xi Fang |
-| [MAPREDUCE-5405](https://issues.apache.org/jira/browse/MAPREDUCE-5405) | Job recovery can fail if task log directory symlink from prior run still exists | Major | mrv1 | Chris Nauroth | Chris Nauroth |
-| [MAPREDUCE-5288](https://issues.apache.org/jira/browse/MAPREDUCE-5288) | ResourceEstimator#getEstimatedTotalMapOutputSize suffers from divide by zero issues | Major | mrv1 | Harsh J | Karthik Kambatla |
+| [HDFS-5685](https://issues.apache.org/jira/browse/HDFS-5685) | DistCp will fail to copy with -delete switch | Major | hdfs-client | Yongjun Zhang | Yongjun Zhang |
+| [MAPREDUCE-5710](https://issues.apache.org/jira/browse/MAPREDUCE-5710) | Backport MAPREDUCE-1305 to branch-1 | Major | . | Yongjun Zhang | Yongjun Zhang |
+| [HDFS-5944](https://issues.apache.org/jira/browse/HDFS-5944) | LeaseManager:findLeaseWithPrefixPath can't handle path like /a/b/ right and cause SecondaryNameNode failed do checkpoint | Major | namenode | yunjiong zhao | yunjiong zhao |
+| [HDFS-5516](https://issues.apache.org/jira/browse/HDFS-5516) | WebHDFS does not require user name when anonymous http requests are disallowed. | Major | webhdfs | Chris Nauroth | Miodrag Radulovic |
+| [MAPREDUCE-5808](https://issues.apache.org/jira/browse/MAPREDUCE-5808) | Port output replication factor configurable for terasort to Hadoop 1.x | Minor | examples | Chuan Liu | Chuan Liu |
+| [MAPREDUCE-5822](https://issues.apache.org/jira/browse/MAPREDUCE-5822) | FairScheduler does not preempt due to fairshare-starvation when fairshare is 1 | Major | scheduler | Anubhav Dhoot | Anubhav Dhoot |
+| [HDFS-6141](https://issues.apache.org/jira/browse/HDFS-6141) | WebHdfsFileSystem#toUrl does not perform character escaping. | Major | webhdfs | Chris Nauroth | Chris Nauroth |
+| [HADOOP-10562](https://issues.apache.org/jira/browse/HADOOP-10562) | Namenode exits on exception without printing stack trace in AbstractDelegationTokenSecretManager | Critical | . | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-5877](https://issues.apache.org/jira/browse/MAPREDUCE-5877) | Inconsistency between JT/TT for tasks taking a long time to launch | Critical | jobtracker, tasktracker | Karthik Kambatla | Karthik Kambatla |
+| [MAPREDUCE-5979](https://issues.apache.org/jira/browse/MAPREDUCE-5979) | FairScheduler: zero weight can cause sort failures | Major | scheduler | Anubhav Dhoot | Anubhav Dhoot |
+| [MAPREDUCE-5966](https://issues.apache.org/jira/browse/MAPREDUCE-5966) | MR1 FairScheduler use of custom weight adjuster is not thread safe for comparisons | Major | scheduler | Anubhav Dhoot | Anubhav Dhoot |
+| [MAPREDUCE-5968](https://issues.apache.org/jira/browse/MAPREDUCE-5968) | Work directory is not deleted when downloadCacheObject throws IOException | Major | mrv1 | zhihai xu | zhihai xu |
+| [HDFS-6822](https://issues.apache.org/jira/browse/HDFS-6822) | In branch-1, Namenode and datanode fails to replace "\_HOST" to hostname for hadoop.http.authentication.kerberos.principal | Major | security | Jing Zhao | Jing Zhao |
+| [MAPREDUCE-6012](https://issues.apache.org/jira/browse/MAPREDUCE-6012) | DBInputSplit creates invalid ranges on Oracle | Major | . | Julien Serdaru | Wei Yan |
+| [HADOOP-11035](https://issues.apache.org/jira/browse/HADOOP-11035) | distcp on mr1(branch-1) fails with NPE using a short relative source path. | Major | tools | zhihai xu | zhihai xu |
+| [MAPREDUCE-6009](https://issues.apache.org/jira/browse/MAPREDUCE-6009) | Map-only job with new-api runs wrong OutputCommitter when cleanup scheduled in a reduce slot | Blocker | client, job submission | Gera Shegalov | Gera Shegalov |
+| [MAPREDUCE-6147](https://issues.apache.org/jira/browse/MAPREDUCE-6147) | Support mapreduce.input.fileinputformat.split.maxsize | Minor | mrv1 | zhihai xu | zhihai xu |
+| [MAPREDUCE-6170](https://issues.apache.org/jira/browse/MAPREDUCE-6170) | TestUlimit failure on JDK8 | Major | contrib/streaming | bc Wong | bc Wong |
+| [HDFS-7503](https://issues.apache.org/jira/browse/HDFS-7503) | Namenode restart after large deletions can cause slow processReport (due to logging) | Major | namenode | Arpit Agarwal | Arpit Agarwal |
+| [MAPREDUCE-6196](https://issues.apache.org/jira/browse/MAPREDUCE-6196) | Fix BigDecimal ArithmeticException in PiEstimator | Minor | . | Ray Chiang | Ray Chiang |
+| [MAPREDUCE-6198](https://issues.apache.org/jira/browse/MAPREDUCE-6198) | NPE from JobTracker#resolveAndAddToTopology in MR1 cause initJob and heartbeat failure. | Major | mrv1 | zhihai xu | zhihai xu |
| [MAPREDUCE-5272](https://issues.apache.org/jira/browse/MAPREDUCE-5272) | A Minor Error in Javadoc of TestMRWithDistributedCache in Branch-1 | Trivial | test | Zhijie Shen | Zhijie Shen |
-| [MAPREDUCE-5250](https://issues.apache.org/jira/browse/MAPREDUCE-5250) | Searching for ';' in JobTracker History throws ArrayOutOfBoundException | Minor | . | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-5218](https://issues.apache.org/jira/browse/MAPREDUCE-5218) | Annotate (comment) internal classes as Private | Minor | . | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-5217](https://issues.apache.org/jira/browse/MAPREDUCE-5217) | DistCp fails when launched by Oozie in a secure cluster | Major | distcp, security | Venkat Ranganathan | Venkat Ranganathan |
+| [MAPREDUCE-5556](https://issues.apache.org/jira/browse/MAPREDUCE-5556) | mapred docs have incorrect classpath | Trivial | . | Allen Wittenauer | Harsh J |
+| [MAPREDUCE-5660](https://issues.apache.org/jira/browse/MAPREDUCE-5660) | Log info about possible thrashing (when using memory-based scheduling in Capacity Scheduler) is not printed | Trivial | capacity-sched, mrv1, tasktracker | Adam Kawa | Adam Kawa |
| [MAPREDUCE-5183](https://issues.apache.org/jira/browse/MAPREDUCE-5183) | In, TaskTracker#reportProgress logging of 0.0-1.0 progress is followed by percent sign | Minor | mrv1, tasktracker | Sandy Ryza | Niranjan Singh |
-| [MAPREDUCE-5133](https://issues.apache.org/jira/browse/MAPREDUCE-5133) | TestSubmitJob.testSecureJobExecution is flaky due to job dir deletion race | Major | test | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5095](https://issues.apache.org/jira/browse/MAPREDUCE-5095) | TestShuffleExceptionCount#testCheckException fails occasionally with JDK7 | Major | . | Arpit Agarwal | Arpit Agarwal |
-| [MAPREDUCE-5073](https://issues.apache.org/jira/browse/MAPREDUCE-5073) | TestJobStatusPersistency.testPersistency fails on JDK7 | Major | test | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5072](https://issues.apache.org/jira/browse/MAPREDUCE-5072) | TestDelegationTokenRenewal.testDTRenewal fails in MR1 on jdk7 | Major | test | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5070](https://issues.apache.org/jira/browse/MAPREDUCE-5070) | TestClusterStatus.testClusterMetrics fails on JDK7 | Major | test | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5047](https://issues.apache.org/jira/browse/MAPREDUCE-5047) | keep.failed.task.files=true causes job failure on secure clusters | Major | task, tasktracker | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5046](https://issues.apache.org/jira/browse/MAPREDUCE-5046) | backport MAPREDUCE-1423 to mapred.lib.CombineFileInputFormat | Major | client | Sangjin Lee | |
-| [MAPREDUCE-4366](https://issues.apache.org/jira/browse/MAPREDUCE-4366) | mapred metrics shows negative count of waiting maps and reduces | Major | jobtracker | Thomas Graves | Sandy Ryza |
-| [MAPREDUCE-2817](https://issues.apache.org/jira/browse/MAPREDUCE-2817) | MiniRMCluster hardcodes 'mapred.local.dir' configuration to 'build/test/mapred/local' | Minor | test | Alejandro Abdelnur | Robert Kanter |
+| [HDFS-6649](https://issues.apache.org/jira/browse/HDFS-6649) | Documentation for setrep is wrong | Trivial | documentation | Alexander Fahlke | Akira Ajisaka |
+| [MAPREDUCE-6076](https://issues.apache.org/jira/browse/MAPREDUCE-6076) | Zero map split input length combine with none zero map split input length may cause MR1 job hung sometimes. | Major | mrv1 | zhihai xu | zhihai xu |
### TESTS:
@@ -145,13 +133,7 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9573](https://issues.apache.org/jira/browse/HADOOP-9573) | Fix test-patch script to work with the enhanced PreCommit-Admin script. | Major | build | Giridharan Kesavan | Giridharan Kesavan |
| [MAPREDUCE-4049](https://issues.apache.org/jira/browse/MAPREDUCE-4049) | plugin for generic shuffle service | Major | performance, task, tasktracker | Avner BenHanoch | Avner BenHanoch |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-9573](https://issues.apache.org/jira/browse/HADOOP-9573) | Fix test-patch script to work with the enhanced PreCommit-Admin script. | Major | build | Giridharan Kesavan | Giridharan Kesavan |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.3.0/RELEASENOTES.1.3.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.3.0/RELEASENOTES.1.3.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.3.0/RELEASENOTES.1.3.0.md
index a6cf8f8..f9d52c7 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.3.0/RELEASENOTES.1.3.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.3.0/RELEASENOTES.1.3.0.md
@@ -23,47 +23,47 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-8873](https://issues.apache.org/jira/browse/HADOOP-8873) | *Major* | **Port HADOOP-8175 (Add mkdir -p flag) to branch-1**
+* [MAPREDUCE-4049](https://issues.apache.org/jira/browse/MAPREDUCE-4049) | *Major* | **plugin for generic shuffle service**
-FsShell mkdir now accepts a -p flag. Like unix, mkdir -p will not fail if the directory already exists. Unlike unix, intermediate directories are always created, regardless of the flag, to avoid incompatibilities.
+Allow ReduceTask loading a third party plugin for shuffle (and merge) instead of the default shuffle.
---
-* [HDFS-7312](https://issues.apache.org/jira/browse/HDFS-7312) | *Minor* | **Update DistCp v1 to optionally not use tmp location (branch-1 only)**
+* [HADOOP-8873](https://issues.apache.org/jira/browse/HADOOP-8873) | *Major* | **Port HADOOP-8175 (Add mkdir -p flag) to branch-1**
-DistCp v1 currently copies files to a temporary location and then renames that to the specified destination. This can cause performance issues on file systems such as S3. A -skiptmp flag is added to bypass this step and copy directly to the destination.
+FsShell mkdir now accepts a -p flag. Like unix, mkdir -p will not fail if the directory already exists. Unlike unix, intermediate directories are always created, regardless of the flag, to avoid incompatibilities.
---
-* [HDFS-5685](https://issues.apache.org/jira/browse/HDFS-5685) | *Major* | **DistCp will fail to copy with -delete switch**
+* [MAPREDUCE-5408](https://issues.apache.org/jira/browse/MAPREDUCE-5408) | *Major* | **CLONE - The logging level of the tasks should be configurable by the job**
-Has dependency on MAPREDUCE-1285/MAPREDUCE-5698
+Allow logging level of map/reduce tasks to be configurable.
+Configuration changes:
+ add mapred.map.child.log.level
+ add mapred.reduce.child.log.level
---
-* [MAPREDUCE-5777](https://issues.apache.org/jira/browse/MAPREDUCE-5777) | *Major* | **Support utf-8 text with BOM (byte order marker)**
+* [HDFS-5685](https://issues.apache.org/jira/browse/HDFS-5685) | *Major* | **DistCp will fail to copy with -delete switch**
-**WARNING: No release note provided for this incompatible change.**
+Has dependency on MAPREDUCE-1285/MAPREDUCE-5698
---
-* [MAPREDUCE-5408](https://issues.apache.org/jira/browse/MAPREDUCE-5408) | *Major* | **CLONE - The logging level of the tasks should be configurable by the job**
+* [MAPREDUCE-5777](https://issues.apache.org/jira/browse/MAPREDUCE-5777) | *Major* | **Support utf-8 text with BOM (byte order marker)**
-Allow logging level of map/reduce tasks to be configurable.
-Configuration changes:
- add mapred.map.child.log.level
- add mapred.reduce.child.log.level
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-4049](https://issues.apache.org/jira/browse/MAPREDUCE-4049) | *Major* | **plugin for generic shuffle service**
+* [HDFS-7312](https://issues.apache.org/jira/browse/HDFS-7312) | *Minor* | **Update DistCp v1 to optionally not use tmp location (branch-1 only)**
-Allow ReduceTask loading a third party plugin for shuffle (and merge) instead of the default shuffle.
+DistCp v1 currently copies files to a temporary location and then renames that to the specified destination. This can cause performance issues on file systems such as S3. A -skiptmp flag is added to bypass this step and copy directly to the destination.
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[05/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.3.0/RELEASENOTES.2.3.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.3.0/RELEASENOTES.2.3.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.3.0/RELEASENOTES.2.3.0.md
index 43dc922..ad29c29 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.3.0/RELEASENOTES.2.3.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.3.0/RELEASENOTES.2.3.0.md
@@ -23,13 +23,6 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-10047](https://issues.apache.org/jira/browse/HADOOP-10047) | *Major* | **Add a directbuffer Decompressor API to hadoop**
-
-Direct Bytebuffer decompressors for Zlib (Deflate & Gzip) and Snappy
-
-
----
-
* [HADOOP-9241](https://issues.apache.org/jira/browse/HADOOP-9241) | *Trivial* | **DU refresh interval is not configurable**
The 'du' (disk usage command from Unix) script refresh monitor is now configurable in the same way as its 'df' counterpart, via the property 'fs.du.interval', the default of which is 10 minute (in ms).
@@ -73,21 +66,32 @@ Additional information specified on github: https://github.com/DmitryMezhensky/H
---
-* [HDFS-5704](https://issues.apache.org/jira/browse/HDFS-5704) | *Major* | **Change OP\_UPDATE\_BLOCKS with a new OP\_ADD\_BLOCK**
+* [MAPREDUCE-1176](https://issues.apache.org/jira/browse/MAPREDUCE-1176) | *Major* | **FixedLengthInputFormat and FixedLengthRecordReader**
-Add a new editlog record (OP\_ADD\_BLOCK) that only records allocation of the new block instead of the entire block list, on every block allocation.
+Addition of FixedLengthInputFormat and FixedLengthRecordReader in the org.apache.hadoop.mapreduce.lib.input package. These two classes can be used when you need to read data from files containing fixed length (fixed width) records. Such files have no CR/LF (or any combination thereof), no delimiters etc, but each record is a fixed length, and extra data is padded with spaces. The data is one gigantic line within a file. When creating a job that specifies this input format, the job must have the "mapreduce.input.fixedlengthinputformat.record.length" property set as follows myJobConf.setInt("mapreduce.input.fixedlengthinputformat.record.length",[myFixedRecordLength]);
+
+Please see javadoc for more details.
---
-* [HDFS-5663](https://issues.apache.org/jira/browse/HDFS-5663) | *Major* | **make the retry time and interval value configurable in openInfo()**
+* [HDFS-5502](https://issues.apache.org/jira/browse/HDFS-5502) | *Major* | **Fix HTTPS support in HsftpFileSystem**
-Makes the retries and time between retries getting the length of the last block on file configurable. Below are the new configurations.
+Fix the https support in HsftpFileSystem. With the change the client now verifies the server certificate. In particular, client side will verify the Common Name of the certificate using a strategy specified by the configuration property "hadoop.ssl.hostname.verifier".
-dfs.client.retry.times.get-last-block-length
-dfs.client.retry.interval-ms.get-last-block-length
-They are set to the 3 and 4000 respectively, these being what was previously hardcoded.
+---
+
+* [HADOOP-10047](https://issues.apache.org/jira/browse/HADOOP-10047) | *Major* | **Add a directbuffer Decompressor API to hadoop**
+
+Direct Bytebuffer decompressors for Zlib (Deflate & Gzip) and Snappy
+
+
+---
+
+* [HDFS-4997](https://issues.apache.org/jira/browse/HDFS-4997) | *Major* | **libhdfs doesn't return correct error codes in most cases**
+
+libhdfs now returns correct codes in errno. Previously, due to a bug, many functions set errno to 255 instead of the more specific error code.
---
@@ -108,32 +112,28 @@ hadoop.ssl.enabled and dfs.https.enabled are deprecated. When the deprecated con
---
-* [HDFS-5502](https://issues.apache.org/jira/browse/HDFS-5502) | *Major* | **Fix HTTPS support in HsftpFileSystem**
+* [HDFS-4983](https://issues.apache.org/jira/browse/HDFS-4983) | *Major* | **Numeric usernames do not work with WebHDFS FS**
-Fix the https support in HsftpFileSystem. With the change the client now verifies the server certificate. In particular, client side will verify the Common Name of the certificate using a strategy specified by the configuration property "hadoop.ssl.hostname.verifier".
+Add a new configuration property "dfs.webhdfs.user.provider.user.pattern" for specifying user name filters for WebHDFS.
---
-* [HDFS-4997](https://issues.apache.org/jira/browse/HDFS-4997) | *Major* | **libhdfs doesn't return correct error codes in most cases**
-
-libhdfs now returns correct codes in errno. Previously, due to a bug, many functions set errno to 255 instead of the more specific error code.
-
+* [HDFS-5663](https://issues.apache.org/jira/browse/HDFS-5663) | *Major* | **make the retry time and interval value configurable in openInfo()**
----
+Makes the retries and time between retries getting the length of the last block on file configurable. Below are the new configurations.
-* [HDFS-4983](https://issues.apache.org/jira/browse/HDFS-4983) | *Major* | **Numeric usernames do not work with WebHDFS FS**
+dfs.client.retry.times.get-last-block-length
+dfs.client.retry.interval-ms.get-last-block-length
-Add a new configuration property "dfs.webhdfs.user.provider.user.pattern" for specifying user name filters for WebHDFS.
+They are set to the 3 and 4000 respectively, these being what was previously hardcoded.
---
-* [MAPREDUCE-1176](https://issues.apache.org/jira/browse/MAPREDUCE-1176) | *Major* | **FixedLengthInputFormat and FixedLengthRecordReader**
-
-Addition of FixedLengthInputFormat and FixedLengthRecordReader in the org.apache.hadoop.mapreduce.lib.input package. These two classes can be used when you need to read data from files containing fixed length (fixed width) records. Such files have no CR/LF (or any combination thereof), no delimiters etc, but each record is a fixed length, and extra data is padded with spaces. The data is one gigantic line within a file. When creating a job that specifies this input format, the job must have the "mapreduce.input.fixedlengthinputformat.record.length" property set as follows myJobConf.setInt("mapreduce.input.fixedlengthinputformat.record.length",[myFixedRecordLength]);
+* [HDFS-5704](https://issues.apache.org/jira/browse/HDFS-5704) | *Major* | **Change OP\_UPDATE\_BLOCKS with a new OP\_ADD\_BLOCK**
-Please see javadoc for more details.
+Add a new editlog record (OP\_ADD\_BLOCK) that only records allocation of the new block instead of the entire block list, on every block allocation.
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[33/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.0/RELEASENOTES.0.21.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.0/RELEASENOTES.0.21.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.0/RELEASENOTES.0.21.0.md
index 9f341c1..8a8bef3 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.0/RELEASENOTES.0.21.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.0/RELEASENOTES.0.21.0.md
@@ -23,298 +23,298 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-6813](https://issues.apache.org/jira/browse/HADOOP-6813) | *Blocker* | **Add a new newInstance method in FileSystem that takes a "user" as argument**
+* [HADOOP-4895](https://issues.apache.org/jira/browse/HADOOP-4895) | *Major* | **Remove deprecated methods in DFSClient**
-I've just committed this to 0.21.
+Removed deprecated methods DFSClient.getHints() and DFSClient.isDirectory().
---
-* [HADOOP-6748](https://issues.apache.org/jira/browse/HADOOP-6748) | *Major* | **Remove hadoop.cluster.administrators**
+* [HADOOP-4941](https://issues.apache.org/jira/browse/HADOOP-4941) | *Major* | **Remove getBlockSize(Path f), getLength(Path f) and getReplication(Path src)**
-Removed configuration property "hadoop.cluster.administrators". Added constructor public HttpServer(String name, String bindAddress, int port, boolean findPort, Configuration conf, AccessControlList adminsAcl) in HttpServer, which takes cluster administrators acl as a parameter.
+Removed deprecated FileSystem methods getBlockSize(Path f), getLength(Path f), and getReplication(Path src).
---
-* [HADOOP-6701](https://issues.apache.org/jira/browse/HADOOP-6701) | *Minor* | ** Incorrect exit codes for "dfs -chown", "dfs -chgrp"**
+* [HADOOP-4268](https://issues.apache.org/jira/browse/HADOOP-4268) | *Major* | **Permission checking in fsck**
-Commands chmod, chown and chgrp now returns non zero exit code and an error message on failure instead of returning zero.
+Fsck now checks permissions as directories are traversed. Any user can now use fsck, but information is provided only for directories the user has permission to read.
---
-* [HADOOP-6692](https://issues.apache.org/jira/browse/HADOOP-6692) | *Major* | **Add FileContext#listStatus that returns an iterator**
+* [HADOOP-4648](https://issues.apache.org/jira/browse/HADOOP-4648) | *Major* | **Remove ChecksumDistriubtedFileSystem and InMemoryFileSystem**
-This issue adds Iterator\<FileStatus\> listStatus(Path) to FileContext, moves FileStatus[] listStatus(Path) to FileContext#Util, and adds Iterator\<FileStatus\> listStatusItor(Path) to AbstractFileSystem which provides a default implementation by using FileStatus[] listStatus(Path).
+Removed obsolete, deprecated subclasses of ChecksumFileSystem (InMemoryFileSystem, ChecksumDistributedFileSystem).
---
-* [HADOOP-6686](https://issues.apache.org/jira/browse/HADOOP-6686) | *Major* | **Remove redundant exception class name in unwrapped exceptions thrown at the RPC client**
+* [HADOOP-4940](https://issues.apache.org/jira/browse/HADOOP-4940) | *Major* | **Remove delete(Path f)**
-The exceptions thrown by the RPC client no longer carries a redundant exception class name in exception message.
+Removed deprecated method FileSystem.delete(Path).
---
-* [HADOOP-6577](https://issues.apache.org/jira/browse/HADOOP-6577) | *Major* | **IPC server response buffer reset threshold should be configurable**
+* [HADOOP-3953](https://issues.apache.org/jira/browse/HADOOP-3953) | *Major* | **Sticky bit for directories**
-Add hidden configuration option "ipc.server.max.response.size" to change the default 1 MB, the maximum size when large IPC handler response buffer is reset.
+UNIX-style sticky bit implemented for HDFS directories. When the sticky bit is set on a directory, files in that directory may be deleted or renamed only by a superuser or the file's owner.
---
-* [HADOOP-6569](https://issues.apache.org/jira/browse/HADOOP-6569) | *Major* | **FsShell#cat should avoid calling unecessary getFileStatus before opening a file to read**
+* [HADOOP-5022](https://issues.apache.org/jira/browse/HADOOP-5022) | *Blocker* | **[HOD] logcondense should delete all hod logs for a user, including jobtracker logs**
-**WARNING: No release note provided for this incompatible change.**
+New logcondense option retain-master-logs indicates whether the script should delete master logs as part of its cleanup process. By default this option is false; master logs are deleted. Earlier versions of logcondense did not delete master logs.
---
-* [HADOOP-6568](https://issues.apache.org/jira/browse/HADOOP-6568) | *Major* | **Authorization for default servlets**
+* [HADOOP-4368](https://issues.apache.org/jira/browse/HADOOP-4368) | *Minor* | **Superuser privileges required to do "df"**
-Added web-authorization for the default servlets - /logs, /stacks, /logLevel, /metrics, /conf, so that only cluster administrators can access these servlets. hadoop.cluster.administrators is the new configuration in core-default.xml that can be used to specify the ACL against which an authenticated user should be verified if he/she is an administrator.
+New filesystem shell command -df reports capacity, space used and space free. Any user may execute this command without special privileges.
---
-* [HADOOP-6537](https://issues.apache.org/jira/browse/HADOOP-6537) | *Major* | **Proposal for exceptions thrown by FileContext and Abstract File System**
+* [HADOOP-5094](https://issues.apache.org/jira/browse/HADOOP-5094) | *Minor* | **Show dead nodes information in dfsadmin -report**
-Detailed exceptions declared in FileContext and AbstractFileSystem
+Changed df dfsadmin -report to list live and dead nodes, and attempt to resolve the hostname of datanode ip addresses.
---
-* [HADOOP-6531](https://issues.apache.org/jira/browse/HADOOP-6531) | *Minor* | **add FileUtil.fullyDeleteContents(dir) api to delete contents of a directory**
+* [HADOOP-3741](https://issues.apache.org/jira/browse/HADOOP-3741) | *Major* | **SecondaryNameNode has http server on dfs.secondary.http.address but without any contents**
-Added an api FileUtil.fullyDeleteContents(String dir) to delete contents of the directory.
+Backup namenode's web UI default page now has some useful content.
---
-* [HADOOP-6515](https://issues.apache.org/jira/browse/HADOOP-6515) | *Major* | **Make maximum number of http threads configurable**
+* [HADOOP-5176](https://issues.apache.org/jira/browse/HADOOP-5176) | *Trivial* | **TestDFSIO reports itself as TestFDSIO**
-HADOOP-6515. Make maximum number of http threads configurable (Scott Chen via zshao)
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-6489](https://issues.apache.org/jira/browse/HADOOP-6489) | *Major* | **Findbug report: LI\_LAZY\_INIT\_STATIC, OBL\_UNSATISFIED\_OBLIGATION**
+* [HADOOP-5018](https://issues.apache.org/jira/browse/HADOOP-5018) | *Major* | **Chukwa should support pipelined writers**
-Fix 3 findsbugs warnings.
+Chukwa supports pipelined writers for improved extensibility.
---
-* [HADOOP-6441](https://issues.apache.org/jira/browse/HADOOP-6441) | *Major* | **Prevent remote CSS attacks in Hostname and UTF-7.**
+* [HADOOP-4942](https://issues.apache.org/jira/browse/HADOOP-4942) | *Major* | **Remove getName() and getNamed(String name, Configuration conf)**
-Quotes the characters coming out of getRequestUrl and getServerName in HttpServer.java as per the specification in HADOOP-6151.
+Removed deprecated methods getName() and getNamed(String, Configuration) from FileSystem and descendant classes.
---
-* [HADOOP-6433](https://issues.apache.org/jira/browse/HADOOP-6433) | *Major* | **Add AsyncDiskService that is used in both hdfs and mapreduce**
+* [HADOOP-4779](https://issues.apache.org/jira/browse/HADOOP-4779) | *Major* | **Remove deprecated FileSystem methods**
-HADOOP-6433. Add AsyncDiskService for asynchronous disk services.
+Removed deprecated FileSystem methods .
---
-* [HADOOP-6386](https://issues.apache.org/jira/browse/HADOOP-6386) | *Blocker* | **NameNode's HttpServer can't instantiate InetSocketAddress: IllegalArgumentException is thrown**
+* [HADOOP-1722](https://issues.apache.org/jira/browse/HADOOP-1722) | *Major* | **Make streaming to handle non-utf8 byte array**
-Improved initialization sequence so that Port Out of Range error when starting web server will less likely interrupt testing.
+Streaming allows binary (or other non-UTF8) streams.
---
-* [HADOOP-6367](https://issues.apache.org/jira/browse/HADOOP-6367) | *Major* | **Move Access Token implementation from Common to HDFS**
+* [HADOOP-4933](https://issues.apache.org/jira/browse/HADOOP-4933) | *Blocker* | **ConcurrentModificationException in JobHistory.java**
-**WARNING: No release note provided for this incompatible change.**
+Fixed a synchronization bug in job history content parsing that could result in garbled history data or a ConcurrentModificationException.
---
-* [HADOOP-6344](https://issues.apache.org/jira/browse/HADOOP-6344) | *Major* | **rm and rmr fail to correctly move the user's files to the trash prior to deleting when they are over quota.**
+* [HADOOP-4885](https://issues.apache.org/jira/browse/HADOOP-4885) | *Major* | **Try to restore failed replicas of Name Node storage (at checkpoint time)**
-Trash feature notifies user of over-quota condition rather than silently deleting files/directories; deletion can be compelled with "rm -skiptrash".
+Patch introduces new configuration switch dfs.name.dir.restore (boolean) enabling this functionality. Documentation needs to be updated.
+
+UPDATE: Config key is now "dfs.namenode.name.dir.restore" for 1.x and 2.x+ versions of HDFS
---
-* [HADOOP-6343](https://issues.apache.org/jira/browse/HADOOP-6343) | *Major* | **Stack trace of any runtime exceptions should be recorded in the server logs.**
+* [HADOOP-5222](https://issues.apache.org/jira/browse/HADOOP-5222) | *Minor* | **Add offset in client trace**
-Record runtime exceptions in server log to facilitate fault analysis.
+Include IO offset to client trace logging output.
---
-* [HADOOP-6313](https://issues.apache.org/jira/browse/HADOOP-6313) | *Major* | **Expose flush APIs to application users**
+* [HADOOP-5052](https://issues.apache.org/jira/browse/HADOOP-5052) | *Major* | **Add an example for computing exact digits of Pi**
-FSOutputDataStream implement Syncable interface to provide hflush and hsync APIs to the application users.
+New example BaileyBorweinPlouffe computes digits of pi. (World record!)
---
-* [HADOOP-6299](https://issues.apache.org/jira/browse/HADOOP-6299) | *Major* | **Use JAAS LoginContext for our login**
+* [HADOOP-4927](https://issues.apache.org/jira/browse/HADOOP-4927) | *Major* | **Part files on the output filesystem are created irrespective of whether the corresponding task has anything to write there**
-**WARNING: No release note provided for this incompatible change.**
+All output part files are created regardless of whether the corresponding task has output.
---
-* [HADOOP-6281](https://issues.apache.org/jira/browse/HADOOP-6281) | *Major* | **HtmlQuoting throws NullPointerException**
+* [HADOOP-5219](https://issues.apache.org/jira/browse/HADOOP-5219) | *Major* | **SequenceFile is using mapred property**
-Fixed null pointer error when quoting HTML in the case JSP has no parameters.
+New configuration parameter io.seqfile.local.dir for use by SequenceFile replaces mapred.local.dir.
---
-* [HADOOP-6235](https://issues.apache.org/jira/browse/HADOOP-6235) | *Major* | **Adding a new method for getting server default values from a FileSystem**
+* [HADOOP-5042](https://issues.apache.org/jira/browse/HADOOP-5042) | *Major* | ** Add expiration handling to the chukwa log4j appender**
-New FileSystem method reports default parameters that would be used by server. See also HDFS-578.
+Chukwwa Log4J appender options allow a retention policy to limit number of files.
---
-* [HADOOP-6234](https://issues.apache.org/jira/browse/HADOOP-6234) | *Major* | **Permission configuration files should use octal and symbolic**
+* [HADOOP-5144](https://issues.apache.org/jira/browse/HADOOP-5144) | *Major* | **manual way of turning on restore of failed storage replicas for namenode**
-New configuration option dfs.umaskmode sets umask with octal or symbolic value.
+New DFSAdmin command -restoreFailedStorage true\|false\|check sets policy for restoring failed fsimage/editslog volumes.
---
-* [HADOOP-6230](https://issues.apache.org/jira/browse/HADOOP-6230) | *Major* | **Move process tree, and memory calculator classes out of Common into Map/Reduce.**
+* [HADOOP-5258](https://issues.apache.org/jira/browse/HADOOP-5258) | *Major* | **Provide dfsadmin functionality to report on namenode's view of network topology**
-Moved process tree, and memory calculator classes out of Common project into the Map/Reduce project.
+New dfsAdmin command -printTopology shows topology as understood by the namenode.
---
-* [HADOOP-6226](https://issues.apache.org/jira/browse/HADOOP-6226) | *Major* | **Create a LimitedByteArrayOutputStream that does not expand its buffer on write**
+* [HADOOP-4756](https://issues.apache.org/jira/browse/HADOOP-4756) | *Major* | **Create a command line tool to access JMX exported properties from a NameNode server**
-New LimitedByteArrayOutputStream does not expand buffer on writes.
+New HDFS tool JMXGet facilitates command line access to statistics via JMX.
---
-* [HADOOP-6223](https://issues.apache.org/jira/browse/HADOOP-6223) | *Major* | **New improved FileSystem interface for those implementing new files systems.**
+* [HADOOP-4539](https://issues.apache.org/jira/browse/HADOOP-4539) | *Major* | **Streaming Edits to a Backup Node.**
-Add new file system interface AbstractFileSystem with implementation of some file systems that delegate to old FileSystem.
+Introduced backup node which maintains the up-to-date state of the namespace by receiving edits from the namenode, and checkpoint node, which creates checkpoints of the name space. These facilities replace the secondary namenode.
---
-* [HADOOP-6203](https://issues.apache.org/jira/browse/HADOOP-6203) | *Major* | **Improve error message when moving to trash fails due to quota issue**
+* [HADOOP-4842](https://issues.apache.org/jira/browse/HADOOP-4842) | *Major* | **Streaming combiner should allow command, not just JavaClass**
-Improved error message suggests using -skpTrash option when hdfs -rm fails to move to trash because of quota.
+Streaming option -combiner allows any streaming command (not just Java class) to be a combiner.
---
-* [HADOOP-6201](https://issues.apache.org/jira/browse/HADOOP-6201) | *Major* | **FileSystem::ListStatus should throw FileNotFoundException**
+* [HADOOP-4655](https://issues.apache.org/jira/browse/HADOOP-4655) | *Major* | **FileSystem.CACHE should be ref-counted**
-FileSystem listStatus method throws FileNotFoundException for all implementations. Application code should catch or propagate FileNotFoundException.
+Every invocation of FileSystem.newInstance() returns a newly allocated FileSystem object. This may be an incompatible change for applications that relied on FileSystem object identity.
---
-* [HADOOP-6184](https://issues.apache.org/jira/browse/HADOOP-6184) | *Major* | **Provide a configuration dump in json format.**
+* [HADOOP-5191](https://issues.apache.org/jira/browse/HADOOP-5191) | *Minor* | **After creation and startup of the hadoop namenode on AIX or Solaris, you will only be allowed to connect to the namenode via hostname but not IP.**
-New Configuration.dumpConfiguration(Configuration, Writer) writes configuration parameters in the JSON format.
+Accessing HDFS with any ip, hostname, or proxy should work as long as it points to the interface NameNode is listening on.
---
-* [HADOOP-6170](https://issues.apache.org/jira/browse/HADOOP-6170) | *Major* | **add Avro-based RPC serialization**
+* [HADOOP-5363](https://issues.apache.org/jira/browse/HADOOP-5363) | *Major* | **Proxying for multiple HDFS clusters of different versions**
-RPC can use Avro serialization.
+New HDFS proxy server (Tomcat based) allows clients controlled access to clusters with different versions. See Hadoop-5366 for information on using curl and wget.
---
-* [HADOOP-6161](https://issues.apache.org/jira/browse/HADOOP-6161) | *Minor* | **Add get/setEnum to Configuration**
+* [HADOOP-5464](https://issues.apache.org/jira/browse/HADOOP-5464) | *Major* | **DFSClient does not treat write timeout of 0 properly**
-Added following APIs to Configuration:
-- public \<T extends Enum\<T\>\> T getEnum(String name, T defaultValue)
-- public \<T extends Enum\<T\>\> void setEnum(String name, T value)
+Zero values for dfs.socket.timeout and dfs.datanode.socket.write.timeout are now respected. Previously zero values for these parameters resulted in a 5 second timeout.
---
-* [HADOOP-6151](https://issues.apache.org/jira/browse/HADOOP-6151) | *Critical* | **The servlets should quote html characters**
+* [HADOOP-2827](https://issues.apache.org/jira/browse/HADOOP-2827) | *Major* | **Remove deprecated NetUtils.getServerAddress**
-The input parameters for all of the servlets will have the 5 html meta characters quoted. The characters are '&', '\<', '\>', '"' and the apostrophe. The goal is to ensure that our web ui servlets can't be used for cross site scripting (XSS) attacks. In particular, it blocks the frequent (especially for errors) case where the servlet echos back the parameters to the user.
+Removed deprecated NetUtils.getServerAddress.
---
-* [HADOOP-6120](https://issues.apache.org/jira/browse/HADOOP-6120) | *Major* | **Add support for Avro types in hadoop**
+* [HADOOP-5528](https://issues.apache.org/jira/browse/HADOOP-5528) | *Major* | **Binary partitioner**
-New Avro serialization in .../io/serializer/avro.
+New BinaryPartitioner that partitions BinaryComparable keys by hashing a configurable part of the bytes array corresponding to the key.
---
-* [HADOOP-5976](https://issues.apache.org/jira/browse/HADOOP-5976) | *Major* | **create script to provide classpath for external tools**
+* [HADOOP-5518](https://issues.apache.org/jira/browse/HADOOP-5518) | *Major* | **MRUnit unit test library**
-New Hadoop script command classpath prints the path to the Hadoop jar and libraries.
+New contribution MRUnit helps authors of map-reduce programs write unit tests with JUnit.
---
-* [HADOOP-5913](https://issues.apache.org/jira/browse/HADOOP-5913) | *Major* | **Allow administrators to be able to start and stop queues**
+* [HADOOP-5257](https://issues.apache.org/jira/browse/HADOOP-5257) | *Minor* | **Export namenode/datanode functionality through a pluggable RPC layer**
-New mradmin command -refreshQueues reads new configuration of ACLs and queue states from mapred-queues.xml. If the new queue state is not "running," jobs in progress will continue, but no other jobs from that queue will be started.
+New plugin facility for namenode and datanode instantiates classes named in new configuration properties dfs.datanode.plugins and dfs.namenode.plugins.
---
-* [HADOOP-5887](https://issues.apache.org/jira/browse/HADOOP-5887) | *Major* | **Sqoop should create tables in Hive metastore after importing to HDFS**
+* [HADOOP-5469](https://issues.apache.org/jira/browse/HADOOP-5469) | *Major* | **Exposing Hadoop metrics via HTTP**
-New Sqoop argument --hive-import facilitates loading data into Hive.
+New server web page .../metrics allows convenient access to metrics data via JSON and text.
---
-* [HADOOP-5879](https://issues.apache.org/jira/browse/HADOOP-5879) | *Major* | **GzipCodec should read compression level etc from configuration**
+* [HADOOP-5485](https://issues.apache.org/jira/browse/HADOOP-5485) | *Major* | **Authorisation machanism required for acceesing jobtracker url :- jobtracker.com:port/scheduler**
-Provide an ability to configure the compression level and strategy for codecs. Compressors need to be 'reinited' with new characteristics such as compression level etc. and hence an incompatible addition to the api.
+New Fair Scheduler configuration parameter webinterface.private.actions controls whether changes to pools and priorities are permitted from the web interface. Changes are not permitted by default.
---
-* [HADOOP-5861](https://issues.apache.org/jira/browse/HADOOP-5861) | *Major* | **s3n files are not getting split by default**
+* [HADOOP-5396](https://issues.apache.org/jira/browse/HADOOP-5396) | *Major* | **Queue ACLs should be refreshed without requiring a restart of the job tracker**
-Files stored on the native S3 filesystem (s3n:// URIs) now report a block size determined by the fs.s3n.block.size property (default 64MB).
+Job Tracker queue ACLs can be changed without restarting Job Tracker.
---
-* [HADOOP-5815](https://issues.apache.org/jira/browse/HADOOP-5815) | *Major* | **Sqoop: A database import tool for Hadoop**
+* [HADOOP-5467](https://issues.apache.org/jira/browse/HADOOP-5467) | *Major* | **Create an offline fsimage image viewer**
-New contribution Sqoop is a JDBC-based database import tool for Hadoop.
+New Offline Image Viewer (oiv) tool reads an fsimage file and writes the data in a variety of user-friendly formats, including XML.
---
-* [HADOOP-5784](https://issues.apache.org/jira/browse/HADOOP-5784) | *Major* | **The length of the heartbeat cycle should be configurable.**
+* [HADOOP-5752](https://issues.apache.org/jira/browse/HADOOP-5752) | *Major* | **Provide examples of using offline image viewer (oiv) to analyze hadoop file systems**
-Introduced a configuration parameter, mapred.heartbeats.in.second, as an expert option, that defines how many heartbeats a jobtracker can process in a second. Administrators can set this to an appropriate value based on cluster size and expected processing time on the jobtracker to achieve a balance between jobtracker scalability and latency of jobs.
+Additional examples and documentation for HDFS Offline Image Viewer Tool show how to generate Pig-friendly data and to do analysis with Pig.
---
-* [HADOOP-5771](https://issues.apache.org/jira/browse/HADOOP-5771) | *Major* | **Create unit test for LinuxTaskController**
+* [HADOOP-5592](https://issues.apache.org/jira/browse/HADOOP-5592) | *Minor* | **Hadoop Streaming - GzipCodec**
-Added unit tests for verifying LinuxTaskController functionality.
+Updates streaming documentation to correct the name used for the GZipCodec.
---
-* [HADOOP-5752](https://issues.apache.org/jira/browse/HADOOP-5752) | *Major* | **Provide examples of using offline image viewer (oiv) to analyze hadoop file systems**
+* [HADOOP-5738](https://issues.apache.org/jira/browse/HADOOP-5738) | *Major* | **Split waiting tasks field in JobTracker metrics to individual tasks**
-Additional examples and documentation for HDFS Offline Image Viewer Tool show how to generate Pig-friendly data and to do analysis with Pig.
+**WARNING: No release note provided for this change.**
---
@@ -326,23 +326,23 @@ New Fair Scheduler configuration parameter sets a default limit on number of run
---
-* [HADOOP-5738](https://issues.apache.org/jira/browse/HADOOP-5738) | *Major* | **Split waiting tasks field in JobTracker metrics to individual tasks**
+* [HADOOP-5679](https://issues.apache.org/jira/browse/HADOOP-5679) | *Major* | **Resolve findbugs warnings in core/streaming/pipes/examples**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-5737](https://issues.apache.org/jira/browse/HADOOP-5737) | *Major* | **UGI checks in testcases are broken**
+* [HADOOP-5643](https://issues.apache.org/jira/browse/HADOOP-5643) | *Major* | **Ability to blacklist tasktracker**
-Fixed JobTracker to use it's own credentials instead of the job's credentials for accessing mapred.system.dir. Also added APIs in the JobTracker to get the FileSystem objects as per the JobTracker's configuration.
+New mradmin command -refreshNodes updates the job tracker's node lists.
---
-* [HADOOP-5679](https://issues.apache.org/jira/browse/HADOOP-5679) | *Major* | **Resolve findbugs warnings in core/streaming/pipes/examples**
+* [HADOOP-5771](https://issues.apache.org/jira/browse/HADOOP-5771) | *Major* | **Create unit test for LinuxTaskController**
-**WARNING: No release note provided for this incompatible change.**
+Added unit tests for verifying LinuxTaskController functionality.
---
@@ -354,23 +354,16 @@ Distcp will no longer start jobs that move no data.
---
-* [HADOOP-5643](https://issues.apache.org/jira/browse/HADOOP-5643) | *Major* | **Ability to blacklist tasktracker**
-
-New mradmin command -refreshNodes updates the job tracker's node lists.
-
-
----
-
-* [HADOOP-5620](https://issues.apache.org/jira/browse/HADOOP-5620) | *Major* | **discp can preserve modification times of files**
+* [HADOOP-5737](https://issues.apache.org/jira/browse/HADOOP-5737) | *Major* | **UGI checks in testcases are broken**
-New DistCp option -pt preserves last modification and last access times of copied files.
+Fixed JobTracker to use it's own credentials instead of the job's credentials for accessing mapred.system.dir. Also added APIs in the JobTracker to get the FileSystem objects as per the JobTracker's configuration.
---
-* [HADOOP-5592](https://issues.apache.org/jira/browse/HADOOP-5592) | *Minor* | **Hadoop Streaming - GzipCodec**
+* [HADOOP-4359](https://issues.apache.org/jira/browse/HADOOP-4359) | *Major* | **Access Token: Support for data access authorization checking on DataNodes**
-Updates streaming documentation to correct the name used for the GZipCodec.
+Introduced access tokens as capabilities for accessing datanodes. This change to internal protocols does not affect client applications.
---
@@ -382,996 +375,1035 @@ Fixed error parsing job history counters after change of counter format.
---
-* [HADOOP-5528](https://issues.apache.org/jira/browse/HADOOP-5528) | *Major* | **Binary partitioner**
+* [HADOOP-4829](https://issues.apache.org/jira/browse/HADOOP-4829) | *Minor* | **Allow FileSystem shutdown hook to be disabled**
-New BinaryPartitioner that partitions BinaryComparable keys by hashing a configurable part of the bytes array corresponding to the key.
+New configuration parameter fs.automatic.close can be set false to disable the JVM shutdown hook that automatically closes FileSystems.
---
-* [HADOOP-5518](https://issues.apache.org/jira/browse/HADOOP-5518) | *Major* | **MRUnit unit test library**
+* [HADOOP-5438](https://issues.apache.org/jira/browse/HADOOP-5438) | *Major* | **Merge FileSystem.create and FileSystem.append**
-New contribution MRUnit helps authors of map-reduce programs write unit tests with JUnit.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-5485](https://issues.apache.org/jira/browse/HADOOP-5485) | *Major* | **Authorisation machanism required for acceesing jobtracker url :- jobtracker.com:port/scheduler**
+* [HADOOP-5815](https://issues.apache.org/jira/browse/HADOOP-5815) | *Major* | **Sqoop: A database import tool for Hadoop**
-New Fair Scheduler configuration parameter webinterface.private.actions controls whether changes to pools and priorities are permitted from the web interface. Changes are not permitted by default.
+New contribution Sqoop is a JDBC-based database import tool for Hadoop.
---
-* [HADOOP-5469](https://issues.apache.org/jira/browse/HADOOP-5469) | *Major* | **Exposing Hadoop metrics via HTTP**
+* [HADOOP-4861](https://issues.apache.org/jira/browse/HADOOP-4861) | *Trivial* | **Add disk usage with human-readable size (-duh)**
-New server web page .../metrics allows convenient access to metrics data via JSON and text.
+Output of hadoop fs -dus changed to be consistent with hadoop fs -du and with Linux du. Users who previously parsed this output should update their scripts. New feature hadoop fs -du -h may be used for human readable output.
---
-* [HADOOP-5467](https://issues.apache.org/jira/browse/HADOOP-5467) | *Major* | **Create an offline fsimage image viewer**
+* [HADOOP-5175](https://issues.apache.org/jira/browse/HADOOP-5175) | *Major* | **Option to prohibit jars unpacking**
-New Offline Image Viewer (oiv) tool reads an fsimage file and writes the data in a variety of user-friendly formats, including XML.
+Jars passed to the -libjars option of hadoop jars are no longer unpacked inside mapred.local.dir.
---
-* [HADOOP-5464](https://issues.apache.org/jira/browse/HADOOP-5464) | *Major* | **DFSClient does not treat write timeout of 0 properly**
+* [HADOOP-5620](https://issues.apache.org/jira/browse/HADOOP-5620) | *Major* | **discp can preserve modification times of files**
-Zero values for dfs.socket.timeout and dfs.datanode.socket.write.timeout are now respected. Previously zero values for these parameters resulted in a 5 second timeout.
+New DistCp option -pt preserves last modification and last access times of copied files.
---
-* [HADOOP-5457](https://issues.apache.org/jira/browse/HADOOP-5457) | *Major* | **Failing contrib tests should not stop the build**
+* [HADOOP-5784](https://issues.apache.org/jira/browse/HADOOP-5784) | *Major* | **The length of the heartbeat cycle should be configurable.**
-Fixed the build to make sure that all the unit tests in contrib are run, regardless of the success/failure status of the previous projects' tests.
+Introduced a configuration parameter, mapred.heartbeats.in.second, as an expert option, that defines how many heartbeats a jobtracker can process in a second. Administrators can set this to an appropriate value based on cluster size and expected processing time on the jobtracker to achieve a balance between jobtracker scalability and latency of jobs.
---
-* [HADOOP-5438](https://issues.apache.org/jira/browse/HADOOP-5438) | *Major* | **Merge FileSystem.create and FileSystem.append**
+* [HADOOP-5861](https://issues.apache.org/jira/browse/HADOOP-5861) | *Major* | **s3n files are not getting split by default**
-**WARNING: No release note provided for this incompatible change.**
+Files stored on the native S3 filesystem (s3n:// URIs) now report a block size determined by the fs.s3n.block.size property (default 64MB).
---
-* [HADOOP-5396](https://issues.apache.org/jira/browse/HADOOP-5396) | *Major* | **Queue ACLs should be refreshed without requiring a restart of the job tracker**
+* [HADOOP-4768](https://issues.apache.org/jira/browse/HADOOP-4768) | *Major* | **Dynamic Priority Scheduler that allows queue shares to be controlled dynamically by a currency**
-Job Tracker queue ACLs can be changed without restarting Job Tracker.
+New contribution Dynamic Scheduler implements dynamic priorities with a currency model. Usage instructions are in the Jira item.
---
-* [HADOOP-5363](https://issues.apache.org/jira/browse/HADOOP-5363) | *Major* | **Proxying for multiple HDFS clusters of different versions**
+* [HADOOP-5457](https://issues.apache.org/jira/browse/HADOOP-5457) | *Major* | **Failing contrib tests should not stop the build**
-New HDFS proxy server (Tomcat based) allows clients controlled access to clusters with different versions. See Hadoop-5366 for information on using curl and wget.
+Fixed the build to make sure that all the unit tests in contrib are run, regardless of the success/failure status of the previous projects' tests.
---
-* [HADOOP-5258](https://issues.apache.org/jira/browse/HADOOP-5258) | *Major* | **Provide dfsadmin functionality to report on namenode's view of network topology**
+* [HADOOP-4041](https://issues.apache.org/jira/browse/HADOOP-4041) | *Major* | **IsolationRunner does not work as documented**
-New dfsAdmin command -printTopology shows topology as understood by the namenode.
+Fixed a bug in IsolationRunner to make it work for map tasks.
---
-* [HADOOP-5257](https://issues.apache.org/jira/browse/HADOOP-5257) | *Minor* | **Export namenode/datanode functionality through a pluggable RPC layer**
+* [HADOOP-5913](https://issues.apache.org/jira/browse/HADOOP-5913) | *Major* | **Allow administrators to be able to start and stop queues**
-New plugin facility for namenode and datanode instantiates classes named in new configuration properties dfs.datanode.plugins and dfs.namenode.plugins.
+New mradmin command -refreshQueues reads new configuration of ACLs and queue states from mapred-queues.xml. If the new queue state is not "running," jobs in progress will continue, but no other jobs from that queue will be started.
---
-* [HADOOP-5222](https://issues.apache.org/jira/browse/HADOOP-5222) | *Minor* | **Add offset in client trace**
+* [HADOOP-5887](https://issues.apache.org/jira/browse/HADOOP-5887) | *Major* | **Sqoop should create tables in Hive metastore after importing to HDFS**
-Include IO offset to client trace logging output.
+New Sqoop argument --hive-import facilitates loading data into Hive.
---
-* [HADOOP-5219](https://issues.apache.org/jira/browse/HADOOP-5219) | *Major* | **SequenceFile is using mapred property**
+* [MAPREDUCE-516](https://issues.apache.org/jira/browse/MAPREDUCE-516) | *Major* | **Fix the 'cluster drain' problem in the Capacity Scheduler wrt High RAM Jobs**
-New configuration parameter io.seqfile.local.dir for use by SequenceFile replaces mapred.local.dir.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-5191](https://issues.apache.org/jira/browse/HADOOP-5191) | *Minor* | **After creation and startup of the hadoop namenode on AIX or Solaris, you will only be allowed to connect to the namenode via hostname but not IP.**
+* [MAPREDUCE-358](https://issues.apache.org/jira/browse/MAPREDUCE-358) | *Major* | **Change org.apache.hadoop.examples. AggregateWordCount and org.apache.hadoop.examples.AggregateWordHistogram to use new mapreduce api.**
-Accessing HDFS with any ip, hostname, or proxy should work as long as it points to the interface NameNode is listening on.
+Modifies AggregateWordCount and AggregateWordHistogram examples to use the new Map/Reduce API
---
-* [HADOOP-5176](https://issues.apache.org/jira/browse/HADOOP-5176) | *Trivial* | **TestDFSIO reports itself as TestFDSIO**
+* [MAPREDUCE-463](https://issues.apache.org/jira/browse/MAPREDUCE-463) | *Major* | **The job setup and cleanup tasks should be optional**
-**WARNING: No release note provided for this incompatible change.**
+Added Configuration property "mapred.committer.job.setup.cleanup.needed" to specify whether job-setup and job-cleanup is needed for the job output committer. The default value is true.
+Added Job.setJobSetupCleanupNeeded and JobContext.getJobSetupCleanupNeeded api for setting/getting the configuration.
+If the configuration is set to false, no setup or cleanup will be done.
---
-* [HADOOP-5175](https://issues.apache.org/jira/browse/HADOOP-5175) | *Major* | **Option to prohibit jars unpacking**
+* [MAPREDUCE-502](https://issues.apache.org/jira/browse/MAPREDUCE-502) | *Major* | **Allow jobtracker to be configured with zero completed jobs in memory**
-Jars passed to the -libjars option of hadoop jars are no longer unpacked inside mapred.local.dir.
+If the number of jobs per user exceeded mapred.jobtracker.completeuserjobs.maximum then the job was flushed out of the jobtracker's memory after the job finishes min-time (hardcoded to 1 min). This caused jobclient's fail with NPE. In this patch the min-time to retain a job is made configurable (mapred.jobtracker.retirejob.interval.min).
---
-* [HADOOP-5144](https://issues.apache.org/jira/browse/HADOOP-5144) | *Major* | **manual way of turning on restore of failed storage replicas for namenode**
+* [MAPREDUCE-551](https://issues.apache.org/jira/browse/MAPREDUCE-551) | *Major* | **Add preemption to the fair scheduler**
-New DFSAdmin command -restoreFailedStorage true\|false\|check sets policy for restoring failed fsimage/editslog volumes.
+Added support for preemption in the fair scheduler. The new configuration options for enabling this are described in the fair scheduler documentation.
---
-* [HADOOP-5094](https://issues.apache.org/jira/browse/HADOOP-5094) | *Minor* | **Show dead nodes information in dfsadmin -report**
-
-Changed df dfsadmin -report to list live and dead nodes, and attempt to resolve the hostname of datanode ip addresses.
+* [MAPREDUCE-416](https://issues.apache.org/jira/browse/MAPREDUCE-416) | *Major* | **Move the completed jobs' history files to a DONE subdirectory inside the configured history directory**
+Once the job is done, the history file and associated conf file is moved to history.folder/done folder. This is done to avoid garbling the running jobs' folder and the framework no longer gets affected with the files in the done folder. This helps in 2 was
+1) ls on running folder (recovery) is faster with less files
+2) changes in running folder results into FileNotFoundException.
----
-* [HADOOP-5073](https://issues.apache.org/jira/browse/HADOOP-5073) | *Major* | **Hadoop 1.0 Interface Classification - scope (visibility - public/private) and stability**
+So with existing code, the best way to keep the running folder clean is to note the id's of running job and then move files that are not in this list to the done folder. Note that on an avg there will be 2 files in the history folder namely
+1) job history file
+2) conf file.
-Annotation mechanism enables interface classification.
+With restart, there might be more than 2 files, mostly the extra conf files. In such a case keep the oldest conf file (based on timestamp) and delete the rest. Note that this its better to do this when the jobtracker is down.
---
-* [HADOOP-5052](https://issues.apache.org/jira/browse/HADOOP-5052) | *Major* | **Add an example for computing exact digits of Pi**
+* [MAPREDUCE-646](https://issues.apache.org/jira/browse/MAPREDUCE-646) | *Major* | **distcp should place the file distcp\_src\_files in distributed cache**
-New example BaileyBorweinPlouffe computes digits of pi. (World record!)
+Patch increases the replication factor of \_distcp\_src\_files to sqrt(min(maxMapsOnCluster, totalMapsInThisJob)) sothat many maps won't access the same replica of the file \_distcp\_src\_files at the same time.
---
-* [HADOOP-5042](https://issues.apache.org/jira/browse/HADOOP-5042) | *Major* | ** Add expiration handling to the chukwa log4j appender**
+* [MAPREDUCE-211](https://issues.apache.org/jira/browse/MAPREDUCE-211) | *Major* | **Provide a node health check script and run it periodically to check the node health status**
-Chukwwa Log4J appender options allow a retention policy to limit number of files.
+Provides ability to run a health check script on the tasktracker nodes and blacklist nodes if they are unhealthy.
---
-* [HADOOP-5022](https://issues.apache.org/jira/browse/HADOOP-5022) | *Blocker* | **[HOD] logcondense should delete all hod logs for a user, including jobtracker logs**
+* [MAPREDUCE-642](https://issues.apache.org/jira/browse/MAPREDUCE-642) | *Major* | **distcp could have an option to preserve the full source path**
-New logcondense option retain-master-logs indicates whether the script should delete master logs as part of its cleanup process. By default this option is false; master logs are deleted. Earlier versions of logcondense did not delete master logs.
+DistCp now has a "-basedir" option that allows you to set the sufix of the source path that will be copied to the destination.
---
-* [HADOOP-5018](https://issues.apache.org/jira/browse/HADOOP-5018) | *Major* | **Chukwa should support pipelined writers**
+* [MAPREDUCE-686](https://issues.apache.org/jira/browse/MAPREDUCE-686) | *Major* | **Move TestSpeculativeExecution.Fake\* into a separate class so that it can be used by other tests also**
-Chukwa supports pipelined writers for improved extensibility.
+Consolidate the Mock Objects used for testing in a separate class(FakeObjectUtiltities) to ease re-usability
---
-* [HADOOP-4952](https://issues.apache.org/jira/browse/HADOOP-4952) | *Major* | **Improved files system interface for the application writer.**
+* [MAPREDUCE-625](https://issues.apache.org/jira/browse/MAPREDUCE-625) | *Minor* | **Modify TestTaskLimits to improve execution time**
-New FileContext API introduced to replace FileSystem API. FileContext will be the version-compatible API for future releases. FileSystem API will be deprecated in the next release.
+Modifies TestTaskLimits to do unit testing instead of running jobs using MR clusters
---
-* [HADOOP-4942](https://issues.apache.org/jira/browse/HADOOP-4942) | *Major* | **Remove getName() and getNamed(String name, Configuration conf)**
+* [MAPREDUCE-532](https://issues.apache.org/jira/browse/MAPREDUCE-532) | *Major* | **Allow admins of the Capacity Scheduler to set a hard-limit on the capacity of a queue**
-Removed deprecated methods getName() and getNamed(String, Configuration) from FileSystem and descendant classes.
+Provided ability in the capacity scheduler to limit the number of slots that can be concurrently used per queue at any given time.
---
-* [HADOOP-4941](https://issues.apache.org/jira/browse/HADOOP-4941) | *Major* | **Remove getBlockSize(Path f), getLength(Path f) and getReplication(Path src)**
+* [MAPREDUCE-701](https://issues.apache.org/jira/browse/MAPREDUCE-701) | *Minor* | **Make TestRackAwareTaskPlacement a unit test**
-Removed deprecated FileSystem methods getBlockSize(Path f), getLength(Path f), and getReplication(Path src).
+Modifies TestRackAwareTaskPlacement to not use MiniMR/DFS Cluster for testing, thereby making it a unit test
---
-* [HADOOP-4940](https://issues.apache.org/jira/browse/HADOOP-4940) | *Major* | **Remove delete(Path f)**
+* [MAPREDUCE-683](https://issues.apache.org/jira/browse/MAPREDUCE-683) | *Major* | **TestJobTrackerRestart fails with Map task completion events ordering mismatch**
-Removed deprecated method FileSystem.delete(Path).
+TestJobTrackerRestart failed because of stale filemanager cache (which was created once per jvm). This patch makes sure that the filemanager is inited upon every JobHistory.init() and hence upon every restart. Note that this wont happen in production as upon a restart the new jobtracker will start in a new jvm and hence a new cache will be created.
---
-* [HADOOP-4933](https://issues.apache.org/jira/browse/HADOOP-4933) | *Blocker* | **ConcurrentModificationException in JobHistory.java**
+* [MAPREDUCE-676](https://issues.apache.org/jira/browse/MAPREDUCE-676) | *Major* | **Existing diagnostic rules fail for MAP ONLY jobs**
-Fixed a synchronization bug in job history content parsing that could result in garbled history data or a ConcurrentModificationException.
+hadoop vaidya counter names LOCAL\_BYTES\_READ and LOCAL\_BYTES\_WRITTEN are changed to respectively FILE\_BYTES\_READ, FILE\_BYTES\_WRITTEN as per current hadoop counter names.
---
-* [HADOOP-4927](https://issues.apache.org/jira/browse/HADOOP-4927) | *Major* | **Part files on the output filesystem are created irrespective of whether the corresponding task has anything to write there**
+* [HADOOP-5976](https://issues.apache.org/jira/browse/HADOOP-5976) | *Major* | **create script to provide classpath for external tools**
-All output part files are created regardless of whether the corresponding task has output.
+New Hadoop script command classpath prints the path to the Hadoop jar and libraries.
---
-* [HADOOP-4895](https://issues.apache.org/jira/browse/HADOOP-4895) | *Major* | **Remove deprecated methods in DFSClient**
+* [MAPREDUCE-371](https://issues.apache.org/jira/browse/MAPREDUCE-371) | *Major* | **Change org.apache.hadoop.mapred.lib.KeyFieldBasedComparator and org.apache.hadoop.mapred.lib.KeyFieldBasedPartitioner to use new api**
-Removed deprecated methods DFSClient.getHints() and DFSClient.isDirectory().
+Ports KeyFieldBasedComparator and KeyFieldBasedPartitioner to the new Map/Reduce API
---
-* [HADOOP-4885](https://issues.apache.org/jira/browse/HADOOP-4885) | *Major* | **Try to restore failed replicas of Name Node storage (at checkpoint time)**
-
-Patch introduces new configuration switch dfs.name.dir.restore (boolean) enabling this functionality. Documentation needs to be updated.
+* [MAPREDUCE-732](https://issues.apache.org/jira/browse/MAPREDUCE-732) | *Minor* | **node health check script should not log "UNHEALTHY" status for every heartbeat in INFO mode**
-UPDATE: Config key is now "dfs.namenode.name.dir.restore" for 1.x and 2.x+ versions of HDFS
+Changed log level of addition of blacklisted reason in the JobTracker log to debug instead of INFO
---
-* [HADOOP-4861](https://issues.apache.org/jira/browse/HADOOP-4861) | *Trivial* | **Add disk usage with human-readable size (-duh)**
+* [MAPREDUCE-655](https://issues.apache.org/jira/browse/MAPREDUCE-655) | *Major* | **Change KeyValueLineRecordReader and KeyValueTextInputFormat to use new api.**
-Output of hadoop fs -dus changed to be consistent with hadoop fs -du and with Linux du. Users who previously parsed this output should update their scripts. New feature hadoop fs -du -h may be used for human readable output.
+Ports KeyValueLineRecordReader and KeyValueTextInputFormat the new Map/Reduce API
---
-* [HADOOP-4842](https://issues.apache.org/jira/browse/HADOOP-4842) | *Major* | **Streaming combiner should allow command, not just JavaClass**
+* [MAPREDUCE-153](https://issues.apache.org/jira/browse/MAPREDUCE-153) | *Major* | **TestJobInProgressListener sometimes timesout**
-Streaming option -combiner allows any streaming command (not just Java class) to be a combiner.
+Only one MR cluster is brought up and hence there is no scope of jobid clashing.
---
-* [HADOOP-4829](https://issues.apache.org/jira/browse/HADOOP-4829) | *Minor* | **Allow FileSystem shutdown hook to be disabled**
+* [MAPREDUCE-632](https://issues.apache.org/jira/browse/MAPREDUCE-632) | *Major* | **Merge TestCustomOutputCommitter with TestCommandLineJobSubmission**
-New configuration parameter fs.automatic.close can be set false to disable the JVM shutdown hook that automatically closes FileSystems.
+Modifies TestCommandLineJobSubmission to add a test for testing custom output committer and removes TestCustomOutputCommitter
---
-* [HADOOP-4779](https://issues.apache.org/jira/browse/HADOOP-4779) | *Major* | **Remove deprecated FileSystem methods**
+* [MAPREDUCE-467](https://issues.apache.org/jira/browse/MAPREDUCE-467) | *Major* | **Collect information about number of tasks succeeded / total per time unit for a tasktracker.**
-Removed deprecated FileSystem methods .
+Provide ability to collect statistics about tasks completed and succeeded for each tracker in time windows. The statistics is available on the jobtrackers' nodes UI page.
---
-* [HADOOP-4768](https://issues.apache.org/jira/browse/HADOOP-4768) | *Major* | **Dynamic Priority Scheduler that allows queue shares to be controlled dynamically by a currency**
+* [MAPREDUCE-677](https://issues.apache.org/jira/browse/MAPREDUCE-677) | *Major* | **TestNodeRefresh timesout**
-New contribution Dynamic Scheduler implements dynamic priorities with a currency model. Usage instructions are in the Jira item.
+TestNodeRefresh sometimes timed out. This happened because the test started a MR cluster with 2 trackers and ran a half-waiting-mapper job. Tasks that have id \> total-maps/2 wait for a signal. Because of 2 trackers, the tasks got scheduled out of order (locality) and hence the job got stuck. The fix is to start only one tracker and then add a new tracker later.
---
-* [HADOOP-4756](https://issues.apache.org/jira/browse/HADOOP-4756) | *Major* | **Create a command line tool to access JMX exported properties from a NameNode server**
+* [MAPREDUCE-627](https://issues.apache.org/jira/browse/MAPREDUCE-627) | *Minor* | **Modify TestTrackerBlacklistAcrossJobs to improve execution time**
-New HDFS tool JMXGet facilitates command line access to statistics via JMX.
+Modifies TestTrackerBlacklistAcrossJobs to use mock objects for testing instead of running a full-fledged job using MiniMR clusters.
---
-* [HADOOP-4655](https://issues.apache.org/jira/browse/HADOOP-4655) | *Major* | **FileSystem.CACHE should be ref-counted**
+* [MAPREDUCE-630](https://issues.apache.org/jira/browse/MAPREDUCE-630) | *Minor* | **TestKillCompletedJob can be modified to improve execution times**
-Every invocation of FileSystem.newInstance() returns a newly allocated FileSystem object. This may be an incompatible change for applications that relied on FileSystem object identity.
+Modifies TestKillCompletedJob to rid of its dependence on MiniMR clusters and makes it a unit test
---
-* [HADOOP-4648](https://issues.apache.org/jira/browse/HADOOP-4648) | *Major* | **Remove ChecksumDistriubtedFileSystem and InMemoryFileSystem**
+* [MAPREDUCE-626](https://issues.apache.org/jira/browse/MAPREDUCE-626) | *Minor* | **Modify TestLostTracker to improve execution time**
-Removed obsolete, deprecated subclasses of ChecksumFileSystem (InMemoryFileSystem, ChecksumDistributedFileSystem).
+Modifies TestLostTracker to use Mock objects instead of running full-fledged jobs using the MiniMR clusters.
---
-* [HADOOP-4539](https://issues.apache.org/jira/browse/HADOOP-4539) | *Major* | **Streaming Edits to a Backup Node.**
+* [MAPREDUCE-353](https://issues.apache.org/jira/browse/MAPREDUCE-353) | *Major* | **Allow shuffle read and connection timeouts to be configurable**
-Introduced backup node which maintains the up-to-date state of the namespace by receiving edits from the namenode, and checkpoint node, which creates checkpoints of the name space. These facilities replace the secondary namenode.
+Expert level config properties mapred.shuffle.connect.timeout and mapred.shuffle.read.timeout that are to be used at cluster level are added by this patch.
---
-* [HADOOP-4368](https://issues.apache.org/jira/browse/HADOOP-4368) | *Minor* | **Superuser privileges required to do "df"**
+* [MAPREDUCE-739](https://issues.apache.org/jira/browse/MAPREDUCE-739) | *Major* | **Allow relative paths to be created inside archives.**
-New filesystem shell command -df reports capacity, space used and space free. Any user may execute this command without special privileges.
+Allow creating archives with relative paths with a -p option on the command line.
---
-* [HADOOP-4359](https://issues.apache.org/jira/browse/HADOOP-4359) | *Major* | **Access Token: Support for data access authorization checking on DataNodes**
+* [MAPREDUCE-740](https://issues.apache.org/jira/browse/MAPREDUCE-740) | *Major* | **Provide summary information per job once a job is finished.**
-Introduced access tokens as capabilities for accessing datanodes. This change to internal protocols does not affect client applications.
+Log a job-summary at the end of a job, while allowing it to be configured to use a custom appender if desired.
---
-* [HADOOP-4268](https://issues.apache.org/jira/browse/HADOOP-4268) | *Major* | **Permission checking in fsck**
+* [MAPREDUCE-245](https://issues.apache.org/jira/browse/MAPREDUCE-245) | *Major* | **Job and JobControl classes should return interfaces rather than implementations**
-Fsck now checks permissions as directories are traversed. Any user can now use fsck, but information is provided only for directories the user has permission to read.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-4041](https://issues.apache.org/jira/browse/HADOOP-4041) | *Major* | **IsolationRunner does not work as documented**
+* [HADOOP-6161](https://issues.apache.org/jira/browse/HADOOP-6161) | *Minor* | **Add get/setEnum to Configuration**
-Fixed a bug in IsolationRunner to make it work for map tasks.
+Added following APIs to Configuration:
+- public \<T extends Enum\<T\>\> T getEnum(String name, T defaultValue)
+- public \<T extends Enum\<T\>\> void setEnum(String name, T value)
---
-* [HADOOP-4012](https://issues.apache.org/jira/browse/HADOOP-4012) | *Major* | **Providing splitting support for bzip2 compressed files**
+* [MAPREDUCE-772](https://issues.apache.org/jira/browse/MAPREDUCE-772) | *Major* | **Chaging LineRecordReader algo so that it does not need to skip backwards in the stream**
-BZip2 files can now be split.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-3953](https://issues.apache.org/jira/browse/HADOOP-3953) | *Major* | **Sticky bit for directories**
+* [MAPREDUCE-717](https://issues.apache.org/jira/browse/MAPREDUCE-717) | *Major* | **Fix some corner case issues in speculative execution (post hadoop-2141)**
-UNIX-style sticky bit implemented for HDFS directories. When the sticky bit is set on a directory, files in that directory may be deleted or renamed only by a superuser or the file's owner.
+Fixes some edge cases while using speculative execution
---
-* [HADOOP-3741](https://issues.apache.org/jira/browse/HADOOP-3741) | *Major* | **SecondaryNameNode has http server on dfs.secondary.http.address but without any contents**
+* [MAPREDUCE-785](https://issues.apache.org/jira/browse/MAPREDUCE-785) | *Major* | **Refactor TestReduceFetchFromPartialMem into a separate test**
-Backup namenode's web UI default page now has some useful content.
+Moves TestReduceFetchFromPartialMem out of TestReduceFetch into a separate test to enable it to be included in the commit-tests target.
---
-* [HADOOP-2827](https://issues.apache.org/jira/browse/HADOOP-2827) | *Major* | **Remove deprecated NetUtils.getServerAddress**
+* [MAPREDUCE-682](https://issues.apache.org/jira/browse/MAPREDUCE-682) | *Major* | **Reserved tasktrackers should be removed when a node is globally blacklisted**
-Removed deprecated NetUtils.getServerAddress.
+Jobtracker was modified to cleanup reservations created on tasktracker nodes to support high RAM jobs, when the nodes are blacklisted.
---
-* [HADOOP-1722](https://issues.apache.org/jira/browse/HADOOP-1722) | *Major* | **Make streaming to handle non-utf8 byte array**
+* [HADOOP-6120](https://issues.apache.org/jira/browse/HADOOP-6120) | *Major* | **Add support for Avro types in hadoop**
-Streaming allows binary (or other non-UTF8) streams.
+New Avro serialization in .../io/serializer/avro.
---
-* [HDFS-1024](https://issues.apache.org/jira/browse/HDFS-1024) | *Blocker* | **SecondaryNamenode fails to checkpoint because namenode fails with CancelledKeyException**
+* [MAPREDUCE-784](https://issues.apache.org/jira/browse/MAPREDUCE-784) | *Major* | **Modify TestUserDefinedCounters to use LocalJobRunner instead of MiniMR**
-**WARNING: No release note provided for this incompatible change.**
+Modifies TestUserDefinedCounters to use LocalJobRunner instead of using MiniMR cluster
---
-* [HDFS-1016](https://issues.apache.org/jira/browse/HDFS-1016) | *Major* | **HDFS side change for HADOOP-6569**
+* [MAPREDUCE-369](https://issues.apache.org/jira/browse/MAPREDUCE-369) | *Major* | **Change org.apache.hadoop.mapred.lib.MultipleInputs to use new api.**
-When cat a directory or a non-existent file from the command line, the error message gets printed becomes
-cat: io.java.FileNotFoundException: File does not exist: \<absolute path name\>
+Patch that ports MultipleInputs, DelegatingInputFormat, DelegatingMapper and TaggedInputSplit to the new Map/Reduce API
---
-* [HDFS-1012](https://issues.apache.org/jira/browse/HDFS-1012) | *Major* | **documentLocation attribute in LdapEntry for HDFSProxy isn't specific to a cluster**
+* [MAPREDUCE-373](https://issues.apache.org/jira/browse/MAPREDUCE-373) | *Major* | **Change org.apache.hadoop.mapred.lib. FieldSelectionMapReduce to use new api.**
-Support for fully qualified HDFS path in addition to simple unqualified path.
-The qualified path indicates that the path is accessible on the specific HDFS. Non qualified path is qualified in all clusters.
+Ports FieldSelectionMapReduce to the new Map/Reduce API
---
-* [HDFS-998](https://issues.apache.org/jira/browse/HDFS-998) | *Major* | **The servlets should quote server generated strings sent in the response**
+* [MAPREDUCE-793](https://issues.apache.org/jira/browse/MAPREDUCE-793) | *Major* | **Create a new test that consolidates a few tests to be included in the commit-test list**
-The servlets should quote server generated strings sent in the response.
+Creates a new test to test several miscellaneous functionality at one shot instead of running a job for each, to be used as a fast test for the ant commit-tests target.
---
-* [HDFS-985](https://issues.apache.org/jira/browse/HDFS-985) | *Major* | **HDFS should issue multiple RPCs for listing a large directory**
+* [MAPREDUCE-809](https://issues.apache.org/jira/browse/MAPREDUCE-809) | *Major* | **Job summary logs show status of completed jobs as RUNNING**
-**WARNING: No release note provided for this incompatible change.**
+Fix job-summary logs to correctly record final status of FAILED and KILLED jobs.
---
-* [HDFS-984](https://issues.apache.org/jira/browse/HDFS-984) | *Major* | **Delegation Tokens should be persisted in Namenode**
+* [MAPREDUCE-797](https://issues.apache.org/jira/browse/MAPREDUCE-797) | *Major* | **MRUnit MapReduceDriver should support combiners**
-Layout version is set to -24 reflecting changes in edits log and fsimage format related to persisting delegation tokens.
+Add Combiner support to MapReduceDriver in MRUnit
---
-* [HDFS-946](https://issues.apache.org/jira/browse/HDFS-946) | *Major* | **NameNode should not return full path name when lisitng a diretory or getting the status of a file**
+* [HDFS-514](https://issues.apache.org/jira/browse/HDFS-514) | *Major* | **DFSClient.namenode is a public field. Should be private.**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [HDFS-913](https://issues.apache.org/jira/browse/HDFS-913) | *Major* | **TestRename won't run automatically from 'run-test-hdfs-faul-inject' target**
+* [MAPREDUCE-760](https://issues.apache.org/jira/browse/MAPREDUCE-760) | *Major* | **TestNodeRefresh might not work as expected**
-HDFS-913. Rename fault injection test TestRename.java to TestFiRename.java to include it in tests run by ant target run-test-hdfs-fault-inject.
+TestNodeRefresh waits for the newly added tracker to join before starting the testing.
---
-* [HDFS-897](https://issues.apache.org/jira/browse/HDFS-897) | *Major* | **ReplicasMap remove has a bug in generation stamp comparison**
+* [MAPREDUCE-766](https://issues.apache.org/jira/browse/MAPREDUCE-766) | *Major* | **Enhance -list-blacklisted-trackers to display host name, blacklisted reason and blacklist report.**
-Fixed a bug in ReplicasMap.remove method, which compares the generation stamp of the replica removed to itself instead of the the block passed to the method to identify the replica to be removed.
+Enhanced -list-blacklisted-trackers to include the reason for blacklisting a node. Modified JobSubmissionProtocol's version as the ClusterStatus is changed to have a new class. The format of the -list-blacklisted-trackers command line interface has also changed to show the reason.
---
-* [HDFS-892](https://issues.apache.org/jira/browse/HDFS-892) | *Major* | **optionally use Avro for namenode RPC**
+* [MAPREDUCE-656](https://issues.apache.org/jira/browse/MAPREDUCE-656) | *Major* | **Change org.apache.hadoop.mapred.SequenceFile\* classes to use new api**
-**WARNING: No release note provided for this incompatible change.**
+Ports the SequenceFile\* classes to the new Map/Reduce API
---
-* [HDFS-873](https://issues.apache.org/jira/browse/HDFS-873) | *Major* | **DataNode directories as URIs**
+* [MAPREDUCE-670](https://issues.apache.org/jira/browse/MAPREDUCE-670) | *Major* | ** Create target for 10 minute patch test build for mapreduce**
-**WARNING: No release note provided for this incompatible change.**
+Added a new target 'test-commit' to the build.xml file which runs tests specified in the file src/test/commit-tests. The tests specified in src/test/commit-tests should provide maximum coverage and all the tests should run within 10mins.
---
-* [HDFS-850](https://issues.apache.org/jira/browse/HDFS-850) | *Minor* | **Display more memory details on the web ui**
+* [MAPREDUCE-408](https://issues.apache.org/jira/browse/MAPREDUCE-408) | *Major* | **TestKillSubProcesses fails with assertion failure sometimes**
-Changes the format of the message with Heap usage on the NameNode web page.
+Fixed a bug in the testcase TestKillSubProcesses.
---
-* [HDFS-814](https://issues.apache.org/jira/browse/HDFS-814) | *Major* | **Add an api to get the visible length of a DFSDataInputStream.**
+* [MAPREDUCE-375](https://issues.apache.org/jira/browse/MAPREDUCE-375) | *Major* | ** Change org.apache.hadoop.mapred.lib.NLineInputFormat and org.apache.hadoop.mapred.MapFileOutputFormat to use new api.**
-Add an api to get the visible length of a DFSDataInputStream.
+Ports NLineInputFormat and MapFileOutputFormat to the new Map/Reduce API
---
-* [HDFS-793](https://issues.apache.org/jira/browse/HDFS-793) | *Blocker* | **DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet**
+* [MAPREDUCE-814](https://issues.apache.org/jira/browse/MAPREDUCE-814) | *Major* | **Move completed Job history files to HDFS**
-**WARNING: No release note provided for this incompatible change.**
+Provides an ability to move completed job history files to a HDFS location via configuring "mapred.job.tracker.history.completed.location". If the directory location does not already exist, it would be created by jobtracker.
---
-* [HDFS-785](https://issues.apache.org/jira/browse/HDFS-785) | *Minor* | **Missing license header in java source files.**
+* [MAPREDUCE-845](https://issues.apache.org/jira/browse/MAPREDUCE-845) | *Minor* | **build.xml hard codes findbugs heap size, in some configurations 512M is insufficient to successfully build**
-Add the Apache license header to several files that are missing it.
+Changes the heapsize for findbugs to a parameter which can be changed on the build command line.
---
-* [HDFS-781](https://issues.apache.org/jira/browse/HDFS-781) | *Blocker* | **Metrics PendingDeletionBlocks is not decremented**
+* [MAPREDUCE-817](https://issues.apache.org/jira/browse/MAPREDUCE-817) | *Major* | **Add a cache for retired jobs with minimal job info and provide a way to access history file url**
-Correct PendingDeletionBlocks metric to properly decrement counts.
+Provides a way to configure the cache of JobStatus objects for the retired jobs.
+Adds an API in RunningJob to access history file url.
+Adds a LRU based cache for job history files loaded in memory when accessed via JobTracker web UI.
+Adds Retired Jobs table on the Jobtracker UI. The job move from Running to Completed/Failed table. Then job move to Retired table when it is purged from memory. The Retired table shows last 100 retired jobs. The Completed/Failed jobs table are only shown if there are non-zero jobs in the table.
---
-* [HDFS-764](https://issues.apache.org/jira/browse/HDFS-764) | *Major* | **Moving Access Token implementation from Common to HDFS**
+* [MAPREDUCE-848](https://issues.apache.org/jira/browse/MAPREDUCE-848) | *Major* | **TestCapacityScheduler is failing**
-**WARNING: No release note provided for this incompatible change.**
+MAPREDUCE-805 changed the way the job was initialized. Capacity schedulers testcases were not modified as part of MAPREDUCE-805. This patch fixes this bug.
---
-* [HDFS-761](https://issues.apache.org/jira/browse/HDFS-761) | *Major* | **Failure to process rename operation from edits log due to quota verification**
+* [MAPREDUCE-842](https://issues.apache.org/jira/browse/MAPREDUCE-842) | *Major* | **Per-job local data on the TaskTracker node should have right access-control**
-Corrected an error when checking quota policy that resulted in a failure to read the edits log, stopping the primary/secondary name node.
+Modified TaskTracker and related classes so that per-job local data on the TaskTracker node has right access-control. Important changes:
+ - All files/directories of the job on the TaskTracker are now user-owned by the job-owner and group-owner by a special TaskTracker's group.
+ - The permissions of the file/directories are set to the most restrictive permissions possible.
+ - Files/dirs shareable by all tasks of the job on this TT are set proper access control as soon as possible, i.e immediately after job-localization and those that are private to a single task are set access control after the corresponding task's localization.
+ - Also fixes MAPREDUCE-131 which is related to a bug because of which tasks hang when the taskcontroller.cfg has multiple entries for mapred.local.dir
+ - A new configuration entry hadoop.log.dir corresponding to the hadoop.log.dir in TT's configuration is now needed in task-controller.cfg so as to support restricted access control for userlogs of the tasks on the TaskTracker.
---
-* [HDFS-758](https://issues.apache.org/jira/browse/HDFS-758) | *Major* | **Improve reporting of progress of decommissioning**
+* [MAPREDUCE-706](https://issues.apache.org/jira/browse/MAPREDUCE-706) | *Major* | **Support for FIFO pools in the fair scheduler**
-New name node web UI page displays details of decommissioning progress. (dfsnodelist.jsp?whatNodes=DECOMMISSIONING)
+Support for FIFO pools added to the Fair Scheduler.
---
-* [HDFS-737](https://issues.apache.org/jira/browse/HDFS-737) | *Major* | **Improvement in metasave output**
+* [MAPREDUCE-852](https://issues.apache.org/jira/browse/MAPREDUCE-852) | *Major* | **ExampleDriver is incorrectly set as a Main-Class in tools in build.xml**
-Add full path name of the file to the under replicated block information and summary of total number of files, blocks, live and dead datanodes to metasave output.
+Changed the target name from "tools-jar" to "tools" in build.xml.
---
-* [HDFS-702](https://issues.apache.org/jira/browse/HDFS-702) | *Major* | **Add Hdfs Impl for the new file system interface**
+* [HDFS-457](https://issues.apache.org/jira/browse/HDFS-457) | *Major* | **better handling of volume failure in Data Node storage**
-Add HDFS implementation of AbstractFileSystem.
+Datanode can continue if a volume for replica storage fails. Previously a datanode resigned if any volume failed.
---
-* [HDFS-677](https://issues.apache.org/jira/browse/HDFS-677) | *Blocker* | **Rename failure due to quota results in deletion of src directory**
+* [MAPREDUCE-773](https://issues.apache.org/jira/browse/MAPREDUCE-773) | *Major* | **LineRecordReader can report non-zero progress while it is processing a compressed stream**
-Rename properly considers the case where both source and destination are over quota; operation will fail with error indication.
+Modifies LineRecordReader to report an approximate progress, instead of just returning 0, when using compressed streams.
---
-* [HDFS-660](https://issues.apache.org/jira/browse/HDFS-660) | *Major* | **Remove deprecated methods from InterDatanodeProtocol.**
+* [MAPREDUCE-711](https://issues.apache.org/jira/browse/MAPREDUCE-711) | *Major* | **Move Distributed Cache from Common to Map/Reduce**
-**WARNING: No release note provided for this incompatible change.**
+- Removed distributed cache classes and package from the Common project.
+- Added the same to the mapreduce project.
+- This will mean that users using Distributed Cache will now necessarily need the mapreduce jar in Hadoop 0.21.
+- Modified the package name to o.a.h.mapreduce.filecache from o.a.h.filecache and deprecated the old package name.
---
-* [HDFS-631](https://issues.apache.org/jira/browse/HDFS-631) | *Major* | **Changes in HDFS to rename the config keys as detailed in HDFS-531.**
+* [MAPREDUCE-870](https://issues.apache.org/jira/browse/MAPREDUCE-870) | *Major* | **Clean up the job Retire code**
-File system configuration keys renamed as a step toward API standardization and backward compatibility.
+Removed the Job Retire thread and the associated configuration parameters. Job is purged from memory as soon as the history file is copied to HDFS. Only JobStatus object is retained in the retired jobs cache.
---
-* [HDFS-630](https://issues.apache.org/jira/browse/HDFS-630) | *Major* | **In DFSOutputStream.nextBlockOutputStream(), the client can exclude specific datanodes when locating the next block.**
+* [MAPREDUCE-800](https://issues.apache.org/jira/browse/MAPREDUCE-800) | *Major* | **MRUnit should support the new API**
-**WARNING: No release note provided for this incompatible change.**
+Support new API in unit tests developed with MRUnit.
---
-* [HDFS-625](https://issues.apache.org/jira/browse/HDFS-625) | *Major* | **ListPathsServlet throws NullPointerException**
+* [HADOOP-6201](https://issues.apache.org/jira/browse/HADOOP-6201) | *Major* | **FileSystem::ListStatus should throw FileNotFoundException**
-Corrected error where listing path no longer in name space could stop ListPathsServlet until system restarted.
+FileSystem listStatus method throws FileNotFoundException for all implementations. Application code should catch or propagate FileNotFoundException.
---
-* [HDFS-618](https://issues.apache.org/jira/browse/HDFS-618) | *Major* | **Support for non-recursive mkdir in HDFS**
+* [HDFS-538](https://issues.apache.org/jira/browse/HDFS-538) | *Major* | **DistributedFileSystem::listStatus incorrectly returns null for empty result sets**
-New DFSClient.mkdir(...) allows option of not creating missing parent(s).
+FileSystem.listStatus() previously returned null for empty or nonexistent directories; will now return empty array for empty directories and throw FileNotFoundException for non-existent directory. Client code should be updated for new semantics.
---
-* [HDFS-617](https://issues.apache.org/jira/browse/HDFS-617) | *Major* | **Support for non-recursive create() in HDFS**
+* [MAPREDUCE-895](https://issues.apache.org/jira/browse/MAPREDUCE-895) | *Major* | **FileSystem::ListStatus will now throw FileNotFoundException, MapRed needs updated**
-New DFSClient.create(...) allows option of not creating missing parent(s).
+The semantics for dealing with non-existent paths passed to FileSystem::listStatus() were updated and solidified in HADOOP-6201 and HDFS-538. Existing code within MapReduce that relied on the previous behavior of some FileSystem implementations of returning null has been updated to catch or propagate a FileNotFoundException, per the method's contract.
---
-* [HDFS-602](https://issues.apache.org/jira/browse/HDFS-602) | *Major* | **Atempt to make a directory under an existing file on DistributedFileSystem should throw an FileAlreadyExistsException instead of FileNotFoundException**
+* [MAPREDUCE-336](https://issues.apache.org/jira/browse/MAPREDUCE-336) | *Major* | **The logging level of the tasks should be configurable by the job**
-**WARNING: No release note provided for this incompatible change.**
+Allow logging level of map/reduce tasks to be configurable.
+Configuration changes:
+ add mapred.map.child.log.level
+ add mapred.reduce.child.log.level
---
-* [HDFS-596](https://issues.apache.org/jira/browse/HDFS-596) | *Blocker* | **Memory leak in libhdfs: hdfsFreeFileInfo() in libhdfs does not free memory for mOwner and mGroup**
+* [MAPREDUCE-479](https://issues.apache.org/jira/browse/MAPREDUCE-479) | *Minor* | **Add reduce ID to shuffle clienttrace**
-Memory leak in function hdfsFreeFileInfo in libhdfs. This bug affects fuse-dfs severely.
+Adds Reduce Attempt ID to ClientTrace log messages, and adds Reduce Attempt ID to HTTP query string sent to mapOutputServlet. Extracts partition number from attempt ID.
---
-* [HDFS-595](https://issues.apache.org/jira/browse/HDFS-595) | *Major* | **FsPermission tests need to be updated for new octal configuration parameter from HADOOP-6234**
+* [MAPREDUCE-355](https://issues.apache.org/jira/browse/MAPREDUCE-355) | *Major* | **Change org.apache.hadoop.mapred.join to use new api**
-Unit tests updated to match syntax of new configuration parameters.
+Ports the mapred.join library to the new Map/Reduce API
---
-* [HDFS-578](https://issues.apache.org/jira/browse/HDFS-578) | *Major* | **Support for using server default values for blockSize and replication when creating a file**
+* [HADOOP-6184](https://issues.apache.org/jira/browse/HADOOP-6184) | *Major* | **Provide a configuration dump in json format.**
-New FileSystem.getServerDefaults() reports the server's default file creation parameters.
+New Configuration.dumpConfiguration(Configuration, Writer) writes configuration parameters in the JSON format.
---
-* [HDFS-567](https://issues.apache.org/jira/browse/HDFS-567) | *Major* | **Two contrib tools to facilitate searching for block history information**
+* [MAPREDUCE-798](https://issues.apache.org/jira/browse/MAPREDUCE-798) | *Major* | **MRUnit should be able to test a succession of MapReduce passes**
-New contribution Block Forensics aids investigation of missing blocks.
+Add PipelineMapReduceDriver to MRUnit to support testing a pipeline of MapReduce passes
---
-* [HDFS-538](https://issues.apache.org/jira/browse/HDFS-538) | *Major* | **DistributedFileSystem::listStatus incorrectly returns null for empty result sets**
+* [MAPREDUCE-476](https://issues.apache.org/jira/browse/MAPREDUCE-476) | *Minor* | **extend DistributedCache to work locally (LocalJobRunner)**
-FileSystem.listStatus() previously returned null for empty or nonexistent directories; will now return empty array for empty directories and throw FileNotFoundException for non-existent directory. Client code should be updated for new semantics.
+Extended DistributedCache to work with LocalJobRunner.
---
-* [HDFS-514](https://issues.apache.org/jira/browse/HDFS-514) | *Major* | **DFSClient.namenode is a public field. Should be private.**
+* [MAPREDUCE-768](https://issues.apache.org/jira/browse/MAPREDUCE-768) | *Major* | **Configuration information should generate dump in a standard format.**
-**WARNING: No release note provided for this incompatible change.**
+Provides an ability to dump jobtracker configuration in JSON format to standard output and exits.
+To dump, use hadoop jobtracker -dumpConfiguration
+The format of the dump is {"properties":[{"key":\<key\>,"value":\<value\>,"isFinal":\<true/false\>,"resource" : \<resource\>}] }
---
-* [HDFS-512](https://issues.apache.org/jira/browse/HDFS-512) | *Major* | **Set block id as the key to Block**
+* [MAPREDUCE-788](https://issues.apache.org/jira/browse/MAPREDUCE-788) | *Major* | **Modify gridmix2 to use new api.**
-**WARNING: No release note provided for this incompatible change.**
+Modifies Gridmix2 to use the new Map/Reduce API
---
-* [HDFS-503](https://issues.apache.org/jira/browse/HDFS-503) | *Major* | **Implement erasure coding as a layer on HDFS**
+* [MAPREDUCE-824](https://issues.apache.org/jira/browse/MAPREDUCE-824) | *Major* | **Support a hierarchy of queues in the capacity scheduler**
-This patch implements an optional layer over HDFS that implements offline erasure-coding. It can be used to reduce the total storage requirements of DFS.
+Support hierarchical queues in the CapacityScheduler to allow for more predictable sharing of cluster resources.
---
-* [HDFS-492](https://issues.apache.org/jira/browse/HDFS-492) | *Major* | **Expose corrupt replica/block information**
+* [MAPREDUCE-871](https://issues.apache.org/jira/browse/MAPREDUCE-871) | *Major* | **Job/Task local files have incorrect group ownership set by LinuxTaskController binary**
-New server web pages provide block information: corrupt\_replicas\_xml and block\_info\_xml.
+Fixed LinuxTaskController binary so that permissions of local files on TT are set correctly: user owned by the job-owner and group-owned by the group owner of the binary and \_not\_ the primary group of the TaskTracker.
---
-* [HDFS-457](https://issues.apache.org/jira/browse/HDFS-457) | *Major* | **better handling of volume failure in Data Node storage**
+* [HDFS-492](https://issues.apache.org/jira/browse/HDFS-492) | *Major* | **Expose corrupt replica/block information**
-Datanode can continue if a volume for replica storage fails. Previously a datanode resigned if any volume failed.
+New server web pages provide block information: corrupt\_replicas\_xml and block\_info\_xml.
---
-* [HDFS-385](https://issues.apache.org/jira/browse/HDFS-385) | *Major* | **Design a pluggable interface to place replicas of blocks in HDFS**
+* [MAPREDUCE-873](https://issues.apache.org/jira/browse/MAPREDUCE-873) | *Major* | **Simplify Job Recovery**
-New experimental API BlockPlacementPolicy allows investigating alternate rules for locating block replicas.
+Simplifies job recovery. On jobtracker restart, incomplete jobs are resubmitted and all tasks reexecute.
+This JIRA removes a public constructor in JobInProgress.
---
-* [HDFS-288](https://issues.apache.org/jira/browse/HDFS-288) | *Major* | **Redundant computation in hashCode() implemenation**
+* [HADOOP-6226](https://issues.apache.org/jira/browse/HADOOP-6226) | *Major* | **Create a LimitedByteArrayOutputStream that does not expand its buffer on write**
-**WARNING: No release note provided for this incompatible change.**
+New LimitedByteArrayOutputStream does not expand buffer on writes.
---
-* [HDFS-245](https://issues.apache.org/jira/browse/HDFS-245) | *Major* | **Create symbolic links in HDFS**
+* [MAPREDUCE-318](https://issues.apache.org/jira/browse/MAPREDUCE-318) | *Major* | **Refactor reduce shuffle code**
-HDFS-245. Adds a symlink implementation to HDFS. This complements the new symlink feature added in HADOOP-6421
+Refactors shuffle code out of ReduceTask into separate classes in a new package(org.apache.hadoop.mapreduce.task.reduce)
+Incorporates MAPREDUCE-240, batches up several map output files from a TT to a reducer in a single transfer
+Introduces new Shuffle counters to keep track of shuffle errors
---
-* [HDFS-235](https://issues.apache.org/jira/browse/HDFS-235) | *Major* | **Add support for byte-ranges to hftp**
+* [MAPREDUCE-370](https://issues.apache.org/jira/browse/MAPREDUCE-370) | *Major* | **Change org.apache.hadoop.mapred.lib.MultipleOutputs to use new api.**
-HFTP can now serve a specific byte range from a file
+Ports MultipleOutputs to the new Map/Reduce API
---
-* [MAPREDUCE-1747](https://issues.apache.org/jira/browse/MAPREDUCE-1747) | *Blocker* | **Remove documentation for the 'unstable' job-acls feature**
+* [MAPREDUCE-943](https://issues.apache.org/jira/browse/MAPREDUCE-943) | *Major* | **TestNodeRefresh timesout occasionally**
-Removed the documentation for the 'unstable' job-acls feature from branch 0.21.
+TestNodeRefresh timed out as the code to do with node refresh got removed. This patch removes the testcase.
---
-* [MAPREDUCE-1727](https://issues.apache.org/jira/browse/MAPREDUCE-1727) | *Major* | **TestJobACLs fails after HADOOP-6686**
+* [HDFS-288](https://issues.apache.org/jira/browse/HDFS-288) | *Major* | **Redundant computation in hashCode() implemenation**
-Fixed a testcase problem in TestJobACLs.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-1697](https://issues.apache.org/jira/browse/MAPREDUCE-1697) | *Major* | **Document the behavior of -file option in streaming and deprecate it in favour of generic -files option.**
+* [HADOOP-6230](https://issues.apache.org/jira/browse/HADOOP-6230) | *Major* | **Move process tree, and memory calculator classes out of Common into Map/Reduce.**
-Documented the behavior of -file option in streaming and deprecated it in favor of generic -files option.
+Moved process tree, and memory calculator classes out of Common project into the Map/Reduce project.
---
-* [MAPREDUCE-1692](https://issues.apache.org/jira/browse/MAPREDUCE-1692) | *Minor* | **Remove TestStreamedMerge from the streaming tests**
+* [HADOOP-6203](https://issues.apache.org/jira/browse/HADOOP-6203) | *Major* | **Improve error message when moving to trash fails due to quota issue**
-Removed streaming testcase which tested non-existent functionality in Streaming.
+Improved error message suggests using -skpTrash option when hdfs -rm fails to move to trash because of quota.
---
-* [MAPREDUCE-1657](https://issues.apache.org/jira/browse/MAPREDUCE-1657) | *Major* | **After task logs directory is deleted, tasklog servlet displays wrong error message about job ACLs**
+* [MAPREDUCE-144](https://issues.apache.org/jira/browse/MAPREDUCE-144) | *Major* | **TaskMemoryManager should log process-tree's status while killing tasks.**
-Fixed a bug in tasklog servlet which displayed wrong error message about job ACLs - an access control error instead of the expected log files gone error - after task logs directory is deleted.
+Modified TaskMemoryManager so that it logs a map/reduce task's process-tree's status just before it is killed when it grows out of its configured memory limits. The log dump is in the format " \|- PID PPID PGRPID SESSID CMD\_NAME VMEM\_USAGE(BYTES) FULL\_CMD\_LINE".
+
+This is useful for debugging the cause for a map/reduce task and it's corresponding process-tree to be killed by the TaskMemoryManager.
---
-* [MAPREDUCE-1635](https://issues.apache.org/jira/browse/MAPREDUCE-1635) | *Major* | **ResourceEstimator does not work after MAPREDUCE-842**
+* [HADOOP-6235](https://issues.apache.org/jira/browse/HADOOP-6235) | *Major* | **Adding a new method for getting server default values from a FileSystem**
-Fixed a bug related to resource estimation for disk-based scheduling by modifying TaskTracker to return correct map output size for the completed maps and -1 for other tasks or failures.
+New FileSystem method reports default parameters that would be used by server. See also HDFS-578.
---
-* [MAPREDUCE-1612](https://issues.apache.org/jira/browse/MAPREDUCE-1612) | *Major* | **job conf file is not accessible from job history web page**
+* [HDFS-578](https://issues.apache.org/jira/browse/HDFS-578) | *Major* | **Support for using server default values for blockSize and replication when creating a file**
-Fixed a bug related to access of job\_conf.xml from the history web page of a job.
+New FileSystem.getServerDefaults() reports the server's default file creation parameters.
---
-* [MAPREDUCE-1611](https://issues.apache.org/jira/browse/MAPREDUCE-1611) | *Blocker* | **Refresh nodes and refresh queues doesnt work with service authorization enabled**
+* [HDFS-595](https://issues.apache.org/jira/browse/HDFS-595) | *Major* | **FsPermission tests need to be updated for new octal configuration parameter from HADOOP-6234**
-Fixed a bug that caused all the AdminOperationsProtocol operations to fail when service-level authorization is enabled. The problem is solved by registering AdminOperationsProtocol also with MapReducePolicyProvider.
+Unit tests updated to match syntax of new configuration parameters.
---
-* [MAPREDUCE-1610](https://issues.apache.org/jira/browse/MAPREDUCE-1610) | *Major* | **Forrest documentation should be updated to reflect the changes in MAPREDUCE-856**
+* [HADOOP-6234](https://issues.apache.org/jira/browse/HADOOP-6234) | *Major* | **Permission configuration files should use octal and symbolic**
-Updated forrest documentation to reflect the changes to make localized files from DistributedCache have right access-control on TaskTrackers(MAPREDUCE-856).
+New configuration option dfs.umaskmode sets umask with octal or symbolic value.
---
-* [MAPREDUCE-1609](https://issues.apache.org/jira/browse/MAPREDUCE-1609) | *Major* | **TaskTracker.localizeJob should not set permissions on job log directory recursively**
+* [HDFS-235](https://issues.apache.org/jira/browse/HDFS-235) | *Major* | **Add support for byte-ranges to hftp**
-Fixed TaskTracker so that it does not set permissions on job-log directory recursively. This fix both improves the performance of job localization as well as avoids a bug related to launching of task-cleanup attempts after TaskTracker's restart.
+HFTP can now serve a specific byte range from a file
---
-* [MAPREDUCE-1607](https://issues.apache.org/jira/browse/MAPREDUCE-1607) | *Major* | **Task controller may not set permissions for a task cleanup attempt's log directory**
+* [HADOOP-5073](https://issues.apache.org/jira/browse/HADOOP-5073) | *Major* | **Hadoop 1.0 Interface Classification - scope (visibility - public/private) and stability**
-Fixed initialization of a task-cleanup attempt's log directory by setting correct permissions via task-controller. Added new log4j properties hadoop.tasklog.iscleanup and log4j.appender.TLA.isCleanup to conf/log4j.properties. Changed the userlogs for a task-cleanup attempt to go into its own directory instead of the original attempt directory. This is an incompatible change as old userlogs of cleanup attempt-dirs before this release will no longer be visible.
+Annotation mechanism enables interface classification.
---
-* [MAPREDUCE-1606](https://issues.apache.org/jira/browse/MAPREDUCE-1606) | *Major* | **TestJobACLs may timeout as there are no slots for launching JOB\_CLEANUP task**
+* [MAPREDUCE-963](https://issues.apache.org/jira/browse/MAPREDUCE-963) | *Major* | **mapred's FileAlreadyExistsException should be deprecated in favor of hadoop-common's one.**
-Fixed TestJobACLs test timeout failure because of no slots for launching JOB\_CLEANUP task.
+Deprecate o.a.h.mapred.FileAlreadyExistsException and replace it with o.a.h.fs.FileAlreadyExistsException.
---
-* [MAPREDUCE-1568](https://issues.apache.org/jira/browse/MAPREDUCE-1568) | *Major* | **TrackerDistributedCacheManager should clean up cache in a background thread**
+* [HADOOP-4012](https://issues.apache.org/jira/browse/HADOOP-4012) | *Major* | **Providing splitting support for bzip2 compressed files**
-MAPREDUCE-1568. TrackerDistributedCacheManager should clean up cache in a background thread. (Scott Chen via zshao)
+BZip2 files can now be split.
---
-* [MAPREDUCE-1493](https://issues.apache.org/jira/browse/MAPREDUCE-1493) | *Major* | **Authorization for job-history pages**
+* [MAPREDUCE-830](https://issues.apache.org/jira/browse/MAPREDUCE-830) | *Major* | **Providing BZip2 splitting support for Text data**
-Added web-authorization for job-history pages. This is an incompatible change - it changes the JobHistory format by adding job-acls to job-history files and JobHistory currently does not have the support to read older versions of history files.
+Splitting support for BZip2 Text data
---
-* [MAPREDUCE-1482](https://issues.apache.org/jira/browse/MAPREDUCE-1482) | *Major* | **Better handling of task diagnostic information stored in the TaskInProgress**
+* [HDFS-602](https://issues.apache.org/jira/browse/HDFS-602) | *Major* | **Atempt to make a directory under an existing file on DistributedFileSystem should throw an FileAlreadyExistsException instead of FileNotFoundException**
-Limit the size of diagnostics-string and state-string shipped as part of task status. This will help keep the JobTracker's memory usage under control. Diagnostic string and state string are capped to 1024 chars.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-1476](https://issues.apache.org/jira/browse/MAPREDUCE-1476) | *Major* | **committer.needsTaskCommit should not be called for a task cleanup attempt**
+* [HADOOP-5879](https://issues.apache.org/jira/browse/HADOOP-5879) | *Major* | **GzipCodec should read compression level etc from configuration**
-Fixed Map/Reduce framework to not call commit task for special tasks like job setup/cleanup and task cleanup.
+Provide an ability to configure the compression level and strategy for codecs. Compressors need to be 'reinited' with new characteristics such as compression level etc. and hence an incompatible addition to the api.
---
-* [MAPREDUCE-1466](https://issues.apache.org/jira/browse/MAPREDUCE-1466) | *Minor* | **FileInputFormat should save #input-files in JobConf**
+* [MAPREDUCE-856](https://issues.apache.org/jira/browse/MAPREDUCE-856) | *Major* | **Localized files from DistributedCache should have right access-control**
-Added a private configuration variable mapreduce.input.num.files, to store num
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[16/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.0-alpha/CHANGES.2.0.0-alpha.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.0-alpha/CHANGES.2.0.0-alpha.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.0-alpha/CHANGES.2.0.0-alpha.md
index 13179e4..6599034 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.0-alpha/CHANGES.2.0.0-alpha.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.0-alpha/CHANGES.2.0.0-alpha.md
@@ -24,48 +24,42 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8314](https://issues.apache.org/jira/browse/HADOOP-8314) | HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8270](https://issues.apache.org/jira/browse/HADOOP-8270) | hadoop-daemon.sh stop action should return 0 for an already stopped service | Minor | scripts | Roman Shaposhnik | Roman Shaposhnik |
-| [HADOOP-8184](https://issues.apache.org/jira/browse/HADOOP-8184) | ProtoBuf RPC engine does not need it own reply packet - it can use the IPC layer reply packet. | Major | ipc | Sanjay Radia | Sanjay Radia |
+| [HDFS-395](https://issues.apache.org/jira/browse/HDFS-395) | DFS Scalability: Incremental block reports | Major | datanode, namenode | dhruba borthakur | Tomasz Nykiel |
+| [HADOOP-7524](https://issues.apache.org/jira/browse/HADOOP-7524) | Change RPC to allow multiple protocols including multiple versions of the same protocol | Major | ipc | Sanjay Radia | Sanjay Radia |
+| [HDFS-2303](https://issues.apache.org/jira/browse/HDFS-2303) | Unbundle jsvc | Major | build, scripts | Roman Shaposhnik | Mingjie Lai |
+| [HDFS-3044](https://issues.apache.org/jira/browse/HDFS-3044) | fsck move should be non-destructive by default | Major | namenode | Eli Collins | Colin P. McCabe |
| [HADOOP-8154](https://issues.apache.org/jira/browse/HADOOP-8154) | DNS#getIPs shouldn't silently return the local host IP for bogus interface names | Major | conf | Eli Collins | Eli Collins |
+| [HADOOP-8184](https://issues.apache.org/jira/browse/HADOOP-8184) | ProtoBuf RPC engine does not need it own reply packet - it can use the IPC layer reply packet. | Major | ipc | Sanjay Radia | Sanjay Radia |
| [HADOOP-8149](https://issues.apache.org/jira/browse/HADOOP-8149) | cap space usage of default log4j rolling policy | Major | conf | Patrick Hunt | Patrick Hunt |
-| [HADOOP-7524](https://issues.apache.org/jira/browse/HADOOP-7524) | Change RPC to allow multiple protocols including multiple versions of the same protocol | Major | ipc | Sanjay Radia | Sanjay Radia |
-| [HDFS-3286](https://issues.apache.org/jira/browse/HDFS-3286) | When the threshold value for balancer is 0(zero) ,unexpected output is displayed | Major | balancer & mover | J.Andreina | Ashish Singhi |
+| [HDFS-3137](https://issues.apache.org/jira/browse/HDFS-3137) | Bump LAST\_UPGRADABLE\_LAYOUT\_VERSION to -16 | Major | namenode | Eli Collins | Eli Collins |
+| [HDFS-3138](https://issues.apache.org/jira/browse/HDFS-3138) | Move DatanodeInfo#ipcPort to DatanodeID | Major | . | Eli Collins | Eli Collins |
| [HDFS-3164](https://issues.apache.org/jira/browse/HDFS-3164) | Move DatanodeInfo#hostName to DatanodeID | Major | datanode | Eli Collins | Eli Collins |
| [HDFS-3144](https://issues.apache.org/jira/browse/HDFS-3144) | Refactor DatanodeID#getName by use | Major | datanode | Eli Collins | Eli Collins |
-| [HDFS-3138](https://issues.apache.org/jira/browse/HDFS-3138) | Move DatanodeInfo#ipcPort to DatanodeID | Major | . | Eli Collins | Eli Collins |
-| [HDFS-3137](https://issues.apache.org/jira/browse/HDFS-3137) | Bump LAST\_UPGRADABLE\_LAYOUT\_VERSION to -16 | Major | namenode | Eli Collins | Eli Collins |
-| [HDFS-3044](https://issues.apache.org/jira/browse/HDFS-3044) | fsck move should be non-destructive by default | Major | namenode | Eli Collins | Colin Patrick McCabe |
-| [HDFS-2303](https://issues.apache.org/jira/browse/HDFS-2303) | Unbundle jsvc | Major | build, scripts | Roman Shaposhnik | Mingjie Lai |
-| [HDFS-395](https://issues.apache.org/jira/browse/HDFS-395) | DFS Scalability: Incremental block reports | Major | datanode, namenode | dhruba borthakur | Tomasz Nykiel |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-8270](https://issues.apache.org/jira/browse/HADOOP-8270) | hadoop-daemon.sh stop action should return 0 for an already stopped service | Minor | scripts | Roman Shaposhnik | Roman Shaposhnik |
+| [HADOOP-8314](https://issues.apache.org/jira/browse/HADOOP-8314) | HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3286](https://issues.apache.org/jira/browse/HDFS-3286) | When the threshold value for balancer is 0(zero) ,unexpected output is displayed | Major | balancer & mover | J.Andreina | Ashish Singhi |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8343](https://issues.apache.org/jira/browse/HADOOP-8343) | Allow configuration of authorization for JmxJsonServlet and MetricsServlet | Major | util | Philip Zeyliger | Alejandro Abdelnur |
-| [HADOOP-8206](https://issues.apache.org/jira/browse/HADOOP-8206) | Common portion of ZK-based failover controller | Major | ha | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8121](https://issues.apache.org/jira/browse/HADOOP-8121) | Active Directory Group Mapping Service | Major | security | Jonathan Natkins | Jonathan Natkins |
| [HADOOP-7876](https://issues.apache.org/jira/browse/HADOOP-7876) | Allow access to BlockKey/DelegationKey encoded key for RPC over protobuf | Major | ipc | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-7806](https://issues.apache.org/jira/browse/HADOOP-7806) | Support binding to sub-interfaces | Major | util | Harsh J | Harsh J |
+| [HDFS-2430](https://issues.apache.org/jira/browse/HDFS-2430) | The number of failed or low-resource volumes the NN can tolerate should be configurable | Major | namenode | Aaron T. Myers | Aaron T. Myers |
| [HADOOP-7454](https://issues.apache.org/jira/browse/HADOOP-7454) | Common side of High Availability Framework (HDFS-1623) | Major | . | Aaron T. Myers | |
+| [HDFS-1623](https://issues.apache.org/jira/browse/HDFS-1623) | High Availability Framework for HDFS NN | Major | . | Sanjay Radia | |
+| [HDFS-2731](https://issues.apache.org/jira/browse/HDFS-2731) | HA: Autopopulate standby name dirs if they're empty | Major | ha | Aaron T. Myers | Todd Lipcon |
+| [HADOOP-8121](https://issues.apache.org/jira/browse/HADOOP-8121) | Active Directory Group Mapping Service | Major | security | Jonathan Natkins | Jonathan Natkins |
+| [HADOOP-7806](https://issues.apache.org/jira/browse/HADOOP-7806) | Support binding to sub-interfaces | Major | util | Harsh J | Harsh J |
| [HADOOP-7030](https://issues.apache.org/jira/browse/HADOOP-7030) | Add TableMapping topology implementation to read host to rack mapping from a file | Major | . | Patrick Angeles | Tom White |
+| [HDFS-2941](https://issues.apache.org/jira/browse/HDFS-2941) | Add an administrative command to download a copy of the fsimage from the NN | Major | hdfs-client, namenode | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-8206](https://issues.apache.org/jira/browse/HADOOP-8206) | Common portion of ZK-based failover controller | Major | ha | Todd Lipcon | Todd Lipcon |
| [HDFS-3167](https://issues.apache.org/jira/browse/HDFS-3167) | CLI-based driver for MiniDFSCluster | Minor | test | Henry Robinson | Henry Robinson |
| [HDFS-3148](https://issues.apache.org/jira/browse/HDFS-3148) | The client should be able to use multiple local interfaces for data transfer | Major | hdfs-client, performance | Eli Collins | Eli Collins |
-| [HDFS-3102](https://issues.apache.org/jira/browse/HDFS-3102) | Add CLI tool to initialize the shared-edits dir | Major | ha, namenode | Todd Lipcon | Aaron T. Myers |
-| [HDFS-3004](https://issues.apache.org/jira/browse/HDFS-3004) | Implement Recovery Mode | Major | tools | Colin Patrick McCabe | Colin Patrick McCabe |
| [HDFS-3000](https://issues.apache.org/jira/browse/HDFS-3000) | Add a public API for setting quotas | Major | hdfs-client | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-2941](https://issues.apache.org/jira/browse/HDFS-2941) | Add an administrative command to download a copy of the fsimage from the NN | Major | hdfs-client, namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-2731](https://issues.apache.org/jira/browse/HDFS-2731) | HA: Autopopulate standby name dirs if they're empty | Major | ha | Aaron T. Myers | Todd Lipcon |
-| [HDFS-2430](https://issues.apache.org/jira/browse/HDFS-2430) | The number of failed or low-resource volumes the NN can tolerate should be configurable | Major | namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-1623](https://issues.apache.org/jira/browse/HDFS-1623) | High Availability Framework for HDFS NN | Major | . | Sanjay Radia | |
+| [HDFS-3102](https://issues.apache.org/jira/browse/HDFS-3102) | Add CLI tool to initialize the shared-edits dir | Major | ha, namenode | Todd Lipcon | Aaron T. Myers |
+| [HDFS-3004](https://issues.apache.org/jira/browse/HDFS-3004) | Implement Recovery Mode | Major | tools | Colin P. McCabe | Colin P. McCabe |
+| [HADOOP-8343](https://issues.apache.org/jira/browse/HADOOP-8343) | Allow configuration of authorization for JmxJsonServlet and MetricsServlet | Major | util | Philip Zeyliger | Alejandro Abdelnur |
| [HDFS-234](https://issues.apache.org/jira/browse/HDFS-234) | Integration with BookKeeper logging system | Major | . | Luca Telloli | Ivan Kelly |
@@ -73,245 +67,245 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8366](https://issues.apache.org/jira/browse/HADOOP-8366) | Use ProtoBuf for RpcResponseHeader | Blocker | . | Sanjay Radia | Sanjay Radia |
-| [HADOOP-8356](https://issues.apache.org/jira/browse/HADOOP-8356) | FileSystem service loading mechanism should print the FileSystem impl it is failing to load | Major | fs | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8353](https://issues.apache.org/jira/browse/HADOOP-8353) | hadoop-daemon.sh and yarn-daemon.sh can be misleading on stop | Major | scripts | Roman Shaposhnik | Roman Shaposhnik |
-| [HADOOP-8350](https://issues.apache.org/jira/browse/HADOOP-8350) | Improve NetUtils.getInputStream to return a stream which has a tunable timeout | Major | util | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8285](https://issues.apache.org/jira/browse/HADOOP-8285) | Use ProtoBuf for RpcPayLoadHeader | Major | ipc | Sanjay Radia | Sanjay Radia |
-| [HADOOP-8280](https://issues.apache.org/jira/browse/HADOOP-8280) | Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. | Major | test, util | Ahmed Radwan | Ahmed Radwan |
-| [HADOOP-8236](https://issues.apache.org/jira/browse/HADOOP-8236) | haadmin should have configurable timeouts for failover commands | Major | ha | Philip Zeyliger | Todd Lipcon |
-| [HADOOP-8214](https://issues.apache.org/jira/browse/HADOOP-8214) | make hadoop script recognize a full set of deprecated commands | Major | scripts | Roman Shaposhnik | Roman Shaposhnik |
-| [HADOOP-8200](https://issues.apache.org/jira/browse/HADOOP-8200) | Remove HADOOP\_[JOBTRACKER\|TASKTRACKER]\_OPTS | Minor | conf | Eli Collins | Eli Collins |
-| [HADOOP-8193](https://issues.apache.org/jira/browse/HADOOP-8193) | Refactor FailoverController/HAAdmin code to add an abstract class for "target" services | Major | ha | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8185](https://issues.apache.org/jira/browse/HADOOP-8185) | Update namenode -format documentation and add -nonInteractive and -force | Major | documentation | Arpit Gupta | Arpit Gupta |
-| [HADOOP-8183](https://issues.apache.org/jira/browse/HADOOP-8183) | Stop using "mapred.used.genericoptionsparser" to avoid unnecessary warnings | Minor | util | Harsh J | Harsh J |
-| [HADOOP-8163](https://issues.apache.org/jira/browse/HADOOP-8163) | Improve ActiveStandbyElector to provide hooks for fencing old active | Major | ha | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8152](https://issues.apache.org/jira/browse/HADOOP-8152) | Expand public APIs for security library classes | Major | security | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-8118](https://issues.apache.org/jira/browse/HADOOP-8118) | Print the stack trace of InstanceAlreadyExistsException in trace level | Minor | metrics | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-8117](https://issues.apache.org/jira/browse/HADOOP-8117) | Upgrade test build to Surefire 2.12 | Trivial | build, test | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8113](https://issues.apache.org/jira/browse/HADOOP-8113) | Correction to BUILDING.txt: HDFS needs ProtocolBuffer, too (not just MapReduce) | Trivial | documentation | Eugene Koontz | Eugene Koontz |
-| [HADOOP-8098](https://issues.apache.org/jira/browse/HADOOP-8098) | KerberosAuthenticatorHandler should use \_HOST replacement to resolve principal name | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8086](https://issues.apache.org/jira/browse/HADOOP-8086) | KerberosName silently sets defaultRealm to "" if the Kerberos config is not found, it should log a WARN | Minor | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8085](https://issues.apache.org/jira/browse/HADOOP-8085) | Add RPC metrics to ProtobufRpcEngine | Major | ipc, metrics | Suresh Srinivas | Hari Mankude |
-| [HADOOP-8084](https://issues.apache.org/jira/browse/HADOOP-8084) | Protobuf RPC engine can be optimized to not do copying for the RPC request/response | Major | ipc | Devaraj Das | Devaraj Das |
-| [HADOOP-8077](https://issues.apache.org/jira/browse/HADOOP-8077) | HA: fencing method should be able to be configured on a per-NN or per-NS basis | Major | ha | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8070](https://issues.apache.org/jira/browse/HADOOP-8070) | Add standalone benchmark of protobuf IPC | Major | benchmarks, ipc | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8007](https://issues.apache.org/jira/browse/HADOOP-8007) | HA: use substitution token for fencing argument | Major | ha | Aaron T. Myers | Todd Lipcon |
-| [HADOOP-7987](https://issues.apache.org/jira/browse/HADOOP-7987) | Support setting the run-as user in unsecure mode | Major | security | Devaraj Das | Jitendra Nath Pandey |
+| [MAPREDUCE-2887](https://issues.apache.org/jira/browse/MAPREDUCE-2887) | MR changes to match HADOOP-7524 (multiple RPC protocols) | Major | . | Sanjay Radia | Sanjay Radia |
+| [HDFS-2223](https://issues.apache.org/jira/browse/HDFS-2223) | Untangle depencencies between NN components | Major | namenode | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-2934](https://issues.apache.org/jira/browse/MAPREDUCE-2934) | MR portion of HADOOP-7607 - Simplify the RPC proxy cleanup process | Major | mrv2 | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-7607](https://issues.apache.org/jira/browse/HADOOP-7607) | Simplify the RPC proxy cleanup process | Major | ipc | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-7635](https://issues.apache.org/jira/browse/HADOOP-7635) | RetryInvocationHandler should release underlying resources on close | Major | ipc | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-2337](https://issues.apache.org/jira/browse/HDFS-2337) | DFSClient shouldn't keep multiple RPC proxy references | Major | hdfs-client | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-2351](https://issues.apache.org/jira/browse/HDFS-2351) | Change Namenode and Datanode to register each of their protocols seperately | Major | . | Sanjay Radia | Sanjay Radia |
+| [HADOOP-7687](https://issues.apache.org/jira/browse/HADOOP-7687) | Make getProtocolSignature public | Minor | . | Sanjay Radia | Sanjay Radia |
+| [HADOOP-7716](https://issues.apache.org/jira/browse/HADOOP-7716) | RPC protocol registration on SS does not log the protocol name (only the class which may be different) | Minor | . | Sanjay Radia | Sanjay Radia |
+| [HADOOP-7717](https://issues.apache.org/jira/browse/HADOOP-7717) | Move handling of concurrent client fail-overs to RetryInvocationHandler | Major | ipc | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-7727](https://issues.apache.org/jira/browse/HADOOP-7727) | fix some typos and tabs in CHANGES.TXT | Trivial | build | Steve Loughran | Steve Loughran |
+| [HADOOP-7729](https://issues.apache.org/jira/browse/HADOOP-7729) | Send back valid HTTP response if user hits IPC port with HTTP GET | Major | ipc | Todd Lipcon | Todd Lipcon |
+| [HDFS-2188](https://issues.apache.org/jira/browse/HDFS-2188) | HDFS-1580: Make FSEditLog create its journals from a list of URIs rather than NNStorage | Major | . | Ivan Kelly | Ivan Kelly |
+| [HDFS-2496](https://issues.apache.org/jira/browse/HDFS-2496) | Separate datatypes for DatanodeProtocol | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-2564](https://issues.apache.org/jira/browse/HDFS-2564) | Cleanup unnecessary exceptions thrown and unnecessary casts | Minor | datanode, hdfs-client, namenode | Hari Mankude | Hari Mankude |
+| [HDFS-2410](https://issues.apache.org/jira/browse/HDFS-2410) | Further clean up hard-coded configuration keys | Minor | datanode, namenode, test | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-7875](https://issues.apache.org/jira/browse/HADOOP-7875) | Add helper class to unwrap RemoteException from ServiceException thrown on protobuf based RPC | Major | ipc | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-1580](https://issues.apache.org/jira/browse/HDFS-1580) | Add interface for generic Write Ahead Logging mechanisms | Major | namenode | Ivan Kelly | Jitendra Nath Pandey |
+| [HDFS-2650](https://issues.apache.org/jira/browse/HDFS-2650) | Replace @inheritDoc with @Override | Minor | . | Hari Mankude | Hari Mankude |
| [HADOOP-7957](https://issues.apache.org/jira/browse/HADOOP-7957) | Classes deriving GetGroupsBase should be able to override proxy creation. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HADOOP-7987](https://issues.apache.org/jira/browse/HADOOP-7987) | Support setting the run-as user in unsecure mode | Major | security | Devaraj Das | Jitendra Nath Pandey |
+| [HDFS-2895](https://issues.apache.org/jira/browse/HDFS-2895) | Remove Writable wire protocol related code that is no longer necessary | Major | datanode, namenode | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-8070](https://issues.apache.org/jira/browse/HADOOP-8070) | Add standalone benchmark of protobuf IPC | Major | benchmarks, ipc | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8084](https://issues.apache.org/jira/browse/HADOOP-8084) | Protobuf RPC engine can be optimized to not do copying for the RPC request/response | Major | ipc | Devaraj Das | Devaraj Das |
+| [HADOOP-8085](https://issues.apache.org/jira/browse/HADOOP-8085) | Add RPC metrics to ProtobufRpcEngine | Major | ipc, metrics | Suresh Srinivas | Hari Mankude |
+| [HDFS-3003](https://issues.apache.org/jira/browse/HDFS-3003) | Remove getHostPortString() from NameNode, replace it with NetUtils.getHostPortString() | Trivial | namenode | Brandon Li | Brandon Li |
+| [MAPREDUCE-3909](https://issues.apache.org/jira/browse/MAPREDUCE-3909) | javadoc the Service interfaces | Trivial | mrv2 | Steve Loughran | Steve Loughran |
| [HADOOP-7899](https://issues.apache.org/jira/browse/HADOOP-7899) | Generate proto java files as part of the build | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-7875](https://issues.apache.org/jira/browse/HADOOP-7875) | Add helper class to unwrap RemoteException from ServiceException thrown on protobuf based RPC | Major | ipc | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-7729](https://issues.apache.org/jira/browse/HADOOP-7729) | Send back valid HTTP response if user hits IPC port with HTTP GET | Major | ipc | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7727](https://issues.apache.org/jira/browse/HADOOP-7727) | fix some typos and tabs in CHANGES.TXT | Trivial | build | Steve Loughran | Steve Loughran |
-| [HADOOP-7717](https://issues.apache.org/jira/browse/HADOOP-7717) | Move handling of concurrent client fail-overs to RetryInvocationHandler | Major | ipc | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-7716](https://issues.apache.org/jira/browse/HADOOP-7716) | RPC protocol registration on SS does not log the protocol name (only the class which may be different) | Minor | . | Sanjay Radia | Sanjay Radia |
+| [HADOOP-8113](https://issues.apache.org/jira/browse/HADOOP-8113) | Correction to BUILDING.txt: HDFS needs ProtocolBuffer, too (not just MapReduce) | Trivial | documentation | Eugene Koontz | Eugene Koontz |
| [HADOOP-7693](https://issues.apache.org/jira/browse/HADOOP-7693) | fix RPC.Server#addProtocol to work in AvroRpcEngine | Major | ipc | Doug Cutting | Doug Cutting |
-| [HADOOP-7687](https://issues.apache.org/jira/browse/HADOOP-7687) | Make getProtocolSignature public | Minor | . | Sanjay Radia | Sanjay Radia |
-| [HADOOP-7635](https://issues.apache.org/jira/browse/HADOOP-7635) | RetryInvocationHandler should release underlying resources on close | Major | ipc | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-7607](https://issues.apache.org/jira/browse/HADOOP-7607) | Simplify the RPC proxy cleanup process | Major | ipc | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-7549](https://issues.apache.org/jira/browse/HADOOP-7549) | Use JDK ServiceLoader mechanism to find FileSystem implementations | Major | fs | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-7350](https://issues.apache.org/jira/browse/HADOOP-7350) | Use ServiceLoader to discover compression codec classes | Major | conf, io | Tom White | Tom White |
-| [HDFS-3418](https://issues.apache.org/jira/browse/HDFS-3418) | Rename BlockWithLocationsProto datanodeIDs field to storageIDs | Minor | . | Eli Collins | Eli Collins |
-| [HDFS-3378](https://issues.apache.org/jira/browse/HDFS-3378) | Remove DFS\_NAMENODE\_SECONDARY\_HTTPS\_PORT\_KEY and DEFAULT | Trivial | . | Eli Collins | Eli Collins |
-| [HDFS-3375](https://issues.apache.org/jira/browse/HDFS-3375) | Put client name in DataXceiver thread name for readBlock and keepalive | Trivial | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-3365](https://issues.apache.org/jira/browse/HDFS-3365) | Enable users to disable socket caching in DFS client configuration | Minor | hdfs-client | Todd Lipcon | Todd Lipcon |
-| [HDFS-3319](https://issues.apache.org/jira/browse/HDFS-3319) | DFSOutputStream should not start a thread in constructors | Minor | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-3294](https://issues.apache.org/jira/browse/HDFS-3294) | Fix indentation in NamenodeWebHdfsMethods and DatanodeWebHdfsMethods | Trivial | datanode, namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-3279](https://issues.apache.org/jira/browse/HDFS-3279) | One of the FSEditLog constructors should be moved to TestEditLog | Minor | namenode | Tsz Wo Nicholas Sze | Arpit Gupta |
-| [HDFS-3263](https://issues.apache.org/jira/browse/HDFS-3263) | HttpFS should read HDFS config from Hadoop site.xml files | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HDFS-3259](https://issues.apache.org/jira/browse/HDFS-3259) | NameNode#initializeSharedEdits should populate shared edits dir with edit log segments | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3249](https://issues.apache.org/jira/browse/HDFS-3249) | Use ToolRunner.confirmPrompt in NameNode | Trivial | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-3247](https://issues.apache.org/jira/browse/HDFS-3247) | Improve bootstrapStandby behavior when original NN is not active | Minor | ha | Todd Lipcon | Todd Lipcon |
-| [HDFS-3244](https://issues.apache.org/jira/browse/HDFS-3244) | Remove dead writable code from hdfs/protocol | Major | . | Eli Collins | Eli Collins |
-| [HDFS-3240](https://issues.apache.org/jira/browse/HDFS-3240) | Drop log level of "heartbeat: ..." in BPServiceActor to DEBUG | Trivial | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-3238](https://issues.apache.org/jira/browse/HDFS-3238) | ServerCommand and friends don't need to be writables | Major | . | Eli Collins | Eli Collins |
-| [HDFS-3226](https://issues.apache.org/jira/browse/HDFS-3226) | Allow GetConf tool to print arbitrary keys | Major | tools | Todd Lipcon | Todd Lipcon |
-| [HDFS-3206](https://issues.apache.org/jira/browse/HDFS-3206) | Miscellaneous xml cleanups for OEV | Minor | tools | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3204](https://issues.apache.org/jira/browse/HDFS-3204) | Minor modification to JournalProtocol.proto to make it generic | Major | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-3179](https://issues.apache.org/jira/browse/HDFS-3179) | Improve the error message: DataStreamer throw an exception, "nodes.length != original.length + 1" on single datanode cluster | Major | hdfs-client | Zhanwei Wang | Tsz Wo Nicholas Sze |
+| [HADOOP-8098](https://issues.apache.org/jira/browse/HADOOP-8098) | KerberosAuthenticatorHandler should use \_HOST replacement to resolve principal name | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-8118](https://issues.apache.org/jira/browse/HADOOP-8118) | Print the stack trace of InstanceAlreadyExistsException in trace level | Minor | metrics | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-3885](https://issues.apache.org/jira/browse/MAPREDUCE-3885) | Apply the fix similar to HADOOP-8084 | Major | mrv2 | Devaraj Das | Devaraj Das |
+| [HDFS-3030](https://issues.apache.org/jira/browse/HDFS-3030) | Remove getProtocolVersion and getProtocolSignature from translators | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HDFS-3021](https://issues.apache.org/jira/browse/HDFS-3021) | Use generic type to declare FSDatasetInterface | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-3036](https://issues.apache.org/jira/browse/HDFS-3036) | Remove unused method DFSUtil#isDefaultNamenodeAddress | Trivial | namenode | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-3014](https://issues.apache.org/jira/browse/HDFS-3014) | FSEditLogOp and its subclasses should have toString() method | Major | namenode | Sho Shimauchi | Sho Shimauchi |
+| [MAPREDUCE-3991](https://issues.apache.org/jira/browse/MAPREDUCE-3991) | Streaming FAQ has some wrong instructions about input files splitting | Trivial | documentation | Harsh J | Harsh J |
+| [HDFS-3056](https://issues.apache.org/jira/browse/HDFS-3056) | Add an interface for DataBlockScanner logging | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-8183](https://issues.apache.org/jira/browse/HADOOP-8183) | Stop using "mapred.used.genericoptionsparser" to avoid unnecessary warnings | Minor | util | Harsh J | Harsh J |
+| [HDFS-3091](https://issues.apache.org/jira/browse/HDFS-3091) | Update the usage limitations of ReplaceDatanodeOnFailure policy in the config description for the smaller clusters. | Major | datanode, hdfs-client, namenode | Uma Maheswara Rao G | Tsz Wo Nicholas Sze |
+| [HDFS-309](https://issues.apache.org/jira/browse/HDFS-309) | FSEditLog should log progress during replay | Major | . | Todd Lipcon | Sho Shimauchi |
+| [HADOOP-8200](https://issues.apache.org/jira/browse/HADOOP-8200) | Remove HADOOP\_[JOBTRACKER\|TASKTRACKER]\_OPTS | Minor | conf | Eli Collins | Eli Collins |
+| [HDFS-3071](https://issues.apache.org/jira/browse/HDFS-3071) | haadmin failover command does not provide enough detail for when target NN is not ready to be active | Major | ha | Philip Zeyliger | Todd Lipcon |
+| [HADOOP-8163](https://issues.apache.org/jira/browse/HADOOP-8163) | Improve ActiveStandbyElector to provide hooks for fencing old active | Major | ha | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8193](https://issues.apache.org/jira/browse/HADOOP-8193) | Refactor FailoverController/HAAdmin code to add an abstract class for "target" services | Major | ha | Todd Lipcon | Todd Lipcon |
+| [HDFS-2413](https://issues.apache.org/jira/browse/HDFS-2413) | Add public APIs for safemode | Major | hdfs-client | Todd Lipcon | Harsh J |
+| [HDFS-3158](https://issues.apache.org/jira/browse/HDFS-3158) | LiveNodes member of NameNodeMXBean should list non-DFS used space and capacity per DN | Major | namenode | Aaron T. Myers | Aaron T. Myers |
+| [MAPREDUCE-3955](https://issues.apache.org/jira/browse/MAPREDUCE-3955) | Replace ProtoOverHadoopRpcEngine with ProtobufRpcEngine. | Blocker | mrv2 | Jitendra Nath Pandey | Jitendra Nath Pandey |
| [HDFS-3172](https://issues.apache.org/jira/browse/HDFS-3172) | dfs.upgrade.permission is dead code | Trivial | namenode | Eli Collins | Eli Collins |
| [HDFS-3171](https://issues.apache.org/jira/browse/HDFS-3171) | The DatanodeID "name" field is overloaded | Major | datanode | Eli Collins | Eli Collins |
-| [HDFS-3169](https://issues.apache.org/jira/browse/HDFS-3169) | TestFsck should test multiple -move operations in a row | Minor | test | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3158](https://issues.apache.org/jira/browse/HDFS-3158) | LiveNodes member of NameNodeMXBean should list non-DFS used space and capacity per DN | Major | namenode | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-8236](https://issues.apache.org/jira/browse/HADOOP-8236) | haadmin should have configurable timeouts for failover commands | Major | ha | Philip Zeyliger | Todd Lipcon |
| [HDFS-3120](https://issues.apache.org/jira/browse/HDFS-3120) | Enable hsync and hflush by default | Major | . | Eli Collins | Eli Collins |
-| [HDFS-3094](https://issues.apache.org/jira/browse/HDFS-3094) | add -nonInteractive and -force option to namenode -format command | Major | . | Arpit Gupta | Arpit Gupta |
-| [HDFS-3091](https://issues.apache.org/jira/browse/HDFS-3091) | Update the usage limitations of ReplaceDatanodeOnFailure policy in the config description for the smaller clusters. | Major | datanode, hdfs-client, namenode | Uma Maheswara Rao G | Tsz Wo Nicholas Sze |
+| [HADOOP-8007](https://issues.apache.org/jira/browse/HADOOP-8007) | HA: use substitution token for fencing argument | Major | ha | Aaron T. Myers | Todd Lipcon |
| [HDFS-3084](https://issues.apache.org/jira/browse/HDFS-3084) | FenceMethod.tryFence() and ShellCommandFencer should pass namenodeId as well as host:port | Major | ha | Philip Zeyliger | Todd Lipcon |
-| [HDFS-3071](https://issues.apache.org/jira/browse/HDFS-3071) | haadmin failover command does not provide enough detail for when target NN is not ready to be active | Major | ha | Philip Zeyliger | Todd Lipcon |
-| [HDFS-3056](https://issues.apache.org/jira/browse/HDFS-3056) | Add an interface for DataBlockScanner logging | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-3050](https://issues.apache.org/jira/browse/HDFS-3050) | rework OEV to share more code with the NameNode | Minor | namenode | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3036](https://issues.apache.org/jira/browse/HDFS-3036) | Remove unused method DFSUtil#isDefaultNamenodeAddress | Trivial | namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3030](https://issues.apache.org/jira/browse/HDFS-3030) | Remove getProtocolVersion and getProtocolSignature from translators | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HDFS-3021](https://issues.apache.org/jira/browse/HDFS-3021) | Use generic type to declare FSDatasetInterface | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-3014](https://issues.apache.org/jira/browse/HDFS-3014) | FSEditLogOp and its subclasses should have toString() method | Major | namenode | Sho Shimauchi | Sho Shimauchi |
-| [HDFS-3003](https://issues.apache.org/jira/browse/HDFS-3003) | Remove getHostPortString() from NameNode, replace it with NetUtils.getHostPortString() | Trivial | namenode | Brandon Li | Brandon Li |
+| [MAPREDUCE-4103](https://issues.apache.org/jira/browse/MAPREDUCE-4103) | Fix HA docs for changes to shell command fencer args | Major | documentation | Todd Lipcon | Todd Lipcon |
+| [HDFS-3050](https://issues.apache.org/jira/browse/HDFS-3050) | rework OEV to share more code with the NameNode | Minor | namenode | Colin P. McCabe | Colin P. McCabe |
+| [HADOOP-8077](https://issues.apache.org/jira/browse/HADOOP-8077) | HA: fencing method should be able to be configured on a per-NN or per-NS basis | Major | ha | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8086](https://issues.apache.org/jira/browse/HADOOP-8086) | KerberosName silently sets defaultRealm to "" if the Kerberos config is not found, it should log a WARN | Minor | security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3204](https://issues.apache.org/jira/browse/HDFS-3204) | Minor modification to JournalProtocol.proto to make it generic | Major | namenode | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-3226](https://issues.apache.org/jira/browse/HDFS-3226) | Allow GetConf tool to print arbitrary keys | Major | tools | Todd Lipcon | Todd Lipcon |
+| [HDFS-3240](https://issues.apache.org/jira/browse/HDFS-3240) | Drop log level of "heartbeat: ..." in BPServiceActor to DEBUG | Trivial | datanode | Todd Lipcon | Todd Lipcon |
+| [HDFS-3238](https://issues.apache.org/jira/browse/HDFS-3238) | ServerCommand and friends don't need to be writables | Major | . | Eli Collins | Eli Collins |
+| [HDFS-3244](https://issues.apache.org/jira/browse/HDFS-3244) | Remove dead writable code from hdfs/protocol | Major | . | Eli Collins | Eli Collins |
+| [HDFS-3247](https://issues.apache.org/jira/browse/HDFS-3247) | Improve bootstrapStandby behavior when original NN is not active | Minor | ha | Todd Lipcon | Todd Lipcon |
+| [HDFS-3249](https://issues.apache.org/jira/browse/HDFS-3249) | Use ToolRunner.confirmPrompt in NameNode | Trivial | namenode | Todd Lipcon | Todd Lipcon |
+| [HDFS-3179](https://issues.apache.org/jira/browse/HDFS-3179) | Improve the error message: DataStreamer throw an exception, "nodes.length != original.length + 1" on single datanode cluster | Major | hdfs-client | Zhanwei Wang | Tsz Wo Nicholas Sze |
| [HDFS-2983](https://issues.apache.org/jira/browse/HDFS-2983) | Relax the build version check to permit rolling upgrades within a release | Major | . | Eli Collins | Aaron T. Myers |
-| [HDFS-2895](https://issues.apache.org/jira/browse/HDFS-2895) | Remove Writable wire protocol related code that is no longer necessary | Major | datanode, namenode | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-3259](https://issues.apache.org/jira/browse/HDFS-3259) | NameNode#initializeSharedEdits should populate shared edits dir with edit log segments | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers |
| [HDFS-2708](https://issues.apache.org/jira/browse/HDFS-2708) | Stats for the # of blocks per DN | Minor | datanode, namenode | Eli Collins | Aaron T. Myers |
-| [HDFS-2650](https://issues.apache.org/jira/browse/HDFS-2650) | Replace @inheritDoc with @Override | Minor | . | Hari Mankude | Hari Mankude |
-| [HDFS-2564](https://issues.apache.org/jira/browse/HDFS-2564) | Cleanup unnecessary exceptions thrown and unnecessary casts | Minor | datanode, hdfs-client, namenode | Hari Mankude | Hari Mankude |
-| [HDFS-2496](https://issues.apache.org/jira/browse/HDFS-2496) | Separate datatypes for DatanodeProtocol | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-2413](https://issues.apache.org/jira/browse/HDFS-2413) | Add public APIs for safemode | Major | hdfs-client | Todd Lipcon | Harsh J |
-| [HDFS-2410](https://issues.apache.org/jira/browse/HDFS-2410) | Further clean up hard-coded configuration keys | Minor | datanode, namenode, test | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-2351](https://issues.apache.org/jira/browse/HDFS-2351) | Change Namenode and Datanode to register each of their protocols seperately | Major | . | Sanjay Radia | Sanjay Radia |
-| [HDFS-2337](https://issues.apache.org/jira/browse/HDFS-2337) | DFSClient shouldn't keep multiple RPC proxy references | Major | hdfs-client | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-2223](https://issues.apache.org/jira/browse/HDFS-2223) | Untangle depencencies between NN components | Major | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2188](https://issues.apache.org/jira/browse/HDFS-2188) | HDFS-1580: Make FSEditLog create its journals from a list of URIs rather than NNStorage | Major | . | Ivan Kelly | Ivan Kelly |
-| [HDFS-1580](https://issues.apache.org/jira/browse/HDFS-1580) | Add interface for generic Write Ahead Logging mechanisms | Major | namenode | Ivan Kelly | Jitendra Nath Pandey |
-| [HDFS-309](https://issues.apache.org/jira/browse/HDFS-309) | FSEditLog should log progress during replay | Major | . | Todd Lipcon | Sho Shimauchi |
-| [MAPREDUCE-4219](https://issues.apache.org/jira/browse/MAPREDUCE-4219) | make default container-executor.conf.dir be a path relative to the container-executor binary | Major | security | Roman Shaposhnik | Roman Shaposhnik |
-| [MAPREDUCE-4138](https://issues.apache.org/jira/browse/MAPREDUCE-4138) | Reduce memory usage of counters due to non-static nested classes | Major | . | Tom White | Tom White |
-| [MAPREDUCE-4103](https://issues.apache.org/jira/browse/MAPREDUCE-4103) | Fix HA docs for changes to shell command fencer args | Major | documentation | Todd Lipcon | Todd Lipcon |
+| [HDFS-3279](https://issues.apache.org/jira/browse/HDFS-3279) | One of the FSEditLog constructors should be moved to TestEditLog | Minor | namenode | Tsz Wo Nicholas Sze | Arpit Gupta |
+| [HADOOP-8280](https://issues.apache.org/jira/browse/HADOOP-8280) | Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. | Major | test, util | Ahmed Radwan | Ahmed Radwan |
+| [HDFS-3294](https://issues.apache.org/jira/browse/HDFS-3294) | Fix indentation in NamenodeWebHdfsMethods and DatanodeWebHdfsMethods | Trivial | datanode, namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-3263](https://issues.apache.org/jira/browse/HDFS-3263) | HttpFS should read HDFS config from Hadoop site.xml files | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-8117](https://issues.apache.org/jira/browse/HADOOP-8117) | Upgrade test build to Surefire 2.12 | Trivial | build, test | Todd Lipcon | Todd Lipcon |
+| [HDFS-3169](https://issues.apache.org/jira/browse/HDFS-3169) | TestFsck should test multiple -move operations in a row | Minor | test | Colin P. McCabe | Colin P. McCabe |
+| [HADOOP-7350](https://issues.apache.org/jira/browse/HADOOP-7350) | Use ServiceLoader to discover compression codec classes | Major | conf, io | Tom White | Tom White |
| [MAPREDUCE-4093](https://issues.apache.org/jira/browse/MAPREDUCE-4093) | Improve RM WebApp start up when proxy address is not set | Major | mrv2 | Devaraj K | Devaraj K |
-| [MAPREDUCE-3991](https://issues.apache.org/jira/browse/MAPREDUCE-3991) | Streaming FAQ has some wrong instructions about input files splitting | Trivial | documentation | Harsh J | Harsh J |
-| [MAPREDUCE-3955](https://issues.apache.org/jira/browse/MAPREDUCE-3955) | Replace ProtoOverHadoopRpcEngine with ProtobufRpcEngine. | Blocker | mrv2 | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [MAPREDUCE-3909](https://issues.apache.org/jira/browse/MAPREDUCE-3909) | javadoc the Service interfaces | Trivial | mrv2 | Steve Loughran | Steve Loughran |
-| [MAPREDUCE-3885](https://issues.apache.org/jira/browse/MAPREDUCE-3885) | Apply the fix similar to HADOOP-8084 | Major | mrv2 | Devaraj Das | Devaraj Das |
+| [HDFS-3206](https://issues.apache.org/jira/browse/HDFS-3206) | Miscellaneous xml cleanups for OEV | Minor | tools | Colin P. McCabe | Colin P. McCabe |
+| [HADOOP-8285](https://issues.apache.org/jira/browse/HADOOP-8285) | Use ProtoBuf for RpcPayLoadHeader | Major | ipc | Sanjay Radia | Sanjay Radia |
+| [HADOOP-8152](https://issues.apache.org/jira/browse/HADOOP-8152) | Expand public APIs for security library classes | Major | security | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-7549](https://issues.apache.org/jira/browse/HADOOP-7549) | Use JDK ServiceLoader mechanism to find FileSystem implementations | Major | fs | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3319](https://issues.apache.org/jira/browse/HDFS-3319) | DFSOutputStream should not start a thread in constructors | Minor | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-3094](https://issues.apache.org/jira/browse/HDFS-3094) | add -nonInteractive and -force option to namenode -format command | Major | . | Arpit Gupta | Arpit Gupta |
+| [MAPREDUCE-4138](https://issues.apache.org/jira/browse/MAPREDUCE-4138) | Reduce memory usage of counters due to non-static nested classes | Major | . | Tom White | Tom White |
| [MAPREDUCE-3883](https://issues.apache.org/jira/browse/MAPREDUCE-3883) | Document yarn.nodemanager.delete.debug-delay-sec configuration property | Minor | documentation, mrv2 | Eugene Koontz | Eugene Koontz |
-| [MAPREDUCE-2934](https://issues.apache.org/jira/browse/MAPREDUCE-2934) | MR portion of HADOOP-7607 - Simplify the RPC proxy cleanup process | Major | mrv2 | Aaron T. Myers | Aaron T. Myers |
-| [MAPREDUCE-2887](https://issues.apache.org/jira/browse/MAPREDUCE-2887) | MR changes to match HADOOP-7524 (multiple RPC protocols) | Major | . | Sanjay Radia | Sanjay Radia |
+| [HADOOP-8185](https://issues.apache.org/jira/browse/HADOOP-8185) | Update namenode -format documentation and add -nonInteractive and -force | Major | documentation | Arpit Gupta | Arpit Gupta |
+| [HADOOP-8214](https://issues.apache.org/jira/browse/HADOOP-8214) | make hadoop script recognize a full set of deprecated commands | Major | scripts | Roman Shaposhnik | Roman Shaposhnik |
+| [MAPREDUCE-4219](https://issues.apache.org/jira/browse/MAPREDUCE-4219) | make default container-executor.conf.dir be a path relative to the container-executor binary | Major | security | Roman Shaposhnik | Roman Shaposhnik |
+| [HADOOP-8350](https://issues.apache.org/jira/browse/HADOOP-8350) | Improve NetUtils.getInputStream to return a stream which has a tunable timeout | Major | util | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8356](https://issues.apache.org/jira/browse/HADOOP-8356) | FileSystem service loading mechanism should print the FileSystem impl it is failing to load | Major | fs | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3365](https://issues.apache.org/jira/browse/HDFS-3365) | Enable users to disable socket caching in DFS client configuration | Minor | hdfs-client | Todd Lipcon | Todd Lipcon |
+| [HDFS-3375](https://issues.apache.org/jira/browse/HDFS-3375) | Put client name in DataXceiver thread name for readBlock and keepalive | Trivial | datanode | Todd Lipcon | Todd Lipcon |
+| [HDFS-3378](https://issues.apache.org/jira/browse/HDFS-3378) | Remove DFS\_NAMENODE\_SECONDARY\_HTTPS\_PORT\_KEY and DEFAULT | Trivial | . | Eli Collins | Eli Collins |
+| [HADOOP-8353](https://issues.apache.org/jira/browse/HADOOP-8353) | hadoop-daemon.sh and yarn-daemon.sh can be misleading on stop | Major | scripts | Roman Shaposhnik | Roman Shaposhnik |
+| [HADOOP-8366](https://issues.apache.org/jira/browse/HADOOP-8366) | Use ProtoBuf for RpcResponseHeader | Blocker | . | Sanjay Radia | Sanjay Radia |
+| [HDFS-3418](https://issues.apache.org/jira/browse/HDFS-3418) | Rename BlockWithLocationsProto datanodeIDs field to storageIDs | Minor | . | Eli Collins | Eli Collins |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8355](https://issues.apache.org/jira/browse/HADOOP-8355) | SPNEGO filter throws/logs exception when authentication fails | Minor | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8349](https://issues.apache.org/jira/browse/HADOOP-8349) | ViewFS doesn't work when the root of a file system is mounted | Major | viewfs | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-8347](https://issues.apache.org/jira/browse/HADOOP-8347) | Hadoop Common logs misspell 'successful' | Major | security | Philip Zeyliger | Philip Zeyliger |
-| [HADOOP-8310](https://issues.apache.org/jira/browse/HADOOP-8310) | FileContext#checkPath should handle URIs with no port | Major | fs | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-8309](https://issues.apache.org/jira/browse/HADOOP-8309) | Pseudo & Kerberos AuthenticationHandler should use getType() to create token | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8296](https://issues.apache.org/jira/browse/HADOOP-8296) | hadoop/yarn daemonlog usage wrong | Minor | . | Thomas Graves | Devaraj K |
-| [HADOOP-8282](https://issues.apache.org/jira/browse/HADOOP-8282) | start-all.sh refers incorrectly start-dfs.sh existence for starting start-yarn.sh | Minor | scripts | Devaraj K | Devaraj K |
-| [HADOOP-8275](https://issues.apache.org/jira/browse/HADOOP-8275) | Range check DelegationKey length | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8264](https://issues.apache.org/jira/browse/HADOOP-8264) | Remove irritating double double quotes in front of hostname | Trivial | . | Bernd Fondermann | Bernd Fondermann |
-| [HADOOP-8263](https://issues.apache.org/jira/browse/HADOOP-8263) | Stringification of IPC calls not useful | Minor | ipc | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8261](https://issues.apache.org/jira/browse/HADOOP-8261) | Har file system doesn't deal with FS URIs with a host but no port | Major | fs | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-8251](https://issues.apache.org/jira/browse/HADOOP-8251) | SecurityUtil.fetchServiceTicket broken after HADOOP-6941 | Blocker | security | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8243](https://issues.apache.org/jira/browse/HADOOP-8243) | Security support broken in CLI (manual) failover controller | Critical | ha, security | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8238](https://issues.apache.org/jira/browse/HADOOP-8238) | NetUtils#getHostNameOfIP blows up if given ip:port string w/o port | Major | . | Eli Collins | Eli Collins |
-| [HADOOP-8218](https://issues.apache.org/jira/browse/HADOOP-8218) | RPC.closeProxy shouldn't throw error when closing a mock | Critical | ipc, test | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8204](https://issues.apache.org/jira/browse/HADOOP-8204) | TestHealthMonitor fails occasionally | Major | . | Tom White | Todd Lipcon |
-| [HADOOP-8202](https://issues.apache.org/jira/browse/HADOOP-8202) | stopproxy() is not closing the proxies correctly | Minor | ipc | Hari Mankude | Hari Mankude |
-| [HADOOP-8199](https://issues.apache.org/jira/browse/HADOOP-8199) | Fix issues in start-all.sh and stop-all.sh | Major | . | Nishan Shetty | Devaraj K |
-| [HADOOP-8191](https://issues.apache.org/jira/browse/HADOOP-8191) | SshFenceByTcpPort uses netcat incorrectly | Major | ha | Philip Zeyliger | Todd Lipcon |
-| [HADOOP-8189](https://issues.apache.org/jira/browse/HADOOP-8189) | LdapGroupsMapping shouldn't throw away IOException | Major | security | Jonathan Natkins | Jonathan Natkins |
-| [HADOOP-8169](https://issues.apache.org/jira/browse/HADOOP-8169) | javadoc generation fails with java.lang.OutOfMemoryError: Java heap space | Critical | build | Thomas Graves | Thomas Graves |
-| [HADOOP-8159](https://issues.apache.org/jira/browse/HADOOP-8159) | NetworkTopology: getLeaf should check for invalid topologies | Major | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8119](https://issues.apache.org/jira/browse/HADOOP-8119) | Fix javac warnings in TestAuthenticationFilter | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-7988](https://issues.apache.org/jira/browse/HADOOP-7988) | Upper case in hostname part of the principals doesn't work with kerberos. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-7968](https://issues.apache.org/jira/browse/HADOOP-7968) | Errant println left in RPC.getHighestSupportedProtocol | Minor | ipc | Todd Lipcon | Sho Shimauchi |
-| [HADOOP-7940](https://issues.apache.org/jira/browse/HADOOP-7940) | method clear() in org.apache.hadoop.io.Text does not work | Major | io | Aaron, | Csaba Miklos |
-| [HADOOP-7931](https://issues.apache.org/jira/browse/HADOOP-7931) | o.a.h.ipc.WritableRpcEngine should have a way to force initialization | Major | ipc | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-7920](https://issues.apache.org/jira/browse/HADOOP-7920) | Remove Avro RPC | Major | ipc | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-7900](https://issues.apache.org/jira/browse/HADOOP-7900) | LocalDirAllocator confChanged() accesses conf.get() twice | Major | fs | Ravi Gummadi | Ravi Gummadi |
-| [HADOOP-7897](https://issues.apache.org/jira/browse/HADOOP-7897) | ProtobufRPCEngine client side exception mechanism is not consistent with WritableRpcEngine | Major | ipc | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-7892](https://issues.apache.org/jira/browse/HADOOP-7892) | IPC logs too verbose after "RpcKind" introduction | Trivial | ipc | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7888](https://issues.apache.org/jira/browse/HADOOP-7888) | TestFailoverProxy fails intermittently on trunk | Major | test | Jason Lowe | Jason Lowe |
-| [HADOOP-7833](https://issues.apache.org/jira/browse/HADOOP-7833) | Inner classes of org.apache.hadoop.ipc.protobuf.HadoopRpcProtos generates findbugs warnings which results in -1 for findbugs | Major | ipc | John Lee | John Lee |
-| [HADOOP-7827](https://issues.apache.org/jira/browse/HADOOP-7827) | jsp pages missing DOCTYPE | Trivial | . | Dave Vronay | Dave Vronay |
+| [MAPREDUCE-2942](https://issues.apache.org/jira/browse/MAPREDUCE-2942) | TestNMAuditLogger.testNMAuditLoggerWithIP failing | Critical | . | Vinod Kumar Vavilapalli | Thomas Graves |
+| [HADOOP-7669](https://issues.apache.org/jira/browse/HADOOP-7669) | Fix newly introduced release audit warning. | Minor | . | Uma Maheswara Rao G | Uma Maheswara Rao G |
| [HADOOP-7704](https://issues.apache.org/jira/browse/HADOOP-7704) | JsonFactory can be created only once and used for every next request to create JsonGenerator inside JMXJsonServlet | Minor | . | Devaraj K | Devaraj K |
| [HADOOP-7695](https://issues.apache.org/jira/browse/HADOOP-7695) | RPC.stopProxy can throw unintended exception while logging error | Major | ipc | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-7669](https://issues.apache.org/jira/browse/HADOOP-7669) | Fix newly introduced release audit warning. | Minor | . | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HADOOP-6941](https://issues.apache.org/jira/browse/HADOOP-6941) | Support non-SUN JREs in UserGroupInformation | Major | . | Stephen Watt | Devaraj Das |
-| [HADOOP-6924](https://issues.apache.org/jira/browse/HADOOP-6924) | Build fails with non-Sun JREs due to different pathing to the operating system architecture shared libraries | Major | . | Stephen Watt | Devaraj Das |
-| [HDFS-3396](https://issues.apache.org/jira/browse/HDFS-3396) | FUSE build fails on Ubuntu 12.04 | Minor | fuse-dfs | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3395](https://issues.apache.org/jira/browse/HDFS-3395) | NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0 | Major | namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3376](https://issues.apache.org/jira/browse/HDFS-3376) | DFSClient fails to make connection to DN if there are many unusable cached sockets | Critical | hdfs-client | Todd Lipcon | Todd Lipcon |
-| [HDFS-3357](https://issues.apache.org/jira/browse/HDFS-3357) | DataXceiver reads from client socket with incorrect/no timeout | Critical | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-3351](https://issues.apache.org/jira/browse/HDFS-3351) | NameNode#initializeGenericKeys should always set fs.defaultFS regardless of whether HA or Federation is enabled | Major | namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3350](https://issues.apache.org/jira/browse/HDFS-3350) | findbugs warning: INodeFileUnderConstruction doesn't override INodeFile.equals(Object) | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-3336](https://issues.apache.org/jira/browse/HDFS-3336) | hdfs launcher script will be better off not special casing namenode command with regards to hadoop.security.logger | Minor | scripts | Roman Shaposhnik | Roman Shaposhnik |
-| [HDFS-3332](https://issues.apache.org/jira/browse/HDFS-3332) | NullPointerException in DN when directoryscanner is trying to report bad blocks | Major | datanode | amith | amith |
-| [HDFS-3330](https://issues.apache.org/jira/browse/HDFS-3330) | If GetImageServlet throws an Error or RTE, response has HTTP "OK" status | Critical | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-3328](https://issues.apache.org/jira/browse/HDFS-3328) | NPE in DataNode.getIpcPort | Minor | datanode | Uma Maheswara Rao G | Eli Collins |
-| [HDFS-3326](https://issues.apache.org/jira/browse/HDFS-3326) | Append enabled log message uses the wrong variable | Trivial | namenode | J.Andreina | Matthew Jacobs |
-| [HDFS-3314](https://issues.apache.org/jira/browse/HDFS-3314) | HttpFS operation for getHomeDirectory is incorrect | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HDFS-3309](https://issues.apache.org/jira/browse/HDFS-3309) | HttpFS (Hoop) chmod not supporting octal and sticky bit permissions | Major | . | Romain Rigaux | Alejandro Abdelnur |
-| [HDFS-3305](https://issues.apache.org/jira/browse/HDFS-3305) | GetImageServlet should consider SBN a valid requestor in a secure HA setup | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3303](https://issues.apache.org/jira/browse/HDFS-3303) | RemoteEditLogManifest doesn't need to implements Writable | Minor | namenode | Brandon Li | Brandon Li |
-| [HDFS-3284](https://issues.apache.org/jira/browse/HDFS-3284) | bootstrapStandby fails in secure cluster | Minor | ha, security | Todd Lipcon | Todd Lipcon |
-| [HDFS-3280](https://issues.apache.org/jira/browse/HDFS-3280) | DFSOutputStream.sync should not be synchronized | Critical | hdfs-client | Todd Lipcon | Todd Lipcon |
-| [HDFS-3268](https://issues.apache.org/jira/browse/HDFS-3268) | Hdfs mishandles token service & incompatible with HA | Critical | ha, hdfs-client | Daryn Sharp | Daryn Sharp |
-| [HDFS-3260](https://issues.apache.org/jira/browse/HDFS-3260) | TestDatanodeRegistration should set minimum DN version in addition to minimum NN version | Major | . | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3256](https://issues.apache.org/jira/browse/HDFS-3256) | HDFS considers blocks under-replicated if topology script is configured with only 1 rack | Major | . | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3255](https://issues.apache.org/jira/browse/HDFS-3255) | HA DFS returns wrong token service | Critical | ha, hdfs-client | Daryn Sharp | Daryn Sharp |
-| [HDFS-3254](https://issues.apache.org/jira/browse/HDFS-3254) | Branch-2 build broken due to wrong version number in fuse-dfs' pom.xml | Major | fuse-dfs | Anupam Seth | Anupam Seth |
-| [HDFS-3248](https://issues.apache.org/jira/browse/HDFS-3248) | bootstrapstanby repeated twice in hdfs namenode usage message | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3236](https://issues.apache.org/jira/browse/HDFS-3236) | NameNode does not initialize generic conf keys when started with -initializeSharedEditsDir | Minor | ha, namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3234](https://issues.apache.org/jira/browse/HDFS-3234) | Accidentally left log message in GetConf after HDFS-3226 | Trivial | tools | Todd Lipcon | Todd Lipcon |
-| [HDFS-3222](https://issues.apache.org/jira/browse/HDFS-3222) | DFSInputStream#openInfo should not silently get the length as 0 when locations length is zero for last partial block. | Major | hdfs-client | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HDFS-3214](https://issues.apache.org/jira/browse/HDFS-3214) | InterDatanodeProtocolServerSideTranslatorPB doesn't handle null response from initReplicaRecovery | Blocker | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-3210](https://issues.apache.org/jira/browse/HDFS-3210) | JsonUtil#toJsonMap for for a DatanodeInfo should use "ipAddr" instead of "name" | Major | . | Eli Collins | Eli Collins |
-| [HDFS-3208](https://issues.apache.org/jira/browse/HDFS-3208) | Bogus entries in hosts files are incorrectly displayed in the report | Major | namenode | Eli Collins | Eli Collins |
-| [HDFS-3202](https://issues.apache.org/jira/browse/HDFS-3202) | NamespaceInfo PB translation drops build version | Major | datanode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3199](https://issues.apache.org/jira/browse/HDFS-3199) | TestValidateConfigurationSettings is failing | Major | . | Eli Collins | Todd Lipcon |
-| [HDFS-3181](https://issues.apache.org/jira/browse/HDFS-3181) | testHardLeaseRecoveryAfterNameNodeRestart fails when length before restart is 1 byte less than CRC chunk size | Minor | test | Colin Patrick McCabe | Tsz Wo Nicholas Sze |
+| [HDFS-2405](https://issues.apache.org/jira/browse/HDFS-2405) | hadoop dfs command with webhdfs fails on secure hadoop | Critical | webhdfs | Arpit Gupta | Jitendra Nath Pandey |
+| [HDFS-2497](https://issues.apache.org/jira/browse/HDFS-2497) | Fix TestBackupNode failure | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-2526](https://issues.apache.org/jira/browse/HDFS-2526) | (Client)NamenodeProtocolTranslatorR23 do not need to keep a reference to rpcProxyWithoutRetry | Major | hdfs-client, namenode | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-7833](https://issues.apache.org/jira/browse/HADOOP-7833) | Inner classes of org.apache.hadoop.ipc.protobuf.HadoopRpcProtos generates findbugs warnings which results in -1 for findbugs | Major | ipc | John Lee | John Lee |
+| [HDFS-2532](https://issues.apache.org/jira/browse/HDFS-2532) | TestDfsOverAvroRpc timing out in trunk | Critical | test | Todd Lipcon | Uma Maheswara Rao G |
+| [HDFS-2481](https://issues.apache.org/jira/browse/HDFS-2481) | Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol | Major | . | Tsz Wo Nicholas Sze | Sanjay Radia |
+| [HADOOP-7888](https://issues.apache.org/jira/browse/HADOOP-7888) | TestFailoverProxy fails intermittently on trunk | Major | test | Jason Lowe | Jason Lowe |
+| [HADOOP-7897](https://issues.apache.org/jira/browse/HADOOP-7897) | ProtobufRPCEngine client side exception mechanism is not consistent with WritableRpcEngine | Major | ipc | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-7892](https://issues.apache.org/jira/browse/HADOOP-7892) | IPC logs too verbose after "RpcKind" introduction | Trivial | ipc | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-3545](https://issues.apache.org/jira/browse/MAPREDUCE-3545) | Remove Avro RPC | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-2676](https://issues.apache.org/jira/browse/HDFS-2676) | Remove Avro RPC | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-7931](https://issues.apache.org/jira/browse/HADOOP-7931) | o.a.h.ipc.WritableRpcEngine should have a way to force initialization | Major | ipc | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-2694](https://issues.apache.org/jira/browse/HDFS-2694) | Removal of Avro broke non-PB NN services | Major | namenode | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-2700](https://issues.apache.org/jira/browse/HDFS-2700) | TestDataNodeMultipleRegistrations is failing in trunk | Major | . | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [HDFS-2739](https://issues.apache.org/jira/browse/HDFS-2739) | SecondaryNameNode doesn't start up | Critical | . | Sho Shimauchi | Jitendra Nath Pandey |
+| [HADOOP-7920](https://issues.apache.org/jira/browse/HADOOP-7920) | Remove Avro RPC | Major | ipc | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-7968](https://issues.apache.org/jira/browse/HADOOP-7968) | Errant println left in RPC.getHighestSupportedProtocol | Minor | ipc | Todd Lipcon | Sho Shimauchi |
+| [MAPREDUCE-3740](https://issues.apache.org/jira/browse/MAPREDUCE-3740) | Mapreduce Trunk compilation fails | Blocker | mrv2 | Devaraj K | Devaraj K |
+| [HADOOP-7988](https://issues.apache.org/jira/browse/HADOOP-7988) | Upper case in hostname part of the principals doesn't work with kerberos. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [MAPREDUCE-3818](https://issues.apache.org/jira/browse/MAPREDUCE-3818) | Trunk MRV1 compilation is broken. | Blocker | build, test | Vinod Kumar Vavilapalli | Suresh Srinivas |
+| [HDFS-2878](https://issues.apache.org/jira/browse/HDFS-2878) | TestBlockRecovery does not compile | Blocker | test | Eli Collins | Todd Lipcon |
+| [HDFS-2968](https://issues.apache.org/jira/browse/HDFS-2968) | Protocol translator for BlockRecoveryCommand broken when multiple blocks need recovery | Blocker | datanode, namenode | Todd Lipcon | Todd Lipcon |
+| [HADOOP-7940](https://issues.apache.org/jira/browse/HADOOP-7940) | method clear() in org.apache.hadoop.io.Text does not work | Major | io | Aaron, | Csaba Miklos |
+| [MAPREDUCE-3933](https://issues.apache.org/jira/browse/MAPREDUCE-3933) | Failures because MALLOC\_ARENA\_MAX is not set | Major | mrv2, test | Ahmed Radwan | Ahmed Radwan |
+| [HDFS-3020](https://issues.apache.org/jira/browse/HDFS-3020) | Auto-logSync based on edit log buffer size broken | Critical | namenode | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8119](https://issues.apache.org/jira/browse/HADOOP-8119) | Fix javac warnings in TestAuthenticationFilter | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-3038](https://issues.apache.org/jira/browse/HDFS-3038) | Add FSEditLog.metrics to findbugs exclude list | Trivial | . | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-3952](https://issues.apache.org/jira/browse/MAPREDUCE-3952) | In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split. | Major | mrv2 | Zhenxiao Luo | Bhallamudi Venkata Siva Kamesh |
+| [HDFS-1765](https://issues.apache.org/jira/browse/HDFS-1765) | Block Replication should respect under-replication block priority | Major | namenode | Hairong Kuang | Uma Maheswara Rao G |
+| [MAPREDUCE-3578](https://issues.apache.org/jira/browse/MAPREDUCE-3578) | starting nodemanager as 'root' gives "Unknown -jvm option" | Major | nodemanager | Gilad Wolff | Tom White |
+| [HADOOP-7900](https://issues.apache.org/jira/browse/HADOOP-7900) | LocalDirAllocator confChanged() accesses conf.get() twice | Major | fs | Ravi Gummadi | Ravi Gummadi |
+| [MAPREDUCE-3974](https://issues.apache.org/jira/browse/MAPREDUCE-3974) | TestSubmitJob in MR1 tests doesn't compile after HDFS-1623 merge | Blocker | . | Arun C Murthy | Aaron T. Myers |
+| [HADOOP-8169](https://issues.apache.org/jira/browse/HADOOP-8169) | javadoc generation fails with java.lang.OutOfMemoryError: Java heap space | Critical | build | Thomas Graves | Thomas Graves |
+| [HDFS-3057](https://issues.apache.org/jira/browse/HDFS-3057) | httpfs and hdfs launcher scripts should honor CATALINA\_HOME and HADOOP\_LIBEXEC\_DIR | Major | scripts | Roman Shaposhnik | Roman Shaposhnik |
+| [MAPREDUCE-4007](https://issues.apache.org/jira/browse/MAPREDUCE-4007) | JobClient getJob(JobID) should return NULL if the job does not exist (for backwards compatibility) | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3093](https://issues.apache.org/jira/browse/HDFS-3093) | TestAllowFormat is trying to be interactive | Critical | . | Todd Lipcon | Todd Lipcon |
+| [HDFS-3005](https://issues.apache.org/jira/browse/HDFS-3005) | ConcurrentModificationException in FSDataset$FSVolume.getDfsUsed(..) | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-3099](https://issues.apache.org/jira/browse/HDFS-3099) | SecondaryNameNode does not properly initialize metrics system | Major | namenode | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-3062](https://issues.apache.org/jira/browse/HDFS-3062) | Fail to submit mapred job on a secured-HA-HDFS: logic URI cannot be picked up by job submission. | Critical | ha, security | Mingjie Lai | Mingjie Lai |
+| [MAPREDUCE-3431](https://issues.apache.org/jira/browse/MAPREDUCE-3431) | NPE in Resource Manager shutdown | Minor | resourcemanager | Steve Loughran | Steve Loughran |
+| [HADOOP-6924](https://issues.apache.org/jira/browse/HADOOP-6924) | Build fails with non-Sun JREs due to different pathing to the operating system architecture shared libraries | Major | . | Stephen Watt | Devaraj Das |
+| [HADOOP-8189](https://issues.apache.org/jira/browse/HADOOP-8189) | LdapGroupsMapping shouldn't throw away IOException | Major | security | Jonathan Natkins | Jonathan Natkins |
+| [HADOOP-6941](https://issues.apache.org/jira/browse/HADOOP-6941) | Support non-SUN JREs in UserGroupInformation | Major | . | Stephen Watt | Devaraj Das |
+| [MAPREDUCE-1740](https://issues.apache.org/jira/browse/MAPREDUCE-1740) | NPE in getMatchingLevelForNodes when node locations are variable depth | Major | jobtracker | Todd Lipcon | Ahmed Radwan |
+| [HDFS-3083](https://issues.apache.org/jira/browse/HDFS-3083) | Cannot run an MR job with HA and security enabled when second-listed NN active | Critical | ha, security | Mingjie Lai | Aaron T. Myers |
+| [HADOOP-8191](https://issues.apache.org/jira/browse/HADOOP-8191) | SshFenceByTcpPort uses netcat incorrectly | Major | ha | Philip Zeyliger | Todd Lipcon |
+| [HDFS-3100](https://issues.apache.org/jira/browse/HDFS-3100) | failed to append data | Major | datanode | Zhanwei Wang | Brandon Li |
+| [HDFS-3132](https://issues.apache.org/jira/browse/HDFS-3132) | Findbugs warning on HDFS trunk | Minor | namenode | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8204](https://issues.apache.org/jira/browse/HADOOP-8204) | TestHealthMonitor fails occasionally | Major | . | Tom White | Todd Lipcon |
+| [MAPREDUCE-3353](https://issues.apache.org/jira/browse/MAPREDUCE-3353) | Need a RM-\>AM channel to inform AMs about faulty/unhealthy/lost nodes | Major | applicationmaster, mrv2, resourcemanager | Vinod Kumar Vavilapalli | Bikas Saha |
+| [MAPREDUCE-4066](https://issues.apache.org/jira/browse/MAPREDUCE-4066) | To get "yarn.app.mapreduce.am.staging-dir" value, should set the default value | Minor | job submission, mrv2 | xieguiming | xieguiming |
+| [HADOOP-8159](https://issues.apache.org/jira/browse/HADOOP-8159) | NetworkTopology: getLeaf should check for invalid topologies | Major | . | Colin P. McCabe | Colin P. McCabe |
+| [HADOOP-8202](https://issues.apache.org/jira/browse/HADOOP-8202) | stopproxy() is not closing the proxies correctly | Minor | ipc | Hari Mankude | Hari Mankude |
+| [HADOOP-8218](https://issues.apache.org/jira/browse/HADOOP-8218) | RPC.closeProxy shouldn't throw error when closing a mock | Critical | ipc, test | Todd Lipcon | Todd Lipcon |
| [HDFS-3156](https://issues.apache.org/jira/browse/HDFS-3156) | TestDFSHAAdmin is failing post HADOOP-8202 | Major | test | Aaron T. Myers | Aaron T. Myers |
| [HDFS-3143](https://issues.apache.org/jira/browse/HDFS-3143) | TestGetBlocks.testGetBlocks is failing | Major | test | Eli Collins | Arpit Gupta |
+| [MAPREDUCE-3377](https://issues.apache.org/jira/browse/MAPREDUCE-3377) | Compatibility issue with 0.20.203. | Major | . | Jane Chen | Jane Chen |
+| [MAPREDUCE-4081](https://issues.apache.org/jira/browse/MAPREDUCE-4081) | TestMROutputFormat.java does not compile | Blocker | build, mrv2 | Jason Lowe | Jason Lowe |
| [HDFS-3142](https://issues.apache.org/jira/browse/HDFS-3142) | TestHDFSCLI.testAll is failing | Blocker | test | Eli Collins | Brandon Li |
-| [HDFS-3132](https://issues.apache.org/jira/browse/HDFS-3132) | Findbugs warning on HDFS trunk | Minor | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-3119](https://issues.apache.org/jira/browse/HDFS-3119) | Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file | Minor | namenode | J.Andreina | Ashish Singhi |
-| [HDFS-3109](https://issues.apache.org/jira/browse/HDFS-3109) | Remove hsqldb exclusions from pom.xml | Major | . | Ravi Prakash | Ravi Prakash |
-| [HDFS-3100](https://issues.apache.org/jira/browse/HDFS-3100) | failed to append data | Major | datanode | Zhanwei Wang | Brandon Li |
-| [HDFS-3099](https://issues.apache.org/jira/browse/HDFS-3099) | SecondaryNameNode does not properly initialize metrics system | Major | namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3093](https://issues.apache.org/jira/browse/HDFS-3093) | TestAllowFormat is trying to be interactive | Critical | . | Todd Lipcon | Todd Lipcon |
-| [HDFS-3083](https://issues.apache.org/jira/browse/HDFS-3083) | Cannot run an MR job with HA and security enabled when second-listed NN active | Critical | ha, security | Mingjie Lai | Aaron T. Myers |
+| [MAPREDUCE-3916](https://issues.apache.org/jira/browse/MAPREDUCE-3916) | various issues with running yarn proxyserver | Critical | mrv2, resourcemanager, webapps | Roman Shaposhnik | Devaraj K |
| [HDFS-3070](https://issues.apache.org/jira/browse/HDFS-3070) | HDFS balancer doesn't ensure that hdfs-site.xml is loaded | Major | balancer & mover | Stephen Chu | Aaron T. Myers |
-| [HDFS-3062](https://issues.apache.org/jira/browse/HDFS-3062) | Fail to submit mapred job on a secured-HA-HDFS: logic URI cannot be picked up by job submission. | Critical | ha, security | Mingjie Lai | Mingjie Lai |
-| [HDFS-3057](https://issues.apache.org/jira/browse/HDFS-3057) | httpfs and hdfs launcher scripts should honor CATALINA\_HOME and HADOOP\_LIBEXEC\_DIR | Major | scripts | Roman Shaposhnik | Roman Shaposhnik |
-| [HDFS-3038](https://issues.apache.org/jira/browse/HDFS-3038) | Add FSEditLog.metrics to findbugs exclude list | Trivial | . | Todd Lipcon | Todd Lipcon |
-| [HDFS-3026](https://issues.apache.org/jira/browse/HDFS-3026) | HA: Handle failure during HA state transition | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3020](https://issues.apache.org/jira/browse/HDFS-3020) | Auto-logSync based on edit log buffer size broken | Critical | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-3005](https://issues.apache.org/jira/browse/HDFS-3005) | ConcurrentModificationException in FSDataset$FSVolume.getDfsUsed(..) | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-8199](https://issues.apache.org/jira/browse/HADOOP-8199) | Fix issues in start-all.sh and stop-all.sh | Major | . | Nishan Shetty | Devaraj K |
+| [HADOOP-8238](https://issues.apache.org/jira/browse/HADOOP-8238) | NetUtils#getHostNameOfIP blows up if given ip:port string w/o port | Major | . | Eli Collins | Eli Collins |
+| [MAPREDUCE-4095](https://issues.apache.org/jira/browse/MAPREDUCE-4095) | TestJobInProgress#testLocality uses a bogus topology | Major | . | Eli Collins | Colin P. McCabe |
+| [HADOOP-8243](https://issues.apache.org/jira/browse/HADOOP-8243) | Security support broken in CLI (manual) failover controller | Critical | ha, security | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-4098](https://issues.apache.org/jira/browse/MAPREDUCE-4098) | TestMRApps testSetClasspath fails | Major | test | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3199](https://issues.apache.org/jira/browse/HDFS-3199) | TestValidateConfigurationSettings is failing | Major | . | Eli Collins | Todd Lipcon |
+| [HDFS-3202](https://issues.apache.org/jira/browse/HDFS-3202) | NamespaceInfo PB translation drops build version | Major | datanode | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-3109](https://issues.apache.org/jira/browse/HDFS-3109) | Remove hsqldb exclusions from pom.xml | Major | . | Ravi Prakash | Ravi Prakash |
+| [HDFS-3210](https://issues.apache.org/jira/browse/HDFS-3210) | JsonUtil#toJsonMap for for a DatanodeInfo should use "ipAddr" instead of "name" | Major | . | Eli Collins | Eli Collins |
+| [HDFS-3208](https://issues.apache.org/jira/browse/HDFS-3208) | Bogus entries in hosts files are incorrectly displayed in the report | Major | namenode | Eli Collins | Eli Collins |
+| [HADOOP-8251](https://issues.apache.org/jira/browse/HADOOP-8251) | SecurityUtil.fetchServiceTicket broken after HADOOP-6941 | Blocker | security | Todd Lipcon | Todd Lipcon |
+| [HDFS-3214](https://issues.apache.org/jira/browse/HDFS-3214) | InterDatanodeProtocolServerSideTranslatorPB doesn't handle null response from initReplicaRecovery | Blocker | datanode | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8261](https://issues.apache.org/jira/browse/HADOOP-8261) | Har file system doesn't deal with FS URIs with a host but no port | Major | fs | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-3119](https://issues.apache.org/jira/browse/HDFS-3119) | Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file | Minor | namenode | J.Andreina | Ashish Singhi |
| [HDFS-2995](https://issues.apache.org/jira/browse/HDFS-2995) | start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configured | Major | scripts | Todd Lipcon | Eli Collins |
-| [HDFS-2968](https://issues.apache.org/jira/browse/HDFS-2968) | Protocol translator for BlockRecoveryCommand broken when multiple blocks need recovery | Blocker | datanode, namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2878](https://issues.apache.org/jira/browse/HDFS-2878) | TestBlockRecovery does not compile | Blocker | test | Eli Collins | Todd Lipcon |
-| [HDFS-2799](https://issues.apache.org/jira/browse/HDFS-2799) | Trim fs.checkpoint.dir values | Major | namenode | Eli Collins | amith |
+| [MAPREDUCE-4105](https://issues.apache.org/jira/browse/MAPREDUCE-4105) | Yarn RackResolver ignores rack configurations | Major | mrv2 | Ahmed Radwan | Ahmed Radwan |
+| [MAPREDUCE-3869](https://issues.apache.org/jira/browse/MAPREDUCE-3869) | Distributed shell application fails with NoClassDefFoundError | Blocker | mrv2 | Devaraj K | Devaraj K |
+| [HDFS-3234](https://issues.apache.org/jira/browse/HDFS-3234) | Accidentally left log message in GetConf after HDFS-3226 | Trivial | tools | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8263](https://issues.apache.org/jira/browse/HADOOP-8263) | Stringification of IPC calls not useful | Minor | ipc | Todd Lipcon | Todd Lipcon |
+| [HDFS-3236](https://issues.apache.org/jira/browse/HDFS-3236) | NameNode does not initialize generic conf keys when started with -initializeSharedEditsDir | Minor | ha, namenode | Aaron T. Myers | Aaron T. Myers |
| [HDFS-2768](https://issues.apache.org/jira/browse/HDFS-2768) | BackupNode stop can not close proxy connections because it is not a proxy instance. | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HDFS-2765](https://issues.apache.org/jira/browse/HDFS-2765) | TestNameEditsConfigs is incorrectly swallowing IOE | Major | test | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-2739](https://issues.apache.org/jira/browse/HDFS-2739) | SecondaryNameNode doesn't start up | Critical | . | Sho Shimauchi | Jitendra Nath Pandey |
-| [HDFS-2700](https://issues.apache.org/jira/browse/HDFS-2700) | TestDataNodeMultipleRegistrations is failing in trunk | Major | . | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [HADOOP-8264](https://issues.apache.org/jira/browse/HADOOP-8264) | Remove irritating double double quotes in front of hostname | Trivial | . | Bernd Fondermann | Bernd Fondermann |
+| [MAPREDUCE-4057](https://issues.apache.org/jira/browse/MAPREDUCE-4057) | Compilation error in RAID | Major | contrib/raid | Tsz Wo Nicholas Sze | Devaraj K |
+| [MAPREDUCE-4076](https://issues.apache.org/jira/browse/MAPREDUCE-4076) | Stream job fails with ZipException when use yarn jar command | Blocker | mrv2 | Devaraj K | Devaraj K |
+| [HDFS-3248](https://issues.apache.org/jira/browse/HDFS-3248) | bootstrapstanby repeated twice in hdfs namenode usage message | Minor | . | Colin P. McCabe | Colin P. McCabe |
| [HDFS-2696](https://issues.apache.org/jira/browse/HDFS-2696) | Fix the fuse-fds build | Major | build, fuse-dfs | Petru Dimulescu | Bruno Mahé |
-| [HDFS-2694](https://issues.apache.org/jira/browse/HDFS-2694) | Removal of Avro broke non-PB NN services | Major | namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-2676](https://issues.apache.org/jira/browse/HDFS-2676) | Remove Avro RPC | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-2532](https://issues.apache.org/jira/browse/HDFS-2532) | TestDfsOverAvroRpc timing out in trunk | Critical | test | Todd Lipcon | Uma Maheswara Rao G |
-| [HDFS-2526](https://issues.apache.org/jira/browse/HDFS-2526) | (Client)NamenodeProtocolTranslatorR23 do not need to keep a reference to rpcProxyWithoutRetry | Major | hdfs-client, namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-2497](https://issues.apache.org/jira/browse/HDFS-2497) | Fix TestBackupNode failure | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-2481](https://issues.apache.org/jira/browse/HDFS-2481) | Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol | Major | . | Tsz Wo Nicholas Sze | Sanjay Radia |
-| [HDFS-2405](https://issues.apache.org/jira/browse/HDFS-2405) | hadoop dfs command with webhdfs fails on secure hadoop | Critical | webhdfs | Arpit Gupta | Jitendra Nath Pandey |
-| [HDFS-1765](https://issues.apache.org/jira/browse/HDFS-1765) | Block Replication should respect under-replication block priority | Major | namenode | Hairong Kuang | Uma Maheswara Rao G |
-| [HDFS-891](https://issues.apache.org/jira/browse/HDFS-891) | DataNode no longer needs to check for dfs.network.script | Minor | datanode | Steve Loughran | Harsh J |
-| [MAPREDUCE-4231](https://issues.apache.org/jira/browse/MAPREDUCE-4231) | Update RAID to not to use FSInodeInfo | Major | contrib/raid | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [MAPREDUCE-4202](https://issues.apache.org/jira/browse/MAPREDUCE-4202) | TestYarnClientProtocolProvider is broken | Major | test | Daryn Sharp | Daryn Sharp |
-| [MAPREDUCE-4193](https://issues.apache.org/jira/browse/MAPREDUCE-4193) | broken doc link for yarn-default.xml in site.xml | Major | documentation | Patrick Hunt | Patrick Hunt |
+| [HDFS-3254](https://issues.apache.org/jira/browse/HDFS-3254) | Branch-2 build broken due to wrong version number in fuse-dfs' pom.xml | Major | fuse-dfs | Anupam Seth | Anupam Seth |
+| [HDFS-3260](https://issues.apache.org/jira/browse/HDFS-3260) | TestDatanodeRegistration should set minimum DN version in addition to minimum NN version | Major | . | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-3255](https://issues.apache.org/jira/browse/HDFS-3255) | HA DFS returns wrong token service | Critical | ha, hdfs-client | Daryn Sharp | Daryn Sharp |
+| [HDFS-3256](https://issues.apache.org/jira/browse/HDFS-3256) | HDFS considers blocks under-replicated if topology script is configured with only 1 rack | Major | . | Aaron T. Myers | Aaron T. Myers |
| [MAPREDUCE-4147](https://issues.apache.org/jira/browse/MAPREDUCE-4147) | YARN should not have a compile-time dependency on HDFS | Major | . | Tom White | Tom White |
-| [MAPREDUCE-4105](https://issues.apache.org/jira/browse/MAPREDUCE-4105) | Yarn RackResolver ignores rack configurations | Major | mrv2 | Ahmed Radwan | Ahmed Radwan |
-| [MAPREDUCE-4098](https://issues.apache.org/jira/browse/MAPREDUCE-4098) | TestMRApps testSetClasspath fails | Major | test | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-4095](https://issues.apache.org/jira/browse/MAPREDUCE-4095) | TestJobInProgress#testLocality uses a bogus topology | Major | . | Eli Collins | Colin Patrick McCabe |
-| [MAPREDUCE-4081](https://issues.apache.org/jira/browse/MAPREDUCE-4081) | TestMROutputFormat.java does not compile | Blocker | build, mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4076](https://issues.apache.org/jira/browse/MAPREDUCE-4076) | Stream job fails with ZipException when use yarn jar command | Blocker | mrv2 | Devaraj K | Devaraj K |
-| [MAPREDUCE-4066](https://issues.apache.org/jira/browse/MAPREDUCE-4066) | To get "yarn.app.mapreduce.am.staging-dir" value, should set the default value | Minor | job submission, mrv2 | xieguiming | xieguiming |
-| [MAPREDUCE-4057](https://issues.apache.org/jira/browse/MAPREDUCE-4057) | Compilation error in RAID | Major | contrib/raid | Tsz Wo Nicholas Sze | Devaraj K |
+| [HDFS-2799](https://issues.apache.org/jira/browse/HDFS-2799) | Trim fs.checkpoint.dir values | Major | namenode | Eli Collins | amith |
+| [HDFS-2765](https://issues.apache.org/jira/browse/HDFS-2765) | TestNameEditsConfigs is incorrectly swallowing IOE | Major | test | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-3280](https://issues.apache.org/jira/browse/HDFS-3280) | DFSOutputStream.sync should not be synchronized | Critical | hdfs-client | Todd Lipcon | Todd Lipcon |
| [MAPREDUCE-4008](https://issues.apache.org/jira/browse/MAPREDUCE-4008) | ResourceManager throws MetricsException on start up saying QueueMetrics MBean already exists | Major | mrv2, scheduler | Devaraj K | Devaraj K |
-| [MAPREDUCE-4007](https://issues.apache.org/jira/browse/MAPREDUCE-4007) | JobClient getJob(JobID) should return NULL if the job does not exist (for backwards compatibility) | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-3974](https://issues.apache.org/jira/browse/MAPREDUCE-3974) | TestSubmitJob in MR1 tests doesn't compile after HDFS-1623 merge | Blocker | . | Arun C Murthy | Aaron T. Myers |
-| [MAPREDUCE-3958](https://issues.apache.org/jira/browse/MAPREDUCE-3958) | RM: Remove RMNodeState and replace it with NodeState | Major | mrv2 | Bikas Saha | Bikas Saha |
-| [MAPREDUCE-3952](https://issues.apache.org/jira/browse/MAPREDUCE-3952) | In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split. | Major | mrv2 | Zhenxiao Luo | Bhallamudi Venkata Siva Kamesh |
-| [MAPREDUCE-3933](https://issues.apache.org/jira/browse/MAPREDUCE-3933) | Failures because MALLOC\_ARENA\_MAX is not set | Major | mrv2, test | Ahmed Radwan | Ahmed Radwan |
-| [MAPREDUCE-3916](https://issues.apache.org/jira/browse/MAPREDUCE-3916) | various issues with running yarn proxyserver | Critical | mrv2, resourcemanager, webapps | Roman Shaposhnik | Devaraj K |
-| [MAPREDUCE-3869](https://issues.apache.org/jira/browse/MAPREDUCE-3869) | Distributed shell application fails with NoClassDefFoundError | Blocker | mrv2 | Devaraj K | Devaraj K |
+| [HDFS-3268](https://issues.apache.org/jira/browse/HDFS-3268) | Hdfs mishandles token service & incompatible with HA | Critical | ha, hdfs-client | Daryn Sharp | Daryn Sharp |
+| [HDFS-3284](https://issues.apache.org/jira/browse/HDFS-3284) | bootstrapStandby fails in secure cluster | Minor | ha, security | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8282](https://issues.apache.org/jira/browse/HADOOP-8282) | start-all.sh refers incorrectly start-dfs.sh existence for starting start-yarn.sh | Minor | scripts | Devaraj K | Devaraj K |
+| [HDFS-891](https://issues.apache.org/jira/browse/HDFS-891) | DataNode no longer needs to check for dfs.network.script | Minor | datanode | Steve Loughran | Harsh J |
| [MAPREDUCE-3867](https://issues.apache.org/jira/browse/MAPREDUCE-3867) | MiniMRYarn/MiniYarn uses fixed ports | Major | test | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-3818](https://issues.apache.org/jira/browse/MAPREDUCE-3818) | Trunk MRV1 compilation is broken. | Blocker | build, test | Vinod Kumar Vavilapalli | Suresh Srinivas |
-| [MAPREDUCE-3740](https://issues.apache.org/jira/browse/MAPREDUCE-3740) | Mapreduce Trunk compilation fails | Blocker | mrv2 | Devaraj K | Devaraj K |
-| [MAPREDUCE-3578](https://issues.apache.org/jira/browse/MAPREDUCE-3578) | starting nodemanager as 'root' gives "Unknown -jvm option" | Major | nodemanager | Gilad Wolff | Tom White |
-| [MAPREDUCE-3545](https://issues.apache.org/jira/browse/MAPREDUCE-3545) | Remove Avro RPC | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [MAPREDUCE-3431](https://issues.apache.org/jira/browse/MAPREDUCE-3431) | NPE in Resource Manager shutdown | Minor | resourcemanager | Steve Loughran | Steve Loughran |
-| [MAPREDUCE-3377](https://issues.apache.org/jira/browse/MAPREDUCE-3377) | Compatibility issue with 0.20.203. | Major | . | Jane Chen | Jane Chen |
-| [MAPREDUCE-3353](https://issues.apache.org/jira/browse/MAPREDUCE-3353) | Need a RM-\>AM channel to inform AMs about faulty/unhealthy/lost nodes | Major | applicationmaster, mrv2, resourcemanager | Vinod Kumar Vavilapalli | Bikas Saha |
+| [HDFS-3305](https://issues.apache.org/jira/browse/HDFS-3305) | GetImageServlet should consider SBN a valid requestor in a secure HA setup | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-8309](https://issues.apache.org/jira/browse/HADOOP-8309) | Pseudo & Kerberos AuthenticationHandler should use getType() to create token | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3314](https://issues.apache.org/jira/browse/HDFS-3314) | HttpFS operation for getHomeDirectory is incorrect | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-4193](https://issues.apache.org/jira/browse/MAPREDUCE-4193) | broken doc link for yarn-default.xml in site.xml | Major | documentation | Patrick Hunt | Patrick Hunt |
+| [HADOOP-8296](https://issues.apache.org/jira/browse/HADOOP-8296) | hadoop/yarn daemonlog usage wrong | Minor | . | Thomas Graves | Devaraj K |
+| [HADOOP-8310](https://issues.apache.org/jira/browse/HADOOP-8310) | FileContext#checkPath should handle URIs with no port | Major | fs | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-3222](https://issues.apache.org/jira/browse/HDFS-3222) | DFSInputStream#openInfo should not silently get the length as 0 when locations length is zero for last partial block. | Major | hdfs-client | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [HDFS-3181](https://issues.apache.org/jira/browse/HDFS-3181) | testHardLeaseRecoveryAfterNameNodeRestart fails when length before restart is 1 byte less than CRC chunk size | Minor | test | Colin P. McCabe | Tsz Wo Nicholas Sze |
+| [HDFS-3309](https://issues.apache.org/jira/browse/HDFS-3309) | HttpFS (Hoop) chmod not supporting octal and sticky bit permissions | Major | . | Romain Rigaux | Alejandro Abdelnur |
+| [HDFS-3326](https://issues.apache.org/jira/browse/HDFS-3326) | Append enabled log message uses the wrong variable | Trivial | namenode | J.Andreina | Matthew Jacobs |
+| [MAPREDUCE-4202](https://issues.apache.org/jira/browse/MAPREDUCE-4202) | TestYarnClientProtocolProvider is broken | Major | test | Daryn Sharp | Daryn Sharp |
+| [HADOOP-8275](https://issues.apache.org/jira/browse/HADOOP-8275) | Range check DelegationKey length | Minor | . | Colin P. McCabe | Colin P. McCabe |
| [MAPREDUCE-3173](https://issues.apache.org/jira/browse/MAPREDUCE-3173) | MRV2 UI doesn't work properly without internet | Critical | mrv2 | Devaraj K | Devaraj K |
-| [MAPREDUCE-2942](https://issues.apache.org/jira/browse/MAPREDUCE-2942) | TestNMAuditLogger.testNMAuditLoggerWithIP failing | Critical | . | Vinod Kumar Vavilapalli | Thomas Graves |
-| [MAPREDUCE-1740](https://issues.apache.org/jira/browse/MAPREDUCE-1740) | NPE in getMatchingLevelForNodes when node locations are variable depth | Major | jobtracker | Todd Lipcon | Ahmed Radwan |
+| [HDFS-3336](https://issues.apache.org/jira/browse/HDFS-3336) | hdfs launcher script will be better off not special casing namenode command with regards to hadoop.security.logger | Minor | scripts | Roman Shaposhnik | Roman Shaposhnik |
+| [HDFS-3351](https://issues.apache.org/jira/browse/HDFS-3351) | NameNode#initializeGenericKeys should always set fs.defaultFS regardless of whether HA or Federation is enabled | Major | namenode | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-8347](https://issues.apache.org/jira/browse/HADOOP-8347) | Hadoop Common logs misspell 'successful' | Major | security | Philip Zeyliger | Philip Zeyliger |
+| [HDFS-3332](https://issues.apache.org/jira/browse/HDFS-3332) | NullPointerException in DN when directoryscanner is trying to report bad blocks | Major | datanode | amith | amith |
+| [HDFS-3350](https://issues.apache.org/jira/browse/HDFS-3350) | findbugs warning: INodeFileUnderConstruction doesn't override INodeFile.equals(Object) | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-8355](https://issues.apache.org/jira/browse/HADOOP-8355) | SPNEGO filter throws/logs exception when authentication fails | Minor | security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-3958](https://issues.apache.org/jira/browse/MAPREDUCE-3958) | RM: Remove RMNodeState and replace it with NodeState | Major | mrv2 | Bikas Saha | Bik
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[19/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/CHANGES.1.1.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/CHANGES.1.1.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/CHANGES.1.1.0.md
index a475bb3..db317ba 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/CHANGES.1.1.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/CHANGES.1.1.0.md
@@ -24,176 +24,170 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8552](https://issues.apache.org/jira/browse/HADOOP-8552) | Conflict: Same security.log.file for multiple users. | Major | conf, security | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-8365](https://issues.apache.org/jira/browse/HADOOP-8365) | Add flag to disable durable sync | Blocker | . | Eli Collins | Eli Collins |
+| [HADOOP-5464](https://issues.apache.org/jira/browse/HADOOP-5464) | DFSClient does not treat write timeout of 0 properly | Major | . | Raghu Angadi | Raghu Angadi |
+| [HDFS-3044](https://issues.apache.org/jira/browse/HDFS-3044) | fsck move should be non-destructive by default | Major | namenode | Eli Collins | Colin P. McCabe |
+| [HADOOP-8154](https://issues.apache.org/jira/browse/HADOOP-8154) | DNS#getIPs shouldn't silently return the local host IP for bogus interface names | Major | conf | Eli Collins | Eli Collins |
| [HADOOP-8314](https://issues.apache.org/jira/browse/HADOOP-8314) | HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
| [HADOOP-8230](https://issues.apache.org/jira/browse/HADOOP-8230) | Enable sync by default and disable append | Major | . | Eli Collins | Eli Collins |
-| [HADOOP-8154](https://issues.apache.org/jira/browse/HADOOP-8154) | DNS#getIPs shouldn't silently return the local host IP for bogus interface names | Major | conf | Eli Collins | Eli Collins |
-| [HADOOP-5464](https://issues.apache.org/jira/browse/HADOOP-5464) | DFSClient does not treat write timeout of 0 properly | Major | . | Raghu Angadi | Raghu Angadi |
| [HDFS-3522](https://issues.apache.org/jira/browse/HDFS-3522) | If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations | Major | namenode | Brandon Li | Brandon Li |
-| [HDFS-3044](https://issues.apache.org/jira/browse/HDFS-3044) | fsck move should be non-destructive by default | Major | namenode | Eli Collins | Colin Patrick McCabe |
+| [HADOOP-8365](https://issues.apache.org/jira/browse/HADOOP-8365) | Add flag to disable durable sync | Blocker | . | Eli Collins | Eli Collins |
+| [HADOOP-8552](https://issues.apache.org/jira/browse/HADOOP-8552) | Conflict: Same security.log.file for multiple users. | Major | conf, security | Karthik Kambatla | Karthik Kambatla |
| [HDFS-2617](https://issues.apache.org/jira/browse/HDFS-2617) | Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution | Major | security | Jakob Homan | Jakob Homan |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7823](https://issues.apache.org/jira/browse/HADOOP-7823) | port HADOOP-4012 to branch-1 (splitting support for bzip2) | Major | . | Tim Broberg | Andrew Purtell |
+| [MAPREDUCE-3118](https://issues.apache.org/jira/browse/MAPREDUCE-3118) | Backport Gridmix and Rumen features from trunk to Hadoop 0.20 security branch | Major | contrib/gridmix, tools/rumen | Ravi Gummadi | Ravi Gummadi |
| [HADOOP-7806](https://issues.apache.org/jira/browse/HADOOP-7806) | Support binding to sub-interfaces | Major | util | Harsh J | Harsh J |
-| [HDFS-3150](https://issues.apache.org/jira/browse/HDFS-3150) | Add option for clients to contact DNs via hostname | Major | datanode, hdfs-client | Eli Collins | Eli Collins |
| [HDFS-3148](https://issues.apache.org/jira/browse/HDFS-3148) | The client should be able to use multiple local interfaces for data transfer | Major | hdfs-client, performance | Eli Collins | Eli Collins |
-| [HDFS-3055](https://issues.apache.org/jira/browse/HDFS-3055) | Implement recovery mode for branch-1 | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
+| [HDFS-3055](https://issues.apache.org/jira/browse/HDFS-3055) | Implement recovery mode for branch-1 | Minor | . | Colin P. McCabe | Colin P. McCabe |
| [MAPREDUCE-3837](https://issues.apache.org/jira/browse/MAPREDUCE-3837) | Job tracker is not able to recover job in case of crash and after that no user can submit job. | Major | . | Mayank Bansal | Mayank Bansal |
-| [MAPREDUCE-3118](https://issues.apache.org/jira/browse/MAPREDUCE-3118) | Backport Gridmix and Rumen features from trunk to Hadoop 0.20 security branch | Major | contrib/gridmix, tools/rumen | Ravi Gummadi | Ravi Gummadi |
+| [HADOOP-7823](https://issues.apache.org/jira/browse/HADOOP-7823) | port HADOOP-4012 to branch-1 (splitting support for bzip2) | Major | . | Tim Broberg | Andrew Purtell |
+| [HDFS-3150](https://issues.apache.org/jira/browse/HDFS-3150) | Add option for clients to contact DNs via hostname | Major | datanode, hdfs-client | Eli Collins | Eli Collins |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8748](https://issues.apache.org/jira/browse/HADOOP-8748) | Move dfsclient retry to a util class | Minor | io | Arun C Murthy | Arun C Murthy |
-| [HADOOP-8656](https://issues.apache.org/jira/browse/HADOOP-8656) | backport forced daemon shutdown of HADOOP-8353 into branch-1 | Minor | bin | Steve Loughran | Roman Shaposhnik |
-| [HADOOP-8430](https://issues.apache.org/jira/browse/HADOOP-8430) | Backport new FileSystem methods introduced by HADOOP-8014 to branch-1 | Major | . | Eli Collins | Eli Collins |
-| [HADOOP-8209](https://issues.apache.org/jira/browse/HADOOP-8209) | Add option to relax build-version check for branch-1 | Major | . | Eli Collins | Eli Collins |
-| [HADOOP-7509](https://issues.apache.org/jira/browse/HADOOP-7509) | Improve message when Authentication is required | Trivial | . | Ravi Prakash | Ravi Prakash |
+| [MAPREDUCE-782](https://issues.apache.org/jira/browse/MAPREDUCE-782) | Use PureJavaCrc32 in mapreduce spills | Minor | performance | Todd Lipcon | Todd Lipcon |
+| [HDFS-496](https://issues.apache.org/jira/browse/HDFS-496) | Use PureJavaCrc32 in HDFS | Minor | datanode, hdfs-client, performance | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-1906](https://issues.apache.org/jira/browse/MAPREDUCE-1906) | Lower default minimum heartbeat interval for tasktracker \> Jobtracker | Major | jobtracker, performance, tasktracker | Scott Carey | Todd Lipcon |
| [HADOOP-6995](https://issues.apache.org/jira/browse/HADOOP-6995) | Allow wildcards to be used in ProxyUsers configurations | Minor | security | Todd Lipcon | Todd Lipcon |
-| [HDFS-3871](https://issues.apache.org/jira/browse/HDFS-3871) | Change NameNodeProxies to use HADOOP-8748 | Minor | hdfs-client | Arun C Murthy | Arun C Murthy |
-| [HDFS-3814](https://issues.apache.org/jira/browse/HDFS-3814) | Make the replication monitor multipliers configurable in 1.x | Major | namenode | Suresh Srinivas | Jing Zhao |
-| [HDFS-3703](https://issues.apache.org/jira/browse/HDFS-3703) | Decrease the datanode failure detection time | Major | datanode, namenode | Nicolas Liochon | Jing Zhao |
-| [HDFS-3667](https://issues.apache.org/jira/browse/HDFS-3667) | Add retry support to WebHdfsFileSystem | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-3617](https://issues.apache.org/jira/browse/HDFS-3617) | Port HDFS-96 to branch-1 (support blocks greater than 2GB) | Major | . | Matt Foley | Harsh J |
-| [HDFS-3596](https://issues.apache.org/jira/browse/HDFS-3596) | Improve FSEditLog pre-allocation in branch-1 | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3516](https://issues.apache.org/jira/browse/HDFS-3516) | Check content-type in WebHdfsFileSystem | Major | hdfs-client, webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-3504](https://issues.apache.org/jira/browse/HDFS-3504) | Configurable retry in DFSClient | Major | hdfs-client | Siddharth Seth | Tsz Wo Nicholas Sze |
-| [HDFS-3131](https://issues.apache.org/jira/browse/HDFS-3131) | Improve TestStorageRestore | Minor | . | Tsz Wo Nicholas Sze | Brandon Li |
-| [HDFS-3094](https://issues.apache.org/jira/browse/HDFS-3094) | add -nonInteractive and -force option to namenode -format command | Major | . | Arpit Gupta | Arpit Gupta |
-| [HDFS-2872](https://issues.apache.org/jira/browse/HDFS-2872) | Add sanity checks during edits loading that generation stamps are non-decreasing | Major | namenode | Todd Lipcon | Colin Patrick McCabe |
-| [HDFS-2654](https://issues.apache.org/jira/browse/HDFS-2654) | Make BlockReaderLocal not extend RemoteBlockReader2 | Major | datanode | Eli Collins | Eli Collins |
-| [HDFS-2653](https://issues.apache.org/jira/browse/HDFS-2653) | DFSClient should cache whether addrs are non-local when short-circuiting is enabled | Major | datanode | Eli Collins | Eli Collins |
-| [HDFS-2638](https://issues.apache.org/jira/browse/HDFS-2638) | Improve a block recovery log | Minor | namenode | Eli Collins | Eli Collins |
+| [MAPREDUCE-2103](https://issues.apache.org/jira/browse/MAPREDUCE-2103) | task-controller shouldn't require o-r permissions | Trivial | task-controller | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-2836](https://issues.apache.org/jira/browse/MAPREDUCE-2836) | Provide option to fail jobs when submitted to non-existent pools. | Minor | contrib/fair-share | Jeff Bean | Ahmed Radwan |
+| [HADOOP-7509](https://issues.apache.org/jira/browse/HADOOP-7509) | Improve message when Authentication is required | Trivial | . | Ravi Prakash | Ravi Prakash |
| [HDFS-2465](https://issues.apache.org/jira/browse/HDFS-2465) | Add HDFS support for fadvise readahead and drop-behind | Major | datanode, performance | Todd Lipcon | Todd Lipcon |
-| [HDFS-1378](https://issues.apache.org/jira/browse/HDFS-1378) | Edit log replay should track and report file offsets in case of errors | Major | namenode | Todd Lipcon | Colin Patrick McCabe |
-| [HDFS-496](https://issues.apache.org/jira/browse/HDFS-496) | Use PureJavaCrc32 in HDFS | Minor | datanode, hdfs-client, performance | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-4603](https://issues.apache.org/jira/browse/MAPREDUCE-4603) | Allow JobClient to retry job-submission when JT is in safemode | Major | . | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-4511](https://issues.apache.org/jira/browse/MAPREDUCE-4511) | Add IFile readahead | Major | mrv1, mrv2, performance | Ahmed Radwan | Ahmed Radwan |
-| [MAPREDUCE-4328](https://issues.apache.org/jira/browse/MAPREDUCE-4328) | Add the option to quiesce the JobTracker | Major | mrv1 | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-4001](https://issues.apache.org/jira/browse/MAPREDUCE-4001) | Improve MAPREDUCE-3789's fix logic by looking at job's slot demands instead | Minor | capacity-sched | Harsh J | Harsh J |
-| [MAPREDUCE-3597](https://issues.apache.org/jira/browse/MAPREDUCE-3597) | Provide a way to access other info of history file from Rumentool | Major | tools/rumen | Ravi Gummadi | Ravi Gummadi |
+| [MAPREDUCE-3278](https://issues.apache.org/jira/browse/MAPREDUCE-3278) | 0.20: avoid a busy-loop in ReduceTask scheduling | Major | mrv1, performance, task | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-3365](https://issues.apache.org/jira/browse/MAPREDUCE-3365) | Uncomment eventlog settings from the documentation | Trivial | contrib/fair-share | Sho Shimauchi | Sho Shimauchi |
| [MAPREDUCE-3395](https://issues.apache.org/jira/browse/MAPREDUCE-3395) | Add mapred.disk.healthChecker.interval to mapred-default.xml | Trivial | documentation | Eli Collins | Eli Collins |
| [MAPREDUCE-3394](https://issues.apache.org/jira/browse/MAPREDUCE-3394) | Add log guard for a debug message in ReduceTask | Trivial | task | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-3365](https://issues.apache.org/jira/browse/MAPREDUCE-3365) | Uncomment eventlog settings from the documentation | Trivial | contrib/fair-share | Sho Shimauchi | Sho Shimauchi |
-| [MAPREDUCE-3289](https://issues.apache.org/jira/browse/MAPREDUCE-3289) | Make use of fadvise in the NM's shuffle handler | Major | mrv2, nodemanager, performance | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-3278](https://issues.apache.org/jira/browse/MAPREDUCE-3278) | 0.20: avoid a busy-loop in ReduceTask scheduling | Major | mrv1, performance, task | Todd Lipcon | Todd Lipcon |
+| [HDFS-2638](https://issues.apache.org/jira/browse/HDFS-2638) | Improve a block recovery log | Minor | namenode | Eli Collins | Eli Collins |
+| [HDFS-2653](https://issues.apache.org/jira/browse/HDFS-2653) | DFSClient should cache whether addrs are non-local when short-circuiting is enabled | Major | datanode | Eli Collins | Eli Collins |
+| [HDFS-2654](https://issues.apache.org/jira/browse/HDFS-2654) | Make BlockReaderLocal not extend RemoteBlockReader2 | Major | datanode | Eli Collins | Eli Collins |
+| [MAPREDUCE-3597](https://issues.apache.org/jira/browse/MAPREDUCE-3597) | Provide a way to access other info of history file from Rumentool | Major | tools/rumen | Ravi Gummadi | Ravi Gummadi |
| [MAPREDUCE-2919](https://issues.apache.org/jira/browse/MAPREDUCE-2919) | The JT web UI should show job start times | Minor | jobtracker | Eli Collins | Harsh J |
-| [MAPREDUCE-2836](https://issues.apache.org/jira/browse/MAPREDUCE-2836) | Provide option to fail jobs when submitted to non-existent pools. | Minor | contrib/fair-share | Jeff Bean | Ahmed Radwan |
+| [HDFS-2872](https://issues.apache.org/jira/browse/HDFS-2872) | Add sanity checks during edits loading that generation stamps are non-decreasing | Major | namenode | Todd Lipcon | Colin P. McCabe |
+| [MAPREDUCE-4001](https://issues.apache.org/jira/browse/MAPREDUCE-4001) | Improve MAPREDUCE-3789's fix logic by looking at job's slot demands instead | Minor | capacity-sched | Harsh J | Harsh J |
| [MAPREDUCE-2835](https://issues.apache.org/jira/browse/MAPREDUCE-2835) | Make per-job counter limits configurable | Major | . | Tom White | Tom White |
-| [MAPREDUCE-2103](https://issues.apache.org/jira/browse/MAPREDUCE-2103) | task-controller shouldn't require o-r permissions | Trivial | task-controller | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-1906](https://issues.apache.org/jira/browse/MAPREDUCE-1906) | Lower default minimum heartbeat interval for tasktracker \> Jobtracker | Major | jobtracker, performance, tasktracker | Scott Carey | Todd Lipcon |
-| [MAPREDUCE-782](https://issues.apache.org/jira/browse/MAPREDUCE-782) | Use PureJavaCrc32 in mapreduce spills | Minor | performance | Todd Lipcon | Todd Lipcon |
+| [HDFS-3131](https://issues.apache.org/jira/browse/HDFS-3131) | Improve TestStorageRestore | Minor | . | Tsz Wo Nicholas Sze | Brandon Li |
+| [HDFS-1378](https://issues.apache.org/jira/browse/HDFS-1378) | Edit log replay should track and report file offsets in case of errors | Major | namenode | Todd Lipcon | Colin P. McCabe |
+| [HADOOP-8209](https://issues.apache.org/jira/browse/HADOOP-8209) | Add option to relax build-version check for branch-1 | Major | . | Eli Collins | Eli Collins |
+| [HDFS-3094](https://issues.apache.org/jira/browse/HDFS-3094) | add -nonInteractive and -force option to namenode -format command | Major | . | Arpit Gupta | Arpit Gupta |
+| [HADOOP-8430](https://issues.apache.org/jira/browse/HADOOP-8430) | Backport new FileSystem methods introduced by HADOOP-8014 to branch-1 | Major | . | Eli Collins | Eli Collins |
+| [HDFS-3504](https://issues.apache.org/jira/browse/HDFS-3504) | Configurable retry in DFSClient | Major | hdfs-client | Siddharth Seth | Tsz Wo Nicholas Sze |
+| [HDFS-3516](https://issues.apache.org/jira/browse/HDFS-3516) | Check content-type in WebHdfsFileSystem | Major | hdfs-client, webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-3596](https://issues.apache.org/jira/browse/HDFS-3596) | Improve FSEditLog pre-allocation in branch-1 | Minor | . | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-3617](https://issues.apache.org/jira/browse/HDFS-3617) | Port HDFS-96 to branch-1 (support blocks greater than 2GB) | Major | . | Matt Foley | Harsh J |
+| [HDFS-3667](https://issues.apache.org/jira/browse/HDFS-3667) | Add retry support to WebHdfsFileSystem | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-3289](https://issues.apache.org/jira/browse/MAPREDUCE-3289) | Make use of fadvise in the NM's shuffle handler | Major | mrv2, nodemanager, performance | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8656](https://issues.apache.org/jira/browse/HADOOP-8656) | backport forced daemon shutdown of HADOOP-8353 into branch-1 | Minor | bin | Steve Loughran | Roman Shaposhnik |
+| [MAPREDUCE-4511](https://issues.apache.org/jira/browse/MAPREDUCE-4511) | Add IFile readahead | Major | mrv1, mrv2, performance | Ahmed Radwan | Ahmed Radwan |
+| [HDFS-3814](https://issues.apache.org/jira/browse/HDFS-3814) | Make the replication monitor multipliers configurable in 1.x | Major | namenode | Suresh Srinivas | Jing Zhao |
+| [MAPREDUCE-4328](https://issues.apache.org/jira/browse/MAPREDUCE-4328) | Add the option to quiesce the JobTracker | Major | mrv1 | Arun C Murthy | Arun C Murthy |
+| [HADOOP-8748](https://issues.apache.org/jira/browse/HADOOP-8748) | Move dfsclient retry to a util class | Minor | io | Arun C Murthy | Arun C Murthy |
+| [HDFS-3871](https://issues.apache.org/jira/browse/HDFS-3871) | Change NameNodeProxies to use HADOOP-8748 | Minor | hdfs-client | Arun C Murthy | Arun C Murthy |
+| [HDFS-3703](https://issues.apache.org/jira/browse/HDFS-3703) | Decrease the datanode failure detection time | Major | datanode, namenode | Nicolas Liochon | Jing Zhao |
+| [MAPREDUCE-4603](https://issues.apache.org/jira/browse/MAPREDUCE-4603) | Allow JobClient to retry job-submission when JT is in safemode | Major | . | Arun C Murthy | Arun C Murthy |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8617](https://issues.apache.org/jira/browse/HADOOP-8617) | backport pure Java CRC32 calculator changes to branch-1 | Major | performance | Brandon Li | Brandon Li |
-| [HADOOP-8445](https://issues.apache.org/jira/browse/HADOOP-8445) | Token should not print the password in toString | Major | security | Ravi Prakash | Ravi Prakash |
-| [HADOOP-8417](https://issues.apache.org/jira/browse/HADOOP-8417) | HADOOP-6963 didn't update hadoop-core-pom-template.xml | Major | . | Ted Yu | Ted Yu |
-| [HADOOP-8399](https://issues.apache.org/jira/browse/HADOOP-8399) | Remove JDK5 dependency from Hadoop 1.0+ line | Major | build | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-8329](https://issues.apache.org/jira/browse/HADOOP-8329) | Build fails with Java 7 | Major | build | Kumar Ravi | Eli Collins |
-| [HADOOP-8269](https://issues.apache.org/jira/browse/HADOOP-8269) | Fix some javadoc warnings on branch-1 | Trivial | documentation | Eli Collins | Eli Collins |
-| [HADOOP-8159](https://issues.apache.org/jira/browse/HADOOP-8159) | NetworkTopology: getLeaf should check for invalid topologies | Major | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-7988](https://issues.apache.org/jira/browse/HADOOP-7988) | Upper case in hostname part of the principals doesn't work with kerberos. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-7982](https://issues.apache.org/jira/browse/HADOOP-7982) | UserGroupInformation fails to login if thread's context classloader can't load HadoopLoginModule | Major | security | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7908](https://issues.apache.org/jira/browse/HADOOP-7908) | Fix three javadoc warnings on branch-1 | Trivial | documentation | Eli Collins | Eli Collins |
-| [HADOOP-7898](https://issues.apache.org/jira/browse/HADOOP-7898) | Fix javadoc warnings in AuthenticationToken.java | Minor | security | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-7879](https://issues.apache.org/jira/browse/HADOOP-7879) | DistributedFileSystem#createNonRecursive should also incrementWriteOps statistics. | Trivial | . | Jonathan Hsieh | Jonathan Hsieh |
-| [HADOOP-7870](https://issues.apache.org/jira/browse/HADOOP-7870) | fix SequenceFile#createWriter with boolean createParent arg to respect createParent. | Major | . | Jonathan Hsieh | Jonathan Hsieh |
-| [HADOOP-7745](https://issues.apache.org/jira/browse/HADOOP-7745) | I switched variable names in HADOOP-7509 | Major | . | Ravi Prakash | Ravi Prakash |
-| [HADOOP-7666](https://issues.apache.org/jira/browse/HADOOP-7666) | branch-0.20-security doesn't include o.a.h.security.TestAuthenticationFilter | Major | security | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-7665](https://issues.apache.org/jira/browse/HADOOP-7665) | branch-0.20-security doesn't include SPNEGO settings in core-default.xml | Major | security | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-7653](https://issues.apache.org/jira/browse/HADOOP-7653) | tarball doesn't include .eclipse.templates | Minor | build | Jonathan Natkins | Jonathan Natkins |
-| [HADOOP-7634](https://issues.apache.org/jira/browse/HADOOP-7634) | Cluster setup docs specify wrong owner for task-controller.cfg | Minor | documentation, security | Eli Collins | Eli Collins |
+| [HADOOP-5836](https://issues.apache.org/jira/browse/HADOOP-5836) | Bug in S3N handling of directory markers using an object with a trailing "/" causes jobs to fail | Major | fs/s3 | Ian Nowland | Ian Nowland |
+| [HADOOP-6546](https://issues.apache.org/jira/browse/HADOOP-6546) | BloomMapFile can return false negatives | Major | io | Clark Jefcoat | Clark Jefcoat |
+| [HADOOP-6947](https://issues.apache.org/jira/browse/HADOOP-6947) | Kerberos relogin should set refreshKrb5Config to true | Major | security | Todd Lipcon | Todd Lipcon |
+| [HDFS-2305](https://issues.apache.org/jira/browse/HDFS-2305) | Running multiple 2NNs can result in corrupt file system | Major | namenode | Aaron T. Myers | Aaron T. Myers |
| [HADOOP-7629](https://issues.apache.org/jira/browse/HADOOP-7629) | regression with MAPREDUCE-2289 - setPermission passed immutable FsPermission (rpc failure) | Major | . | Patrick Hunt | Todd Lipcon |
+| [HADOOP-7634](https://issues.apache.org/jira/browse/HADOOP-7634) | Cluster setup docs specify wrong owner for task-controller.cfg | Minor | documentation, security | Eli Collins | Eli Collins |
+| [HADOOP-7665](https://issues.apache.org/jira/browse/HADOOP-7665) | branch-0.20-security doesn't include SPNEGO settings in core-default.xml | Major | security | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-7666](https://issues.apache.org/jira/browse/HADOOP-7666) | branch-0.20-security doesn't include o.a.h.security.TestAuthenticationFilter | Major | security | Aaron T. Myers | Aaron T. Myers |
| [HADOOP-7621](https://issues.apache.org/jira/browse/HADOOP-7621) | alfredo config should be in a file not readable by users | Critical | security | Alejandro Abdelnur | Aaron T. Myers |
+| [HADOOP-7653](https://issues.apache.org/jira/browse/HADOOP-7653) | tarball doesn't include .eclipse.templates | Minor | build | Jonathan Natkins | Jonathan Natkins |
+| [MAPREDUCE-2932](https://issues.apache.org/jira/browse/MAPREDUCE-2932) | Missing instrumentation plugin class shouldn't crash the TT startup per design | Trivial | tasktracker | Harsh J | Harsh J |
+| [HADOOP-7745](https://issues.apache.org/jira/browse/HADOOP-7745) | I switched variable names in HADOOP-7509 | Major | . | Ravi Prakash | Ravi Prakash |
+| [MAPREDUCE-3405](https://issues.apache.org/jira/browse/MAPREDUCE-3405) | MAPREDUCE-3015 broke compilation of contrib scheduler tests | Critical | capacity-sched, contrib/fair-share | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-3419](https://issues.apache.org/jira/browse/MAPREDUCE-3419) | Don't mark exited TT threads as dead in MiniMRCluster | Major | tasktracker, test | Eli Collins | Eli Collins |
| [HADOOP-7297](https://issues.apache.org/jira/browse/HADOOP-7297) | Error in the documentation regarding Checkpoint/Backup Node | Trivial | documentation | arnaud p | Harsh J |
-| [HADOOP-6947](https://issues.apache.org/jira/browse/HADOOP-6947) | Kerberos relogin should set refreshKrb5Config to true | Major | security | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6546](https://issues.apache.org/jira/browse/HADOOP-6546) | BloomMapFile can return false negatives | Major | io | Clark Jefcoat | Clark Jefcoat |
-| [HADOOP-6527](https://issues.apache.org/jira/browse/HADOOP-6527) | UserGroupInformation::createUserForTesting clobbers already defined group mappings | Major | security | Jakob Homan | Ivan Mitic |
-| [HADOOP-5836](https://issues.apache.org/jira/browse/HADOOP-5836) | Bug in S3N handling of directory markers using an object with a trailing "/" causes jobs to fail | Major | fs/s3 | Ian Nowland | Ian Nowland |
-| [HDFS-3966](https://issues.apache.org/jira/browse/HDFS-3966) | For branch-1, TestFileCreation should use JUnit4 to make assumeTrue work | Minor | . | Jing Zhao | Jing Zhao |
-| [HDFS-3701](https://issues.apache.org/jira/browse/HDFS-3701) | HDFS may miss the final block when reading a file opened for writing if one of the datanode is dead | Critical | hdfs-client | Nicolas Liochon | Nicolas Liochon |
-| [HDFS-3698](https://issues.apache.org/jira/browse/HDFS-3698) | TestHftpFileSystem is failing in branch-1 due to changed default secure port | Major | security | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3696](https://issues.apache.org/jira/browse/HDFS-3696) | Create files with WebHdfsFileSystem goes OOM when file size is big | Critical | webhdfs | Kihwal Lee | Tsz Wo Nicholas Sze |
-| [HDFS-3551](https://issues.apache.org/jira/browse/HDFS-3551) | WebHDFS CREATE does not use client location for redirection | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-3518](https://issues.apache.org/jira/browse/HDFS-3518) | Provide API to check HDFS operational state | Major | hdfs-client | Bikas Saha | Tsz Wo Nicholas Sze |
-| [HDFS-3466](https://issues.apache.org/jira/browse/HDFS-3466) | The SPNEGO filter for the NameNode should come out of the web keytab file | Major | namenode, security | Owen O'Malley | Owen O'Malley |
-| [HDFS-3461](https://issues.apache.org/jira/browse/HDFS-3461) | HFTP should use the same port & protocol for getting the delegation token | Major | . | Owen O'Malley | Owen O'Malley |
-| [HDFS-3453](https://issues.apache.org/jira/browse/HDFS-3453) | HDFS does not use ClientProtocol in a backward-compatible way | Major | hdfs-client | Kihwal Lee | Kihwal Lee |
-| [HDFS-3330](https://issues.apache.org/jira/browse/HDFS-3330) | If GetImageServlet throws an Error or RTE, response has HTTP "OK" status | Critical | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-3176](https://issues.apache.org/jira/browse/HDFS-3176) | JsonUtil should not parse the MD5MD5CRC32FileChecksum bytes on its own. | Major | hdfs-client | Kihwal Lee | Kihwal Lee |
-| [HDFS-3078](https://issues.apache.org/jira/browse/HDFS-3078) | 2NN https port setting is broken | Major | . | Eli Collins | Eli Collins |
-| [HDFS-3008](https://issues.apache.org/jira/browse/HDFS-3008) | Negative caching of local addrs doesn't work | Major | hdfs-client | Eli Collins | Eli Collins |
-| [HDFS-2877](https://issues.apache.org/jira/browse/HDFS-2877) | If locking of a storage dir fails, it will remove the other NN's lock file on exit | Major | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2869](https://issues.apache.org/jira/browse/HDFS-2869) | Error in Webhdfs documentation for mkdir | Minor | webhdfs | Harsh J | Harsh J |
-| [HDFS-2790](https://issues.apache.org/jira/browse/HDFS-2790) | FSNamesystem.setTimes throws exception with wrong configuration name in the message | Minor | . | Arpit Gupta | Arpit Gupta |
-| [HDFS-2751](https://issues.apache.org/jira/browse/HDFS-2751) | Datanode drops OS cache behind reads even for short reads | Major | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2741](https://issues.apache.org/jira/browse/HDFS-2741) | dfs.datanode.max.xcievers missing in 0.20.205.0 | Minor | . | Markus Jelsma | |
-| [HDFS-2728](https://issues.apache.org/jira/browse/HDFS-2728) | Remove dfsadmin -printTopology from branch-1 docs since it does not exist | Minor | namenode | Harsh J | Harsh J |
+| [HDFS-2541](https://issues.apache.org/jira/browse/HDFS-2541) | For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. | Major | datanode | Harsh J | Harsh J |
+| [MAPREDUCE-2905](https://issues.apache.org/jira/browse/MAPREDUCE-2905) | CapBasedLoadManager incorrectly allows assignment when assignMultiple is true (was: assignmultiple per job) | Major | contrib/fair-share | Jeff Bean | Jeff Bean |
+| [MAPREDUCE-2806](https://issues.apache.org/jira/browse/MAPREDUCE-2806) | [Gridmix] Load job fails with timeout errors when resource emulation is turned on | Major | contrib/gridmix | Amar Kamat | Amar Kamat |
+| [HADOOP-7870](https://issues.apache.org/jira/browse/HADOOP-7870) | fix SequenceFile#createWriter with boolean createParent arg to respect createParent. | Major | . | Jonathan Hsieh | Jonathan Hsieh |
+| [HADOOP-7879](https://issues.apache.org/jira/browse/HADOOP-7879) | DistributedFileSystem#createNonRecursive should also incrementWriteOps statistics. | Trivial | . | Jonathan Hsieh | Jonathan Hsieh |
| [HDFS-2637](https://issues.apache.org/jira/browse/HDFS-2637) | The rpc timeout for block recovery is too low | Major | hdfs-client | Eli Collins | Eli Collins |
+| [HADOOP-7898](https://issues.apache.org/jira/browse/HADOOP-7898) | Fix javadoc warnings in AuthenticationToken.java | Minor | security | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-7908](https://issues.apache.org/jira/browse/HADOOP-7908) | Fix three javadoc warnings on branch-1 | Trivial | documentation | Eli Collins | Eli Collins |
| [HDFS-2547](https://issues.apache.org/jira/browse/HDFS-2547) | ReplicationTargetChooser has incorrect block placement comments | Trivial | namenode | Harsh J | Harsh J |
-| [HDFS-2541](https://issues.apache.org/jira/browse/HDFS-2541) | For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. | Major | datanode | Harsh J | Harsh J |
-| [HDFS-2305](https://issues.apache.org/jira/browse/HDFS-2305) | Running multiple 2NNs can result in corrupt file system | Major | namenode | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-2728](https://issues.apache.org/jira/browse/HDFS-2728) | Remove dfsadmin -printTopology from branch-1 docs since it does not exist | Minor | namenode | Harsh J | Harsh J |
+| [HDFS-2741](https://issues.apache.org/jira/browse/HDFS-2741) | dfs.datanode.max.xcievers missing in 0.20.205.0 | Minor | . | Markus Jelsma | |
| [HDFS-1910](https://issues.apache.org/jira/browse/HDFS-1910) | when dfs.name.dir and dfs.name.edits.dir are same fsimage will be saved twice every time | Minor | namenode | Gokul | |
-| [MAPREDUCE-4698](https://issues.apache.org/jira/browse/MAPREDUCE-4698) | TestJobHistoryConfig throws Exception in testJobHistoryLogging | Minor | . | Gopal V | Gopal V |
-| [MAPREDUCE-4675](https://issues.apache.org/jira/browse/MAPREDUCE-4675) | TestKillSubProcesses fails as the process is still alive after the job is done | Major | test | Arpit Gupta | Bikas Saha |
-| [MAPREDUCE-4673](https://issues.apache.org/jira/browse/MAPREDUCE-4673) | make TestRawHistoryFile and TestJobHistoryServer more robust | Major | test | Arpit Gupta | Arpit Gupta |
-| [MAPREDUCE-4558](https://issues.apache.org/jira/browse/MAPREDUCE-4558) | TestJobTrackerSafeMode is failing | Major | . | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-4400](https://issues.apache.org/jira/browse/MAPREDUCE-4400) | Fix performance regression for small jobs/workflows | Major | performance, task | Luke Lu | Luke Lu |
-| [MAPREDUCE-4241](https://issues.apache.org/jira/browse/MAPREDUCE-4241) | Pipes examples do not compile on Ubuntu 12.04 | Major | build, examples | Andrew Bayer | Andrew Bayer |
-| [MAPREDUCE-4095](https://issues.apache.org/jira/browse/MAPREDUCE-4095) | TestJobInProgress#testLocality uses a bogus topology | Major | . | Eli Collins | Colin Patrick McCabe |
-| [MAPREDUCE-4088](https://issues.apache.org/jira/browse/MAPREDUCE-4088) | Task stuck in JobLocalizer prevented other tasks on the same node from committing | Critical | mrv1 | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-4087](https://issues.apache.org/jira/browse/MAPREDUCE-4087) | [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases | Major | . | Ravi Gummadi | Ravi Gummadi |
+| [HDFS-2790](https://issues.apache.org/jira/browse/HDFS-2790) | FSNamesystem.setTimes throws exception with wrong configuration name in the message | Minor | . | Arpit Gupta | Arpit Gupta |
+| [HADOOP-7982](https://issues.apache.org/jira/browse/HADOOP-7982) | UserGroupInformation fails to login if thread's context classloader can't load HadoopLoginModule | Major | security | Todd Lipcon | Todd Lipcon |
+| [HDFS-2751](https://issues.apache.org/jira/browse/HDFS-2751) | Datanode drops OS cache behind reads even for short reads | Major | datanode | Todd Lipcon | Todd Lipcon |
+| [HADOOP-7988](https://issues.apache.org/jira/browse/HADOOP-7988) | Upper case in hostname part of the principals doesn't work with kerberos. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HDFS-2877](https://issues.apache.org/jira/browse/HDFS-2877) | If locking of a storage dir fails, it will remove the other NN's lock file on exit | Major | namenode | Todd Lipcon | Todd Lipcon |
| [MAPREDUCE-3789](https://issues.apache.org/jira/browse/MAPREDUCE-3789) | CapacityTaskScheduler may perform unnecessary reservations in heterogenous tracker environments | Critical | capacity-sched, scheduler | Harsh J | Harsh J |
+| [HDFS-2869](https://issues.apache.org/jira/browse/HDFS-2869) | Error in Webhdfs documentation for mkdir | Minor | webhdfs | Harsh J | Harsh J |
+| [HDFS-3008](https://issues.apache.org/jira/browse/HDFS-3008) | Negative caching of local addrs doesn't work | Major | hdfs-client | Eli Collins | Eli Collins |
+| [HDFS-3078](https://issues.apache.org/jira/browse/HDFS-3078) | 2NN https port setting is broken | Major | . | Eli Collins | Eli Collins |
+| [MAPREDUCE-1740](https://issues.apache.org/jira/browse/MAPREDUCE-1740) | NPE in getMatchingLevelForNodes when node locations are variable depth | Major | jobtracker | Todd Lipcon | Ahmed Radwan |
+| [HADOOP-8159](https://issues.apache.org/jira/browse/HADOOP-8159) | NetworkTopology: getLeaf should check for invalid topologies | Major | . | Colin P. McCabe | Colin P. McCabe |
+| [MAPREDUCE-4087](https://issues.apache.org/jira/browse/MAPREDUCE-4087) | [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases | Major | . | Ravi Gummadi | Ravi Gummadi |
+| [MAPREDUCE-4095](https://issues.apache.org/jira/browse/MAPREDUCE-4095) | TestJobInProgress#testLocality uses a bogus topology | Major | . | Eli Collins | Colin P. McCabe |
+| [HDFS-3176](https://issues.apache.org/jira/browse/HDFS-3176) | JsonUtil should not parse the MD5MD5CRC32FileChecksum bytes on its own. | Major | hdfs-client | Kihwal Lee | Kihwal Lee |
+| [HADOOP-8269](https://issues.apache.org/jira/browse/HADOOP-8269) | Fix some javadoc warnings on branch-1 | Trivial | documentation | Eli Collins | Eli Collins |
| [MAPREDUCE-3674](https://issues.apache.org/jira/browse/MAPREDUCE-3674) | If invoked with no queueName request param, jobqueue\_details.jsp injects a null queue name into schedulers. | Critical | jobtracker | Harsh J | Harsh J |
-| [MAPREDUCE-3419](https://issues.apache.org/jira/browse/MAPREDUCE-3419) | Don't mark exited TT threads as dead in MiniMRCluster | Major | tasktracker, test | Eli Collins | Eli Collins |
-| [MAPREDUCE-3405](https://issues.apache.org/jira/browse/MAPREDUCE-3405) | MAPREDUCE-3015 broke compilation of contrib scheduler tests | Critical | capacity-sched, contrib/fair-share | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-2932](https://issues.apache.org/jira/browse/MAPREDUCE-2932) | Missing instrumentation plugin class shouldn't crash the TT startup per design | Trivial | tasktracker | Harsh J | Harsh J |
-| [MAPREDUCE-2905](https://issues.apache.org/jira/browse/MAPREDUCE-2905) | CapBasedLoadManager incorrectly allows assignment when assignMultiple is true (was: assignmultiple per job) | Major | contrib/fair-share | Jeff Bean | Jeff Bean |
-| [MAPREDUCE-2903](https://issues.apache.org/jira/browse/MAPREDUCE-2903) | Map Tasks graph is throwing XML Parse error when Job is executed with 0 maps | Major | jobtracker | Devaraj K | Devaraj K |
-| [MAPREDUCE-2806](https://issues.apache.org/jira/browse/MAPREDUCE-2806) | [Gridmix] Load job fails with timeout errors when resource emulation is turned on | Major | contrib/gridmix | Amar Kamat | Amar Kamat |
-| [MAPREDUCE-2377](https://issues.apache.org/jira/browse/MAPREDUCE-2377) | task-controller fails to parse configuration if it doesn't end in \n | Major | task-controller | Todd Lipcon | Benoy Antony |
+| [MAPREDUCE-4088](https://issues.apache.org/jira/browse/MAPREDUCE-4088) | Task stuck in JobLocalizer prevented other tasks on the same node from committing | Critical | mrv1 | Ravi Prakash | Ravi Prakash |
+| [MAPREDUCE-4241](https://issues.apache.org/jira/browse/MAPREDUCE-4241) | Pipes examples do not compile on Ubuntu 12.04 | Major | build, examples | Andrew Bayer | Andrew Bayer |
+| [HDFS-3330](https://issues.apache.org/jira/browse/HDFS-3330) | If GetImageServlet throws an Error or RTE, response has HTTP "OK" status | Critical | namenode | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8329](https://issues.apache.org/jira/browse/HADOOP-8329) | Build fails with Java 7 | Major | build | Kumar Ravi | Eli Collins |
+| [HDFS-3453](https://issues.apache.org/jira/browse/HDFS-3453) | HDFS does not use ClientProtocol in a backward-compatible way | Major | hdfs-client | Kihwal Lee | Kihwal Lee |
+| [HADOOP-8445](https://issues.apache.org/jira/browse/HADOOP-8445) | Token should not print the password in toString | Major | security | Ravi Prakash | Ravi Prakash |
+| [MAPREDUCE-2377](https://issues.apache.org/jira/browse/MAPREDUCE-2377) | task-controller fails to parse configuration if it doesn't end in \\n | Major | task-controller | Todd Lipcon | Benoy Antony |
+| [HDFS-3518](https://issues.apache.org/jira/browse/HDFS-3518) | Provide API to check HDFS operational state | Major | hdfs-client | Bikas Saha | Tsz Wo Nicholas Sze |
+| [HDFS-3551](https://issues.apache.org/jira/browse/HDFS-3551) | WebHDFS CREATE does not use client location for redirection | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-6527](https://issues.apache.org/jira/browse/HADOOP-6527) | UserGroupInformation::createUserForTesting clobbers already defined group mappings | Major | security | Jakob Homan | Ivan Mitic |
| [MAPREDUCE-2129](https://issues.apache.org/jira/browse/MAPREDUCE-2129) | Job may hang if mapreduce.job.committer.setup.cleanup.needed=false and mapreduce.map/reduce.failures.maxpercent\>0 | Major | jobtracker | Kang Xiao | Subroto Sanyal |
-| [MAPREDUCE-1740](https://issues.apache.org/jira/browse/MAPREDUCE-1740) | NPE in getMatchingLevelForNodes when node locations are variable depth | Major | jobtracker | Todd Lipcon | Ahmed Radwan |
+| [HADOOP-8417](https://issues.apache.org/jira/browse/HADOOP-8417) | HADOOP-6963 didn't update hadoop-core-pom-template.xml | Major | . | Ted Yu | Ted Yu |
+| [HADOOP-8399](https://issues.apache.org/jira/browse/HADOOP-8399) | Remove JDK5 dependency from Hadoop 1.0+ line | Major | build | Konstantin Boudnik | Konstantin Boudnik |
+| [MAPREDUCE-2903](https://issues.apache.org/jira/browse/MAPREDUCE-2903) | Map Tasks graph is throwing XML Parse error when Job is executed with 0 maps | Major | jobtracker | Devaraj K | Devaraj K |
+| [HADOOP-8617](https://issues.apache.org/jira/browse/HADOOP-8617) | backport pure Java CRC32 calculator changes to branch-1 | Major | performance | Brandon Li | Brandon Li |
+| [MAPREDUCE-4400](https://issues.apache.org/jira/browse/MAPREDUCE-4400) | Fix performance regression for small jobs/workflows | Major | performance, task | Luke Lu | Luke Lu |
+| [HDFS-3696](https://issues.apache.org/jira/browse/HDFS-3696) | Create files with WebHdfsFileSystem goes OOM when file size is big | Critical | webhdfs | Kihwal Lee | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-4558](https://issues.apache.org/jira/browse/MAPREDUCE-4558) | TestJobTrackerSafeMode is failing | Major | . | Siddharth Seth | Siddharth Seth |
+| [HDFS-3466](https://issues.apache.org/jira/browse/HDFS-3466) | The SPNEGO filter for the NameNode should come out of the web keytab file | Major | namenode, security | Owen O'Malley | Owen O'Malley |
+| [HDFS-3966](https://issues.apache.org/jira/browse/HDFS-3966) | For branch-1, TestFileCreation should use JUnit4 to make assumeTrue work | Minor | . | Jing Zhao | Jing Zhao |
+| [HDFS-3698](https://issues.apache.org/jira/browse/HDFS-3698) | TestHftpFileSystem is failing in branch-1 due to changed default secure port | Major | security | Aaron T. Myers | Aaron T. Myers |
+| [MAPREDUCE-4673](https://issues.apache.org/jira/browse/MAPREDUCE-4673) | make TestRawHistoryFile and TestJobHistoryServer more robust | Major | test | Arpit Gupta | Arpit Gupta |
+| [MAPREDUCE-4675](https://issues.apache.org/jira/browse/MAPREDUCE-4675) | TestKillSubProcesses fails as the process is still alive after the job is done | Major | test | Arpit Gupta | Bikas Saha |
+| [HDFS-3701](https://issues.apache.org/jira/browse/HDFS-3701) | HDFS may miss the final block when reading a file opened for writing if one of the datanode is dead | Critical | hdfs-client | Nicolas Liochon | Nicolas Liochon |
+| [MAPREDUCE-4698](https://issues.apache.org/jira/browse/MAPREDUCE-4698) | TestJobHistoryConfig throws Exception in testJobHistoryLogging | Minor | . | Gopal V | Gopal V |
+| [HDFS-3461](https://issues.apache.org/jira/browse/HDFS-3461) | HFTP should use the same port & protocol for getting the delegation token | Major | . | Owen O'Malley | Owen O'Malley |
### TESTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7942](https://issues.apache.org/jira/browse/HADOOP-7942) | enabling clover coverage reports fails hadoop unit test compilation | Major | . | Giridharan Kesavan | Jitendra Nath Pandey |
-| [HDFS-3129](https://issues.apache.org/jira/browse/HDFS-3129) | NetworkTopology: add test that getLeaf should check for invalid topologies | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-2332](https://issues.apache.org/jira/browse/HDFS-2332) | Add test for HADOOP-7629: using an immutable FsPermission as an IPC parameter | Major | test | Todd Lipcon | Todd Lipcon |
| [MAPREDUCE-2073](https://issues.apache.org/jira/browse/MAPREDUCE-2073) | TestTrackerDistributedCacheManager should be up-front about requirements on build environment | Trivial | distributed-cache, test | Todd Lipcon | Todd Lipcon |
+| [HDFS-2332](https://issues.apache.org/jira/browse/HDFS-2332) | Add test for HADOOP-7629: using an immutable FsPermission as an IPC parameter | Major | test | Todd Lipcon | Todd Lipcon |
+| [HDFS-3129](https://issues.apache.org/jira/browse/HDFS-3129) | NetworkTopology: add test that getLeaf should check for invalid topologies | Minor | . | Colin P. McCabe | Colin P. McCabe |
+| [HADOOP-7942](https://issues.apache.org/jira/browse/HADOOP-7942) | enabling clover coverage reports fails hadoop unit test compilation | Major | . | Giridharan Kesavan | Jitendra Nath Pandey |
### SUB-TASKS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7753](https://issues.apache.org/jira/browse/HADOOP-7753) | Support fadvise and sync\_data\_range in NativeIO, add ReadaheadPool class | Major | io, native, performance | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-3424](https://issues.apache.org/jira/browse/MAPREDUCE-3424) | Some LinuxTaskController cleanup | Minor | tasktracker | Eli Collins | Eli Collins |
-| [MAPREDUCE-3015](https://issues.apache.org/jira/browse/MAPREDUCE-3015) | Add local dir failure info to metrics and the web UI | Major | tasktracker | Eli Collins | Eli Collins |
| [MAPREDUCE-3008](https://issues.apache.org/jira/browse/MAPREDUCE-3008) | [Gridmix] Improve cumulative CPU usage emulation for short running tasks | Major | contrib/gridmix | Amar Kamat | Amar Kamat |
| [MAPREDUCE-2957](https://issues.apache.org/jira/browse/MAPREDUCE-2957) | The TT should not re-init if it has no good local dirs | Major | tasktracker | Eli Collins | Eli Collins |
+| [HADOOP-7753](https://issues.apache.org/jira/browse/HADOOP-7753) | Support fadvise and sync\_data\_range in NativeIO, add ReadaheadPool class | Major | io, native, performance | Todd Lipcon | Todd Lipcon |
| [MAPREDUCE-2850](https://issues.apache.org/jira/browse/MAPREDUCE-2850) | Add test for TaskTracker disk failure handling (MR-2413) | Major | tasktracker | Eli Collins | Ravi Gummadi |
+| [MAPREDUCE-3015](https://issues.apache.org/jira/browse/MAPREDUCE-3015) | Add local dir failure info to metrics and the web UI | Major | tasktracker | Eli Collins | Eli Collins |
+| [MAPREDUCE-3424](https://issues.apache.org/jira/browse/MAPREDUCE-3424) | Some LinuxTaskController cleanup | Minor | tasktracker | Eli Collins | Eli Collins |
### OTHER:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/RELEASENOTES.1.1.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/RELEASENOTES.1.1.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/RELEASENOTES.1.1.0.md
index 53c7939..3298d25 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/RELEASENOTES.1.1.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/RELEASENOTES.1.1.0.md
@@ -23,92 +23,90 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-8552](https://issues.apache.org/jira/browse/HADOOP-8552) | *Major* | **Conflict: Same security.log.file for multiple users.**
+* [HADOOP-5464](https://issues.apache.org/jira/browse/HADOOP-5464) | *Major* | **DFSClient does not treat write timeout of 0 properly**
-**WARNING: No release note provided for this incompatible change.**
+Zero values for dfs.socket.timeout and dfs.datanode.socket.write.timeout are now respected. Previously zero values for these parameters resulted in a 5 second timeout.
---
-* [HADOOP-8365](https://issues.apache.org/jira/browse/HADOOP-8365) | *Blocker* | **Add flag to disable durable sync**
+* [MAPREDUCE-1906](https://issues.apache.org/jira/browse/MAPREDUCE-1906) | *Major* | **Lower default minimum heartbeat interval for tasktracker \> Jobtracker**
-This patch enables durable sync by default. Installation where HBase was not used, that used to run without setting "dfs.support.append" or setting it to false explicitly in the configuration, must add a new flag "dfs.durable.sync" and set it to false to preserve the previous semantics.
+The default minimum heartbeat interval has been dropped from 3 seconds to 300ms to increase scheduling throughput on small clusters. Users may tune mapreduce.jobtracker.heartbeats.in.second to adjust this value.
---
-* [HADOOP-8314](https://issues.apache.org/jira/browse/HADOOP-8314) | *Major* | **HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated**
+* [HADOOP-6995](https://issues.apache.org/jira/browse/HADOOP-6995) | *Minor* | **Allow wildcards to be used in ProxyUsers configurations**
-**WARNING: No release note provided for this incompatible change.**
+When configuring proxy users and hosts, the special wildcard value "\*" may be specified to match any host or any user.
---
-* [HADOOP-8230](https://issues.apache.org/jira/browse/HADOOP-8230) | *Major* | **Enable sync by default and disable append**
+* [MAPREDUCE-2517](https://issues.apache.org/jira/browse/MAPREDUCE-2517) | *Major* | **Porting Gridmix v3 system tests into trunk branch.**
-Append is not supported in Hadoop 1.x. Please upgrade to 2.x if you need append. If you enabled dfs.support.append for HBase, you're OK, as durable sync (why HBase required dfs.support.append) is now enabled by default. If you really need the previous functionality, to turn on the append functionality set the flag "dfs.support.broken.append" to true.
+Adds system tests to Gridmix. These system tests cover various features like job types (load and sleep), user resolvers (round-robin, submitter-user, echo) and submission modes (stress, replay and serial).
---
-* [HADOOP-8154](https://issues.apache.org/jira/browse/HADOOP-8154) | *Major* | **DNS#getIPs shouldn't silently return the local host IP for bogus interface names**
+* [MAPREDUCE-3008](https://issues.apache.org/jira/browse/MAPREDUCE-3008) | *Major* | **[Gridmix] Improve cumulative CPU usage emulation for short running tasks**
-**WARNING: No release note provided for this incompatible change.**
+Improves cumulative CPU emulation for short running tasks.
---
-* [HADOOP-6995](https://issues.apache.org/jira/browse/HADOOP-6995) | *Minor* | **Allow wildcards to be used in ProxyUsers configurations**
+* [MAPREDUCE-3118](https://issues.apache.org/jira/browse/MAPREDUCE-3118) | *Major* | **Backport Gridmix and Rumen features from trunk to Hadoop 0.20 security branch**
-When configuring proxy users and hosts, the special wildcard value "\*" may be specified to match any host or any user.
+Backports latest features from trunk to 0.20.206 branch.
---
-* [HADOOP-5464](https://issues.apache.org/jira/browse/HADOOP-5464) | *Major* | **DFSClient does not treat write timeout of 0 properly**
+* [HDFS-2465](https://issues.apache.org/jira/browse/HDFS-2465) | *Major* | **Add HDFS support for fadvise readahead and drop-behind**
-Zero values for dfs.socket.timeout and dfs.datanode.socket.write.timeout are now respected. Previously zero values for these parameters resulted in a 5 second timeout.
+HDFS now has the ability to use posix\_fadvise and sync\_data\_range syscalls to manage the OS buffer cache. This support is currently considered experimental, and may be enabled by configuring the following keys:
+dfs.datanode.drop.cache.behind.writes - set to true to drop data out of the buffer cache after writing
+dfs.datanode.drop.cache.behind.reads - set to true to drop data out of the buffer cache when performing sequential reads
+dfs.datanode.sync.behind.writes - set to true to trigger dirty page writeback immediately after writing data
+dfs.datanode.readahead.bytes - set to a non-zero value to trigger readahead for sequential reads
---
-* [HDFS-3814](https://issues.apache.org/jira/browse/HDFS-3814) | *Major* | **Make the replication monitor multipliers configurable in 1.x**
-
-This change adds two new configuration parameters.
-# {{dfs.namenode.invalidate.work.pct.per.iteration}} for controlling deletion rate of blocks.
-# {{dfs.namenode.replication.work.multiplier.per.iteration}} for controlling replication rate. This in turn allows controlling the time it takes for decommissioning.
+* [MAPREDUCE-3597](https://issues.apache.org/jira/browse/MAPREDUCE-3597) | *Major* | **Provide a way to access other info of history file from Rumentool**
-Please see hdfs-default.xml for detailed description.
+Rumen now provides {{Parsed\*}} objects. These objects provide extra information that are not provided by {{Logged\*}} objects.
---
-* [HDFS-3703](https://issues.apache.org/jira/browse/HDFS-3703) | *Major* | **Decrease the datanode failure detection time**
-
-This jira adds a new DataNode state called "stale" at the NameNode. DataNodes are marked as stale if it does not send heartbeat message to NameNode within the timeout configured using the configuration parameter "dfs.namenode.stale.datanode.interval" in seconds (default value is 30 seconds). NameNode picks a stale datanode as the last target to read from when returning block locations for reads.
+* [HDFS-2741](https://issues.apache.org/jira/browse/HDFS-2741) | *Minor* | **dfs.datanode.max.xcievers missing in 0.20.205.0**
-This feature is by default turned \* off \*. To turn on the feature, set the HDFS configuration "dfs.namenode.check.stale.datanode" to true.
+Document and raise the maximum allowed transfer threads on a DataNode to 4096. This helps Apache HBase in particular.
---
-* [HDFS-3522](https://issues.apache.org/jira/browse/HDFS-3522) | *Major* | **If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations**
+* [HDFS-3044](https://issues.apache.org/jira/browse/HDFS-3044) | *Major* | **fsck move should be non-destructive by default**
-getBlockLocations(), and hence open() for read, will now throw SafeModeException if the NameNode is still in safe mode and there are no replicas reported yet for one of the blocks in the file.
+The fsck "move" option is no longer destructive. It copies the accessible blocks of corrupt files to lost and found as before, but no longer deletes the corrupt files after copying the blocks. The original, destructive behavior can be enabled by specifying both the "move" and "delete" options.
---
-* [HDFS-3518](https://issues.apache.org/jira/browse/HDFS-3518) | *Major* | **Provide API to check HDFS operational state**
+* [HADOOP-8154](https://issues.apache.org/jira/browse/HADOOP-8154) | *Major* | **DNS#getIPs shouldn't silently return the local host IP for bogus interface names**
-Add a utility method HdfsUtils.isHealthy(uri) for checking if the given HDFS is healthy.
+**WARNING: No release note provided for this change.**
---
-* [HDFS-3094](https://issues.apache.org/jira/browse/HDFS-3094) | *Major* | **add -nonInteractive and -force option to namenode -format command**
+* [MAPREDUCE-4087](https://issues.apache.org/jira/browse/MAPREDUCE-4087) | *Major* | **[Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases**
-The 'namenode -format' command now supports the flags '-nonInteractive' and '-force' to improve usefulness without user input.
+Fixes the issue of GenerateDistCacheData job slowness.
---
@@ -120,97 +118,99 @@ This is a new feature. It is documented in hdfs\_user\_guide.xml.
---
-* [HDFS-3044](https://issues.apache.org/jira/browse/HDFS-3044) | *Major* | **fsck move should be non-destructive by default**
+* [HDFS-3094](https://issues.apache.org/jira/browse/HDFS-3094) | *Major* | **add -nonInteractive and -force option to namenode -format command**
-The fsck "move" option is no longer destructive. It copies the accessible blocks of corrupt files to lost and found as before, but no longer deletes the corrupt files after copying the blocks. The original, destructive behavior can be enabled by specifying both the "move" and "delete" options.
+The 'namenode -format' command now supports the flags '-nonInteractive' and '-force' to improve usefulness without user input.
---
-* [HDFS-2741](https://issues.apache.org/jira/browse/HDFS-2741) | *Minor* | **dfs.datanode.max.xcievers missing in 0.20.205.0**
+* [HADOOP-8314](https://issues.apache.org/jira/browse/HADOOP-8314) | *Major* | **HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated**
-Document and raise the maximum allowed transfer threads on a DataNode to 4096. This helps Apache HBase in particular.
+**WARNING: No release note provided for this change.**
---
-* [HDFS-2617](https://issues.apache.org/jira/browse/HDFS-2617) | *Major* | **Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution**
+* [HADOOP-8230](https://issues.apache.org/jira/browse/HADOOP-8230) | *Major* | **Enable sync by default and disable append**
-Due to the requirement that KSSL use weak encryption types for Kerberos tickets, HTTP authentication to the NameNode will now use SPNEGO by default. This will require users of previous branch-1 releases with security enabled to modify their configurations and create new Kerberos principals in order to use SPNEGO. The old behavior of using KSSL can optionally be enabled by setting the configuration option "hadoop.security.use-weak-http-crypto" to "true".
+Append is not supported in Hadoop 1.x. Please upgrade to 2.x if you need append. If you enabled dfs.support.append for HBase, you're OK, as durable sync (why HBase required dfs.support.append) is now enabled by default. If you really need the previous functionality, to turn on the append functionality set the flag "dfs.support.broken.append" to true.
---
-* [HDFS-2465](https://issues.apache.org/jira/browse/HDFS-2465) | *Major* | **Add HDFS support for fadvise readahead and drop-behind**
+* [HDFS-3522](https://issues.apache.org/jira/browse/HDFS-3522) | *Major* | **If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations**
-HDFS now has the ability to use posix\_fadvise and sync\_data\_range syscalls to manage the OS buffer cache. This support is currently considered experimental, and may be enabled by configuring the following keys:
-dfs.datanode.drop.cache.behind.writes - set to true to drop data out of the buffer cache after writing
-dfs.datanode.drop.cache.behind.reads - set to true to drop data out of the buffer cache when performing sequential reads
-dfs.datanode.sync.behind.writes - set to true to trigger dirty page writeback immediately after writing data
-dfs.datanode.readahead.bytes - set to a non-zero value to trigger readahead for sequential reads
+getBlockLocations(), and hence open() for read, will now throw SafeModeException if the NameNode is still in safe mode and there are no replicas reported yet for one of the blocks in the file.
---
-* [MAPREDUCE-4698](https://issues.apache.org/jira/browse/MAPREDUCE-4698) | *Minor* | **TestJobHistoryConfig throws Exception in testJobHistoryLogging**
+* [HDFS-3518](https://issues.apache.org/jira/browse/HDFS-3518) | *Major* | **Provide API to check HDFS operational state**
-Optionally call initialize/initializeFileSystem in JobTracker::startTracker() to allow for proper initialization when offerService is not being called.
+Add a utility method HdfsUtils.isHealthy(uri) for checking if the given HDFS is healthy.
---
-* [MAPREDUCE-4675](https://issues.apache.org/jira/browse/MAPREDUCE-4675) | *Major* | **TestKillSubProcesses fails as the process is still alive after the job is done**
+* [HADOOP-8365](https://issues.apache.org/jira/browse/HADOOP-8365) | *Blocker* | **Add flag to disable durable sync**
-Fixed a race condition caused in TestKillSubProcesses caused due to a recent commit.
+This patch enables durable sync by default. Installation where HBase was not used, that used to run without setting "dfs.support.append" or setting it to false explicitly in the configuration, must add a new flag "dfs.durable.sync" and set it to false to preserve the previous semantics.
---
-* [MAPREDUCE-4673](https://issues.apache.org/jira/browse/MAPREDUCE-4673) | *Major* | **make TestRawHistoryFile and TestJobHistoryServer more robust**
+* [HADOOP-8552](https://issues.apache.org/jira/browse/HADOOP-8552) | *Major* | **Conflict: Same security.log.file for multiple users.**
-Fixed TestRawHistoryFile and TestJobHistoryServer to not write to /tmp.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-4087](https://issues.apache.org/jira/browse/MAPREDUCE-4087) | *Major* | **[Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases**
+* [HDFS-2617](https://issues.apache.org/jira/browse/HDFS-2617) | *Major* | **Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution**
-Fixes the issue of GenerateDistCacheData job slowness.
+Due to the requirement that KSSL use weak encryption types for Kerberos tickets, HTTP authentication to the NameNode will now use SPNEGO by default. This will require users of previous branch-1 releases with security enabled to modify their configurations and create new Kerberos principals in order to use SPNEGO. The old behavior of using KSSL can optionally be enabled by setting the configuration option "hadoop.security.use-weak-http-crypto" to "true".
---
-* [MAPREDUCE-3597](https://issues.apache.org/jira/browse/MAPREDUCE-3597) | *Major* | **Provide a way to access other info of history file from Rumentool**
+* [HDFS-3814](https://issues.apache.org/jira/browse/HDFS-3814) | *Major* | **Make the replication monitor multipliers configurable in 1.x**
-Rumen now provides {{Parsed\*}} objects. These objects provide extra information that are not provided by {{Logged\*}} objects.
+This change adds two new configuration parameters.
+# {{dfs.namenode.invalidate.work.pct.per.iteration}} for controlling deletion rate of blocks.
+# {{dfs.namenode.replication.work.multiplier.per.iteration}} for controlling replication rate. This in turn allows controlling the time it takes for decommissioning.
+
+Please see hdfs-default.xml for detailed description.
---
-* [MAPREDUCE-3118](https://issues.apache.org/jira/browse/MAPREDUCE-3118) | *Major* | **Backport Gridmix and Rumen features from trunk to Hadoop 0.20 security branch**
+* [HDFS-3703](https://issues.apache.org/jira/browse/HDFS-3703) | *Major* | **Decrease the datanode failure detection time**
-Backports latest features from trunk to 0.20.206 branch.
+This jira adds a new DataNode state called "stale" at the NameNode. DataNodes are marked as stale if it does not send heartbeat message to NameNode within the timeout configured using the configuration parameter "dfs.namenode.stale.datanode.interval" in seconds (default value is 30 seconds). NameNode picks a stale datanode as the last target to read from when returning block locations for reads.
+
+This feature is by default turned \* off \*. To turn on the feature, set the HDFS configuration "dfs.namenode.check.stale.datanode" to true.
---
-* [MAPREDUCE-3008](https://issues.apache.org/jira/browse/MAPREDUCE-3008) | *Major* | **[Gridmix] Improve cumulative CPU usage emulation for short running tasks**
+* [MAPREDUCE-4673](https://issues.apache.org/jira/browse/MAPREDUCE-4673) | *Major* | **make TestRawHistoryFile and TestJobHistoryServer more robust**
-Improves cumulative CPU emulation for short running tasks.
+Fixed TestRawHistoryFile and TestJobHistoryServer to not write to /tmp.
---
-* [MAPREDUCE-2517](https://issues.apache.org/jira/browse/MAPREDUCE-2517) | *Major* | **Porting Gridmix v3 system tests into trunk branch.**
+* [MAPREDUCE-4675](https://issues.apache.org/jira/browse/MAPREDUCE-4675) | *Major* | **TestKillSubProcesses fails as the process is still alive after the job is done**
-Adds system tests to Gridmix. These system tests cover various features like job types (load and sleep), user resolvers (round-robin, submitter-user, echo) and submission modes (stress, replay and serial).
+Fixed a race condition caused in TestKillSubProcesses caused due to a recent commit.
---
-* [MAPREDUCE-1906](https://issues.apache.org/jira/browse/MAPREDUCE-1906) | *Major* | **Lower default minimum heartbeat interval for tasktracker \> Jobtracker**
+* [MAPREDUCE-4698](https://issues.apache.org/jira/browse/MAPREDUCE-4698) | *Minor* | **TestJobHistoryConfig throws Exception in testJobHistoryLogging**
-The default minimum heartbeat interval has been dropped from 3 seconds to 300ms to increase scheduling throughput on small clusters. Users may tune mapreduce.jobtracker.heartbeats.in.second to adjust this value.
+Optionally call initialize/initializeFileSystem in JobTracker::startTracker() to allow for proper initialization when offerService is not being called.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.1/CHANGES.1.1.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.1/CHANGES.1.1.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.1/CHANGES.1.1.1.md
index 315a43a..7460505 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.1/CHANGES.1.1.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.1/CHANGES.1.1.1.md
@@ -20,16 +20,6 @@
## Release 1.1.1 - 2012-11-27
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
@@ -43,36 +33,30 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-1539](https://issues.apache.org/jira/browse/HDFS-1539) | prevent data loss when a cluster suffers a power loss | Major | datanode, hdfs-client, namenode | dhruba borthakur | dhruba borthakur |
| [HADOOP-8823](https://issues.apache.org/jira/browse/HADOOP-8823) | ant package target should not depend on cn-docs | Major | build | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HDFS-4174](https://issues.apache.org/jira/browse/HDFS-4174) | Backport HDFS-1031 to branch-1: to list a few of the corrupted files in WebUI | Major | . | Jing Zhao | Jing Zhao |
-| [HDFS-1539](https://issues.apache.org/jira/browse/HDFS-1539) | prevent data loss when a cluster suffers a power loss | Major | datanode, hdfs-client, namenode | dhruba borthakur | dhruba borthakur |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9017](https://issues.apache.org/jira/browse/HADOOP-9017) | fix hadoop-client-pom-template.xml and hadoop-client-pom-template.xml for version | Major | build | Giridharan Kesavan | Giridharan Kesavan |
-| [HADOOP-8995](https://issues.apache.org/jira/browse/HADOOP-8995) | Remove unnecessary bogus exception log from Configuration | Minor | . | Jing Zhao | Jing Zhao |
-| [HADOOP-8882](https://issues.apache.org/jira/browse/HADOOP-8882) | uppercase namenode host name causes fsck to fail when useKsslAuth is on | Major | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-8878](https://issues.apache.org/jira/browse/HADOOP-8878) | uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on | Major | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-8745](https://issues.apache.org/jira/browse/HADOOP-8745) | Incorrect version numbers in hadoop-core POM | Minor | . | Matthias Friedrich | Matthias Friedrich |
-| [HDFS-4161](https://issues.apache.org/jira/browse/HDFS-4161) | HDFS keeps a thread open for every file writer | Major | hdfs-client | Suresh Srinivas | Tsz Wo Nicholas Sze |
-| [HDFS-4134](https://issues.apache.org/jira/browse/HDFS-4134) | hadoop namenode & datanode entry points should return negative exit code on bad arguments | Minor | namenode | Steve Loughran | |
-| [HDFS-4105](https://issues.apache.org/jira/browse/HDFS-4105) | the SPNEGO user for secondary namenode should use the web keytab | Major | . | Arpit Gupta | Arpit Gupta |
+| [HDFS-3658](https://issues.apache.org/jira/browse/HDFS-3658) | TestDFSClientRetries#testNamenodeRestart failed | Major | . | Eli Collins | Tsz Wo Nicholas Sze |
| [HDFS-3846](https://issues.apache.org/jira/browse/HDFS-3846) | Namenode deadlock in branch-1 | Major | namenode | Tsz Wo Nicholas Sze | Brandon Li |
| [HDFS-3791](https://issues.apache.org/jira/browse/HDFS-3791) | Backport HDFS-173 to Branch-1 : Recursively deleting a directory with millions of files makes NameNode unresponsive for other commands until the deletion completes | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HDFS-3658](https://issues.apache.org/jira/browse/HDFS-3658) | TestDFSClientRetries#testNamenodeRestart failed | Major | . | Eli Collins | Tsz Wo Nicholas Sze |
| [HDFS-2815](https://issues.apache.org/jira/browse/HDFS-2815) | Namenode is not coming out of safemode when we perform ( NN crash + restart ) . Also FSCK report shows blocks missed. | Critical | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [MAPREDUCE-4792](https://issues.apache.org/jira/browse/MAPREDUCE-4792) | Unit Test TestJobTrackerRestartWithLostTracker fails with ant-1.8.4 | Major | test | Amir Sanjar | Amir Sanjar |
+| [HADOOP-8745](https://issues.apache.org/jira/browse/HADOOP-8745) | Incorrect version numbers in hadoop-core POM | Minor | . | Matthias Friedrich | Matthias Friedrich |
+| [HADOOP-8878](https://issues.apache.org/jira/browse/HADOOP-8878) | uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on | Major | . | Arpit Gupta | Arpit Gupta |
+| [HADOOP-8882](https://issues.apache.org/jira/browse/HADOOP-8882) | uppercase namenode host name causes fsck to fail when useKsslAuth is on | Major | . | Arpit Gupta | Arpit Gupta |
+| [HADOOP-8995](https://issues.apache.org/jira/browse/HADOOP-8995) | Remove unnecessary bogus exception log from Configuration | Minor | . | Jing Zhao | Jing Zhao |
+| [HDFS-4134](https://issues.apache.org/jira/browse/HDFS-4134) | hadoop namenode & datanode entry points should return negative exit code on bad arguments | Minor | namenode | Steve Loughran | |
| [MAPREDUCE-4782](https://issues.apache.org/jira/browse/MAPREDUCE-4782) | NLineInputFormat skips first line of last InputSplit | Blocker | client | Mark Fuhs | Mark Fuhs |
+| [HDFS-4161](https://issues.apache.org/jira/browse/HDFS-4161) | HDFS keeps a thread open for every file writer | Major | hdfs-client | Suresh Srinivas | Tsz Wo Nicholas Sze |
| [MAPREDUCE-4749](https://issues.apache.org/jira/browse/MAPREDUCE-4749) | Killing multiple attempts of a task taker longer as more attempts are killed | Major | . | Arpit Gupta | Arpit Gupta |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-9017](https://issues.apache.org/jira/browse/HADOOP-9017) | fix hadoop-client-pom-template.xml and hadoop-client-pom-template.xml for version | Major | build | Giridharan Kesavan | Giridharan Kesavan |
+| [HDFS-4105](https://issues.apache.org/jira/browse/HDFS-4105) | the SPNEGO user for secondary namenode should use the web keytab | Major | . | Arpit Gupta | Arpit Gupta |
+| [MAPREDUCE-4792](https://issues.apache.org/jira/browse/MAPREDUCE-4792) | Unit Test TestJobTrackerRestartWithLostTracker fails with ant-1.8.4 | Major | test | Amir Sanjar | Amir Sanjar |
### SUB-TASKS:
@@ -82,9 +66,3 @@
| [HDFS-1108](https://issues.apache.org/jira/browse/HDFS-1108) | Log newly allocated blocks | Major | ha, namenode | dhruba borthakur | Todd Lipcon |
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/CHANGES.1.1.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/CHANGES.1.1.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/CHANGES.1.1.2.md
index 100f23a..20a8885 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/CHANGES.1.1.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/CHANGES.1.1.2.md
@@ -20,16 +20,6 @@
## Release 1.1.2 - 2013-02-15
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
@@ -43,9 +33,9 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-4252](https://issues.apache.org/jira/browse/HDFS-4252) | Improve confusing log message that prints exception when editlog read is completed | Major | namenode | Suresh Srinivas | Jing Zhao |
| [HADOOP-9111](https://issues.apache.org/jira/browse/HADOOP-9111) | Fix failed testcases with @ignore annotation In branch-1 | Minor | test | Jing Zhao | Jing Zhao |
| [HADOOP-8561](https://issues.apache.org/jira/browse/HADOOP-8561) | Introduce HADOOP\_PROXY\_USER for secure impersonation in child hadoop client processes | Major | security | Luke Lu | Yu Gao |
-| [HDFS-4252](https://issues.apache.org/jira/browse/HDFS-4252) | Improve confusing log message that prints exception when editlog read is completed | Major | namenode | Suresh Srinivas | Jing Zhao |
| [MAPREDUCE-4397](https://issues.apache.org/jira/browse/MAPREDUCE-4397) | Introduce HADOOP\_SECURITY\_CONF\_DIR for task-controller | Major | task-controller | Luke Lu | Yu Gao |
@@ -53,25 +43,25 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9115](https://issues.apache.org/jira/browse/HADOOP-9115) | Deadlock in configuration when writing configuration to hdfs | Blocker | . | Arpit Gupta | Jing Zhao |
+| [MAPREDUCE-2374](https://issues.apache.org/jira/browse/MAPREDUCE-2374) | "Text File Busy" errors launching MR tasks | Major | . | Todd Lipcon | Andy Isaacson |
| [HADOOP-8880](https://issues.apache.org/jira/browse/HADOOP-8880) | Missing jersey jars as dependency in the pom causes hive tests to fail | Major | . | Giridharan Kesavan | Giridharan Kesavan |
-| [HADOOP-8419](https://issues.apache.org/jira/browse/HADOOP-8419) | GzipCodec NPE upon reset with IBM JDK | Major | io | Luke Lu | Yu Li |
-| [HADOOP-8418](https://issues.apache.org/jira/browse/HADOOP-8418) | Fix UGI for IBM JDK running on Windows | Major | security | Luke Lu | Yu Gao |
-| [HDFS-5996](https://issues.apache.org/jira/browse/HDFS-5996) | hadoop 1.1.2. hdfs write bug | Major | fuse-dfs | WangMeng | |
-| [HDFS-4423](https://issues.apache.org/jira/browse/HDFS-4423) | Checkpoint exception causes fatal damage to fsimage. | Blocker | namenode | ChenFolin | Chris Nauroth |
| [HDFS-4208](https://issues.apache.org/jira/browse/HDFS-4208) | NameNode could be stuck in SafeMode due to never-created blocks | Critical | namenode | Brandon Li | Brandon Li |
| [HDFS-3727](https://issues.apache.org/jira/browse/HDFS-3727) | When using SPNEGO, NN should not try to log in using KSSL principal | Major | namenode | Aaron T. Myers | Aaron T. Myers |
-| [MAPREDUCE-4888](https://issues.apache.org/jira/browse/MAPREDUCE-4888) | NLineInputFormat drops data in 1.1 and beyond | Blocker | mrv1 | Robert Joseph Evans | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-4859](https://issues.apache.org/jira/browse/MAPREDUCE-4859) | TestRecoveryManager fails on branch-1 | Major | . | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-4858](https://issues.apache.org/jira/browse/MAPREDUCE-4858) | TestWebUIAuthorization fails on branch-1 | Major | . | Arun C Murthy | Arun C Murthy |
+| [MAPREDUCE-4478](https://issues.apache.org/jira/browse/MAPREDUCE-4478) | TaskTracker's heartbeat is out of control | Major | . | Liyin Liang | Liyin Liang |
| [MAPREDUCE-4798](https://issues.apache.org/jira/browse/MAPREDUCE-4798) | TestJobHistoryServer fails some times with 'java.lang.AssertionError: Address already in use' | Minor | jobhistoryserver, test | sam liu | sam liu |
-| [MAPREDUCE-4699](https://issues.apache.org/jira/browse/MAPREDUCE-4699) | TestFairScheduler & TestCapacityScheduler fails due to JobHistory exception | Minor | . | Gopal V | Gopal V |
-| [MAPREDUCE-4697](https://issues.apache.org/jira/browse/MAPREDUCE-4697) | TestMapredHeartbeat fails assertion on HeartbeatInterval | Minor | . | Gopal V | Gopal V |
+| [HADOOP-9115](https://issues.apache.org/jira/browse/HADOOP-9115) | Deadlock in configuration when writing configuration to hdfs | Blocker | . | Arpit Gupta | Jing Zhao |
| [MAPREDUCE-4696](https://issues.apache.org/jira/browse/MAPREDUCE-4696) | TestMRServerPorts throws NullReferenceException | Minor | . | Gopal V | Gopal V |
-| [MAPREDUCE-4478](https://issues.apache.org/jira/browse/MAPREDUCE-4478) | TaskTracker's heartbeat is out of control | Major | . | Liyin Liang | Liyin Liang |
+| [MAPREDUCE-4697](https://issues.apache.org/jira/browse/MAPREDUCE-4697) | TestMapredHeartbeat fails assertion on HeartbeatInterval | Minor | . | Gopal V | Gopal V |
+| [MAPREDUCE-4699](https://issues.apache.org/jira/browse/MAPREDUCE-4699) | TestFairScheduler & TestCapacityScheduler fails due to JobHistory exception | Minor | . | Gopal V | Gopal V |
+| [MAPREDUCE-4858](https://issues.apache.org/jira/browse/MAPREDUCE-4858) | TestWebUIAuthorization fails on branch-1 | Major | . | Arun C Murthy | Arun C Murthy |
+| [MAPREDUCE-4859](https://issues.apache.org/jira/browse/MAPREDUCE-4859) | TestRecoveryManager fails on branch-1 | Major | . | Arun C Murthy | Arun C Murthy |
| [MAPREDUCE-4396](https://issues.apache.org/jira/browse/MAPREDUCE-4396) | Make LocalJobRunner work with private distributed cache | Minor | client | Luke Lu | Yu Gao |
+| [MAPREDUCE-4888](https://issues.apache.org/jira/browse/MAPREDUCE-4888) | NLineInputFormat drops data in 1.1 and beyond | Blocker | mrv1 | Robert Joseph Evans | Vinod Kumar Vavilapalli |
| [MAPREDUCE-4272](https://issues.apache.org/jira/browse/MAPREDUCE-4272) | SortedRanges.Range#compareTo is not spec compliant | Major | task | Luke Lu | Yu Gao |
-| [MAPREDUCE-2374](https://issues.apache.org/jira/browse/MAPREDUCE-2374) | "Text File Busy" errors launching MR tasks | Major | . | Todd Lipcon | Andy Isaacson |
+| [HDFS-4423](https://issues.apache.org/jira/browse/HDFS-4423) | Checkpoint exception causes fatal damage to fsimage. | Blocker | namenode | ChenFolin | Chris Nauroth |
+| [HADOOP-8418](https://issues.apache.org/jira/browse/HADOOP-8418) | Fix UGI for IBM JDK running on Windows | Major | security | Luke Lu | Yu Gao |
+| [HADOOP-8419](https://issues.apache.org/jira/browse/HADOOP-8419) | GzipCodec NPE upon reset with IBM JDK | Major | io | Luke Lu | Yu Li |
+| [HDFS-5996](https://issues.apache.org/jira/browse/HDFS-5996) | hadoop 1.1.2. hdfs write bug | Major | fuse-dfs | WangMeng | |
### TESTS:
@@ -81,15 +71,3 @@
| [HADOOP-9051](https://issues.apache.org/jira/browse/HADOOP-9051) | “ant test” will build failed for trying to delete a file | Minor | test | meng gong | Luke Lu |
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/RELEASENOTES.1.1.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/RELEASENOTES.1.1.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/RELEASENOTES.1.1.2.md
index b55f17d..d3a97b3 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/RELEASENOTES.1.1.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/RELEASENOTES.1.1.2.md
@@ -23,13 +23,6 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-9115](https://issues.apache.org/jira/browse/HADOOP-9115) | *Blocker* | **Deadlock in configuration when writing configuration to hdfs**
-
-This fixes a bug where Hive could trigger a deadlock condition in the Hadoop configuration management code.
-
-
----
-
* [HADOOP-8567](https://issues.apache.org/jira/browse/HADOOP-8567) | *Major* | **Port conf servlet to dump running configuration to branch 1.x**
Users can use the conf servlet to get the server-side configuration. Users can
@@ -40,16 +33,23 @@ Users can use the conf servlet to get the server-side configuration. Users can
---
-* [HDFS-5996](https://issues.apache.org/jira/browse/HDFS-5996) | *Major* | **hadoop 1.1.2. hdfs write bug**
+* [MAPREDUCE-4478](https://issues.apache.org/jira/browse/MAPREDUCE-4478) | *Major* | **TaskTracker's heartbeat is out of control**
-someone has discovered this bug and it has been resolved
+Fixed a bug in TaskTracker's heartbeat to keep it under control.
---
-* [MAPREDUCE-4478](https://issues.apache.org/jira/browse/MAPREDUCE-4478) | *Major* | **TaskTracker's heartbeat is out of control**
+* [HADOOP-9115](https://issues.apache.org/jira/browse/HADOOP-9115) | *Blocker* | **Deadlock in configuration when writing configuration to hdfs**
-Fixed a bug in TaskTracker's heartbeat to keep it under control.
+This fixes a bug where Hive could trigger a deadlock condition in the Hadoop configuration management code.
+
+
+---
+
+* [HDFS-5996](https://issues.apache.org/jira/browse/HDFS-5996) | *Major* | **hadoop 1.1.2. hdfs write bug**
+
+someone has discovered this bug and it has been resolved
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.3/CHANGES.1.1.3.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.3/CHANGES.1.1.3.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.3/CHANGES.1.1.3.md
index 86aeb5d..0944cef 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.3/CHANGES.1.1.3.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.3/CHANGES.1.1.3.md
@@ -18,54 +18,14 @@
-->
# Apache Hadoop Changelog
-## Release 1.1.3 - Unreleased (as of 2016-03-04)
+## Release 1.1.3 - Unreleased (as of 2017-08-28)
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HDFS-5028](https://issues.apache.org/jira/browse/HDFS-5028) | LeaseRenewer throw java.util.ConcurrentModificationException when timeout | Major | . | zhaoyunjiong | zhaoyunjiong |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-5028](https://issues.apache.org/jira/browse/HDFS-5028) | LeaseRenewer throw java.util.ConcurrentModificationException when timeout | Major | . | yunjiong zhao | yunjiong zhao |
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[08/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.1-beta/CHANGES.2.1.1-beta.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.1-beta/CHANGES.2.1.1-beta.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.1-beta/CHANGES.2.1.1-beta.md
index 1e7747e..1042346 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.1-beta/CHANGES.2.1.1-beta.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.1-beta/CHANGES.2.1.1-beta.md
@@ -24,15 +24,9 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9944](https://issues.apache.org/jira/browse/HADOOP-9944) | RpcRequestHeaderProto defines callId as uint32 while ipc.Client.CONNECTION\_CONTEXT\_CALL\_ID is signed (-3) | Blocker | . | Arun C Murthy | Arun C Murthy |
-| [YARN-1170](https://issues.apache.org/jira/browse/YARN-1170) | yarn proto definitions should specify package as 'hadoop.yarn' | Blocker | . | Arun C Murthy | Binglin Chang |
| [YARN-707](https://issues.apache.org/jira/browse/YARN-707) | Add user info in the YARN ClientToken | Blocker | . | Bikas Saha | Jason Lowe |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [YARN-1170](https://issues.apache.org/jira/browse/YARN-1170) | yarn proto definitions should specify package as 'hadoop.yarn' | Blocker | . | Arun C Murthy | Binglin Chang |
+| [HADOOP-9944](https://issues.apache.org/jira/browse/HADOOP-9944) | RpcRequestHeaderProto defines callId as uint32 while ipc.Client.CONNECTION\_CONTEXT\_CALL\_ID is signed (-3) | Blocker | . | Arun C Murthy | Arun C Murthy |
### NEW FEATURES:
@@ -40,199 +34,193 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
| [HADOOP-9789](https://issues.apache.org/jira/browse/HADOOP-9789) | Support server advertised kerberos principals | Critical | ipc, security | Daryn Sharp | Daryn Sharp |
-| [HDFS-5118](https://issues.apache.org/jira/browse/HDFS-5118) | Provide testing support for DFSClient to drop RPC responses | Major | . | Jing Zhao | Jing Zhao |
| [HDFS-5076](https://issues.apache.org/jira/browse/HDFS-5076) | Add MXBean methods to query NN's transaction information and JournalNode's journal status | Minor | . | Jing Zhao | Jing Zhao |
+| [HDFS-5118](https://issues.apache.org/jira/browse/HDFS-5118) | Provide testing support for DFSClient to drop RPC responses | Major | . | Jing Zhao | Jing Zhao |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9962](https://issues.apache.org/jira/browse/HADOOP-9962) | in order to avoid dependency divergence within Hadoop itself lets enable DependencyConvergence | Major | build | Roman Shaposhnik | Roman Shaposhnik |
-| [HADOOP-9945](https://issues.apache.org/jira/browse/HADOOP-9945) | HAServiceState should have a state for stopped services | Minor | ha | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-9918](https://issues.apache.org/jira/browse/HADOOP-9918) | Add addIfService() to CompositeService | Minor | . | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-9886](https://issues.apache.org/jira/browse/HADOOP-9886) | Turn warning message in RetryInvocationHandler to debug | Minor | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-9879](https://issues.apache.org/jira/browse/HADOOP-9879) | Move the version info of zookeeper dependencies to hadoop-project/pom | Minor | build | Karthik Kambatla | Karthik Kambatla |
+| [HADOOP-8814](https://issues.apache.org/jira/browse/HADOOP-8814) | Inefficient comparison with the empty string. Use isEmpty() instead | Minor | conf, fs, fs/s3, ha, io, metrics, performance, record, security, util | Brandon Li | Brandon Li |
+| [MAPREDUCE-1981](https://issues.apache.org/jira/browse/MAPREDUCE-1981) | Improve getSplits performance by using listLocatedStatus | Major | job submission | Hairong Kuang | Hairong Kuang |
+| [HADOOP-9803](https://issues.apache.org/jira/browse/HADOOP-9803) | Add generic type parameter to RetryInvocationHandler | Minor | ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [YARN-758](https://issues.apache.org/jira/browse/YARN-758) | Augment MockNM to use multiple cores | Minor | . | Bikas Saha | Karthik Kambatla |
+| [MAPREDUCE-5367](https://issues.apache.org/jira/browse/MAPREDUCE-5367) | Local jobs all use same local working directory | Major | . | Sandy Ryza | Sandy Ryza |
+| [HDFS-5061](https://issues.apache.org/jira/browse/HDFS-5061) | Make FSNameSystem#auditLoggers an unmodifiable list | Major | namenode | Arpit Agarwal | Arpit Agarwal |
+| [HDFS-4905](https://issues.apache.org/jira/browse/HDFS-4905) | Add appendToFile command to "hdfs dfs" | Minor | tools | Arpit Agarwal | Arpit Agarwal |
+| [HADOOP-9821](https://issues.apache.org/jira/browse/HADOOP-9821) | ClientId should have getMsb/getLsb methods | Minor | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa |
+| [HDFS-4926](https://issues.apache.org/jira/browse/HDFS-4926) | namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link | Trivial | namenode | Joseph Lorenzini | Vivek Ganesan |
| [HADOOP-9833](https://issues.apache.org/jira/browse/HADOOP-9833) | move slf4j to version 1.7.5 | Minor | build | Steve Loughran | Kousuke Saruta |
| [HADOOP-9831](https://issues.apache.org/jira/browse/HADOOP-9831) | Make checknative shell command accessible on Windows. | Minor | bin | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9821](https://issues.apache.org/jira/browse/HADOOP-9821) | ClientId should have getMsb/getLsb methods | Minor | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa |
-| [HADOOP-9803](https://issues.apache.org/jira/browse/HADOOP-9803) | Add generic type parameter to RetryInvocationHandler | Minor | ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-9802](https://issues.apache.org/jira/browse/HADOOP-9802) | Support Snappy codec on Windows. | Major | io | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9686](https://issues.apache.org/jira/browse/HADOOP-9686) | Easy access to final parameters in Configuration | Major | conf | Jason Lowe | Jason Lowe |
+| [YARN-589](https://issues.apache.org/jira/browse/YARN-589) | Expose a REST API for monitoring the fair scheduler | Major | scheduler | Sandy Ryza | Sandy Ryza |
| [HADOOP-9672](https://issues.apache.org/jira/browse/HADOOP-9672) | Upgrade Avro dependency to 1.7.4 | Major | . | Sandy Ryza | Sandy Ryza |
-| [HADOOP-9669](https://issues.apache.org/jira/browse/HADOOP-9669) | Reduce the number of byte array creations and copies in XDR data manipulation | Major | nfs | Tsz Wo Nicholas Sze | Haohui Mai |
+| [HADOOP-9802](https://issues.apache.org/jira/browse/HADOOP-9802) | Support Snappy codec on Windows. | Major | io | Chris Nauroth | Chris Nauroth |
| [HADOOP-9446](https://issues.apache.org/jira/browse/HADOOP-9446) | Support Kerberos HTTP SPNEGO authentication for non-SUN JDK | Major | security | Yu Gao | Yu Gao |
-| [HADOOP-8814](https://issues.apache.org/jira/browse/HADOOP-8814) | Inefficient comparison with the empty string. Use isEmpty() instead | Minor | conf, fs, fs/s3, ha, io, metrics, performance, record, security, util | Brandon Li | Brandon Li |
-| [HDFS-5128](https://issues.apache.org/jira/browse/HDFS-5128) | Allow multiple net interfaces to be used with HA namenode RPC server | Critical | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-5061](https://issues.apache.org/jira/browse/HDFS-5061) | Make FSNameSystem#auditLoggers an unmodifiable list | Major | namenode | Arpit Agarwal | Arpit Agarwal |
+| [HADOOP-9879](https://issues.apache.org/jira/browse/HADOOP-9879) | Move the version info of zookeeper dependencies to hadoop-project/pom | Minor | build | Karthik Kambatla | Karthik Kambatla |
+| [HADOOP-9686](https://issues.apache.org/jira/browse/HADOOP-9686) | Easy access to final parameters in Configuration | Major | conf | Jason Lowe | Jason Lowe |
+| [HADOOP-9886](https://issues.apache.org/jira/browse/HADOOP-9886) | Turn warning message in RetryInvocationHandler to debug | Minor | . | Arpit Gupta | Arpit Gupta |
| [HDFS-5045](https://issues.apache.org/jira/browse/HDFS-5045) | Add more unit tests for retry cache to cover all AtMostOnce methods | Minor | . | Jing Zhao | Jing Zhao |
-| [HDFS-4926](https://issues.apache.org/jira/browse/HDFS-4926) | namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link | Trivial | namenode | Joseph Lorenzini | Vivek Ganesan |
-| [HDFS-4905](https://issues.apache.org/jira/browse/HDFS-4905) | Add appendToFile command to "hdfs dfs" | Minor | tools | Arpit Agarwal | Arpit Agarwal |
-| [HDFS-4513](https://issues.apache.org/jira/browse/HDFS-4513) | Clarify WebHDFS REST API that all JSON respsonses may contain additional properties | Minor | documentation, webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-3245](https://issues.apache.org/jira/browse/HDFS-3245) | Add metrics and web UI for cluster version summary | Major | namenode | Todd Lipcon | Ravi Prakash |
| [MAPREDUCE-5478](https://issues.apache.org/jira/browse/MAPREDUCE-5478) | TeraInputFormat unnecessarily defines its own FileSplit subclass | Minor | examples | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5379](https://issues.apache.org/jira/browse/MAPREDUCE-5379) | Include token tracking ids in jobconf | Major | job submission, security | Sandy Ryza | Karthik Kambatla |
-| [MAPREDUCE-5367](https://issues.apache.org/jira/browse/MAPREDUCE-5367) | Local jobs all use same local working directory | Major | . | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-1981](https://issues.apache.org/jira/browse/MAPREDUCE-1981) | Improve getSplits performance by using listLocatedStatus | Major | job submission | Hairong Kuang | Hairong Kuang |
-| [YARN-1137](https://issues.apache.org/jira/browse/YARN-1137) | Add support whitelist for system users to Yarn container-executor.c | Major | nodemanager | Alejandro Abdelnur | Roman Shaposhnik |
-| [YARN-1117](https://issues.apache.org/jira/browse/YARN-1117) | Improve help message for $ yarn applications and $yarn node | Major | client | Tassapol Athiapinya | Xuan Gong |
-| [YARN-1081](https://issues.apache.org/jira/browse/YARN-1081) | Minor improvement to output header for $ yarn node -list | Minor | client | Tassapol Athiapinya | Akira AJISAKA |
-| [YARN-1080](https://issues.apache.org/jira/browse/YARN-1080) | Improve help message for $ yarn logs | Major | client | Tassapol Athiapinya | Xuan Gong |
| [YARN-1074](https://issues.apache.org/jira/browse/YARN-1074) | Clean up YARN CLI app list to show only running apps. | Major | client | Tassapol Athiapinya | Xuan Gong |
-| [YARN-910](https://issues.apache.org/jira/browse/YARN-910) | Allow auxiliary services to listen for container starts and completions | Major | nodemanager | Sandy Ryza | Alejandro Abdelnur |
-| [YARN-758](https://issues.apache.org/jira/browse/YARN-758) | Augment MockNM to use multiple cores | Minor | . | Bikas Saha | Karthik Kambatla |
+| [HDFS-3245](https://issues.apache.org/jira/browse/HDFS-3245) | Add metrics and web UI for cluster version summary | Major | namenode | Todd Lipcon | Ravi Prakash |
+| [HDFS-5128](https://issues.apache.org/jira/browse/HDFS-5128) | Allow multiple net interfaces to be used with HA namenode RPC server | Critical | . | Kihwal Lee | Kihwal Lee |
+| [YARN-1081](https://issues.apache.org/jira/browse/YARN-1081) | Minor improvement to output header for $ yarn node -list | Minor | client | Tassapol Athiapinya | Akira Ajisaka |
+| [YARN-1080](https://issues.apache.org/jira/browse/YARN-1080) | Improve help message for $ yarn logs | Major | client | Tassapol Athiapinya | Xuan Gong |
+| [YARN-1117](https://issues.apache.org/jira/browse/YARN-1117) | Improve help message for $ yarn applications and $yarn node | Major | client | Tassapol Athiapinya | Xuan Gong |
+| [HADOOP-9918](https://issues.apache.org/jira/browse/HADOOP-9918) | Add addIfService() to CompositeService | Minor | . | Karthik Kambatla | Karthik Kambatla |
| [YARN-696](https://issues.apache.org/jira/browse/YARN-696) | Enable multiple states to to be specified in Resource Manager apps REST call | Major | resourcemanager | Trevor Lorimer | Trevor Lorimer |
-| [YARN-589](https://issues.apache.org/jira/browse/YARN-589) | Expose a REST API for monitoring the fair scheduler | Major | scheduler | Sandy Ryza | Sandy Ryza |
+| [YARN-910](https://issues.apache.org/jira/browse/YARN-910) | Allow auxiliary services to listen for container starts and completions | Major | nodemanager | Sandy Ryza | Alejandro Abdelnur |
+| [HADOOP-9945](https://issues.apache.org/jira/browse/HADOOP-9945) | HAServiceState should have a state for stopped services | Minor | ha | Karthik Kambatla | Karthik Kambatla |
+| [YARN-1137](https://issues.apache.org/jira/browse/YARN-1137) | Add support whitelist for system users to Yarn container-executor.c | Major | nodemanager | Alejandro Abdelnur | Roman Shaposhnik |
+| [HADOOP-9962](https://issues.apache.org/jira/browse/HADOOP-9962) | in order to avoid dependency divergence within Hadoop itself lets enable DependencyConvergence | Major | build | Roman Shaposhnik | Roman Shaposhnik |
+| [MAPREDUCE-5379](https://issues.apache.org/jira/browse/MAPREDUCE-5379) | Include token tracking ids in jobconf | Major | job submission, security | Sandy Ryza | Karthik Kambatla |
+| [HADOOP-9669](https://issues.apache.org/jira/browse/HADOOP-9669) | Reduce the number of byte array creations and copies in XDR data manipulation | Major | nfs | Tsz Wo Nicholas Sze | Haohui Mai |
+| [HDFS-4513](https://issues.apache.org/jira/browse/HDFS-4513) | Clarify WebHDFS REST API that all JSON respsonses may contain additional properties | Minor | documentation, webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9977](https://issues.apache.org/jira/browse/HADOOP-9977) | Hadoop services won't start with different keypass and keystorepass when https is enabled | Major | security | Yesha Vora | Chris Nauroth |
-| [HADOOP-9961](https://issues.apache.org/jira/browse/HADOOP-9961) | versions of a few transitive dependencies diverged between hadoop subprojects | Minor | build | Roman Shaposhnik | Roman Shaposhnik |
-| [HADOOP-9960](https://issues.apache.org/jira/browse/HADOOP-9960) | Upgrade Jersey version to 1.9 | Blocker | . | Brock Noland | Karthik Kambatla |
-| [HADOOP-9958](https://issues.apache.org/jira/browse/HADOOP-9958) | Add old constructor back to DelegationTokenInformation to unbreak downstream builds | Major | . | Andrew Wang | Andrew Wang |
-| [HADOOP-9932](https://issues.apache.org/jira/browse/HADOOP-9932) | Improper synchronization in RetryCache | Blocker | . | Kihwal Lee | Kihwal Lee |
-| [HADOOP-9924](https://issues.apache.org/jira/browse/HADOOP-9924) | FileUtil.createJarWithClassPath() does not generate relative classpath correctly | Major | fs | shanyu zhao | shanyu zhao |
-| [HADOOP-9916](https://issues.apache.org/jira/browse/HADOOP-9916) | Race condition in ipc.Client causes TestIPC timeout | Minor | . | Binglin Chang | Binglin Chang |
-| [HADOOP-9910](https://issues.apache.org/jira/browse/HADOOP-9910) | proxy server start and stop documentation wrong | Minor | . | André Kelpe | |
-| [HADOOP-9906](https://issues.apache.org/jira/browse/HADOOP-9906) | Move HAZKUtil to o.a.h.util.ZKUtil and make inner-classes public | Minor | ha | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-9899](https://issues.apache.org/jira/browse/HADOOP-9899) | Remove the debug message added by HADOOP-8855 | Minor | security | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-9880](https://issues.apache.org/jira/browse/HADOOP-9880) | SASL changes from HADOOP-9421 breaks Secure HA NN | Blocker | . | Kihwal Lee | Daryn Sharp |
-| [HADOOP-9868](https://issues.apache.org/jira/browse/HADOOP-9868) | Server must not advertise kerberos realm | Blocker | ipc | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9858](https://issues.apache.org/jira/browse/HADOOP-9858) | Remove unused private RawLocalFileSystem#execCommand method from branch-2. | Trivial | fs | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9857](https://issues.apache.org/jira/browse/HADOOP-9857) | Tests block and sometimes timeout on Windows due to invalid entropy source. | Major | build, test | Chris Nauroth | Chris Nauroth |
+| [MAPREDUCE-3193](https://issues.apache.org/jira/browse/MAPREDUCE-3193) | FileInputFormat doesn't read files recursively in the input path dir | Major | mrv1, mrv2 | Ramgopal N | Devaraj K |
+| [MAPREDUCE-5358](https://issues.apache.org/jira/browse/MAPREDUCE-5358) | MRAppMaster throws invalid transitions for JobImpl | Major | mr-am | Devaraj K | Devaraj K |
+| [HADOOP-9435](https://issues.apache.org/jira/browse/HADOOP-9435) | Support building the JNI code against the IBM JVM | Major | build | Tian Hong Wang | Tian Hong Wang |
+| [MAPREDUCE-5317](https://issues.apache.org/jira/browse/MAPREDUCE-5317) | Stale files left behind for failed jobs | Major | mrv2 | Ravi Prakash | Ravi Prakash |
+| [MAPREDUCE-5251](https://issues.apache.org/jira/browse/MAPREDUCE-5251) | Reducer should not implicate map attempt if it has insufficient space to fetch map output | Major | mrv2 | Jason Lowe | Ashwin Shankar |
+| [HADOOP-9768](https://issues.apache.org/jira/browse/HADOOP-9768) | chown and chgrp reject users and groups with spaces on platforms where spaces are otherwise acceptable | Major | fs | Chris Nauroth | Chris Nauroth |
+| [MAPREDUCE-5385](https://issues.apache.org/jira/browse/MAPREDUCE-5385) | JobContext cache files api are broken | Blocker | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
+| [YARN-948](https://issues.apache.org/jira/browse/YARN-948) | RM should validate the release container list before actually releasing them | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
+| [YARN-966](https://issues.apache.org/jira/browse/YARN-966) | The thread of ContainerLaunch#call will fail without any signal if getLocalizedResources() is called when the container is not at LOCALIZED | Major | . | Zhijie Shen | Zhijie Shen |
+| [HDFS-5043](https://issues.apache.org/jira/browse/HDFS-5043) | For HdfsFileStatus, set default value of childrenNum to -1 instead of 0 to avoid confusing applications | Major | . | Brandon Li | Brandon Li |
| [HADOOP-9806](https://issues.apache.org/jira/browse/HADOOP-9806) | PortmapInterface should check if the procedure is out-of-range | Major | nfs | Brandon Li | Brandon Li |
+| [MAPREDUCE-5428](https://issues.apache.org/jira/browse/MAPREDUCE-5428) | HistoryFileManager doesn't stop threads when service is stopped | Major | jobhistoryserver, mrv2 | Jason Lowe | Karthik Kambatla |
| [HADOOP-9801](https://issues.apache.org/jira/browse/HADOOP-9801) | Configuration#writeXml uses platform defaulting encoding, which may mishandle multi-byte characters. | Major | conf | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9774](https://issues.apache.org/jira/browse/HADOOP-9774) | RawLocalFileSystem.listStatus() return absolute paths when input path is relative on Windows | Major | fs | shanyu zhao | shanyu zhao |
-| [HADOOP-9768](https://issues.apache.org/jira/browse/HADOOP-9768) | chown and chgrp reject users and groups with spaces on platforms where spaces are otherwise acceptable | Major | fs | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9757](https://issues.apache.org/jira/browse/HADOOP-9757) | Har metadata cache can grow without limit | Major | fs | Jason Lowe | Cristina L. Abad |
-| [HADOOP-9557](https://issues.apache.org/jira/browse/HADOOP-9557) | hadoop-client excludes commons-httpclient | Major | build | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-9435](https://issues.apache.org/jira/browse/HADOOP-9435) | Support building the JNI code against the IBM JVM | Major | build | Tian Hong Wang | Tian Hong Wang |
-| [HADOOP-9381](https://issues.apache.org/jira/browse/HADOOP-9381) | Document dfs cp -f option | Trivial | . | Keegan Witt | Keegan Witt |
+| [YARN-903](https://issues.apache.org/jira/browse/YARN-903) | DistributedShell throwing Errors in logs after successfull completion | Major | applications/distributed-shell | Abhishek Kapoor | Omkar Vinit Joshi |
+| [HDFS-5028](https://issues.apache.org/jira/browse/HDFS-5028) | LeaseRenewer throw java.util.ConcurrentModificationException when timeout | Major | . | yunjiong zhao | yunjiong zhao |
+| [MAPREDUCE-5440](https://issues.apache.org/jira/browse/MAPREDUCE-5440) | TestCopyCommitter Fails on JDK7 | Major | mrv2 | Robert Parker | Robert Parker |
+| [MAPREDUCE-5446](https://issues.apache.org/jira/browse/MAPREDUCE-5446) | TestJobHistoryEvents and TestJobHistoryParsing have race conditions | Major | mrv2, test | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-5425](https://issues.apache.org/jira/browse/MAPREDUCE-5425) | Junit in TestJobHistoryServer failing in jdk 7 | Major | jobhistoryserver | Ashwin Shankar | Robert Parker |
+| [HDFS-5047](https://issues.apache.org/jira/browse/HDFS-5047) | Supress logging of full stack trace of quota and lease exceptions | Major | namenode | Kihwal Lee | Robert Parker |
| [HADOOP-9315](https://issues.apache.org/jira/browse/HADOOP-9315) | Port HADOOP-9249 hadoop-maven-plugins Clover fix to branch-2 to fix build failures | Major | build | Dennis Y | Chris Nauroth |
-| [HDFS-5231](https://issues.apache.org/jira/browse/HDFS-5231) | Fix broken links in the document of HDFS Federation | Minor | . | Haohui Mai | Haohui Mai |
-| [HDFS-5219](https://issues.apache.org/jira/browse/HDFS-5219) | Add configuration keys for retry policy in WebHDFSFileSystem | Major | webhdfs | Haohui Mai | Haohui Mai |
-| [HDFS-5192](https://issues.apache.org/jira/browse/HDFS-5192) | NameNode may fail to start when dfs.client.test.drop.namenode.response.number is set | Minor | . | Jing Zhao | Jing Zhao |
-| [HDFS-5159](https://issues.apache.org/jira/browse/HDFS-5159) | Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint | Major | namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-5150](https://issues.apache.org/jira/browse/HDFS-5150) | Allow per NN SPN for internal SPNEGO. | Blocker | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-5140](https://issues.apache.org/jira/browse/HDFS-5140) | Too many safemode monitor threads being created in the standby namenode causing it to fail with out of memory error | Blocker | ha | Arpit Gupta | Jing Zhao |
-| [HDFS-5132](https://issues.apache.org/jira/browse/HDFS-5132) | Deadlock in NameNode between SafeModeMonitor#run and DatanodeManager#handleHeartbeat | Blocker | namenode | Arpit Gupta | Kihwal Lee |
-| [HDFS-5124](https://issues.apache.org/jira/browse/HDFS-5124) | DelegationTokenSecretManager#retrievePassword can cause deadlock in NameNode | Blocker | namenode | Deepesh Khandelwal | Daryn Sharp |
-| [HDFS-5111](https://issues.apache.org/jira/browse/HDFS-5111) | Remove duplicated error message for snapshot commands when processing invalid arguments | Minor | snapshots | Jing Zhao | Jing Zhao |
-| [HDFS-5106](https://issues.apache.org/jira/browse/HDFS-5106) | TestDatanodeBlockScanner fails on Windows due to incorrect path format | Minor | test | Chuan Liu | Chuan Liu |
-| [HDFS-5105](https://issues.apache.org/jira/browse/HDFS-5105) | TestFsck fails on Windows | Minor | . | Chuan Liu | Chuan Liu |
-| [HDFS-5103](https://issues.apache.org/jira/browse/HDFS-5103) | TestDirectoryScanner fails on Windows | Minor | test | Chuan Liu | Chuan Liu |
-| [HDFS-5102](https://issues.apache.org/jira/browse/HDFS-5102) | Snapshot names should not be allowed to contain slash characters | Major | snapshots | Aaron T. Myers | Jing Zhao |
-| [HDFS-5100](https://issues.apache.org/jira/browse/HDFS-5100) | TestNamenodeRetryCache fails on Windows due to incorrect cleanup | Minor | test | Chuan Liu | Chuan Liu |
-| [HDFS-5099](https://issues.apache.org/jira/browse/HDFS-5099) | Namenode#copyEditLogSegmentsToSharedDir should close EditLogInputStreams upon finishing | Major | namenode | Chuan Liu | Chuan Liu |
+| [HDFS-4993](https://issues.apache.org/jira/browse/HDFS-4993) | fsck can fail if a file is renamed or deleted | Major | . | Kihwal Lee | Robert Parker |
+| [HADOOP-9757](https://issues.apache.org/jira/browse/HADOOP-9757) | Har metadata cache can grow without limit | Major | fs | Jason Lowe | Cristina L. Abad |
+| [HADOOP-9858](https://issues.apache.org/jira/browse/HADOOP-9858) | Remove unused private RawLocalFileSystem#execCommand method from branch-2. | Trivial | fs | Chris Nauroth | Chris Nauroth |
+| [HADOOP-9857](https://issues.apache.org/jira/browse/HADOOP-9857) | Tests block and sometimes timeout on Windows due to invalid entropy source. | Major | build, test | Chris Nauroth | Chris Nauroth |
+| [MAPREDUCE-5454](https://issues.apache.org/jira/browse/MAPREDUCE-5454) | TestDFSIO fails intermittently on JDK7 | Major | test | Karthik Kambatla | Karthik Kambatla |
| [HDFS-5091](https://issues.apache.org/jira/browse/HDFS-5091) | Support for spnego keytab separate from the JournalNode keytab for secure HA | Minor | . | Jing Zhao | Jing Zhao |
-| [HDFS-5080](https://issues.apache.org/jira/browse/HDFS-5080) | BootstrapStandby not working with QJM when the existing NN is active | Major | ha, qjm | Jing Zhao | Jing Zhao |
-| [HDFS-5077](https://issues.apache.org/jira/browse/HDFS-5077) | NPE in FSNamesystem.commitBlockSynchronization() | Major | namenode | Konstantin Shvachko | Plamen Jeliazkov |
+| [YARN-337](https://issues.apache.org/jira/browse/YARN-337) | RM handles killed application tracking URL poorly | Major | resourcemanager | Jason Lowe | Jason Lowe |
+| [HADOOP-9381](https://issues.apache.org/jira/browse/HADOOP-9381) | Document dfs cp -f option | Trivial | . | Keegan Witt | Keegan Witt |
| [HDFS-5055](https://issues.apache.org/jira/browse/HDFS-5055) | nn fails to download checkpointed image from snn in some setups | Blocker | namenode | Allen Wittenauer | Vinayakumar B |
-| [HDFS-5047](https://issues.apache.org/jira/browse/HDFS-5047) | Supress logging of full stack trace of quota and lease exceptions | Major | namenode | Kihwal Lee | Robert Parker |
-| [HDFS-5043](https://issues.apache.org/jira/browse/HDFS-5043) | For HdfsFileStatus, set default value of childrenNum to -1 instead of 0 to avoid confusing applications | Major | . | Brandon Li | Brandon Li |
-| [HDFS-5028](https://issues.apache.org/jira/browse/HDFS-5028) | LeaseRenewer throw java.util.ConcurrentModificationException when timeout | Major | . | zhaoyunjiong | zhaoyunjiong |
-| [HDFS-4993](https://issues.apache.org/jira/browse/HDFS-4993) | fsck can fail if a file is renamed or deleted | Major | . | Kihwal Lee | Robert Parker |
| [HDFS-4898](https://issues.apache.org/jira/browse/HDFS-4898) | BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack | Minor | namenode | Eric Sirianni | Tsz Wo Nicholas Sze |
-| [HDFS-4680](https://issues.apache.org/jira/browse/HDFS-4680) | Audit logging of delegation tokens for MR tracing | Major | namenode, security | Andrew Wang | Andrew Wang |
| [HDFS-4632](https://issues.apache.org/jira/browse/HDFS-4632) | globStatus using backslash for escaping does not work on Windows | Major | test | Chris Nauroth | Chuan Liu |
+| [HDFS-5080](https://issues.apache.org/jira/browse/HDFS-5080) | BootstrapStandby not working with QJM when the existing NN is active | Major | ha, qjm | Jing Zhao | Jing Zhao |
+| [HADOOP-9868](https://issues.apache.org/jira/browse/HADOOP-9868) | Server must not advertise kerberos realm | Blocker | ipc | Daryn Sharp | Daryn Sharp |
+| [HDFS-5099](https://issues.apache.org/jira/browse/HDFS-5099) | Namenode#copyEditLogSegmentsToSharedDir should close EditLogInputStreams upon finishing | Major | namenode | Chuan Liu | Chuan Liu |
+| [HDFS-5100](https://issues.apache.org/jira/browse/HDFS-5100) | TestNamenodeRetryCache fails on Windows due to incorrect cleanup | Minor | test | Chuan Liu | Chuan Liu |
+| [HDFS-5103](https://issues.apache.org/jira/browse/HDFS-5103) | TestDirectoryScanner fails on Windows | Minor | test | Chuan Liu | Chuan Liu |
+| [HDFS-5102](https://issues.apache.org/jira/browse/HDFS-5102) | Snapshot names should not be allowed to contain slash characters | Major | snapshots | Aaron T. Myers | Jing Zhao |
+| [HADOOP-9880](https://issues.apache.org/jira/browse/HADOOP-9880) | SASL changes from HADOOP-9421 breaks Secure HA NN | Blocker | . | Kihwal Lee | Daryn Sharp |
+| [HDFS-5106](https://issues.apache.org/jira/browse/HDFS-5106) | TestDatanodeBlockScanner fails on Windows due to incorrect path format | Minor | test | Chuan Liu | Chuan Liu |
+| [YARN-107](https://issues.apache.org/jira/browse/YARN-107) | ClientRMService.forceKillApplication() should handle the non-RUNNING applications properly | Major | resourcemanager | Devaraj K | Xuan Gong |
+| [HDFS-5105](https://issues.apache.org/jira/browse/HDFS-5105) | TestFsck fails on Windows | Minor | . | Chuan Liu | Chuan Liu |
+| [YARN-643](https://issues.apache.org/jira/browse/YARN-643) | WHY appToken is removed both in BaseFinalTransition and AMUnregisteredTransition AND clientToken is removed in FinalTransition and not BaseFinalTransition | Major | . | Jian He | Xuan Gong |
+| [YARN-1006](https://issues.apache.org/jira/browse/YARN-1006) | Nodes list web page on the RM web UI is broken | Major | . | Jian He | Xuan Gong |
+| [MAPREDUCE-5001](https://issues.apache.org/jira/browse/MAPREDUCE-5001) | LocalJobRunner has race condition resulting in job failures | Major | . | Brock Noland | Sandy Ryza |
+| [HDFS-5111](https://issues.apache.org/jira/browse/HDFS-5111) | Remove duplicated error message for snapshot commands when processing invalid arguments | Minor | snapshots | Jing Zhao | Jing Zhao |
| [HDFS-4594](https://issues.apache.org/jira/browse/HDFS-4594) | WebHDFS open sets Content-Length header to what is specified by length parameter rather than how much data is actually returned. | Minor | webhdfs | Arpit Gupta | Chris Nauroth |
-| [HDFS-2994](https://issues.apache.org/jira/browse/HDFS-2994) | If lease soft limit is recovered successfully the append can fail | Major | . | Todd Lipcon | Tao Luo |
-| [MAPREDUCE-5497](https://issues.apache.org/jira/browse/MAPREDUCE-5497) | '5s sleep' in MRAppMaster.shutDownJob is only needed before stopping ClientService | Major | . | Jian He | Jian He |
-| [MAPREDUCE-5493](https://issues.apache.org/jira/browse/MAPREDUCE-5493) | In-memory map outputs can be leaked after shuffle completes | Blocker | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-5483](https://issues.apache.org/jira/browse/MAPREDUCE-5483) | revert MAPREDUCE-5357 | Major | distcp | Alejandro Abdelnur | Robert Kanter |
-| [MAPREDUCE-5475](https://issues.apache.org/jira/browse/MAPREDUCE-5475) | MRClientService does not verify ACLs properly | Blocker | mr-am, mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-5470](https://issues.apache.org/jira/browse/MAPREDUCE-5470) | LocalJobRunner does not work on Windows. | Major | . | Chris Nauroth | Sandy Ryza |
+| [YARN-881](https://issues.apache.org/jira/browse/YARN-881) | Priority#compareTo method seems to be wrong. | Major | . | Jian He | Jian He |
+| [YARN-1082](https://issues.apache.org/jira/browse/YARN-1082) | Secure RM with recovery enabled and rm state store on hdfs fails with gss exception | Blocker | resourcemanager | Arpit Gupta | Vinod Kumar Vavilapalli |
| [MAPREDUCE-5468](https://issues.apache.org/jira/browse/MAPREDUCE-5468) | AM recovery does not work for map only jobs | Blocker | . | Yesha Vora | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-5454](https://issues.apache.org/jira/browse/MAPREDUCE-5454) | TestDFSIO fails intermittently on JDK7 | Major | test | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-5446](https://issues.apache.org/jira/browse/MAPREDUCE-5446) | TestJobHistoryEvents and TestJobHistoryParsing have race conditions | Major | mrv2, test | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-5440](https://issues.apache.org/jira/browse/MAPREDUCE-5440) | TestCopyCommitter Fails on JDK7 | Major | mrv2 | Robert Parker | Robert Parker |
-| [MAPREDUCE-5428](https://issues.apache.org/jira/browse/MAPREDUCE-5428) | HistoryFileManager doesn't stop threads when service is stopped | Major | jobhistoryserver, mrv2 | Jason Lowe | Karthik Kambatla |
-| [MAPREDUCE-5425](https://issues.apache.org/jira/browse/MAPREDUCE-5425) | Junit in TestJobHistoryServer failing in jdk 7 | Major | jobhistoryserver | Ashwin Shankar | Robert Parker |
-| [MAPREDUCE-5414](https://issues.apache.org/jira/browse/MAPREDUCE-5414) | TestTaskAttempt fails jdk7 with NullPointerException | Major | test | Nemon Lou | Nemon Lou |
-| [MAPREDUCE-5385](https://issues.apache.org/jira/browse/MAPREDUCE-5385) | JobContext cache files api are broken | Blocker | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
-| [MAPREDUCE-5358](https://issues.apache.org/jira/browse/MAPREDUCE-5358) | MRAppMaster throws invalid transitions for JobImpl | Major | mr-am | Devaraj K | Devaraj K |
-| [MAPREDUCE-5317](https://issues.apache.org/jira/browse/MAPREDUCE-5317) | Stale files left behind for failed jobs | Major | mrv2 | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-5251](https://issues.apache.org/jira/browse/MAPREDUCE-5251) | Reducer should not implicate map attempt if it has insufficient space to fetch map output | Major | mrv2 | Jason Lowe | Ashwin Shankar |
-| [MAPREDUCE-5164](https://issues.apache.org/jira/browse/MAPREDUCE-5164) | command "mapred job" and "mapred queue" omit HADOOP\_CLIENT\_OPTS | Major | . | Nemon Lou | Nemon Lou |
-| [MAPREDUCE-5020](https://issues.apache.org/jira/browse/MAPREDUCE-5020) | Compile failure with JDK8 | Major | client | Trevor Robinson | Trevor Robinson |
-| [MAPREDUCE-5001](https://issues.apache.org/jira/browse/MAPREDUCE-5001) | LocalJobRunner has race condition resulting in job failures | Major | . | Brock Noland | Sandy Ryza |
-| [MAPREDUCE-3193](https://issues.apache.org/jira/browse/MAPREDUCE-3193) | FileInputFormat doesn't read files recursively in the input path dir | Major | mrv1, mrv2 | Ramgopal N | Devaraj K |
-| [YARN-1194](https://issues.apache.org/jira/browse/YARN-1194) | TestContainerLogsPage fails with native builds | Minor | nodemanager | Roman Shaposhnik | Roman Shaposhnik |
-| [YARN-1189](https://issues.apache.org/jira/browse/YARN-1189) | NMTokenSecretManagerInNM is not being told when applications have finished | Blocker | . | Jason Lowe | Omkar Vinit Joshi |
-| [YARN-1176](https://issues.apache.org/jira/browse/YARN-1176) | RM web services ClusterMetricsInfo total nodes doesn't include unhealthy nodes | Critical | resourcemanager | Thomas Graves | Jonathan Eagles |
-| [YARN-1152](https://issues.apache.org/jira/browse/YARN-1152) | Invalid key to HMAC computation error when getting application report for completed app attempt | Blocker | resourcemanager | Jason Lowe | Jason Lowe |
-| [YARN-1144](https://issues.apache.org/jira/browse/YARN-1144) | Unmanaged AMs registering a tracking URI should not be proxy-fied | Critical | resourcemanager | Alejandro Abdelnur | Alejandro Abdelnur |
-| [YARN-1124](https://issues.apache.org/jira/browse/YARN-1124) | By default yarn application -list should display all the applications in a state other than FINISHED / FAILED | Blocker | . | Omkar Vinit Joshi | Xuan Gong |
-| [YARN-1120](https://issues.apache.org/jira/browse/YARN-1120) | Make ApplicationConstants.Environment.USER definition OS neutral | Minor | . | Chuan Liu | Chuan Liu |
-| [YARN-1107](https://issues.apache.org/jira/browse/YARN-1107) | Job submitted with Delegation token in secured environment causes RM to fail during RM restart | Blocker | resourcemanager | Arpit Gupta | Omkar Vinit Joshi |
-| [YARN-1101](https://issues.apache.org/jira/browse/YARN-1101) | Active nodes can be decremented below 0 | Major | resourcemanager | Robert Parker | Robert Parker |
+| [HDFS-5124](https://issues.apache.org/jira/browse/HDFS-5124) | DelegationTokenSecretManager#retrievePassword can cause deadlock in NameNode | Blocker | namenode | Deepesh Khandelwal | Daryn Sharp |
+| [HADOOP-9899](https://issues.apache.org/jira/browse/HADOOP-9899) | Remove the debug message added by HADOOP-8855 | Minor | security | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-5470](https://issues.apache.org/jira/browse/MAPREDUCE-5470) | LocalJobRunner does not work on Windows. | Major | . | Chris Nauroth | Sandy Ryza |
| [YARN-1094](https://issues.apache.org/jira/browse/YARN-1094) | RM restart throws Null pointer Exception in Secure Env | Blocker | . | Yesha Vora | Vinod Kumar Vavilapalli |
+| [YARN-1008](https://issues.apache.org/jira/browse/YARN-1008) | MiniYARNCluster with multiple nodemanagers, all nodes have same key for allocations | Major | nodemanager | Alejandro Abdelnur | Alejandro Abdelnur |
| [YARN-1093](https://issues.apache.org/jira/browse/YARN-1093) | Corrections to Fair Scheduler documentation | Major | documentation | Wing Yew Poon | |
+| [YARN-942](https://issues.apache.org/jira/browse/YARN-942) | In Fair Scheduler documentation, inconsistency on which properties have prefix | Major | scheduler | Sandy Ryza | Akira Ajisaka |
+| [HDFS-5132](https://issues.apache.org/jira/browse/HDFS-5132) | Deadlock in NameNode between SafeModeMonitor#run and DatanodeManager#handleHeartbeat | Blocker | namenode | Arpit Gupta | Kihwal Lee |
| [YARN-1083](https://issues.apache.org/jira/browse/YARN-1083) | ResourceManager should fail when yarn.nm.liveness-monitor.expiry-interval-ms is set less than heartbeat interval | Major | resourcemanager | Yesha Vora | Zhijie Shen |
-| [YARN-1082](https://issues.apache.org/jira/browse/YARN-1082) | Secure RM with recovery enabled and rm state store on hdfs fails with gss exception | Blocker | resourcemanager | Arpit Gupta | Vinod Kumar Vavilapalli |
-| [YARN-1078](https://issues.apache.org/jira/browse/YARN-1078) | TestNodeManagerResync, TestNodeManagerShutdown, and TestNodeStatusUpdater fail on Windows | Minor | . | Chuan Liu | Chuan Liu |
-| [YARN-1077](https://issues.apache.org/jira/browse/YARN-1077) | TestContainerLaunch fails on Windows | Minor | . | Chuan Liu | Chuan Liu |
-| [YARN-1025](https://issues.apache.org/jira/browse/YARN-1025) | ResourceManager and NodeManager do not load native libraries on Windows. | Major | nodemanager, resourcemanager | Chris Nauroth | Chris Nauroth |
-| [YARN-1008](https://issues.apache.org/jira/browse/YARN-1008) | MiniYARNCluster with multiple nodemanagers, all nodes have same key for allocations | Major | nodemanager | Alejandro Abdelnur | Alejandro Abdelnur |
-| [YARN-1006](https://issues.apache.org/jira/browse/YARN-1006) | Nodes list web page on the RM web UI is broken | Major | . | Jian He | Xuan Gong |
+| [YARN-602](https://issues.apache.org/jira/browse/YARN-602) | NodeManager should mandatorily set some Environment variables into every containers that it launches | Major | . | Xuan Gong | Kenji Kikushima |
| [YARN-994](https://issues.apache.org/jira/browse/YARN-994) | HeartBeat thread in AMRMClientAsync does not handle runtime exception correctly | Major | . | Xuan Gong | Xuan Gong |
+| [HADOOP-9910](https://issues.apache.org/jira/browse/HADOOP-9910) | proxy server start and stop documentation wrong | Minor | . | André Kelpe | |
+| [HADOOP-9906](https://issues.apache.org/jira/browse/HADOOP-9906) | Move HAZKUtil to o.a.h.util.ZKUtil and make inner-classes public | Minor | ha | Karthik Kambatla | Karthik Kambatla |
+| [YARN-1101](https://issues.apache.org/jira/browse/YARN-1101) | Active nodes can be decremented below 0 | Major | resourcemanager | Robert Parker | Robert Parker |
+| [MAPREDUCE-5483](https://issues.apache.org/jira/browse/MAPREDUCE-5483) | revert MAPREDUCE-5357 | Major | distcp | Alejandro Abdelnur | Robert Kanter |
+| [HADOOP-9774](https://issues.apache.org/jira/browse/HADOOP-9774) | RawLocalFileSystem.listStatus() return absolute paths when input path is relative on Windows | Major | fs | shanyu zhao | shanyu zhao |
+| [HDFS-5140](https://issues.apache.org/jira/browse/HDFS-5140) | Too many safemode monitor threads being created in the standby namenode causing it to fail with out of memory error | Blocker | ha | Arpit Gupta | Jing Zhao |
| [YARN-981](https://issues.apache.org/jira/browse/YARN-981) | YARN/MR2/Job-history /logs link does not have correct content | Major | . | Xuan Gong | Jian He |
-| [YARN-966](https://issues.apache.org/jira/browse/YARN-966) | The thread of ContainerLaunch#call will fail without any signal if getLocalizedResources() is called when the container is not at LOCALIZED | Major | . | Zhijie Shen | Zhijie Shen |
+| [YARN-1120](https://issues.apache.org/jira/browse/YARN-1120) | Make ApplicationConstants.Environment.USER definition OS neutral | Minor | . | Chuan Liu | Chuan Liu |
+| [YARN-1077](https://issues.apache.org/jira/browse/YARN-1077) | TestContainerLaunch fails on Windows | Minor | . | Chuan Liu | Chuan Liu |
+| [HDFS-5150](https://issues.apache.org/jira/browse/HDFS-5150) | Allow per NN SPN for internal SPNEGO. | Blocker | . | Kihwal Lee | Kihwal Lee |
+| [YARN-1124](https://issues.apache.org/jira/browse/YARN-1124) | By default yarn application -list should display all the applications in a state other than FINISHED / FAILED | Blocker | . | Omkar Vinit Joshi | Xuan Gong |
+| [HADOOP-9924](https://issues.apache.org/jira/browse/HADOOP-9924) | FileUtil.createJarWithClassPath() does not generate relative classpath correctly | Major | fs | shanyu zhao | shanyu zhao |
+| [HADOOP-9916](https://issues.apache.org/jira/browse/HADOOP-9916) | Race condition in ipc.Client causes TestIPC timeout | Minor | . | Binglin Chang | Binglin Chang |
+| [HADOOP-9932](https://issues.apache.org/jira/browse/HADOOP-9932) | Improper synchronization in RetryCache | Blocker | . | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-5475](https://issues.apache.org/jira/browse/MAPREDUCE-5475) | MRClientService does not verify ACLs properly | Blocker | mr-am, mrv2 | Jason Lowe | Jason Lowe |
+| [HDFS-5159](https://issues.apache.org/jira/browse/HDFS-5159) | Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint | Major | namenode | Aaron T. Myers | Aaron T. Myers |
| [YARN-957](https://issues.apache.org/jira/browse/YARN-957) | Capacity Scheduler tries to reserve the memory more than what node manager reports. | Blocker | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
-| [YARN-948](https://issues.apache.org/jira/browse/YARN-948) | RM should validate the release container list before actually releasing them | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
-| [YARN-942](https://issues.apache.org/jira/browse/YARN-942) | In Fair Scheduler documentation, inconsistency on which properties have prefix | Major | scheduler | Sandy Ryza | Akira AJISAKA |
-| [YARN-903](https://issues.apache.org/jira/browse/YARN-903) | DistributedShell throwing Errors in logs after successfull completion | Major | applications/distributed-shell | Abhishek Kapoor | Omkar Vinit Joshi |
-| [YARN-881](https://issues.apache.org/jira/browse/YARN-881) | Priority#compareTo method seems to be wrong. | Major | . | Jian He | Jian He |
-| [YARN-643](https://issues.apache.org/jira/browse/YARN-643) | WHY appToken is removed both in BaseFinalTransition and AMUnregisteredTransition AND clientToken is removed in FinalTransition and not BaseFinalTransition | Major | . | Jian He | Xuan Gong |
-| [YARN-602](https://issues.apache.org/jira/browse/YARN-602) | NodeManager should mandatorily set some Environment variables into every containers that it launches | Major | . | Xuan Gong | Kenji Kikushima |
-| [YARN-337](https://issues.apache.org/jira/browse/YARN-337) | RM handles killed application tracking URL poorly | Major | resourcemanager | Jason Lowe | Jason Lowe |
-| [YARN-107](https://issues.apache.org/jira/browse/YARN-107) | ClientRMService.forceKillApplication() should handle the non-RUNNING applications properly | Major | resourcemanager | Devaraj K | Xuan Gong |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [YARN-1107](https://issues.apache.org/jira/browse/YARN-1107) | Job submitted with Delegation token in secured environment causes RM to fail during RM restart | Blocker | resourcemanager | Arpit Gupta | Omkar Vinit Joshi |
+| [MAPREDUCE-5414](https://issues.apache.org/jira/browse/MAPREDUCE-5414) | TestTaskAttempt fails jdk7 with NullPointerException | Major | test | Nemon Lou | Nemon Lou |
+| [YARN-1144](https://issues.apache.org/jira/browse/YARN-1144) | Unmanaged AMs registering a tracking URI should not be proxy-fied | Critical | resourcemanager | Alejandro Abdelnur | Alejandro Abdelnur |
+| [YARN-1152](https://issues.apache.org/jira/browse/YARN-1152) | Invalid key to HMAC computation error when getting application report for completed app attempt | Blocker | resourcemanager | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-5020](https://issues.apache.org/jira/browse/MAPREDUCE-5020) | Compile failure with JDK8 | Major | client | Trevor Robinson | Trevor Robinson |
+| [YARN-1025](https://issues.apache.org/jira/browse/YARN-1025) | ResourceManager and NodeManager do not load native libraries on Windows. | Major | nodemanager, resourcemanager | Chris Nauroth | Chris Nauroth |
+| [MAPREDUCE-5497](https://issues.apache.org/jira/browse/MAPREDUCE-5497) | '5s sleep' in MRAppMaster.shutDownJob is only needed before stopping ClientService | Major | . | Jian He | Jian He |
+| [HDFS-4680](https://issues.apache.org/jira/browse/HDFS-4680) | Audit logging of delegation tokens for MR tracing | Major | namenode, security | Andrew Wang | Andrew Wang |
+| [YARN-1176](https://issues.apache.org/jira/browse/YARN-1176) | RM web services ClusterMetricsInfo total nodes doesn't include unhealthy nodes | Critical | resourcemanager | Thomas Graves | Jonathan Eagles |
+| [MAPREDUCE-5164](https://issues.apache.org/jira/browse/MAPREDUCE-5164) | command "mapred job" and "mapred queue" omit HADOOP\_CLIENT\_OPTS | Major | . | Nemon Lou | Nemon Lou |
+| [YARN-1078](https://issues.apache.org/jira/browse/YARN-1078) | TestNodeManagerResync, TestNodeManagerShutdown, and TestNodeStatusUpdater fail on Windows | Minor | . | Chuan Liu | Chuan Liu |
+| [HADOOP-9958](https://issues.apache.org/jira/browse/HADOOP-9958) | Add old constructor back to DelegationTokenInformation to unbreak downstream builds | Major | . | Andrew Wang | Andrew Wang |
+| [HDFS-5192](https://issues.apache.org/jira/browse/HDFS-5192) | NameNode may fail to start when dfs.client.test.drop.namenode.response.number is set | Minor | . | Jing Zhao | Jing Zhao |
+| [YARN-1194](https://issues.apache.org/jira/browse/YARN-1194) | TestContainerLogsPage fails with native builds | Minor | nodemanager | Roman Shaposhnik | Roman Shaposhnik |
+| [HADOOP-9960](https://issues.apache.org/jira/browse/HADOOP-9960) | Upgrade Jersey version to 1.9 | Blocker | . | Brock Noland | Karthik Kambatla |
+| [YARN-1189](https://issues.apache.org/jira/browse/YARN-1189) | NMTokenSecretManagerInNM is not being told when applications have finished | Blocker | . | Jason Lowe | Omkar Vinit Joshi |
+| [HADOOP-9557](https://issues.apache.org/jira/browse/HADOOP-9557) | hadoop-client excludes commons-httpclient | Major | build | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-9961](https://issues.apache.org/jira/browse/HADOOP-9961) | versions of a few transitive dependencies diverged between hadoop subprojects | Minor | build | Roman Shaposhnik | Roman Shaposhnik |
+| [MAPREDUCE-5493](https://issues.apache.org/jira/browse/MAPREDUCE-5493) | In-memory map outputs can be leaked after shuffle completes | Blocker | mrv2 | Jason Lowe | Jason Lowe |
+| [HDFS-5219](https://issues.apache.org/jira/browse/HDFS-5219) | Add configuration keys for retry policy in WebHDFSFileSystem | Major | webhdfs | Haohui Mai | Haohui Mai |
+| [HDFS-5231](https://issues.apache.org/jira/browse/HDFS-5231) | Fix broken links in the document of HDFS Federation | Minor | . | Haohui Mai | Haohui Mai |
+| [HADOOP-9977](https://issues.apache.org/jira/browse/HADOOP-9977) | Hadoop services won't start with different keypass and keystorepass when https is enabled | Major | security | Yesha Vora | Chris Nauroth |
+| [HDFS-2994](https://issues.apache.org/jira/browse/HDFS-2994) | If lease soft limit is recovered successfully the append can fail | Major | . | Todd Lipcon | Tao Luo |
+| [HDFS-5077](https://issues.apache.org/jira/browse/HDFS-5077) | NPE in FSNamesystem.commitBlockSynchronization() | Major | namenode | Konstantin Shvachko | Plamen Jeliazkov |
### SUB-TASKS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HDFS-5249](https://issues.apache.org/jira/browse/HDFS-5249) | Fix dumper thread which may die silently | Major | nfs | Brandon Li | Brandon Li |
-| [HDFS-5234](https://issues.apache.org/jira/browse/HDFS-5234) | Move RpcFrameDecoder out of the public API | Minor | nfs | Haohui Mai | Haohui Mai |
-| [HDFS-5212](https://issues.apache.org/jira/browse/HDFS-5212) | Refactor RpcMessage and NFS3Response to support different types of authentication information | Major | nfs | Jing Zhao | Jing Zhao |
-| [HDFS-5199](https://issues.apache.org/jira/browse/HDFS-5199) | Add more debug trace for NFS READ and WRITE | Trivial | nfs | Brandon Li | Brandon Li |
-| [HDFS-5136](https://issues.apache.org/jira/browse/HDFS-5136) | MNT EXPORT should give the full group list which can mount the exports | Major | nfs | Brandon Li | Brandon Li |
-| [HDFS-5110](https://issues.apache.org/jira/browse/HDFS-5110) | Change FSDataOutputStream to HdfsDataOutputStream for opened streams to fix type cast error | Major | nfs | Brandon Li | Brandon Li |
-| [HDFS-5107](https://issues.apache.org/jira/browse/HDFS-5107) | Fix array copy error in Readdir and Readdirplus responses | Major | nfs | Brandon Li | Brandon Li |
-| [HDFS-5104](https://issues.apache.org/jira/browse/HDFS-5104) | Support dotdot name in NFS LOOKUP operation | Major | nfs | Brandon Li | Brandon Li |
-| [HDFS-5085](https://issues.apache.org/jira/browse/HDFS-5085) | Refactor o.a.h.nfs to support different types of authentications | Major | nfs | Brandon Li | Jing Zhao |
-| [HDFS-5078](https://issues.apache.org/jira/browse/HDFS-5078) | Support file append in NFSv3 gateway to enable data streaming to HDFS | Major | nfs | Brandon Li | Brandon Li |
-| [HDFS-5071](https://issues.apache.org/jira/browse/HDFS-5071) | Change hdfs-nfs parent project to hadoop-project | Major | nfs | Kihwal Lee | Brandon Li |
-| [HDFS-5069](https://issues.apache.org/jira/browse/HDFS-5069) | Include hadoop-nfs and hadoop-hdfs-nfs into hadoop dist for NFS deployment | Major | nfs | Brandon Li | Brandon Li |
-| [HDFS-5067](https://issues.apache.org/jira/browse/HDFS-5067) | Support symlink operations | Major | nfs | Brandon Li | Brandon Li |
-| [HDFS-4971](https://issues.apache.org/jira/browse/HDFS-4971) | Move IO operations out of locking in OpenFileCtx | Major | nfs | Jing Zhao | Jing Zhao |
| [HDFS-4962](https://issues.apache.org/jira/browse/HDFS-4962) | Use enum for nfs constants | Minor | nfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-4947](https://issues.apache.org/jira/browse/HDFS-4947) | Add NFS server export table to control export by hostname or IP range | Major | nfs | Brandon Li | Jing Zhao |
+| [YARN-502](https://issues.apache.org/jira/browse/YARN-502) | RM crash with NPE on NODE\_REMOVED event with FairScheduler | Major | . | Lohit Vijayarenu | Mayank Bansal |
+| [YARN-573](https://issues.apache.org/jira/browse/YARN-573) | Shared data structures in Public Localizer and Private Localizer are not Thread safe. | Critical | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
+| [YARN-906](https://issues.apache.org/jira/browse/YARN-906) | Cancelling ContainerLaunch#call at KILLING causes that the container cannot be completed | Major | . | Zhijie Shen | Zhijie Shen |
+| [HDFS-5071](https://issues.apache.org/jira/browse/HDFS-5071) | Change hdfs-nfs parent project to hadoop-project | Major | nfs | Kihwal Lee | Brandon Li |
| [HDFS-4763](https://issues.apache.org/jira/browse/HDFS-4763) | Add script changes/utility for starting NFS gateway | Major | nfs | Brandon Li | Brandon Li |
-| [MAPREDUCE-5476](https://issues.apache.org/jira/browse/MAPREDUCE-5476) | Job can fail when RM restarts after staging dir is cleaned but before MR successfully unregister with RM | Blocker | . | Jian He | Jian He |
-| [MAPREDUCE-5466](https://issues.apache.org/jira/browse/MAPREDUCE-5466) | Historyserver does not refresh the result of restarted jobs after RM restart | Blocker | . | Yesha Vora | Jian He |
| [MAPREDUCE-5462](https://issues.apache.org/jira/browse/MAPREDUCE-5462) | In map-side sort, swap entire meta entries instead of indexes for better cache performance | Major | performance, task | Sandy Ryza | Sandy Ryza |
+| [HDFS-5104](https://issues.apache.org/jira/browse/HDFS-5104) | Support dotdot name in NFS LOOKUP operation | Major | nfs | Brandon Li | Brandon Li |
+| [HDFS-5107](https://issues.apache.org/jira/browse/HDFS-5107) | Fix array copy error in Readdir and Readdirplus responses | Major | nfs | Brandon Li | Brandon Li |
+| [HDFS-5110](https://issues.apache.org/jira/browse/HDFS-5110) | Change FSDataOutputStream to HdfsDataOutputStream for opened streams to fix type cast error | Major | nfs | Brandon Li | Brandon Li |
+| [HDFS-5069](https://issues.apache.org/jira/browse/HDFS-5069) | Include hadoop-nfs and hadoop-hdfs-nfs into hadoop dist for NFS deployment | Major | nfs | Brandon Li | Brandon Li |
+| [MAPREDUCE-5466](https://issues.apache.org/jira/browse/MAPREDUCE-5466) | Historyserver does not refresh the result of restarted jobs after RM restart | Blocker | . | Yesha Vora | Jian He |
+| [MAPREDUCE-5476](https://issues.apache.org/jira/browse/MAPREDUCE-5476) | Job can fail when RM restarts after staging dir is cleaned but before MR successfully unregister with RM | Blocker | . | Jian He | Jian He |
+| [HDFS-4947](https://issues.apache.org/jira/browse/HDFS-4947) | Add NFS server export table to control export by hostname or IP range | Major | nfs | Brandon Li | Jing Zhao |
+| [YARN-1085](https://issues.apache.org/jira/browse/YARN-1085) | Yarn and MRv2 should do HTTP client authentication in kerberos setup. | Blocker | nodemanager, resourcemanager | Jaimin Jetly | Omkar Vinit Joshi |
+| [HDFS-5078](https://issues.apache.org/jira/browse/HDFS-5078) | Support file append in NFSv3 gateway to enable data streaming to HDFS | Major | nfs | Brandon Li | Brandon Li |
| [MAPREDUCE-5441](https://issues.apache.org/jira/browse/MAPREDUCE-5441) | JobClient exit whenever RM issue Reboot command to 1st attempt App Master. | Major | applicationmaster, client | Rohith Sharma K S | Jian He |
-| [YARN-1184](https://issues.apache.org/jira/browse/YARN-1184) | ClassCastException is thrown during preemption When a huge job is submitted to a queue B whose resources is used by a job in queueA | Major | capacityscheduler, resourcemanager | J.Andreina | Chris Douglas |
-| [YARN-1116](https://issues.apache.org/jira/browse/YARN-1116) | Populate AMRMTokens back to AMRMTokenSecretManager after RM restarts | Major | resourcemanager | Jian He | Jian He |
-| [YARN-1085](https://issues.apache.org/jira/browse/YARN-1085) | Yarn and MRv2 should do HTTP client authentication in kerberos setup. | Blocker | nodemanager, resourcemanager | Jaimin D Jetly | Omkar Vinit Joshi |
-| [YARN-1049](https://issues.apache.org/jira/browse/YARN-1049) | ContainerExistStatus should define a status for preempted containers | Blocker | api | Alejandro Abdelnur | Alejandro Abdelnur |
-| [YARN-906](https://issues.apache.org/jira/browse/YARN-906) | Cancelling ContainerLaunch#call at KILLING causes that the container cannot be completed | Major | . | Zhijie Shen | Zhijie Shen |
| [YARN-771](https://issues.apache.org/jira/browse/YARN-771) | AMRMClient support for resource blacklisting | Major | . | Bikas Saha | Junping Du |
-| [YARN-573](https://issues.apache.org/jira/browse/YARN-573) | Shared data structures in Public Localizer and Private Localizer are not Thread safe. | Critical | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
-| [YARN-540](https://issues.apache.org/jira/browse/YARN-540) | Race condition causing RM to potentially relaunch already unregistered AMs on RM restart | Major | resourcemanager | Jian He | Jian He |
-| [YARN-502](https://issues.apache.org/jira/browse/YARN-502) | RM crash with NPE on NODE\_REMOVED event with FairScheduler | Major | . | Lohit Vijayarenu | Mayank Bansal |
+| [HDFS-5136](https://issues.apache.org/jira/browse/HDFS-5136) | MNT EXPORT should give the full group list which can mount the exports | Major | nfs | Brandon Li | Brandon Li |
+| [YARN-1049](https://issues.apache.org/jira/browse/YARN-1049) | ContainerExistStatus should define a status for preempted containers | Blocker | api | Alejandro Abdelnur | Alejandro Abdelnur |
| [YARN-292](https://issues.apache.org/jira/browse/YARN-292) | ResourceManager throws ArrayIndexOutOfBoundsException while handling CONTAINER\_ALLOCATED for application attempt | Major | resourcemanager | Devaraj K | Zhijie Shen |
+| [HDFS-5085](https://issues.apache.org/jira/browse/HDFS-5085) | Refactor o.a.h.nfs to support different types of authentications | Major | nfs | Brandon Li | Jing Zhao |
+| [HDFS-5067](https://issues.apache.org/jira/browse/HDFS-5067) | Support symlink operations | Major | nfs | Brandon Li | Brandon Li |
+| [HDFS-5199](https://issues.apache.org/jira/browse/HDFS-5199) | Add more debug trace for NFS READ and WRITE | Trivial | nfs | Brandon Li | Brandon Li |
+| [YARN-1116](https://issues.apache.org/jira/browse/YARN-1116) | Populate AMRMTokens back to AMRMTokenSecretManager after RM restarts | Major | resourcemanager | Jian He | Jian He |
+| [YARN-540](https://issues.apache.org/jira/browse/YARN-540) | Race condition causing RM to potentially relaunch already unregistered AMs on RM restart | Major | resourcemanager | Jian He | Jian He |
+| [YARN-1184](https://issues.apache.org/jira/browse/YARN-1184) | ClassCastException is thrown during preemption When a huge job is submitted to a queue B whose resources is used by a job in queueA | Major | capacityscheduler, resourcemanager | J.Andreina | Chris Douglas |
+| [HDFS-5212](https://issues.apache.org/jira/browse/HDFS-5212) | Refactor RpcMessage and NFS3Response to support different types of authentication information | Major | nfs | Jing Zhao | Jing Zhao |
+| [HDFS-5234](https://issues.apache.org/jira/browse/HDFS-5234) | Move RpcFrameDecoder out of the public API | Minor | nfs | Haohui Mai | Haohui Mai |
+| [HDFS-4971](https://issues.apache.org/jira/browse/HDFS-4971) | Move IO operations out of locking in OpenFileCtx | Major | nfs | Jing Zhao | Jing Zhao |
+| [HDFS-5249](https://issues.apache.org/jira/browse/HDFS-5249) | Fix dumper thread which may die silently | Major | nfs | Brandon Li | Brandon Li |
### OTHER:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.1-beta/RELEASENOTES.2.1.1-beta.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.1-beta/RELEASENOTES.2.1.1-beta.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.1-beta/RELEASENOTES.2.1.1-beta.md
index c1dd568..79530b5 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.1-beta/RELEASENOTES.2.1.1-beta.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.1-beta/RELEASENOTES.2.1.1-beta.md
@@ -23,9 +23,9 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-9944](https://issues.apache.org/jira/browse/HADOOP-9944) | *Blocker* | **RpcRequestHeaderProto defines callId as uint32 while ipc.Client.CONNECTION\_CONTEXT\_CALL\_ID is signed (-3)**
+* [YARN-707](https://issues.apache.org/jira/browse/YARN-707) | *Blocker* | **Add user info in the YARN ClientToken**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
@@ -39,14 +39,14 @@ Used for testing when NameNode HA is enabled. Users can use a new configuration
* [YARN-1170](https://issues.apache.org/jira/browse/YARN-1170) | *Blocker* | **yarn proto definitions should specify package as 'hadoop.yarn'**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-707](https://issues.apache.org/jira/browse/YARN-707) | *Blocker* | **Add user info in the YARN ClientToken**
+* [HADOOP-9944](https://issues.apache.org/jira/browse/HADOOP-9944) | *Blocker* | **RpcRequestHeaderProto defines callId as uint32 while ipc.Client.CONNECTION\_CONTEXT\_CALL\_ID is signed (-3)**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[25/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.2/CHANGES.0.23.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.2/CHANGES.0.23.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.2/CHANGES.0.23.2.md
index 37b85a5..5f1ac09 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.2/CHANGES.0.23.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.2/CHANGES.0.23.2.md
@@ -18,21 +18,15 @@
-->
# Apache Hadoop Changelog
-## Release 0.23.2 - Unreleased (as of 2016-03-04)
+## Release 0.23.2 - Unreleased (as of 2017-08-28)
### INCOMPATIBLE CHANGES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8164](https://issues.apache.org/jira/browse/HADOOP-8164) | Handle paths using back slash as path separator for windows only | Major | fs | Suresh Srinivas | Daryn Sharp |
-| [HADOOP-8131](https://issues.apache.org/jira/browse/HADOOP-8131) | FsShell put doesn't correctly handle a non-existent dir | Critical | . | Daryn Sharp | Daryn Sharp |
| [HDFS-2887](https://issues.apache.org/jira/browse/HDFS-2887) | Define a FSVolume interface | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-8131](https://issues.apache.org/jira/browse/HADOOP-8131) | FsShell put doesn't correctly handle a non-existent dir | Critical | . | Daryn Sharp | Daryn Sharp |
+| [HADOOP-8164](https://issues.apache.org/jira/browse/HADOOP-8164) | Handle paths using back slash as path separator for windows only | Major | fs | Suresh Srinivas | Daryn Sharp |
### NEW FEATURES:
@@ -46,131 +40,131 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8071](https://issues.apache.org/jira/browse/HADOOP-8071) | Avoid an extra packet in client code when nagling is disabled | Minor | ipc | Todd Lipcon | Todd Lipcon |
+| [HDFS-1217](https://issues.apache.org/jira/browse/HDFS-1217) | Some methods in the NameNdoe should not be public | Major | namenode | Tsz Wo Nicholas Sze | Laxman |
| [HADOOP-8048](https://issues.apache.org/jira/browse/HADOOP-8048) | Allow merging of Credentials | Major | util | Daryn Sharp | Daryn Sharp |
-| [HDFS-3066](https://issues.apache.org/jira/browse/HDFS-3066) | cap space usage of default log4j rolling policy (hdfs specific changes) | Major | scripts | Patrick Hunt | Patrick Hunt |
-| [HDFS-3024](https://issues.apache.org/jira/browse/HDFS-3024) | Improve performance of stringification in addStoredBlock | Minor | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2985](https://issues.apache.org/jira/browse/HDFS-2985) | Improve logging when replicas are marked as corrupt | Minor | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2981](https://issues.apache.org/jira/browse/HDFS-2981) | The default value of dfs.client.block.write.replace-datanode-on-failure.enable should be true | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2907](https://issues.apache.org/jira/browse/HDFS-2907) | Make FSDataset in Datanode Pluggable | Minor | . | Sanjay Radia | Tsz Wo Nicholas Sze |
-| [HDFS-2655](https://issues.apache.org/jira/browse/HDFS-2655) | BlockReaderLocal#skip performs unnecessary IO | Major | datanode | Eli Collins | Brandon Li |
| [HDFS-2506](https://issues.apache.org/jira/browse/HDFS-2506) | Umbrella jira for tracking separation of wire protocol datatypes from the implementation types | Major | datanode, namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-1217](https://issues.apache.org/jira/browse/HDFS-1217) | Some methods in the NameNdoe should not be public | Major | namenode | Tsz Wo Nicholas Sze | Laxman |
-| [MAPREDUCE-3989](https://issues.apache.org/jira/browse/MAPREDUCE-3989) | cap space usage of default log4j rolling policy (mr specific changes) | Major | . | Patrick Hunt | Patrick Hunt |
-| [MAPREDUCE-3922](https://issues.apache.org/jira/browse/MAPREDUCE-3922) | Fix the potential problem compiling 32 bit binaries on a x86\_64 host. | Minor | build, mrv2 | Eugene Koontz | Hitesh Shah |
-| [MAPREDUCE-3901](https://issues.apache.org/jira/browse/MAPREDUCE-3901) | lazy load JobHistory Task and TaskAttempt details | Major | jobhistoryserver, mrv2 | Siddharth Seth | Siddharth Seth |
+| [HADOOP-8071](https://issues.apache.org/jira/browse/HADOOP-8071) | Avoid an extra packet in client code when nagling is disabled | Minor | ipc | Todd Lipcon | Todd Lipcon |
| [MAPREDUCE-3864](https://issues.apache.org/jira/browse/MAPREDUCE-3864) | Fix cluster setup docs for correct SNN HTTPS parameters | Minor | documentation, security | Todd Lipcon | Todd Lipcon |
| [MAPREDUCE-3849](https://issues.apache.org/jira/browse/MAPREDUCE-3849) | Change TokenCache's reading of the binary token file | Major | security | Daryn Sharp | Daryn Sharp |
+| [HDFS-2655](https://issues.apache.org/jira/browse/HDFS-2655) | BlockReaderLocal#skip performs unnecessary IO | Major | datanode | Eli Collins | Brandon Li |
+| [HDFS-2907](https://issues.apache.org/jira/browse/HDFS-2907) | Make FSDataset in Datanode Pluggable | Minor | . | Sanjay Radia | Tsz Wo Nicholas Sze |
+| [HDFS-2985](https://issues.apache.org/jira/browse/HDFS-2985) | Improve logging when replicas are marked as corrupt | Minor | namenode | Todd Lipcon | Todd Lipcon |
+| [HDFS-2981](https://issues.apache.org/jira/browse/HDFS-2981) | The default value of dfs.client.block.write.replace-datanode-on-failure.enable should be true | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [MAPREDUCE-3730](https://issues.apache.org/jira/browse/MAPREDUCE-3730) | Allow restarted NM to rejoin cluster before RM expires it | Minor | mrv2, resourcemanager | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-3901](https://issues.apache.org/jira/browse/MAPREDUCE-3901) | lazy load JobHistory Task and TaskAttempt details | Major | jobhistoryserver, mrv2 | Siddharth Seth | Siddharth Seth |
+| [MAPREDUCE-3922](https://issues.apache.org/jira/browse/MAPREDUCE-3922) | Fix the potential problem compiling 32 bit binaries on a x86\_64 host. | Minor | build, mrv2 | Eugene Koontz | Hitesh Shah |
+| [HDFS-3024](https://issues.apache.org/jira/browse/HDFS-3024) | Improve performance of stringification in addStoredBlock | Minor | namenode | Todd Lipcon | Todd Lipcon |
+| [HDFS-3066](https://issues.apache.org/jira/browse/HDFS-3066) | cap space usage of default log4j rolling policy (hdfs specific changes) | Major | scripts | Patrick Hunt | Patrick Hunt |
+| [MAPREDUCE-3989](https://issues.apache.org/jira/browse/MAPREDUCE-3989) | cap space usage of default log4j rolling policy (mr specific changes) | Major | . | Patrick Hunt | Patrick Hunt |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8176](https://issues.apache.org/jira/browse/HADOOP-8176) | Disambiguate the destination of FsShell copies | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8146](https://issues.apache.org/jira/browse/HADOOP-8146) | FsShell commands cannot be interrupted | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8140](https://issues.apache.org/jira/browse/HADOOP-8140) | dfs -getmerge should process its argments better | Major | . | arkady borkovsky | Daryn Sharp |
-| [HADOOP-8137](https://issues.apache.org/jira/browse/HADOOP-8137) | Site side links for commands manual (MAPREDUCE-3497) | Major | documentation | Vinod Kumar Vavilapalli | Thomas Graves |
-| [HADOOP-8123](https://issues.apache.org/jira/browse/HADOOP-8123) | hadoop-project invalid pom warnings prevent transitive dependency resolution | Critical | build | Jonathan Eagles | Jonathan Eagles |
-| [HADOOP-8083](https://issues.apache.org/jira/browse/HADOOP-8083) | javadoc generation for some modules is not done under target/ | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-7874](https://issues.apache.org/jira/browse/HADOOP-7874) | native libs should be under lib/native/ dir | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-8042](https://issues.apache.org/jira/browse/HADOOP-8042) | When copying a file out of HDFS, modifying it, and uploading it back into HDFS, the put fails due to a CRC mismatch | Critical | fs | Kevin J. Price | Daryn Sharp |
+| [HADOOP-8035](https://issues.apache.org/jira/browse/HADOOP-8035) | Hadoop Maven site is inefficient and runs phases redundantly | Minor | build | Andrew Bayer | Andrew Bayer |
+| [HDFS-2764](https://issues.apache.org/jira/browse/HDFS-2764) | TestBackupNode is racy | Major | namenode, test | Aaron T. Myers | Aaron T. Myers |
+| [MAPREDUCE-3680](https://issues.apache.org/jira/browse/MAPREDUCE-3680) | FifoScheduler web service rest API can print out invalid JSON | Major | mrv2 | Thomas Graves | |
+| [HADOOP-8051](https://issues.apache.org/jira/browse/HADOOP-8051) | HttpFS documentation it is not wired to the generated site | Major | documentation | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-3852](https://issues.apache.org/jira/browse/MAPREDUCE-3852) | test TestLinuxResourceCalculatorPlugin failing | Blocker | mrv2 | Thomas Graves | Thomas Graves |
+| [HDFS-776](https://issues.apache.org/jira/browse/HDFS-776) | Fix exception handling in Balancer | Critical | balancer & mover | Owen O'Malley | Uma Maheswara Rao G |
+| [HADOOP-6502](https://issues.apache.org/jira/browse/HADOOP-6502) | DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300 | Critical | util | Hairong Kuang | Sharad Agarwal |
+| [HDFS-2950](https://issues.apache.org/jira/browse/HDFS-2950) | Secondary NN HTTPS address should be listed as a NAMESERVICE\_SPECIFIC\_KEY | Minor | namenode | Todd Lipcon | Todd Lipcon |
+| [HDFS-2525](https://issues.apache.org/jira/browse/HDFS-2525) | Race between BlockPoolSliceScanner and append | Critical | datanode | Todd Lipcon | Brandon Li |
+| [HDFS-2938](https://issues.apache.org/jira/browse/HDFS-2938) | Recursive delete of a large directory makes namenode unresponsive | Major | namenode | Suresh Srinivas | Hari Mankude |
+| [HADOOP-8074](https://issues.apache.org/jira/browse/HADOOP-8074) | Small bug in hadoop error message for unknown commands | Trivial | scripts | Eli Collins | Colin P. McCabe |
| [HADOOP-8082](https://issues.apache.org/jira/browse/HADOOP-8082) | add hadoop-client and hadoop-minicluster to the dependency-management section | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8074](https://issues.apache.org/jira/browse/HADOOP-8074) | Small bug in hadoop error message for unknown commands | Trivial | scripts | Eli Collins | Colin Patrick McCabe |
| [HADOOP-8066](https://issues.apache.org/jira/browse/HADOOP-8066) | The full docs build intermittently fails | Major | build | Aaron T. Myers | Andrew Bayer |
-| [HADOOP-8064](https://issues.apache.org/jira/browse/HADOOP-8064) | Remove unnecessary dependency on w3c.org in document processing | Major | build | Kihwal Lee | Kihwal Lee |
+| [HADOOP-8083](https://issues.apache.org/jira/browse/HADOOP-8083) | javadoc generation for some modules is not done under target/ | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-8036](https://issues.apache.org/jira/browse/HADOOP-8036) | TestViewFsTrash assumes the user's home directory is 2 levels deep | Major | fs, test | Eli Collins | Colin P. McCabe |
+| [MAPREDUCE-3862](https://issues.apache.org/jira/browse/MAPREDUCE-3862) | Nodemanager can appear to hang on shutdown due to lingering DeletionService threads | Major | mrv2, nodemanager | Jason Lowe | Jason Lowe |
+| [HDFS-2969](https://issues.apache.org/jira/browse/HDFS-2969) | ExtendedBlock.equals is incorrectly implemented | Critical | datanode | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8046](https://issues.apache.org/jira/browse/HADOOP-8046) | Revert StaticMapping semantics to the existing ones, add DNS mapping diagnostics in progress | Minor | . | Steve Loughran | Steve Loughran |
+| [HDFS-2725](https://issues.apache.org/jira/browse/HDFS-2725) | hdfs script usage information is missing the information about "dfs" command | Major | hdfs-client | Prashant Sharma | |
| [HADOOP-8057](https://issues.apache.org/jira/browse/HADOOP-8057) | hadoop-setup-conf.sh not working because of some extra spaces. | Major | scripts | Vinayakumar B | Vinayakumar B |
-| [HADOOP-8051](https://issues.apache.org/jira/browse/HADOOP-8051) | HttpFS documentation it is not wired to the generated site | Major | documentation | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-3634](https://issues.apache.org/jira/browse/MAPREDUCE-3634) | All daemons should crash instead of hanging around when their EventHandlers get exceptions | Major | mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
| [HADOOP-8050](https://issues.apache.org/jira/browse/HADOOP-8050) | Deadlock in metrics | Major | metrics | Kihwal Lee | Kihwal Lee |
-| [HADOOP-8046](https://issues.apache.org/jira/browse/HADOOP-8046) | Revert StaticMapping semantics to the existing ones, add DNS mapping diagnostics in progress | Minor | . | Steve Loughran | Steve Loughran |
-| [HADOOP-8042](https://issues.apache.org/jira/browse/HADOOP-8042) | When copying a file out of HDFS, modifying it, and uploading it back into HDFS, the put fails due to a CRC mismatch | Critical | fs | Kevin J. Price | Daryn Sharp |
-| [HADOOP-8036](https://issues.apache.org/jira/browse/HADOOP-8036) | TestViewFsTrash assumes the user's home directory is 2 levels deep | Major | fs, test | Eli Collins | Colin Patrick McCabe |
-| [HADOOP-8035](https://issues.apache.org/jira/browse/HADOOP-8035) | Hadoop Maven site is inefficient and runs phases redundantly | Minor | build | Andrew Bayer | Andrew Bayer |
-| [HADOOP-7874](https://issues.apache.org/jira/browse/HADOOP-7874) | native libs should be under lib/native/ dir | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-3884](https://issues.apache.org/jira/browse/MAPREDUCE-3884) | PWD should be first in the classpath of MR tasks | Critical | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur |
| [HADOOP-7660](https://issues.apache.org/jira/browse/HADOOP-7660) | Maven generated .classpath doesnot includes "target/generated-test-source/java" as source directory. | Minor | build | Laxman | Laxman |
-| [HADOOP-6502](https://issues.apache.org/jira/browse/HADOOP-6502) | DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300 | Critical | util | Hairong Kuang | Sharad Agarwal |
-| [HDFS-3853](https://issues.apache.org/jira/browse/HDFS-3853) | Port MiniDFSCluster enableManagedDfsDirsRedundancy option to branch-2 | Minor | namenode | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3160](https://issues.apache.org/jira/browse/HDFS-3160) | httpfs should exec catalina instead of forking it | Major | scripts | Roman Shaposhnik | Roman Shaposhnik |
-| [HDFS-3101](https://issues.apache.org/jira/browse/HDFS-3101) | cannot read empty file using webhdfs | Major | webhdfs | Zhanwei Wang | Tsz Wo Nicholas Sze |
-| [HDFS-3032](https://issues.apache.org/jira/browse/HDFS-3032) | Lease renewer tries forever even if renewal is not possible | Major | hdfs-client | Kihwal Lee | Kihwal Lee |
-| [HDFS-3012](https://issues.apache.org/jira/browse/HDFS-3012) | Exception while renewing delegation token | Critical | . | Ramya Sunil | Robert Joseph Evans |
+| [HDFS-2944](https://issues.apache.org/jira/browse/HDFS-2944) | Typo in hdfs-default.xml causes dfs.client.block.write.replace-datanode-on-failure.enable to be mistakenly disabled | Major | hdfs-client | Aaron T. Myers | Aaron T. Myers |
+| [MAPREDUCE-3878](https://issues.apache.org/jira/browse/MAPREDUCE-3878) | Null user on filtered jobhistory job page | Critical | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-3583](https://issues.apache.org/jira/browse/MAPREDUCE-3583) | ProcfsBasedProcessTree#constructProcessInfo() may throw NumberFormatException | Critical | . | Ted Yu | Ted Yu |
+| [MAPREDUCE-3738](https://issues.apache.org/jira/browse/MAPREDUCE-3738) | NM can hang during shutdown if AppLogAggregatorImpl thread dies unexpectedly | Critical | mrv2, nodemanager | Jason Lowe | Jason Lowe |
| [HDFS-3008](https://issues.apache.org/jira/browse/HDFS-3008) | Negative caching of local addrs doesn't work | Major | hdfs-client | Eli Collins | Eli Collins |
+| [MAPREDUCE-3866](https://issues.apache.org/jira/browse/MAPREDUCE-3866) | bin/yarn prints the command line unnecessarily | Minor | mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [MAPREDUCE-3904](https://issues.apache.org/jira/browse/MAPREDUCE-3904) | [NPE] Job history produced with mapreduce.cluster.acls.enabled false can not be viewed with mapreduce.cluster.acls.enabled true | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-3918](https://issues.apache.org/jira/browse/MAPREDUCE-3918) | proc\_historyserver no longer in command line arguments for HistoryServer | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
| [HDFS-3006](https://issues.apache.org/jira/browse/HDFS-3006) | Webhdfs "SETOWNER" call returns incorrect content-type | Major | webhdfs | bc Wong | Tsz Wo Nicholas Sze |
-| [HDFS-2969](https://issues.apache.org/jira/browse/HDFS-2969) | ExtendedBlock.equals is incorrectly implemented | Critical | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2950](https://issues.apache.org/jira/browse/HDFS-2950) | Secondary NN HTTPS address should be listed as a NAMESERVICE\_SPECIFIC\_KEY | Minor | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2944](https://issues.apache.org/jira/browse/HDFS-2944) | Typo in hdfs-default.xml causes dfs.client.block.write.replace-datanode-on-failure.enable to be mistakenly disabled | Major | hdfs-client | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-2938](https://issues.apache.org/jira/browse/HDFS-2938) | Recursive delete of a large directory makes namenode unresponsive | Major | namenode | Suresh Srinivas | Hari Mankude |
-| [HDFS-2815](https://issues.apache.org/jira/browse/HDFS-2815) | Namenode is not coming out of safemode when we perform ( NN crash + restart ) . Also FSCK report shows blocks missed. | Critical | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HDFS-2764](https://issues.apache.org/jira/browse/HDFS-2764) | TestBackupNode is racy | Major | namenode, test | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-2725](https://issues.apache.org/jira/browse/HDFS-2725) | hdfs script usage information is missing the information about "dfs" command | Major | hdfs-client | Prashant Sharma | |
-| [HDFS-2525](https://issues.apache.org/jira/browse/HDFS-2525) | Race between BlockPoolSliceScanner and append | Critical | datanode | Todd Lipcon | Brandon Li |
-| [HDFS-776](https://issues.apache.org/jira/browse/HDFS-776) | Fix exception handling in Balancer | Critical | balancer & mover | Owen O'Malley | Uma Maheswara Rao G |
-| [MAPREDUCE-4061](https://issues.apache.org/jira/browse/MAPREDUCE-4061) | RM only has 1 AM launcher thread | Blocker | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4043](https://issues.apache.org/jira/browse/MAPREDUCE-4043) | Secret keys set in Credentials are not seen by tasks | Blocker | mrv2, security | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4034](https://issues.apache.org/jira/browse/MAPREDUCE-4034) | Unable to view task logs on history server with mapreduce.job.acl-view-job=\* | Blocker | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4025](https://issues.apache.org/jira/browse/MAPREDUCE-4025) | AM can crash if task attempt reports bogus progress value | Blocker | mr-am, mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4006](https://issues.apache.org/jira/browse/MAPREDUCE-4006) | history server container log web UI sometimes combines stderr/stdout/syslog contents together | Major | jobhistoryserver, mrv2 | Jason Lowe | Siddharth Seth |
-| [MAPREDUCE-4005](https://issues.apache.org/jira/browse/MAPREDUCE-4005) | AM container logs URL is broken for completed apps when log aggregation is enabled | Major | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-3982](https://issues.apache.org/jira/browse/MAPREDUCE-3982) | TestEmptyJob fails with FileNotFound | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-3977](https://issues.apache.org/jira/browse/MAPREDUCE-3977) | LogAggregationService leaks log aggregator objects | Critical | mrv2, nodemanager | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-3976](https://issues.apache.org/jira/browse/MAPREDUCE-3976) | TestRMContainerAllocator failing | Major | mrv2 | Bikas Saha | Jason Lowe |
-| [MAPREDUCE-3975](https://issues.apache.org/jira/browse/MAPREDUCE-3975) | Default value not set for Configuration parameter mapreduce.job.local.dir | Blocker | mrv2 | Eric Payne | Eric Payne |
-| [MAPREDUCE-3964](https://issues.apache.org/jira/browse/MAPREDUCE-3964) | ResourceManager does not have JVM metrics | Critical | mrv2, resourcemanager | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-3961](https://issues.apache.org/jira/browse/MAPREDUCE-3961) | Map/ReduceSlotMillis computation incorrect | Major | mrv2 | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-3960](https://issues.apache.org/jira/browse/MAPREDUCE-3960) | web proxy doesn't forward request to AM with configured hostname/IP | Critical | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3954](https://issues.apache.org/jira/browse/MAPREDUCE-3954) | Clean up passing HEAPSIZE to yarn and mapred commands. | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-3931](https://issues.apache.org/jira/browse/MAPREDUCE-3931) | MR tasks failing due to changing timestamps on Resources to download | Major | mrv2 | Vinod Kumar Vavilapalli | Siddharth Seth |
+| [MAPREDUCE-2793](https://issues.apache.org/jira/browse/MAPREDUCE-2793) | [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs | Critical | mrv2 | Ramya Sunil | Bikas Saha |
+| [MAPREDUCE-3910](https://issues.apache.org/jira/browse/MAPREDUCE-3910) | user not allowed to submit jobs even though queue -showacls shows it allows | Blocker | mrv2 | John George | John George |
+| [MAPREDUCE-3686](https://issues.apache.org/jira/browse/MAPREDUCE-3686) | history server web ui - job counter values for map/reduce not shown properly | Critical | mrv2 | Thomas Graves | Bhallamudi Venkata Siva Kamesh |
+| [MAPREDUCE-3913](https://issues.apache.org/jira/browse/MAPREDUCE-3913) | RM application webpage is unresponsive after 2000 jobs | Critical | mrv2, webapps | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-2855](https://issues.apache.org/jira/browse/MAPREDUCE-2855) | ResourceBundle lookup during counter name resolution takes a lot of time | Major | . | Todd Lipcon | Siddharth Seth |
+| [MAPREDUCE-3790](https://issues.apache.org/jira/browse/MAPREDUCE-3790) | Broken pipe on streaming job can lead to truncated output for a successful job | Major | contrib/streaming, mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-3816](https://issues.apache.org/jira/browse/MAPREDUCE-3816) | capacity scheduler web ui bar graphs for used capacity wrong | Critical | mrv2 | Thomas Graves | Thomas Graves |
| [MAPREDUCE-3930](https://issues.apache.org/jira/browse/MAPREDUCE-3930) | The AM page for a Reducer that has not been launched causes an NPE | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-3929](https://issues.apache.org/jira/browse/MAPREDUCE-3929) | output of mapred -showacl is not clear | Major | mrv2 | John George | John George |
+| [MAPREDUCE-3931](https://issues.apache.org/jira/browse/MAPREDUCE-3931) | MR tasks failing due to changing timestamps on Resources to download | Major | mrv2 | Vinod Kumar Vavilapalli | Siddharth Seth |
+| [MAPREDUCE-3687](https://issues.apache.org/jira/browse/MAPREDUCE-3687) | If AM dies before it returns new tracking URL, proxy redirects to http://N/A/ and doesn't return error code | Major | mrv2 | David Capwell | Ravi Prakash |
| [MAPREDUCE-3920](https://issues.apache.org/jira/browse/MAPREDUCE-3920) | Revise yarn default port number selection | Major | nodemanager, resourcemanager | Dave Thompson | Dave Thompson |
-| [MAPREDUCE-3918](https://issues.apache.org/jira/browse/MAPREDUCE-3918) | proc\_historyserver no longer in command line arguments for HistoryServer | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-3913](https://issues.apache.org/jira/browse/MAPREDUCE-3913) | RM application webpage is unresponsive after 2000 jobs | Critical | mrv2, webapps | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-3910](https://issues.apache.org/jira/browse/MAPREDUCE-3910) | user not allowed to submit jobs even though queue -showacls shows it allows | Blocker | mrv2 | John George | John George |
-| [MAPREDUCE-3904](https://issues.apache.org/jira/browse/MAPREDUCE-3904) | [NPE] Job history produced with mapreduce.cluster.acls.enabled false can not be viewed with mapreduce.cluster.acls.enabled true | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
| [MAPREDUCE-3903](https://issues.apache.org/jira/browse/MAPREDUCE-3903) | no admin override to view jobs on mr app master and job history server | Critical | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3897](https://issues.apache.org/jira/browse/MAPREDUCE-3897) | capacity scheduler - maxActiveApplicationsPerUser calculation can be wrong | Critical | mrv2 | Thomas Graves | Eric Payne |
+| [HDFS-3012](https://issues.apache.org/jira/browse/HDFS-3012) | Exception while renewing delegation token | Critical | . | Ramya Sunil | Robert Joseph Evans |
+| [MAPREDUCE-3706](https://issues.apache.org/jira/browse/MAPREDUCE-3706) | HTTP Circular redirect error on the job attempts page | Critical | mrv2 | Thomas Graves | Robert Joseph Evans |
| [MAPREDUCE-3896](https://issues.apache.org/jira/browse/MAPREDUCE-3896) | pig job through oozie hangs | Blocker | jobhistoryserver, mrv2 | John George | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-3884](https://issues.apache.org/jira/browse/MAPREDUCE-3884) | PWD should be first in the classpath of MR tasks | Critical | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-3878](https://issues.apache.org/jira/browse/MAPREDUCE-3878) | Null user on filtered jobhistory job page | Critical | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-3866](https://issues.apache.org/jira/browse/MAPREDUCE-3866) | bin/yarn prints the command line unnecessarily | Minor | mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-3862](https://issues.apache.org/jira/browse/MAPREDUCE-3862) | Nodemanager can appear to hang on shutdown due to lingering DeletionService threads | Major | mrv2, nodemanager | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-3852](https://issues.apache.org/jira/browse/MAPREDUCE-3852) | test TestLinuxResourceCalculatorPlugin failing | Blocker | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3816](https://issues.apache.org/jira/browse/MAPREDUCE-3816) | capacity scheduler web ui bar graphs for used capacity wrong | Critical | mrv2 | Thomas Graves | Thomas Graves |
| [MAPREDUCE-3792](https://issues.apache.org/jira/browse/MAPREDUCE-3792) | job -list displays only the jobs submitted by a particular user | Critical | mrv2 | Ramya Sunil | Jason Lowe |
-| [MAPREDUCE-3790](https://issues.apache.org/jira/browse/MAPREDUCE-3790) | Broken pipe on streaming job can lead to truncated output for a successful job | Major | contrib/streaming, mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-3738](https://issues.apache.org/jira/browse/MAPREDUCE-3738) | NM can hang during shutdown if AppLogAggregatorImpl thread dies unexpectedly | Critical | mrv2, nodemanager | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-3706](https://issues.apache.org/jira/browse/MAPREDUCE-3706) | HTTP Circular redirect error on the job attempts page | Critical | mrv2 | Thomas Graves | Robert Joseph Evans |
-| [MAPREDUCE-3687](https://issues.apache.org/jira/browse/MAPREDUCE-3687) | If AM dies before it returns new tracking URL, proxy redirects to http://N/A/ and doesn't return error code | Major | mrv2 | David Capwell | Ravi Prakash |
-| [MAPREDUCE-3686](https://issues.apache.org/jira/browse/MAPREDUCE-3686) | history server web ui - job counter values for map/reduce not shown properly | Critical | mrv2 | Thomas Graves | Bhallamudi Venkata Siva Kamesh |
-| [MAPREDUCE-3680](https://issues.apache.org/jira/browse/MAPREDUCE-3680) | FifoScheduler web service rest API can print out invalid JSON | Major | mrv2 | Thomas Graves | |
-| [MAPREDUCE-3634](https://issues.apache.org/jira/browse/MAPREDUCE-3634) | All daemons should crash instead of hanging around when their EventHandlers get exceptions | Major | mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
| [MAPREDUCE-3614](https://issues.apache.org/jira/browse/MAPREDUCE-3614) | finalState UNDEFINED if AM is killed by hand | Major | mrv2 | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-3583](https://issues.apache.org/jira/browse/MAPREDUCE-3583) | ProcfsBasedProcessTree#constructProcessInfo() may throw NumberFormatException | Critical | . | Ted Yu | Ted Yu |
+| [MAPREDUCE-3929](https://issues.apache.org/jira/browse/MAPREDUCE-3929) | output of mapred -showacl is not clear | Major | mrv2 | John George | John George |
+| [HADOOP-8123](https://issues.apache.org/jira/browse/HADOOP-8123) | hadoop-project invalid pom warnings prevent transitive dependency resolution | Critical | build | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-3960](https://issues.apache.org/jira/browse/MAPREDUCE-3960) | web proxy doesn't forward request to AM with configured hostname/IP | Critical | mrv2 | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-3897](https://issues.apache.org/jira/browse/MAPREDUCE-3897) | capacity scheduler - maxActiveApplicationsPerUser calculation can be wrong | Critical | mrv2 | Thomas Graves | Eric Payne |
| [MAPREDUCE-3497](https://issues.apache.org/jira/browse/MAPREDUCE-3497) | missing documentation for yarn cli and subcommands - similar to commands\_manual.html | Major | documentation, mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3034](https://issues.apache.org/jira/browse/MAPREDUCE-3034) | NM should act on a REBOOT command from RM | Critical | mrv2, nodemanager | Vinod Kumar Vavilapalli | Devaraj K |
+| [HADOOP-8137](https://issues.apache.org/jira/browse/HADOOP-8137) | Site side links for commands manual (MAPREDUCE-3497) | Major | documentation | Vinod Kumar Vavilapalli | Thomas Graves |
| [MAPREDUCE-3009](https://issues.apache.org/jira/browse/MAPREDUCE-3009) | RM UI -\> Applications -\> Application(Job History) -\> Map Tasks -\> Task ID -\> Node link is not working | Major | jobhistoryserver, mrv2 | chackaravarthy | chackaravarthy |
-| [MAPREDUCE-2855](https://issues.apache.org/jira/browse/MAPREDUCE-2855) | ResourceBundle lookup during counter name resolution takes a lot of time | Major | . | Todd Lipcon | Siddharth Seth |
-| [MAPREDUCE-2793](https://issues.apache.org/jira/browse/MAPREDUCE-2793) | [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs | Critical | mrv2 | Ramya Sunil | Bikas Saha |
+| [MAPREDUCE-3954](https://issues.apache.org/jira/browse/MAPREDUCE-3954) | Clean up passing HEAPSIZE to yarn and mapred commands. | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-3964](https://issues.apache.org/jira/browse/MAPREDUCE-3964) | ResourceManager does not have JVM metrics | Critical | mrv2, resourcemanager | Jason Lowe | Jason Lowe |
+| [HADOOP-8064](https://issues.apache.org/jira/browse/HADOOP-8064) | Remove unnecessary dependency on w3c.org in document processing | Major | build | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-3034](https://issues.apache.org/jira/browse/MAPREDUCE-3034) | NM should act on a REBOOT command from RM | Critical | mrv2, nodemanager | Vinod Kumar Vavilapalli | Devaraj K |
+| [HDFS-3032](https://issues.apache.org/jira/browse/HDFS-3032) | Lease renewer tries forever even if renewal is not possible | Major | hdfs-client | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-3976](https://issues.apache.org/jira/browse/MAPREDUCE-3976) | TestRMContainerAllocator failing | Major | mrv2 | Bikas Saha | Jason Lowe |
+| [HADOOP-8140](https://issues.apache.org/jira/browse/HADOOP-8140) | dfs -getmerge should process its argments better | Major | . | arkady borkovsky | Daryn Sharp |
+| [MAPREDUCE-3961](https://issues.apache.org/jira/browse/MAPREDUCE-3961) | Map/ReduceSlotMillis computation incorrect | Major | mrv2 | Siddharth Seth | Siddharth Seth |
+| [MAPREDUCE-3977](https://issues.apache.org/jira/browse/MAPREDUCE-3977) | LogAggregationService leaks log aggregator objects | Critical | mrv2, nodemanager | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-3975](https://issues.apache.org/jira/browse/MAPREDUCE-3975) | Default value not set for Configuration parameter mapreduce.job.local.dir | Blocker | mrv2 | Eric Payne | Eric Payne |
+| [HADOOP-8146](https://issues.apache.org/jira/browse/HADOOP-8146) | FsShell commands cannot be interrupted | Major | fs | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-3982](https://issues.apache.org/jira/browse/MAPREDUCE-3982) | TestEmptyJob fails with FileNotFound | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [HDFS-3101](https://issues.apache.org/jira/browse/HDFS-3101) | cannot read empty file using webhdfs | Major | webhdfs | Zhanwei Wang | Tsz Wo Nicholas Sze |
+| [HADOOP-8176](https://issues.apache.org/jira/browse/HADOOP-8176) | Disambiguate the destination of FsShell copies | Major | fs | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4005](https://issues.apache.org/jira/browse/MAPREDUCE-4005) | AM container logs URL is broken for completed apps when log aggregation is enabled | Major | mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4006](https://issues.apache.org/jira/browse/MAPREDUCE-4006) | history server container log web UI sometimes combines stderr/stdout/syslog contents together | Major | jobhistoryserver, mrv2 | Jason Lowe | Siddharth Seth |
+| [MAPREDUCE-4025](https://issues.apache.org/jira/browse/MAPREDUCE-4025) | AM can crash if task attempt reports bogus progress value | Blocker | mr-am, mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4034](https://issues.apache.org/jira/browse/MAPREDUCE-4034) | Unable to view task logs on history server with mapreduce.job.acl-view-job=\* | Blocker | mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4043](https://issues.apache.org/jira/browse/MAPREDUCE-4043) | Secret keys set in Credentials are not seen by tasks | Blocker | mrv2, security | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4061](https://issues.apache.org/jira/browse/MAPREDUCE-4061) | RM only has 1 AM launcher thread | Blocker | mrv2 | Thomas Graves | Thomas Graves |
+| [HDFS-3160](https://issues.apache.org/jira/browse/HDFS-3160) | httpfs should exec catalina instead of forking it | Major | scripts | Roman Shaposhnik | Roman Shaposhnik |
+| [HDFS-3853](https://issues.apache.org/jira/browse/HDFS-3853) | Port MiniDFSCluster enableManagedDfsDirsRedundancy option to branch-2 | Minor | namenode | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-2815](https://issues.apache.org/jira/browse/HDFS-2815) | Namenode is not coming out of safemode when we perform ( NN crash + restart ) . Also FSCK report shows blocks missed. | Critical | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
### TESTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HDFS-3104](https://issues.apache.org/jira/browse/HDFS-3104) | Add tests for mkdir -p | Major | test | Daryn Sharp | Daryn Sharp |
-| [HDFS-3098](https://issues.apache.org/jira/browse/HDFS-3098) | Update FsShell tests for quoted metachars | Major | test | Daryn Sharp | Daryn Sharp |
-| [HDFS-3060](https://issues.apache.org/jira/browse/HDFS-3060) | Bump TestDistributedUpgrade#testDistributedUpgrade timeout | Minor | test | Eli Collins | Eli Collins |
-| [HDFS-2038](https://issues.apache.org/jira/browse/HDFS-2038) | Update test to handle relative paths with globs | Critical | test | Daryn Sharp | Kihwal Lee |
| [MAPREDUCE-3877](https://issues.apache.org/jira/browse/MAPREDUCE-3877) | Add a test to formalise the current state transitions of the yarn lifecycle | Minor | mrv2 | Steve Loughran | Steve Loughran |
| [MAPREDUCE-3798](https://issues.apache.org/jira/browse/MAPREDUCE-3798) | TestJobCleanup testCustomCleanup is failing | Major | test | Ravi Prakash | Ravi Prakash |
+| [HDFS-3060](https://issues.apache.org/jira/browse/HDFS-3060) | Bump TestDistributedUpgrade#testDistributedUpgrade timeout | Minor | test | Eli Collins | Eli Collins |
+| [HDFS-2038](https://issues.apache.org/jira/browse/HDFS-2038) | Update test to handle relative paths with globs | Critical | test | Daryn Sharp | Kihwal Lee |
+| [HDFS-3098](https://issues.apache.org/jira/browse/HDFS-3098) | Update FsShell tests for quoted metachars | Major | test | Daryn Sharp | Daryn Sharp |
+| [HDFS-3104](https://issues.apache.org/jira/browse/HDFS-3104) | Add tests for mkdir -p | Major | test | Daryn Sharp | Daryn Sharp |
### SUB-TASKS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8175](https://issues.apache.org/jira/browse/HADOOP-8175) | Add mkdir -p flag | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8173](https://issues.apache.org/jira/browse/HADOOP-8173) | FsShell needs to handle quoted metachars | Major | fs | Daryn Sharp | Daryn Sharp |
| [MAPREDUCE-3944](https://issues.apache.org/jira/browse/MAPREDUCE-3944) | JobHistory web services are slower then the UI and can easly overload the JH | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [HADOOP-8173](https://issues.apache.org/jira/browse/HADOOP-8173) | FsShell needs to handle quoted metachars | Major | fs | Daryn Sharp | Daryn Sharp |
+| [HADOOP-8175](https://issues.apache.org/jira/browse/HADOOP-8175) | Add mkdir -p flag | Major | fs | Daryn Sharp | Daryn Sharp |
### OTHER:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.2/RELEASENOTES.0.23.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.2/RELEASENOTES.0.23.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.2/RELEASENOTES.0.23.2.md
index ed372ba..3f4ecc5 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.2/RELEASENOTES.0.23.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.2/RELEASENOTES.0.23.2.md
@@ -23,30 +23,30 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-8175](https://issues.apache.org/jira/browse/HADOOP-8175) | *Major* | **Add mkdir -p flag**
+* [HDFS-2887](https://issues.apache.org/jira/browse/HDFS-2887) | *Major* | **Define a FSVolume interface**
-FsShell mkdir now accepts a -p flag. Like unix, mkdir -p will not fail if the directory already exists. Unlike unix, intermediate directories are always created, regardless of the flag, to avoid incompatibilities at this time.
+FSVolume, is a part of FSDatasetInterface implementation, should not be referred outside FSDataset. A new FSVolumeInterface is defined. The BlockVolumeChoosingPolicy.chooseVolume(..) method signature is also updated.
---
-* [HADOOP-8164](https://issues.apache.org/jira/browse/HADOOP-8164) | *Major* | **Handle paths using back slash as path separator for windows only**
+* [HDFS-2950](https://issues.apache.org/jira/browse/HDFS-2950) | *Minor* | **Secondary NN HTTPS address should be listed as a NAMESERVICE\_SPECIFIC\_KEY**
-This jira only allows providing paths using back slash as separator on Windows. The back slash on \*nix system will be used as escape character. The support for paths using back slash as path separator will be removed in HADOOP-8139 in release 23.3.
+The configuration dfs.secondary.https.port has been renamed to dfs.namenode.secondary.https-port for consistency. The old configuration is still supported via a deprecation path.
---
-* [HADOOP-8131](https://issues.apache.org/jira/browse/HADOOP-8131) | *Critical* | **FsShell put doesn't correctly handle a non-existent dir**
+* [MAPREDUCE-3634](https://issues.apache.org/jira/browse/MAPREDUCE-3634) | *Major* | **All daemons should crash instead of hanging around when their EventHandlers get exceptions**
-**WARNING: No release note provided for this incompatible change.**
+Fixed all daemons to crash instead of hanging around when their EventHandlers get exceptions.
---
-* [HDFS-2950](https://issues.apache.org/jira/browse/HDFS-2950) | *Minor* | **Secondary NN HTTPS address should be listed as a NAMESERVICE\_SPECIFIC\_KEY**
+* [MAPREDUCE-3798](https://issues.apache.org/jira/browse/MAPREDUCE-3798) | *Major* | **TestJobCleanup testCustomCleanup is failing**
-The configuration dfs.secondary.https.port has been renamed to dfs.namenode.secondary.https-port for consistency. The old configuration is still supported via a deprecation path.
+Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build.
---
@@ -58,142 +58,142 @@ Add a private conf property dfs.datanode.fsdataset.factory to make FSDataset in
---
-* [HDFS-2887](https://issues.apache.org/jira/browse/HDFS-2887) | *Major* | **Define a FSVolume interface**
+* [MAPREDUCE-3738](https://issues.apache.org/jira/browse/MAPREDUCE-3738) | *Critical* | **NM can hang during shutdown if AppLogAggregatorImpl thread dies unexpectedly**
-FSVolume, is a part of FSDatasetInterface implementation, should not be referred outside FSDataset. A new FSVolumeInterface is defined. The BlockVolumeChoosingPolicy.chooseVolume(..) method signature is also updated.
+Committed to trunk and branch-0.23. Thanks Jason.
---
-* [MAPREDUCE-3982](https://issues.apache.org/jira/browse/MAPREDUCE-3982) | *Critical* | **TestEmptyJob fails with FileNotFound**
+* [MAPREDUCE-3866](https://issues.apache.org/jira/browse/MAPREDUCE-3866) | *Minor* | **bin/yarn prints the command line unnecessarily**
-Fixed FileOutputCommitter to not err out for an 'empty-job' whose tasks don't write any outputs.
+Fixed the bin/yarn script to not print the command line unnecessarily.
---
-* [MAPREDUCE-3975](https://issues.apache.org/jira/browse/MAPREDUCE-3975) | *Blocker* | **Default value not set for Configuration parameter mapreduce.job.local.dir**
+* [MAPREDUCE-3730](https://issues.apache.org/jira/browse/MAPREDUCE-3730) | *Minor* | **Allow restarted NM to rejoin cluster before RM expires it**
-Exporting mapreduce.job.local.dir for mapreduce tasks to use as job-level shared scratch space.
+Modified RM to allow restarted NMs to be able to join the cluster without waiting for expiry.
---
-* [MAPREDUCE-3954](https://issues.apache.org/jira/browse/MAPREDUCE-3954) | *Blocker* | **Clean up passing HEAPSIZE to yarn and mapred commands.**
+* [MAPREDUCE-2793](https://issues.apache.org/jira/browse/MAPREDUCE-2793) | *Critical* | **[MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs**
-Added new envs to separate heap size for different daemons started via bin scripts.
+Corrected AppIDs, JobIDs, TaskAttemptIDs to be of correct format on the web pages.
---
-* [MAPREDUCE-3931](https://issues.apache.org/jira/browse/MAPREDUCE-3931) | *Major* | **MR tasks failing due to changing timestamps on Resources to download**
+* [MAPREDUCE-3910](https://issues.apache.org/jira/browse/MAPREDUCE-3910) | *Blocker* | **user not allowed to submit jobs even though queue -showacls shows it allows**
-Changed PB implementation of LocalResource to take locks so that race conditions don't fail tasks by inadvertantly changing the timestamps.
+Fixed a bug in CapacityScheduler LeafQueue which was causing app-submission to fail.
---
-* [MAPREDUCE-3922](https://issues.apache.org/jira/browse/MAPREDUCE-3922) | *Minor* | **Fix the potential problem compiling 32 bit binaries on a x86\_64 host.**
+* [MAPREDUCE-3686](https://issues.apache.org/jira/browse/MAPREDUCE-3686) | *Critical* | **history server web ui - job counter values for map/reduce not shown properly**
-Fixed build to not compile 32bit container-executor binary by default on all platforms.
+Fixed two bugs in Counters because of which web app displays zero counter values for framework counters.
---
-* [MAPREDUCE-3920](https://issues.apache.org/jira/browse/MAPREDUCE-3920) | *Major* | **Revise yarn default port number selection**
+* [MAPREDUCE-3901](https://issues.apache.org/jira/browse/MAPREDUCE-3901) | *Major* | **lazy load JobHistory Task and TaskAttempt details**
-port number changes for resourcemanager and nodemanager
+Modified JobHistory records in YARN to lazily load job and task reports so as to improve UI response times.
---
-* [MAPREDUCE-3910](https://issues.apache.org/jira/browse/MAPREDUCE-3910) | *Blocker* | **user not allowed to submit jobs even though queue -showacls shows it allows**
+* [MAPREDUCE-2855](https://issues.apache.org/jira/browse/MAPREDUCE-2855) | *Major* | **ResourceBundle lookup during counter name resolution takes a lot of time**
-Fixed a bug in CapacityScheduler LeafQueue which was causing app-submission to fail.
+Passing a cached class-loader to ResourceBundle creator to minimize counter names lookup time.
---
-* [MAPREDUCE-3901](https://issues.apache.org/jira/browse/MAPREDUCE-3901) | *Major* | **lazy load JobHistory Task and TaskAttempt details**
+* [MAPREDUCE-3922](https://issues.apache.org/jira/browse/MAPREDUCE-3922) | *Minor* | **Fix the potential problem compiling 32 bit binaries on a x86\_64 host.**
-Modified JobHistory records in YARN to lazily load job and task reports so as to improve UI response times.
+Fixed build to not compile 32bit container-executor binary by default on all platforms.
---
-* [MAPREDUCE-3866](https://issues.apache.org/jira/browse/MAPREDUCE-3866) | *Minor* | **bin/yarn prints the command line unnecessarily**
+* [MAPREDUCE-3931](https://issues.apache.org/jira/browse/MAPREDUCE-3931) | *Major* | **MR tasks failing due to changing timestamps on Resources to download**
-Fixed the bin/yarn script to not print the command line unnecessarily.
+Changed PB implementation of LocalResource to take locks so that race conditions don't fail tasks by inadvertantly changing the timestamps.
---
-* [MAPREDUCE-3798](https://issues.apache.org/jira/browse/MAPREDUCE-3798) | *Major* | **TestJobCleanup testCustomCleanup is failing**
+* [MAPREDUCE-3920](https://issues.apache.org/jira/browse/MAPREDUCE-3920) | *Major* | **Revise yarn default port number selection**
-Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build.
+port number changes for resourcemanager and nodemanager
---
-* [MAPREDUCE-3792](https://issues.apache.org/jira/browse/MAPREDUCE-3792) | *Critical* | **job -list displays only the jobs submitted by a particular user**
+* [HADOOP-8131](https://issues.apache.org/jira/browse/HADOOP-8131) | *Critical* | **FsShell put doesn't correctly handle a non-existent dir**
-Fix "bin/mapred job -list" to display all jobs instead of only the jobs owned by the user.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-3738](https://issues.apache.org/jira/browse/MAPREDUCE-3738) | *Critical* | **NM can hang during shutdown if AppLogAggregatorImpl thread dies unexpectedly**
+* [MAPREDUCE-3792](https://issues.apache.org/jira/browse/MAPREDUCE-3792) | *Critical* | **job -list displays only the jobs submitted by a particular user**
-Committed to trunk and branch-0.23. Thanks Jason.
+Fix "bin/mapred job -list" to display all jobs instead of only the jobs owned by the user.
---
-* [MAPREDUCE-3730](https://issues.apache.org/jira/browse/MAPREDUCE-3730) | *Minor* | **Allow restarted NM to rejoin cluster before RM expires it**
+* [MAPREDUCE-3614](https://issues.apache.org/jira/browse/MAPREDUCE-3614) | *Major* | ** finalState UNDEFINED if AM is killed by hand**
-Modified RM to allow restarted NMs to be able to join the cluster without waiting for expiry.
+Fixed MR AM to close history file quickly and send a correct final state to the RM when it is killed.
---
-* [MAPREDUCE-3686](https://issues.apache.org/jira/browse/MAPREDUCE-3686) | *Critical* | **history server web ui - job counter values for map/reduce not shown properly**
+* [MAPREDUCE-3009](https://issues.apache.org/jira/browse/MAPREDUCE-3009) | *Major* | **RM UI -\> Applications -\> Application(Job History) -\> Map Tasks -\> Task ID -\> Node link is not working**
-Fixed two bugs in Counters because of which web app displays zero counter values for framework counters.
+Fixed node link on JobHistory webapp.
---
-* [MAPREDUCE-3634](https://issues.apache.org/jira/browse/MAPREDUCE-3634) | *Major* | **All daemons should crash instead of hanging around when their EventHandlers get exceptions**
+* [MAPREDUCE-3954](https://issues.apache.org/jira/browse/MAPREDUCE-3954) | *Blocker* | **Clean up passing HEAPSIZE to yarn and mapred commands.**
-Fixed all daemons to crash instead of hanging around when their EventHandlers get exceptions.
+Added new envs to separate heap size for different daemons started via bin scripts.
---
-* [MAPREDUCE-3614](https://issues.apache.org/jira/browse/MAPREDUCE-3614) | *Major* | ** finalState UNDEFINED if AM is killed by hand**
+* [MAPREDUCE-3975](https://issues.apache.org/jira/browse/MAPREDUCE-3975) | *Blocker* | **Default value not set for Configuration parameter mapreduce.job.local.dir**
-Fixed MR AM to close history file quickly and send a correct final state to the RM when it is killed.
+Exporting mapreduce.job.local.dir for mapreduce tasks to use as job-level shared scratch space.
---
-* [MAPREDUCE-3009](https://issues.apache.org/jira/browse/MAPREDUCE-3009) | *Major* | **RM UI -\> Applications -\> Application(Job History) -\> Map Tasks -\> Task ID -\> Node link is not working**
+* [MAPREDUCE-3982](https://issues.apache.org/jira/browse/MAPREDUCE-3982) | *Critical* | **TestEmptyJob fails with FileNotFound**
-Fixed node link on JobHistory webapp.
+Fixed FileOutputCommitter to not err out for an 'empty-job' whose tasks don't write any outputs.
---
-* [MAPREDUCE-2855](https://issues.apache.org/jira/browse/MAPREDUCE-2855) | *Major* | **ResourceBundle lookup during counter name resolution takes a lot of time**
+* [HADOOP-8164](https://issues.apache.org/jira/browse/HADOOP-8164) | *Major* | **Handle paths using back slash as path separator for windows only**
-Passing a cached class-loader to ResourceBundle creator to minimize counter names lookup time.
+This jira only allows providing paths using back slash as separator on Windows. The back slash on \*nix system will be used as escape character. The support for paths using back slash as path separator will be removed in HADOOP-8139 in release 23.3.
---
-* [MAPREDUCE-2793](https://issues.apache.org/jira/browse/MAPREDUCE-2793) | *Critical* | **[MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs**
+* [HADOOP-8175](https://issues.apache.org/jira/browse/HADOOP-8175) | *Major* | **Add mkdir -p flag**
-Corrected AppIDs, JobIDs, TaskAttemptIDs to be of correct format on the web pages.
+FsShell mkdir now accepts a -p flag. Like unix, mkdir -p will not fail if the directory already exists. Unlike unix, intermediate directories are always created, regardless of the flag, to avoid incompatibilities at this time.
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[03/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.4.0/RELEASENOTES.2.4.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.4.0/RELEASENOTES.2.4.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.4.0/RELEASENOTES.2.4.0.md
index a86f1e0..ea93496 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.4.0/RELEASENOTES.2.4.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.4.0/RELEASENOTES.2.4.0.md
@@ -23,102 +23,102 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-10295](https://issues.apache.org/jira/browse/HADOOP-10295) | *Major* | **Allow distcp to automatically identify the checksum type of source files and use it for the target**
+* [HDFS-5790](https://issues.apache.org/jira/browse/HDFS-5790) | *Major* | **LeaseManager.findPath is very slow when many leases need recovery**
-Add option for distcp to preserve the checksum type of the source files. Users can use "-pc" as distcp command option to preserve the checksum type.
+Committed to branch-2 and trunk.
---
-* [HADOOP-10221](https://issues.apache.org/jira/browse/HADOOP-10221) | *Major* | **Add a plugin to specify SaslProperties for RPC protocol based on connection properties**
-
-SaslPropertiesResolver or its subclass is used to resolve the QOP used for a connection. The subclass can be specified via "hadoop.security.saslproperties.resolver.class" configuration property. If not specified, the full set of values specified in hadoop.rpc.protection is used while determining the QOP used for the connection. If a class is specified, then the QOP values returned by the class will be used while determining the QOP used for the connection.
+* [HADOOP-10295](https://issues.apache.org/jira/browse/HADOOP-10295) | *Major* | **Allow distcp to automatically identify the checksum type of source files and use it for the target**
-Note that this change, effectively removes SaslRpcServer.SASL\_PROPS which was a public field. Any use of this variable should be replaced with the following code:
-SaslPropertiesResolver saslPropsResolver = SaslPropertiesResolver.getInstance(conf);
-Map\<String, String\> sasl\_props = saslPropsResolver.getDefaultProperties();
+Add option for distcp to preserve the checksum type of the source files. Users can use "-pc" as distcp command option to preserve the checksum type.
---
-* [HADOOP-10211](https://issues.apache.org/jira/browse/HADOOP-10211) | *Major* | **Enable RPC protocol to negotiate SASL-QOP values between clients and servers**
+* [HDFS-5804](https://issues.apache.org/jira/browse/HDFS-5804) | *Major* | **HDFS NFS Gateway fails to mount and proxy when using Kerberos**
-The hadoop.rpc.protection configuration property previously supported specifying a single value: one of authentication, integrity or privacy. An unrecognized value was silently assumed to mean authentication. This configuration property now accepts a comma-separated list of any of the 3 values, and unrecognized values are rejected with an error. Existing configurations containing an invalid value must be corrected. If the property is empty or not specified, authentication is assumed.
+Fixes NFS on Kerberized cluster.
---
-* [HADOOP-8691](https://issues.apache.org/jira/browse/HADOOP-8691) | *Minor* | **FsShell can print "Found xxx items" unnecessarily often**
+* [HDFS-5698](https://issues.apache.org/jira/browse/HDFS-5698) | *Major* | **Use protobuf to serialize / deserialize FSImage**
-The `ls` command only prints "Found foo items" once when listing the directories recursively.
+Use protobuf to serialize/deserialize the FSImage.
---
-* [HDFS-6102](https://issues.apache.org/jira/browse/HDFS-6102) | *Blocker* | **Lower the default maximum items per directory to fix PB fsimage loading**
+* [HDFS-4370](https://issues.apache.org/jira/browse/HDFS-4370) | *Major* | **Fix typo Blanacer in DataNode**
-**WARNING: No release note provided for this incompatible change.**
+I just committed this. Thank you Chu.
---
-* [HDFS-6055](https://issues.apache.org/jira/browse/HDFS-6055) | *Major* | **Change default configuration to limit file name length in HDFS**
+* [HDFS-5776](https://issues.apache.org/jira/browse/HDFS-5776) | *Major* | **Support 'hedged' reads in DFSClient**
-The default configuration of HDFS now sets dfs.namenode.fs-limits.max-component-length to 255 for improved interoperability with other file system implementations. This limits each component of a file system path to a maximum of 255 bytes in UTF-8 encoding. Attempts to create new files that violate this rule will fail with an error. Existing files that violate the rule are not effected. Previously, dfs.namenode.fs-limits.max-component-length was set to 0 (ignored). If necessary, it is possible to set the value back to 0 in the cluster's configuration to restore the old behavior.
+If a read from a block is slow, start up another parallel, 'hedged' read against a different block replica. We then take the result of which ever read returns first (the outstanding read is cancelled). This 'hedged' read feature will help rein in the outliers, the odd read that takes a long time because it hit a bad patch on the disc, etc.
+This feature is off by default. To enable this feature, set \<code\>dfs.client.hedged.read.threadpool.size\</code\> to a positive number. The threadpool size is how many threads to dedicate to the running of these 'hedged', concurrent reads in your client.
----
+Then set \<code\>dfs.client.hedged.read.threshold.millis\</code\> to the number of milliseconds to wait before starting up a 'hedged' read. For example, if you set this property to 10, then if a read has not returned within 10 milliseconds, we will start up a new read against a different block replica.
-* [HDFS-5804](https://issues.apache.org/jira/browse/HDFS-5804) | *Major* | **HDFS NFS Gateway fails to mount and proxy when using Kerberos**
+This feature emits new metrics:
-Fixes NFS on Kerberized cluster.
++ hedgedReadOps
++ hedgeReadOpsWin -- how many times the hedged read 'beat' the original read
++ hedgedReadOpsInCurThread -- how many times we went to do a hedged read but we had to run it in the current thread because dfs.client.hedged.read.threadpool.size was at a maximum.
---
-* [HDFS-5790](https://issues.apache.org/jira/browse/HDFS-5790) | *Major* | **LeaseManager.findPath is very slow when many leases need recovery**
+* [HADOOP-8691](https://issues.apache.org/jira/browse/HADOOP-8691) | *Minor* | **FsShell can print "Found xxx items" unnecessarily often**
-Committed to branch-2 and trunk.
+The \`ls\` command only prints "Found foo items" once when listing the directories recursively.
---
-* [HDFS-5776](https://issues.apache.org/jira/browse/HDFS-5776) | *Major* | **Support 'hedged' reads in DFSClient**
+* [HDFS-5321](https://issues.apache.org/jira/browse/HDFS-5321) | *Major* | **Clean up the HTTP-related configuration in HDFS**
-If a read from a block is slow, start up another parallel, 'hedged' read against a different block replica. We then take the result of which ever read returns first (the outstanding read is cancelled). This 'hedged' read feature will help rein in the outliers, the odd read that takes a long time because it hit a bad patch on the disc, etc.
+dfs.http.port and dfs.https.port are removed. Filesystem clients, such as WebHdfsFileSystem, now have fixed instead of configurable default ports (i.e., 50070 for http and 50470 for https).
-This feature is off by default. To enable this feature, set \<code\>dfs.client.hedged.read.threadpool.size\</code\> to a positive number. The threadpool size is how many threads to dedicate to the running of these 'hedged', concurrent reads in your client.
+Users can explicitly specify the port in the URI to access the file system which runs on non-default ports.
-Then set \<code\>dfs.client.hedged.read.threshold.millis\</code\> to the number of milliseconds to wait before starting up a 'hedged' read. For example, if you set this property to 10, then if a read has not returned within 10 milliseconds, we will start up a new read against a different block replica.
-This feature emits new metrics:
+---
-+ hedgedReadOps
-+ hedgeReadOpsWin -- how many times the hedged read 'beat' the original read
-+ hedgedReadOpsInCurThread -- how many times we went to do a hedged read but we had to run it in the current thread because dfs.client.hedged.read.threadpool.size was at a maximum.
+* [HADOOP-10211](https://issues.apache.org/jira/browse/HADOOP-10211) | *Major* | **Enable RPC protocol to negotiate SASL-QOP values between clients and servers**
+
+The hadoop.rpc.protection configuration property previously supported specifying a single value: one of authentication, integrity or privacy. An unrecognized value was silently assumed to mean authentication. This configuration property now accepts a comma-separated list of any of the 3 values, and unrecognized values are rejected with an error. Existing configurations containing an invalid value must be corrected. If the property is empty or not specified, authentication is assumed.
---
-* [HDFS-5698](https://issues.apache.org/jira/browse/HDFS-5698) | *Major* | **Use protobuf to serialize / deserialize FSImage**
+* [HDFS-6055](https://issues.apache.org/jira/browse/HDFS-6055) | *Major* | **Change default configuration to limit file name length in HDFS**
-Use protobuf to serialize/deserialize the FSImage.
+The default configuration of HDFS now sets dfs.namenode.fs-limits.max-component-length to 255 for improved interoperability with other file system implementations. This limits each component of a file system path to a maximum of 255 bytes in UTF-8 encoding. Attempts to create new files that violate this rule will fail with an error. Existing files that violate the rule are not effected. Previously, dfs.namenode.fs-limits.max-component-length was set to 0 (ignored). If necessary, it is possible to set the value back to 0 in the cluster's configuration to restore the old behavior.
---
-* [HDFS-5321](https://issues.apache.org/jira/browse/HDFS-5321) | *Major* | **Clean up the HTTP-related configuration in HDFS**
-
-dfs.http.port and dfs.https.port are removed. Filesystem clients, such as WebHdfsFileSystem, now have fixed instead of configurable default ports (i.e., 50070 for http and 50470 for https).
+* [HDFS-6102](https://issues.apache.org/jira/browse/HDFS-6102) | *Blocker* | **Lower the default maximum items per directory to fix PB fsimage loading**
-Users can explicitly specify the port in the URI to access the file system which runs on non-default ports.
+**WARNING: No release note provided for this change.**
---
-* [HDFS-5138](https://issues.apache.org/jira/browse/HDFS-5138) | *Blocker* | **Support HDFS upgrade in HA**
+* [HADOOP-10221](https://issues.apache.org/jira/browse/HADOOP-10221) | *Major* | **Add a plugin to specify SaslProperties for RPC protocol based on connection properties**
-**WARNING: No release note provided for this incompatible change.**
+SaslPropertiesResolver or its subclass is used to resolve the QOP used for a connection. The subclass can be specified via "hadoop.security.saslproperties.resolver.class" configuration property. If not specified, the full set of values specified in hadoop.rpc.protection is used while determining the QOP used for the connection. If a class is specified, then the QOP values returned by the class will be used while determining the QOP used for the connection.
+
+Note that this change, effectively removes SaslRpcServer.SASL\_PROPS which was a public field. Any use of this variable should be replaced with the following code:
+SaslPropertiesResolver saslPropsResolver = SaslPropertiesResolver.getInstance(conf);
+Map\<String, String\> sasl\_props = saslPropsResolver.getDefaultProperties();
---
@@ -130,16 +130,16 @@ HDFS now supports ACLs (Access Control Lists). ACLs can specify fine-grained fi
---
-* [HDFS-4370](https://issues.apache.org/jira/browse/HDFS-4370) | *Major* | **Fix typo Blanacer in DataNode**
+* [HDFS-5138](https://issues.apache.org/jira/browse/HDFS-5138) | *Blocker* | **Support HDFS upgrade in HA**
-I just committed this. Thank you Chu.
+**WARNING: No release note provided for this change.**
---
* [MAPREDUCE-5036](https://issues.apache.org/jira/browse/MAPREDUCE-5036) | *Major* | **Default shuffle handler port should not be 8080**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.4.1/CHANGES.2.4.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.4.1/CHANGES.2.4.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.4.1/CHANGES.2.4.1.md
index 9ad1697..c5cd5d7 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.4.1/CHANGES.2.4.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.4.1/CHANGES.2.4.1.md
@@ -20,30 +20,14 @@
## Release 2.4.1 - 2014-06-30
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10466](https://issues.apache.org/jira/browse/HADOOP-10466) | Lower the log level in UserGroupInformation | Minor | security | Nicolas Liochon | Nicolas Liochon |
| [HDFS-4052](https://issues.apache.org/jira/browse/HDFS-4052) | BlockManager#invalidateWork should print logs outside the lock | Minor | . | Jing Zhao | Jing Zhao |
+| [HADOOP-10466](https://issues.apache.org/jira/browse/HADOOP-10466) | Lower the log level in UserGroupInformation | Minor | security | Nicolas Liochon | Nicolas Liochon |
| [YARN-1892](https://issues.apache.org/jira/browse/YARN-1892) | Excessive logging in RM | Minor | scheduler | Siddharth Seth | Jian He |
@@ -51,77 +35,77 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-11273](https://issues.apache.org/jira/browse/HADOOP-11273) | TestMiniKdc failure: login options not compatible with IBM JDK | Major | test | Gao Zhong Liang | Gao Zhong Liang |
-| [HADOOP-10612](https://issues.apache.org/jira/browse/HADOOP-10612) | NFS failed to refresh the user group id mapping table | Major | nfs | Brandon Li | Brandon Li |
-| [HADOOP-10562](https://issues.apache.org/jira/browse/HADOOP-10562) | Namenode exits on exception without printing stack trace in AbstractDelegationTokenSecretManager | Critical | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-10527](https://issues.apache.org/jira/browse/HADOOP-10527) | Fix incorrect return code and allow more retries on EINTR | Major | . | Kihwal Lee | Kihwal Lee |
-| [HADOOP-10522](https://issues.apache.org/jira/browse/HADOOP-10522) | JniBasedUnixGroupMapping mishandles errors | Critical | . | Kihwal Lee | Kihwal Lee |
-| [HADOOP-10490](https://issues.apache.org/jira/browse/HADOOP-10490) | TestMapFile and TestBloomMapFile leak file descriptors. | Minor | test | Chris Nauroth | Chris Nauroth |
-| [HADOOP-10473](https://issues.apache.org/jira/browse/HADOOP-10473) | TestCallQueueManager is still flaky | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-10456](https://issues.apache.org/jira/browse/HADOOP-10456) | Bug in Configuration.java exposed by Spark (ConcurrentModificationException) | Major | conf | Nishkam Ravi | Nishkam Ravi |
+| [YARN-1883](https://issues.apache.org/jira/browse/YARN-1883) | TestRMAdminService fails due to inconsistent entries in UserGroups | Major | . | Mit Desai | Mit Desai |
| [HADOOP-10455](https://issues.apache.org/jira/browse/HADOOP-10455) | When there is an exception, ipc.Server should first check whether it is an terse exception | Major | ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-8826](https://issues.apache.org/jira/browse/HADOOP-8826) | Docs still refer to 0.20.205 as stable line | Minor | . | Robert Joseph Evans | Mit Desai |
-| [HDFS-6411](https://issues.apache.org/jira/browse/HDFS-6411) | nfs-hdfs-gateway mount raises I/O error and hangs when a unauthorized user attempts to access it | Major | nfs | Zhongyi Xie | Brandon Li |
-| [HDFS-6402](https://issues.apache.org/jira/browse/HDFS-6402) | Suppress findbugs warning for failure to override equals and hashCode in FsAclPermission. | Trivial | namenode | Chris Nauroth | Chris Nauroth |
-| [HDFS-6397](https://issues.apache.org/jira/browse/HDFS-6397) | NN shows inconsistent value in deadnode count | Critical | . | Mohammad Kamrul Islam | Mohammad Kamrul Islam |
-| [HDFS-6362](https://issues.apache.org/jira/browse/HDFS-6362) | InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID | Blocker | namenode | Arpit Agarwal | Arpit Agarwal |
-| [HDFS-6361](https://issues.apache.org/jira/browse/HDFS-6361) | TestIdUserGroup.testUserUpdateSetting failed due to out of range nfsnobody Id | Major | nfs | Yongjun Zhang | Yongjun Zhang |
-| [HDFS-6340](https://issues.apache.org/jira/browse/HDFS-6340) | DN can't finalize upgrade | Blocker | datanode | Rahul Singhal | Rahul Singhal |
-| [HDFS-6329](https://issues.apache.org/jira/browse/HDFS-6329) | WebHdfs does not work if HA is enabled on NN but logical URI is not configured. | Blocker | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-6326](https://issues.apache.org/jira/browse/HDFS-6326) | WebHdfs ACL compatibility is broken | Blocker | webhdfs | Daryn Sharp | Chris Nauroth |
-| [HDFS-6325](https://issues.apache.org/jira/browse/HDFS-6325) | Append should fail if the last block has insufficient number of replicas | Major | namenode | Konstantin Shvachko | Keith Pak |
-| [HDFS-6313](https://issues.apache.org/jira/browse/HDFS-6313) | WebHdfs may use the wrong NN when configured for multiple HA NNs | Blocker | webhdfs | Daryn Sharp | Kihwal Lee |
-| [HDFS-6245](https://issues.apache.org/jira/browse/HDFS-6245) | datanode fails to start with a bad disk even when failed volumes is set | Major | . | Arpit Gupta | Arpit Agarwal |
-| [HDFS-6236](https://issues.apache.org/jira/browse/HDFS-6236) | ImageServlet should use Time#monotonicNow to measure latency. | Minor | namenode | Chris Nauroth | Chris Nauroth |
-| [HDFS-6235](https://issues.apache.org/jira/browse/HDFS-6235) | TestFileJournalManager can fail on Windows due to file locking if tests run out of order. | Trivial | namenode, test | Chris Nauroth | Chris Nauroth |
-| [HDFS-6234](https://issues.apache.org/jira/browse/HDFS-6234) | TestDatanodeConfig#testMemlockLimit fails on Windows due to invalid file path. | Trivial | datanode, test | Chris Nauroth | Chris Nauroth |
-| [HDFS-6232](https://issues.apache.org/jira/browse/HDFS-6232) | OfflineEditsViewer throws a NPE on edits containing ACL modifications | Major | tools | Stephen Chu | Akira AJISAKA |
-| [HDFS-6231](https://issues.apache.org/jira/browse/HDFS-6231) | DFSClient hangs infinitely if using hedged reads and all eligible datanodes die. | Major | hdfs-client | Chris Nauroth | Chris Nauroth |
-| [HDFS-6229](https://issues.apache.org/jira/browse/HDFS-6229) | Race condition in failover can cause RetryCache fail to work | Major | ha | Jing Zhao | Jing Zhao |
+| [MAPREDUCE-5818](https://issues.apache.org/jira/browse/MAPREDUCE-5818) | hsadmin cmd is missing in mapred.cmd | Major | . | Jian He | Jian He |
+| [HADOOP-10456](https://issues.apache.org/jira/browse/HADOOP-10456) | Bug in Configuration.java exposed by Spark (ConcurrentModificationException) | Major | conf | Nishkam Ravi | Nishkam Ravi |
+| [YARN-1837](https://issues.apache.org/jira/browse/YARN-1837) | TestMoveApplication.testMoveRejectedByScheduler randomly fails | Major | . | Tsuyoshi Ozawa | Hong Zhiguo |
+| [HDFS-6197](https://issues.apache.org/jira/browse/HDFS-6197) | Rolling upgrade rollback on Windows can fail attempting to rename edit log segment files to a destination that already exists. | Minor | namenode | Chris Nauroth | Chris Nauroth |
+| [HDFS-6198](https://issues.apache.org/jira/browse/HDFS-6198) | DataNode rolling upgrade does not correctly identify current block pool directory and replace with trash on Windows. | Major | datanode | Chris Nauroth | Chris Nauroth |
+| [YARN-1908](https://issues.apache.org/jira/browse/YARN-1908) | Distributed shell with custom script has permission error. | Major | applications/distributed-shell | Tassapol Athiapinya | Vinod Kumar Vavilapalli |
+| [YARN-1907](https://issues.apache.org/jira/browse/YARN-1907) | TestRMApplicationHistoryWriter#testRMWritingMassiveHistory runs slow and intermittently fails | Major | . | Mit Desai | Mit Desai |
| [HDFS-6215](https://issues.apache.org/jira/browse/HDFS-6215) | Wrong error message for upgrade | Minor | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-6209](https://issues.apache.org/jira/browse/HDFS-6209) | Fix flaky test TestValidateConfigurationSettings.testThatDifferentRPCandHttpPortsAreOK | Minor | test | Arpit Agarwal | Arpit Agarwal |
-| [HDFS-6208](https://issues.apache.org/jira/browse/HDFS-6208) | DataNode caching can leak file descriptors. | Major | datanode | Chris Nauroth | Chris Nauroth |
+| [HADOOP-10473](https://issues.apache.org/jira/browse/HADOOP-10473) | TestCallQueueManager is still flaky | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HDFS-6206](https://issues.apache.org/jira/browse/HDFS-6206) | DFSUtil.substituteForWildcardAddress may throw NPE | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HDFS-6204](https://issues.apache.org/jira/browse/HDFS-6204) | TestRBWBlockInvalidation may fail | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-6198](https://issues.apache.org/jira/browse/HDFS-6198) | DataNode rolling upgrade does not correctly identify current block pool directory and replace with trash on Windows. | Major | datanode | Chris Nauroth | Chris Nauroth |
-| [HDFS-6197](https://issues.apache.org/jira/browse/HDFS-6197) | Rolling upgrade rollback on Windows can fail attempting to rename edit log segment files to a destination that already exists. | Minor | namenode | Chris Nauroth | Chris Nauroth |
-| [HDFS-2882](https://issues.apache.org/jira/browse/HDFS-2882) | DN continues to start up, even if block pool fails to initialize | Major | datanode | Todd Lipcon | Vinayakumar B |
-| [MAPREDUCE-5841](https://issues.apache.org/jira/browse/MAPREDUCE-5841) | uber job doesn't terminate on getting mapred job kill | Major | mrv2 | Sangjin Lee | Sangjin Lee |
-| [MAPREDUCE-5835](https://issues.apache.org/jira/browse/MAPREDUCE-5835) | Killing Task might cause the job to go to ERROR state | Critical | . | Ming Ma | Ming Ma |
-| [MAPREDUCE-5832](https://issues.apache.org/jira/browse/MAPREDUCE-5832) | Few tests in TestJobClient fail on Windows | Major | . | Jian He | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-5830](https://issues.apache.org/jira/browse/MAPREDUCE-5830) | HostUtil.getTaskLogUrl is not backwards binary compatible with 2.3 | Blocker | . | Jason Lowe | Akira AJISAKA |
-| [MAPREDUCE-5828](https://issues.apache.org/jira/browse/MAPREDUCE-5828) | TestMapReduceJobControl fails on JDK 7 + Windows | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-5827](https://issues.apache.org/jira/browse/MAPREDUCE-5827) | TestSpeculativeExecutionWithMRApp fails | Major | . | Zhijie Shen | Zhijie Shen |
-| [MAPREDUCE-5826](https://issues.apache.org/jira/browse/MAPREDUCE-5826) | TestHistoryServerFileSystemStateStoreService.testTokenStore fails in windows | Major | . | Varun Vasudev | Varun Vasudev |
+| [HDFS-6209](https://issues.apache.org/jira/browse/HDFS-6209) | Fix flaky test TestValidateConfigurationSettings.testThatDifferentRPCandHttpPortsAreOK | Minor | test | Arpit Agarwal | Arpit Agarwal |
+| [HDFS-6208](https://issues.apache.org/jira/browse/HDFS-6208) | DataNode caching can leak file descriptors. | Major | datanode | Chris Nauroth | Chris Nauroth |
+| [YARN-1910](https://issues.apache.org/jira/browse/YARN-1910) | TestAMRMTokens fails on windows | Major | . | Xuan Gong | Xuan Gong |
| [MAPREDUCE-5824](https://issues.apache.org/jira/browse/MAPREDUCE-5824) | TestPipesNonJavaInputFormat.testFormat fails in windows | Major | . | Xuan Gong | Xuan Gong |
-| [MAPREDUCE-5821](https://issues.apache.org/jira/browse/MAPREDUCE-5821) | IFile merge allocates new byte array for every value | Major | performance, task | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-5818](https://issues.apache.org/jira/browse/MAPREDUCE-5818) | hsadmin cmd is missing in mapred.cmd | Major | . | Jian He | Jian He |
-| [MAPREDUCE-5815](https://issues.apache.org/jira/browse/MAPREDUCE-5815) | Fix NPE in TestMRAppMaster | Blocker | client, mrv2 | Gera Shegalov | Akira AJISAKA |
-| [MAPREDUCE-5714](https://issues.apache.org/jira/browse/MAPREDUCE-5714) | TestMRAppComponentDependencies causes surefire to exit without saying proper goodbye | Major | test | Jinghui Wang | Jinghui Wang |
-| [MAPREDUCE-3191](https://issues.apache.org/jira/browse/MAPREDUCE-3191) | docs for map output compression incorrectly reference SequenceFile | Trivial | . | Todd Lipcon | Chen He |
-| [YARN-2081](https://issues.apache.org/jira/browse/YARN-2081) | TestDistributedShell fails after YARN-1962 | Minor | applications/distributed-shell | Hong Zhiguo | Hong Zhiguo |
-| [YARN-2066](https://issues.apache.org/jira/browse/YARN-2066) | Wrong field is referenced in GetApplicationsRequestPBImpl#mergeLocalToBuilder() | Minor | . | Ted Yu | Hong Zhiguo |
-| [YARN-2016](https://issues.apache.org/jira/browse/YARN-2016) | Yarn getApplicationRequest start time range is not honored | Major | resourcemanager | Venkat Ranganathan | Junping Du |
-| [YARN-1986](https://issues.apache.org/jira/browse/YARN-1986) | In Fifo Scheduler, node heartbeat in between creating app and attempt causes NPE | Critical | . | Jon Bringhurst | Hong Zhiguo |
-| [YARN-1976](https://issues.apache.org/jira/browse/YARN-1976) | Tracking url missing http protocol for FAILED application | Major | . | Yesha Vora | Junping Du |
-| [YARN-1975](https://issues.apache.org/jira/browse/YARN-1975) | Used resources shows escaped html in CapacityScheduler and FairScheduler page | Major | resourcemanager | Nathan Roberts | Mit Desai |
-| [YARN-1934](https://issues.apache.org/jira/browse/YARN-1934) | Potential NPE in ZKRMStateStore caused by handling Disconnected event from ZK. | Blocker | resourcemanager | Rohith Sharma K S | Karthik Kambatla |
-| [YARN-1933](https://issues.apache.org/jira/browse/YARN-1933) | TestAMRestart and TestNodeHealthService failing sometimes on Windows | Major | . | Jian He | Jian He |
-| [YARN-1932](https://issues.apache.org/jira/browse/YARN-1932) | Javascript injection on the job status page | Blocker | . | Mit Desai | Mit Desai |
-| [YARN-1931](https://issues.apache.org/jira/browse/YARN-1931) | Private API change in YARN-1824 in 2.4 broke compatibility with previous releases | Blocker | applications | Thomas Graves | Sandy Ryza |
-| [YARN-1929](https://issues.apache.org/jira/browse/YARN-1929) | DeadLock in RM when automatic failover is enabled. | Blocker | resourcemanager | Rohith Sharma K S | Karthik Kambatla |
-| [YARN-1928](https://issues.apache.org/jira/browse/YARN-1928) | TestAMRMRPCNodeUpdates fails ocassionally | Major | . | Zhijie Shen | Zhijie Shen |
-| [YARN-1926](https://issues.apache.org/jira/browse/YARN-1926) | DistributedShell unit tests fail on Windows | Major | . | Varun Vasudev | Varun Vasudev |
-| [YARN-1924](https://issues.apache.org/jira/browse/YARN-1924) | STATE\_STORE\_OP\_FAILED happens when ZKRMStateStore tries to update app(attempt) before storing it | Critical | . | Arpit Gupta | Jian He |
| [YARN-1920](https://issues.apache.org/jira/browse/YARN-1920) | TestFileSystemApplicationHistoryStore.testMissingApplicationAttemptHistoryData fails in windows | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
| [YARN-1914](https://issues.apache.org/jira/browse/YARN-1914) | Test TestFSDownload.testDownloadPublicWithStatCache fails on Windows | Major | . | Varun Vasudev | Varun Vasudev |
-| [YARN-1910](https://issues.apache.org/jira/browse/YARN-1910) | TestAMRMTokens fails on windows | Major | . | Xuan Gong | Xuan Gong |
-| [YARN-1908](https://issues.apache.org/jira/browse/YARN-1908) | Distributed shell with custom script has permission error. | Major | applications/distributed-shell | Tassapol Athiapinya | Vinod Kumar Vavilapalli |
-| [YARN-1907](https://issues.apache.org/jira/browse/YARN-1907) | TestRMApplicationHistoryWriter#testRMWritingMassiveHistory runs slow and intermittently fails | Major | . | Mit Desai | Mit Desai |
| [YARN-1903](https://issues.apache.org/jira/browse/YARN-1903) | Killing Container on NEW and LOCALIZING will result in exitCode and diagnostics not set | Major | . | Zhijie Shen | Zhijie Shen |
-| [YARN-1883](https://issues.apache.org/jira/browse/YARN-1883) | TestRMAdminService fails due to inconsistent entries in UserGroups | Major | . | Mit Desai | Mit Desai |
-| [YARN-1837](https://issues.apache.org/jira/browse/YARN-1837) | TestMoveApplication.testMoveRejectedByScheduler randomly fails | Major | . | Tsuyoshi Ozawa | Hong Zhiguo |
+| [YARN-1924](https://issues.apache.org/jira/browse/YARN-1924) | STATE\_STORE\_OP\_FAILED happens when ZKRMStateStore tries to update app(attempt) before storing it | Critical | . | Arpit Gupta | Jian He |
+| [MAPREDUCE-5815](https://issues.apache.org/jira/browse/MAPREDUCE-5815) | Fix NPE in TestMRAppMaster | Blocker | client, mrv2 | Gera Shegalov | Akira Ajisaka |
+| [YARN-1926](https://issues.apache.org/jira/browse/YARN-1926) | DistributedShell unit tests fail on Windows | Major | . | Varun Vasudev | Varun Vasudev |
+| [HDFS-6231](https://issues.apache.org/jira/browse/HDFS-6231) | DFSClient hangs infinitely if using hedged reads and all eligible datanodes die. | Major | hdfs-client | Chris Nauroth | Chris Nauroth |
+| [MAPREDUCE-5826](https://issues.apache.org/jira/browse/MAPREDUCE-5826) | TestHistoryServerFileSystemStateStoreService.testTokenStore fails in windows | Major | . | Varun Vasudev | Varun Vasudev |
+| [HADOOP-10490](https://issues.apache.org/jira/browse/HADOOP-10490) | TestMapFile and TestBloomMapFile leak file descriptors. | Minor | test | Chris Nauroth | Chris Nauroth |
+| [HDFS-6234](https://issues.apache.org/jira/browse/HDFS-6234) | TestDatanodeConfig#testMemlockLimit fails on Windows due to invalid file path. | Trivial | datanode, test | Chris Nauroth | Chris Nauroth |
+| [HADOOP-8826](https://issues.apache.org/jira/browse/HADOOP-8826) | Docs still refer to 0.20.205 as stable line | Minor | . | Robert Joseph Evans | Mit Desai |
+| [HDFS-6235](https://issues.apache.org/jira/browse/HDFS-6235) | TestFileJournalManager can fail on Windows due to file locking if tests run out of order. | Trivial | namenode, test | Chris Nauroth | Chris Nauroth |
+| [HDFS-6229](https://issues.apache.org/jira/browse/HDFS-6229) | Race condition in failover can cause RetryCache fail to work | Major | ha | Jing Zhao | Jing Zhao |
+| [HDFS-6232](https://issues.apache.org/jira/browse/HDFS-6232) | OfflineEditsViewer throws a NPE on edits containing ACL modifications | Major | tools | Stephen Chu | Akira Ajisaka |
+| [HDFS-6236](https://issues.apache.org/jira/browse/HDFS-6236) | ImageServlet should use Time#monotonicNow to measure latency. | Minor | namenode | Chris Nauroth | Chris Nauroth |
+| [MAPREDUCE-5828](https://issues.apache.org/jira/browse/MAPREDUCE-5828) | TestMapReduceJobControl fails on JDK 7 + Windows | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [YARN-1933](https://issues.apache.org/jira/browse/YARN-1933) | TestAMRestart and TestNodeHealthService failing sometimes on Windows | Major | . | Jian He | Jian He |
+| [YARN-1928](https://issues.apache.org/jira/browse/YARN-1928) | TestAMRMRPCNodeUpdates fails ocassionally | Major | . | Zhijie Shen | Zhijie Shen |
+| [YARN-1934](https://issues.apache.org/jira/browse/YARN-1934) | Potential NPE in ZKRMStateStore caused by handling Disconnected event from ZK. | Blocker | resourcemanager | Rohith Sharma K S | Karthik Kambatla |
+| [MAPREDUCE-3191](https://issues.apache.org/jira/browse/MAPREDUCE-3191) | docs for map output compression incorrectly reference SequenceFile | Trivial | . | Todd Lipcon | Chen He |
+| [YARN-1931](https://issues.apache.org/jira/browse/YARN-1931) | Private API change in YARN-1824 in 2.4 broke compatibility with previous releases | Blocker | applications | Thomas Graves | Sandy Ryza |
+| [YARN-1932](https://issues.apache.org/jira/browse/YARN-1932) | Javascript injection on the job status page | Blocker | . | Mit Desai | Mit Desai |
+| [HDFS-6245](https://issues.apache.org/jira/browse/HDFS-6245) | datanode fails to start with a bad disk even when failed volumes is set | Major | . | Arpit Gupta | Arpit Agarwal |
+| [HADOOP-10522](https://issues.apache.org/jira/browse/HADOOP-10522) | JniBasedUnixGroupMapping mishandles errors | Critical | . | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-5827](https://issues.apache.org/jira/browse/MAPREDUCE-5827) | TestSpeculativeExecutionWithMRApp fails | Major | . | Zhijie Shen | Zhijie Shen |
+| [MAPREDUCE-5832](https://issues.apache.org/jira/browse/MAPREDUCE-5832) | Few tests in TestJobClient fail on Windows | Major | . | Jian He | Vinod Kumar Vavilapalli |
+| [HADOOP-10527](https://issues.apache.org/jira/browse/HADOOP-10527) | Fix incorrect return code and allow more retries on EINTR | Major | . | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-5841](https://issues.apache.org/jira/browse/MAPREDUCE-5841) | uber job doesn't terminate on getting mapred job kill | Major | mrv2 | Sangjin Lee | Sangjin Lee |
+| [YARN-1975](https://issues.apache.org/jira/browse/YARN-1975) | Used resources shows escaped html in CapacityScheduler and FairScheduler page | Major | resourcemanager | Nathan Roberts | Mit Desai |
+| [MAPREDUCE-5835](https://issues.apache.org/jira/browse/MAPREDUCE-5835) | Killing Task might cause the job to go to ERROR state | Critical | . | Ming Ma | Ming Ma |
+| [MAPREDUCE-5714](https://issues.apache.org/jira/browse/MAPREDUCE-5714) | TestMRAppComponentDependencies causes surefire to exit without saying proper goodbye | Major | test | Jinghui Wang | Jinghui Wang |
+| [HDFS-2882](https://issues.apache.org/jira/browse/HDFS-2882) | DN continues to start up, even if block pool fails to initialize | Major | datanode | Todd Lipcon | Vinayakumar B |
+| [YARN-1929](https://issues.apache.org/jira/browse/YARN-1929) | DeadLock in RM when automatic failover is enabled. | Blocker | resourcemanager | Rohith Sharma K S | Karthik Kambatla |
| [YARN-1201](https://issues.apache.org/jira/browse/YARN-1201) | TestAMAuthorization fails with local hostname cannot be resolved | Minor | resourcemanager | Nemon Lou | Wangda Tan |
+| [HADOOP-10562](https://issues.apache.org/jira/browse/HADOOP-10562) | Namenode exits on exception without printing stack trace in AbstractDelegationTokenSecretManager | Critical | . | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-6340](https://issues.apache.org/jira/browse/HDFS-6340) | DN can't finalize upgrade | Blocker | datanode | Rahul Singhal | Rahul Singhal |
+| [HDFS-6329](https://issues.apache.org/jira/browse/HDFS-6329) | WebHdfs does not work if HA is enabled on NN but logical URI is not configured. | Blocker | . | Kihwal Lee | Kihwal Lee |
+| [HDFS-6313](https://issues.apache.org/jira/browse/HDFS-6313) | WebHdfs may use the wrong NN when configured for multiple HA NNs | Blocker | webhdfs | Daryn Sharp | Kihwal Lee |
+| [YARN-1976](https://issues.apache.org/jira/browse/YARN-1976) | Tracking url missing http protocol for FAILED application | Major | . | Yesha Vora | Junping Du |
+| [YARN-2016](https://issues.apache.org/jira/browse/YARN-2016) | Yarn getApplicationRequest start time range is not honored | Major | resourcemanager | Venkat Ranganathan | Junping Du |
+| [YARN-1986](https://issues.apache.org/jira/browse/YARN-1986) | In Fifo Scheduler, node heartbeat in between creating app and attempt causes NPE | Critical | . | Jon Bringhurst | Hong Zhiguo |
+| [MAPREDUCE-5821](https://issues.apache.org/jira/browse/MAPREDUCE-5821) | IFile merge allocates new byte array for every value | Major | performance, task | Todd Lipcon | Todd Lipcon |
+| [HDFS-6326](https://issues.apache.org/jira/browse/HDFS-6326) | WebHdfs ACL compatibility is broken | Blocker | webhdfs | Daryn Sharp | Chris Nauroth |
+| [HDFS-6361](https://issues.apache.org/jira/browse/HDFS-6361) | TestIdUserGroup.testUserUpdateSetting failed due to out of range nfsnobody Id | Major | nfs | Yongjun Zhang | Yongjun Zhang |
+| [HDFS-6362](https://issues.apache.org/jira/browse/HDFS-6362) | InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID | Blocker | namenode | Arpit Agarwal | Arpit Agarwal |
+| [HDFS-6402](https://issues.apache.org/jira/browse/HDFS-6402) | Suppress findbugs warning for failure to override equals and hashCode in FsAclPermission. | Trivial | namenode | Chris Nauroth | Chris Nauroth |
+| [YARN-2066](https://issues.apache.org/jira/browse/YARN-2066) | Wrong field is referenced in GetApplicationsRequestPBImpl#mergeLocalToBuilder() | Minor | . | Ted Yu | Hong Zhiguo |
+| [HDFS-6325](https://issues.apache.org/jira/browse/HDFS-6325) | Append should fail if the last block has insufficient number of replicas | Major | namenode | Konstantin Shvachko | Keith Pak |
+| [HDFS-6397](https://issues.apache.org/jira/browse/HDFS-6397) | NN shows inconsistent value in deadnode count | Critical | . | Mohammad Kamrul Islam | Mohammad Kamrul Islam |
+| [HADOOP-10612](https://issues.apache.org/jira/browse/HADOOP-10612) | NFS failed to refresh the user group id mapping table | Major | nfs | Brandon Li | Brandon Li |
+| [YARN-2081](https://issues.apache.org/jira/browse/YARN-2081) | TestDistributedShell fails after YARN-1962 | Minor | applications/distributed-shell | Hong Zhiguo | Hong Zhiguo |
+| [HDFS-6411](https://issues.apache.org/jira/browse/HDFS-6411) | nfs-hdfs-gateway mount raises I/O error and hangs when a unauthorized user attempts to access it | Major | nfs | Zhongyi Xie | Brandon Li |
+| [MAPREDUCE-5830](https://issues.apache.org/jira/browse/MAPREDUCE-5830) | HostUtil.getTaskLogUrl is not backwards binary compatible with 2.3 | Blocker | . | Jason Lowe | Akira Ajisaka |
+| [HADOOP-11273](https://issues.apache.org/jira/browse/HADOOP-11273) | TestMiniKdc failure: login options not compatible with IBM JDK | Major | test | Gao Zhong Liang | Gao Zhong Liang |
### TESTS:
@@ -129,30 +113,24 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
| [HDFS-6189](https://issues.apache.org/jira/browse/HDFS-6189) | Multiple HDFS tests fail on Windows attempting to use a test root path containing a colon. | Major | test | Chris Nauroth | Chris Nauroth |
-| [MAPREDUCE-5843](https://issues.apache.org/jira/browse/MAPREDUCE-5843) | TestMRKeyValueTextInputFormat failing on Windows | Major | . | Varun Vasudev | Varun Vasudev |
-| [MAPREDUCE-5833](https://issues.apache.org/jira/browse/MAPREDUCE-5833) | TestRMContainerAllocator fails ocassionally | Major | . | Zhijie Shen | Zhijie Shen |
-| [YARN-1947](https://issues.apache.org/jira/browse/YARN-1947) | TestRMDelegationTokens#testRMDTMasterKeyStateOnRollingMasterKey is failing intermittently | Major | . | Jian He | Jian He |
| [YARN-1905](https://issues.apache.org/jira/browse/YARN-1905) | TestProcfsBasedProcessTree must only run on Linux. | Trivial | nodemanager | Chris Nauroth | Chris Nauroth |
| [YARN-1750](https://issues.apache.org/jira/browse/YARN-1750) | TestNodeStatusUpdater#testNMRegistration is incorrect in test case | Major | nodemanager | Ming Ma | Wangda Tan |
+| [YARN-1947](https://issues.apache.org/jira/browse/YARN-1947) | TestRMDelegationTokens#testRMDTMasterKeyStateOnRollingMasterKey is failing intermittently | Major | . | Jian He | Jian He |
| [YARN-1281](https://issues.apache.org/jira/browse/YARN-1281) | TestZKRMStateStoreZKClientConnections fails intermittently | Major | resourcemanager | Karthik Kambatla | Tsuyoshi Ozawa |
+| [MAPREDUCE-5833](https://issues.apache.org/jira/browse/MAPREDUCE-5833) | TestRMContainerAllocator fails ocassionally | Major | . | Zhijie Shen | Zhijie Shen |
+| [MAPREDUCE-5843](https://issues.apache.org/jira/browse/MAPREDUCE-5843) | TestMRKeyValueTextInputFormat failing on Windows | Major | . | Varun Vasudev | Varun Vasudev |
### SUB-TASKS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [YARN-2053](https://issues.apache.org/jira/browse/YARN-2053) | Slider AM fails to restart: NPE in RegisterApplicationMasterResponseProto$Builder.addAllNmTokensFromPreviousAttempts | Major | resourcemanager | Sumit Mohanty | Wangda Tan |
+| [YARN-1696](https://issues.apache.org/jira/browse/YARN-1696) | Document RM HA | Blocker | resourcemanager | Karthik Kambatla | Tsuyoshi Ozawa |
+| [YARN-1701](https://issues.apache.org/jira/browse/YARN-1701) | Improve default paths of timeline store and generic history store | Major | . | Gera Shegalov | Tsuyoshi Ozawa |
| [YARN-1962](https://issues.apache.org/jira/browse/YARN-1962) | Timeline server is enabled by default | Major | . | Mohammad Kamrul Islam | Mohammad Kamrul Islam |
+| [YARN-1861](https://issues.apache.org/jira/browse/YARN-1861) | Both RM stuck in standby mode when automatic failover is enabled | Blocker | resourcemanager | Arpit Gupta | Karthik Kambatla |
| [YARN-1957](https://issues.apache.org/jira/browse/YARN-1957) | ProportionalCapacitPreemptionPolicy handling of corner cases... | Major | resourcemanager | Carlo Curino | Carlo Curino |
+| [YARN-2053](https://issues.apache.org/jira/browse/YARN-2053) | Slider AM fails to restart: NPE in RegisterApplicationMasterResponseProto$Builder.addAllNmTokensFromPreviousAttempts | Major | resourcemanager | Sumit Mohanty | Wangda Tan |
| [YARN-1898](https://issues.apache.org/jira/browse/YARN-1898) | Standby RM's conf, stacks, logLevel, metrics, jmx and logs links are redirecting to Active RM | Major | resourcemanager | Yesha Vora | Xuan Gong |
-| [YARN-1861](https://issues.apache.org/jira/browse/YARN-1861) | Both RM stuck in standby mode when automatic failover is enabled | Blocker | resourcemanager | Arpit Gupta | Karthik Kambatla |
-| [YARN-1701](https://issues.apache.org/jira/browse/YARN-1701) | Improve default paths of timeline store and generic history store | Major | . | Gera Shegalov | Tsuyoshi Ozawa |
-| [YARN-1696](https://issues.apache.org/jira/browse/YARN-1696) | Document RM HA | Blocker | resourcemanager | Karthik Kambatla | Tsuyoshi Ozawa |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[44/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.0/CHANGES.0.18.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.0/CHANGES.0.18.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.0/CHANGES.0.18.0.md
index 202f434..d5cc886 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.0/CHANGES.0.18.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.0/CHANGES.0.18.0.md
@@ -24,299 +24,293 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-3837](https://issues.apache.org/jira/browse/HADOOP-3837) | hadop streaming does not use progress reporting to detect hung tasks | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-3808](https://issues.apache.org/jira/browse/HADOOP-3808) | [HOD] Include job tracker RPC in notes attribute after job submission | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-3703](https://issues.apache.org/jira/browse/HADOOP-3703) | [HOD] logcondense needs to use the new pattern of output in hadoop dfs -lsr | Blocker | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-| [HADOOP-3683](https://issues.apache.org/jira/browse/HADOOP-3683) | Hadoop dfs metric FilesListed shows number of files listed instead of operations | Major | metrics | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3665](https://issues.apache.org/jira/browse/HADOOP-3665) | WritableComparator newKey() fails for NullWritable | Minor | io | Lukas Vlcek | Chris Douglas |
-| [HADOOP-3610](https://issues.apache.org/jira/browse/HADOOP-3610) | [HOD] HOD does not automatically create a cluster directory for the script option | Blocker | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-| [HADOOP-3598](https://issues.apache.org/jira/browse/HADOOP-3598) | Map-Reduce framework needlessly creates temporary \_${taskid} directories for Maps | Blocker | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-3569](https://issues.apache.org/jira/browse/HADOOP-3569) | KFS input stream read() returns 4 bytes instead of 1 | Minor | . | Sriram Rao | Sriram Rao |
-| [HADOOP-3512](https://issues.apache.org/jira/browse/HADOOP-3512) | Split map/reduce tools into separate jars | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-3486](https://issues.apache.org/jira/browse/HADOOP-3486) | Change default for initial block report to 0 sec and document it in hadoop-defaults.xml | Major | . | Sanjay Radia | Sanjay Radia |
-| [HADOOP-3483](https://issues.apache.org/jira/browse/HADOOP-3483) | [HOD] Improvements with cluster directory handling | Major | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-3459](https://issues.apache.org/jira/browse/HADOOP-3459) | Change dfs -ls listing to closely match format on Linux | Major | . | Mukund Madhugiri | Mukund Madhugiri |
-| [HADOOP-3452](https://issues.apache.org/jira/browse/HADOOP-3452) | fsck exit code would be better if non-zero when FS corrupt | Minor | . | Pete Wyckoff | Lohit Vijayarenu |
-| [HADOOP-3417](https://issues.apache.org/jira/browse/HADOOP-3417) | JobClient should not have a static configuration for cli parsing | Major | . | Owen O'Malley | Amareshwari Sriramadasu |
-| [HADOOP-3405](https://issues.apache.org/jira/browse/HADOOP-3405) | Make mapred internal classes package-local | Major | . | Enis Soztutar | Enis Soztutar |
-| [HADOOP-3390](https://issues.apache.org/jira/browse/HADOOP-3390) | Remove deprecated ClientProtocol.abandonFileInProgress() | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3379](https://issues.apache.org/jira/browse/HADOOP-3379) | Document the "stream.non.zero.exit.status.is.failure" knob for streaming | Blocker | documentation | Arun C Murthy | Amareshwari Sriramadasu |
-| [HADOOP-3329](https://issues.apache.org/jira/browse/HADOOP-3329) | DatanodeDescriptor objects stored in FSImage may be out dated. | Major | . | Tsz Wo Nicholas Sze | dhruba borthakur |
-| [HADOOP-3317](https://issues.apache.org/jira/browse/HADOOP-3317) | add default port for hdfs namenode | Minor | . | Doug Cutting | Doug Cutting |
-| [HADOOP-3310](https://issues.apache.org/jira/browse/HADOOP-3310) | Lease recovery for append | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3283](https://issues.apache.org/jira/browse/HADOOP-3283) | Need a mechanism for data nodes to update generation stamps. | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3265](https://issues.apache.org/jira/browse/HADOOP-3265) | Remove deprecated API getFileCacheHints | Major | fs | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3226](https://issues.apache.org/jira/browse/HADOOP-3226) | Run combiner when merging spills from map output | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-3193](https://issues.apache.org/jira/browse/HADOOP-3193) | Discovery of corrupt block reported in name node log | Minor | . | Robert Chansler | Chris Douglas |
-| [HADOOP-3184](https://issues.apache.org/jira/browse/HADOOP-3184) | HOD gracefully exclude "bad" nodes during ring formation | Major | contrib/hod | Marco Nicosia | Hemanth Yamijala |
-| [HADOOP-3113](https://issues.apache.org/jira/browse/HADOOP-3113) | DFSOututStream.flush() should flush data to real block file on DataNode. | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-3095](https://issues.apache.org/jira/browse/HADOOP-3095) | Validating input paths and creating splits is slow on S3 | Major | fs, fs/s3 | Tom White | Tom White |
-| [HADOOP-3035](https://issues.apache.org/jira/browse/HADOOP-3035) | Data nodes should inform the name-node about block crc errors. | Major | . | Konstantin Shvachko | Lohit Vijayarenu |
-| [HADOOP-2909](https://issues.apache.org/jira/browse/HADOOP-2909) | Improve IPC idle connection management | Major | ipc | Hairong Kuang | Hairong Kuang |
+| [HADOOP-2585](https://issues.apache.org/jira/browse/HADOOP-2585) | Automatic namespace recovery from the secondary image. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-2703](https://issues.apache.org/jira/browse/HADOOP-2703) | New files under lease (before close) still shows up as MISSING files/blocks in fsck | Minor | . | Koji Noguchi | Lohit Vijayarenu |
| [HADOOP-2865](https://issues.apache.org/jira/browse/HADOOP-2865) | FsShell.ls() should print file attributes first then the path name. | Major | . | Konstantin Shvachko | Edward J. Yoon |
+| [HADOOP-3283](https://issues.apache.org/jira/browse/HADOOP-3283) | Need a mechanism for data nodes to update generation stamps. | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-2797](https://issues.apache.org/jira/browse/HADOOP-2797) | Withdraw CRC upgrade from HDFS | Critical | . | Robert Chansler | Raghu Angadi |
-| [HADOOP-2703](https://issues.apache.org/jira/browse/HADOOP-2703) | New files under lease (before close) still shows up as MISSING files/blocks in fsck | Minor | . | Koji Noguchi | Lohit Vijayarenu |
-| [HADOOP-2656](https://issues.apache.org/jira/browse/HADOOP-2656) | Support for upgrading existing cluster to facilitate appends to HDFS files | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-2585](https://issues.apache.org/jira/browse/HADOOP-2585) | Automatic namespace recovery from the secondary image. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-544](https://issues.apache.org/jira/browse/HADOOP-544) | Replace the job, tip and task ids with objects. | Major | . | Owen O'Malley | Enis Soztutar |
| [HADOOP-2188](https://issues.apache.org/jira/browse/HADOOP-2188) | RPC should send a ping rather than use client timeouts | Major | ipc | Owen O'Malley | Hairong Kuang |
| [HADOOP-2181](https://issues.apache.org/jira/browse/HADOOP-2181) | Input Split details for maps should be logged | Minor | . | Lohit Vijayarenu | Amareshwari Sriramadasu |
+| [HADOOP-3317](https://issues.apache.org/jira/browse/HADOOP-3317) | add default port for hdfs namenode | Minor | . | Doug Cutting | Doug Cutting |
+| [HADOOP-3226](https://issues.apache.org/jira/browse/HADOOP-3226) | Run combiner when merging spills from map output | Major | . | Chris Douglas | Chris Douglas |
+| [HADOOP-3329](https://issues.apache.org/jira/browse/HADOOP-3329) | DatanodeDescriptor objects stored in FSImage may be out dated. | Major | . | Tsz Wo Nicholas Sze | dhruba borthakur |
| [HADOOP-2065](https://issues.apache.org/jira/browse/HADOOP-2065) | Replication policy for corrupted block | Major | . | Koji Noguchi | Lohit Vijayarenu |
| [HADOOP-1702](https://issues.apache.org/jira/browse/HADOOP-1702) | Reduce buffer copies when data is written to DFS | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-544](https://issues.apache.org/jira/browse/HADOOP-544) | Replace the job, tip and task ids with objects. | Major | . | Owen O'Malley | Enis Soztutar |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-2656](https://issues.apache.org/jira/browse/HADOOP-2656) | Support for upgrading existing cluster to facilitate appends to HDFS files | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-3390](https://issues.apache.org/jira/browse/HADOOP-3390) | Remove deprecated ClientProtocol.abandonFileInProgress() | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3405](https://issues.apache.org/jira/browse/HADOOP-3405) | Make mapred internal classes package-local | Major | . | Enis Soztutar | Enis Soztutar |
+| [HADOOP-3035](https://issues.apache.org/jira/browse/HADOOP-3035) | Data nodes should inform the name-node about block crc errors. | Major | . | Konstantin Shvachko | Lohit Vijayarenu |
+| [HADOOP-3265](https://issues.apache.org/jira/browse/HADOOP-3265) | Remove deprecated API getFileCacheHints | Major | fs | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3310](https://issues.apache.org/jira/browse/HADOOP-3310) | Lease recovery for append | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3417](https://issues.apache.org/jira/browse/HADOOP-3417) | JobClient should not have a static configuration for cli parsing | Major | . | Owen O'Malley | Amareshwari Sriramadasu |
+| [HADOOP-2909](https://issues.apache.org/jira/browse/HADOOP-2909) | Improve IPC idle connection management | Major | ipc | Hairong Kuang | Hairong Kuang |
+| [HADOOP-3486](https://issues.apache.org/jira/browse/HADOOP-3486) | Change default for initial block report to 0 sec and document it in hadoop-defaults.xml | Major | . | Sanjay Radia | Sanjay Radia |
+| [HADOOP-3459](https://issues.apache.org/jira/browse/HADOOP-3459) | Change dfs -ls listing to closely match format on Linux | Major | . | Mukund Madhugiri | Mukund Madhugiri |
+| [HADOOP-3113](https://issues.apache.org/jira/browse/HADOOP-3113) | DFSOututStream.flush() should flush data to real block file on DataNode. | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-3452](https://issues.apache.org/jira/browse/HADOOP-3452) | fsck exit code would be better if non-zero when FS corrupt | Minor | . | Pete Wyckoff | Lohit Vijayarenu |
+| [HADOOP-3095](https://issues.apache.org/jira/browse/HADOOP-3095) | Validating input paths and creating splits is slow on S3 | Major | fs, fs/s3 | Tom White | Tom White |
+| [HADOOP-3483](https://issues.apache.org/jira/browse/HADOOP-3483) | [HOD] Improvements with cluster directory handling | Major | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-3184](https://issues.apache.org/jira/browse/HADOOP-3184) | HOD gracefully exclude "bad" nodes during ring formation | Major | contrib/hod | Marco Nicosia | Hemanth Yamijala |
+| [HADOOP-3193](https://issues.apache.org/jira/browse/HADOOP-3193) | Discovery of corrupt block reported in name node log | Minor | . | Robert Chansler | Chris Douglas |
+| [HADOOP-3512](https://issues.apache.org/jira/browse/HADOOP-3512) | Split map/reduce tools into separate jars | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-3379](https://issues.apache.org/jira/browse/HADOOP-3379) | Document the "stream.non.zero.exit.status.is.failure" knob for streaming | Blocker | documentation | Arun C Murthy | Amareshwari Sriramadasu |
+| [HADOOP-3569](https://issues.apache.org/jira/browse/HADOOP-3569) | KFS input stream read() returns 4 bytes instead of 1 | Minor | . | Sriram Rao | Sriram Rao |
+| [HADOOP-3598](https://issues.apache.org/jira/browse/HADOOP-3598) | Map-Reduce framework needlessly creates temporary \_${taskid} directories for Maps | Blocker | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-3610](https://issues.apache.org/jira/browse/HADOOP-3610) | [HOD] HOD does not automatically create a cluster directory for the script option | Blocker | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-3665](https://issues.apache.org/jira/browse/HADOOP-3665) | WritableComparator newKey() fails for NullWritable | Minor | io | Lukas Vlcek | Chris Douglas |
+| [HADOOP-3683](https://issues.apache.org/jira/browse/HADOOP-3683) | Hadoop dfs metric FilesListed shows number of files listed instead of operations | Major | metrics | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3703](https://issues.apache.org/jira/browse/HADOOP-3703) | [HOD] logcondense needs to use the new pattern of output in hadoop dfs -lsr | Blocker | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-3808](https://issues.apache.org/jira/browse/HADOOP-3808) | [HOD] Include job tracker RPC in notes attribute after job submission | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-3837](https://issues.apache.org/jira/browse/HADOOP-3837) | hadop streaming does not use progress reporting to detect hung tasks | Major | . | dhruba borthakur | dhruba borthakur |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-3502](https://issues.apache.org/jira/browse/HADOOP-3502) | Quota API needs documentation in Forrest | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-3460](https://issues.apache.org/jira/browse/HADOOP-3460) | SequenceFileAsBinaryOutputFormat | Minor | . | Koji Noguchi | Koji Noguchi |
-| [HADOOP-3336](https://issues.apache.org/jira/browse/HADOOP-3336) | Direct a subset of namenode RPC events for audit logging | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-3307](https://issues.apache.org/jira/browse/HADOOP-3307) | Archives in Hadoop. | Major | fs | Mahadev konar | Mahadev konar |
-| [HADOOP-3250](https://issues.apache.org/jira/browse/HADOOP-3250) | Extend FileSystem API to allow appending to files | Major | fs | dhruba borthakur | Tsz Wo Nicholas Sze |
-| [HADOOP-3246](https://issues.apache.org/jira/browse/HADOOP-3246) | FTP client over HDFS | Major | util | Ankur | Ankur |
-| [HADOOP-3230](https://issues.apache.org/jira/browse/HADOOP-3230) | Add command line access to named counters | Major | scripts | Tom White | Tom White |
-| [HADOOP-3221](https://issues.apache.org/jira/browse/HADOOP-3221) | Need a "LineBasedTextInputFormat" | Major | . | Milind Bhandarkar | Amareshwari Sriramadasu |
-| [HADOOP-3188](https://issues.apache.org/jira/browse/HADOOP-3188) | compaction utility for directories | Major | . | Robert Chansler | Robert Chansler |
-| [HADOOP-3187](https://issues.apache.org/jira/browse/HADOOP-3187) | Quotas for name space management | Major | . | Robert Chansler | Hairong Kuang |
| [HADOOP-3074](https://issues.apache.org/jira/browse/HADOOP-3074) | URLStreamHandler for the DFS | Major | util | Christophe Taton | Christophe Taton |
| [HADOOP-3061](https://issues.apache.org/jira/browse/HADOOP-3061) | Writable for single byte and double | Major | io | Andrzej Bialecki | Andrzej Bialecki |
-| [HADOOP-3022](https://issues.apache.org/jira/browse/HADOOP-3022) | Fast Cluster Restart | Major | . | Robert Chansler | Konstantin Shvachko |
+| [HADOOP-3221](https://issues.apache.org/jira/browse/HADOOP-3221) | Need a "LineBasedTextInputFormat" | Major | . | Milind Bhandarkar | Amareshwari Sriramadasu |
+| [HADOOP-3336](https://issues.apache.org/jira/browse/HADOOP-3336) | Direct a subset of namenode RPC events for audit logging | Major | . | Chris Douglas | Chris Douglas |
| [HADOOP-1915](https://issues.apache.org/jira/browse/HADOOP-1915) | adding counters methods using String (as opposed to Enum) | Minor | . | Alejandro Abdelnur | Tom White |
+| [HADOOP-3246](https://issues.apache.org/jira/browse/HADOOP-3246) | FTP client over HDFS | Major | util | Ankur | Ankur |
+| [HADOOP-3250](https://issues.apache.org/jira/browse/HADOOP-3250) | Extend FileSystem API to allow appending to files | Major | fs | dhruba borthakur | Tsz Wo Nicholas Sze |
| [HADOOP-1328](https://issues.apache.org/jira/browse/HADOOP-1328) | Hadoop Streaming needs to provide a way for the stream plugin to update global counters | Major | . | Runping Qi | Tom White |
+| [HADOOP-3187](https://issues.apache.org/jira/browse/HADOOP-3187) | Quotas for name space management | Major | . | Robert Chansler | Hairong Kuang |
+| [HADOOP-3307](https://issues.apache.org/jira/browse/HADOOP-3307) | Archives in Hadoop. | Major | fs | Mahadev konar | Mahadev konar |
+| [HADOOP-3460](https://issues.apache.org/jira/browse/HADOOP-3460) | SequenceFileAsBinaryOutputFormat | Minor | . | Koji Noguchi | Koji Noguchi |
+| [HADOOP-3230](https://issues.apache.org/jira/browse/HADOOP-3230) | Add command line access to named counters | Major | scripts | Tom White | Tom White |
| [HADOOP-930](https://issues.apache.org/jira/browse/HADOOP-930) | Add support for reading regular (non-block-based) files from S3 in S3FileSystem | Major | fs | Tom White | Tom White |
+| [HADOOP-3022](https://issues.apache.org/jira/browse/HADOOP-3022) | Fast Cluster Restart | Major | . | Robert Chansler | Konstantin Shvachko |
+| [HADOOP-3502](https://issues.apache.org/jira/browse/HADOOP-3502) | Quota API needs documentation in Forrest | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-3188](https://issues.apache.org/jira/browse/HADOOP-3188) | compaction utility for directories | Major | . | Robert Chansler | Robert Chansler |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-3599](https://issues.apache.org/jira/browse/HADOOP-3599) | The new setCombineOnceOnly shouldn't take a JobConf, since it is a method on JobConf | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-3572](https://issues.apache.org/jira/browse/HADOOP-3572) | setQuotas usage interface has some minor bugs. | Minor | . | Mahadev konar | Hairong Kuang |
-| [HADOOP-3547](https://issues.apache.org/jira/browse/HADOOP-3547) | Improve documentation about distributing native libraries via DistributedCache | Blocker | documentation | Arun C Murthy | Amareshwari Sriramadasu |
-| [HADOOP-3535](https://issues.apache.org/jira/browse/HADOOP-3535) | IOUtils.close needs better documentation | Blocker | io | Owen O'Malley | Owen O'Malley |
-| [HADOOP-3532](https://issues.apache.org/jira/browse/HADOOP-3532) | Create build targets to create api change reports using jdiff | Major | build | Owen O'Malley | Owen O'Malley |
-| [HADOOP-3501](https://issues.apache.org/jira/browse/HADOOP-3501) | deprecate InMemoryFileSystem | Major | fs | Doug Cutting | Doug Cutting |
-| [HADOOP-3492](https://issues.apache.org/jira/browse/HADOOP-3492) | add forrest documentation for user archives | Blocker | . | Mahadev konar | Mahadev konar |
-| [HADOOP-3467](https://issues.apache.org/jira/browse/HADOOP-3467) | The javadoc for FileSystem.deleteOnExit should have more description | Blocker | documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3464](https://issues.apache.org/jira/browse/HADOOP-3464) | [HOD] HOD can improve error messages by reporting failures on compute nodes back to hod client | Major | contrib/hod | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [HADOOP-3455](https://issues.apache.org/jira/browse/HADOOP-3455) | IPC.Client synchronisation looks weak | Major | ipc | Steve Loughran | Hairong Kuang |
-| [HADOOP-3448](https://issues.apache.org/jira/browse/HADOOP-3448) | Add some more hints of the problem when datanode and namenode don't match | Minor | . | Steve Loughran | Steve Loughran |
-| [HADOOP-3434](https://issues.apache.org/jira/browse/HADOOP-3434) | Retain cause of bind failure in Server.bind | Major | . | Steve Loughran | Steve Loughran |
-| [HADOOP-3429](https://issues.apache.org/jira/browse/HADOOP-3429) | Increase the buffersize for the streaming parent java process's streams | Major | . | Devaraj Das | Amareshwari Sriramadasu |
-| [HADOOP-3406](https://issues.apache.org/jira/browse/HADOOP-3406) | Document controls for profiling maps & reduces | Blocker | documentation | Arun C Murthy | Amareshwari Sriramadasu |
-| [HADOOP-3400](https://issues.apache.org/jira/browse/HADOOP-3400) | Facilitate creation of temporary files in HDFS | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-3398](https://issues.apache.org/jira/browse/HADOOP-3398) | ReduceTask::closestPowerOf2 is inefficient | Trivial | . | Chris Douglas | Chris Douglas |
-| [HADOOP-3377](https://issues.apache.org/jira/browse/HADOOP-3377) | Use StringUtils#replaceAll instead of | Trivial | . | Brice Arnould | Brice Arnould |
-| [HADOOP-3369](https://issues.apache.org/jira/browse/HADOOP-3369) | Fast block processing during name-node startup. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-3366](https://issues.apache.org/jira/browse/HADOOP-3366) | Shuffle/Merge improvements | Major | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-3364](https://issues.apache.org/jira/browse/HADOOP-3364) | Faster image and log edits loading. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-3355](https://issues.apache.org/jira/browse/HADOOP-3355) | Configuration should accept decimal and hexadecimal values | Major | conf | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-3350](https://issues.apache.org/jira/browse/HADOOP-3350) | distcp should permit users to limit the number of maps | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-3345](https://issues.apache.org/jira/browse/HADOOP-3345) | Enhance the hudson-test-patch target | Minor | build | Nigel Daley | Nigel Daley |
-| [HADOOP-3334](https://issues.apache.org/jira/browse/HADOOP-3334) | Move lease handling codes out from FSNamesystem | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3332](https://issues.apache.org/jira/browse/HADOOP-3332) | improving the logging during shuffling | Blocker | . | Runping Qi | Devaraj Das |
-| [HADOOP-3308](https://issues.apache.org/jira/browse/HADOOP-3308) | Improve QuickSort by excluding values eq the pivot from the partition | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-3297](https://issues.apache.org/jira/browse/HADOOP-3297) | The way in which ReduceTask/TaskTracker gets completion events during shuffle can be improved | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-3295](https://issues.apache.org/jira/browse/HADOOP-3295) | Allow TextOutputFormat to use configurable separators | Minor | io | Zheng Shao | Zheng Shao |
-| [HADOOP-3277](https://issues.apache.org/jira/browse/HADOOP-3277) | hod should better errors message when deallocate is fired on non allocated directory. | Minor | contrib/hod | Karam Singh | |
+| [HADOOP-3254](https://issues.apache.org/jira/browse/HADOOP-3254) | FSNamesystem.gotHeartbeat(..., Object[] xferResults, Object[] deleteList) should not use Object[] as pass-by-reference parameters | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-3274](https://issues.apache.org/jira/browse/HADOOP-3274) | The default constructor of BytesWritable should not create a 100-byte array. | Minor | io | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-2910](https://issues.apache.org/jira/browse/HADOOP-2910) | Throttle IPC Client/Server during bursts of requests or server slowdown | Major | ipc | Hairong Kuang | Hairong Kuang |
| [HADOOP-3270](https://issues.apache.org/jira/browse/HADOOP-3270) | Constant DatanodeCommand should be stored in static fianl immutable variables. | Minor | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3254](https://issues.apache.org/jira/browse/HADOOP-3254) | FSNamesystem.gotHeartbeat(..., Object[] xferResults, Object[] deleteList) should not use Object[] as pass-by-reference parameters | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3177](https://issues.apache.org/jira/browse/HADOOP-3177) | Expose DFSOutputStream.fsync API though the FileSystem interface | Major | . | dhruba borthakur | Tsz Wo Nicholas Sze |
| [HADOOP-3164](https://issues.apache.org/jira/browse/HADOOP-3164) | Use FileChannel.transferTo() when data is read from DataNode. | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-3295](https://issues.apache.org/jira/browse/HADOOP-3295) | Allow TextOutputFormat to use configurable separators | Minor | io | Zheng Shao | Zheng Shao |
+| [HADOOP-3308](https://issues.apache.org/jira/browse/HADOOP-3308) | Improve QuickSort by excluding values eq the pivot from the partition | Major | . | Chris Douglas | Chris Douglas |
+| [HADOOP-2857](https://issues.apache.org/jira/browse/HADOOP-2857) | libhdfs: no way to set JVM args other than classpath | Minor | . | Craig Macdonald | Craig Macdonald |
+| [HADOOP-2461](https://issues.apache.org/jira/browse/HADOOP-2461) | Configuration should trim property names and accept decimal, hexadecimal, and octal numbers | Minor | conf | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-2799](https://issues.apache.org/jira/browse/HADOOP-2799) | Replace org.apache.hadoop.io.Closeable with java.io.Closeable | Minor | io | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3345](https://issues.apache.org/jira/browse/HADOOP-3345) | Enhance the hudson-test-patch target | Minor | build | Nigel Daley | Nigel Daley |
| [HADOOP-3144](https://issues.apache.org/jira/browse/HADOOP-3144) | better fault tolerance for corrupted text files | Major | . | Joydeep Sen Sarma | Zheng Shao |
-| [HADOOP-3096](https://issues.apache.org/jira/browse/HADOOP-3096) | Improve documentation about the Task Execution Environment in the Map-Reduce tutorial | Blocker | documentation | Arun C Murthy | Amareshwari Sriramadasu |
+| [HADOOP-3334](https://issues.apache.org/jira/browse/HADOOP-3334) | Move lease handling codes out from FSNamesystem | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-2019](https://issues.apache.org/jira/browse/HADOOP-2019) | DistributedFileCache should support .tgz files in addition to jars and zip files | Major | . | Owen O'Malley | Amareshwari Sriramadasu |
| [HADOOP-3058](https://issues.apache.org/jira/browse/HADOOP-3058) | Hadoop DFS to report more replication metrics | Minor | metrics | Marco Nicosia | Lohit Vijayarenu |
+| [HADOOP-3297](https://issues.apache.org/jira/browse/HADOOP-3297) | The way in which ReduceTask/TaskTracker gets completion events during shuffle can be improved | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-3364](https://issues.apache.org/jira/browse/HADOOP-3364) | Faster image and log edits loading. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-3369](https://issues.apache.org/jira/browse/HADOOP-3369) | Fast block processing during name-node startup. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-2154](https://issues.apache.org/jira/browse/HADOOP-2154) | Non-interleaved checksums would optimize block transfers. | Major | . | Konstantin Shvachko | Raghu Angadi |
+| [HADOOP-3332](https://issues.apache.org/jira/browse/HADOOP-3332) | improving the logging during shuffling | Blocker | . | Runping Qi | Devaraj Das |
+| [HADOOP-3355](https://issues.apache.org/jira/browse/HADOOP-3355) | Configuration should accept decimal and hexadecimal values | Major | conf | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-3350](https://issues.apache.org/jira/browse/HADOOP-3350) | distcp should permit users to limit the number of maps | Major | . | Chris Douglas | Chris Douglas |
| [HADOOP-3013](https://issues.apache.org/jira/browse/HADOOP-3013) | fsck to show (checksum) corrupted files | Major | . | Koji Noguchi | Lohit Vijayarenu |
-| [HADOOP-2987](https://issues.apache.org/jira/browse/HADOOP-2987) | Keep two generations of fsimage | Major | . | Robert Chansler | Konstantin Shvachko |
-| [HADOOP-2910](https://issues.apache.org/jira/browse/HADOOP-2910) | Throttle IPC Client/Server during bursts of requests or server slowdown | Major | ipc | Hairong Kuang | Hairong Kuang |
-| [HADOOP-2867](https://issues.apache.org/jira/browse/HADOOP-2867) | Add a task's cwd to it's LD\_LIBRARY\_PATH | Major | . | Arun C Murthy | Amareshwari Sriramadasu |
-| [HADOOP-2857](https://issues.apache.org/jira/browse/HADOOP-2857) | libhdfs: no way to set JVM args other than classpath | Minor | . | Craig Macdonald | Craig Macdonald |
-| [HADOOP-2799](https://issues.apache.org/jira/browse/HADOOP-2799) | Replace org.apache.hadoop.io.Closeable with java.io.Closeable | Minor | io | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-2762](https://issues.apache.org/jira/browse/HADOOP-2762) | Better documentation of controls for memory limits on hadoop daemons and Map-Reduce tasks | Blocker | documentation, scripts | Arun C Murthy | Amareshwari Sriramadasu |
+| [HADOOP-3377](https://issues.apache.org/jira/browse/HADOOP-3377) | Use StringUtils#replaceAll instead of | Trivial | . | Brice Arnould | Brice Arnould |
| [HADOOP-2661](https://issues.apache.org/jira/browse/HADOOP-2661) | Replicator log should include block id | Minor | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-2461](https://issues.apache.org/jira/browse/HADOOP-2461) | Configuration should trim property names and accept decimal, hexadecimal, and octal numbers | Minor | conf | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-2154](https://issues.apache.org/jira/browse/HADOOP-2154) | Non-interleaved checksums would optimize block transfers. | Major | . | Konstantin Shvachko | Raghu Angadi |
-| [HADOOP-2019](https://issues.apache.org/jira/browse/HADOOP-2019) | DistributedFileCache should support .tgz files in addition to jars and zip files | Major | . | Owen O'Malley | Amareshwari Sriramadasu |
+| [HADOOP-3398](https://issues.apache.org/jira/browse/HADOOP-3398) | ReduceTask::closestPowerOf2 is inefficient | Trivial | . | Chris Douglas | Chris Douglas |
+| [HADOOP-2867](https://issues.apache.org/jira/browse/HADOOP-2867) | Add a task's cwd to it's LD\_LIBRARY\_PATH | Major | . | Arun C Murthy | Amareshwari Sriramadasu |
+| [HADOOP-3400](https://issues.apache.org/jira/browse/HADOOP-3400) | Facilitate creation of temporary files in HDFS | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-4](https://issues.apache.org/jira/browse/HADOOP-4) | tool to mount dfs on linux | Major | . | John Xing | Pete Wyckoff |
+| [HADOOP-3434](https://issues.apache.org/jira/browse/HADOOP-3434) | Retain cause of bind failure in Server.bind | Major | . | Steve Loughran | Steve Loughran |
+| [HADOOP-3429](https://issues.apache.org/jira/browse/HADOOP-3429) | Increase the buffersize for the streaming parent java process's streams | Major | . | Devaraj Das | Amareshwari Sriramadasu |
+| [HADOOP-3448](https://issues.apache.org/jira/browse/HADOOP-3448) | Add some more hints of the problem when datanode and namenode don't match | Minor | . | Steve Loughran | Steve Loughran |
+| [HADOOP-3177](https://issues.apache.org/jira/browse/HADOOP-3177) | Expose DFSOutputStream.fsync API though the FileSystem interface | Major | . | dhruba borthakur | Tsz Wo Nicholas Sze |
+| [HADOOP-3464](https://issues.apache.org/jira/browse/HADOOP-3464) | [HOD] HOD can improve error messages by reporting failures on compute nodes back to hod client | Major | contrib/hod | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [HADOOP-3455](https://issues.apache.org/jira/browse/HADOOP-3455) | IPC.Client synchronisation looks weak | Major | ipc | Steve Loughran | Hairong Kuang |
+| [HADOOP-3501](https://issues.apache.org/jira/browse/HADOOP-3501) | deprecate InMemoryFileSystem | Major | fs | Doug Cutting | Doug Cutting |
+| [HADOOP-3366](https://issues.apache.org/jira/browse/HADOOP-3366) | Shuffle/Merge improvements | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-3492](https://issues.apache.org/jira/browse/HADOOP-3492) | add forrest documentation for user archives | Blocker | . | Mahadev konar | Mahadev konar |
+| [HADOOP-3467](https://issues.apache.org/jira/browse/HADOOP-3467) | The javadoc for FileSystem.deleteOnExit should have more description | Blocker | documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3096](https://issues.apache.org/jira/browse/HADOOP-3096) | Improve documentation about the Task Execution Environment in the Map-Reduce tutorial | Blocker | documentation | Arun C Murthy | Amareshwari Sriramadasu |
+| [HADOOP-3406](https://issues.apache.org/jira/browse/HADOOP-3406) | Document controls for profiling maps & reduces | Blocker | documentation | Arun C Murthy | Amareshwari Sriramadasu |
+| [HADOOP-3277](https://issues.apache.org/jira/browse/HADOOP-3277) | hod should better errors message when deallocate is fired on non allocated directory. | Minor | contrib/hod | Karam Singh | |
+| [HADOOP-2762](https://issues.apache.org/jira/browse/HADOOP-2762) | Better documentation of controls for memory limits on hadoop daemons and Map-Reduce tasks | Blocker | documentation, scripts | Arun C Murthy | Amareshwari Sriramadasu |
+| [HADOOP-3535](https://issues.apache.org/jira/browse/HADOOP-3535) | IOUtils.close needs better documentation | Blocker | io | Owen O'Malley | Owen O'Malley |
+| [HADOOP-3599](https://issues.apache.org/jira/browse/HADOOP-3599) | The new setCombineOnceOnly shouldn't take a JobConf, since it is a method on JobConf | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-3547](https://issues.apache.org/jira/browse/HADOOP-3547) | Improve documentation about distributing native libraries via DistributedCache | Blocker | documentation | Arun C Murthy | Amareshwari Sriramadasu |
+| [HADOOP-3532](https://issues.apache.org/jira/browse/HADOOP-3532) | Create build targets to create api change reports using jdiff | Major | build | Owen O'Malley | Owen O'Malley |
+| [HADOOP-3572](https://issues.apache.org/jira/browse/HADOOP-3572) | setQuotas usage interface has some minor bugs. | Minor | . | Mahadev konar | Hairong Kuang |
+| [HADOOP-2987](https://issues.apache.org/jira/browse/HADOOP-2987) | Keep two generations of fsimage | Major | . | Robert Chansler | Konstantin Shvachko |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-3947](https://issues.apache.org/jira/browse/HADOOP-3947) | TaskTrackers fail to connect back upon a re-init action | Blocker | . | Amar Kamat | Amareshwari Sriramadasu |
-| [HADOOP-3901](https://issues.apache.org/jira/browse/HADOOP-3901) | CLASSPATH in bin/hadoop script is set incorrectly for cygwin | Blocker | scripts | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3897](https://issues.apache.org/jira/browse/HADOOP-3897) | SecondaryNameNode fails with NullPointerException | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3884](https://issues.apache.org/jira/browse/HADOOP-3884) | eclipse plugin build is broken with current eclipse versions | Blocker | contrib/eclipse-plugin | Doug Cutting | Doug Cutting |
-| [HADOOP-3865](https://issues.apache.org/jira/browse/HADOOP-3865) | SecondaryNameNode runs out of memory | Blocker | . | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3855](https://issues.apache.org/jira/browse/HADOOP-3855) | Fix import of MiniDFSCluster in TestCompressedEmptyMapOutputs.java | Blocker | test | Arun C Murthy | Arun C Murthy |
-| [HADOOP-3827](https://issues.apache.org/jira/browse/HADOOP-3827) | Jobs with empty map-outputs and intermediate compression fail | Blocker | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-3806](https://issues.apache.org/jira/browse/HADOOP-3806) | Remove debug message from Quicksort | Trivial | . | Chris Douglas | |
-| [HADOOP-3798](https://issues.apache.org/jira/browse/HADOOP-3798) | compile-core-test fails to compile | Blocker | build | Mukund Madhugiri | Mukund Madhugiri |
-| [HADOOP-3794](https://issues.apache.org/jira/browse/HADOOP-3794) | KFS implementation needs to return directory modification time | Minor | . | Sriram Rao | Sriram Rao |
-| [HADOOP-3776](https://issues.apache.org/jira/browse/HADOOP-3776) | NPE in NameNode with unknown blocks | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-3774](https://issues.apache.org/jira/browse/HADOOP-3774) | Typos in shell output | Blocker | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3762](https://issues.apache.org/jira/browse/HADOOP-3762) | Task tracker died due to OOM | Blocker | . | Runping Qi | Doug Cutting |
-| [HADOOP-3755](https://issues.apache.org/jira/browse/HADOOP-3755) | the gridmix scripts do not work with hod 0.4 | Major | . | Runping Qi | Runping Qi |
-| [HADOOP-3752](https://issues.apache.org/jira/browse/HADOOP-3752) | Audit logging fails to record rename | Blocker | . | Chris Douglas | Chris Douglas |
-| [HADOOP-3743](https://issues.apache.org/jira/browse/HADOOP-3743) | -libjars, -files and -archives options do not work with 0.18 | Blocker | . | Mahadev konar | Amareshwari Sriramadasu |
-| [HADOOP-3737](https://issues.apache.org/jira/browse/HADOOP-3737) | CompressedWritable throws OutOfMemoryError | Major | io | Grant Glouser | Grant Glouser |
-| [HADOOP-3724](https://issues.apache.org/jira/browse/HADOOP-3724) | Namenode does not start due to exception throw while saving Image | Blocker | . | Lohit Vijayarenu | dhruba borthakur |
-| [HADOOP-3718](https://issues.apache.org/jira/browse/HADOOP-3718) | KFS: write(int v) API writes out an integer rather than a byte | Minor | . | Sriram Rao | Sriram Rao |
-| [HADOOP-3716](https://issues.apache.org/jira/browse/HADOOP-3716) | KFS listStatus() returns NULL on empty directories | Minor | . | Sriram Rao | Sriram Rao |
-| [HADOOP-3706](https://issues.apache.org/jira/browse/HADOOP-3706) | CompositeInputFormat: Unable to wrap custom InputFormats | Major | . | Jingkei Ly | Jingkei Ly |
-| [HADOOP-3693](https://issues.apache.org/jira/browse/HADOOP-3693) | Fix documentation for Archives, distcp and native libraries | Blocker | documentation | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-3692](https://issues.apache.org/jira/browse/HADOOP-3692) | Fix documentation for Cluster setup and Quick start guides | Blocker | documentation | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-3691](https://issues.apache.org/jira/browse/HADOOP-3691) | Fix mapred docs | Blocker | documentation | Amareshwari Sriramadasu | Jothi Padmanabhan |
-| [HADOOP-3688](https://issues.apache.org/jira/browse/HADOOP-3688) | Fix up HDFS docs | Blocker | . | Robert Chansler | Robert Chansler |
-| [HADOOP-3677](https://issues.apache.org/jira/browse/HADOOP-3677) | Problems with generation stamp upgrade | Blocker | . | Konstantin Shvachko | Raghu Angadi |
-| [HADOOP-3673](https://issues.apache.org/jira/browse/HADOOP-3673) | Deadlock in Datanode RPC servers | Blocker | . | dhruba borthakur | Tsz Wo Nicholas Sze |
-| [HADOOP-3670](https://issues.apache.org/jira/browse/HADOOP-3670) | JobTracker running out of heap space | Blocker | . | Christian Kunz | Amareshwari Sriramadasu |
-| [HADOOP-3668](https://issues.apache.org/jira/browse/HADOOP-3668) | Clean up HOD documentation | Blocker | contrib/hod | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [HADOOP-3653](https://issues.apache.org/jira/browse/HADOOP-3653) | test-patch target not working on hudson.zones.apache.org due to HADOOP-3480 | Blocker | . | Nigel Daley | Brice Arnould |
-| [HADOOP-3649](https://issues.apache.org/jira/browse/HADOOP-3649) | ArrayIndexOutOfBounds in FSNamesystem.getBlockLocationsInternal | Blocker | . | Arun C Murthy | Lohit Vijayarenu |
-| [HADOOP-3647](https://issues.apache.org/jira/browse/HADOOP-3647) | Corner-case in IFile leads to failed tasks | Blocker | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-3645](https://issues.apache.org/jira/browse/HADOOP-3645) | MetricsTimeVaryingRate returns wrong value for metric\_avg\_time | Blocker | metrics | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3639](https://issues.apache.org/jira/browse/HADOOP-3639) | Exception when closing DFSClient while multiple files are open | Blocker | . | Benjamin Gufler | Benjamin Gufler |
-| [HADOOP-3635](https://issues.apache.org/jira/browse/HADOOP-3635) | Uncaught exception in DataBlockScanner | Blocker | . | Koji Noguchi | Tsz Wo Nicholas Sze |
-| [HADOOP-3630](https://issues.apache.org/jira/browse/HADOOP-3630) | CompositeRecordReader: key and values can be in uninitialized state if files being joined have no records | Major | . | Jingkei Ly | Chris Douglas |
-| [HADOOP-3615](https://issues.apache.org/jira/browse/HADOOP-3615) | DatanodeProtocol.versionID should be 16L | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3606](https://issues.apache.org/jira/browse/HADOOP-3606) | Update streaming documentation | Blocker | documentation | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-3604](https://issues.apache.org/jira/browse/HADOOP-3604) | Reduce stuck at shuffling phase | Blocker | . | Runping Qi | Arun C Murthy |
-| [HADOOP-3603](https://issues.apache.org/jira/browse/HADOOP-3603) | Setting spill threshold to 100% fails to detect spill for records | Blocker | . | Chris Douglas | Chris Douglas |
-| [HADOOP-3597](https://issues.apache.org/jira/browse/HADOOP-3597) | SortValidator always uses the default file system irrespective of the actual input | Major | test | Jothi Padmanabhan | Jothi Padmanabhan |
-| [HADOOP-3593](https://issues.apache.org/jira/browse/HADOOP-3593) | Update MapRed tutorial | Blocker | documentation | Devaraj Das | Devaraj Das |
-| [HADOOP-3590](https://issues.apache.org/jira/browse/HADOOP-3590) | Null pointer exception in JobTracker when the task tracker is not yet resolved | Blocker | . | Amar Kamat | Amar Kamat |
-| [HADOOP-3588](https://issues.apache.org/jira/browse/HADOOP-3588) | Bug report for archives | Blocker | . | Hairong Kuang | Mahadev konar |
-| [HADOOP-3586](https://issues.apache.org/jira/browse/HADOOP-3586) | keep combiner backward compatible with earlier versions of hadoop | Blocker | . | Olga Natkovich | Chris Douglas |
-| [HADOOP-3580](https://issues.apache.org/jira/browse/HADOOP-3580) | Using a har file as input for the Sort example fails | Blocker | . | Jothi Padmanabhan | Mahadev konar |
-| [HADOOP-3576](https://issues.apache.org/jira/browse/HADOOP-3576) | hadoop dfs -mv throws NullPointerException | Blocker | . | Lohit Vijayarenu | Tsz Wo Nicholas Sze |
-| [HADOOP-3575](https://issues.apache.org/jira/browse/HADOOP-3575) | clover target broken after src restructuring | Minor | build | Nigel Daley | Nigel Daley |
-| [HADOOP-3571](https://issues.apache.org/jira/browse/HADOOP-3571) | ArrayIndexOutOfBoundsException in BlocksMap$BlockInfo.setPrevious | Blocker | . | Tsz Wo Nicholas Sze | Konstantin Shvachko |
-| [HADOOP-3564](https://issues.apache.org/jira/browse/HADOOP-3564) | Sometime after successful hod allocation datanode fails to come up with java.net.BindException for dfs.datanode.ipc.address | Blocker | contrib/hod | Karam Singh | Vinod Kumar Vavilapalli |
-| [HADOOP-3561](https://issues.apache.org/jira/browse/HADOOP-3561) | With trash enabled, 'hadoop fs -rmr .' still fully deletes the working dir | Blocker | . | Chris Douglas | Chris Douglas |
-| [HADOOP-3560](https://issues.apache.org/jira/browse/HADOOP-3560) | Archvies sometimes create empty part files. | Blocker | . | Mahadev konar | Mahadev konar |
-| [HADOOP-3559](https://issues.apache.org/jira/browse/HADOOP-3559) | test-libhdfs fails on linux | Blocker | . | Mukund Madhugiri | Lohit Vijayarenu |
-| [HADOOP-3552](https://issues.apache.org/jira/browse/HADOOP-3552) | forrest doc for hadoop commands | Blocker | documentation | Sharad Agarwal | Sharad Agarwal |
-| [HADOOP-3548](https://issues.apache.org/jira/browse/HADOOP-3548) | The tools.jar is not included in the distribution | Blocker | build | Owen O'Malley | Owen O'Malley |
-| [HADOOP-3546](https://issues.apache.org/jira/browse/HADOOP-3546) | TaskTracker re-initialization gets stuck in cleaning up | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-3545](https://issues.apache.org/jira/browse/HADOOP-3545) | archive is failing with "Illegal Capacity" error | Blocker | . | Jothi Padmanabhan | Mahadev konar |
-| [HADOOP-3544](https://issues.apache.org/jira/browse/HADOOP-3544) | The command "archive" is missing in the example in docs/hadoop\_archives.html (and pdf) | Blocker | documentation | Jothi Padmanabhan | Jothi Padmanabhan |
-| [HADOOP-3542](https://issues.apache.org/jira/browse/HADOOP-3542) | Hadoop archives should not create \_logs file in the final archive directory. | Blocker | . | Mahadev konar | Mahadev konar |
-| [HADOOP-3539](https://issues.apache.org/jira/browse/HADOOP-3539) | Cygwin: cygpath displays an error message in running bin/hadoop script | Blocker | scripts | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3537](https://issues.apache.org/jira/browse/HADOOP-3537) | Datanode not starting up with java.lang.StringIndexOutOfBoundsException in NetworkTopology.remove | Blocker | . | Koji Noguchi | Hairong Kuang |
-| [HADOOP-3534](https://issues.apache.org/jira/browse/HADOOP-3534) | The namenode ignores ioexceptions in close | Blocker | . | Owen O'Malley | Tsz Wo Nicholas Sze |
-| [HADOOP-3533](https://issues.apache.org/jira/browse/HADOOP-3533) | The api to JobTracker and TaskTracker have changed incompatibly | Blocker | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-3531](https://issues.apache.org/jira/browse/HADOOP-3531) | Hod does not report job tracker failure on hod client side when job tracker fails to come up | Blocker | contrib/hod | Karam Singh | Hemanth Yamijala |
-| [HADOOP-3528](https://issues.apache.org/jira/browse/HADOOP-3528) | Metrics FilesCreated and files\_deleted metrics do not match. | Blocker | metrics | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3523](https://issues.apache.org/jira/browse/HADOOP-3523) | [HOD] If a job does not exist in Torque's list of jobs, HOD allocate on previously allocated directory fails. | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-3521](https://issues.apache.org/jira/browse/HADOOP-3521) | Hadoop mapreduce task metrics, unable to send metrics data. | Blocker | . | Eric Yang | Arun C Murthy |
-| [HADOOP-3520](https://issues.apache.org/jira/browse/HADOOP-3520) | Generation stamp upgrade fails TestDFSUpgradeFromImage | Blocker | . | Konstantin Shvachko | dhruba borthakur |
-| [HADOOP-3519](https://issues.apache.org/jira/browse/HADOOP-3519) | NPE in DFS FileSystem rename | Blocker | . | Tom White | Hairong Kuang |
-| [HADOOP-3517](https://issues.apache.org/jira/browse/HADOOP-3517) | The last InMemory merge may be missed | Blocker | . | Devaraj Das | Arun C Murthy |
-| [HADOOP-3516](https://issues.apache.org/jira/browse/HADOOP-3516) | TestHarFileSystem.testArchives fails with NullPointerException | Blocker | test | Nigel Daley | Subru Krishnan |
-| [HADOOP-3513](https://issues.apache.org/jira/browse/HADOOP-3513) | Improve NNThroughputBenchmark log messages. | Major | test | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-3511](https://issues.apache.org/jira/browse/HADOOP-3511) | Namenode should not restore the root's quota if the quota was not in the image | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-3509](https://issues.apache.org/jira/browse/HADOOP-3509) | FSNamesystem.close() throws NullPointerException | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3505](https://issues.apache.org/jira/browse/HADOOP-3505) | omissions in HOD documentation | Blocker | contrib/hod, documentation | Ari Rabkin | Vinod Kumar Vavilapalli |
-| [HADOOP-3503](https://issues.apache.org/jira/browse/HADOOP-3503) | Race condition when client and namenode start block recovery simultaneously | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-3496](https://issues.apache.org/jira/browse/HADOOP-3496) | TestHarFileSystem.testArchives fails | Blocker | fs | Amareshwari Sriramadasu | Tom White |
-| [HADOOP-3493](https://issues.apache.org/jira/browse/HADOOP-3493) | TestStreamingFailure fails. | Major | . | Amareshwari Sriramadasu | Lohit Vijayarenu |
-| [HADOOP-3491](https://issues.apache.org/jira/browse/HADOOP-3491) | Name-node shutdown causes InterruptedException in ResolutionMonitor | Major | . | Konstantin Shvachko | Lohit Vijayarenu |
-| [HADOOP-3489](https://issues.apache.org/jira/browse/HADOOP-3489) | NPE in SafeModeMonitor | Major | . | Konstantin Shvachko | Lohit Vijayarenu |
-| [HADOOP-3487](https://issues.apache.org/jira/browse/HADOOP-3487) | Balancer should not allocate a thread per block move | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-3480](https://issues.apache.org/jira/browse/HADOOP-3480) | Need to update Eclipse template to reflect current trunk | Blocker | build | Tsz Wo Nicholas Sze | Brice Arnould |
-| [HADOOP-3476](https://issues.apache.org/jira/browse/HADOOP-3476) | Code cleanup needed in fuse-dfs | Major | . | Tsz Wo Nicholas Sze | Pete Wyckoff |
-| [HADOOP-3471](https://issues.apache.org/jira/browse/HADOOP-3471) | TestIndexedSort sometimes fails | Major | test | Chris Douglas | Chris Douglas |
-| [HADOOP-3468](https://issues.apache.org/jira/browse/HADOOP-3468) | Compile error: FTPFileSystem.java:26: cannot access org.apache.commons.net.ftp.FTP | Blocker | fs | Tsz Wo Nicholas Sze | Ankur |
-| [HADOOP-3463](https://issues.apache.org/jira/browse/HADOOP-3463) | hadoop scripts don't change directory to hadoop\_home | Critical | scripts | Owen O'Malley | Owen O'Malley |
-| [HADOOP-3454](https://issues.apache.org/jira/browse/HADOOP-3454) | Text.find incorrectly searches beyond the end of the buffer | Major | . | Chad Whipkey | Chad Whipkey |
-| [HADOOP-3453](https://issues.apache.org/jira/browse/HADOOP-3453) | ipc.Client.close() throws NullPointerException | Major | ipc | Tsz Wo Nicholas Sze | Hairong Kuang |
-| [HADOOP-3451](https://issues.apache.org/jira/browse/HADOOP-3451) | test-libhdfs fails on Linux | Blocker | test | Mukund Madhugiri | Lohit Vijayarenu |
-| [HADOOP-3443](https://issues.apache.org/jira/browse/HADOOP-3443) | map outputs should not be renamed between partitions | Critical | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-3440](https://issues.apache.org/jira/browse/HADOOP-3440) | TaskRunner creates a symlink with name 'null' if a file is added to DistributedCache without fragment | Minor | . | Abhijit Bagri | Devaraj Das |
-| [HADOOP-3435](https://issues.apache.org/jira/browse/HADOOP-3435) | test-patch fail if sh != bash | Major | . | Brice Arnould | Brice Arnould |
-| [HADOOP-3427](https://issues.apache.org/jira/browse/HADOOP-3427) | In ReduceTask::fetchOutputs, wait for result can be improved slightly | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-3424](https://issues.apache.org/jira/browse/HADOOP-3424) | the value returned from getPartition should be checked to make sure it is in the range 0..#reduces-1 | Major | . | Owen O'Malley | Chris Douglas |
-| [HADOOP-3419](https://issues.apache.org/jira/browse/HADOOP-3419) | TestFsck fails once in a while on WINDOWS/LINUX | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3418](https://issues.apache.org/jira/browse/HADOOP-3418) | NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted. | Blocker | . | Raghu Angadi | Tsz Wo Nicholas Sze |
-| [HADOOP-3413](https://issues.apache.org/jira/browse/HADOOP-3413) | SequenceFile.Reader doesn't use the Serialization framework | Critical | io | Arun C Murthy | Tom White |
-| [HADOOP-3410](https://issues.apache.org/jira/browse/HADOOP-3410) | KFS implementation needs to return file modification time | Minor | . | Sriram Rao | Sriram Rao |
-| [HADOOP-3409](https://issues.apache.org/jira/browse/HADOOP-3409) | NameNode should save the root inode into fsimage | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-3408](https://issues.apache.org/jira/browse/HADOOP-3408) | Change FSNamesytem status metrics to IntValue | Major | metrics | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3403](https://issues.apache.org/jira/browse/HADOOP-3403) | Job tracker's ExpireTackers thread gets NullPointerException if a tasktracker is lost. | Blocker | . | Amareshwari Sriramadasu | Arun C Murthy |
-| [HADOOP-3401](https://issues.apache.org/jira/browse/HADOOP-3401) | Update FileBench to use the "work" directory for SequenceFileOutputFormat | Major | test | Chris Douglas | Chris Douglas |
-| [HADOOP-3399](https://issues.apache.org/jira/browse/HADOOP-3399) | Debug log not removed in ipc client | Trivial | ipc | Raghu Angadi | Raghu Angadi |
-| [HADOOP-3396](https://issues.apache.org/jira/browse/HADOOP-3396) | Unit test TestDatanodeBlockScanner fails on Windows | Critical | . | Mukund Madhugiri | Lohit Vijayarenu |
-| [HADOOP-3393](https://issues.apache.org/jira/browse/HADOOP-3393) | TestHDFSServerPorts fails on LINUX (NFS mounted directory) and on WINDOWS | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3391](https://issues.apache.org/jira/browse/HADOOP-3391) | HADOOP-3248 introduced a findbugs warning. | Minor | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-3388](https://issues.apache.org/jira/browse/HADOOP-3388) | TestDatanodeBlockScanner failed while trying to corrupt replicas | Major | test | dhruba borthakur | dhruba borthakur |
-| [HADOOP-3381](https://issues.apache.org/jira/browse/HADOOP-3381) | INode interlinks can multiply effect of memory leaks | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-3376](https://issues.apache.org/jira/browse/HADOOP-3376) | [HOD] HOD should have a way to detect and deal with clusters that violate/exceed resource manager limits | Major | contrib/hod | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [HADOOP-3375](https://issues.apache.org/jira/browse/HADOOP-3375) | Lease paths are sometimes not removed from LeaseManager.sortedLeasesByPath | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3371](https://issues.apache.org/jira/browse/HADOOP-3371) | MBeanUtil dumps stacktrace from registerMBean | Minor | metrics | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3365](https://issues.apache.org/jira/browse/HADOOP-3365) | SequenceFile.Sorter.MergeQueue.next does an unnecessary copy of the key | Major | io | Arun C Murthy | Devaraj Das |
-| [HADOOP-3363](https://issues.apache.org/jira/browse/HADOOP-3363) | HDFS throws a InconsistentFSStateException when the name node starts up on a directory that isnt formatted | Blocker | . | Steve Loughran | Konstantin Shvachko |
-| [HADOOP-3351](https://issues.apache.org/jira/browse/HADOOP-3351) | Fix history viewer | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-3349](https://issues.apache.org/jira/browse/HADOOP-3349) | FSNamesystem.changeLease(src, dst) incorrectly updates the paths inside a lease | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3348](https://issues.apache.org/jira/browse/HADOOP-3348) | TestUrlStreamHandler hangs on LINUX | Major | fs | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3340](https://issues.apache.org/jira/browse/HADOOP-3340) | hadoop dfs metrics shows 0 | Major | metrics | Eric Yang | Lohit Vijayarenu |
-| [HADOOP-3339](https://issues.apache.org/jira/browse/HADOOP-3339) | DFS Write pipeline does not detect defective datanode correctly if it times out. | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-3338](https://issues.apache.org/jira/browse/HADOOP-3338) | trunk doesn't compile after HADOOP-544 was committed | Blocker | . | Nigel Daley | Christophe Taton |
-| [HADOOP-3337](https://issues.apache.org/jira/browse/HADOOP-3337) | Name-node fails to start because DatanodeInfo format changed. | Blocker | . | Konstantin Shvachko | Tsz Wo Nicholas Sze |
-| [HADOOP-3335](https://issues.apache.org/jira/browse/HADOOP-3335) | 'make clean' in src/c++/libhdfs does 'rm -rf /\*' | Critical | build | Doug Cutting | Doug Cutting |
-| [HADOOP-3333](https://issues.apache.org/jira/browse/HADOOP-3333) | job failing because of reassigning same tasktracker to failing tasks | Blocker | . | Christian Kunz | Jothi Padmanabhan |
-| [HADOOP-3326](https://issues.apache.org/jira/browse/HADOOP-3326) | ReduceTask should not sleep for 200 ms while waiting for merge to finish | Major | . | Owen O'Malley | Sharad Agarwal |
-| [HADOOP-3320](https://issues.apache.org/jira/browse/HADOOP-3320) | NPE in NetworkTopology.getDistance() | Blocker | . | Konstantin Shvachko | Hairong Kuang |
-| [HADOOP-3318](https://issues.apache.org/jira/browse/HADOOP-3318) | Hadoop streaming doesn't recognize "Darwin" as an OS but Soylatte (OpenJDK port to Mac) reports that rather than "Mac OS X" | Major | . | Sam Pullara | Sam Pullara |
-| [HADOOP-3313](https://issues.apache.org/jira/browse/HADOOP-3313) | RPC::Invoker makes unnecessary calls to System.currentTimeMillis | Minor | . | Chris Douglas | Chris Douglas |
-| [HADOOP-3309](https://issues.apache.org/jira/browse/HADOOP-3309) | Unit test fails on Windows: org.apache.hadoop.mapred.TestMiniMRDFSSort.unknown | Major | . | Mukund Madhugiri | Lohit Vijayarenu |
-| [HADOOP-3301](https://issues.apache.org/jira/browse/HADOOP-3301) | Misleading error message when S3 URI contains hostname containing an underscore | Major | fs/s3 | Tom White | Tom White |
-| [HADOOP-3300](https://issues.apache.org/jira/browse/HADOOP-3300) | FindBugs warnings in NetworkTopology | Major | . | Tom White | Tom White |
-| [HADOOP-3299](https://issues.apache.org/jira/browse/HADOOP-3299) | org.apache.hadoop.mapred.join.CompositeInputFormat does not initialize TextInput format files with the configuration resulting in an NullPointerException | Major | io | Jason | Chris Douglas |
-| [HADOOP-3296](https://issues.apache.org/jira/browse/HADOOP-3296) | Some levels are skipped while creating the task cache in JobInProgress | Major | . | Amar Kamat | Amar Kamat |
+| [HADOOP-2905](https://issues.apache.org/jira/browse/HADOOP-2905) | fsck -move triggers NPE in namenode | Major | . | Michael Bieniosek | Lohit Vijayarenu |
+| [HADOOP-2928](https://issues.apache.org/jira/browse/HADOOP-2928) | Remove deprecated methods getContentLength() in ClientProtocol, NameNode, FileSystem, DistributedFileSystem and DFSClient | Blocker | . | Tsz Wo Nicholas Sze | Lohit Vijayarenu |
+| [HADOOP-3176](https://issues.apache.org/jira/browse/HADOOP-3176) | Change lease record when a open-for-write-file gets renamed | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-3130](https://issues.apache.org/jira/browse/HADOOP-3130) | Shuffling takes too long to get the last map output. | Major | . | Runping Qi | Amar Kamat |
+| [HADOOP-3160](https://issues.apache.org/jira/browse/HADOOP-3160) | remove exists() from ClientProtocol and NameNode | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3269](https://issues.apache.org/jira/browse/HADOOP-3269) | NameNode doesn't startup when restarted after running an MR job | Blocker | . | Devaraj Das | Tsz Wo Nicholas Sze |
| [HADOOP-3282](https://issues.apache.org/jira/browse/HADOOP-3282) | TestCheckpoint occasionally fails because of the port issues. | Major | test | Konstantin Shvachko | Konstantin Shvachko |
| [HADOOP-3272](https://issues.apache.org/jira/browse/HADOOP-3272) | Reduce redundant copy of Block object in BlocksMap.map hash map | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3269](https://issues.apache.org/jira/browse/HADOOP-3269) | NameNode doesn't startup when restarted after running an MR job | Blocker | . | Devaraj Das | Tsz Wo Nicholas Sze |
| [HADOOP-3268](https://issues.apache.org/jira/browse/HADOOP-3268) | TestUrlStreamHandler.testFileUrls fails on Windows | Major | test | Nigel Daley | Christophe Taton |
-| [HADOOP-3259](https://issues.apache.org/jira/browse/HADOOP-3259) | Configuration.substituteVars() needs to handle security exceptions | Trivial | conf | Steve Loughran | Edward J. Yoon |
-| [HADOOP-3248](https://issues.apache.org/jira/browse/HADOOP-3248) | Improve Namenode startup performance | Major | . | girish vaitheeswaran | dhruba borthakur |
-| [HADOOP-3240](https://issues.apache.org/jira/browse/HADOOP-3240) | TestJobShell should not create files in the current directory | Blocker | test | Tsz Wo Nicholas Sze | Mahadev konar |
-| [HADOOP-3232](https://issues.apache.org/jira/browse/HADOOP-3232) | Datanodes time out | Critical | . | Johan Oskarsson | Johan Oskarsson |
-| [HADOOP-3203](https://issues.apache.org/jira/browse/HADOOP-3203) | TaskTracker::localizeJob doesn't provide the correct size to LocalDirAllocator | Major | . | Chris Douglas | Amareshwari Sriramadasu |
-| [HADOOP-3176](https://issues.apache.org/jira/browse/HADOOP-3176) | Change lease record when a open-for-write-file gets renamed | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-3160](https://issues.apache.org/jira/browse/HADOOP-3160) | remove exists() from ClientProtocol and NameNode | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3151](https://issues.apache.org/jira/browse/HADOOP-3151) | Hod should have better error messages. | Major | contrib/hod | Arkady Borkovsky | Vinod Kumar Vavilapalli |
-| [HADOOP-3135](https://issues.apache.org/jira/browse/HADOOP-3135) | if the 'mapred.system.dir' in the client jobconf is different from the JobTracker's value job submission fails | Critical | . | Alejandro Abdelnur | Subru Krishnan |
-| [HADOOP-3130](https://issues.apache.org/jira/browse/HADOOP-3130) | Shuffling takes too long to get the last map output. | Major | . | Runping Qi | Amar Kamat |
| [HADOOP-3127](https://issues.apache.org/jira/browse/HADOOP-3127) | rm /user/\<username\>/.Trash/\_\_\_\_ only moves it back to .Trash | Minor | fs | Koji Noguchi | Brice Arnould |
-| [HADOOP-3119](https://issues.apache.org/jira/browse/HADOOP-3119) | Text.getBytes() | Trivial | . | Andrew Gudkov | Tim Nelson |
+| [HADOOP-3300](https://issues.apache.org/jira/browse/HADOOP-3300) | FindBugs warnings in NetworkTopology | Major | . | Tom White | Tom White |
+| [HADOOP-2793](https://issues.apache.org/jira/browse/HADOOP-2793) | Links for worst performing shuffle tasks are broken in Analyze Job. | Minor | . | Amar Kamat | Amareshwari Sriramadasu |
+| [HADOOP-3313](https://issues.apache.org/jira/browse/HADOOP-3313) | RPC::Invoker makes unnecessary calls to System.currentTimeMillis | Minor | . | Chris Douglas | Chris Douglas |
+| [HADOOP-3318](https://issues.apache.org/jira/browse/HADOOP-3318) | Hadoop streaming doesn't recognize "Darwin" as an OS but Soylatte (OpenJDK port to Mac) reports that rather than "Mac OS X" | Major | . | Sam Pullara | Sam Pullara |
+| [HADOOP-3301](https://issues.apache.org/jira/browse/HADOOP-3301) | Misleading error message when S3 URI contains hostname containing an underscore | Major | fs/s3 | Tom White | Tom White |
| [HADOOP-3109](https://issues.apache.org/jira/browse/HADOOP-3109) | RPC should accepted connections even when rpc queue is full (ie undo part of HADOOP-2910) | Blocker | . | Sanjay Radia | Hairong Kuang |
+| [HADOOP-3338](https://issues.apache.org/jira/browse/HADOOP-3338) | trunk doesn't compile after HADOOP-544 was committed | Blocker | . | Nigel Daley | Christophe Taton |
+| [HADOOP-3337](https://issues.apache.org/jira/browse/HADOOP-3337) | Name-node fails to start because DatanodeInfo format changed. | Blocker | . | Konstantin Shvachko | Tsz Wo Nicholas Sze |
| [HADOOP-3101](https://issues.apache.org/jira/browse/HADOOP-3101) | 'bin/hadoop job' should display the help and silently exit | Minor | . | Amar Kamat | Edward J. Yoon |
-| [HADOOP-3085](https://issues.apache.org/jira/browse/HADOOP-3085) | pushMetric() method of various metric util classes should catch exceptions | Major | metrics | Runping Qi | Chris Douglas |
-| [HADOOP-3076](https://issues.apache.org/jira/browse/HADOOP-3076) | [HOD] If a cluster directory is specified as a relative path, an existing script.exitcode file will not be deleted. | Blocker | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-| [HADOOP-2961](https://issues.apache.org/jira/browse/HADOOP-2961) | [HOD] Hod expects port info though external host is not mentioned. | Minor | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-3119](https://issues.apache.org/jira/browse/HADOOP-3119) | Text.getBytes() | Trivial | . | Andrew Gudkov | Tim Nelson |
+| [HADOOP-2294](https://issues.apache.org/jira/browse/HADOOP-2294) | In hdfs.h , the comment says you release the result of a hdfsListDirectory with a freehdfsFileInfo, but should say hdfsFreeFileInfo | Trivial | . | Dick King | Craig Macdonald |
+| [HADOOP-3335](https://issues.apache.org/jira/browse/HADOOP-3335) | 'make clean' in src/c++/libhdfs does 'rm -rf /\*' | Critical | build | Doug Cutting | Doug Cutting |
| [HADOOP-2930](https://issues.apache.org/jira/browse/HADOOP-2930) | make {start,stop}-balancer.sh work even if hadoop-daemon.sh isn't in the PATH | Trivial | scripts | Spiros Papadimitriou | Spiros Papadimitriou |
-| [HADOOP-2928](https://issues.apache.org/jira/browse/HADOOP-2928) | Remove deprecated methods getContentLength() in ClientProtocol, NameNode, FileSystem, DistributedFileSystem and DFSClient | Blocker | . | Tsz Wo Nicholas Sze | Lohit Vijayarenu |
-| [HADOOP-2905](https://issues.apache.org/jira/browse/HADOOP-2905) | fsck -move triggers NPE in namenode | Major | . | Michael Bieniosek | Lohit Vijayarenu |
-| [HADOOP-2793](https://issues.apache.org/jira/browse/HADOOP-2793) | Links for worst performing shuffle tasks are broken in Analyze Job. | Minor | . | Amar Kamat | Amareshwari Sriramadasu |
+| [HADOOP-3085](https://issues.apache.org/jira/browse/HADOOP-3085) | pushMetric() method of various metric util classes should catch exceptions | Major | metrics | Runping Qi | Chris Douglas |
+| [HADOOP-3248](https://issues.apache.org/jira/browse/HADOOP-3248) | Improve Namenode startup performance | Major | . | girish vaitheeswaran | dhruba borthakur |
+| [HADOOP-3299](https://issues.apache.org/jira/browse/HADOOP-3299) | org.apache.hadoop.mapred.join.CompositeInputFormat does not initialize TextInput format files with the configuration resulting in an NullPointerException | Major | io | Jason | Chris Douglas |
+| [HADOOP-3309](https://issues.apache.org/jira/browse/HADOOP-3309) | Unit test fails on Windows: org.apache.hadoop.mapred.TestMiniMRDFSSort.unknown | Major | . | Mukund Madhugiri | Lohit Vijayarenu |
+| [HADOOP-3348](https://issues.apache.org/jira/browse/HADOOP-3348) | TestUrlStreamHandler hangs on LINUX | Major | fs | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3371](https://issues.apache.org/jira/browse/HADOOP-3371) | MBeanUtil dumps stacktrace from registerMBean | Minor | metrics | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3349](https://issues.apache.org/jira/browse/HADOOP-3349) | FSNamesystem.changeLease(src, dst) incorrectly updates the paths inside a lease | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3365](https://issues.apache.org/jira/browse/HADOOP-3365) | SequenceFile.Sorter.MergeQueue.next does an unnecessary copy of the key | Major | io | Arun C Murthy | Devaraj Das |
+| [HADOOP-3203](https://issues.apache.org/jira/browse/HADOOP-3203) | TaskTracker::localizeJob doesn't provide the correct size to LocalDirAllocator | Major | . | Chris Douglas | Amareshwari Sriramadasu |
+| [HADOOP-3388](https://issues.apache.org/jira/browse/HADOOP-3388) | TestDatanodeBlockScanner failed while trying to corrupt replicas | Major | test | dhruba borthakur | dhruba borthakur |
+| [HADOOP-3393](https://issues.apache.org/jira/browse/HADOOP-3393) | TestHDFSServerPorts fails on LINUX (NFS mounted directory) and on WINDOWS | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3391](https://issues.apache.org/jira/browse/HADOOP-3391) | HADOOP-3248 introduced a findbugs warning. | Minor | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-3399](https://issues.apache.org/jira/browse/HADOOP-3399) | Debug log not removed in ipc client | Trivial | ipc | Raghu Angadi | Raghu Angadi |
+| [HADOOP-3339](https://issues.apache.org/jira/browse/HADOOP-3339) | DFS Write pipeline does not detect defective datanode correctly if it times out. | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-3396](https://issues.apache.org/jira/browse/HADOOP-3396) | Unit test TestDatanodeBlockScanner fails on Windows | Critical | . | Mukund Madhugiri | Lohit Vijayarenu |
+| [HADOOP-3409](https://issues.apache.org/jira/browse/HADOOP-3409) | NameNode should save the root inode into fsimage | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-3296](https://issues.apache.org/jira/browse/HADOOP-3296) | Some levels are skipped while creating the task cache in JobInProgress | Major | . | Amar Kamat | Amar Kamat |
+| [HADOOP-3375](https://issues.apache.org/jira/browse/HADOOP-3375) | Lease paths are sometimes not removed from LeaseManager.sortedLeasesByPath | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3424](https://issues.apache.org/jira/browse/HADOOP-3424) | the value returned from getPartition should be checked to make sure it is in the range 0..#reduces-1 | Major | . | Owen O'Malley | Chris Douglas |
+| [HADOOP-3408](https://issues.apache.org/jira/browse/HADOOP-3408) | Change FSNamesytem status metrics to IntValue | Major | metrics | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3381](https://issues.apache.org/jira/browse/HADOOP-3381) | INode interlinks can multiply effect of memory leaks | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-3403](https://issues.apache.org/jira/browse/HADOOP-3403) | Job tracker's ExpireTackers thread gets NullPointerException if a tasktracker is lost. | Blocker | . | Amareshwari Sriramadasu | Arun C Murthy |
+| [HADOOP-1318](https://issues.apache.org/jira/browse/HADOOP-1318) | Do not fail completed maps on lost tasktrackers if '-reducer NONE' is specified | Minor | . | Arun C Murthy | Amareshwari Sriramadasu |
+| [HADOOP-3351](https://issues.apache.org/jira/browse/HADOOP-3351) | Fix history viewer | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-3419](https://issues.apache.org/jira/browse/HADOOP-3419) | TestFsck fails once in a while on WINDOWS/LINUX | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3259](https://issues.apache.org/jira/browse/HADOOP-3259) | Configuration.substituteVars() needs to handle security exceptions | Trivial | conf | Steve Loughran | Edward J. Yoon |
+| [HADOOP-3232](https://issues.apache.org/jira/browse/HADOOP-3232) | Datanodes time out | Critical | . | Johan Oskarsson | Johan Oskarsson |
+| [HADOOP-3451](https://issues.apache.org/jira/browse/HADOOP-3451) | test-libhdfs fails on Linux | Blocker | test | Mukund Madhugiri | Lohit Vijayarenu |
+| [HADOOP-3401](https://issues.apache.org/jira/browse/HADOOP-3401) | Update FileBench to use the "work" directory for SequenceFileOutputFormat | Major | test | Chris Douglas | Chris Douglas |
+| [HADOOP-3468](https://issues.apache.org/jira/browse/HADOOP-3468) | Compile error: FTPFileSystem.java:26: cannot access org.apache.commons.net.ftp.FTP | Blocker | fs | Tsz Wo Nicholas Sze | Ankur |
| [HADOOP-2669](https://issues.apache.org/jira/browse/HADOOP-2669) | DFS client lost lease during writing into DFS files | Major | . | Runping Qi | dhruba borthakur |
-| [HADOOP-2565](https://issues.apache.org/jira/browse/HADOOP-2565) | DFSPath cache of FileStatus can become stale | Major | . | Doug Cutting | Tsz Wo Nicholas Sze |
-| [HADOOP-2427](https://issues.apache.org/jira/browse/HADOOP-2427) | Cleanup of mapred.local.dir after maptask is complete | Major | . | Lohit Vijayarenu | Amareshwari Sriramadasu |
-| [HADOOP-2393](https://issues.apache.org/jira/browse/HADOOP-2393) | TaskTracker locks up removing job files within a synchronized method | Critical | . | Joydeep Sen Sarma | Amareshwari Sriramadasu |
-| [HADOOP-2294](https://issues.apache.org/jira/browse/HADOOP-2294) | In hdfs.h , the comment says you release the result of a hdfsListDirectory with a freehdfsFileInfo, but should say hdfsFreeFileInfo | Trivial | . | Dick King | Craig Macdonald |
+| [HADOOP-3410](https://issues.apache.org/jira/browse/HADOOP-3410) | KFS implementation needs to return file modification time | Minor | . | Sriram Rao | Sriram Rao |
+| [HADOOP-3340](https://issues.apache.org/jira/browse/HADOOP-3340) | hadoop dfs metrics shows 0 | Major | metrics | Eric Yang | Lohit Vijayarenu |
+| [HADOOP-3435](https://issues.apache.org/jira/browse/HADOOP-3435) | test-patch fail if sh != bash | Major | . | Brice Arnould | Brice Arnould |
+| [HADOOP-3471](https://issues.apache.org/jira/browse/HADOOP-3471) | TestIndexedSort sometimes fails | Major | test | Chris Douglas | Chris Douglas |
+| [HADOOP-3443](https://issues.apache.org/jira/browse/HADOOP-3443) | map outputs should not be renamed between partitions | Critical | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-3454](https://issues.apache.org/jira/browse/HADOOP-3454) | Text.find incorrectly searches beyond the end of the buffer | Major | . | Chad Whipkey | Chad Whipkey |
+| [HADOOP-3376](https://issues.apache.org/jira/browse/HADOOP-3376) | [HOD] HOD should have a way to detect and deal with clusters that violate/exceed resource manager limits | Major | contrib/hod | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
| [HADOOP-2132](https://issues.apache.org/jira/browse/HADOOP-2132) | Killing successfully completed jobs moves them to failed | Critical | . | Srikanth Kakani | Jothi Padmanabhan |
+| [HADOOP-2961](https://issues.apache.org/jira/browse/HADOOP-2961) | [HOD] Hod expects port info though external host is not mentioned. | Minor | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-3151](https://issues.apache.org/jira/browse/HADOOP-3151) | Hod should have better error messages. | Major | contrib/hod | Arkady Borkovsky | Vinod Kumar Vavilapalli |
+| [HADOOP-3476](https://issues.apache.org/jira/browse/HADOOP-3476) | Code cleanup needed in fuse-dfs | Major | . | Tsz Wo Nicholas Sze | Pete Wyckoff |
| [HADOOP-2095](https://issues.apache.org/jira/browse/HADOOP-2095) | Reducer failed due to Out ofMemory | Major | . | Runping Qi | Arun C Murthy |
-| [HADOOP-1318](https://issues.apache.org/jira/browse/HADOOP-1318) | Do not fail completed maps on lost tasktrackers if '-reducer NONE' is specified | Minor | . | Arun C Murthy | Amareshwari Sriramadasu |
+| [HADOOP-2427](https://issues.apache.org/jira/browse/HADOOP-2427) | Cleanup of mapred.local.dir after maptask is complete | Major | . | Lohit Vijayarenu | Amareshwari Sriramadasu |
+| [HADOOP-2565](https://issues.apache.org/jira/browse/HADOOP-2565) | DFSPath cache of FileStatus can become stale | Major | . | Doug Cutting | Tsz Wo Nicholas Sze |
+| [HADOOP-3326](https://issues.apache.org/jira/browse/HADOOP-3326) | ReduceTask should not sleep for 200 ms while waiting for merge to finish | Major | . | Owen O'Malley | Sharad Agarwal |
+| [HADOOP-3493](https://issues.apache.org/jira/browse/HADOOP-3493) | TestStreamingFailure fails. | Major | . | Amareshwari Sriramadasu | Lohit Vijayarenu |
| [HADOOP-236](https://issues.apache.org/jira/browse/HADOOP-236) | job tracker should refuse connection from a task tracker with a different version number | Major | . | Hairong Kuang | Sharad Agarwal |
+| [HADOOP-3453](https://issues.apache.org/jira/browse/HADOOP-3453) | ipc.Client.close() throws NullPointerException | Major | ipc | Tsz Wo Nicholas Sze | Hairong Kuang |
+| [HADOOP-3427](https://issues.apache.org/jira/browse/HADOOP-3427) | In ReduceTask::fetchOutputs, wait for result can be improved slightly | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-3240](https://issues.apache.org/jira/browse/HADOOP-3240) | TestJobShell should not create files in the current directory | Blocker | test | Tsz Wo Nicholas Sze | Mahadev konar |
+| [HADOOP-3496](https://issues.apache.org/jira/browse/HADOOP-3496) | TestHarFileSystem.testArchives fails | Blocker | fs | Amareshwari Sriramadasu | Tom White |
+| [HADOOP-2393](https://issues.apache.org/jira/browse/HADOOP-2393) | TaskTracker locks up removing job files within a synchronized method | Critical | . | Joydeep Sen Sarma | Amareshwari Sriramadasu |
+| [HADOOP-3135](https://issues.apache.org/jira/browse/HADOOP-3135) | if the 'mapred.system.dir' in the client jobconf is different from the JobTracker's value job submission fails | Critical | . | Alejandro Abdelnur | Subru Krishnan |
+| [HADOOP-3503](https://issues.apache.org/jira/browse/HADOOP-3503) | Race condition when client and namenode start block recovery simultaneously | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-3440](https://issues.apache.org/jira/browse/HADOOP-3440) | TaskRunner creates a symlink with name 'null' if a file is added to DistributedCache without fragment | Minor | . | Abhijit Bagri | Devaraj Das |
+| [HADOOP-3413](https://issues.apache.org/jira/browse/HADOOP-3413) | SequenceFile.Reader doesn't use the Serialization framework | Critical | io | Arun C Murthy | Tom White |
+| [HADOOP-3463](https://issues.apache.org/jira/browse/HADOOP-3463) | hadoop scripts don't change directory to hadoop\_home | Critical | scripts | Owen O'Malley | Owen O'Malley |
+| [HADOOP-3491](https://issues.apache.org/jira/browse/HADOOP-3491) | Name-node shutdown causes InterruptedException in ResolutionMonitor | Major | . | Konstantin Shvachko | Lohit Vijayarenu |
+| [HADOOP-3509](https://issues.apache.org/jira/browse/HADOOP-3509) | FSNamesystem.close() throws NullPointerException | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3489](https://issues.apache.org/jira/browse/HADOOP-3489) | NPE in SafeModeMonitor | Major | . | Konstantin Shvachko | Lohit Vijayarenu |
+| [HADOOP-3511](https://issues.apache.org/jira/browse/HADOOP-3511) | Namenode should not restore the root's quota if the quota was not in the image | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-3516](https://issues.apache.org/jira/browse/HADOOP-3516) | TestHarFileSystem.testArchives fails with NullPointerException | Blocker | test | Nigel Daley | Subru Krishnan |
+| [HADOOP-3513](https://issues.apache.org/jira/browse/HADOOP-3513) | Improve NNThroughputBenchmark log messages. | Major | test | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-3519](https://issues.apache.org/jira/browse/HADOOP-3519) | NPE in DFS FileSystem rename | Blocker | . | Tom White | Hairong Kuang |
+| [HADOOP-3528](https://issues.apache.org/jira/browse/HADOOP-3528) | Metrics FilesCreated and files\_deleted metrics do not match. | Blocker | metrics | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3418](https://issues.apache.org/jira/browse/HADOOP-3418) | NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted. | Blocker | . | Raghu Angadi | Tsz Wo Nicholas Sze |
+| [HADOOP-3542](https://issues.apache.org/jira/browse/HADOOP-3542) | Hadoop archives should not create \_logs file in the final archive directory. | Blocker | . | Mahadev konar | Mahadev konar |
+| [HADOOP-3544](https://issues.apache.org/jira/browse/HADOOP-3544) | The command "archive" is missing in the example in docs/hadoop\_archives.html (and pdf) | Blocker | documentation | Jothi Padmanabhan | Jothi Padmanabhan |
+| [HADOOP-3523](https://issues.apache.org/jira/browse/HADOOP-3523) | [HOD] If a job does not exist in Torque's list of jobs, HOD allocate on previously allocated directory fails. | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-3517](https://issues.apache.org/jira/browse/HADOOP-3517) | The last InMemory merge may be missed | Blocker | . | Devaraj Das | Arun C Murthy |
+| [HADOOP-3548](https://issues.apache.org/jira/browse/HADOOP-3548) | The tools.jar is not included in the distribution | Blocker | build | Owen O'Malley | Owen O'Malley |
+| [HADOOP-3363](https://issues.apache.org/jira/browse/HADOOP-3363) | HDFS throws a InconsistentFSStateException when the name node starts up on a directory that isnt formatted | Blocker | . | Steve Loughran | Konstantin Shvachko |
+| [HADOOP-3560](https://issues.apache.org/jira/browse/HADOOP-3560) | Archvies sometimes create empty part files. | Blocker | . | Mahadev konar | Mahadev konar |
+| [HADOOP-3545](https://issues.apache.org/jira/browse/HADOOP-3545) | archive is failing with "Illegal Capacity" error | Blocker | . | Jothi Padmanabhan | Mahadev konar |
+| [HADOOP-3561](https://issues.apache.org/jira/browse/HADOOP-3561) | With trash enabled, 'hadoop fs -rmr .' still fully deletes the working dir | Blocker | . | Chris Douglas | Chris Douglas |
+| [HADOOP-3531](https://issues.apache.org/jira/browse/HADOOP-3531) | Hod does not report job tracker failure on hod client side when job tracker fails to come up | Blocker | contrib/hod | Karam Singh | Hemanth Yamijala |
+| [HADOOP-3575](https://issues.apache.org/jira/browse/HADOOP-3575) | clover target broken after src restructuring | Minor | build | Nigel Daley | Nigel Daley |
+| [HADOOP-3539](https://issues.apache.org/jira/browse/HADOOP-3539) | Cygwin: cygpath displays an error message in running bin/hadoop script | Blocker | scripts | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3564](https://issues.apache.org/jira/browse/HADOOP-3564) | Sometime after successful hod allocation datanode fails to come up with java.net.BindException for dfs.datanode.ipc.address | Blocker | contrib/hod | Karam Singh | Vinod Kumar Vavilapalli |
+| [HADOOP-3520](https://issues.apache.org/jira/browse/HADOOP-3520) | Generation stamp upgrade fails TestDFSUpgradeFromImage | Blocker | . | Konstantin Shvachko | dhruba borthakur |
+| [HADOOP-3586](https://issues.apache.org/jira/browse/HADOOP-3586) | keep combiner backward compatible with earlier versions of hadoop | Blocker | . | Olga Natkovich | Chris Douglas |
+| [HADOOP-3533](https://issues.apache.org/jira/browse/HADOOP-3533) | The api to JobTracker and TaskTracker have changed incompatibly | Blocker | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-3593](https://issues.apache.org/jira/browse/HADOOP-3593) | Update MapRed tutorial | Blocker | documentation | Devaraj Das | Devaraj Das |
+| [HADOOP-3580](https://issues.apache.org/jira/browse/HADOOP-3580) | Using a har file as input for the Sort example fails | Blocker | . | Jothi Padmanabhan | Mahadev konar |
+| [HADOOP-3333](https://issues.apache.org/jira/browse/HADOOP-3333) | job failing because of reassigning same tasktracker to failing tasks | Blocker | . | Christian Kunz | Jothi Padmanabhan |
+| [HADOOP-3534](https://issues.apache.org/jira/browse/HADOOP-3534) | The namenode ignores ioexceptions in close | Blocker | . | Owen O'Malley | Tsz Wo Nicholas Sze |
+| [HADOOP-3546](https://issues.apache.org/jira/browse/HADOOP-3546) | TaskTracker re-initialization gets stuck in cleaning up | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-3320](https://issues.apache.org/jira/browse/HADOOP-3320) | NPE in NetworkTopology.getDistance() | Blocker | . | Konstantin Shvachko | Hairong Kuang |
+| [HADOOP-3576](https://issues.apache.org/jira/browse/HADOOP-3576) | hadoop dfs -mv throws NullPointerException | Blocker | . | Lohit Vijayarenu | Tsz Wo Nicholas Sze |
+| [HADOOP-3076](https://issues.apache.org/jira/browse/HADOOP-3076) | [HOD] If a cluster directory is specified as a relative path, an existing script.exitcode file will not be deleted. | Blocker | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-3590](https://issues.apache.org/jira/browse/HADOOP-3590) | Null pointer exception in JobTracker when the task tracker is not yet resolved | Blocker | . | Amar Kamat | Amar Kamat |
+| [HADOOP-3606](https://issues.apache.org/jira/browse/HADOOP-3606) | Update streaming documentation | Blocker | documentation | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-3505](https://issues.apache.org/jira/browse/HADOOP-3505) | omissions in HOD documentation | Blocker | contrib/hod, documentation | Ari Rabkin | Vinod Kumar Vavilapalli |
+| [HADOOP-3603](https://issues.apache.org/jira/browse/HADOOP-3603) | Setting spill threshold to 100% fails to detect spill for records | Blocker | . | Chris Douglas | Chris Douglas |
+| [HADOOP-3615](https://issues.apache.org/jira/browse/HADOOP-3615) | DatanodeProtocol.versionID should be 16L | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3537](https://issues.apache.org/jira/browse/HADOOP-3537) | Datanode not starting up with java.lang.StringIndexOutOfBoundsException in NetworkTopology.remove | Blocker | . | Koji Noguchi | Hairong Kuang |
+| [HADOOP-3487](https://issues.apache.org/jira/browse/HADOOP-3487) | Balancer should not allocate a thread per block move | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-3571](https://issues.apache.org/jira/browse/HADOOP-3571) | ArrayIndexOutOfBoundsException in BlocksMap$BlockInfo.setPrevious | Blocker | . | Tsz Wo Nicholas Sze | Konstantin Shvachko |
+| [HADOOP-3559](https://issues.apache.org/jira/browse/HADOOP-3559) | test-libhdfs fails on linux | Blocker | . | Mukund Madhugiri | Lohit Vijayarenu |
+| [HADOOP-3480](https://issues.apache.org/jira/browse/HADOOP-3480) | Need to update Eclipse template to reflect current trunk | Blocker | build | Tsz Wo Nicholas Sze | Brice Arnould |
+| [HADOOP-3645](https://issues.apache.org/jira/browse/HADOOP-3645) | MetricsTimeVaryingRate returns wrong value for metric\_avg\_time | Blocker | metrics | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3552](https://issues.apache.org/jira/browse/HADOOP-3552) | forrest doc for hadoop commands | Blocker | documentation | Sharad Agarwal | Sharad Agarwal |
+| [HADOOP-3588](https://issues.apache.org/jira/browse/HADOOP-3588) | Bug report for archives | Blocker | . | Hairong Kuang | Mahadev konar |
+| [HADOOP-3635](https://issues.apache.org/jira/browse/HADOOP-3635) | Uncaught exception in DataBlockScanner | Blocker | . | Koji Noguchi | Tsz Wo Nicholas Sze |
+| [HADOOP-3639](https://issues.apache.org/jira/browse/HADOOP-3639) | Exception when closing DFSClient while multiple files are open | Blocker | . | Benjamin Gufler | Benjamin Gufler |
+| [HADOOP-3649](https://issues.apache.org/jira/browse/HADOOP-3649) | ArrayIndexOutOfBounds in FSNamesystem.getBlockLocationsInternal | Blocker | . | Arun C Murthy | Lohit Vijayarenu |
+| [HADOOP-3604](https://issues.apache.org/jira/browse/HADOOP-3604) | Reduce stuck at shuffling phase | Blocker | . | Runping Qi | Arun C Murthy |
+| [HADOOP-3668](https://issues.apache.org/jira/browse/HADOOP-3668) | Clean up HOD documentation | Blocker | contrib/hod | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [HADOOP-3597](https://issues.apache.org/jira/browse/HADOOP-3597) | SortValidator always uses the default file system irrespective of the actual input | Major | test | Jothi Padmanabhan | Jothi Padmanabhan |
+| [HADOOP-3688](https://issues.apache.org/jira/browse/HADOOP-3688) | Fix up HDFS docs | Blocker | . | Robert Chansler | Robert Chansler |
+| [HADOOP-3693](https://issues.apache.org/jira/browse/HADOOP-3693) | Fix documentation for Archives, distcp and native libraries | Blocker | documentation | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-3653](https://issues.apache.org/jira/browse/HADOOP-3653) | test-patch target not working on hudson.zones.apache.org due to HADOOP-3480 | Blocker | . | Nigel Daley | Brice Arnould |
+| [HADOOP-3692](https://issues.apache.org/jira/browse/HADOOP-3692) | Fix documentation for Cluster setup and Quick start guides | Blocker | documentation | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-3691](https://issues.apache.org/jira/browse/HADOOP-3691) | Fix mapred docs | Blocker | documentation | Amareshwari Sriramadasu | Jothi Padmanabhan |
+| [HADOOP-3673](https://issues.apache.org/jira/browse/HADOOP-3673) | Deadlock in Datanode RPC servers | Blocker | . | dhruba borthakur | Tsz Wo Nicholas Sze |
+| [HADOOP-3630](https://issues.apache.org/jira/browse/HADOOP-3630) | CompositeRecordReader: key and values can be in uninitialized state if files being joined have no records | Major | . | Jingkei Ly | Chris Douglas |
+| [HADOOP-3706](https://issues.apache.o
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[02/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.5.0/CHANGES.2.5.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.5.0/CHANGES.2.5.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.5.0/CHANGES.2.5.0.md
index f62f96b..b27686a 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.5.0/CHANGES.2.5.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.5.0/CHANGES.2.5.0.md
@@ -24,534 +24,528 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HDFS-6168](https://issues.apache.org/jira/browse/HDFS-6168) | Remove deprecated methods in DistributedFileSystem | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HDFS-6164](https://issues.apache.org/jira/browse/HDFS-6164) | Remove lsr in OfflineImageViewer | Major | tools | Haohui Mai | Haohui Mai |
-| [HDFS-6153](https://issues.apache.org/jira/browse/HDFS-6153) | Document "fileId" and "childrenNum" fields in the FileStatus Json schema | Minor | documentation, webhdfs | Akira AJISAKA | Akira AJISAKA |
-| [MAPREDUCE-5777](https://issues.apache.org/jira/browse/MAPREDUCE-5777) | Support utf-8 text with BOM (byte order marker) | Major | . | bc Wong | zhihai xu |
+| [HDFS-6168](https://issues.apache.org/jira/browse/HDFS-6168) | Remove deprecated methods in DistributedFileSystem | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-6153](https://issues.apache.org/jira/browse/HDFS-6153) | Document "fileId" and "childrenNum" fields in the FileStatus Json schema | Minor | documentation, webhdfs | Akira Ajisaka | Akira Ajisaka |
| [YARN-2107](https://issues.apache.org/jira/browse/YARN-2107) | Refactor timeline classes into server.timeline package | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [MAPREDUCE-5777](https://issues.apache.org/jira/browse/MAPREDUCE-5777) | Support utf-8 text with BOM (byte order marker) | Major | . | bc Wong | zhihai xu |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10514](https://issues.apache.org/jira/browse/HADOOP-10514) | Common side changes to support HDFS extended attributes (HDFS-2006) | Major | fs | Uma Maheswara Rao G | Yi Liu |
| [HADOOP-10498](https://issues.apache.org/jira/browse/HADOOP-10498) | Add support for proxy server | Major | util | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9704](https://issues.apache.org/jira/browse/HADOOP-9704) | Write metrics sink plugin for Hadoop/Graphite | Major | . | Chu Tong | |
-| [HDFS-6435](https://issues.apache.org/jira/browse/HDFS-6435) | Add support for specifying a static uid/gid mapping for the NFS gateway | Major | nfs | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-6406](https://issues.apache.org/jira/browse/HDFS-6406) | Add capability for NFS gateway to reject connections from unprivileged ports | Major | nfs | Aaron T. Myers | Aaron T. Myers |
| [HDFS-6281](https://issues.apache.org/jira/browse/HDFS-6281) | Provide option to use the NFS Gateway without having to use the Hadoop portmapper | Major | nfs | Aaron T. Myers | Aaron T. Myers |
| [YARN-1864](https://issues.apache.org/jira/browse/YARN-1864) | Fair Scheduler Dynamic Hierarchical User Queues | Major | scheduler | Ashwin Shankar | Ashwin Shankar |
+| [HDFS-6406](https://issues.apache.org/jira/browse/HDFS-6406) | Add capability for NFS gateway to reject connections from unprivileged ports | Major | nfs | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-6435](https://issues.apache.org/jira/browse/HDFS-6435) | Add support for specifying a static uid/gid mapping for the NFS gateway | Major | nfs | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-9704](https://issues.apache.org/jira/browse/HADOOP-9704) | Write metrics sink plugin for Hadoop/Graphite | Major | . | Chu Tong | |
+| [HADOOP-10514](https://issues.apache.org/jira/browse/HADOOP-10514) | Common side changes to support HDFS extended attributes (HDFS-2006) | Major | fs | Uma Maheswara Rao G | Yi Liu |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10896](https://issues.apache.org/jira/browse/HADOOP-10896) | Update compatibility doc to capture visibility of un-annotated classes/ methods | Blocker | documentation | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-10782](https://issues.apache.org/jira/browse/HADOOP-10782) | Typo in DataChecksum classs | Trivial | . | Jingguo Yao | Jingguo Yao |
-| [HADOOP-10767](https://issues.apache.org/jira/browse/HADOOP-10767) | Clean up unused code in Ls shell command. | Trivial | fs | Chris Nauroth | Chris Nauroth |
-| [HADOOP-10747](https://issues.apache.org/jira/browse/HADOOP-10747) | Support configurable retries on SASL connection failures in RPC client. | Minor | ipc | Chris Nauroth | Chris Nauroth |
-| [HADOOP-10691](https://issues.apache.org/jira/browse/HADOOP-10691) | Improve the readability of 'hadoop fs -help' | Minor | tools | Lei (Eddy) Xu | Lei (Eddy) Xu |
-| [HADOOP-10688](https://issues.apache.org/jira/browse/HADOOP-10688) | Expose thread-level FileSystem StatisticsData | Major | fs | Sandy Ryza | Sandy Ryza |
-| [HADOOP-10674](https://issues.apache.org/jira/browse/HADOOP-10674) | Rewrite the PureJavaCrc32 loop for performance improvement | Major | performance, util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-10666](https://issues.apache.org/jira/browse/HADOOP-10666) | Remove Copyright /d/d/d/d Apache Software Foundation from the source files license header | Minor | documentation | Henry Saputra | Henry Saputra |
-| [HADOOP-10665](https://issues.apache.org/jira/browse/HADOOP-10665) | Make Hadoop Authentication Handler loads case in-sensitive | Minor | security | Benoy Antony | Benoy Antony |
-| [HADOOP-10618](https://issues.apache.org/jira/browse/HADOOP-10618) | Remove SingleNodeSetup.apt.vm | Minor | documentation | Akira AJISAKA | Akira AJISAKA |
-| [HADOOP-10614](https://issues.apache.org/jira/browse/HADOOP-10614) | CBZip2InputStream is not threadsafe | Major | . | Xiangrui Meng | Xiangrui Meng |
-| [HADOOP-10572](https://issues.apache.org/jira/browse/HADOOP-10572) | Example NFS mount command must pass noacl as it isn't supported by the server yet | Trivial | nfs | Harsh J | Harsh J |
-| [HADOOP-10561](https://issues.apache.org/jira/browse/HADOOP-10561) | Copy command with preserve option should handle Xattrs | Major | fs | Uma Maheswara Rao G | Yi Liu |
-| [HADOOP-10557](https://issues.apache.org/jira/browse/HADOOP-10557) | FsShell -cp -pa option for preserving extended ACLs | Major | fs | Akira AJISAKA | Akira AJISAKA |
-| [HADOOP-10556](https://issues.apache.org/jira/browse/HADOOP-10556) | Add toLowerCase support to auth\_to\_local rules for service name | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-10549](https://issues.apache.org/jira/browse/HADOOP-10549) | MAX\_SUBST and varPat should be final in Configuration.java | Major | conf | Gera Shegalov | Gera Shegalov |
-| [HADOOP-10539](https://issues.apache.org/jira/browse/HADOOP-10539) | Provide backward compatibility for ProxyUsers.authorize() call | Minor | security | Benoy Antony | Benoy Antony |
-| [HADOOP-10535](https://issues.apache.org/jira/browse/HADOOP-10535) | Make the retry numbers in ActiveStandbyElector configurable | Minor | . | Jing Zhao | Jing Zhao |
-| [HADOOP-10458](https://issues.apache.org/jira/browse/HADOOP-10458) | swifts should throw FileAlreadyExistsException on attempt to overwrite file | Minor | fs | Steve Loughran | Steve Loughran |
-| [HADOOP-10454](https://issues.apache.org/jira/browse/HADOOP-10454) | Provide FileContext version of har file system | Major | . | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-5014](https://issues.apache.org/jira/browse/MAPREDUCE-5014) | Extending DistCp through a custom CopyListing is not possible | Major | distcp | Srikanth Sundarrajan | Srikanth Sundarrajan |
+| [YARN-1479](https://issues.apache.org/jira/browse/YARN-1479) | Invalid NaN values in Hadoop REST API JSON response | Major | . | Kendall Thrapp | Chen He |
+| [HADOOP-9968](https://issues.apache.org/jira/browse/HADOOP-9968) | ProxyUsers does not work with NetGroups | Major | security | Benoy Antony | Benoy Antony |
+| [YARN-1561](https://issues.apache.org/jira/browse/YARN-1561) | Fix a generic type warning in FairScheduler | Minor | scheduler | Junping Du | Chen He |
+| [YARN-1845](https://issues.apache.org/jira/browse/YARN-1845) | Elapsed time for failed tasks that never started is wrong | Major | . | Rushabh S Shah | Rushabh S Shah |
+| [HDFS-6007](https://issues.apache.org/jira/browse/HDFS-6007) | Update documentation about short-circuit local reads | Minor | documentation | Masatake Iwasaki | |
+| [HDFS-5196](https://issues.apache.org/jira/browse/HDFS-5196) | Provide more snapshot information in WebUI | Minor | snapshots | Haohui Mai | Shinichi Yamashita |
+| [HDFS-6158](https://issues.apache.org/jira/browse/HDFS-6158) | Clean up dead code for OfflineImageViewer | Major | . | Haohui Mai | Haohui Mai |
| [HADOOP-10451](https://issues.apache.org/jira/browse/HADOOP-10451) | Remove unused field and imports from SaslRpcServer | Trivial | security | Benoy Antony | Benoy Antony |
-| [HADOOP-10376](https://issues.apache.org/jira/browse/HADOOP-10376) | Refactor refresh\*Protocols into a single generic refreshConfigProtocol | Minor | . | Chris Li | Chris Li |
| [HADOOP-10345](https://issues.apache.org/jira/browse/HADOOP-10345) | Sanitize the the inputs (groups and hosts) for the proxyuser configuration | Minor | security | Benoy Antony | Benoy Antony |
-| [HADOOP-10322](https://issues.apache.org/jira/browse/HADOOP-10322) | Add ability to read principal names from a keytab | Major | security | Benoy Antony | Benoy Antony |
-| [HADOOP-9968](https://issues.apache.org/jira/browse/HADOOP-9968) | ProxyUsers does not work with NetGroups | Major | security | Benoy Antony | Benoy Antony |
-| [HADOOP-9495](https://issues.apache.org/jira/browse/HADOOP-9495) | Define behaviour of Seekable.seek(), write tests, fix all hadoop implementations for compliance | Major | fs | Steve Loughran | Steve Loughran |
-| [HADOOP-9361](https://issues.apache.org/jira/browse/HADOOP-9361) | Strictly define the expected behavior of filesystem APIs and write tests to verify compliance | Blocker | fs, test | Steve Loughran | Steve Loughran |
-| [HADOOP-8943](https://issues.apache.org/jira/browse/HADOOP-8943) | Support multiple group mapping providers | Major | security | Kai Zheng | Kai Zheng |
-| [HADOOP-6350](https://issues.apache.org/jira/browse/HADOOP-6350) | Documenting Hadoop metrics | Major | documentation, metrics | Hong Tang | Akira AJISAKA |
-| [HDFS-6620](https://issues.apache.org/jira/browse/HDFS-6620) | Snapshot docs should specify about preserve options with cp command | Major | namenode | Uma Maheswara Rao G | Stephen Chu |
-| [HDFS-6603](https://issues.apache.org/jira/browse/HDFS-6603) | Add XAttr with ACL test | Minor | test | Stephen Chu | Stephen Chu |
-| [HDFS-6595](https://issues.apache.org/jira/browse/HDFS-6595) | Configure the maximum threads allowed for balancing on datanodes | Minor | balancer & mover, datanode | Benoy Antony | Benoy Antony |
-| [HDFS-6593](https://issues.apache.org/jira/browse/HDFS-6593) | Move SnapshotDiffInfo out of INodeDirectorySnapshottable | Minor | namenode, snapshots | Jing Zhao | Jing Zhao |
-| [HDFS-6580](https://issues.apache.org/jira/browse/HDFS-6580) | FSNamesystem.mkdirsInt should call the getAuditFileInfo() wrapper | Major | namenode | Zhilei Xu | Zhilei Xu |
-| [HDFS-6578](https://issues.apache.org/jira/browse/HDFS-6578) | add toString method to DatanodeStorage for easier debugging | Major | . | Yongjun Zhang | Yongjun Zhang |
-| [HDFS-6558](https://issues.apache.org/jira/browse/HDFS-6558) | Missing '\n' in the description of dfsadmin -rollingUpgrade | Trivial | . | Akira AJISAKA | Chen He |
-| [HDFS-6545](https://issues.apache.org/jira/browse/HDFS-6545) | Finalizing rolling upgrade can make NN unavailable for a long duration | Critical | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-6529](https://issues.apache.org/jira/browse/HDFS-6529) | Trace logging for RemoteBlockReader2 to identify remote datanode and file being read | Minor | hdfs-client | Anubhav Dhoot | Anubhav Dhoot |
-| [HDFS-6528](https://issues.apache.org/jira/browse/HDFS-6528) | Add XAttrs to TestOfflineImageViewer | Minor | test | Stephen Chu | Stephen Chu |
-| [HDFS-6507](https://issues.apache.org/jira/browse/HDFS-6507) | Improve DFSAdmin to support HA cluster better | Major | tools | Zesheng Wu | Zesheng Wu |
-| [HDFS-6503](https://issues.apache.org/jira/browse/HDFS-6503) | Fix typo of DFSAdmin restoreFailedStorage | Minor | tools | Zesheng Wu | Zesheng Wu |
-| [HDFS-6499](https://issues.apache.org/jira/browse/HDFS-6499) | Use NativeIO#renameTo instead of File#renameTo in FileJournalManager | Major | namenode | Yongjun Zhang | Yongjun Zhang |
-| [HDFS-6492](https://issues.apache.org/jira/browse/HDFS-6492) | Support create-time xattrs and atomically setting multiple xattrs | Major | namenode | Andrew Wang | Andrew Wang |
-| [HDFS-6463](https://issues.apache.org/jira/browse/HDFS-6463) | Clarify behavior of AclStorage#createFsPermissionForExtendedAcl in comments. | Trivial | namenode | Aaron T. Myers | Chris Nauroth |
-| [HDFS-6460](https://issues.apache.org/jira/browse/HDFS-6460) | Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance | Minor | . | Yongjun Zhang | Yongjun Zhang |
-| [HDFS-6453](https://issues.apache.org/jira/browse/HDFS-6453) | use Time#monotonicNow to avoid system clock reset | Major | datanode, namenode | Liang Xie | Liang Xie |
-| [HDFS-6448](https://issues.apache.org/jira/browse/HDFS-6448) | BlockReaderLocalLegacy should set socket timeout based on conf.socketTimeout | Major | hdfs-client | Liang Xie | Liang Xie |
-| [HDFS-6447](https://issues.apache.org/jira/browse/HDFS-6447) | balancer should timestamp the completion message | Trivial | balancer & mover | Allen Wittenauer | Juan Yu |
-| [HDFS-6442](https://issues.apache.org/jira/browse/HDFS-6442) | Fix TestEditLogAutoroll and TestStandbyCheckpoints failure caused by port conficts | Minor | test | Zesheng Wu | Zesheng Wu |
-| [HDFS-6433](https://issues.apache.org/jira/browse/HDFS-6433) | Replace BytesMoved class with AtomicLong | Major | balancer & mover | Benoy Antony | Benoy Antony |
-| [HDFS-6432](https://issues.apache.org/jira/browse/HDFS-6432) | Add snapshot related APIs to webhdfs | Major | namenode, webhdfs | Suresh Srinivas | Jing Zhao |
-| [HDFS-6416](https://issues.apache.org/jira/browse/HDFS-6416) | Use Time#monotonicNow in OpenFileCtx and OpenFileCtxCatch to avoid system clock bugs | Minor | nfs | Brandon Li | Abhiraj Butala |
-| [HDFS-6403](https://issues.apache.org/jira/browse/HDFS-6403) | Add metrics for log warnings reported by JVM pauses | Major | datanode, namenode | Yongjun Zhang | Yongjun Zhang |
-| [HDFS-6396](https://issues.apache.org/jira/browse/HDFS-6396) | Remove support for ACL feature from INodeSymlink | Minor | . | Andrew Wang | Charles Lamb |
-| [HDFS-6375](https://issues.apache.org/jira/browse/HDFS-6375) | Listing extended attributes with the search permission | Major | namenode | Andrew Wang | Charles Lamb |
-| [HDFS-6369](https://issues.apache.org/jira/browse/HDFS-6369) | Document that BlockReader#available() can return more bytes than are remaining in the block | Trivial | . | Ted Yu | Ted Yu |
-| [HDFS-6356](https://issues.apache.org/jira/browse/HDFS-6356) | Fix typo in DatanodeLayoutVersion | Trivial | datanode | Tulasi G | Tulasi G |
-| [HDFS-6334](https://issues.apache.org/jira/browse/HDFS-6334) | Client failover proxy provider for IP failover based NN HA | Major | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-6304](https://issues.apache.org/jira/browse/HDFS-6304) | Consolidate the logic of path resolution in FSDirectory | Major | namenode | Haohui Mai | Haohui Mai |
-| [HDFS-6297](https://issues.apache.org/jira/browse/HDFS-6297) | Add CLI testcases to reflect new features of dfs and dfsadmin | Major | test | Dasha Boudnik | Dasha Boudnik |
-| [HDFS-6295](https://issues.apache.org/jira/browse/HDFS-6295) | Add "decommissioning" state and node state filtering to dfsadmin | Major | . | Andrew Wang | Andrew Wang |
-| [HDFS-6282](https://issues.apache.org/jira/browse/HDFS-6282) | re-add testIncludeByRegistrationName | Minor | test | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-6279](https://issues.apache.org/jira/browse/HDFS-6279) | Create new index page for JN / DN | Major | . | Haohui Mai | Haohui Mai |
+| [YARN-1889](https://issues.apache.org/jira/browse/YARN-1889) | In Fair Scheduler, avoid creating objects on each call to AppSchedulable comparator | Minor | scheduler | Hong Zhiguo | Hong Zhiguo |
+| [HDFS-6167](https://issues.apache.org/jira/browse/HDFS-6167) | Relocate the non-public API classes in the hdfs.client package | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-10454](https://issues.apache.org/jira/browse/HADOOP-10454) | Provide FileContext version of har file system | Major | . | Kihwal Lee | Kihwal Lee |
+| [HDFS-6191](https://issues.apache.org/jira/browse/HDFS-6191) | Disable quota checks when replaying edit log. | Major | namenode | Kihwal Lee | Kihwal Lee |
+| [HDFS-6225](https://issues.apache.org/jira/browse/HDFS-6225) | Remove the o.a.h.hdfs.server.common.UpgradeStatusReport | Major | . | Haohui Mai | Haohui Mai |
+| [MAPREDUCE-5825](https://issues.apache.org/jira/browse/MAPREDUCE-5825) | Provide diagnostics for reducers killed during ramp down | Major | mr-am | Gera Shegalov | Gera Shegalov |
+| [YARN-1923](https://issues.apache.org/jira/browse/YARN-1923) | Make FairScheduler resource ratio calculations terminate faster | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot |
+| [YARN-1870](https://issues.apache.org/jira/browse/YARN-1870) | FileInputStream is not closed in ProcfsBasedProcessTree#constructProcessSMAPInfo() | Minor | resourcemanager | Ted Yu | Fengdong Yu |
+| [HDFS-6256](https://issues.apache.org/jira/browse/HDFS-6256) | Clean up ImageVisitor and SpotCheckImageVisitor | Major | tools | Akira Ajisaka | Akira Ajisaka |
| [HDFS-6278](https://issues.apache.org/jira/browse/HDFS-6278) | Create HTML5-based UI for SNN | Major | . | Haohui Mai | Haohui Mai |
+| [HDFS-6279](https://issues.apache.org/jira/browse/HDFS-6279) | Create new index page for JN / DN | Major | . | Haohui Mai | Haohui Mai |
+| [HDFS-5693](https://issues.apache.org/jira/browse/HDFS-5693) | Few NN metrics data points were collected via JMX when NN is under heavy load | Major | namenode | Ming Ma | Ming Ma |
| [HDFS-6273](https://issues.apache.org/jira/browse/HDFS-6273) | Config options to allow wildcard endpoints for namenode HTTP and HTTPS servers | Major | namenode | Arpit Agarwal | Arpit Agarwal |
-| [HDFS-6269](https://issues.apache.org/jira/browse/HDFS-6269) | NameNode Audit Log should differentiate between webHDFS open and HDFS open. | Major | namenode, webhdfs | Eric Payne | Eric Payne |
-| [HDFS-6268](https://issues.apache.org/jira/browse/HDFS-6268) | Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found | Minor | . | Andrew Wang | Andrew Wang |
+| [HADOOP-10539](https://issues.apache.org/jira/browse/HADOOP-10539) | Provide backward compatibility for ProxyUsers.authorize() call | Minor | security | Benoy Antony | Benoy Antony |
+| [HADOOP-10535](https://issues.apache.org/jira/browse/HADOOP-10535) | Make the retry numbers in ActiveStandbyElector configurable | Minor | . | Jing Zhao | Jing Zhao |
+| [HDFS-6282](https://issues.apache.org/jira/browse/HDFS-6282) | re-add testIncludeByRegistrationName | Minor | test | Colin P. McCabe | Colin P. McCabe |
| [HDFS-6266](https://issues.apache.org/jira/browse/HDFS-6266) | Identify full path for a given INode | Major | snapshots | Jing Zhao | Jing Zhao |
-| [HDFS-6256](https://issues.apache.org/jira/browse/HDFS-6256) | Clean up ImageVisitor and SpotCheckImageVisitor | Major | tools | Akira AJISAKA | Akira AJISAKA |
-| [HDFS-6225](https://issues.apache.org/jira/browse/HDFS-6225) | Remove the o.a.h.hdfs.server.common.UpgradeStatusReport | Major | . | Haohui Mai | Haohui Mai |
-| [HDFS-6191](https://issues.apache.org/jira/browse/HDFS-6191) | Disable quota checks when replaying edit log. | Major | namenode | Kihwal Lee | Kihwal Lee |
-| [HDFS-6167](https://issues.apache.org/jira/browse/HDFS-6167) | Relocate the non-public API classes in the hdfs.client package | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-6158](https://issues.apache.org/jira/browse/HDFS-6158) | Clean up dead code for OfflineImageViewer | Major | . | Haohui Mai | Haohui Mai |
-| [HDFS-6110](https://issues.apache.org/jira/browse/HDFS-6110) | adding more slow action log in critical write path | Major | datanode | Liang Xie | Liang Xie |
-| [HDFS-6109](https://issues.apache.org/jira/browse/HDFS-6109) | let sync\_file\_range() system call run in background | Major | datanode | Liang Xie | Liang Xie |
-| [HDFS-6007](https://issues.apache.org/jira/browse/HDFS-6007) | Update documentation about short-circuit local reads | Minor | documentation | Masatake Iwasaki | |
-| [HDFS-5693](https://issues.apache.org/jira/browse/HDFS-5693) | Few NN metrics data points were collected via JMX when NN is under heavy load | Major | namenode | Ming Ma | Ming Ma |
-| [HDFS-5683](https://issues.apache.org/jira/browse/HDFS-5683) | Better audit log messages for caching operations | Major | namenode | Andrew Wang | Abhiraj Butala |
-| [HDFS-5381](https://issues.apache.org/jira/browse/HDFS-5381) | ExtendedBlock#hashCode should use both blockId and block pool ID | Minor | federation | Colin Patrick McCabe | Benoy Antony |
-| [HDFS-5196](https://issues.apache.org/jira/browse/HDFS-5196) | Provide more snapshot information in WebUI | Minor | snapshots | Haohui Mai | Shinichi Yamashita |
+| [YARN-483](https://issues.apache.org/jira/browse/YARN-483) | Improve documentation on log aggregation in yarn-default.xml | Major | documentation | Sandy Ryza | Akira Ajisaka |
+| [HADOOP-10322](https://issues.apache.org/jira/browse/HADOOP-10322) | Add ability to read principal names from a keytab | Major | security | Benoy Antony | Benoy Antony |
+| [MAPREDUCE-5812](https://issues.apache.org/jira/browse/MAPREDUCE-5812) | Make job context available to OutputCommitter.isRecoverySupported() | Major | mr-am | Mohammad Kamrul Islam | Mohammad Kamrul Islam |
+| [HDFS-6269](https://issues.apache.org/jira/browse/HDFS-6269) | NameNode Audit Log should differentiate between webHDFS open and HDFS open. | Major | namenode, webhdfs | Eric Payne | Eric Payne |
+| [HDFS-6304](https://issues.apache.org/jira/browse/HDFS-6304) | Consolidate the logic of path resolution in FSDirectory | Major | namenode | Haohui Mai | Haohui Mai |
+| [HADOOP-10549](https://issues.apache.org/jira/browse/HADOOP-10549) | MAX\_SUBST and varPat should be final in Configuration.java | Major | conf | Gera Shegalov | Gera Shegalov |
| [HDFS-5168](https://issues.apache.org/jira/browse/HDFS-5168) | BlockPlacementPolicy does not work for cross node group dependencies | Critical | namenode | Nikola Vujic | Nikola Vujic |
+| [HDFS-6295](https://issues.apache.org/jira/browse/HDFS-6295) | Add "decommissioning" state and node state filtering to dfsadmin | Major | . | Andrew Wang | Andrew Wang |
+| [MAPREDUCE-5402](https://issues.apache.org/jira/browse/MAPREDUCE-5402) | DynamicInputFormat should allow overriding of MAX\_CHUNKS\_TOLERABLE | Major | distcp, mrv2 | David Rosenstrauch | Tsuyoshi Ozawa |
+| [HADOOP-10556](https://issues.apache.org/jira/browse/HADOOP-10556) | Add toLowerCase support to auth\_to\_local rules for service name | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-5381](https://issues.apache.org/jira/browse/HDFS-5381) | ExtendedBlock#hashCode should use both blockId and block pool ID | Minor | federation | Colin P. McCabe | Benoy Antony |
+| [YARN-1987](https://issues.apache.org/jira/browse/YARN-1987) | Wrapper for leveldb DBIterator to aid in handling database exceptions | Major | . | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-5774](https://issues.apache.org/jira/browse/MAPREDUCE-5774) | Job overview in History UI should list reducer phases in chronological order | Trivial | jobhistoryserver | Gera Shegalov | Gera Shegalov |
+| [HDFS-6334](https://issues.apache.org/jira/browse/HDFS-6334) | Client failover proxy provider for IP failover based NN HA | Major | . | Kihwal Lee | Kihwal Lee |
+| [YARN-1751](https://issues.apache.org/jira/browse/YARN-1751) | Improve MiniYarnCluster for log aggregation testing | Major | nodemanager | Ming Ma | Ming Ma |
+| [HADOOP-10572](https://issues.apache.org/jira/browse/HADOOP-10572) | Example NFS mount command must pass noacl as it isn't supported by the server yet | Trivial | nfs | Harsh J | Harsh J |
| [HDFS-2949](https://issues.apache.org/jira/browse/HDFS-2949) | HA: Add check to active state transition to prevent operator-induced split brain | Major | ha, namenode | Todd Lipcon | Rushabh S Shah |
-| [HDFS-2006](https://issues.apache.org/jira/browse/HDFS-2006) | ability to support storing extended attributes per file | Major | namenode | dhruba borthakur | Yi Liu |
-| [MAPREDUCE-5899](https://issues.apache.org/jira/browse/MAPREDUCE-5899) | Support incremental data copy in DistCp | Major | distcp | Jing Zhao | Jing Zhao |
-| [MAPREDUCE-5896](https://issues.apache.org/jira/browse/MAPREDUCE-5896) | InputSplits should indicate which locations have the block cached in memory | Major | . | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5886](https://issues.apache.org/jira/browse/MAPREDUCE-5886) | Allow wordcount example job to accept multiple input paths. | Minor | examples | Chris Nauroth | Chris Nauroth |
| [MAPREDUCE-5861](https://issues.apache.org/jira/browse/MAPREDUCE-5861) | finishedSubMaps field in LocalContainerLauncher does not need to be volatile | Minor | . | Ted Yu | Tsuyoshi Ozawa |
-| [MAPREDUCE-5825](https://issues.apache.org/jira/browse/MAPREDUCE-5825) | Provide diagnostics for reducers killed during ramp down | Major | mr-am | Gera Shegalov | Gera Shegalov |
-| [MAPREDUCE-5812](https://issues.apache.org/jira/browse/MAPREDUCE-5812) | Make job context available to OutputCommitter.isRecoverySupported() | Major | mr-am | Mohammad Kamrul Islam | Mohammad Kamrul Islam |
+| [HDFS-5683](https://issues.apache.org/jira/browse/HDFS-5683) | Better audit log messages for caching operations | Major | namenode | Andrew Wang | Abhiraj Butala |
| [MAPREDUCE-5809](https://issues.apache.org/jira/browse/MAPREDUCE-5809) | Enhance distcp to support preserving HDFS ACLs. | Major | distcp | Chris Nauroth | Chris Nauroth |
-| [MAPREDUCE-5774](https://issues.apache.org/jira/browse/MAPREDUCE-5774) | Job overview in History UI should list reducer phases in chronological order | Trivial | jobhistoryserver | Gera Shegalov | Gera Shegalov |
-| [MAPREDUCE-5402](https://issues.apache.org/jira/browse/MAPREDUCE-5402) | DynamicInputFormat should allow overriding of MAX\_CHUNKS\_TOLERABLE | Major | distcp, mrv2 | David Rosenstrauch | Tsuyoshi Ozawa |
-| [MAPREDUCE-5014](https://issues.apache.org/jira/browse/MAPREDUCE-5014) | Extending DistCp through a custom CopyListing is not possible | Major | distcp | Srikanth Sundarrajan | Srikanth Sundarrajan |
-| [YARN-2335](https://issues.apache.org/jira/browse/YARN-2335) | Annotate all hadoop-sls APIs as @Private | Minor | . | Wei Yan | Wei Yan |
-| [YARN-2300](https://issues.apache.org/jira/browse/YARN-2300) | Document better sample requests for RM web services for submitting apps | Major | documentation | Varun Vasudev | Varun Vasudev |
-| [YARN-2195](https://issues.apache.org/jira/browse/YARN-2195) | Clean a piece of code in ResourceRequest | Trivial | . | Wei Yan | Wei Yan |
-| [YARN-2159](https://issues.apache.org/jira/browse/YARN-2159) | Better logging in SchedulerNode#allocateContainer | Trivial | resourcemanager | Ray Chiang | Ray Chiang |
+| [HADOOP-10614](https://issues.apache.org/jira/browse/HADOOP-10614) | CBZip2InputStream is not threadsafe | Major | . | Xiangrui Meng | Xiangrui Meng |
+| [HDFS-6432](https://issues.apache.org/jira/browse/HDFS-6432) | Add snapshot related APIs to webhdfs | Major | namenode, webhdfs | Suresh Srinivas | Jing Zhao |
+| [HDFS-6396](https://issues.apache.org/jira/browse/HDFS-6396) | Remove support for ACL feature from INodeSymlink | Minor | . | Andrew Wang | Charles Lamb |
+| [HDFS-6433](https://issues.apache.org/jira/browse/HDFS-6433) | Replace BytesMoved class with AtomicLong | Major | balancer & mover | Benoy Antony | Benoy Antony |
| [YARN-2089](https://issues.apache.org/jira/browse/YARN-2089) | FairScheduler: QueuePlacementPolicy and QueuePlacementRule are missing audience annotations | Major | scheduler | Anubhav Dhoot | zhihai xu |
-| [YARN-2072](https://issues.apache.org/jira/browse/YARN-2072) | RM/NM UIs and webservices are missing vcore information | Major | nodemanager, resourcemanager, webapp | Nathan Roberts | Nathan Roberts |
+| [MAPREDUCE-5899](https://issues.apache.org/jira/browse/MAPREDUCE-5899) | Support incremental data copy in DistCp | Major | distcp | Jing Zhao | Jing Zhao |
+| [HADOOP-10618](https://issues.apache.org/jira/browse/HADOOP-10618) | Remove SingleNodeSetup.apt.vm | Minor | documentation | Akira Ajisaka | Akira Ajisaka |
+| [YARN-2012](https://issues.apache.org/jira/browse/YARN-2012) | Fair Scheduler: allow default queue placement rule to take an arbitrary queue | Major | scheduler | Ashwin Shankar | Ashwin Shankar |
+| [HDFS-6110](https://issues.apache.org/jira/browse/HDFS-6110) | adding more slow action log in critical write path | Major | datanode | Liang Xie | Liang Xie |
+| [HDFS-6416](https://issues.apache.org/jira/browse/HDFS-6416) | Use Time#monotonicNow in OpenFileCtx and OpenFileCtxCatch to avoid system clock bugs | Minor | nfs | Brandon Li | Abhiraj Butala |
+| [HDFS-6448](https://issues.apache.org/jira/browse/HDFS-6448) | BlockReaderLocalLegacy should set socket timeout based on conf.socketTimeout | Major | hdfs-client | Liang Xie | Liang Xie |
+| [HDFS-6442](https://issues.apache.org/jira/browse/HDFS-6442) | Fix TestEditLogAutoroll and TestStandbyCheckpoints failure caused by port conficts | Minor | test | Zesheng Wu | Zesheng Wu |
+| [HDFS-6453](https://issues.apache.org/jira/browse/HDFS-6453) | use Time#monotonicNow to avoid system clock reset | Major | datanode, namenode | Liang Xie | Liang Xie |
+| [HDFS-6356](https://issues.apache.org/jira/browse/HDFS-6356) | Fix typo in DatanodeLayoutVersion | Trivial | datanode | Tulasi G | Tulasi G |
+| [HDFS-6447](https://issues.apache.org/jira/browse/HDFS-6447) | balancer should timestamp the completion message | Trivial | balancer & mover | Allen Wittenauer | Juan Yu |
+| [HDFS-6463](https://issues.apache.org/jira/browse/HDFS-6463) | Clarify behavior of AclStorage#createFsPermissionForExtendedAcl in comments. | Trivial | namenode | Aaron T. Myers | Chris Nauroth |
+| [HDFS-6375](https://issues.apache.org/jira/browse/HDFS-6375) | Listing extended attributes with the search permission | Major | namenode | Andrew Wang | Charles Lamb |
+| [HDFS-6109](https://issues.apache.org/jira/browse/HDFS-6109) | let sync\_file\_range() system call run in background | Major | datanode | Liang Xie | Liang Xie |
+| [HDFS-6268](https://issues.apache.org/jira/browse/HDFS-6268) | Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found | Minor | . | Andrew Wang | Andrew Wang |
| [YARN-2061](https://issues.apache.org/jira/browse/YARN-2061) | Revisit logging levels in ZKRMStateStore | Minor | resourcemanager | Karthik Kambatla | Ray Chiang |
+| [HDFS-6369](https://issues.apache.org/jira/browse/HDFS-6369) | Document that BlockReader#available() can return more bytes than are remaining in the block | Trivial | . | Ted Yu | Ted Yu |
+| [HDFS-6297](https://issues.apache.org/jira/browse/HDFS-6297) | Add CLI testcases to reflect new features of dfs and dfsadmin | Major | test | Dasha Boudnik | Dasha Boudnik |
| [YARN-2030](https://issues.apache.org/jira/browse/YARN-2030) | Use StateMachine to simplify handleStoreEvent() in RMStateStore | Major | . | Junping Du | Binglin Chang |
-| [YARN-2012](https://issues.apache.org/jira/browse/YARN-2012) | Fair Scheduler: allow default queue placement rule to take an arbitrary queue | Major | scheduler | Ashwin Shankar | Ashwin Shankar |
-| [YARN-1987](https://issues.apache.org/jira/browse/YARN-1987) | Wrapper for leveldb DBIterator to aid in handling database exceptions | Major | . | Jason Lowe | Jason Lowe |
-| [YARN-1923](https://issues.apache.org/jira/browse/YARN-1923) | Make FairScheduler resource ratio calculations terminate faster | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot |
-| [YARN-1889](https://issues.apache.org/jira/browse/YARN-1889) | In Fair Scheduler, avoid creating objects on each call to AppSchedulable comparator | Minor | scheduler | Hong Zhiguo | Hong Zhiguo |
-| [YARN-1870](https://issues.apache.org/jira/browse/YARN-1870) | FileInputStream is not closed in ProcfsBasedProcessTree#constructProcessSMAPInfo() | Minor | resourcemanager | Ted Yu | Fengdong Yu |
-| [YARN-1845](https://issues.apache.org/jira/browse/YARN-1845) | Elapsed time for failed tasks that never started is wrong | Major | . | Rushabh S Shah | Rushabh S Shah |
-| [YARN-1751](https://issues.apache.org/jira/browse/YARN-1751) | Improve MiniYarnCluster for log aggregation testing | Major | nodemanager | Ming Ma | Ming Ma |
-| [YARN-1561](https://issues.apache.org/jira/browse/YARN-1561) | Fix a generic type warning in FairScheduler | Minor | scheduler | Junping Du | Chen He |
-| [YARN-1479](https://issues.apache.org/jira/browse/YARN-1479) | Invalid NaN values in Hadoop REST API JSON response | Major | . | Kendall Thrapp | Chen He |
+| [MAPREDUCE-5886](https://issues.apache.org/jira/browse/MAPREDUCE-5886) | Allow wordcount example job to accept multiple input paths. | Minor | examples | Chris Nauroth | Chris Nauroth |
| [YARN-1424](https://issues.apache.org/jira/browse/YARN-1424) | RMAppAttemptImpl should return the DummyApplicationResourceUsageReport for all invalid accesses | Minor | resourcemanager | Sandy Ryza | Ray Chiang |
+| [HDFS-6503](https://issues.apache.org/jira/browse/HDFS-6503) | Fix typo of DFSAdmin restoreFailedStorage | Minor | tools | Zesheng Wu | Zesheng Wu |
+| [HDFS-2006](https://issues.apache.org/jira/browse/HDFS-2006) | ability to support storing extended attributes per file | Major | namenode | dhruba borthakur | Yi Liu |
+| [HADOOP-10376](https://issues.apache.org/jira/browse/HADOOP-10376) | Refactor refresh\*Protocols into a single generic refreshConfigProtocol | Minor | . | Chris Li | Chris Li |
+| [HADOOP-10561](https://issues.apache.org/jira/browse/HADOOP-10561) | Copy command with preserve option should handle Xattrs | Major | fs | Uma Maheswara Rao G | Yi Liu |
+| [HDFS-6460](https://issues.apache.org/jira/browse/HDFS-6460) | Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance | Minor | . | Yongjun Zhang | Yongjun Zhang |
+| [HADOOP-6350](https://issues.apache.org/jira/browse/HADOOP-6350) | Documenting Hadoop metrics | Major | documentation, metrics | Hong Tang | Akira Ajisaka |
+| [HADOOP-10691](https://issues.apache.org/jira/browse/HADOOP-10691) | Improve the readability of 'hadoop fs -help' | Minor | tools | Lei (Eddy) Xu | Lei (Eddy) Xu |
+| [HADOOP-10688](https://issues.apache.org/jira/browse/HADOOP-10688) | Expose thread-level FileSystem StatisticsData | Major | fs | Sandy Ryza | Sandy Ryza |
+| [HDFS-6529](https://issues.apache.org/jira/browse/HDFS-6529) | Trace logging for RemoteBlockReader2 to identify remote datanode and file being read | Minor | hdfs-client | Anubhav Dhoot | Anubhav Dhoot |
+| [HDFS-6499](https://issues.apache.org/jira/browse/HDFS-6499) | Use NativeIO#renameTo instead of File#renameTo in FileJournalManager | Major | namenode | Yongjun Zhang | Yongjun Zhang |
+| [YARN-2159](https://issues.apache.org/jira/browse/YARN-2159) | Better logging in SchedulerNode#allocateContainer | Trivial | resourcemanager | Ray Chiang | Ray Chiang |
+| [HDFS-6528](https://issues.apache.org/jira/browse/HDFS-6528) | Add XAttrs to TestOfflineImageViewer | Minor | test | Stephen Chu | Stephen Chu |
+| [HADOOP-10666](https://issues.apache.org/jira/browse/HADOOP-10666) | Remove Copyright /d/d/d/d Apache Software Foundation from the source files license header | Minor | documentation | Henry Saputra | Henry Saputra |
+| [HADOOP-10557](https://issues.apache.org/jira/browse/HADOOP-10557) | FsShell -cp -pa option for preserving extended ACLs | Major | fs | Akira Ajisaka | Akira Ajisaka |
+| [HDFS-6545](https://issues.apache.org/jira/browse/HDFS-6545) | Finalizing rolling upgrade can make NN unavailable for a long duration | Critical | . | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-5896](https://issues.apache.org/jira/browse/MAPREDUCE-5896) | InputSplits should indicate which locations have the block cached in memory | Major | . | Sandy Ryza | Sandy Ryza |
+| [HDFS-6492](https://issues.apache.org/jira/browse/HDFS-6492) | Support create-time xattrs and atomically setting multiple xattrs | Major | namenode | Andrew Wang | Andrew Wang |
+| [HDFS-6403](https://issues.apache.org/jira/browse/HDFS-6403) | Add metrics for log warnings reported by JVM pauses | Major | datanode, namenode | Yongjun Zhang | Yongjun Zhang |
+| [HDFS-6507](https://issues.apache.org/jira/browse/HDFS-6507) | Improve DFSAdmin to support HA cluster better | Major | tools | Zesheng Wu | Zesheng Wu |
+| [HDFS-6580](https://issues.apache.org/jira/browse/HDFS-6580) | FSNamesystem.mkdirsInt should call the getAuditFileInfo() wrapper | Major | namenode | Zhilei Xu | Zhilei Xu |
+| [HDFS-6578](https://issues.apache.org/jira/browse/HDFS-6578) | add toString method to DatanodeStorage for easier debugging | Major | . | Yongjun Zhang | Yongjun Zhang |
+| [HADOOP-10665](https://issues.apache.org/jira/browse/HADOOP-10665) | Make Hadoop Authentication Handler loads case in-sensitive | Minor | security | Benoy Antony | Benoy Antony |
+| [YARN-2195](https://issues.apache.org/jira/browse/YARN-2195) | Clean a piece of code in ResourceRequest | Trivial | . | Wei Yan | Wei Yan |
+| [YARN-2072](https://issues.apache.org/jira/browse/YARN-2072) | RM/NM UIs and webservices are missing vcore information | Major | nodemanager, resourcemanager, webapp | Nathan Roberts | Nathan Roberts |
+| [HDFS-6593](https://issues.apache.org/jira/browse/HDFS-6593) | Move SnapshotDiffInfo out of INodeDirectorySnapshottable | Minor | namenode, snapshots | Jing Zhao | Jing Zhao |
+| [HADOOP-10747](https://issues.apache.org/jira/browse/HADOOP-10747) | Support configurable retries on SASL connection failures in RPC client. | Minor | ipc | Chris Nauroth | Chris Nauroth |
+| [HADOOP-10674](https://issues.apache.org/jira/browse/HADOOP-10674) | Rewrite the PureJavaCrc32 loop for performance improvement | Major | performance, util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-6595](https://issues.apache.org/jira/browse/HDFS-6595) | Configure the maximum threads allowed for balancing on datanodes | Minor | balancer & mover, datanode | Benoy Antony | Benoy Antony |
+| [HADOOP-8943](https://issues.apache.org/jira/browse/HADOOP-8943) | Support multiple group mapping providers | Major | security | Kai Zheng | Kai Zheng |
| [YARN-614](https://issues.apache.org/jira/browse/YARN-614) | Separate AM failures from hardware failure or YARN error and do not count them to AM retry count | Major | resourcemanager | Bikas Saha | Xuan Gong |
-| [YARN-483](https://issues.apache.org/jira/browse/YARN-483) | Improve documentation on log aggregation in yarn-default.xml | Major | documentation | Sandy Ryza | Akira AJISAKA |
+| [HDFS-6558](https://issues.apache.org/jira/browse/HDFS-6558) | Missing '\\n' in the description of dfsadmin -rollingUpgrade | Trivial | . | Akira Ajisaka | Chen He |
+| [HADOOP-10767](https://issues.apache.org/jira/browse/HADOOP-10767) | Clean up unused code in Ls shell command. | Trivial | fs | Chris Nauroth | Chris Nauroth |
+| [HDFS-6603](https://issues.apache.org/jira/browse/HDFS-6603) | Add XAttr with ACL test | Minor | test | Stephen Chu | Stephen Chu |
+| [HADOOP-9495](https://issues.apache.org/jira/browse/HADOOP-9495) | Define behaviour of Seekable.seek(), write tests, fix all hadoop implementations for compliance | Major | fs | Steve Loughran | Steve Loughran |
+| [HADOOP-10458](https://issues.apache.org/jira/browse/HADOOP-10458) | swifts should throw FileAlreadyExistsException on attempt to overwrite file | Minor | fs | Steve Loughran | Steve Loughran |
+| [HADOOP-9361](https://issues.apache.org/jira/browse/HADOOP-9361) | Strictly define the expected behavior of filesystem APIs and write tests to verify compliance | Blocker | fs, test | Steve Loughran | Steve Loughran |
+| [HDFS-6620](https://issues.apache.org/jira/browse/HDFS-6620) | Snapshot docs should specify about preserve options with cp command | Major | namenode | Uma Maheswara Rao G | Stephen Chu |
+| [HADOOP-10782](https://issues.apache.org/jira/browse/HADOOP-10782) | Typo in DataChecksum classs | Trivial | . | Jingguo Yao | Jingguo Yao |
+| [YARN-2300](https://issues.apache.org/jira/browse/YARN-2300) | Document better sample requests for RM web services for submitting apps | Major | documentation | Varun Vasudev | Varun Vasudev |
+| [YARN-2335](https://issues.apache.org/jira/browse/YARN-2335) | Annotate all hadoop-sls APIs as @Private | Minor | . | Wei Yan | Wei Yan |
+| [HADOOP-10896](https://issues.apache.org/jira/browse/HADOOP-10896) | Update compatibility doc to capture visibility of un-annotated classes/ methods | Blocker | documentation | Karthik Kambatla | Karthik Kambatla |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10910](https://issues.apache.org/jira/browse/HADOOP-10910) | Increase findbugs maxHeap size | Blocker | . | Andrew Wang | Andrew Wang |
-| [HADOOP-10890](https://issues.apache.org/jira/browse/HADOOP-10890) | TestDFVariations.testMount fails intermittently | Major | . | Yongjun Zhang | Yongjun Zhang |
-| [HADOOP-10872](https://issues.apache.org/jira/browse/HADOOP-10872) | TestPathData fails intermittently with "Mkdirs failed to create d1" | Major | fs | Yongjun Zhang | Yongjun Zhang |
-| [HADOOP-10801](https://issues.apache.org/jira/browse/HADOOP-10801) | Fix dead link in site.xml | Major | documentation | Akira AJISAKA | Akira AJISAKA |
-| [HADOOP-10746](https://issues.apache.org/jira/browse/HADOOP-10746) | TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC | Major | test | Jinghui Wang | Jinghui Wang |
-| [HADOOP-10739](https://issues.apache.org/jira/browse/HADOOP-10739) | Renaming a file into a directory containing the same filename results in a confusing I/O error | Major | fs | Jason Lowe | Chang Li |
-| [HADOOP-10737](https://issues.apache.org/jira/browse/HADOOP-10737) | S3n silent failure on copy, data loss on rename | Major | fs/s3 | Gian Merlino | Steve Loughran |
-| [HADOOP-10716](https://issues.apache.org/jira/browse/HADOOP-10716) | Cannot use more than 1 har filesystem | Critical | conf, fs | Daryn Sharp | Rushabh S Shah |
-| [HADOOP-10711](https://issues.apache.org/jira/browse/HADOOP-10711) | Cleanup some extra dependencies from hadoop-auth | Major | security | Robert Kanter | Robert Kanter |
-| [HADOOP-10710](https://issues.apache.org/jira/browse/HADOOP-10710) | hadoop.auth cookie is not properly constructed according to RFC2109 | Major | security | Alejandro Abdelnur | Juan Yu |
-| [HADOOP-10702](https://issues.apache.org/jira/browse/HADOOP-10702) | KerberosAuthenticationHandler does not log the principal names correctly | Minor | security | Benoy Antony | Benoy Antony |
-| [HADOOP-10701](https://issues.apache.org/jira/browse/HADOOP-10701) | NFS should not validate the access premission only based on the user's primary group | Major | nfs | Premchandra Preetham Kukillaya | Harsh J |
-| [HADOOP-10699](https://issues.apache.org/jira/browse/HADOOP-10699) | Fix build native library on mac osx | Major | . | Kirill A. Korinskiy | Binglin Chang |
-| [HADOOP-10686](https://issues.apache.org/jira/browse/HADOOP-10686) | Writables are not always configured | Major | . | Abraham Elmahrek | Abraham Elmahrek |
-| [HADOOP-10683](https://issues.apache.org/jira/browse/HADOOP-10683) | Users authenticated with KERBEROS are recorded as being authenticated with SIMPLE | Major | security | Benoy Antony | Benoy Antony |
-| [HADOOP-10678](https://issues.apache.org/jira/browse/HADOOP-10678) | SecurityUtil has unnecessary synchronization on collection used for only tests | Minor | security | Benoy Antony | Benoy Antony |
-| [HADOOP-10664](https://issues.apache.org/jira/browse/HADOOP-10664) | TestNetUtils.testNormalizeHostName fails | Major | . | Chen He | Aaron T. Myers |
-| [HADOOP-10660](https://issues.apache.org/jira/browse/HADOOP-10660) | GraphiteSink should implement Closeable | Major | . | Ted Yu | Chen He |
-| [HADOOP-10658](https://issues.apache.org/jira/browse/HADOOP-10658) | SSLFactory expects truststores being configured | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-10657](https://issues.apache.org/jira/browse/HADOOP-10657) | Have RetryInvocationHandler log failover attempt at INFO level | Major | . | Ming Ma | Ming Ma |
-| [HADOOP-10656](https://issues.apache.org/jira/browse/HADOOP-10656) | The password keystore file is not picked by LDAP group mapping | Major | security | Brandon Li | Brandon Li |
-| [HADOOP-10647](https://issues.apache.org/jira/browse/HADOOP-10647) | String Format Exception in SwiftNativeFileSystemStore.java | Minor | fs/swift | Gene Kim | Gene Kim |
-| [HADOOP-10639](https://issues.apache.org/jira/browse/HADOOP-10639) | FileBasedKeyStoresFactory initialization is not using default for SSL\_REQUIRE\_CLIENT\_CERT\_KEY | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-10638](https://issues.apache.org/jira/browse/HADOOP-10638) | Updating hadoop-daemon.sh to work as expected when nfs is started as a privileged user. | Major | nfs | Manikandan Narayanaswamy | Manikandan Narayanaswamy |
-| [HADOOP-10630](https://issues.apache.org/jira/browse/HADOOP-10630) | Possible race condition in RetryInvocationHandler | Major | . | Jing Zhao | Jing Zhao |
-| [HADOOP-10625](https://issues.apache.org/jira/browse/HADOOP-10625) | Configuration: names should be trimmed when putting/getting to properties | Major | conf | Wangda Tan | Wangda Tan |
-| [HADOOP-10622](https://issues.apache.org/jira/browse/HADOOP-10622) | Shell.runCommand can deadlock | Critical | . | Jason Lowe | Gera Shegalov |
-| [HADOOP-10609](https://issues.apache.org/jira/browse/HADOOP-10609) | .gitignore should ignore .orig and .rej files | Major | . | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-10602](https://issues.apache.org/jira/browse/HADOOP-10602) | Documentation has broken "Go Back" hyperlinks. | Trivial | documentation | Chris Nauroth | Akira AJISAKA |
-| [HADOOP-10590](https://issues.apache.org/jira/browse/HADOOP-10590) | ServiceAuthorizationManager is not threadsafe | Major | security | Benoy Antony | Benoy Antony |
-| [HADOOP-10589](https://issues.apache.org/jira/browse/HADOOP-10589) | NativeS3FileSystem throw NullPointerException when the file is empty | Major | fs/s3 | shuisheng wei | Steve Loughran |
-| [HADOOP-10588](https://issues.apache.org/jira/browse/HADOOP-10588) | Workaround for jetty6 acceptor startup issue | Major | . | Kihwal Lee | Kihwal Lee |
-| [HADOOP-10585](https://issues.apache.org/jira/browse/HADOOP-10585) | Retry polices ignore interrupted exceptions | Critical | ipc | Daryn Sharp | Daryn Sharp |
-| [HADOOP-10581](https://issues.apache.org/jira/browse/HADOOP-10581) | TestUserGroupInformation#testGetServerSideGroups fails because groups stored in Set and ArrayList are compared | Major | . | Mit Desai | Mit Desai |
-| [HADOOP-10568](https://issues.apache.org/jira/browse/HADOOP-10568) | Add s3 server-side encryption | Major | fs/s3 | David S. Wang | David S. Wang |
-| [HADOOP-10547](https://issues.apache.org/jira/browse/HADOOP-10547) | Give SaslPropertiesResolver.getDefaultProperties() public scope | Major | security | Jason Dere | Benoy Antony |
-| [HADOOP-10543](https://issues.apache.org/jira/browse/HADOOP-10543) | RemoteException's unwrapRemoteException method failed for PathIOException | Major | . | Yongjun Zhang | Yongjun Zhang |
-| [HADOOP-10541](https://issues.apache.org/jira/browse/HADOOP-10541) | InputStream in MiniKdc#initKDCServer for minikdc.ldiff is not closed | Minor | test | Ted Yu | Swarnim Kulkarni |
-| [HADOOP-10540](https://issues.apache.org/jira/browse/HADOOP-10540) | Datanode upgrade in Windows fails with hardlink error. | Major | tools | Huan Huang | Arpit Agarwal |
-| [HADOOP-10533](https://issues.apache.org/jira/browse/HADOOP-10533) | S3 input stream NPEs in MapReduce job | Minor | fs/s3 | Benjamin Kim | Steve Loughran |
-| [HADOOP-10531](https://issues.apache.org/jira/browse/HADOOP-10531) | hadoop-config.sh - bug in --hosts argument | Major | . | Sebastien Barrier | Sebastien Barrier |
-| [HADOOP-10526](https://issues.apache.org/jira/browse/HADOOP-10526) | Chance for Stream leakage in CompressorStream | Minor | . | SreeHari | Rushabh S Shah |
-| [HADOOP-10517](https://issues.apache.org/jira/browse/HADOOP-10517) | InputStream is not closed in two methods of JarFinder | Minor | test, util | Ted Yu | Ted Yu |
-| [HADOOP-10508](https://issues.apache.org/jira/browse/HADOOP-10508) | RefreshCallQueue fails when authorization is enabled | Major | ipc | Chris Li | Chris Li |
-| [HADOOP-10500](https://issues.apache.org/jira/browse/HADOOP-10500) | TestDoAsEffectiveUser fails on JDK7 due to failure to reset proxy user configuration. | Trivial | security, test | Chris Nauroth | Chris Nauroth |
-| [HADOOP-10496](https://issues.apache.org/jira/browse/HADOOP-10496) | Metrics system FileSink can leak file descriptor. | Major | metrics | Chris Nauroth | Chris Nauroth |
-| [HADOOP-10495](https://issues.apache.org/jira/browse/HADOOP-10495) | TestFileUtil fails on Windows due to bad permission assertions. | Trivial | fs, test | Chris Nauroth | Chris Nauroth |
-| [HADOOP-10489](https://issues.apache.org/jira/browse/HADOOP-10489) | UserGroupInformation#getTokens and UserGroupInformation#addToken can lead to ConcurrentModificationException | Major | . | Jing Zhao | Robert Kanter |
-| [HADOOP-10475](https://issues.apache.org/jira/browse/HADOOP-10475) | ConcurrentModificationException in AbstractDelegationTokenSelector.selectToken() | Major | security | Arpit Gupta | Jing Zhao |
-| [HADOOP-10468](https://issues.apache.org/jira/browse/HADOOP-10468) | TestMetricsSystemImpl.testMultiThreadedPublish fails intermediately | Blocker | . | Haohui Mai | Akira AJISAKA |
-| [HADOOP-10462](https://issues.apache.org/jira/browse/HADOOP-10462) | DF#getFilesystem is not parsing the command output | Major | . | Akira AJISAKA | Akira AJISAKA |
-| [HADOOP-10459](https://issues.apache.org/jira/browse/HADOOP-10459) | distcp V2 doesn't preserve root dir's attributes when -p is specified | Major | tools/distcp | Yongjun Zhang | Yongjun Zhang |
-| [HADOOP-10419](https://issues.apache.org/jira/browse/HADOOP-10419) | BufferedFSInputStream NPEs on getPos() on a closed stream | Minor | fs | Steve Loughran | Steve Loughran |
-| [HADOOP-10418](https://issues.apache.org/jira/browse/HADOOP-10418) | SaslRpcClient should not assume that remote principals are in the default\_realm | Major | security | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-10414](https://issues.apache.org/jira/browse/HADOOP-10414) | Incorrect property name for RefreshUserMappingProtocol in hadoop-policy.xml | Major | conf | Joey Echeverria | Joey Echeverria |
-| [HADOOP-10401](https://issues.apache.org/jira/browse/HADOOP-10401) | ShellBasedUnixGroupsMapping#getGroups does not always return primary group first | Major | util | Colin Patrick McCabe | Akira AJISAKA |
-| [HADOOP-10378](https://issues.apache.org/jira/browse/HADOOP-10378) | Typo in help printed by hdfs dfs -help | Major | . | Mit Desai | Mit Desai |
-| [HADOOP-10350](https://issues.apache.org/jira/browse/HADOOP-10350) | BUILDING.txt should mention openssl dependency required for hadoop-pipes | Major | . | Vinayakumar B | Vinayakumar B |
+| [HADOOP-9099](https://issues.apache.org/jira/browse/HADOOP-9099) | NetUtils.normalizeHostName fails on domains where UnknownHost resolves to an IP address | Minor | test | Ivan Mitic | Ivan Mitic |
| [HADOOP-10342](https://issues.apache.org/jira/browse/HADOOP-10342) | Extend UserGroupInformation to return a UGI given a preauthenticated kerberos Subject | Major | security | Larry McCay | Larry McCay |
-| [HADOOP-10332](https://issues.apache.org/jira/browse/HADOOP-10332) | HttpServer's jetty audit log always logs 200 OK | Major | . | Daryn Sharp | Jonathan Eagles |
-| [HADOOP-10312](https://issues.apache.org/jira/browse/HADOOP-10312) | Shell.ExitCodeException to have more useful toString | Minor | util | Steve Loughran | Steve Loughran |
-| [HADOOP-10251](https://issues.apache.org/jira/browse/HADOOP-10251) | Both NameNodes could be in STANDBY State if SNN network is unstable | Critical | ha | Vinayakumar B | Vinayakumar B |
-| [HADOOP-10158](https://issues.apache.org/jira/browse/HADOOP-10158) | SPNEGO should work with multiple interfaces/SPNs. | Critical | . | Kihwal Lee | Daryn Sharp |
-| [HADOOP-9919](https://issues.apache.org/jira/browse/HADOOP-9919) | Update hadoop-metrics2.properties examples to Yarn | Major | conf | Akira AJISAKA | Akira AJISAKA |
-| [HADOOP-9705](https://issues.apache.org/jira/browse/HADOOP-9705) | FsShell cp -p does not preserve directory attibutes | Major | fs | Stephen Chu | Akira AJISAKA |
-| [HADOOP-9559](https://issues.apache.org/jira/browse/HADOOP-9559) | When metrics system is restarted MBean names get incorrectly flagged as dupes | Major | metrics | Mostafa Elhemali | Mike Liddell |
-| [HADOOP-9555](https://issues.apache.org/jira/browse/HADOOP-9555) | HA functionality that uses ZooKeeper may experience inadvertent TCP RST and miss session expiration event due to bug in client connection management | Major | ha | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9099](https://issues.apache.org/jira/browse/HADOOP-9099) | NetUtils.normalizeHostName fails on domains where UnknownHost resolves to an IP address | Minor | test | Ivan Mitic | Ivan Mitic |
-| [HDFS-6793](https://issues.apache.org/jira/browse/HDFS-6793) | Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2 | Blocker | . | Juan Yu | Juan Yu |
-| [HDFS-6752](https://issues.apache.org/jira/browse/HDFS-6752) | Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit | Major | test | Vinayakumar B | Vinayakumar B |
-| [HDFS-6723](https://issues.apache.org/jira/browse/HDFS-6723) | New NN webUI no longer displays decommissioned state for dead node | Major | . | Ming Ma | Ming Ma |
-| [HDFS-6712](https://issues.apache.org/jira/browse/HDFS-6712) | Document HDFS Multihoming Settings | Major | documentation | Arpit Agarwal | Arpit Agarwal |
-| [HDFS-6703](https://issues.apache.org/jira/browse/HDFS-6703) | NFS: Files can be deleted from a read-only mount | Major | nfs | Abhiraj Butala | Srikanth Upputuri |
-| [HDFS-6696](https://issues.apache.org/jira/browse/HDFS-6696) | Name node cannot start if the path of a file under construction contains ".snapshot" | Blocker | . | Kihwal Lee | Andrew Wang |
-| [HDFS-6680](https://issues.apache.org/jira/browse/HDFS-6680) | BlockPlacementPolicyDefault does not choose favored nodes correctly | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-6647](https://issues.apache.org/jira/browse/HDFS-6647) | Edit log corruption when pipeline recovery occurs for deleted file present in snapshot | Blocker | namenode, snapshots | Aaron T. Myers | Kihwal Lee |
-| [HDFS-6632](https://issues.apache.org/jira/browse/HDFS-6632) | Reintroduce dfs.http.port / dfs.https.port in branch-2 | Major | . | Yongjun Zhang | Yongjun Zhang |
-| [HDFS-6631](https://issues.apache.org/jira/browse/HDFS-6631) | TestPread#testHedgedReadLoopTooManyTimes fails intermittently. | Major | hdfs-client, test | Chris Nauroth | Liang Xie |
-| [HDFS-6622](https://issues.apache.org/jira/browse/HDFS-6622) | Rename and AddBlock may race and produce invalid edits | Blocker | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-6618](https://issues.apache.org/jira/browse/HDFS-6618) | FSNamesystem#delete drops the FSN lock between removing INodes from the tree and deleting them from the inode map | Blocker | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-6612](https://issues.apache.org/jira/browse/HDFS-6612) | MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID | Minor | . | Juan Yu | Juan Yu |
-| [HDFS-6610](https://issues.apache.org/jira/browse/HDFS-6610) | TestShortCircuitLocalRead tests sometimes timeout on slow machines | Minor | test | Charles Lamb | Charles Lamb |
-| [HDFS-6604](https://issues.apache.org/jira/browse/HDFS-6604) | The short-circuit cache doesn't correctly time out replicas that haven't been used in a while | Critical | hdfs-client | Giuseppe Reina | Colin Patrick McCabe |
-| [HDFS-6601](https://issues.apache.org/jira/browse/HDFS-6601) | Issues in finalizing rolling upgrade when there is a layout version change | Blocker | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-6599](https://issues.apache.org/jira/browse/HDFS-6599) | 2.4 addBlock is 10 to 20 times slower compared to 0.23 | Blocker | . | Kihwal Lee | Daryn Sharp |
-| [HDFS-6598](https://issues.apache.org/jira/browse/HDFS-6598) | Fix a typo in message issued from explorer.js | Trivial | webhdfs | Yongjun Zhang | Yongjun Zhang |
-| [HDFS-6591](https://issues.apache.org/jira/browse/HDFS-6591) | while loop is executed tens of thousands of times in Hedged Read | Major | hdfs-client | LiuLei | Liang Xie |
-| [HDFS-6587](https://issues.apache.org/jira/browse/HDFS-6587) | Bug in TestBPOfferService can cause test failure | Major | test | Zhilei Xu | Zhilei Xu |
-| [HDFS-6583](https://issues.apache.org/jira/browse/HDFS-6583) | Remove clientNode in FileUnderConstructionFeature | Minor | namenode | Haohui Mai | Haohui Mai |
-| [HDFS-6572](https://issues.apache.org/jira/browse/HDFS-6572) | Add an option to the NameNode that prints the software and on-disk image versions | Minor | namenode | Charles Lamb | Charles Lamb |
-| [HDFS-6563](https://issues.apache.org/jira/browse/HDFS-6563) | NameNode cannot save fsimage in certain circumstances when snapshots are in use | Critical | namenode, snapshots | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-6559](https://issues.apache.org/jira/browse/HDFS-6559) | Fix wrong option "dfsadmin -rollingUpgrade start" in the document | Minor | documentation | Akira AJISAKA | Akira AJISAKA |
-| [HDFS-6556](https://issues.apache.org/jira/browse/HDFS-6556) | Refine XAttr permissions | Major | namenode | Yi Liu | Uma Maheswara Rao G |
-| [HDFS-6553](https://issues.apache.org/jira/browse/HDFS-6553) | Add missing DeprecationDeltas for NFS Kerberos configurations | Major | nfs | Stephen Chu | Stephen Chu |
-| [HDFS-6552](https://issues.apache.org/jira/browse/HDFS-6552) | add DN storage to a BlockInfo will not replace the different storage from same DN | Trivial | namenode | Amir Langer | Amir Langer |
-| [HDFS-6551](https://issues.apache.org/jira/browse/HDFS-6551) | Rename with OVERWRITE option may throw NPE when the target file/directory is a reference INode | Major | namenode, snapshots | Jing Zhao | Jing Zhao |
-| [HDFS-6549](https://issues.apache.org/jira/browse/HDFS-6549) | Add support for accessing the NFS gateway from the AIX NFS client | Major | nfs | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-6539](https://issues.apache.org/jira/browse/HDFS-6539) | test\_native\_mini\_dfs is skipped in hadoop-hdfs/pom.xml | Major | . | Binglin Chang | Binglin Chang |
-| [HDFS-6535](https://issues.apache.org/jira/browse/HDFS-6535) | HDFS quota update is wrong when file is appended | Major | namenode | George Wong | George Wong |
-| [HDFS-6530](https://issues.apache.org/jira/browse/HDFS-6530) | Fix Balancer documentation | Minor | documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-6527](https://issues.apache.org/jira/browse/HDFS-6527) | Edit log corruption due to defered INode removal | Blocker | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-6518](https://issues.apache.org/jira/browse/HDFS-6518) | TestCacheDirectives#testExceedsCapacity should take FSN read lock when accessing pendingCached list | Major | . | Yongjun Zhang | Andrew Wang |
-| [HDFS-6500](https://issues.apache.org/jira/browse/HDFS-6500) | Snapshot shouldn't be removed silently after renaming to an existing snapshot | Blocker | snapshots | Junping Du | Tsz Wo Nicholas Sze |
-| [HDFS-6497](https://issues.apache.org/jira/browse/HDFS-6497) | Make TestAvailableSpaceVolumeChoosingPolicy deterministic | Minor | test | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-6493](https://issues.apache.org/jira/browse/HDFS-6493) | Change dfs.namenode.startup.delay.block.deletion to second instead of millisecond | Trivial | . | Juan Yu | Juan Yu |
-| [HDFS-6487](https://issues.apache.org/jira/browse/HDFS-6487) | TestStandbyCheckpoint#testSBNCheckpoints is racy | Major | . | Mit Desai | Mit Desai |
-| [HDFS-6475](https://issues.apache.org/jira/browse/HDFS-6475) | WebHdfs clients fail without retry because incorrect handling of StandbyException | Major | ha, webhdfs | Yongjun Zhang | Yongjun Zhang |
-| [HDFS-6472](https://issues.apache.org/jira/browse/HDFS-6472) | fix typo in webapps/hdfs/explorer.js | Trivial | . | Juan Yu | Juan Yu |
-| [HDFS-6471](https://issues.apache.org/jira/browse/HDFS-6471) | Make moveFromLocal CLI testcases to be non-disruptive | Major | test | Dasha Boudnik | Dasha Boudnik |
-| [HDFS-6470](https://issues.apache.org/jira/browse/HDFS-6470) | TestBPOfferService.testBPInitErrorHandling is flaky | Major | . | Andrew Wang | Ming Ma |
-| [HDFS-6464](https://issues.apache.org/jira/browse/HDFS-6464) | Support multiple xattr.name parameters for WebHDFS getXAttrs. | Major | webhdfs | Yi Liu | Yi Liu |
-| [HDFS-6462](https://issues.apache.org/jira/browse/HDFS-6462) | NFS: fsstat request fails with the secure hdfs | Major | nfs | Yesha Vora | Brandon Li |
-| [HDFS-6461](https://issues.apache.org/jira/browse/HDFS-6461) | Use Time#monotonicNow to compute duration in DataNode#shutDown | Trivial | datanode | James Thomas | James Thomas |
-| [HDFS-6443](https://issues.apache.org/jira/browse/HDFS-6443) | Fix MiniQJMHACluster related test failures | Minor | test | Zesheng Wu | Zesheng Wu |
-| [HDFS-6439](https://issues.apache.org/jira/browse/HDFS-6439) | NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not | Major | nfs | Brandon Li | Aaron T. Myers |
-| [HDFS-6438](https://issues.apache.org/jira/browse/HDFS-6438) | DeleteSnapshot should be a DELETE request in WebHdfs | Major | webhdfs | Jing Zhao | Jing Zhao |
-| [HDFS-6424](https://issues.apache.org/jira/browse/HDFS-6424) | blockReport doesn't need to invalidate blocks on SBN | Major | . | Ming Ma | Ming Ma |
-| [HDFS-6423](https://issues.apache.org/jira/browse/HDFS-6423) | Diskspace quota usage should be updated when appending data to partial block | Major | namenode | Jing Zhao | Jing Zhao |
-| [HDFS-6422](https://issues.apache.org/jira/browse/HDFS-6422) | getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist | Blocker | . | Charles Lamb | Charles Lamb |
-| [HDFS-6421](https://issues.apache.org/jira/browse/HDFS-6421) | Fix vecsum.c compile on BSD and some other systems | Major | libhdfs | Jason Lowe | Mit Desai |
-| [HDFS-6418](https://issues.apache.org/jira/browse/HDFS-6418) | Regression: DFS\_NAMENODE\_USER\_NAME\_KEY missing in trunk | Blocker | hdfs-client | Steve Loughran | Tsz Wo Nicholas Sze |
-| [HDFS-6409](https://issues.apache.org/jira/browse/HDFS-6409) | Fix typo in log message about NameNode layout version upgrade. | Trivial | namenode | Chris Nauroth | Chen He |
-| [HDFS-6404](https://issues.apache.org/jira/browse/HDFS-6404) | HttpFS should use a 000 umask for mkdir and create operations | Major | . | Alejandro Abdelnur | Mike Yoder |
-| [HDFS-6400](https://issues.apache.org/jira/browse/HDFS-6400) | Cannot execute "hdfs oiv\_legacy" | Critical | tools | Akira AJISAKA | Akira AJISAKA |
-| [HDFS-6399](https://issues.apache.org/jira/browse/HDFS-6399) | Add note about setfacl in HDFS permissions guide | Minor | documentation, namenode | Charles Lamb | Chris Nauroth |
-| [HDFS-6395](https://issues.apache.org/jira/browse/HDFS-6395) | Skip checking xattr limits for non-user-visible namespaces | Major | namenode | Andrew Wang | Yi Liu |
-| [HDFS-6381](https://issues.apache.org/jira/browse/HDFS-6381) | Fix a typo in INodeReference.java | Trivial | documentation | Binglin Chang | Binglin Chang |
-| [HDFS-6379](https://issues.apache.org/jira/browse/HDFS-6379) | HTTPFS - Implement ACLs support | Major | . | Alejandro Abdelnur | Mike Yoder |
-| [HDFS-6378](https://issues.apache.org/jira/browse/HDFS-6378) | NFS registration should timeout instead of hanging when portmap/rpcbind is not available | Major | nfs | Brandon Li | Abhiraj Butala |
-| [HDFS-6370](https://issues.apache.org/jira/browse/HDFS-6370) | Web UI fails to display in intranet under IE | Major | datanode, journal-node, namenode | Haohui Mai | Haohui Mai |
-| [HDFS-6367](https://issues.apache.org/jira/browse/HDFS-6367) | EnumSetParam$Domain#parse fails for parameter containing more than one enum. | Major | webhdfs | Yi Liu | Yi Liu |
-| [HDFS-6364](https://issues.apache.org/jira/browse/HDFS-6364) | Incorrect check for unknown datanode in Balancer | Major | balancer & mover | Benoy Antony | Benoy Antony |
-| [HDFS-6355](https://issues.apache.org/jira/browse/HDFS-6355) | Fix divide-by-zero, improper use of wall-clock time in BlockPoolSliceScanner | Major | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-6345](https://issues.apache.org/jira/browse/HDFS-6345) | DFS.listCacheDirectives() should allow filtering based on cache directive ID | Major | caching | Lenni Kuff | Andrew Wang |
-| [HDFS-6337](https://issues.apache.org/jira/browse/HDFS-6337) | Setfacl testcase is failing due to dash character in username in TestAclCLI | Major | test | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HDFS-6312](https://issues.apache.org/jira/browse/HDFS-6312) | WebHdfs HA failover is broken on secure clusters | Blocker | webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-6305](https://issues.apache.org/jira/browse/HDFS-6305) | WebHdfs response decoding may throw RuntimeExceptions | Critical | webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-6294](https://issues.apache.org/jira/browse/HDFS-6294) | Use INode IDs to avoid conflicts when a file open for write is renamed | Major | namenode | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-6293](https://issues.apache.org/jira/browse/HDFS-6293) | Issues with OIV processing PB-based fsimages | Blocker | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-6289](https://issues.apache.org/jira/browse/HDFS-6289) | HA failover can fail if there are pending DN messages for DNs which no longer exist | Critical | ha | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-6288](https://issues.apache.org/jira/browse/HDFS-6288) | DFSInputStream Pread doesn't update ReadStatistics | Minor | . | Juan Yu | Juan Yu |
-| [HDFS-6270](https://issues.apache.org/jira/browse/HDFS-6270) | Secondary namenode status page shows transaction count in bytes | Minor | . | Benoy Antony | Benoy Antony |
-| [HDFS-6250](https://issues.apache.org/jira/browse/HDFS-6250) | TestBalancerWithNodeGroup.testBalancerWithRackLocality fails | Major | . | Kihwal Lee | Binglin Chang |
-| [HDFS-6243](https://issues.apache.org/jira/browse/HDFS-6243) | HA NameNode transition to active or shutdown may leave lingering image transfer thread. | Major | ha, namenode | Chris Nauroth | Chris Nauroth |
-| [HDFS-6238](https://issues.apache.org/jira/browse/HDFS-6238) | TestDirectoryScanner leaks file descriptors. | Minor | datanode, test | Chris Nauroth | Chris Nauroth |
-| [HDFS-6230](https://issues.apache.org/jira/browse/HDFS-6230) | Expose upgrade status through NameNode web UI | Major | namenode | Arpit Agarwal | Mit Desai |
-| [HDFS-6227](https://issues.apache.org/jira/browse/HDFS-6227) | ShortCircuitCache#unref should purge ShortCircuitReplicas whose streams have been closed by java interrupts | Major | . | Jing Zhao | Colin Patrick McCabe |
-| [HDFS-6222](https://issues.apache.org/jira/browse/HDFS-6222) | Remove background token renewer from webhdfs | Major | webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-6216](https://issues.apache.org/jira/browse/HDFS-6216) | Issues with webhdfs and http proxies | Major | webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-6214](https://issues.apache.org/jira/browse/HDFS-6214) | Webhdfs has poor throughput for files \>2GB | Major | webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-6213](https://issues.apache.org/jira/browse/HDFS-6213) | TestDataNodeConfig failing on Jenkins runs due to DN web port in use | Minor | test | Steve Loughran | Andrew Wang |
-| [HDFS-6194](https://issues.apache.org/jira/browse/HDFS-6194) | Create new tests for ByteRangeInputStream | Major | . | Haohui Mai | Akira AJISAKA |
+| [YARN-1718](https://issues.apache.org/jira/browse/YARN-1718) | Fix a couple isTerminals in Fair Scheduler queue placement rules | Major | scheduler | Sandy Ryza | Sandy Ryza |
+| [YARN-1736](https://issues.apache.org/jira/browse/YARN-1736) | FS: AppSchedulable.assignContainer's priority argument is redundant | Minor | scheduler | Sandy Ryza | Naren Koneru |
+| [MAPREDUCE-5671](https://issues.apache.org/jira/browse/MAPREDUCE-5671) | NaN can be created by client and assign to Progress | Major | . | Chen He | Chen He |
+| [YARN-1678](https://issues.apache.org/jira/browse/YARN-1678) | Fair scheduler gabs incessantly about reservations | Major | scheduler | Sandy Ryza | Sandy Ryza |
+| [YARN-1429](https://issues.apache.org/jira/browse/YARN-1429) | \*nix: Allow a way for users to augment classpath of YARN daemons | Trivial | client | Sandy Ryza | Jarek Jarcec Cecho |
+| [MAPREDUCE-5665](https://issues.apache.org/jira/browse/MAPREDUCE-5665) | Add audience annotations to MiniMRYarnCluster and MiniMRCluster | Major | test | Sandy Ryza | Anubhav Dhoot |
+| [HADOOP-10378](https://issues.apache.org/jira/browse/HADOOP-10378) | Typo in help printed by hdfs dfs -help | Major | . | Mit Desai | Mit Desai |
+| [YARN-1790](https://issues.apache.org/jira/browse/YARN-1790) | Fair Scheduler UI not showing apps table | Major | . | bc Wong | bc Wong |
+| [MAPREDUCE-5765](https://issues.apache.org/jira/browse/MAPREDUCE-5765) | Update hadoop-pipes examples README | Minor | pipes | Jonathan Eagles | Mit Desai |
+| [HADOOP-10332](https://issues.apache.org/jira/browse/HADOOP-10332) | HttpServer's jetty audit log always logs 200 OK | Major | . | Daryn Sharp | Jonathan Eagles |
+| [MAPREDUCE-5713](https://issues.apache.org/jira/browse/MAPREDUCE-5713) | InputFormat and JobConf JavaDoc Fixes | Trivial | documentation | Ben Robie | Chen He |
+| [MAPREDUCE-5456](https://issues.apache.org/jira/browse/MAPREDUCE-5456) | TestFetcher.testCopyFromHostExtraBytes is missing | Minor | mrv2, test | Jason Lowe | Jason Lowe |
+| [YARN-1520](https://issues.apache.org/jira/browse/YARN-1520) | update capacity scheduler docs to include necessary parameters | Major | . | Chen He | Chen He |
+| [YARN-1136](https://issues.apache.org/jira/browse/YARN-1136) | Replace junit.framework.Assert with org.junit.Assert | Major | . | Karthik Kambatla | Chen He |
+| [HDFS-6112](https://issues.apache.org/jira/browse/HDFS-6112) | NFS Gateway docs are incorrect for allowed hosts configuration | Minor | nfs | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-10418](https://issues.apache.org/jira/browse/HADOOP-10418) | SaslRpcClient should not assume that remote principals are in the default\_realm | Major | security | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-3087](https://issues.apache.org/jira/browse/HDFS-3087) | Decomissioning on NN restart can complete without blocks being replicated | Critical | namenode | Kihwal Lee | Rushabh S Shah |
+| [HDFS-6156](https://issues.apache.org/jira/browse/HDFS-6156) | Simplify the JMX API that provides snapshot information | Major | . | Haohui Mai | Shinichi Yamashita |
+| [MAPREDUCE-5759](https://issues.apache.org/jira/browse/MAPREDUCE-5759) | Remove unnecessary conf load in Limits | Major | . | Sandy Ryza | Sandy Ryza |
+| [HADOOP-10414](https://issues.apache.org/jira/browse/HADOOP-10414) | Incorrect property name for RefreshUserMappingProtocol in hadoop-policy.xml | Major | conf | Joey Echeverria | Joey Echeverria |
+| [HDFS-5591](https://issues.apache.org/jira/browse/HDFS-5591) | Checkpointing should use monotonic time when calculating period | Minor | namenode | Andrew Wang | Charles Lamb |
+| [HADOOP-10459](https://issues.apache.org/jira/browse/HADOOP-10459) | distcp V2 doesn't preserve root dir's attributes when -p is specified | Major | tools/distcp | Yongjun Zhang | Yongjun Zhang |
| [HDFS-6190](https://issues.apache.org/jira/browse/HDFS-6190) | minor textual fixes in DFSClient | Trivial | tools | Charles Lamb | Charles Lamb |
+| [HADOOP-10462](https://issues.apache.org/jira/browse/HADOOP-10462) | DF#getFilesystem is not parsing the command output | Major | . | Akira Ajisaka | Akira Ajisaka |
+| [HDFS-6159](https://issues.apache.org/jira/browse/HDFS-6159) | TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails if there is block missing after balancer success | Major | test | Chen He | Chen He |
| [HDFS-6181](https://issues.apache.org/jira/browse/HDFS-6181) | Fix the wrong property names in NFS user guide | Trivial | documentation, nfs | Brandon Li | Brandon Li |
| [HDFS-6180](https://issues.apache.org/jira/browse/HDFS-6180) | dead node count / listing is very broken in JMX and old GUI | Blocker | . | Travis Thompson | Haohui Mai |
-| [HDFS-6178](https://issues.apache.org/jira/browse/HDFS-6178) | Decommission on standby NN couldn't finish | Major | namenode | Ming Ma | Ming Ma |
-| [HDFS-6160](https://issues.apache.org/jira/browse/HDFS-6160) | TestSafeMode occasionally fails | Major | test | Ted Yu | Arpit Agarwal |
-| [HDFS-6159](https://issues.apache.org/jira/browse/HDFS-6159) | TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails if there is block missing after balancer success | Major | test | Chen He | Chen He |
-| [HDFS-6156](https://issues.apache.org/jira/browse/HDFS-6156) | Simplify the JMX API that provides snapshot information | Major | . | Haohui Mai | Shinichi Yamashita |
| [HDFS-6143](https://issues.apache.org/jira/browse/HDFS-6143) | WebHdfsFileSystem open should throw FileNotFoundException for non-existing paths | Blocker | . | Gera Shegalov | Gera Shegalov |
-| [HDFS-6112](https://issues.apache.org/jira/browse/HDFS-6112) | NFS Gateway docs are incorrect for allowed hosts configuration | Minor | nfs | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-6056](https://issues.apache.org/jira/browse/HDFS-6056) | Clean up NFS config settings | Major | nfs | Aaron T. Myers | Brandon Li |
+| [HADOOP-10475](https://issues.apache.org/jira/browse/HADOOP-10475) | ConcurrentModificationException in AbstractDelegationTokenSelector.selectToken() | Major | security | Arpit Gupta | Jing Zhao |
+| [YARN-1784](https://issues.apache.org/jira/browse/YARN-1784) | TestContainerAllocation assumes CapacityScheduler | Minor | resourcemanager | Karthik Kambatla | Robert Kanter |
+| [HDFS-6160](https://issues.apache.org/jira/browse/HDFS-6160) | TestSafeMode occasionally fails | Major | test | Ted Yu | Arpit Agarwal |
| [HDFS-5669](https://issues.apache.org/jira/browse/HDFS-5669) | Storage#tryLock() should check for null before logging successfull message | Major | datanode | Vinayakumar B | Vinayakumar B |
-| [HDFS-5591](https://issues.apache.org/jira/browse/HDFS-5591) | Checkpointing should use monotonic time when calculating period | Minor | namenode | Andrew Wang | Charles Lamb |
-| [HDFS-5522](https://issues.apache.org/jira/browse/HDFS-5522) | Datanode disk error check may be incorrectly skipped | Major | . | Kihwal Lee | Rushabh S Shah |
-| [HDFS-4913](https://issues.apache.org/jira/browse/HDFS-4913) | Deleting file through fuse-dfs when using trash fails requiring root permissions | Major | fuse-dfs | Stephen Chu | Colin Patrick McCabe |
-| [HDFS-4909](https://issues.apache.org/jira/browse/HDFS-4909) | Avoid protocol buffer RPC namespace clashes | Blocker | datanode, journal-node, namenode | Ralph Castain | Colin Patrick McCabe |
-| [HDFS-3848](https://issues.apache.org/jira/browse/HDFS-3848) | A Bug in recoverLeaseInternal method of FSNameSystem class | Major | namenode | Hooman Peiro Sajjad | Chen He |
-| [HDFS-3828](https://issues.apache.org/jira/browse/HDFS-3828) | Block Scanner rescans blocks too frequently | Major | . | Andy Isaacson | Andy Isaacson |
-| [HDFS-3493](https://issues.apache.org/jira/browse/HDFS-3493) | Invalidate excess corrupted blocks as long as minimum replication is satisfied | Major | namenode | J.Andreina | Juan Yu |
-| [HDFS-3087](https://issues.apache.org/jira/browse/HDFS-3087) | Decomissioning on NN restart can complete without blocks being replicated | Critical | namenode | Kihwal Lee | Rushabh S Shah |
-| [MAPREDUCE-6002](https://issues.apache.org/jira/browse/MAPREDUCE-6002) | MR task should prevent report error to AM when process is shutting down | Major | task | Wangda Tan | Wangda Tan |
-| [MAPREDUCE-5952](https://issues.apache.org/jira/browse/MAPREDUCE-5952) | LocalContainerLauncher#renameMapOutputForReduce incorrectly assumes a single dir for mapOutIndex | Blocker | mr-am, mrv2 | Gera Shegalov | Gera Shegalov |
-| [MAPREDUCE-5939](https://issues.apache.org/jira/browse/MAPREDUCE-5939) | StartTime showing up as the epoch time in JHS UI after upgrade | Major | . | Kihwal Lee | Chen He |
-| [MAPREDUCE-5924](https://issues.apache.org/jira/browse/MAPREDUCE-5924) | Windows: Sort Job failed due to 'Invalid event: TA\_COMMIT\_PENDING at COMMIT\_PENDING' | Major | . | Yesha Vora | Zhijie Shen |
-| [MAPREDUCE-5920](https://issues.apache.org/jira/browse/MAPREDUCE-5920) | Add Xattr option in DistCp docs | Minor | distcp, documentation | Uma Maheswara Rao G | Yi Liu |
-| [MAPREDUCE-5898](https://issues.apache.org/jira/browse/MAPREDUCE-5898) | distcp to support preserving HDFS extended attributes(XAttrs) | Major | distcp | Uma Maheswara Rao G | Yi Liu |
-| [MAPREDUCE-5895](https://issues.apache.org/jira/browse/MAPREDUCE-5895) | FileAlreadyExistsException was thrown : Temporary Index File can not be cleaned up because OutputStream doesn't close properly | Major | client | Kousuke Saruta | Kousuke Saruta |
-| [MAPREDUCE-5888](https://issues.apache.org/jira/browse/MAPREDUCE-5888) | Failed job leaves hung AM after it unregisters | Major | mr-am | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-5884](https://issues.apache.org/jira/browse/MAPREDUCE-5884) | History server uses short user name when canceling tokens | Major | jobhistoryserver, security | Mohammad Kamrul Islam | Mohammad Kamrul Islam |
-| [MAPREDUCE-5874](https://issues.apache.org/jira/browse/MAPREDUCE-5874) | Creating MapReduce REST API section | Major | documentation | Ravi Prakash | Tsuyoshi Ozawa |
-| [MAPREDUCE-5868](https://issues.apache.org/jira/browse/MAPREDUCE-5868) | TestPipeApplication causing nightly build to fail | Major | test | Jason Lowe | Akira AJISAKA |
-| [MAPREDUCE-5862](https://issues.apache.org/jira/browse/MAPREDUCE-5862) | Line records longer than 2x split size aren't handled correctly | Critical | . | bc Wong | bc Wong |
+| [HADOOP-10350](https://issues.apache.org/jira/browse/HADOOP-10350) | BUILDING.txt should mention openssl dependency required for hadoop-pipes | Major | . | Vinayakumar B | Vinayakumar B |
+| [HADOOP-10495](https://issues.apache.org/jira/browse/HADOOP-10495) | TestFileUtil fails on Windows due to bad permission assertions. | Trivial | fs, test | Chris Nauroth | Chris Nauroth |
+| [HADOOP-10496](https://issues.apache.org/jira/browse/HADOOP-10496) | Metrics system FileSink can leak file descriptor. | Major | metrics | Chris Nauroth | Chris Nauroth |
+| [HDFS-6238](https://issues.apache.org/jira/browse/HDFS-6238) | TestDirectoryScanner leaks file descriptors. | Minor | datanode, test | Chris Nauroth | Chris Nauroth |
+| [HADOOP-10500](https://issues.apache.org/jira/browse/HADOOP-10500) | TestDoAsEffectiveUser fails on JDK7 due to failure to reset proxy user configuration. | Trivial | security, test | Chris Nauroth | Chris Nauroth |
+| [HDFS-6243](https://issues.apache.org/jira/browse/HDFS-6243) | HA NameNode transition to active or shutdown may leave lingering image transfer thread. | Major | ha, namenode | Chris Nauroth | Chris Nauroth |
+| [HDFS-6194](https://issues.apache.org/jira/browse/HDFS-6194) | Create new tests for ByteRangeInputStream | Major | . | Haohui Mai | Akira Ajisaka |
+| [MAPREDUCE-5836](https://issues.apache.org/jira/browse/MAPREDUCE-5836) | Fix typo in RandomTextWriter | Trivial | . | Akira Ajisaka | Akira Ajisaka |
+| [MAPREDUCE-5775](https://issues.apache.org/jira/browse/MAPREDUCE-5775) | Remove unnecessary job.setNumReduceTasks in SleepJob.createJob | Minor | . | Liyin Liang | jhanver chand sharma |
+| [HDFS-6214](https://issues.apache.org/jira/browse/HDFS-6214) | Webhdfs has poor throughput for files \>2GB | Major | webhdfs | Daryn Sharp | Daryn Sharp |
+| [HDFS-4909](https://issues.apache.org/jira/browse/HDFS-4909) | Avoid protocol buffer RPC namespace clashes | Blocker | datanode, journal-node, namenode | Ralph Castain | Colin P. McCabe |
+| [YARN-1940](https://issues.apache.org/jira/browse/YARN-1940) | deleteAsUser() terminates early without deleting more files on error | Major | . | Kihwal Lee | Rushabh S Shah |
+| [MAPREDUCE-4937](https://issues.apache.org/jira/browse/MAPREDUCE-4937) | MR AM handles an oversized split metainfo file poorly | Major | mr-am | Jason Lowe | Eric Payne |
+| [YARN-1865](https://issues.apache.org/jira/browse/YARN-1865) | ShellScriptBuilder does not check for some error conditions | Minor | nodemanager | Remus Rusanu | Remus Rusanu |
+| [HADOOP-9919](https://issues.apache.org/jira/browse/HADOOP-9919) | Update hadoop-metrics2.properties examples to Yarn | Major | conf | Akira Ajisaka | Akira Ajisaka |
+| [HADOOP-10526](https://issues.apache.org/jira/browse/HADOOP-10526) | Chance for Stream leakage in CompressorStream | Minor | . | SreeHari | Rushabh S Shah |
+| [HDFS-6178](https://issues.apache.org/jira/browse/HDFS-6178) | Decommission on standby NN couldn't finish | Major | namenode | Ming Ma | Ming Ma |
+| [HDFS-6213](https://issues.apache.org/jira/browse/HDFS-6213) | TestDataNodeConfig failing on Jenkins runs due to DN web port in use | Minor | test | Steve Loughran | Andrew Wang |
+| [HADOOP-10251](https://issues.apache.org/jira/browse/HADOOP-10251) | Both NameNodes could be in STANDBY State if SNN network is unstable | Critical | ha | Vinayakumar B | Vinayakumar B |
+| [HADOOP-10531](https://issues.apache.org/jira/browse/HADOOP-10531) | hadoop-config.sh - bug in --hosts argument | Major | . | Sebastien Barrier | Sebastien Barrier |
| [MAPREDUCE-5846](https://issues.apache.org/jira/browse/MAPREDUCE-5846) | Rumen doesn't understand JobQueueChangedEvent | Major | tools/rumen | Nathan Roberts | Nathan Roberts |
-| [MAPREDUCE-5844](https://issues.apache.org/jira/browse/MAPREDUCE-5844) | Add a configurable delay to reducer-preemption | Major | . | Maysam Yabandeh | Maysam Yabandeh |
| [MAPREDUCE-5837](https://issues.apache.org/jira/browse/MAPREDUCE-5837) | MRAppMaster fails when checking on uber mode | Critical | . | Haohui Mai | Haohui Mai |
-| [MAPREDUCE-5836](https://issues.apache.org/jira/browse/MAPREDUCE-5836) | Fix typo in RandomTextWriter | Trivial | . | Akira AJISAKA | Akira AJISAKA |
-| [MAPREDUCE-5834](https://issues.apache.org/jira/browse/MAPREDUCE-5834) | TestGridMixClasses tests timesout on branch-2 | Major | . | Mit Desai | Mit Desai |
-| [MAPREDUCE-5814](https://issues.apache.org/jira/browse/MAPREDUCE-5814) | fat jar with \*-default.xml may fail when mapreduce.job.classloader=true. | Major | mrv2 | Gera Shegalov | Gera Shegalov |
-| [MAPREDUCE-5790](https://issues.apache.org/jira/browse/MAPREDUCE-5790) | Default map hprof profile options do not work | Blocker | . | Andrew Wang | Gera Shegalov |
-| [MAPREDUCE-5775](https://issues.apache.org/jira/browse/MAPREDUCE-5775) | Remove unnecessary job.setNumReduceTasks in SleepJob.createJob | Minor | . | Liyin Liang | jhanver chand sharma |
-| [MAPREDUCE-5765](https://issues.apache.org/jira/browse/MAPREDUCE-5765) | Update hadoop-pipes examples README | Minor | pipes | Jonathan Eagles | Mit Desai |
-| [MAPREDUCE-5759](https://issues.apache.org/jira/browse/MAPREDUCE-5759) | Remove unnecessary conf load in Limits | Major | . | Sandy Ryza | Sandy Ryza |
+| [HADOOP-10540](https://issues.apache.org/jira/browse/HADOOP-10540) | Datanode upgrade in Windows fails with hardlink error. | Major | tools | Huan Huang | Arpit Agarwal |
| [MAPREDUCE-5749](https://issues.apache.org/jira/browse/MAPREDUCE-5749) | TestRMContainerAllocator#testReportedAppProgress Failed | Major | . | Hong Shen | Jason Lowe |
-| [MAPREDUCE-5713](https://issues.apache.org/jira/browse/MAPREDUCE-5713) | InputFormat and JobConf JavaDoc Fixes | Trivial | documentation | Ben Robie | Chen He |
-| [MAPREDUCE-5671](https://issues.apache.org/jira/browse/MAPREDUCE-5671) | NaN can be created by client and assign to Progress | Major | . | Chen He | Chen He |
-| [MAPREDUCE-5665](https://issues.apache.org/jira/browse/MAPREDUCE-5665) | Add audience annotations to MiniMRYarnCluster and MiniMRCluster | Major | test | Sandy Ryza | Anubhav Dhoot |
+| [HDFS-6270](https://issues.apache.org/jira/browse/HDFS-6270) | Secondary namenode status page shows transaction count in bytes | Minor | . | Benoy Antony | Benoy Antony |
+| [HDFS-6288](https://issues.apache.org/jira/browse/HDFS-6288) | DFSInputStream Pread doesn't update ReadStatistics | Minor | . | Juan Yu | Juan Yu |
+| [HADOOP-10508](https://issues.apache.org/jira/browse/HADOOP-10508) | RefreshCallQueue fails when authorization is enabled | Major | ipc | Chris Li | Chris Li |
+| [HDFS-3828](https://issues.apache.org/jira/browse/HDFS-3828) | Block Scanner rescans blocks too frequently | Major | . | Andy Isaacson | Andy Isaacson |
+| [YARN-738](https://issues.apache.org/jira/browse/YARN-738) | TestClientRMTokens is failing irregularly while running all yarn tests | Major | . | Omkar Vinit Joshi | Ming Ma |
+| [HDFS-6216](https://issues.apache.org/jira/browse/HDFS-6216) | Issues with webhdfs and http proxies | Major | webhdfs | Daryn Sharp | Daryn Sharp |
+| [HADOOP-10547](https://issues.apache.org/jira/browse/HADOOP-10547) | Give SaslPropertiesResolver.getDefaultProperties() public scope | Major | security | Jason Dere | Benoy Antony |
+| [HADOOP-10543](https://issues.apache.org/jira/browse/HADOOP-10543) | RemoteException's unwrapRemoteException method failed for PathIOException | Major | . | Yongjun Zhang | Yongjun Zhang |
+| [HDFS-6289](https://issues.apache.org/jira/browse/HDFS-6289) | HA failover can fail if there are pending DN messages for DNs which no longer exist | Critical | ha | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-10568](https://issues.apache.org/jira/browse/HADOOP-10568) | Add s3 server-side encryption | Major | fs/s3 | David S. Wang | David S. Wang |
+| [HDFS-6337](https://issues.apache.org/jira/browse/HDFS-6337) | Setfacl testcase is failing due to dash character in username in TestAclCLI | Major | test | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [HADOOP-10541](https://issues.apache.org/jira/browse/HADOOP-10541) | InputStream in MiniKdc#initKDCServer for minikdc.ldiff is not closed | Minor | test | Ted Yu | Swarnim Kulkarni |
+| [HADOOP-10517](https://issues.apache.org/jira/browse/HADOOP-10517) | InputStream is not closed in two methods of JarFinder | Minor | test, util | Ted Yu | Ted Yu |
+| [HADOOP-10581](https://issues.apache.org/jira/browse/HADOOP-10581) | TestUserGroupInformation#testGetServerSideGroups fails because groups stored in Set and ArrayList are compared | Major | . | Mit Desai | Mit Desai |
+| [HADOOP-10158
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[32/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.1/CHANGES.0.21.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.1/CHANGES.0.21.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.1/CHANGES.0.21.1.md
index c5e4468..dcb5f6f 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.1/CHANGES.0.21.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.1/CHANGES.0.21.1.md
@@ -18,7 +18,7 @@
-->
# Apache Hadoop Changelog
-## Release 0.21.1 - Unreleased (as of 2016-03-04)
+## Release 0.21.1 - Unreleased (as of 2017-08-28)
### INCOMPATIBLE CHANGES:
@@ -27,12 +27,6 @@
| [MAPREDUCE-1905](https://issues.apache.org/jira/browse/MAPREDUCE-1905) | Context.setStatus() and progress() api are ignored | Blocker | task | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
@@ -44,65 +38,65 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7193](https://issues.apache.org/jira/browse/HADOOP-7193) | Help message is wrong for touchz command. | Minor | fs | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HADOOP-7177](https://issues.apache.org/jira/browse/HADOOP-7177) | CodecPool should report which compressor it is using | Trivial | native | Allen Wittenauer | Allen Wittenauer |
-| [HADOOP-7117](https://issues.apache.org/jira/browse/HADOOP-7117) | Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml | Major | conf | Patrick Angeles | Harsh J |
+| [MAPREDUCE-1501](https://issues.apache.org/jira/browse/MAPREDUCE-1501) | FileInputFormat to support multi-level/recursive directory listing | Major | . | Zheng Shao | Zheng Shao |
| [HADOOP-6786](https://issues.apache.org/jira/browse/HADOOP-6786) | test-patch needs to verify Herriot integrity | Major | build | Konstantin Boudnik | Konstantin Boudnik |
-| [HDFS-1596](https://issues.apache.org/jira/browse/HDFS-1596) | Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml | Major | documentation, namenode | Patrick Angeles | Harsh J |
| [HDFS-1343](https://issues.apache.org/jira/browse/HDFS-1343) | Instrumented build should be concentrated in one build area | Minor | build | Konstantin Boudnik | Konstantin Boudnik |
| [MAPREDUCE-2140](https://issues.apache.org/jira/browse/MAPREDUCE-2140) | Re-generate fair scheduler design doc PDF | Trivial | . | Matei Zaharia | Matei Zaharia |
-| [MAPREDUCE-1501](https://issues.apache.org/jira/browse/MAPREDUCE-1501) | FileInputFormat to support multi-level/recursive directory listing | Major | . | Zheng Shao | Zheng Shao |
+| [HADOOP-7177](https://issues.apache.org/jira/browse/HADOOP-7177) | CodecPool should report which compressor it is using | Trivial | native | Allen Wittenauer | Allen Wittenauer |
+| [HDFS-1596](https://issues.apache.org/jira/browse/HDFS-1596) | Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml | Major | documentation, namenode | Patrick Angeles | Harsh J |
+| [HADOOP-7117](https://issues.apache.org/jira/browse/HADOOP-7117) | Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml | Major | conf | Patrick Angeles | Harsh J |
+| [HADOOP-7193](https://issues.apache.org/jira/browse/HADOOP-7193) | Help message is wrong for touchz command. | Minor | fs | Uma Maheswara Rao G | Uma Maheswara Rao G |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7215](https://issues.apache.org/jira/browse/HADOOP-7215) | RPC clients must connect over a network interface corresponding to the host name in the client's kerberos principal key | Blocker | security | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-7194](https://issues.apache.org/jira/browse/HADOOP-7194) | Potential Resource leak in IOUtils.java | Major | io | Devaraj K | Devaraj K |
-| [HADOOP-7183](https://issues.apache.org/jira/browse/HADOOP-7183) | WritableComparator.get should not cache comparator objects | Blocker | . | Todd Lipcon | Tom White |
-| [HADOOP-7174](https://issues.apache.org/jira/browse/HADOOP-7174) | null is displayed in the console,if the src path is invalid while doing copyToLocal operation from commandLine | Minor | fs | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HADOOP-7162](https://issues.apache.org/jira/browse/HADOOP-7162) | FsShell: call srcFs.listStatus(src) twice | Minor | fs | Alexey Diomin | Alexey Diomin |
-| [HADOOP-7120](https://issues.apache.org/jira/browse/HADOOP-7120) | 200 new Findbugs warnings | Major | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-7053](https://issues.apache.org/jira/browse/HADOOP-7053) | wrong FSNamesystem Audit logging setting in conf/log4j.properties | Minor | conf | Jingguo Yao | Jingguo Yao |
-| [HADOOP-7052](https://issues.apache.org/jira/browse/HADOOP-7052) | misspelling of threshold in conf/log4j.properties | Major | conf | Jingguo Yao | Jingguo Yao |
-| [HADOOP-7019](https://issues.apache.org/jira/browse/HADOOP-7019) | Refactor build targets to enable faster cross project dev cycles. | Major | build | Owen O'Malley | Luke Lu |
-| [HADOOP-6993](https://issues.apache.org/jira/browse/HADOOP-6993) | Broken link on cluster setup page of docs | Major | documentation | Aaron T. Myers | Eli Collins |
-| [HADOOP-6971](https://issues.apache.org/jira/browse/HADOOP-6971) | Clover build doesn't generate per-test coverage | Major | build, test | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-6969](https://issues.apache.org/jira/browse/HADOOP-6969) | CHANGES.txt does not reflect the release of version 0.21.0. | Major | . | Konstantin Shvachko | Tom White |
-| [HADOOP-6954](https://issues.apache.org/jira/browse/HADOOP-6954) | Sources JARs are not correctly published to the Maven repository | Major | build | Tom White | Tom White |
| [HADOOP-6925](https://issues.apache.org/jira/browse/HADOOP-6925) | BZip2Codec incorrectly implements read() | Critical | io | Todd Lipcon | Todd Lipcon |
| [HADOOP-6833](https://issues.apache.org/jira/browse/HADOOP-6833) | IPC leaks call parameters when exceptions thrown | Blocker | . | Todd Lipcon | Todd Lipcon |
-| [HDFS-1750](https://issues.apache.org/jira/browse/HDFS-1750) | fs -ls hftp://file not working | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1728](https://issues.apache.org/jira/browse/HDFS-1728) | SecondaryNameNode.checkpointSize is in byte but not MB. | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1665](https://issues.apache.org/jira/browse/HDFS-1665) | Balancer sleeps inadequately | Minor | balancer & mover | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1612](https://issues.apache.org/jira/browse/HDFS-1612) | HDFS Design Documentation is outdated | Minor | documentation | Joe Crobak | Joe Crobak |
-| [HDFS-1598](https://issues.apache.org/jira/browse/HDFS-1598) | ListPathsServlet excludes .\*.crc files | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1552](https://issues.apache.org/jira/browse/HDFS-1552) | Remove java5 dependencies from build | Major | build | Konstantin Boudnik | Konstantin Boudnik |
-| [HDFS-1548](https://issues.apache.org/jira/browse/HDFS-1548) | Fault-injection tests are executed multiple times if invoked with run-test-hdfs-fault-inject target | Major | build, test | Konstantin Boudnik | Konstantin Boudnik |
-| [HDFS-1474](https://issues.apache.org/jira/browse/HDFS-1474) | ant binary-system is broken | Major | build | Konstantin Boudnik | Konstantin Boudnik |
-| [HDFS-1452](https://issues.apache.org/jira/browse/HDFS-1452) | ant compile-contrib is broken | Major | contrib/hdfsproxy | Jakob Homan | Konstantin Boudnik |
-| [HDFS-1444](https://issues.apache.org/jira/browse/HDFS-1444) | Test related code of build.xml is error-prone and needs to be re-aligned. | Minor | build | Konstantin Boudnik | Konstantin Boudnik |
+| [MAPREDUCE-1897](https://issues.apache.org/jira/browse/MAPREDUCE-1897) | trunk build broken on compile-mapred-test | Major | test | Greg Roelofs | Konstantin Boudnik |
+| [MAPREDUCE-2032](https://issues.apache.org/jira/browse/MAPREDUCE-2032) | TestJobOutputCommitter fails in ant test run | Major | task | Amareshwari Sriramadasu | Dick King |
+| [HDFS-1363](https://issues.apache.org/jira/browse/HDFS-1363) | startFileInternal should return the last block of the file opened for append as an under-construction block | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HDFS-1411](https://issues.apache.org/jira/browse/HDFS-1411) | The startup command of the Backup Node is "bin/hdfs namenode -backup" | Minor | documentation | Ching-Shen Chen | Ching-Shen Chen |
+| [MAPREDUCE-1280](https://issues.apache.org/jira/browse/MAPREDUCE-1280) | Eclipse Plugin does not work with Eclipse Ganymede (3.4) | Major | . | Aaron Kimball | Alex Kozlov |
+| [HDFS-1413](https://issues.apache.org/jira/browse/HDFS-1413) | Broken links to HDFS Wiki in hdfs site and documentation. | Major | documentation | Konstantin Shvachko | Konstantin Shvachko |
+| [MAPREDUCE-1984](https://issues.apache.org/jira/browse/MAPREDUCE-1984) | herriot TestCluster fails because exclusion is not there | Major | . | Balaji Rajagopalan | Balaji Rajagopalan |
+| [HADOOP-6971](https://issues.apache.org/jira/browse/HADOOP-6971) | Clover build doesn't generate per-test coverage | Major | build, test | Konstantin Boudnik | Konstantin Boudnik |
| [HDFS-1420](https://issues.apache.org/jira/browse/HDFS-1420) | Clover build doesn't generate per-test coverage | Major | build, test | Konstantin Boudnik | Konstantin Boudnik |
+| [MAPREDUCE-2090](https://issues.apache.org/jira/browse/MAPREDUCE-2090) | Clover build doesn't generate per-test coverage | Major | build, test | Konstantin Boudnik | Konstantin Boudnik |
+| [HADOOP-6969](https://issues.apache.org/jira/browse/HADOOP-6969) | CHANGES.txt does not reflect the release of version 0.21.0. | Major | . | Konstantin Shvachko | Tom White |
| [HDFS-1416](https://issues.apache.org/jira/browse/HDFS-1416) | CHANGES.txt does not reflect the release version 0.21.0. | Major | . | Konstantin Shvachko | Tom White |
-| [HDFS-1413](https://issues.apache.org/jira/browse/HDFS-1413) | Broken links to HDFS Wiki in hdfs site and documentation. | Major | documentation | Konstantin Shvachko | Konstantin Shvachko |
-| [HDFS-1411](https://issues.apache.org/jira/browse/HDFS-1411) | The startup command of the Backup Node is "bin/hdfs namenode -backup" | Minor | documentation | Ching-Shen Chen | Ching-Shen Chen |
+| [MAPREDUCE-2086](https://issues.apache.org/jira/browse/MAPREDUCE-2086) | CHANGES.txt does not reflect the release of version 0.21.0. | Major | . | Konstantin Shvachko | Tom White |
+| [HADOOP-6993](https://issues.apache.org/jira/browse/HADOOP-6993) | Broken link on cluster setup page of docs | Major | documentation | Aaron T. Myers | Eli Collins |
+| [HDFS-1444](https://issues.apache.org/jira/browse/HDFS-1444) | Test related code of build.xml is error-prone and needs to be re-aligned. | Minor | build | Konstantin Boudnik | Konstantin Boudnik |
+| [HDFS-1452](https://issues.apache.org/jira/browse/HDFS-1452) | ant compile-contrib is broken | Major | contrib/hdfsproxy | Jakob Homan | Konstantin Boudnik |
+| [MAPREDUCE-2134](https://issues.apache.org/jira/browse/MAPREDUCE-2134) | ant binary-system is broken in mapreduce project. | Major | build | Vinay Kumar Thota | Konstantin Boudnik |
+| [HDFS-1474](https://issues.apache.org/jira/browse/HDFS-1474) | ant binary-system is broken | Major | build | Konstantin Boudnik | Konstantin Boudnik |
+| [HADOOP-6954](https://issues.apache.org/jira/browse/HADOOP-6954) | Sources JARs are not correctly published to the Maven repository | Major | build | Tom White | Tom White |
+| [HADOOP-7052](https://issues.apache.org/jira/browse/HADOOP-7052) | misspelling of threshold in conf/log4j.properties | Major | conf | Jingguo Yao | Jingguo Yao |
+| [HADOOP-7053](https://issues.apache.org/jira/browse/HADOOP-7053) | wrong FSNamesystem Audit logging setting in conf/log4j.properties | Minor | conf | Jingguo Yao | Jingguo Yao |
| [HDFS-1377](https://issues.apache.org/jira/browse/HDFS-1377) | Quota bug for partial blocks allows quotas to be violated | Blocker | namenode | Eli Collins | Eli Collins |
-| [HDFS-1363](https://issues.apache.org/jira/browse/HDFS-1363) | startFileInternal should return the last block of the file opened for append as an under-construction block | Major | . | Konstantin Shvachko | Konstantin Shvachko |
| [HDFS-1206](https://issues.apache.org/jira/browse/HDFS-1206) | TestFiHFlush fails intermittently | Major | test | Tsz Wo Nicholas Sze | Konstantin Boudnik |
-| [HDFS-1189](https://issues.apache.org/jira/browse/HDFS-1189) | Quota counts missed between clear quota and set quota | Major | namenode | Kang Xiao | John George |
-| [HDFS-996](https://issues.apache.org/jira/browse/HDFS-996) | JUnit tests should never depend on anything in conf | Blocker | test | Konstantin Boudnik | Konstantin Boudnik |
-| [MAPREDUCE-2317](https://issues.apache.org/jira/browse/MAPREDUCE-2317) | HadoopArchives throwing NullPointerException while creating hadoop archives (.har files) | Minor | harchive | Devaraj K | Devaraj K |
-| [MAPREDUCE-2228](https://issues.apache.org/jira/browse/MAPREDUCE-2228) | Remove java5 dependencies from build | Major | build | Konstantin Boudnik | Konstantin Boudnik |
| [MAPREDUCE-2223](https://issues.apache.org/jira/browse/MAPREDUCE-2223) | TestMRCLI might fail on Ubuntu with default /etc/hosts | Minor | test | Konstantin Boudnik | Konstantin Boudnik |
-| [MAPREDUCE-2134](https://issues.apache.org/jira/browse/MAPREDUCE-2134) | ant binary-system is broken in mapreduce project. | Major | build | Vinay Kumar Thota | Konstantin Boudnik |
-| [MAPREDUCE-2090](https://issues.apache.org/jira/browse/MAPREDUCE-2090) | Clover build doesn't generate per-test coverage | Major | build, test | Konstantin Boudnik | Konstantin Boudnik |
-| [MAPREDUCE-2086](https://issues.apache.org/jira/browse/MAPREDUCE-2086) | CHANGES.txt does not reflect the release of version 0.21.0. | Major | . | Konstantin Shvachko | Tom White |
-| [MAPREDUCE-2032](https://issues.apache.org/jira/browse/MAPREDUCE-2032) | TestJobOutputCommitter fails in ant test run | Major | task | Amareshwari Sriramadasu | Dick King |
-| [MAPREDUCE-1984](https://issues.apache.org/jira/browse/MAPREDUCE-1984) | herriot TestCluster fails because exclusion is not there | Major | . | Balaji Rajagopalan | Balaji Rajagopalan |
+| [HDFS-1548](https://issues.apache.org/jira/browse/HDFS-1548) | Fault-injection tests are executed multiple times if invoked with run-test-hdfs-fault-inject target | Major | build, test | Konstantin Boudnik | Konstantin Boudnik |
+| [HDFS-1552](https://issues.apache.org/jira/browse/HDFS-1552) | Remove java5 dependencies from build | Major | build | Konstantin Boudnik | Konstantin Boudnik |
+| [MAPREDUCE-2228](https://issues.apache.org/jira/browse/MAPREDUCE-2228) | Remove java5 dependencies from build | Major | build | Konstantin Boudnik | Konstantin Boudnik |
| [MAPREDUCE-1929](https://issues.apache.org/jira/browse/MAPREDUCE-1929) | Allow artifacts to be published to the staging Apache Nexus Maven Repository | Blocker | build | Tom White | Tom White |
-| [MAPREDUCE-1897](https://issues.apache.org/jira/browse/MAPREDUCE-1897) | trunk build broken on compile-mapred-test | Major | test | Greg Roelofs | Konstantin Boudnik |
-| [MAPREDUCE-1280](https://issues.apache.org/jira/browse/MAPREDUCE-1280) | Eclipse Plugin does not work with Eclipse Ganymede (3.4) | Major | . | Aaron Kimball | Alex Kozlov |
+| [HDFS-996](https://issues.apache.org/jira/browse/HDFS-996) | JUnit tests should never depend on anything in conf | Blocker | test | Konstantin Boudnik | Konstantin Boudnik |
+| [HADOOP-7120](https://issues.apache.org/jira/browse/HADOOP-7120) | 200 new Findbugs warnings | Major | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-1598](https://issues.apache.org/jira/browse/HDFS-1598) | ListPathsServlet excludes .\*.crc files | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-1612](https://issues.apache.org/jira/browse/HDFS-1612) | HDFS Design Documentation is outdated | Minor | documentation | Joe Crobak | Joe Crobak |
+| [HADOOP-7162](https://issues.apache.org/jira/browse/HADOOP-7162) | FsShell: call srcFs.listStatus(src) twice | Minor | fs | Alexey Diomin | Alexey Diomin |
+| [HDFS-1665](https://issues.apache.org/jira/browse/HDFS-1665) | Balancer sleeps inadequately | Minor | balancer & mover | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-1728](https://issues.apache.org/jira/browse/HDFS-1728) | SecondaryNameNode.checkpointSize is in byte but not MB. | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-1750](https://issues.apache.org/jira/browse/HDFS-1750) | fs -ls hftp://file not working | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-7174](https://issues.apache.org/jira/browse/HADOOP-7174) | null is displayed in the console,if the src path is invalid while doing copyToLocal operation from commandLine | Minor | fs | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [HADOOP-7194](https://issues.apache.org/jira/browse/HADOOP-7194) | Potential Resource leak in IOUtils.java | Major | io | Devaraj K | Devaraj K |
+| [HADOOP-7019](https://issues.apache.org/jira/browse/HADOOP-7019) | Refactor build targets to enable faster cross project dev cycles. | Major | build | Owen O'Malley | Luke Lu |
+| [HDFS-1189](https://issues.apache.org/jira/browse/HDFS-1189) | Quota counts missed between clear quota and set quota | Major | namenode | Kang Xiao | John George |
+| [MAPREDUCE-2317](https://issues.apache.org/jira/browse/MAPREDUCE-2317) | HadoopArchives throwing NullPointerException while creating hadoop archives (.har files) | Minor | harchive | Devaraj K | Devaraj K |
+| [HADOOP-7183](https://issues.apache.org/jira/browse/HADOOP-7183) | WritableComparator.get should not cache comparator objects | Blocker | . | Todd Lipcon | Tom White |
+| [HADOOP-7215](https://issues.apache.org/jira/browse/HADOOP-7215) | RPC clients must connect over a network interface corresponding to the host name in the client's kerberos principal key | Blocker | security | Suresh Srinivas | Suresh Srinivas |
### TESTS:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.1/RELEASENOTES.0.21.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.1/RELEASENOTES.0.21.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.1/RELEASENOTES.0.21.1.md
index 0e2a4e8..1c8c589 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.1/RELEASENOTES.0.21.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.1/RELEASENOTES.0.21.1.md
@@ -23,72 +23,72 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-7193](https://issues.apache.org/jira/browse/HADOOP-7193) | *Minor* | **Help message is wrong for touchz command.**
+* [MAPREDUCE-2032](https://issues.apache.org/jira/browse/MAPREDUCE-2032) | *Major* | **TestJobOutputCommitter fails in ant test run**
-Updated the help for the touchz command.
+Clears a problem that {{TestJobCleanup}} leaves behind files that cause {{TestJobOutputCommitter}} to error out.
---
-* [HADOOP-7117](https://issues.apache.org/jira/browse/HADOOP-7117) | *Major* | **Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml**
+* [HADOOP-6971](https://issues.apache.org/jira/browse/HADOOP-6971) | *Major* | **Clover build doesn't generate per-test coverage**
-Removed references to the older fs.checkpoint.\* properties that resided in core-site.xml
+This fix requires that test coverage is running under Clover 3.0+
---
-* [HADOOP-6971](https://issues.apache.org/jira/browse/HADOOP-6971) | *Major* | **Clover build doesn't generate per-test coverage**
+* [HDFS-1420](https://issues.apache.org/jira/browse/HDFS-1420) | *Major* | **Clover build doesn't generate per-test coverage**
This fix requires that test coverage is running under Clover 3.0+
---
-* [HADOOP-6944](https://issues.apache.org/jira/browse/HADOOP-6944) | *Major* | **[Herriot] Implement a functionality for getting proxy users definitions like groups and hosts.**
+* [MAPREDUCE-2090](https://issues.apache.org/jira/browse/MAPREDUCE-2090) | *Major* | **Clover build doesn't generate per-test coverage**
-I have just committed this to 0.21 and trunk. Thanks Vinay.
+This fix requires that test coverage is running under Clover 3.0+
---
-* [HDFS-1596](https://issues.apache.org/jira/browse/HDFS-1596) | *Major* | **Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml**
+* [MAPREDUCE-2040](https://issues.apache.org/jira/browse/MAPREDUCE-2040) | *Minor* | **Forrest Documentation for Dynamic Priority Scheduler**
-Removed references to the older fs.checkpoint.\* properties that resided in core-site.xml
+Forrest Documentation for Dynamic Priority Scheduler
---
-* [HDFS-1420](https://issues.apache.org/jira/browse/HDFS-1420) | *Major* | **Clover build doesn't generate per-test coverage**
+* [HADOOP-6944](https://issues.apache.org/jira/browse/HADOOP-6944) | *Major* | **[Herriot] Implement a functionality for getting proxy users definitions like groups and hosts.**
-This fix requires that test coverage is running under Clover 3.0+
+I have just committed this to 0.21 and trunk. Thanks Vinay.
---
-* [MAPREDUCE-2090](https://issues.apache.org/jira/browse/MAPREDUCE-2090) | *Major* | **Clover build doesn't generate per-test coverage**
+* [MAPREDUCE-1905](https://issues.apache.org/jira/browse/MAPREDUCE-1905) | *Blocker* | **Context.setStatus() and progress() api are ignored**
-This fix requires that test coverage is running under Clover 3.0+
+Moved the api public Counter getCounter(Enum\<?\> counterName), public Counter getCounter(String groupName, String counterName) from org.apache.hadoop.mapreduce.TaskInputOutputContext to org.apache.hadoop.mapreduce.TaskAttemptContext
---
-* [MAPREDUCE-2040](https://issues.apache.org/jira/browse/MAPREDUCE-2040) | *Minor* | **Forrest Documentation for Dynamic Priority Scheduler**
+* [HDFS-1596](https://issues.apache.org/jira/browse/HDFS-1596) | *Major* | **Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml**
-Forrest Documentation for Dynamic Priority Scheduler
+Removed references to the older fs.checkpoint.\* properties that resided in core-site.xml
---
-* [MAPREDUCE-2032](https://issues.apache.org/jira/browse/MAPREDUCE-2032) | *Major* | **TestJobOutputCommitter fails in ant test run**
+* [HADOOP-7117](https://issues.apache.org/jira/browse/HADOOP-7117) | *Major* | **Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml**
-Clears a problem that {{TestJobCleanup}} leaves behind files that cause {{TestJobOutputCommitter}} to error out.
+Removed references to the older fs.checkpoint.\* properties that resided in core-site.xml
---
-* [MAPREDUCE-1905](https://issues.apache.org/jira/browse/MAPREDUCE-1905) | *Blocker* | **Context.setStatus() and progress() api are ignored**
+* [HADOOP-7193](https://issues.apache.org/jira/browse/HADOOP-7193) | *Minor* | **Help message is wrong for touchz command.**
-Moved the api public Counter getCounter(Enum\<?\> counterName), public Counter getCounter(String groupName, String counterName) from org.apache.hadoop.mapreduce.TaskInputOutputContext to org.apache.hadoop.mapreduce.TaskAttemptContext
+Updated the help for the touchz command.
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[07/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.2.0/CHANGES.2.2.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.2.0/CHANGES.2.2.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.2.0/CHANGES.2.2.0.md
index e47ecd8..cf4d6c9 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.2.0/CHANGES.2.2.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.2.0/CHANGES.2.2.0.md
@@ -24,91 +24,79 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10020](https://issues.apache.org/jira/browse/HADOOP-10020) | disable symlinks temporarily | Blocker | fs | Colin Patrick McCabe | Sanjay Radia |
| [YARN-1229](https://issues.apache.org/jira/browse/YARN-1229) | Define constraints on Auxiliary Service names. Change ShuffleHandler service name from mapreduce.shuffle to mapreduce\_shuffle. | Blocker | nodemanager | Tassapol Athiapinya | Xuan Gong |
| [YARN-1228](https://issues.apache.org/jira/browse/YARN-1228) | Clean up Fair Scheduler configuration loading | Major | scheduler | Sandy Ryza | Sandy Ryza |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-10020](https://issues.apache.org/jira/browse/HADOOP-10020) | disable symlinks temporarily | Blocker | fs | Colin P. McCabe | Sanjay Radia |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-4817](https://issues.apache.org/jira/browse/HDFS-4817) | make HDFS advisory caching configurable on a per-file basis | Minor | hdfs-client | Colin P. McCabe | Colin P. McCabe |
| [HADOOP-9758](https://issues.apache.org/jira/browse/HADOOP-9758) | Provide configuration option for FileSystem/FileContext symlink resolution | Major | . | Andrew Wang | Andrew Wang |
-| [HADOOP-8315](https://issues.apache.org/jira/browse/HADOOP-8315) | Support SASL-authenticated ZooKeeper in ActiveStandbyElector | Major | auto-failover, ha | Todd Lipcon | Todd Lipcon |
-| [HDFS-5308](https://issues.apache.org/jira/browse/HDFS-5308) | Replace HttpConfig#getSchemePrefix with implicit schemes in HDFS JSP | Major | . | Haohui Mai | Haohui Mai |
-| [HDFS-5256](https://issues.apache.org/jira/browse/HDFS-5256) | Use guava LoadingCache to implement DFSClientCache | Major | nfs | Haohui Mai | Haohui Mai |
| [HDFS-5139](https://issues.apache.org/jira/browse/HDFS-5139) | Remove redundant -R option from setrep | Major | tools | Arpit Agarwal | Arpit Agarwal |
-| [HDFS-4817](https://issues.apache.org/jira/browse/HDFS-4817) | make HDFS advisory caching configurable on a per-file basis | Minor | hdfs-client | Colin Patrick McCabe | Colin Patrick McCabe |
| [YARN-1246](https://issues.apache.org/jira/browse/YARN-1246) | Log application status in the rm log when app is done running | Minor | . | Arpit Gupta | Arpit Gupta |
+| [HDFS-5256](https://issues.apache.org/jira/browse/HDFS-5256) | Use guava LoadingCache to implement DFSClientCache | Major | nfs | Haohui Mai | Haohui Mai |
+| [HADOOP-8315](https://issues.apache.org/jira/browse/HADOOP-8315) | Support SASL-authenticated ZooKeeper in ActiveStandbyElector | Major | auto-failover, ha | Todd Lipcon | Todd Lipcon |
| [YARN-1213](https://issues.apache.org/jira/browse/YARN-1213) | Restore config to ban submitting to undeclared pools in the Fair Scheduler | Major | scheduler | Sandy Ryza | Sandy Ryza |
+| [HDFS-5308](https://issues.apache.org/jira/browse/HDFS-5308) | Replace HttpConfig#getSchemePrefix with implicit schemes in HDFS JSP | Major | . | Haohui Mai | Haohui Mai |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10012](https://issues.apache.org/jira/browse/HADOOP-10012) | Secure Oozie jobs fail with delegation token renewal exception in Namenode HA setup | Blocker | ha | Arpit Gupta | Suresh Srinivas |
-| [HADOOP-10003](https://issues.apache.org/jira/browse/HADOOP-10003) | HarFileSystem.listLocatedStatus() fails | Major | fs | Jason Dere | |
-| [HADOOP-9976](https://issues.apache.org/jira/browse/HADOOP-9976) | Different versions of avro and avro-maven-plugin | Major | . | Karthik Kambatla | Karthik Kambatla |
+| [HDFS-5031](https://issues.apache.org/jira/browse/HDFS-5031) | BlockScanner scans the block multiple times and on restart scans everything | Blocker | datanode | Vinayakumar B | Vinayakumar B |
+| [MAPREDUCE-5488](https://issues.apache.org/jira/browse/MAPREDUCE-5488) | Job recovery fails after killing all the running containers for the app | Major | . | Arpit Gupta | Jian He |
+| [MAPREDUCE-5515](https://issues.apache.org/jira/browse/MAPREDUCE-5515) | Application Manager UI does not appear with Https enabled | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
+| [HDFS-5251](https://issues.apache.org/jira/browse/HDFS-5251) | Race between the initialization of NameNode and the http server | Major | . | Haohui Mai | Haohui Mai |
+| [HDFS-5228](https://issues.apache.org/jira/browse/HDFS-5228) | The RemoteIterator returned by DistributedFileSystem.listFiles(..) may throw NPE | Blocker | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-5523](https://issues.apache.org/jira/browse/MAPREDUCE-5523) | Need to add https port related property in Job history server | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
+| [YARN-1128](https://issues.apache.org/jira/browse/YARN-1128) | FifoPolicy.computeShares throws NPE on empty list of Schedulables | Major | scheduler | Sandy Ryza | Karthik Kambatla |
| [HADOOP-9776](https://issues.apache.org/jira/browse/HADOOP-9776) | HarFileSystem.listStatus() returns invalid authority if port number is empty | Major | fs | shanyu zhao | shanyu zhao |
| [HADOOP-9761](https://issues.apache.org/jira/browse/HADOOP-9761) | ViewFileSystem#rename fails when using DistributedFileSystem | Blocker | viewfs | Andrew Wang | Andrew Wang |
-| [HDFS-5300](https://issues.apache.org/jira/browse/HDFS-5300) | FSNameSystem#deleteSnapshot() should not check owner in case of permissions disabled | Major | namenode | Vinayakumar B | Vinayakumar B |
-| [HDFS-5299](https://issues.apache.org/jira/browse/HDFS-5299) | DFS client hangs in updatePipeline RPC when failover happened | Blocker | namenode | Vinayakumar B | Vinayakumar B |
-| [HDFS-5289](https://issues.apache.org/jira/browse/HDFS-5289) | Race condition in TestRetryCacheWithHA#testCreateSymlink causes spurious test failure | Major | test | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-5279](https://issues.apache.org/jira/browse/HDFS-5279) | Guard against NullPointerException in NameNode JSP pages before initialization of FSNamesystem. | Major | namenode | Chris Nauroth | Chris Nauroth |
-| [HDFS-5268](https://issues.apache.org/jira/browse/HDFS-5268) | NFS write commit verifier is not set in a few places | Major | nfs | Brandon Li | Brandon Li |
-| [HDFS-5265](https://issues.apache.org/jira/browse/HDFS-5265) | Namenode fails to start when dfs.https.port is unspecified | Major | . | Haohui Mai | Haohui Mai |
+| [MAPREDUCE-5503](https://issues.apache.org/jira/browse/MAPREDUCE-5503) | TestMRJobClient.testJobClient is failing | Blocker | mrv2 | Jason Lowe | Jian He |
+| [YARN-1157](https://issues.apache.org/jira/browse/YARN-1157) | ResourceManager UI has invalid tracking URL link for distributed shell application | Major | resourcemanager | Tassapol Athiapinya | Xuan Gong |
+| [MAPREDUCE-5170](https://issues.apache.org/jira/browse/MAPREDUCE-5170) | incorrect exception message if min node size \> min rack size | Trivial | mrv2 | Sangjin Lee | Sangjin Lee |
| [HDFS-5258](https://issues.apache.org/jira/browse/HDFS-5258) | Skip tests in TestHDFSCLI that are not applicable on Windows. | Minor | test | Chris Nauroth | Chuan Liu |
-| [HDFS-5255](https://issues.apache.org/jira/browse/HDFS-5255) | Distcp job fails with hsftp when https is enabled in insecure cluster | Major | . | Yesha Vora | Arpit Agarwal |
-| [HDFS-5251](https://issues.apache.org/jira/browse/HDFS-5251) | Race between the initialization of NameNode and the http server | Major | . | Haohui Mai | Haohui Mai |
-| [HDFS-5228](https://issues.apache.org/jira/browse/HDFS-5228) | The RemoteIterator returned by DistributedFileSystem.listFiles(..) may throw NPE | Blocker | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-5031](https://issues.apache.org/jira/browse/HDFS-5031) | BlockScanner scans the block multiple times and on restart scans everything | Blocker | datanode | Vinayakumar B | Vinayakumar B |
-| [MAPREDUCE-5554](https://issues.apache.org/jira/browse/MAPREDUCE-5554) | hdfs-site.xml included in hadoop-mapreduce-client-jobclient tests jar is breaking tests for downstream components | Minor | test | Robert Kanter | Robert Kanter |
+| [HADOOP-9976](https://issues.apache.org/jira/browse/HADOOP-9976) | Different versions of avro and avro-maven-plugin | Major | . | Karthik Kambatla | Karthik Kambatla |
+| [MAPREDUCE-5513](https://issues.apache.org/jira/browse/MAPREDUCE-5513) | ConcurrentModificationException in JobControl | Major | . | Jason Lowe | Robert Parker |
| [MAPREDUCE-5545](https://issues.apache.org/jira/browse/MAPREDUCE-5545) | org.apache.hadoop.mapred.TestTaskAttemptListenerImpl.testCommitWindow times out | Major | . | Robert Kanter | Robert Kanter |
+| [HDFS-5268](https://issues.apache.org/jira/browse/HDFS-5268) | NFS write commit verifier is not set in a few places | Major | nfs | Brandon Li | Brandon Li |
+| [HDFS-5265](https://issues.apache.org/jira/browse/HDFS-5265) | Namenode fails to start when dfs.https.port is unspecified | Major | . | Haohui Mai | Haohui Mai |
+| [YARN-1221](https://issues.apache.org/jira/browse/YARN-1221) | With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely | Major | resourcemanager, scheduler | Sandy Ryza | Siqi Li |
+| [YARN-1247](https://issues.apache.org/jira/browse/YARN-1247) | test-container-executor has gotten out of sync with the changes to container-executor | Major | nodemanager | Roman Shaposhnik | Roman Shaposhnik |
| [MAPREDUCE-5544](https://issues.apache.org/jira/browse/MAPREDUCE-5544) | JobClient#getJob loads job conf twice | Major | . | Sandy Ryza | Sandy Ryza |
+| [YARN-1215](https://issues.apache.org/jira/browse/YARN-1215) | Yarn URL should include userinfo | Major | api | Chuan Liu | Chuan Liu |
+| [YARN-1262](https://issues.apache.org/jira/browse/YARN-1262) | TestApplicationCleanup relies on all containers assigned in a single heartbeat | Major | . | Sandy Ryza | Karthik Kambatla |
+| [HADOOP-10003](https://issues.apache.org/jira/browse/HADOOP-10003) | HarFileSystem.listLocatedStatus() fails | Major | fs | Jason Dere | |
+| [HDFS-5255](https://issues.apache.org/jira/browse/HDFS-5255) | Distcp job fails with hsftp when https is enabled in insecure cluster | Major | . | Yesha Vora | Arpit Agarwal |
| [MAPREDUCE-5536](https://issues.apache.org/jira/browse/MAPREDUCE-5536) | mapreduce.jobhistory.webapp.https.address property is not respected | Blocker | . | Yesha Vora | Omkar Vinit Joshi |
-| [MAPREDUCE-5533](https://issues.apache.org/jira/browse/MAPREDUCE-5533) | Speculative execution does not function for reduce | Major | applicationmaster | Tassapol Athiapinya | Xuan Gong |
-| [MAPREDUCE-5523](https://issues.apache.org/jira/browse/MAPREDUCE-5523) | Need to add https port related property in Job history server | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
-| [MAPREDUCE-5515](https://issues.apache.org/jira/browse/MAPREDUCE-5515) | Application Manager UI does not appear with Https enabled | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
-| [MAPREDUCE-5513](https://issues.apache.org/jira/browse/MAPREDUCE-5513) | ConcurrentModificationException in JobControl | Major | . | Jason Lowe | Robert Parker |
-| [MAPREDUCE-5503](https://issues.apache.org/jira/browse/MAPREDUCE-5503) | TestMRJobClient.testJobClient is failing | Blocker | mrv2 | Jason Lowe | Jian He |
-| [MAPREDUCE-5489](https://issues.apache.org/jira/browse/MAPREDUCE-5489) | MR jobs hangs as it does not use the node-blacklisting feature in RM requests | Critical | . | Yesha Vora | Zhijie Shen |
-| [MAPREDUCE-5488](https://issues.apache.org/jira/browse/MAPREDUCE-5488) | Job recovery fails after killing all the running containers for the app | Major | . | Arpit Gupta | Jian He |
+| [HADOOP-10012](https://issues.apache.org/jira/browse/HADOOP-10012) | Secure Oozie jobs fail with delegation token renewal exception in Namenode HA setup | Blocker | ha | Arpit Gupta | Suresh Srinivas |
+| [HDFS-5279](https://issues.apache.org/jira/browse/HDFS-5279) | Guard against NullPointerException in NameNode JSP pages before initialization of FSNamesystem. | Major | namenode | Chris Nauroth | Chris Nauroth |
| [MAPREDUCE-5459](https://issues.apache.org/jira/browse/MAPREDUCE-5459) | Update the doc of running MRv1 examples jar on YARN | Major | . | Zhijie Shen | Zhijie Shen |
-| [MAPREDUCE-5442](https://issues.apache.org/jira/browse/MAPREDUCE-5442) | $HADOOP\_MAPRED\_HOME/$HADOOP\_CONF\_DIR setting not working on Windows | Major | client | Yingda Chen | Yingda Chen |
-| [MAPREDUCE-5170](https://issues.apache.org/jira/browse/MAPREDUCE-5170) | incorrect exception message if min node size \> min rack size | Trivial | mrv2 | Sangjin Lee | Sangjin Lee |
-| [YARN-1278](https://issues.apache.org/jira/browse/YARN-1278) | New AM does not start after rm restart | Blocker | . | Yesha Vora | Hitesh Shah |
-| [YARN-1274](https://issues.apache.org/jira/browse/YARN-1274) | LCE fails to run containers that don't have resources to localize | Blocker | nodemanager | Alejandro Abdelnur | Siddharth Seth |
-| [YARN-1273](https://issues.apache.org/jira/browse/YARN-1273) | Distributed shell does not account for start container failures reported asynchronously. | Major | . | Hitesh Shah | Hitesh Shah |
-| [YARN-1271](https://issues.apache.org/jira/browse/YARN-1271) | "Text file busy" errors launching containers again | Major | nodemanager | Sandy Ryza | Sandy Ryza |
-| [YARN-1262](https://issues.apache.org/jira/browse/YARN-1262) | TestApplicationCleanup relies on all containers assigned in a single heartbeat | Major | . | Sandy Ryza | Karthik Kambatla |
-| [YARN-1251](https://issues.apache.org/jira/browse/YARN-1251) | TestDistributedShell#TestDSShell failed with timeout | Major | applications/distributed-shell | Junping Du | Xuan Gong |
-| [YARN-1247](https://issues.apache.org/jira/browse/YARN-1247) | test-container-executor has gotten out of sync with the changes to container-executor | Major | nodemanager | Roman Shaposhnik | Roman Shaposhnik |
+| [YARN-1141](https://issues.apache.org/jira/browse/YARN-1141) | Updating resource requests should be decoupled with updating blacklist | Major | . | Zhijie Shen | Zhijie Shen |
+| [MAPREDUCE-5554](https://issues.apache.org/jira/browse/MAPREDUCE-5554) | hdfs-site.xml included in hadoop-mapreduce-client-jobclient tests jar is breaking tests for downstream components | Minor | test | Robert Kanter | Robert Kanter |
+| [YARN-876](https://issues.apache.org/jira/browse/YARN-876) | Node resource is added twice when node comes back from unhealthy to healthy | Major | resourcemanager | Peng Zhang | Peng Zhang |
+| [HDFS-5289](https://issues.apache.org/jira/browse/HDFS-5289) | Race condition in TestRetryCacheWithHA#testCreateSymlink causes spurious test failure | Major | test | Aaron T. Myers | Aaron T. Myers |
+| [MAPREDUCE-5489](https://issues.apache.org/jira/browse/MAPREDUCE-5489) | MR jobs hangs as it does not use the node-blacklisting feature in RM requests | Critical | . | Yesha Vora | Zhijie Shen |
+| [YARN-890](https://issues.apache.org/jira/browse/YARN-890) | The roundup for memory values on resource manager UI is misleading | Major | resourcemanager | Trupti Dhavle | Xuan Gong |
| [YARN-1236](https://issues.apache.org/jira/browse/YARN-1236) | FairScheduler setting queue name in RMApp is not working | Major | resourcemanager | Sandy Ryza | Sandy Ryza |
-| [YARN-1221](https://issues.apache.org/jira/browse/YARN-1221) | With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely | Major | resourcemanager, scheduler | Sandy Ryza | Siqi Li |
+| [YARN-1271](https://issues.apache.org/jira/browse/YARN-1271) | "Text file busy" errors launching containers again | Major | nodemanager | Sandy Ryza | Sandy Ryza |
+| [YARN-1149](https://issues.apache.org/jira/browse/YARN-1149) | NM throws InvalidStateTransitonException: Invalid event: APPLICATION\_LOG\_HANDLING\_FINISHED at RUNNING | Major | . | Ramya Sunil | Xuan Gong |
+| [MAPREDUCE-5442](https://issues.apache.org/jira/browse/MAPREDUCE-5442) | $HADOOP\_MAPRED\_HOME/$HADOOP\_CONF\_DIR setting not working on Windows | Major | client | Yingda Chen | Yingda Chen |
| [YARN-1219](https://issues.apache.org/jira/browse/YARN-1219) | FSDownload changes file suffix making FileUtil.unTar() throw exception | Major | nodemanager | shanyu zhao | shanyu zhao |
-| [YARN-1215](https://issues.apache.org/jira/browse/YARN-1215) | Yarn URL should include userinfo | Major | api | Chuan Liu | Chuan Liu |
+| [MAPREDUCE-5533](https://issues.apache.org/jira/browse/MAPREDUCE-5533) | Speculative execution does not function for reduce | Major | applicationmaster | Tassapol Athiapinya | Xuan Gong |
+| [HDFS-5300](https://issues.apache.org/jira/browse/HDFS-5300) | FSNameSystem#deleteSnapshot() should not check owner in case of permissions disabled | Major | namenode | Vinayakumar B | Vinayakumar B |
+| [YARN-1251](https://issues.apache.org/jira/browse/YARN-1251) | TestDistributedShell#TestDSShell failed with timeout | Major | applications/distributed-shell | Junping Du | Xuan Gong |
| [YARN-1167](https://issues.apache.org/jira/browse/YARN-1167) | Submitted distributed shell application shows appMasterHost = empty | Major | applications/distributed-shell | Tassapol Athiapinya | Xuan Gong |
-| [YARN-1157](https://issues.apache.org/jira/browse/YARN-1157) | ResourceManager UI has invalid tracking URL link for distributed shell application | Major | resourcemanager | Tassapol Athiapinya | Xuan Gong |
-| [YARN-1149](https://issues.apache.org/jira/browse/YARN-1149) | NM throws InvalidStateTransitonException: Invalid event: APPLICATION\_LOG\_HANDLING\_FINISHED at RUNNING | Major | . | Ramya Sunil | Xuan Gong |
-| [YARN-1141](https://issues.apache.org/jira/browse/YARN-1141) | Updating resource requests should be decoupled with updating blacklist | Major | . | Zhijie Shen | Zhijie Shen |
-| [YARN-1128](https://issues.apache.org/jira/browse/YARN-1128) | FifoPolicy.computeShares throws NPE on empty list of Schedulables | Major | scheduler | Sandy Ryza | Karthik Kambatla |
-| [YARN-1090](https://issues.apache.org/jira/browse/YARN-1090) | Job does not get into Pending State | Major | . | Yesha Vora | Jian He |
+| [YARN-1273](https://issues.apache.org/jira/browse/YARN-1273) | Distributed shell does not account for start container failures reported asynchronously. | Major | . | Hitesh Shah | Hitesh Shah |
| [YARN-1032](https://issues.apache.org/jira/browse/YARN-1032) | NPE in RackResolve | Critical | . | Lohit Vijayarenu | Lohit Vijayarenu |
-| [YARN-890](https://issues.apache.org/jira/browse/YARN-890) | The roundup for memory values on resource manager UI is misleading | Major | resourcemanager | Trupti Dhavle | Xuan Gong |
-| [YARN-876](https://issues.apache.org/jira/browse/YARN-876) | Node resource is added twice when node comes back from unhealthy to healthy | Major | resourcemanager | Peng Zhang | Peng Zhang |
+| [YARN-1090](https://issues.apache.org/jira/browse/YARN-1090) | Job does not get into Pending State | Major | . | Yesha Vora | Jian He |
+| [YARN-1274](https://issues.apache.org/jira/browse/YARN-1274) | LCE fails to run containers that don't have resources to localize | Blocker | nodemanager | Alejandro Abdelnur | Siddharth Seth |
+| [YARN-1278](https://issues.apache.org/jira/browse/YARN-1278) | New AM does not start after rm restart | Blocker | . | Yesha Vora | Hitesh Shah |
+| [HDFS-5299](https://issues.apache.org/jira/browse/HDFS-5299) | DFS client hangs in updatePipeline RPC when failover happened | Blocker | namenode | Vinayakumar B | Vinayakumar B |
### TESTS:
@@ -124,35 +112,29 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10017](https://issues.apache.org/jira/browse/HADOOP-10017) | Fix NPE in DFSClient#getDelegationToken when doing Distcp from a secured cluster to an insecured cluster | Major | . | Jing Zhao | Haohui Mai |
-| [HDFS-5306](https://issues.apache.org/jira/browse/HDFS-5306) | Datanode https port is not available at the namenode | Major | datanode, namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-5259](https://issues.apache.org/jira/browse/HDFS-5259) | Support client which combines appended data with old data before sends it to NFS server | Major | nfs | Yesha Vora | Brandon Li |
+| [YARN-1203](https://issues.apache.org/jira/browse/YARN-1203) | Application Manager UI does not appear with Https enabled | Major | . | Yesha Vora | Omkar Vinit Joshi |
+| [YARN-1204](https://issues.apache.org/jira/browse/YARN-1204) | Need to add https port related property in Yarn | Major | . | Yesha Vora | Omkar Vinit Joshi |
+| [MAPREDUCE-5505](https://issues.apache.org/jira/browse/MAPREDUCE-5505) | Clients should be notified job finished only after job successfully unregistered | Critical | . | Jian He | Zhijie Shen |
+| [YARN-1214](https://issues.apache.org/jira/browse/YARN-1214) | Register ClientToken MasterKey in SecretManager after it is saved | Critical | resourcemanager | Jian He | Jian He |
| [HDFS-5246](https://issues.apache.org/jira/browse/HDFS-5246) | Make Hadoop nfs server port and mount daemon port configurable | Major | nfs | Jinghui Wang | Jinghui Wang |
-| [HDFS-5230](https://issues.apache.org/jira/browse/HDFS-5230) | Introduce RpcInfo to decouple XDR classes from the RPC API | Major | nfs | Haohui Mai | Haohui Mai |
-| [MAPREDUCE-5562](https://issues.apache.org/jira/browse/MAPREDUCE-5562) | MR AM should exit when unregister() throws exception | Major | . | Zhijie Shen | Zhijie Shen |
-| [MAPREDUCE-5551](https://issues.apache.org/jira/browse/MAPREDUCE-5551) | Binary Incompatibility of O.A.H.U.mapred.SequenceFileAsBinaryOutputFormat.WritableValueBytes | Blocker | . | Zhijie Shen | Zhijie Shen |
-| [MAPREDUCE-5538](https://issues.apache.org/jira/browse/MAPREDUCE-5538) | MRAppMaster#shutDownJob shouldn't send job end notification before checking isLastRetry | Blocker | . | Zhijie Shen | Zhijie Shen |
+| [YARN-49](https://issues.apache.org/jira/browse/YARN-49) | Improve distributed shell application to work on a secure cluster | Major | applications/distributed-shell | Hitesh Shah | Vinod Kumar Vavilapalli |
| [MAPREDUCE-5531](https://issues.apache.org/jira/browse/MAPREDUCE-5531) | Binary and source incompatibility in mapreduce.TaskID and mapreduce.TaskAttemptID between branch-1 and branch-2 | Blocker | mrv1, mrv2 | Robert Kanter | Robert Kanter |
-| [MAPREDUCE-5530](https://issues.apache.org/jira/browse/MAPREDUCE-5530) | Binary and source incompatibility in mapred.lib.CombineFileInputFormat between branch-1 and branch-2 | Blocker | mrv1, mrv2 | Robert Kanter | Robert Kanter |
| [MAPREDUCE-5529](https://issues.apache.org/jira/browse/MAPREDUCE-5529) | Binary incompatibilities in mapred.lib.TotalOrderPartitioner between branch-1 and branch-2 | Blocker | mrv1, mrv2 | Robert Kanter | Robert Kanter |
-| [MAPREDUCE-5505](https://issues.apache.org/jira/browse/MAPREDUCE-5505) | Clients should be notified job finished only after job successfully unregistered | Critical | . | Jian He | Zhijie Shen |
-| [YARN-1277](https://issues.apache.org/jira/browse/YARN-1277) | Add http policy support for YARN daemons | Major | . | Suresh Srinivas | Omkar Vinit Joshi |
+| [YARN-899](https://issues.apache.org/jira/browse/YARN-899) | Get queue administration ACLs working | Major | scheduler | Sandy Ryza | Xuan Gong |
+| [MAPREDUCE-5538](https://issues.apache.org/jira/browse/MAPREDUCE-5538) | MRAppMaster#shutDownJob shouldn't send job end notification before checking isLastRetry | Blocker | . | Zhijie Shen | Zhijie Shen |
+| [HDFS-5230](https://issues.apache.org/jira/browse/HDFS-5230) | Introduce RpcInfo to decouple XDR classes from the RPC API | Major | nfs | Haohui Mai | Haohui Mai |
+| [YARN-1070](https://issues.apache.org/jira/browse/YARN-1070) | ContainerImpl State Machine: Invalid event: CONTAINER\_KILLED\_ON\_REQUEST at CONTAINER\_CLEANEDUP\_AFTER\_KILL | Major | nodemanager | Hitesh Shah | Zhijie Shen |
+| [MAPREDUCE-5551](https://issues.apache.org/jira/browse/MAPREDUCE-5551) | Binary Incompatibility of O.A.H.U.mapred.SequenceFileAsBinaryOutputFormat.WritableValueBytes | Blocker | . | Zhijie Shen | Zhijie Shen |
| [YARN-1260](https://issues.apache.org/jira/browse/YARN-1260) | RM\_HOME link breaks when webapp.https.address related properties are not specified | Major | . | Yesha Vora | Omkar Vinit Joshi |
+| [MAPREDUCE-5530](https://issues.apache.org/jira/browse/MAPREDUCE-5530) | Binary and source incompatibility in mapred.lib.CombineFileInputFormat between branch-1 and branch-2 | Blocker | mrv1, mrv2 | Robert Kanter | Robert Kanter |
+| [YARN-621](https://issues.apache.org/jira/browse/YARN-621) | RM triggers web auth failure before first job | Critical | resourcemanager | Allen Wittenauer | Omkar Vinit Joshi |
| [YARN-1256](https://issues.apache.org/jira/browse/YARN-1256) | NM silently ignores non-existent service in StartContainerRequest | Critical | . | Bikas Saha | Xuan Gong |
-| [YARN-1254](https://issues.apache.org/jira/browse/YARN-1254) | NM is polluting container's credentials | Major | . | Vinod Kumar Vavilapalli | Omkar Vinit Joshi |
-| [YARN-1214](https://issues.apache.org/jira/browse/YARN-1214) | Register ClientToken MasterKey in SecretManager after it is saved | Critical | resourcemanager | Jian He | Jian He |
-| [YARN-1204](https://issues.apache.org/jira/browse/YARN-1204) | Need to add https port related property in Yarn | Major | . | Yesha Vora | Omkar Vinit Joshi |
-| [YARN-1203](https://issues.apache.org/jira/browse/YARN-1203) | Application Manager UI does not appear with Https enabled | Major | . | Yesha Vora | Omkar Vinit Joshi |
| [YARN-1131](https://issues.apache.org/jira/browse/YARN-1131) | $yarn logs command should return an appropriate error message if YARN application is still running | Minor | client | Tassapol Athiapinya | Siddharth Seth |
-| [YARN-1070](https://issues.apache.org/jira/browse/YARN-1070) | ContainerImpl State Machine: Invalid event: CONTAINER\_KILLED\_ON\_REQUEST at CONTAINER\_CLEANEDUP\_AFTER\_KILL | Major | nodemanager | Hitesh Shah | Zhijie Shen |
-| [YARN-899](https://issues.apache.org/jira/browse/YARN-899) | Get queue administration ACLs working | Major | scheduler | Sandy Ryza | Xuan Gong |
-| [YARN-621](https://issues.apache.org/jira/browse/YARN-621) | RM triggers web auth failure before first job | Critical | resourcemanager | Allen Wittenauer | Omkar Vinit Joshi |
-| [YARN-49](https://issues.apache.org/jira/browse/YARN-49) | Improve distributed shell application to work on a secure cluster | Major | applications/distributed-shell | Hitesh Shah | Vinod Kumar Vavilapalli |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [YARN-1254](https://issues.apache.org/jira/browse/YARN-1254) | NM is polluting container's credentials | Major | . | Vinod Kumar Vavilapalli | Omkar Vinit Joshi |
+| [HDFS-5306](https://issues.apache.org/jira/browse/HDFS-5306) | Datanode https port is not available at the namenode | Major | datanode, namenode | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-10017](https://issues.apache.org/jira/browse/HADOOP-10017) | Fix NPE in DFSClient#getDelegationToken when doing Distcp from a secured cluster to an insecured cluster | Major | . | Jing Zhao | Haohui Mai |
+| [YARN-1277](https://issues.apache.org/jira/browse/YARN-1277) | Add http policy support for YARN daemons | Major | . | Suresh Srinivas | Omkar Vinit Joshi |
+| [MAPREDUCE-5562](https://issues.apache.org/jira/browse/MAPREDUCE-5562) | MR AM should exit when unregister() throws exception | Major | . | Zhijie Shen | Zhijie Shen |
+| [HDFS-5259](https://issues.apache.org/jira/browse/HDFS-5259) | Support client which combines appended data with old data before sends it to NFS server | Major | nfs | Yesha Vora | Brandon Li |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.2.0/RELEASENOTES.2.2.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.2.0/RELEASENOTES.2.2.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.2.0/RELEASENOTES.2.2.0.md
index 5132927..330ff37 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.2.0/RELEASENOTES.2.2.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.2.0/RELEASENOTES.2.2.0.md
@@ -23,23 +23,23 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-10020](https://issues.apache.org/jira/browse/HADOOP-10020) | *Blocker* | **disable symlinks temporarily**
+* [YARN-1229](https://issues.apache.org/jira/browse/YARN-1229) | *Blocker* | **Define constraints on Auxiliary Service names. Change ShuffleHandler service name from mapreduce.shuffle to mapreduce\_shuffle.**
-During review of symbolic links, many issues were found related to the impact on semantics of existing APIs such FileSystem#listStatus, FileSystem#globStatus etc. There were also many issues brought up about symbolic links, and the impact on security and functionality of HDFS. All these issues will be addressed in the upcoming release 2.3. Until then the feature is temporarily disabled.
+**WARNING: No release note provided for this change.**
---
-* [YARN-1229](https://issues.apache.org/jira/browse/YARN-1229) | *Blocker* | **Define constraints on Auxiliary Service names. Change ShuffleHandler service name from mapreduce.shuffle to mapreduce\_shuffle.**
+* [YARN-1228](https://issues.apache.org/jira/browse/YARN-1228) | *Major* | **Clean up Fair Scheduler configuration loading**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-1228](https://issues.apache.org/jira/browse/YARN-1228) | *Major* | **Clean up Fair Scheduler configuration loading**
+* [HADOOP-10020](https://issues.apache.org/jira/browse/HADOOP-10020) | *Blocker* | **disable symlinks temporarily**
-**WARNING: No release note provided for this incompatible change.**
+During review of symbolic links, many issues were found related to the impact on semantics of existing APIs such FileSystem#listStatus, FileSystem#globStatus etc. There were also many issues brought up about symbolic links, and the impact on security and functionality of HDFS. All these issues will be addressed in the upcoming release 2.3. Until then the feature is temporarily disabled.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.2.1/CHANGES.2.2.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.2.1/CHANGES.2.2.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.2.1/CHANGES.2.2.1.md
index 4584486..4284bb8 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.2.1/CHANGES.2.2.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.2.1/CHANGES.2.2.1.md
@@ -18,24 +18,8 @@
-->
# Apache Hadoop Changelog
-## Release 2.2.1 - Unreleased (as of 2016-03-04)
+## Release 2.2.1 - Unreleased (as of 2017-08-28)
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### IMPROVEMENTS:
@@ -52,21 +36,3 @@
| [HADOOP-10110](https://issues.apache.org/jira/browse/HADOOP-10110) | hadoop-auth has a build break due to missing dependency | Blocker | build | Chuan Liu | Chuan Liu |
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[13/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.2-alpha/RELEASENOTES.2.0.2-alpha.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.2-alpha/RELEASENOTES.2.0.2-alpha.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.2-alpha/RELEASENOTES.2.0.2-alpha.md
index 7073417..77aa1a0 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.2-alpha/RELEASENOTES.2.0.2-alpha.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.2-alpha/RELEASENOTES.2.0.2-alpha.md
@@ -23,65 +23,63 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-8794](https://issues.apache.org/jira/browse/HADOOP-8794) | *Major* | **Modifiy bin/hadoop to point to HADOOP\_YARN\_HOME**
+* [HADOOP-7703](https://issues.apache.org/jira/browse/HADOOP-7703) | *Major* | **WebAppContext should also be stopped and cleared**
-**WARNING: No release note provided for this incompatible change.**
+Improved excpetion handling of shutting down web server. (Devaraj K via Eric Yang)
---
-* [HADOOP-8710](https://issues.apache.org/jira/browse/HADOOP-8710) | *Major* | **Remove ability for users to easily run the trash emptier**
+* [MAPREDUCE-3348](https://issues.apache.org/jira/browse/MAPREDUCE-3348) | *Major* | **mapred job -status fails to give info even if the job is present in History**
-The trash emptier may no longer be run using "hadoop org.apache.hadoop.fs.Trash". The trash emptier runs on the NameNode (if configured). Old trash checkpoints may be deleted using "hadoop fs -expunge".
+Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app.
---
-* [HADOOP-8703](https://issues.apache.org/jira/browse/HADOOP-8703) | *Major* | **distcpV2: turn CRC checking off for 0 byte size**
+* [MAPREDUCE-4072](https://issues.apache.org/jira/browse/MAPREDUCE-4072) | *Major* | **User set java.library.path seems to overwrite default creating problems native lib loading**
-distcp skips CRC on 0 byte files.
+-Djava.library.path in mapred.child.java.opts can cause issues with native libraries. LD\_LIBRARY\_PATH through mapred.child.env should be used instead.
---
-* [HADOOP-8689](https://issues.apache.org/jira/browse/HADOOP-8689) | *Major* | **Make trash a server side configuration option**
+* [HDFS-3110](https://issues.apache.org/jira/browse/HDFS-3110) | *Major* | **libhdfs implementation of direct read API**
-If fs.trash.interval is configured on the server then the client's value for this configuration is ignored.
+libhdfs is enhanced to read directly into user-supplied buffers when possible, reducing the number of memory copies.
---
-* [HADOOP-8551](https://issues.apache.org/jira/browse/HADOOP-8551) | *Major* | **fs -mkdir creates parent directories without the -p option**
+* [MAPREDUCE-4017](https://issues.apache.org/jira/browse/MAPREDUCE-4017) | *Trivial* | **Add jobname to jobsummary log**
-FsShell's "mkdir" no longer implicitly creates all non-existent parent directories. The command adopts the posix compliant behavior of requiring the "-p" flag to auto-create parent directories.
+The Job Summary log may contain commas in values that are escaped by a '\\' character. This was true before, but is more likely to be exposed now.
---
-* [HADOOP-8533](https://issues.apache.org/jira/browse/HADOOP-8533) | *Major* | **Remove Parallel Call in IPC**
-
-Merged the change to branch-2
-
-
----
+* [MAPREDUCE-3812](https://issues.apache.org/jira/browse/MAPREDUCE-3812) | *Major* | **Lower default allocation sizes, fix allocation configurations and document them**
-* [HADOOP-8458](https://issues.apache.org/jira/browse/HADOOP-8458) | *Major* | **Add management hook to AuthenticationHandler to enable delegation token operations support**
+Removes two sets of previously available config properties:
-**WARNING: No release note provided for this incompatible change.**
+1. ( yarn.scheduler.fifo.minimum-allocation-mb and yarn.scheduler.fifo.maximum-allocation-mb ) and,
+2. ( yarn.scheduler.capacity.minimum-allocation-mb and yarn.scheduler.capacity.maximum-allocation-mb )
+In favor of two new, generically named properties:
----
+1. yarn.scheduler.minimum-allocation-mb - This acts as the floor value of memory resource requests for containers.
+2. yarn.scheduler.maximum-allocation-mb - This acts as the ceiling value of memory resource requests for containers.
-* [HADOOP-8388](https://issues.apache.org/jira/browse/HADOOP-8388) | *Minor* | **Remove unused BlockLocation serialization**
+Both these properties need to be set at the ResourceManager (RM) to take effect, as the RM is where the scheduler resides.
-**WARNING: No release note provided for this incompatible change.**
+Also changes the default minimum and maximums to 128 MB and 10 GB respectively.
---
-* [HADOOP-8368](https://issues.apache.org/jira/browse/HADOOP-8368) | *Minor* | **Use CMake rather than autotools to build native code**
+* [HDFS-3318](https://issues.apache.org/jira/browse/HDFS-3318) | *Blocker* | **Hftp hangs on transfers \>2GB**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
@@ -93,30 +91,32 @@ Resolve sporadic distcp issue due to having two DistCp classes (v1 & v2) in the
---
-* [HADOOP-7703](https://issues.apache.org/jira/browse/HADOOP-7703) | *Major* | **WebAppContext should also be stopped and cleared**
+* [HADOOP-8388](https://issues.apache.org/jira/browse/HADOOP-8388) | *Minor* | **Remove unused BlockLocation serialization**
-Improved excpetion handling of shutting down web server. (Devaraj K via Eric Yang)
+**WARNING: No release note provided for this change.**
---
-* [HDFS-3755](https://issues.apache.org/jira/browse/HDFS-3755) | *Major* | **Creating an already-open-for-write file with overwrite=true fails**
+* [MAPREDUCE-3543](https://issues.apache.org/jira/browse/MAPREDUCE-3543) | *Critical* | **Mavenize Gridmix.**
-This is an incompatible change: Before this change, if a file is already open for write by one client, and another client calls fs.create() with overwrite=true, an AlreadyBeingCreatedException is thrown. After this change, the file will be deleted and the new file will be created successfully.
+Note that to apply this you should first run the script - ./MAPREDUCE-3543v3.sh svn, then apply the patch.
+
+If this is merged to more then trunk, the version inside of hadoop-tools/hadoop-gridmix/pom.xml will need to be udpated accordingly.
---
-* [HDFS-3697](https://issues.apache.org/jira/browse/HDFS-3697) | *Minor* | **Enable fadvise readahead by default**
+* [MAPREDUCE-3873](https://issues.apache.org/jira/browse/MAPREDUCE-3873) | *Minor* | **Nodemanager is not getting decommisioned if the absolute ip is given in exclude file.**
-The datanode now performs 4MB readahead by default when reading data from its disks, if the native libraries are present. This has been shown to improve performance in many workloads. The feature may be disabled by setting dfs.datanode.readahead.bytes to "0".
+Fixed NodeManagers' decommissioning at RM to accept IP addresses also.
---
-* [HDFS-3675](https://issues.apache.org/jira/browse/HDFS-3675) | *Minor* | **libhdfs: follow documented return codes**
+* [HADOOP-8368](https://issues.apache.org/jira/browse/HADOOP-8368) | *Minor* | **Use CMake rather than autotools to build native code**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
@@ -128,6 +128,13 @@ getBlockLocations(), and hence open() for read, will now throw SafeModeException
---
+* [HADOOP-8458](https://issues.apache.org/jira/browse/HADOOP-8458) | *Major* | **Add management hook to AuthenticationHandler to enable delegation token operations support**
+
+**WARNING: No release note provided for this change.**
+
+
+---
+
* [HDFS-3518](https://issues.apache.org/jira/browse/HDFS-3518) | *Major* | **Provide API to check HDFS operational state**
Add a utility method HdfsUtils.isHealthy(uri) for checking if the given HDFS is healthy.
@@ -135,6 +142,13 @@ Add a utility method HdfsUtils.isHealthy(uri) for checking if the given HDFS is
---
+* [MAPREDUCE-4311](https://issues.apache.org/jira/browse/MAPREDUCE-4311) | *Major* | **Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings**
+
+**WARNING: No release note provided for this change.**
+
+
+---
+
* [HDFS-3475](https://issues.apache.org/jira/browse/HDFS-3475) | *Trivial* | **Make the replication and invalidation rates configurable**
This change adds two new configuration parameters.
@@ -153,121 +167,107 @@ HDFS no longer silently ignores missing or unreadable host files specified by df
---
-* [HDFS-3318](https://issues.apache.org/jira/browse/HDFS-3318) | *Blocker* | **Hftp hangs on transfers \>2GB**
+* [HADOOP-8533](https://issues.apache.org/jira/browse/HADOOP-8533) | *Major* | **Remove Parallel Call in IPC**
-**WARNING: No release note provided for this incompatible change.**
+Merged the change to branch-2
---
-* [HDFS-3110](https://issues.apache.org/jira/browse/HDFS-3110) | *Major* | **libhdfs implementation of direct read API**
+* [MAPREDUCE-3940](https://issues.apache.org/jira/browse/MAPREDUCE-3940) | *Major* | **ContainerTokens should have an expiry interval**
-libhdfs is enhanced to read directly into user-supplied buffers when possible, reducing the number of memory copies.
+ContainerTokens now have an expiry interval so that stale tokens cannot be used for launching containers.
---
-* [HDFS-2793](https://issues.apache.org/jira/browse/HDFS-2793) | *Major* | **Add an admin command to trigger an edit log roll**
+* [HDFS-3675](https://issues.apache.org/jira/browse/HDFS-3675) | *Minor* | **libhdfs: follow documented return codes**
-Introduced a new command, "hdfs dfsadmin -rollEdits" which requests that the active NameNode roll its edit log. This can be useful for administrators manually backing up log segments.
+**WARNING: No release note provided for this change.**
---
-* [HDFS-2727](https://issues.apache.org/jira/browse/HDFS-2727) | *Minor* | **libhdfs should get the default block size from the server**
+* [HDFS-2617](https://issues.apache.org/jira/browse/HDFS-2617) | *Major* | **Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution**
-libhdfs now uses the server block size configuration rather than the deprecated dfs.block.size client configuration.
+Due to the requirement that KSSL use weak encryption types for Kerberos tickets, HTTP authentication to the NameNode will now use SPNEGO by default. This will require users of previous branch-1 releases with security enabled to modify their configurations and create new Kerberos principals in order to use SPNEGO. The old behavior of using KSSL can optionally be enabled by setting the configuration option "hadoop.security.use-weak-http-crypto" to "true".
---
-* [HDFS-2686](https://issues.apache.org/jira/browse/HDFS-2686) | *Major* | **Remove DistributedUpgrade related code**
+* [HADOOP-8551](https://issues.apache.org/jira/browse/HADOOP-8551) | *Major* | **fs -mkdir creates parent directories without the -p option**
-This jira removes functionality that has not been used/applicable since release 0.17. The incompatibility introduced by this change will not affect any HDFS users.
+FsShell's "mkdir" no longer implicitly creates all non-existent parent directories. The command adopts the posix compliant behavior of requiring the "-p" flag to auto-create parent directories.
---
-* [HDFS-2617](https://issues.apache.org/jira/browse/HDFS-2617) | *Major* | **Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution**
+* [HDFS-3697](https://issues.apache.org/jira/browse/HDFS-3697) | *Minor* | **Enable fadvise readahead by default**
-Due to the requirement that KSSL use weak encryption types for Kerberos tickets, HTTP authentication to the NameNode will now use SPNEGO by default. This will require users of previous branch-1 releases with security enabled to modify their configurations and create new Kerberos principals in order to use SPNEGO. The old behavior of using KSSL can optionally be enabled by setting the configuration option "hadoop.security.use-weak-http-crypto" to "true".
+The datanode now performs 4MB readahead by default when reading data from its disks, if the native libraries are present. This has been shown to improve performance in many workloads. The feature may be disabled by setting dfs.datanode.readahead.bytes to "0".
---
-* [MAPREDUCE-4629](https://issues.apache.org/jira/browse/MAPREDUCE-4629) | *Major* | **Remove JobHistory.DEBUG\_MODE**
+* [HDFS-3755](https://issues.apache.org/jira/browse/HDFS-3755) | *Major* | **Creating an already-open-for-write file with overwrite=true fails**
-**WARNING: No release note provided for this incompatible change.**
+This is an incompatible change: Before this change, if a file is already open for write by one client, and another client calls fs.create() with overwrite=true, an AlreadyBeingCreatedException is thrown. After this change, the file will be deleted and the new file will be created successfully.
---
-* [MAPREDUCE-4311](https://issues.apache.org/jira/browse/MAPREDUCE-4311) | *Major* | **Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings**
+* [HADOOP-8703](https://issues.apache.org/jira/browse/HADOOP-8703) | *Major* | **distcpV2: turn CRC checking off for 0 byte size**
-**WARNING: No release note provided for this incompatible change.**
+distcp skips CRC on 0 byte files.
---
-* [MAPREDUCE-4072](https://issues.apache.org/jira/browse/MAPREDUCE-4072) | *Major* | **User set java.library.path seems to overwrite default creating problems native lib loading**
+* [HADOOP-8689](https://issues.apache.org/jira/browse/HADOOP-8689) | *Major* | **Make trash a server side configuration option**
--Djava.library.path in mapred.child.java.opts can cause issues with native libraries. LD\_LIBRARY\_PATH through mapred.child.env should be used instead.
+If fs.trash.interval is configured on the server then the client's value for this configuration is ignored.
---
-* [MAPREDUCE-4017](https://issues.apache.org/jira/browse/MAPREDUCE-4017) | *Trivial* | **Add jobname to jobsummary log**
+* [HADOOP-8710](https://issues.apache.org/jira/browse/HADOOP-8710) | *Major* | **Remove ability for users to easily run the trash emptier**
-The Job Summary log may contain commas in values that are escaped by a '\' character. This was true before, but is more likely to be exposed now.
+The trash emptier may no longer be run using "hadoop org.apache.hadoop.fs.Trash". The trash emptier runs on the NameNode (if configured). Old trash checkpoints may be deleted using "hadoop fs -expunge".
---
-* [MAPREDUCE-3940](https://issues.apache.org/jira/browse/MAPREDUCE-3940) | *Major* | **ContainerTokens should have an expiry interval**
+* [HDFS-2727](https://issues.apache.org/jira/browse/HDFS-2727) | *Minor* | **libhdfs should get the default block size from the server**
-ContainerTokens now have an expiry interval so that stale tokens cannot be used for launching containers.
+libhdfs now uses the server block size configuration rather than the deprecated dfs.block.size client configuration.
---
-* [MAPREDUCE-3873](https://issues.apache.org/jira/browse/MAPREDUCE-3873) | *Minor* | **Nodemanager is not getting decommisioned if the absolute ip is given in exclude file.**
+* [HDFS-2686](https://issues.apache.org/jira/browse/HDFS-2686) | *Major* | **Remove DistributedUpgrade related code**
-Fixed NodeManagers' decommissioning at RM to accept IP addresses also.
+This jira removes functionality that has not been used/applicable since release 0.17. The incompatibility introduced by this change will not affect any HDFS users.
---
-* [MAPREDUCE-3812](https://issues.apache.org/jira/browse/MAPREDUCE-3812) | *Major* | **Lower default allocation sizes, fix allocation configurations and document them**
-
-Removes two sets of previously available config properties:
-
-1. ( yarn.scheduler.fifo.minimum-allocation-mb and yarn.scheduler.fifo.maximum-allocation-mb ) and,
-2. ( yarn.scheduler.capacity.minimum-allocation-mb and yarn.scheduler.capacity.maximum-allocation-mb )
-
-In favor of two new, generically named properties:
-
-1. yarn.scheduler.minimum-allocation-mb - This acts as the floor value of memory resource requests for containers.
-2. yarn.scheduler.maximum-allocation-mb - This acts as the ceiling value of memory resource requests for containers.
-
-Both these properties need to be set at the ResourceManager (RM) to take effect, as the RM is where the scheduler resides.
+* [HDFS-2793](https://issues.apache.org/jira/browse/HDFS-2793) | *Major* | **Add an admin command to trigger an edit log roll**
-Also changes the default minimum and maximums to 128 MB and 10 GB respectively.
+Introduced a new command, "hdfs dfsadmin -rollEdits" which requests that the active NameNode roll its edit log. This can be useful for administrators manually backing up log segments.
---
-* [MAPREDUCE-3543](https://issues.apache.org/jira/browse/MAPREDUCE-3543) | *Critical* | **Mavenize Gridmix.**
-
-Note that to apply this you should first run the script - ./MAPREDUCE-3543v3.sh svn, then apply the patch.
+* [MAPREDUCE-4629](https://issues.apache.org/jira/browse/MAPREDUCE-4629) | *Major* | **Remove JobHistory.DEBUG\_MODE**
-If this is merged to more then trunk, the version inside of hadoop-tools/hadoop-gridmix/pom.xml will need to be udpated accordingly.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-3348](https://issues.apache.org/jira/browse/MAPREDUCE-3348) | *Major* | **mapred job -status fails to give info even if the job is present in History**
+* [HADOOP-8794](https://issues.apache.org/jira/browse/HADOOP-8794) | *Major* | **Modifiy bin/hadoop to point to HADOOP\_YARN\_HOME**
-Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app.
+**WARNING: No release note provided for this change.**
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[09/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.0-beta/RELEASENOTES.2.1.0-beta.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.0-beta/RELEASENOTES.2.1.0-beta.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.0-beta/RELEASENOTES.2.1.0-beta.md
index 639afd9..5a17ea6 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.0-beta/RELEASENOTES.2.1.0-beta.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.0-beta/RELEASENOTES.2.1.0-beta.md
@@ -23,735 +23,735 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-9832](https://issues.apache.org/jira/browse/HADOOP-9832) | *Blocker* | **Add RPC header to client ping**
+* [MAPREDUCE-3787](https://issues.apache.org/jira/browse/MAPREDUCE-3787) | *Major* | **[Gridmix] Improve STRESS mode**
-Client ping will be sent as a RPC header with a reserved callId instead of as a sentinel RPC packet length.
+JobMonitor can now deploy multiple threads for faster job-status polling. Use 'gridmix.job-monitor.thread-count' to set the number of threads. Stress mode now relies on the updates from the job monitor instead of polling for job status. Failures in job submission now get reported to the statistics module and ultimately reported to the user via summary.
---
-* [HADOOP-9820](https://issues.apache.org/jira/browse/HADOOP-9820) | *Blocker* | **RPCv9 wire protocol is insufficient to support multiplexing**
+* [MAPREDUCE-2722](https://issues.apache.org/jira/browse/MAPREDUCE-2722) | *Major* | **Gridmix simulated job's map's hdfsBytesRead counter is wrong when compressed input is used**
-**WARNING: No release note provided for this incompatible change.**
+Makes Gridmix use the uncompressed input data size while simulating map tasks in the case where compressed input data was used in original job.
---
-* [HADOOP-9698](https://issues.apache.org/jira/browse/HADOOP-9698) | *Blocker* | **RPCv9 client must honor server's SASL negotiate response**
+* [MAPREDUCE-3829](https://issues.apache.org/jira/browse/MAPREDUCE-3829) | *Major* | **[Gridmix] Gridmix should give better error message when input-data directory already exists and -generate option is given**
-The RPC client now waits for the Server's SASL negotiate response before instantiating its SASL client.
+Makes Gridmix emit out correct error message when the input data directory already exists and -generate option is used. Makes Gridmix exit with proper exit codes when Gridmix fails in args-processing, startup/setup.
---
-* [HADOOP-9683](https://issues.apache.org/jira/browse/HADOOP-9683) | *Blocker* | **Wrap IpcConnectionContext in RPC headers**
+* [MAPREDUCE-3953](https://issues.apache.org/jira/browse/MAPREDUCE-3953) | *Major* | **Gridmix throws NPE and does not simulate a job if the trace contains null taskStatus for a task**
-Connection context is now sent as a rpc header wrapped protobuf.
+Fixes NPE and makes Gridmix simulate succeeded-jobs-with-failed-tasks. All tasks of such simulated jobs(including the failed ones of original job) will succeed.
---
-* [HADOOP-9649](https://issues.apache.org/jira/browse/HADOOP-9649) | *Blocker* | **Promote YARN service life-cycle libraries into Hadoop Common**
+* [MAPREDUCE-3757](https://issues.apache.org/jira/browse/MAPREDUCE-3757) | *Major* | **Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts**
-**WARNING: No release note provided for this incompatible change.**
+Fixed the sortFinishTime and shuffleFinishTime adjustments in Rumen Folder.
---
-* [HADOOP-9630](https://issues.apache.org/jira/browse/HADOOP-9630) | *Major* | **Remove IpcSerializationType**
+* [MAPREDUCE-4083](https://issues.apache.org/jira/browse/MAPREDUCE-4083) | *Major* | **GridMix emulated job tasks.resource-usage emulator for CPU usage throws NPE when Trace contains cumulativeCpuUsage value of 0 at attempt level**
-**WARNING: No release note provided for this incompatible change.**
+Fixes NPE in cpu emulation in Gridmix
---
-* [HADOOP-9425](https://issues.apache.org/jira/browse/HADOOP-9425) | *Major* | **Add error codes to rpc-response**
+* [MAPREDUCE-4149](https://issues.apache.org/jira/browse/MAPREDUCE-4149) | *Major* | **Rumen fails to parse certain counter strings**
-**WARNING: No release note provided for this incompatible change.**
+Fixes Rumen to parse counter strings containing the special characters "{" and "}".
---
-* [HADOOP-9421](https://issues.apache.org/jira/browse/HADOOP-9421) | *Blocker* | **Convert SASL to use ProtoBuf and provide negotiation capabilities**
+* [MAPREDUCE-4100](https://issues.apache.org/jira/browse/MAPREDUCE-4100) | *Minor* | **Sometimes gridmix emulates data larger much larger then acutal counter for map only jobs**
-Raw SASL protocol now uses protobufs wrapped with RPC headers.
-The negotiation sequence incorporates the state of the exchange.
-The server now has the ability to advertise its supported auth types.
+Bug fixed in compression emulation feature for map only jobs.
---
-* [HADOOP-9380](https://issues.apache.org/jira/browse/HADOOP-9380) | *Major* | **Add totalLength to rpc response**
+* [MAPREDUCE-4356](https://issues.apache.org/jira/browse/MAPREDUCE-4356) | *Major* | **Provide access to ParsedTask.obtainTaskAttempts()**
-**WARNING: No release note provided for this incompatible change.**
+Made the method ParsedTask.obtainTaskAttempts() public.
---
-* [HADOOP-9228](https://issues.apache.org/jira/browse/HADOOP-9228) | *Minor* | **FileSystemContractTestBase never verifies that files are files**
+* [HADOOP-8886](https://issues.apache.org/jira/browse/HADOOP-8886) | *Major* | **Remove KFS support**
-fixed in HADOOP-9258
+Kosmos FS (KFS) is no longer maintained and Hadoop support has been removed. KFS has been replaced by QFS (HADOOP-8885).
---
-* [HADOOP-9227](https://issues.apache.org/jira/browse/HADOOP-9227) | *Trivial* | **FileSystemContractBaseTest doesn't test filesystem's mkdir/isDirectory() logic rigorously enough**
+* [HDFS-4053](https://issues.apache.org/jira/browse/HDFS-4053) | *Major* | **Increase the default block size**
-fixed in HADOOP-9258
+The default blocks size prior to this change was 64MB. This jira changes the default block size to 128MB. To go back to previous behavior, please configure the in hdfs-site.xml, the configuration parameter "dfs.blocksize" to 67108864.
---
-* [HADOOP-9194](https://issues.apache.org/jira/browse/HADOOP-9194) | *Major* | **RPC Support for QoS**
+* [HADOOP-9163](https://issues.apache.org/jira/browse/HADOOP-9163) | *Major* | **The rpc msg in ProtobufRpcEngine.proto should be moved out to avoid an extra copy**
-Part of the RPC version 9 change. A service class byte is added after the version byte.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-9163](https://issues.apache.org/jira/browse/HADOOP-9163) | *Major* | **The rpc msg in ProtobufRpcEngine.proto should be moved out to avoid an extra copy**
+* [HDFS-4519](https://issues.apache.org/jira/browse/HDFS-4519) | *Major* | **Support override of jsvc binary and log file locations when launching secure datanode.**
+
+With this improvement the following options are available in release 1.2.0 and later on 1.x release stream:
+1. jsvc location can be overridden by setting environment variable JSVC\_HOME. Defaults to jsvc binary packaged within the Hadoop distro.
+2. jsvc log output is directed to the file defined by JSVC\_OUTFILE. Defaults to $HADOOP\_LOG\_DIR/jsvc.out.
+3. jsvc error output is directed to the file defined by JSVC\_ERRFILE file. Defaults to $HADOOP\_LOG\_DIR/jsvc.err.
+
+With this improvement the following options are available in release 2.0.4 and later on 2.x release stream:
+1. jsvc log output is directed to the file defined by JSVC\_OUTFILE. Defaults to $HADOOP\_LOG\_DIR/jsvc.out.
+2. jsvc error output is directed to the file defined by JSVC\_ERRFILE file. Defaults to $HADOOP\_LOG\_DIR/jsvc.err.
-**WARNING: No release note provided for this incompatible change.**
+For overriding jsvc location on 2.x releases, here is the release notes from HDFS-2303:
+To run secure Datanodes users must install jsvc for their platform and set JSVC\_HOME to point to the location of jsvc in their environment.
---
* [HADOOP-9151](https://issues.apache.org/jira/browse/HADOOP-9151) | *Major* | **Include RPC error info in RpcResponseHeader instead of sending it separately**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-8886](https://issues.apache.org/jira/browse/HADOOP-8886) | *Major* | **Remove KFS support**
+* [YARN-396](https://issues.apache.org/jira/browse/YARN-396) | *Major* | **Rationalize AllocateResponse in RM scheduler API**
-Kosmos FS (KFS) is no longer maintained and Hadoop support has been removed. KFS has been replaced by QFS (HADOOP-8885).
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-8562](https://issues.apache.org/jira/browse/HADOOP-8562) | *Major* | **Enhancements to support Hadoop on Windows Server and Windows Azure environments**
+* [HADOOP-9380](https://issues.apache.org/jira/browse/HADOOP-9380) | *Major* | **Add totalLength to rpc response**
-This umbrella jira makes enhancements to support Hadoop natively on Windows Server and Windows Azure environments.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-8470](https://issues.apache.org/jira/browse/HADOOP-8470) | *Major* | **Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWithNodeGroup)**
+* [HADOOP-9228](https://issues.apache.org/jira/browse/HADOOP-9228) | *Minor* | **FileSystemContractTestBase never verifies that files are files**
-This patch should be checked in together (or after) with JIRA Hadoop-8469: https://issues.apache.org/jira/browse/HADOOP-8469
+fixed in HADOOP-9258
---
-* [HDFS-5083](https://issues.apache.org/jira/browse/HDFS-5083) | *Blocker* | **Update the HDFS compatibility version range**
+* [HADOOP-9227](https://issues.apache.org/jira/browse/HADOOP-9227) | *Trivial* | **FileSystemContractBaseTest doesn't test filesystem's mkdir/isDirectory() logic rigorously enough**
-**WARNING: No release note provided for this incompatible change.**
+fixed in HADOOP-9258
---
-* [HDFS-4996](https://issues.apache.org/jira/browse/HDFS-4996) | *Minor* | **ClientProtocol#metaSave can be made idempotent by overwriting the output file instead of appending to it**
+* [YARN-439](https://issues.apache.org/jira/browse/YARN-439) | *Major* | **Flatten NodeHeartbeatResponse**
-The dfsadmin -metasave command has been changed to overwrite the output file. Previously, this command would append to the output file if it already existed.
+**WARNING: No release note provided for this change.**
---
-* [HDFS-4866](https://issues.apache.org/jira/browse/HDFS-4866) | *Blocker* | **Protocol buffer support cannot compile under C**
+* [YARN-440](https://issues.apache.org/jira/browse/YARN-440) | *Major* | **Flatten RegisterNodeManagerResponse**
-The Protocol Buffers definition of the inter-namenode protocol required a change for compatibility with compiled C clients. This is a backwards-incompatible change. A namenode prior to this change will not be able to communicate with a namenode after this change.
+**WARNING: No release note provided for this change.**
---
-* [HDFS-4832](https://issues.apache.org/jira/browse/HDFS-4832) | *Critical* | **Namenode doesn't change the number of missing blocks in safemode when DNs rejoin or leave**
+* [HADOOP-9194](https://issues.apache.org/jira/browse/HADOOP-9194) | *Major* | **RPC Support for QoS**
-This change makes name node keep its internal replication queues and data node state updated in manual safe mode. This allows metrics and UI to present up-to-date information while in safe mode. The behavior during start-up safe mode is unchanged.
+Part of the RPC version 9 change. A service class byte is added after the version byte.
---
-* [HDFS-4659](https://issues.apache.org/jira/browse/HDFS-4659) | *Major* | **Support setting execution bit for regular files**
+* [YARN-536](https://issues.apache.org/jira/browse/YARN-536) | *Major* | **Remove ContainerStatus, ContainerState from Container api interface as they will not be called by the container object**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [HDFS-4519](https://issues.apache.org/jira/browse/HDFS-4519) | *Major* | **Support override of jsvc binary and log file locations when launching secure datanode.**
-
-With this improvement the following options are available in release 1.2.0 and later on 1.x release stream:
-1. jsvc location can be overridden by setting environment variable JSVC\_HOME. Defaults to jsvc binary packaged within the Hadoop distro.
-2. jsvc log output is directed to the file defined by JSVC\_OUTFILE. Defaults to $HADOOP\_LOG\_DIR/jsvc.out.
-3. jsvc error output is directed to the file defined by JSVC\_ERRFILE file. Defaults to $HADOOP\_LOG\_DIR/jsvc.err.
-
-With this improvement the following options are available in release 2.0.4 and later on 2.x release stream:
-1. jsvc log output is directed to the file defined by JSVC\_OUTFILE. Defaults to $HADOOP\_LOG\_DIR/jsvc.out.
-2. jsvc error output is directed to the file defined by JSVC\_ERRFILE file. Defaults to $HADOOP\_LOG\_DIR/jsvc.err.
+* [HDFS-1804](https://issues.apache.org/jira/browse/HDFS-1804) | *Minor* | **Add a new block-volume device choosing policy that looks at free space**
-For overriding jsvc location on 2.x releases, here is the release notes from HDFS-2303:
-To run secure Datanodes users must install jsvc for their platform and set JSVC\_HOME to point to the location of jsvc in their environment.
+There is now a new option to have the DN take into account available disk space on each volume when choosing where to place a replica when performing an HDFS write. This can be enabled by setting the config "dfs.datanode.fsdataset.volume.choosing.policy" to the value "org.apache.hadoop.hdfs.server.datanode.fsdataset.AvailableSpaceVolumeChoosingPolicy".
---
-* [HDFS-4434](https://issues.apache.org/jira/browse/HDFS-4434) | *Major* | **Provide a mapping from INodeId to INode**
+* [YARN-561](https://issues.apache.org/jira/browse/YARN-561) | *Major* | **Nodemanager should set some key information into the environment of every container that it launches.**
-This change adds support for referencing files and directories based on fileID/inodeID using a path /.reserved/.inodes/\<inodeid\>. With this change creating a file or directory /.reserved is not longer allowed. Before upgrading to a release with this change, files /.reserved needs to be renamed to another name.
+**WARNING: No release note provided for this change.**
---
-* [HDFS-4305](https://issues.apache.org/jira/browse/HDFS-4305) | *Minor* | **Add a configurable limit on number of blocks per file, and min block size**
+* [MAPREDUCE-4737](https://issues.apache.org/jira/browse/MAPREDUCE-4737) | *Major* | ** Hadoop does not close output file / does not call Mapper.cleanup if exception in map**
-This change introduces a maximum number of blocks per file, by default one million, and a minimum block size, by default 1MB. These can optionally be changed via the configuration settings "dfs.namenode.fs-limits.max-blocks-per-file" and "dfs.namenode.fs-limits.min-block-size", respectively.
+Ensure that mapreduce APIs are semantically consistent with mapred API w.r.t Mapper.cleanup and Reducer.cleanup; in the sense that cleanup is now called even if there is an error. The old mapred API already ensures that Mapper.close and Reducer.close are invoked during error handling. Note that it is an incompatible change, however end-users can override Mapper.run and Reducer.run to get the old (inconsistent) behaviour.
---
-* [HDFS-4053](https://issues.apache.org/jira/browse/HDFS-4053) | *Major* | **Increase the default block size**
+* [HDFS-4305](https://issues.apache.org/jira/browse/HDFS-4305) | *Minor* | **Add a configurable limit on number of blocks per file, and min block size**
-The default blocks size prior to this change was 64MB. This jira changes the default block size to 128MB. To go back to previous behavior, please configure the in hdfs-site.xml, the configuration parameter "dfs.blocksize" to 67108864.
+This change introduces a maximum number of blocks per file, by default one million, and a minimum block size, by default 1MB. These can optionally be changed via the configuration settings "dfs.namenode.fs-limits.max-blocks-per-file" and "dfs.namenode.fs-limits.min-block-size", respectively.
---
-* [HDFS-2802](https://issues.apache.org/jira/browse/HDFS-2802) | *Major* | **Support for RW/RO snapshots in HDFS**
+* [YARN-579](https://issues.apache.org/jira/browse/YARN-579) | *Major* | **Make ApplicationToken part of Container's token list to help RM-restart**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [HDFS-1804](https://issues.apache.org/jira/browse/HDFS-1804) | *Minor* | **Add a new block-volume device choosing policy that looks at free space**
+* [HDFS-4659](https://issues.apache.org/jira/browse/HDFS-4659) | *Major* | **Support setting execution bit for regular files**
-There is now a new option to have the DN take into account available disk space on each volume when choosing where to place a replica when performing an HDFS write. This can be enabled by setting the config "dfs.datanode.fsdataset.volume.choosing.policy" to the value "org.apache.hadoop.hdfs.server.datanode.fsdataset.AvailableSpaceVolumeChoosingPolicy".
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-5399](https://issues.apache.org/jira/browse/MAPREDUCE-5399) | *Blocker* | **Unnecessary Configuration instantiation in IFileInputStream slows down merge**
+* [HDFS-4434](https://issues.apache.org/jira/browse/HDFS-4434) | *Major* | **Provide a mapping from INodeId to INode**
-Fixes blank Configuration object creation overhead by reusing the Job configuration in InMemoryReader.
+This change adds support for referencing files and directories based on fileID/inodeID using a path /.reserved/.inodes/\<inodeid\>. With this change creating a file or directory /.reserved is not longer allowed. Before upgrading to a release with this change, files /.reserved needs to be renamed to another name.
---
-* [MAPREDUCE-5304](https://issues.apache.org/jira/browse/MAPREDUCE-5304) | *Blocker* | **mapreduce.Job killTask/failTask/getTaskCompletionEvents methods have incompatible signature changes**
+* [HADOOP-9425](https://issues.apache.org/jira/browse/HADOOP-9425) | *Major* | **Add error codes to rpc-response**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-5300](https://issues.apache.org/jira/browse/MAPREDUCE-5300) | *Major* | **Two function signature changes in filecache.DistributedCache**
+* [YARN-629](https://issues.apache.org/jira/browse/YARN-629) | *Major* | **Make YarnRemoteException not be rooted at IOException**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-5237](https://issues.apache.org/jira/browse/MAPREDUCE-5237) | *Major* | **ClusterStatus incompatiblity issues with MR1**
+* [YARN-633](https://issues.apache.org/jira/browse/YARN-633) | *Major* | **Change RMAdminProtocol api to throw IOException and YarnRemoteException**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-5234](https://issues.apache.org/jira/browse/MAPREDUCE-5234) | *Major* | **Signature changes for getTaskId of TaskReport in mapred**
+* [YARN-632](https://issues.apache.org/jira/browse/YARN-632) | *Major* | **Change ContainerManager api to throw IOException and YarnRemoteException**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-5233](https://issues.apache.org/jira/browse/MAPREDUCE-5233) | *Major* | **Functions are changed or removed from Job in jobcontrol**
+* [YARN-631](https://issues.apache.org/jira/browse/YARN-631) | *Major* | **Change ClientRMProtocol api to throw IOException and YarnRemoteException**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-5184](https://issues.apache.org/jira/browse/MAPREDUCE-5184) | *Major* | **Document MR Binary Compatibility vis-a-vis hadoop-1 and hadoop-2**
+* [YARN-630](https://issues.apache.org/jira/browse/YARN-630) | *Major* | **Change AMRMProtocol api to throw IOException and YarnRemoteException**
-Document MR Binary Compatibility vis-a-vis hadoop-1 and hadoop-2 for end-users.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-5176](https://issues.apache.org/jira/browse/MAPREDUCE-5176) | *Major* | **Preemptable annotations (to support preemption in MR)**
+* [MAPREDUCE-4067](https://issues.apache.org/jira/browse/MAPREDUCE-4067) | *Critical* | **Replace YarnRemoteException with IOException in MRv2 APIs**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-5156](https://issues.apache.org/jira/browse/MAPREDUCE-5156) | *Blocker* | **Hadoop-examples-1.x.x.jar cannot run on Yarn**
+* [YARN-615](https://issues.apache.org/jira/browse/YARN-615) | *Major* | **ContainerLaunchContext.containerTokens should simply be called tokens**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-4942](https://issues.apache.org/jira/browse/MAPREDUCE-4942) | *Major* | **mapreduce.Job has a bunch of methods that throw InterruptedException so its incompatible with MR1**
+* [MAPREDUCE-5234](https://issues.apache.org/jira/browse/MAPREDUCE-5234) | *Major* | **Signature changes for getTaskId of TaskReport in mapred**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-4737](https://issues.apache.org/jira/browse/MAPREDUCE-4737) | *Major* | ** Hadoop does not close output file / does not call Mapper.cleanup if exception in map**
+* [MAPREDUCE-5156](https://issues.apache.org/jira/browse/MAPREDUCE-5156) | *Blocker* | **Hadoop-examples-1.x.x.jar cannot run on Yarn**
-Ensure that mapreduce APIs are semantically consistent with mapred API w.r.t Mapper.cleanup and Reducer.cleanup; in the sense that cleanup is now called even if there is an error. The old mapred API already ensures that Mapper.close and Reducer.close are invoked during error handling. Note that it is an incompatible change, however end-users can override Mapper.run and Reducer.run to get the old (inconsistent) behaviour.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-4356](https://issues.apache.org/jira/browse/MAPREDUCE-4356) | *Major* | **Provide access to ParsedTask.obtainTaskAttempts()**
+* [MAPREDUCE-5233](https://issues.apache.org/jira/browse/MAPREDUCE-5233) | *Major* | **Functions are changed or removed from Job in jobcontrol**
-Made the method ParsedTask.obtainTaskAttempts() public.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-4149](https://issues.apache.org/jira/browse/MAPREDUCE-4149) | *Major* | **Rumen fails to parse certain counter strings**
+* [HADOOP-8562](https://issues.apache.org/jira/browse/HADOOP-8562) | *Major* | **Enhancements to support Hadoop on Windows Server and Windows Azure environments**
-Fixes Rumen to parse counter strings containing the special characters "{" and "}".
+This umbrella jira makes enhancements to support Hadoop natively on Windows Server and Windows Azure environments.
---
-* [MAPREDUCE-4100](https://issues.apache.org/jira/browse/MAPREDUCE-4100) | *Minor* | **Sometimes gridmix emulates data larger much larger then acutal counter for map only jobs**
+* [YARN-571](https://issues.apache.org/jira/browse/YARN-571) | *Major* | **User should not be part of ContainerLaunchContext**
-Bug fixed in compression emulation feature for map only jobs.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-4083](https://issues.apache.org/jira/browse/MAPREDUCE-4083) | *Major* | **GridMix emulated job tasks.resource-usage emulator for CPU usage throws NPE when Trace contains cumulativeCpuUsage value of 0 at attempt level**
+* [MAPREDUCE-5237](https://issues.apache.org/jira/browse/MAPREDUCE-5237) | *Major* | **ClusterStatus incompatiblity issues with MR1**
-Fixes NPE in cpu emulation in Gridmix
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-4067](https://issues.apache.org/jira/browse/MAPREDUCE-4067) | *Critical* | **Replace YarnRemoteException with IOException in MRv2 APIs**
+* [YARN-716](https://issues.apache.org/jira/browse/YARN-716) | *Major* | **Make ApplicationID immutable**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-3953](https://issues.apache.org/jira/browse/MAPREDUCE-3953) | *Major* | **Gridmix throws NPE and does not simulate a job if the trace contains null taskStatus for a task**
+* [YARN-684](https://issues.apache.org/jira/browse/YARN-684) | *Major* | **ContainerManager.startContainer needs to only have ContainerTokenIdentifier instead of the whole Container**
-Fixes NPE and makes Gridmix simulate succeeded-jobs-with-failed-tasks. All tasks of such simulated jobs(including the failed ones of original job) will succeed.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-3829](https://issues.apache.org/jira/browse/MAPREDUCE-3829) | *Major* | **[Gridmix] Gridmix should give better error message when input-data directory already exists and -generate option is given**
+* [MAPREDUCE-5176](https://issues.apache.org/jira/browse/MAPREDUCE-5176) | *Major* | **Preemptable annotations (to support preemption in MR)**
-Makes Gridmix emit out correct error message when the input data directory already exists and -generate option is used. Makes Gridmix exit with proper exit codes when Gridmix fails in args-processing, startup/setup.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-3787](https://issues.apache.org/jira/browse/MAPREDUCE-3787) | *Major* | **[Gridmix] Improve STRESS mode**
+* [YARN-735](https://issues.apache.org/jira/browse/YARN-735) | *Major* | **Make ApplicationAttemptID, ContainerID, NodeID immutable**
-JobMonitor can now deploy multiple threads for faster job-status polling. Use 'gridmix.job-monitor.thread-count' to set the number of threads. Stress mode now relies on the updates from the job monitor instead of polling for job status. Failures in job submission now get reported to the statistics module and ultimately reported to the user via summary.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-3757](https://issues.apache.org/jira/browse/MAPREDUCE-3757) | *Major* | **Rumen Folder is not adjusting the shuffleFinished and sortFinished times of reduce task attempts**
+* [YARN-749](https://issues.apache.org/jira/browse/YARN-749) | *Major* | **Rename ResourceRequest (get,set)HostName to (get,set)ResourceName**
-Fixed the sortFinishTime and shuffleFinishTime adjustments in Rumen Folder.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-2722](https://issues.apache.org/jira/browse/MAPREDUCE-2722) | *Major* | **Gridmix simulated job's map's hdfsBytesRead counter is wrong when compressed input is used**
+* [YARN-720](https://issues.apache.org/jira/browse/YARN-720) | *Major* | **container-log4j.properties should not refer to mapreduce properties**
-Makes Gridmix use the uncompressed input data size while simulating map tasks in the case where compressed input data was used in original job.
+**WARNING: No release note provided for this change.**
---
-* [YARN-1056](https://issues.apache.org/jira/browse/YARN-1056) | *Trivial* | **Fix configs yarn.resourcemanager.resourcemanager.connect.{max.wait.secs\|retry\_interval.secs}**
+* [HADOOP-8470](https://issues.apache.org/jira/browse/HADOOP-8470) | *Major* | **Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWithNodeGroup)**
-**WARNING: No release note provided for this incompatible change.**
+This patch should be checked in together (or after) with JIRA Hadoop-8469: https://issues.apache.org/jira/browse/HADOOP-8469
---
-* [YARN-926](https://issues.apache.org/jira/browse/YARN-926) | *Blocker* | **ContainerManagerProtcol APIs should take in requests for multiple containers**
+* [MAPREDUCE-5300](https://issues.apache.org/jira/browse/MAPREDUCE-5300) | *Major* | **Two function signature changes in filecache.DistributedCache**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-918](https://issues.apache.org/jira/browse/YARN-918) | *Blocker* | **ApplicationMasterProtocol doesn't need ApplicationAttemptId in the payload after YARN-701**
+* [YARN-748](https://issues.apache.org/jira/browse/YARN-748) | *Major* | **Move BuilderUtils from yarn-common to yarn-server-common**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-869](https://issues.apache.org/jira/browse/YARN-869) | *Blocker* | **ResourceManagerAdministrationProtocol should neither be public(yet) nor in yarn.api**
+* [YARN-635](https://issues.apache.org/jira/browse/YARN-635) | *Major* | **Rename YarnRemoteException to YarnException**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-851](https://issues.apache.org/jira/browse/YARN-851) | *Major* | **Share NMTokens using NMTokenCache (api-based) instead of memory based approach which is used currently.**
+* [YARN-755](https://issues.apache.org/jira/browse/YARN-755) | *Major* | **Rename AllocateResponse.reboot to AllocateResponse.resync**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-841](https://issues.apache.org/jira/browse/YARN-841) | *Major* | **Annotate and document AuxService APIs**
+* [YARN-756](https://issues.apache.org/jira/browse/YARN-756) | *Major* | **Move PreemptionContainer/PremptionContract/PreemptionMessage/StrictPreemptionContract/PreemptionResourceRequest to api.records**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-840](https://issues.apache.org/jira/browse/YARN-840) | *Major* | **Move ProtoUtils to yarn.api.records.pb.impl**
+* [YARN-753](https://issues.apache.org/jira/browse/YARN-753) | *Major* | **Add individual factory method for api protocol records**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-837](https://issues.apache.org/jira/browse/YARN-837) | *Major* | **ClusterInfo.java doesn't seem to belong to org.apache.hadoop.yarn**
+* [YARN-724](https://issues.apache.org/jira/browse/YARN-724) | *Major* | **Move ProtoBase from api.records to api.records.impl.pb**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-834](https://issues.apache.org/jira/browse/YARN-834) | *Blocker* | **Review/fix annotations for yarn-client module and clearly differentiate \*Async apis**
+* [HDFS-4832](https://issues.apache.org/jira/browse/HDFS-4832) | *Critical* | **Namenode doesn't change the number of missing blocks in safemode when DNs rejoin or leave**
-**WARNING: No release note provided for this incompatible change.**
+This change makes name node keep its internal replication queues and data node state updated in manual safe mode. This allows metrics and UI to present up-to-date information while in safe mode. The behavior during start-up safe mode is unchanged.
---
-* [YARN-831](https://issues.apache.org/jira/browse/YARN-831) | *Blocker* | **Remove resource min from GetNewApplicationResponse**
+* [YARN-777](https://issues.apache.org/jira/browse/YARN-777) | *Major* | **Remove unreferenced objects from proto**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-829](https://issues.apache.org/jira/browse/YARN-829) | *Major* | **Rename RMTokenSelector to be RMDelegationTokenSelector**
+* [YARN-642](https://issues.apache.org/jira/browse/YARN-642) | *Major* | **Fix up /nodes REST API to have 1 param and be consistent with the Java API**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-828](https://issues.apache.org/jira/browse/YARN-828) | *Major* | **Remove YarnVersionAnnotation**
+* [HADOOP-9630](https://issues.apache.org/jira/browse/HADOOP-9630) | *Major* | **Remove IpcSerializationType**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-826](https://issues.apache.org/jira/browse/YARN-826) | *Major* | **Move Clock/SystemClock to util package**
+* [MAPREDUCE-5304](https://issues.apache.org/jira/browse/MAPREDUCE-5304) | *Blocker* | **mapreduce.Job killTask/failTask/getTaskCompletionEvents methods have incompatible signature changes**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-824](https://issues.apache.org/jira/browse/YARN-824) | *Major* | **Add static factory to yarn client lib interface and change it to abstract class**
+* [YARN-530](https://issues.apache.org/jira/browse/YARN-530) | *Major* | **Define Service model strictly, implement AbstractService for robust subclassing, migrate yarn-common services**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-823](https://issues.apache.org/jira/browse/YARN-823) | *Major* | **Move RMAdmin from yarn.client to yarn.client.cli and rename as RMAdminCLI**
+* [YARN-746](https://issues.apache.org/jira/browse/YARN-746) | *Major* | **rename Service.register() and Service.unregister() to registerServiceListener() & unregisterServiceListener() respectively**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-822](https://issues.apache.org/jira/browse/YARN-822) | *Major* | **Rename ApplicationToken to AMRMToken**
+* [YARN-792](https://issues.apache.org/jira/browse/YARN-792) | *Major* | **Move NodeHealthStatus from yarn.api.record to yarn.server.api.record**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-821](https://issues.apache.org/jira/browse/YARN-821) | *Major* | **Rename FinishApplicationMasterRequest.setFinishApplicationStatus to setFinalApplicationStatus to be consistent with getter**
+* [YARN-806](https://issues.apache.org/jira/browse/YARN-806) | *Major* | **Move ContainerExitStatus from yarn.api to yarn.api.records**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-806](https://issues.apache.org/jira/browse/YARN-806) | *Major* | **Move ContainerExitStatus from yarn.api to yarn.api.records**
+* [MAPREDUCE-4942](https://issues.apache.org/jira/browse/MAPREDUCE-4942) | *Major* | **mapreduce.Job has a bunch of methods that throw InterruptedException so its incompatible with MR1**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-792](https://issues.apache.org/jira/browse/YARN-792) | *Major* | **Move NodeHealthStatus from yarn.api.record to yarn.server.api.record**
+* [HDFS-4866](https://issues.apache.org/jira/browse/HDFS-4866) | *Blocker* | **Protocol buffer support cannot compile under C**
-**WARNING: No release note provided for this incompatible change.**
+The Protocol Buffers definition of the inter-namenode protocol required a change for compatibility with compiled C clients. This is a backwards-incompatible change. A namenode prior to this change will not be able to communicate with a namenode after this change.
---
-* [YARN-791](https://issues.apache.org/jira/browse/YARN-791) | *Blocker* | **Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API**
+* [YARN-821](https://issues.apache.org/jira/browse/YARN-821) | *Major* | **Rename FinishApplicationMasterRequest.setFinishApplicationStatus to setFinalApplicationStatus to be consistent with getter**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
* [YARN-787](https://issues.apache.org/jira/browse/YARN-787) | *Blocker* | **Remove resource min from Yarn client API**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-777](https://issues.apache.org/jira/browse/YARN-777) | *Major* | **Remove unreferenced objects from proto**
+* [MAPREDUCE-5184](https://issues.apache.org/jira/browse/MAPREDUCE-5184) | *Major* | **Document MR Binary Compatibility vis-a-vis hadoop-1 and hadoop-2**
-**WARNING: No release note provided for this incompatible change.**
+Document MR Binary Compatibility vis-a-vis hadoop-1 and hadoop-2 for end-users.
---
-* [YARN-756](https://issues.apache.org/jira/browse/YARN-756) | *Major* | **Move PreemptionContainer/PremptionContract/PreemptionMessage/StrictPreemptionContract/PreemptionResourceRequest to api.records**
+* [YARN-829](https://issues.apache.org/jira/browse/YARN-829) | *Major* | **Rename RMTokenSelector to be RMDelegationTokenSelector**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-755](https://issues.apache.org/jira/browse/YARN-755) | *Major* | **Rename AllocateResponse.reboot to AllocateResponse.resync**
+* [YARN-828](https://issues.apache.org/jira/browse/YARN-828) | *Major* | **Remove YarnVersionAnnotation**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-753](https://issues.apache.org/jira/browse/YARN-753) | *Major* | **Add individual factory method for api protocol records**
+* [YARN-823](https://issues.apache.org/jira/browse/YARN-823) | *Major* | **Move RMAdmin from yarn.client to yarn.client.cli and rename as RMAdminCLI**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-749](https://issues.apache.org/jira/browse/YARN-749) | *Major* | **Rename ResourceRequest (get,set)HostName to (get,set)ResourceName**
+* [YARN-387](https://issues.apache.org/jira/browse/YARN-387) | *Blocker* | **Fix inconsistent protocol naming**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-748](https://issues.apache.org/jira/browse/YARN-748) | *Major* | **Move BuilderUtils from yarn-common to yarn-server-common**
+* [YARN-831](https://issues.apache.org/jira/browse/YARN-831) | *Blocker* | **Remove resource min from GetNewApplicationResponse**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-746](https://issues.apache.org/jira/browse/YARN-746) | *Major* | **rename Service.register() and Service.unregister() to registerServiceListener() & unregisterServiceListener() respectively**
+* [YARN-824](https://issues.apache.org/jira/browse/YARN-824) | *Major* | **Add static factory to yarn client lib interface and change it to abstract class**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-735](https://issues.apache.org/jira/browse/YARN-735) | *Major* | **Make ApplicationAttemptID, ContainerID, NodeID immutable**
+* [YARN-826](https://issues.apache.org/jira/browse/YARN-826) | *Major* | **Move Clock/SystemClock to util package**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-724](https://issues.apache.org/jira/browse/YARN-724) | *Major* | **Move ProtoBase from api.records to api.records.impl.pb**
+* [HADOOP-9649](https://issues.apache.org/jira/browse/HADOOP-9649) | *Blocker* | **Promote YARN service life-cycle libraries into Hadoop Common**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-720](https://issues.apache.org/jira/browse/YARN-720) | *Major* | **container-log4j.properties should not refer to mapreduce properties**
+* [YARN-837](https://issues.apache.org/jira/browse/YARN-837) | *Major* | **ClusterInfo.java doesn't seem to belong to org.apache.hadoop.yarn**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-716](https://issues.apache.org/jira/browse/YARN-716) | *Major* | **Make ApplicationID immutable**
+* [YARN-822](https://issues.apache.org/jira/browse/YARN-822) | *Major* | **Rename ApplicationToken to AMRMToken**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-701](https://issues.apache.org/jira/browse/YARN-701) | *Blocker* | **ApplicationTokens should be used irrespective of kerberos**
+* [YARN-610](https://issues.apache.org/jira/browse/YARN-610) | *Blocker* | **ClientToken (ClientToAMToken) should not be set in the environment**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-694](https://issues.apache.org/jira/browse/YARN-694) | *Major* | **Start using NMTokens to authenticate all communication with NM**
+* [YARN-834](https://issues.apache.org/jira/browse/YARN-834) | *Blocker* | **Review/fix annotations for yarn-client module and clearly differentiate \*Async apis**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-684](https://issues.apache.org/jira/browse/YARN-684) | *Major* | **ContainerManager.startContainer needs to only have ContainerTokenIdentifier instead of the whole Container**
+* [YARN-840](https://issues.apache.org/jira/browse/YARN-840) | *Major* | **Move ProtoUtils to yarn.api.records.pb.impl**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-642](https://issues.apache.org/jira/browse/YARN-642) | *Major* | **Fix up /nodes REST API to have 1 param and be consistent with the Java API**
+* [YARN-841](https://issues.apache.org/jira/browse/YARN-841) | *Major* | **Annotate and document AuxService APIs**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-635](https://issues.apache.org/jira/browse/YARN-635) | *Major* | **Rename YarnRemoteException to YarnException**
+* [YARN-694](https://issues.apache.org/jira/browse/YARN-694) | *Major* | **Start using NMTokens to authenticate all communication with NM**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-633](https://issues.apache.org/jira/browse/YARN-633) | *Major* | **Change RMAdminProtocol api to throw IOException and YarnRemoteException**
+* [YARN-553](https://issues.apache.org/jira/browse/YARN-553) | *Minor* | **Have YarnClient generate a directly usable ApplicationSubmissionContext**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-632](https://issues.apache.org/jira/browse/YARN-632) | *Major* | **Change ContainerManager api to throw IOException and YarnRemoteException**
+* [YARN-851](https://issues.apache.org/jira/browse/YARN-851) | *Major* | **Share NMTokens using NMTokenCache (api-based) instead of memory based approach which is used currently.**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-631](https://issues.apache.org/jira/browse/YARN-631) | *Major* | **Change ClientRMProtocol api to throw IOException and YarnRemoteException**
+* [HADOOP-9421](https://issues.apache.org/jira/browse/HADOOP-9421) | *Blocker* | **Convert SASL to use ProtoBuf and provide negotiation capabilities**
-**WARNING: No release note provided for this incompatible change.**
+Raw SASL protocol now uses protobufs wrapped with RPC headers.
+The negotiation sequence incorporates the state of the exchange.
+The server now has the ability to advertise its supported auth types.
---
-* [YARN-630](https://issues.apache.org/jira/browse/YARN-630) | *Major* | **Change AMRMProtocol api to throw IOException and YarnRemoteException**
+* [YARN-869](https://issues.apache.org/jira/browse/YARN-869) | *Blocker* | **ResourceManagerAdministrationProtocol should neither be public(yet) nor in yarn.api**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-629](https://issues.apache.org/jira/browse/YARN-629) | *Major* | **Make YarnRemoteException not be rooted at IOException**
+* [YARN-791](https://issues.apache.org/jira/browse/YARN-791) | *Blocker* | **Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-615](https://issues.apache.org/jira/browse/YARN-615) | *Major* | **ContainerLaunchContext.containerTokens should simply be called tokens**
+* [HADOOP-9683](https://issues.apache.org/jira/browse/HADOOP-9683) | *Blocker* | **Wrap IpcConnectionContext in RPC headers**
-**WARNING: No release note provided for this incompatible change.**
+Connection context is now sent as a rpc header wrapped protobuf.
---
-* [YARN-610](https://issues.apache.org/jira/browse/YARN-610) | *Blocker* | **ClientToken (ClientToAMToken) should not be set in the environment**
+* [YARN-701](https://issues.apache.org/jira/browse/YARN-701) | *Blocker* | **ApplicationTokens should be used irrespective of kerberos**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-579](https://issues.apache.org/jira/browse/YARN-579) | *Major* | **Make ApplicationToken part of Container's token list to help RM-restart**
+* [HDFS-4996](https://issues.apache.org/jira/browse/HDFS-4996) | *Minor* | **ClientProtocol#metaSave can be made idempotent by overwriting the output file instead of appending to it**
-**WARNING: No release note provided for this incompatible change.**
+The dfsadmin -metasave command has been changed to overwrite the output file. Previously, this command would append to the output file if it already existed.
---
-* [YARN-571](https://issues.apache.org/jira/browse/YARN-571) | *Major* | **User should not be part of ContainerLaunchContext**
+* [YARN-918](https://issues.apache.org/jira/browse/YARN-918) | *Blocker* | **ApplicationMasterProtocol doesn't need ApplicationAttemptId in the payload after YARN-701**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-561](https://issues.apache.org/jira/browse/YARN-561) | *Major* | **Nodemanager should set some key information into the environment of every container that it launches.**
+* [YARN-926](https://issues.apache.org/jira/browse/YARN-926) | *Blocker* | **ContainerManagerProtcol APIs should take in requests for multiple containers**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-553](https://issues.apache.org/jira/browse/YARN-553) | *Minor* | **Have YarnClient generate a directly usable ApplicationSubmissionContext**
+* [HADOOP-9698](https://issues.apache.org/jira/browse/HADOOP-9698) | *Blocker* | **RPCv9 client must honor server's SASL negotiate response**
-**WARNING: No release note provided for this incompatible change.**
+The RPC client now waits for the Server's SASL negotiate response before instantiating its SASL client.
---
-* [YARN-536](https://issues.apache.org/jira/browse/YARN-536) | *Major* | **Remove ContainerStatus, ContainerState from Container api interface as they will not be called by the container object**
+* [HADOOP-9832](https://issues.apache.org/jira/browse/HADOOP-9832) | *Blocker* | **Add RPC header to client ping**
-**WARNING: No release note provided for this incompatible change.**
+Client ping will be sent as a RPC header with a reserved callId instead of as a sentinel RPC packet length.
---
-* [YARN-530](https://issues.apache.org/jira/browse/YARN-530) | *Major* | **Define Service model strictly, implement AbstractService for robust subclassing, migrate yarn-common services**
+* [MAPREDUCE-5399](https://issues.apache.org/jira/browse/MAPREDUCE-5399) | *Blocker* | **Unnecessary Configuration instantiation in IFileInputStream slows down merge**
-**WARNING: No release note provided for this incompatible change.**
+Fixes blank Configuration object creation overhead by reusing the Job configuration in InMemoryReader.
---
-* [YARN-440](https://issues.apache.org/jira/browse/YARN-440) | *Major* | **Flatten RegisterNodeManagerResponse**
+* [HADOOP-9820](https://issues.apache.org/jira/browse/HADOOP-9820) | *Blocker* | **RPCv9 wire protocol is insufficient to support multiplexing**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-439](https://issues.apache.org/jira/browse/YARN-439) | *Major* | **Flatten NodeHeartbeatResponse**
+* [HDFS-5083](https://issues.apache.org/jira/browse/HDFS-5083) | *Blocker* | **Update the HDFS compatibility version range**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-396](https://issues.apache.org/jira/browse/YARN-396) | *Major* | **Rationalize AllocateResponse in RM scheduler API**
+* [YARN-1056](https://issues.apache.org/jira/browse/YARN-1056) | *Trivial* | **Fix configs yarn.resourcemanager.resourcemanager.connect.{max.wait.secs\|retry\_interval.secs}**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [YARN-387](https://issues.apache.org/jira/browse/YARN-387) | *Blocker* | **Fix inconsistent protocol naming**
+* [HDFS-2802](https://issues.apache.org/jira/browse/HDFS-2802) | *Major* | **Support for RW/RO snapshots in HDFS**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[49/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.0/CHANGES.0.14.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.0/CHANGES.0.14.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.0/CHANGES.0.14.0.md
index c432600..7470dc8 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.0/CHANGES.0.14.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.0/CHANGES.0.14.0.md
@@ -20,211 +20,195 @@
## Release 0.14.0 - 2007-08-20
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1597](https://issues.apache.org/jira/browse/HADOOP-1597) | Distributed upgrade status reporting and post upgrade features. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1570](https://issues.apache.org/jira/browse/HADOOP-1570) | Add a per-job configuration knob to control loading of native hadoop libraries | Major | io | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1568](https://issues.apache.org/jira/browse/HADOOP-1568) | NameNode Schema for HttpFileSystem | Major | fs | Chris Douglas | Chris Douglas |
-| [HADOOP-1562](https://issues.apache.org/jira/browse/HADOOP-1562) | Report Java VM metrics | Major | metrics | David Bowen | David Bowen |
+| [HADOOP-234](https://issues.apache.org/jira/browse/HADOOP-234) | Hadoop Pipes for writing map/reduce jobs in C++ and python | Major | . | Sanjay Dahiya | Owen O'Malley |
+| [HADOOP-1379](https://issues.apache.org/jira/browse/HADOOP-1379) | Integrate Findbugs into nightly build process | Major | test | Nigel Daley | Nigel Daley |
+| [HADOOP-1447](https://issues.apache.org/jira/browse/HADOOP-1447) | Support for textInputFormat in contrib/data\_join | Minor | . | Senthil Subramanian | Senthil Subramanian |
+| [HADOOP-1469](https://issues.apache.org/jira/browse/HADOOP-1469) | Asynchronous table creation | Minor | . | James Kennedy | stack |
+| [HADOOP-1377](https://issues.apache.org/jira/browse/HADOOP-1377) | Creation time and modification time for hadoop files and directories | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-1515](https://issues.apache.org/jira/browse/HADOOP-1515) | MultiFileSplit, MultiFileInputFormat | Major | . | Enis Soztutar | Enis Soztutar |
| [HADOOP-1508](https://issues.apache.org/jira/browse/HADOOP-1508) | ant Task for FsShell operations | Minor | build, fs | Chris Douglas | Chris Douglas |
-| [HADOOP-1469](https://issues.apache.org/jira/browse/HADOOP-1469) | Asynchronous table creation | Minor | . | James Kennedy | stack |
-| [HADOOP-1447](https://issues.apache.org/jira/browse/HADOOP-1447) | Support for textInputFormat in contrib/data\_join | Minor | . | Senthil Subramanian | Senthil Subramanian |
-| [HADOOP-1437](https://issues.apache.org/jira/browse/HADOOP-1437) | Eclipse plugin for developing and executing MapReduce programs on Hadoop | Major | . | Eugene Hung | Christophe Taton |
+| [HADOOP-1570](https://issues.apache.org/jira/browse/HADOOP-1570) | Add a per-job configuration knob to control loading of native hadoop libraries | Major | io | Arun C Murthy | Arun C Murthy |
| [HADOOP-1433](https://issues.apache.org/jira/browse/HADOOP-1433) | Add job priority | Minor | . | Johan Oskarsson | Johan Oskarsson |
-| [HADOOP-1379](https://issues.apache.org/jira/browse/HADOOP-1379) | Integrate Findbugs into nightly build process | Major | test | Nigel Daley | Nigel Daley |
-| [HADOOP-1377](https://issues.apache.org/jira/browse/HADOOP-1377) | Creation time and modification time for hadoop files and directories | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1597](https://issues.apache.org/jira/browse/HADOOP-1597) | Distributed upgrade status reporting and post upgrade features. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1562](https://issues.apache.org/jira/browse/HADOOP-1562) | Report Java VM metrics | Major | metrics | David Bowen | David Bowen |
| [HADOOP-1134](https://issues.apache.org/jira/browse/HADOOP-1134) | Block level CRCs in HDFS | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-234](https://issues.apache.org/jira/browse/HADOOP-234) | Hadoop Pipes for writing map/reduce jobs in C++ and python | Major | . | Sanjay Dahiya | Owen O'Malley |
+| [HADOOP-1568](https://issues.apache.org/jira/browse/HADOOP-1568) | NameNode Schema for HttpFileSystem | Major | fs | Chris Douglas | Chris Douglas |
+| [HADOOP-1437](https://issues.apache.org/jira/browse/HADOOP-1437) | Eclipse plugin for developing and executing MapReduce programs on Hadoop | Major | . | Eugene Hung | Christophe Taton |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1653](https://issues.apache.org/jira/browse/HADOOP-1653) | FSDirectory class code cleanup | Trivial | . | Christophe Taton | Christophe Taton |
-| [HADOOP-1620](https://issues.apache.org/jira/browse/HADOOP-1620) | FileSystem should have fewer abstract methods | Major | . | Doug Cutting | Doug Cutting |
-| [HADOOP-1585](https://issues.apache.org/jira/browse/HADOOP-1585) | GenericWritable should use generics | Minor | io | Espen Amble Kolstad | Espen Amble Kolstad |
-| [HADOOP-1582](https://issues.apache.org/jira/browse/HADOOP-1582) | hdfsRead and hdfsPread should return 0 instead of -1 at end-of-file. | Minor | . | Christian Kunz | Christian Kunz |
-| [HADOOP-1580](https://issues.apache.org/jira/browse/HADOOP-1580) | provide better error message when subprocesses fail in hadoop streaming | Minor | . | John Heidemann | John Heidemann |
-| [HADOOP-1547](https://issues.apache.org/jira/browse/HADOOP-1547) | Provide examples for aggregate library | Major | . | Tom White | Runping Qi |
-| [HADOOP-1518](https://issues.apache.org/jira/browse/HADOOP-1518) | Add session id to metric data | Major | . | David Bowen | David Bowen |
-| [HADOOP-1485](https://issues.apache.org/jira/browse/HADOOP-1485) | Metrics should be there for reporting shuffle failures/successes | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-1484](https://issues.apache.org/jira/browse/HADOOP-1484) | Kill jobs from web interface | Minor | . | Enis Soztutar | Enis Soztutar |
-| [HADOOP-1478](https://issues.apache.org/jira/browse/HADOOP-1478) | The blockStream of DFSClient.FSInputStream should not be buffered | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1473](https://issues.apache.org/jira/browse/HADOOP-1473) | Make jobids unique across jobtracker restarts | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1470](https://issues.apache.org/jira/browse/HADOOP-1470) | Rework FSInputChecker and FSOutputSummer to support checksum code sharing between ChecksumFileSystem and block level crc dfs | Major | fs | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1467](https://issues.apache.org/jira/browse/HADOOP-1467) | Remove redundant counters from WordCount example | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1462](https://issues.apache.org/jira/browse/HADOOP-1462) | Better progress reporting from a Task | Major | . | Vivek Ratan | Vivek Ratan |
-| [HADOOP-1457](https://issues.apache.org/jira/browse/HADOOP-1457) | Counters for monitoring task assignments | Minor | . | Devaraj Das | Arun C Murthy |
-| [HADOOP-1455](https://issues.apache.org/jira/browse/HADOOP-1455) | Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf | Major | . | Christian Kunz | Devaraj Das |
-| [HADOOP-1450](https://issues.apache.org/jira/browse/HADOOP-1450) | checksums should be closer to data generation and consumption | Major | fs | Doug Cutting | Doug Cutting |
-| [HADOOP-1440](https://issues.apache.org/jira/browse/HADOOP-1440) | JobClient should not sort input-splits | Major | . | Milind Bhandarkar | Senthil Subramanian |
-| [HADOOP-1438](https://issues.apache.org/jira/browse/HADOOP-1438) | Grammatical / wording / copy edits for Hadoop Distributed File System: Architecture and Design white paper | Trivial | documentation | Luke Nezda | |
-| [HADOOP-1429](https://issues.apache.org/jira/browse/HADOOP-1429) | RPC Server won't go quietly | Minor | ipc | stack | stack |
-| [HADOOP-1417](https://issues.apache.org/jira/browse/HADOOP-1417) | Exclude some Findbugs detectors | Minor | build | Nigel Daley | Nigel Daley |
-| [HADOOP-1413](https://issues.apache.org/jira/browse/HADOOP-1413) | A new example to do tile placements using distributed dancing links | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1408](https://issues.apache.org/jira/browse/HADOOP-1408) | fix warning about cast of Map\<String, Map\<String, JobInfo\>\> in jobhistory.jsp | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1376](https://issues.apache.org/jira/browse/HADOOP-1376) | RandomWriter should be tweaked to generate input data for terasort | Major | . | Devaraj Das | Devaraj Das |
| [HADOOP-1343](https://issues.apache.org/jira/browse/HADOOP-1343) | Deprecate the Configuration.set(String,Object) method and make Configuration Iterable | Major | conf | Owen O'Malley | Owen O'Malley |
| [HADOOP-1342](https://issues.apache.org/jira/browse/HADOOP-1342) | A configurable limit on the number of unique values should be set on the UniqueValueCount and ValueHistogram aggregators | Major | . | Runping Qi | Runping Qi |
| [HADOOP-1340](https://issues.apache.org/jira/browse/HADOOP-1340) | md5 file in filecache should inherit replication factor from the file it belongs to. | Major | . | Christian Kunz | dhruba borthakur |
+| [HADOOP-894](https://issues.apache.org/jira/browse/HADOOP-894) | dfs client protocol should allow asking for parts of the block map | Major | . | Owen O'Malley | Konstantin Shvachko |
+| [HADOOP-1413](https://issues.apache.org/jira/browse/HADOOP-1413) | A new example to do tile placements using distributed dancing links | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-800](https://issues.apache.org/jira/browse/HADOOP-800) | More improvements to DFS browsing WI | Major | . | arkady borkovsky | Enis Soztutar |
+| [HADOOP-1408](https://issues.apache.org/jira/browse/HADOOP-1408) | fix warning about cast of Map\<String, Map\<String, JobInfo\>\> in jobhistory.jsp | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1376](https://issues.apache.org/jira/browse/HADOOP-1376) | RandomWriter should be tweaked to generate input data for terasort | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-1429](https://issues.apache.org/jira/browse/HADOOP-1429) | RPC Server won't go quietly | Minor | ipc | stack | stack |
+| [HADOOP-1450](https://issues.apache.org/jira/browse/HADOOP-1450) | checksums should be closer to data generation and consumption | Major | fs | Doug Cutting | Doug Cutting |
+| [HADOOP-1467](https://issues.apache.org/jira/browse/HADOOP-1467) | Remove redundant counters from WordCount example | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1438](https://issues.apache.org/jira/browse/HADOOP-1438) | Grammatical / wording / copy edits for Hadoop Distributed File System: Architecture and Design white paper | Trivial | documentation | Luke Nezda | |
+| [HADOOP-1457](https://issues.apache.org/jira/browse/HADOOP-1457) | Counters for monitoring task assignments | Minor | . | Devaraj Das | Arun C Murthy |
+| [HADOOP-1417](https://issues.apache.org/jira/browse/HADOOP-1417) | Exclude some Findbugs detectors | Minor | build | Nigel Daley | Nigel Daley |
| [HADOOP-1320](https://issues.apache.org/jira/browse/HADOOP-1320) | Rewrite 'random-writer' to use '-reducer NONE' | Minor | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-1484](https://issues.apache.org/jira/browse/HADOOP-1484) | Kill jobs from web interface | Minor | . | Enis Soztutar | Enis Soztutar |
+| [HADOOP-1003](https://issues.apache.org/jira/browse/HADOOP-1003) | Proposal to batch commits to edits log. | Major | . | Raghu Angadi | dhruba borthakur |
+| [HADOOP-1023](https://issues.apache.org/jira/browse/HADOOP-1023) | better links to mailing list archives | Major | documentation | Daniel Naber | Tom White |
+| [HADOOP-1462](https://issues.apache.org/jira/browse/HADOOP-1462) | Better progress reporting from a Task | Major | . | Vivek Ratan | Vivek Ratan |
+| [HADOOP-1440](https://issues.apache.org/jira/browse/HADOOP-1440) | JobClient should not sort input-splits | Major | . | Milind Bhandarkar | Senthil Subramanian |
+| [HADOOP-1455](https://issues.apache.org/jira/browse/HADOOP-1455) | Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf | Major | . | Christian Kunz | Devaraj Das |
+| [HADOOP-1147](https://issues.apache.org/jira/browse/HADOOP-1147) | remove all @author tags from source | Minor | . | Doug Cutting | Doug Cutting |
+| [HADOOP-1283](https://issues.apache.org/jira/browse/HADOOP-1283) | Eliminate internal UTF8 to String and vice versa conversions in the name-node. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1518](https://issues.apache.org/jira/browse/HADOOP-1518) | Add session id to metric data | Major | . | David Bowen | David Bowen |
| [HADOOP-1292](https://issues.apache.org/jira/browse/HADOOP-1292) | dfs -copyToLocal should guarantee file is complete | Major | . | eric baldeschwieler | Tsz Wo Nicholas Sze |
+| [HADOOP-1028](https://issues.apache.org/jira/browse/HADOOP-1028) | Servers should log startup and shutdown messages | Major | . | Nigel Daley | Tsz Wo Nicholas Sze |
+| [HADOOP-1485](https://issues.apache.org/jira/browse/HADOOP-1485) | Metrics should be there for reporting shuffle failures/successes | Major | . | Devaraj Das | Devaraj Das |
| [HADOOP-1286](https://issues.apache.org/jira/browse/HADOOP-1286) | Distributed cluster upgrade | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1283](https://issues.apache.org/jira/browse/HADOOP-1283) | Eliminate internal UTF8 to String and vice versa conversions in the name-node. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1147](https://issues.apache.org/jira/browse/HADOOP-1147) | remove all @author tags from source | Minor | . | Doug Cutting | Doug Cutting |
+| [HADOOP-1580](https://issues.apache.org/jira/browse/HADOOP-1580) | provide better error message when subprocesses fail in hadoop streaming | Minor | . | John Heidemann | John Heidemann |
+| [HADOOP-1473](https://issues.apache.org/jira/browse/HADOOP-1473) | Make jobids unique across jobtracker restarts | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1582](https://issues.apache.org/jira/browse/HADOOP-1582) | hdfsRead and hdfsPread should return 0 instead of -1 at end-of-file. | Minor | . | Christian Kunz | Christian Kunz |
+| [HADOOP-1470](https://issues.apache.org/jira/browse/HADOOP-1470) | Rework FSInputChecker and FSOutputSummer to support checksum code sharing between ChecksumFileSystem and block level crc dfs | Major | fs | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1585](https://issues.apache.org/jira/browse/HADOOP-1585) | GenericWritable should use generics | Minor | io | Espen Amble Kolstad | Espen Amble Kolstad |
+| [HADOOP-1547](https://issues.apache.org/jira/browse/HADOOP-1547) | Provide examples for aggregate library | Major | . | Tom White | Runping Qi |
+| [HADOOP-1620](https://issues.apache.org/jira/browse/HADOOP-1620) | FileSystem should have fewer abstract methods | Major | . | Doug Cutting | Doug Cutting |
+| [HADOOP-1478](https://issues.apache.org/jira/browse/HADOOP-1478) | The blockStream of DFSClient.FSInputStream should not be buffered | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1653](https://issues.apache.org/jira/browse/HADOOP-1653) | FSDirectory class code cleanup | Trivial | . | Christophe Taton | Christophe Taton |
| [HADOOP-1066](https://issues.apache.org/jira/browse/HADOOP-1066) | http://lucene.apache.org/hadoop/ front page is not user-friendly | Minor | documentation | Marco Nicosia | Doug Cutting |
-| [HADOOP-1028](https://issues.apache.org/jira/browse/HADOOP-1028) | Servers should log startup and shutdown messages | Major | . | Nigel Daley | Tsz Wo Nicholas Sze |
-| [HADOOP-1023](https://issues.apache.org/jira/browse/HADOOP-1023) | better links to mailing list archives | Major | documentation | Daniel Naber | Tom White |
-| [HADOOP-1003](https://issues.apache.org/jira/browse/HADOOP-1003) | Proposal to batch commits to edits log. | Major | . | Raghu Angadi | dhruba borthakur |
-| [HADOOP-894](https://issues.apache.org/jira/browse/HADOOP-894) | dfs client protocol should allow asking for parts of the block map | Major | . | Owen O'Malley | Konstantin Shvachko |
-| [HADOOP-800](https://issues.apache.org/jira/browse/HADOOP-800) | More improvements to DFS browsing WI | Major | . | arkady borkovsky | Enis Soztutar |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1717](https://issues.apache.org/jira/browse/HADOOP-1717) | TestDFSUpgradeFromImage fails on Solaris | Blocker | test | Nigel Daley | Raghu Angadi |
-| [HADOOP-1716](https://issues.apache.org/jira/browse/HADOOP-1716) | TestPipes.testPipes fails | Blocker | . | Nigel Daley | Owen O'Malley |
-| [HADOOP-1714](https://issues.apache.org/jira/browse/HADOOP-1714) | TestDFSUpgradeFromImage fails on Windows | Blocker | test | Nigel Daley | Raghu Angadi |
-| [HADOOP-1712](https://issues.apache.org/jira/browse/HADOOP-1712) | Unhandled exception in Block CRC upgrade on datanode. | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1698](https://issues.apache.org/jira/browse/HADOOP-1698) | 7500+ reducers/partitions causes job to hang | Blocker | . | Srikanth Kakani | Devaraj Das |
-| [HADOOP-1681](https://issues.apache.org/jira/browse/HADOOP-1681) | Re organize StreamJob::submitAndMonitorJob() Exception handling | Minor | . | Lohit Vijayarenu | |
-| [HADOOP-1680](https://issues.apache.org/jira/browse/HADOOP-1680) | Improvements to Block CRC upgrade messages | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1668](https://issues.apache.org/jira/browse/HADOOP-1668) | add INCOMPATIBLE CHANGES section to CHANGES.txt for Hadoop 0.14 | Blocker | documentation | Nigel Daley | Nigel Daley |
-| [HADOOP-1666](https://issues.apache.org/jira/browse/HADOOP-1666) | The FsShell Object cannot be used for multiple fs commands. | Minor | fs | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1665](https://issues.apache.org/jira/browse/HADOOP-1665) | DFS Trash feature bugs | Blocker | . | Nigel Daley | dhruba borthakur |
-| [HADOOP-1663](https://issues.apache.org/jira/browse/HADOOP-1663) | streaming returning 0 when submitJob fails with Exception | Major | . | Koji Noguchi | Koji Noguchi |
-| [HADOOP-1659](https://issues.apache.org/jira/browse/HADOOP-1659) | job id / job name mix-up | Blocker | . | Christian Kunz | Arun C Murthy |
-| [HADOOP-1657](https://issues.apache.org/jira/browse/HADOOP-1657) | NNBench benchmark hangs with trunk | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1649](https://issues.apache.org/jira/browse/HADOOP-1649) | Performance regression with Block CRCs | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1647](https://issues.apache.org/jira/browse/HADOOP-1647) | DistributedFileSystem.getFileStatus() fails for path "/" | Blocker | . | Enis Soztutar | dhruba borthakur |
-| [HADOOP-1640](https://issues.apache.org/jira/browse/HADOOP-1640) | TestDecommission fails on Windows | Blocker | . | Nigel Daley | dhruba borthakur |
-| [HADOOP-1639](https://issues.apache.org/jira/browse/HADOOP-1639) | TestSymLink is failing fairly often and is blocking the regression | Major | . | Owen O'Malley | Mahadev konar |
-| [HADOOP-1638](https://issues.apache.org/jira/browse/HADOOP-1638) | Master node unable to bind to DNS hostname | Minor | contrib/cloud | Stu Hood | |
-| [HADOOP-1635](https://issues.apache.org/jira/browse/HADOOP-1635) | Keypair Name Hardcoded | Minor | contrib/cloud | Stu Hood | |
-| [HADOOP-1634](https://issues.apache.org/jira/browse/HADOOP-1634) | EC2 launch-hadoop-cluster awk Problem | Minor | contrib/cloud | Stu Hood | |
-| [HADOOP-1632](https://issues.apache.org/jira/browse/HADOOP-1632) | IllegalArgumentException in fsck | Blocker | . | Konstantin Shvachko | Hairong Kuang |
-| [HADOOP-1625](https://issues.apache.org/jira/browse/HADOOP-1625) | "could not move files" exception in DataXceiver | Blocker | . | Konstantin Shvachko | Raghu Angadi |
-| [HADOOP-1624](https://issues.apache.org/jira/browse/HADOOP-1624) | Unknown op code exception in DataXceiver. | Blocker | . | Konstantin Shvachko | Raghu Angadi |
-| [HADOOP-1623](https://issues.apache.org/jira/browse/HADOOP-1623) | dfs -cp infinite loop creating sub-directories | Blocker | . | Koji Noguchi | dhruba borthakur |
-| [HADOOP-1619](https://issues.apache.org/jira/browse/HADOOP-1619) | FSInputChecker attempts to seek past EOF | Blocker | fs | Nigel Daley | Hairong Kuang |
-| [HADOOP-1613](https://issues.apache.org/jira/browse/HADOOP-1613) | The dfs webui (dfshealth) shows "Last Contact" as a negative number | Minor | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1603](https://issues.apache.org/jira/browse/HADOOP-1603) | Replication gets set to 1 sometimes when Namenode restarted. | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1599](https://issues.apache.org/jira/browse/HADOOP-1599) | TestCopyFiles with IllegalArgumentException on Windows | Blocker | fs | Nigel Daley | Senthil Subramanian |
-| [HADOOP-1596](https://issues.apache.org/jira/browse/HADOOP-1596) | TestSymLink is failing | Blocker | . | Doug Cutting | Owen O'Malley |
-| [HADOOP-1590](https://issues.apache.org/jira/browse/HADOOP-1590) | Jobtracker web interface contains several absolute href links instead of relative ones | Major | . | Thomas Friol | |
-| [HADOOP-1587](https://issues.apache.org/jira/browse/HADOOP-1587) | Tasks run by MiniMRCluster don't get sysprops from TestCases | Blocker | test | Alejandro Abdelnur | Devaraj Das |
-| [HADOOP-1584](https://issues.apache.org/jira/browse/HADOOP-1584) | Bug in readFields of GenericWritable | Minor | io | Espen Amble Kolstad | Espen Amble Kolstad |
-| [HADOOP-1578](https://issues.apache.org/jira/browse/HADOOP-1578) | Data-nodes should send storage ID to the name-node during registration | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1576](https://issues.apache.org/jira/browse/HADOOP-1576) | web interface inconsistencies when using speculative execution | Blocker | . | Christian Kunz | Arun C Murthy |
-| [HADOOP-1564](https://issues.apache.org/jira/browse/HADOOP-1564) | Write unit tests to detect CRC corruption | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1556](https://issues.apache.org/jira/browse/HADOOP-1556) | 9 unit test failures: file.out.index already exists | Major | . | Nigel Daley | Devaraj Das |
-| [HADOOP-1554](https://issues.apache.org/jira/browse/HADOOP-1554) | Fix the JobHistory to display things like the number of nodes the job ran on, the number of killed/failed tasks | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-1553](https://issues.apache.org/jira/browse/HADOOP-1553) | Extensive logging of C++ application can slow down task by an order of magnitude | Blocker | . | Christian Kunz | Owen O'Malley |
-| [HADOOP-1551](https://issues.apache.org/jira/browse/HADOOP-1551) | libhdfs API is out of sync with Filesystem API | Blocker | . | Christian Kunz | Sameer Paranjpye |
-| [HADOOP-1546](https://issues.apache.org/jira/browse/HADOOP-1546) | The DFS WebUI shows an incorrect column for file Creatin Time | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1542](https://issues.apache.org/jira/browse/HADOOP-1542) | Incorrect task/tip being scheduled (looks like speculative execution) | Blocker | . | Nigel Daley | Owen O'Malley |
-| [HADOOP-1536](https://issues.apache.org/jira/browse/HADOOP-1536) | libhdfs tests failing | Blocker | . | Nigel Daley | dhruba borthakur |
-| [HADOOP-1535](https://issues.apache.org/jira/browse/HADOOP-1535) | Wrong comparator used to merge files in Reduce phase | Major | . | Vivek Ratan | Vivek Ratan |
-| [HADOOP-1524](https://issues.apache.org/jira/browse/HADOOP-1524) | Task Logs userlogs don't show up for a while | Major | . | Michael Bieniosek | Michael Bieniosek |
-| [HADOOP-1520](https://issues.apache.org/jira/browse/HADOOP-1520) | IndexOutOfBoundsException in FSEditLog.processIOError | Blocker | . | Nigel Daley | dhruba borthakur |
-| [HADOOP-1517](https://issues.apache.org/jira/browse/HADOOP-1517) | Three methods in FSNamesystem should not be synchronized. | Critical | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1514](https://issues.apache.org/jira/browse/HADOOP-1514) | Progress reporting not handled for the case where a reducer currently doesn't have anything to fetch | Blocker | . | Devaraj Das | Vivek Ratan |
-| [HADOOP-1513](https://issues.apache.org/jira/browse/HADOOP-1513) | A likely race condition between the creation of a directory and checking for its existence in the DiskChecker class | Critical | fs | Devaraj Das | Devaraj Das |
-| [HADOOP-1512](https://issues.apache.org/jira/browse/HADOOP-1512) | TestTextInputFormat fails on Windows | Major | . | Konstantin Shvachko | |
-| [HADOOP-1504](https://issues.apache.org/jira/browse/HADOOP-1504) | terminate-hadoop-cluster may be overzealous | Blocker | fs/s3 | Doug Cutting | Tom White |
-| [HADOOP-1503](https://issues.apache.org/jira/browse/HADOOP-1503) | Fix for broken build by HADOOP-1498 | Major | . | stack | stack |
-| [HADOOP-1501](https://issues.apache.org/jira/browse/HADOOP-1501) | Block reports from all datanodes arrive at the namenode within a small band of time | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1493](https://issues.apache.org/jira/browse/HADOOP-1493) | possible double setting of java.library.path introduced by HADOOP-838 | Major | . | Enis Soztutar | Enis Soztutar |
-| [HADOOP-1492](https://issues.apache.org/jira/browse/HADOOP-1492) | DataNode version mismatch during handshake() causes NullPointerException. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1489](https://issues.apache.org/jira/browse/HADOOP-1489) | Input file get truncated for text files with \r\n | Major | io | Bwolen Yang | |
-| [HADOOP-1486](https://issues.apache.org/jira/browse/HADOOP-1486) | ReplicationMonitor thread goes away | Blocker | . | Koji Noguchi | dhruba borthakur |
-| [HADOOP-1482](https://issues.apache.org/jira/browse/HADOOP-1482) | SecondaryNameNode does not roll ports | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1479](https://issues.apache.org/jira/browse/HADOOP-1479) | NPE in HStore#get if StoreFile only has keys \< than passed key | Minor | . | stack | stack |
-| [HADOOP-1475](https://issues.apache.org/jira/browse/HADOOP-1475) | local filecache disappears | Blocker | . | Christian Kunz | Owen O'Malley |
-| [HADOOP-1472](https://issues.apache.org/jira/browse/HADOOP-1472) | Timed-out tasks are marked as 'KILLED' rather than as 'FAILED' which means the framework doesn't fail a TIP with 4 or more timed-out attempts | Blocker | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-1197](https://issues.apache.org/jira/browse/HADOOP-1197) | The misleading Configuration.set(String, Object) should be removed | Minor | conf | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1344](https://issues.apache.org/jira/browse/HADOOP-1344) | getJobName not accessible from JobClient | Minor | . | Michael Bieniosek | |
+| [HADOOP-1355](https://issues.apache.org/jira/browse/HADOOP-1355) | Possible null pointer dereference in TaskLogAppender.append(LoggingEvent) | Minor | . | Nigel Daley | Arun C Murthy |
+| [HADOOP-1357](https://issues.apache.org/jira/browse/HADOOP-1357) | Call to equals() comparing different types in CopyFiles.cleanup(Configuration, JobConf, String, String) | Minor | util | Nigel Daley | Arun C Murthy |
+| [HADOOP-1335](https://issues.apache.org/jira/browse/HADOOP-1335) | C++ reducers under hadoop-pipes are not started when there are no key-value pairs to be reduced | Major | . | Christian Kunz | Owen O'Malley |
+| [HADOOP-1359](https://issues.apache.org/jira/browse/HADOOP-1359) | Variable dereferenced then later checked for null | Minor | . | Nigel Daley | Hairong Kuang |
+| [HADOOP-1364](https://issues.apache.org/jira/browse/HADOOP-1364) | Inconsistent synchronization of SequenceFile$Reader.noBufferedValues; locked 66% of time | Minor | io | Nigel Daley | Owen O'Malley |
+| [HADOOP-1390](https://issues.apache.org/jira/browse/HADOOP-1390) | Inconsistent Synchronization cleanup for {Configuration, TaskLog, MapTask, Server}.java | Minor | conf, ipc | Devaraj Das | Devaraj Das |
+| [HADOOP-1393](https://issues.apache.org/jira/browse/HADOOP-1393) | using Math.abs(Random.getInt()) does not guarantee a positive number | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1387](https://issues.apache.org/jira/browse/HADOOP-1387) | FindBugs -\> Performance | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-1406](https://issues.apache.org/jira/browse/HADOOP-1406) | Metrics based on Map-Reduce Counters are not cleaned up | Major | . | David Bowen | David Bowen |
+| [HADOOP-1394](https://issues.apache.org/jira/browse/HADOOP-1394) | FindBugs : Performance : in dfs | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1226](https://issues.apache.org/jira/browse/HADOOP-1226) | makeQualified should return an instance of a DfsPath when passed a DfsPath | Major | . | Koji Noguchi | dhruba borthakur |
+| [HADOOP-1443](https://issues.apache.org/jira/browse/HADOOP-1443) | TestFileCorruption fails with ArrayIndexOutOfBoundsException | Critical | . | Nigel Daley | Konstantin Shvachko |
| [HADOOP-1461](https://issues.apache.org/jira/browse/HADOOP-1461) | Corner-case deadlock in TaskTracker | Blocker | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1459](https://issues.apache.org/jira/browse/HADOOP-1459) | FileSystem.getFileCacheHints returns IP addresses rather than hostnames, which breaks 'data-locality' in map-reduce | Blocker | . | Arun C Murthy | dhruba borthakur |
-| [HADOOP-1456](https://issues.apache.org/jira/browse/HADOOP-1456) | TestDecommission fails with assertion Number of replicas for block1 expected:\<3\> but was:\<2\> | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1453](https://issues.apache.org/jira/browse/HADOOP-1453) | exists() not necessary before DFS.open | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1448](https://issues.apache.org/jira/browse/HADOOP-1448) | Setting the replication factor of a file too high causes namenode cpu overload | Major | . | dhruba borthakur | Hairong Kuang |
| [HADOOP-1446](https://issues.apache.org/jira/browse/HADOOP-1446) | Metrics from the TaskTracker are updated only when map/reduce tasks start/end/fail | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-1444](https://issues.apache.org/jira/browse/HADOOP-1444) | Block allocation method does not check pendingCreates for duplicate block ids | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1443](https://issues.apache.org/jira/browse/HADOOP-1443) | TestFileCorruption fails with ArrayIndexOutOfBoundsException | Critical | . | Nigel Daley | Konstantin Shvachko |
-| [HADOOP-1442](https://issues.apache.org/jira/browse/HADOOP-1442) | Zero-byte input files are not included in InputSplit | Major | . | Milind Bhandarkar | Senthil Subramanian |
-| [HADOOP-1428](https://issues.apache.org/jira/browse/HADOOP-1428) | ChecksumFileSystem : some operations implicitly not supported. | Major | fs | Raghu Angadi | |
| [HADOOP-1414](https://issues.apache.org/jira/browse/HADOOP-1414) | Findbugs - Bad Practice | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1412](https://issues.apache.org/jira/browse/HADOOP-1412) | FindBugs: Dodgy bugs in fs, filecache, io, and util packages | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1406](https://issues.apache.org/jira/browse/HADOOP-1406) | Metrics based on Map-Reduce Counters are not cleaned up | Major | . | David Bowen | David Bowen |
-| [HADOOP-1400](https://issues.apache.org/jira/browse/HADOOP-1400) | JobClient rpc times out getting job status | Blocker | . | Nigel Daley | Owen O'Malley |
-| [HADOOP-1396](https://issues.apache.org/jira/browse/HADOOP-1396) | FileNotFound exception on DFS block | Blocker | . | Devaraj Das | dhruba borthakur |
-| [HADOOP-1394](https://issues.apache.org/jira/browse/HADOOP-1394) | FindBugs : Performance : in dfs | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1393](https://issues.apache.org/jira/browse/HADOOP-1393) | using Math.abs(Random.getInt()) does not guarantee a positive number | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-1392](https://issues.apache.org/jira/browse/HADOOP-1392) | FindBugs : Fix some correctness bugs reported in DFS, FS, etc. | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1390](https://issues.apache.org/jira/browse/HADOOP-1390) | Inconsistent Synchronization cleanup for {Configuration, TaskLog, MapTask, Server}.java | Minor | conf, ipc | Devaraj Das | Devaraj Das |
-| [HADOOP-1387](https://issues.apache.org/jira/browse/HADOOP-1387) | FindBugs -\> Performance | Major | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1372](https://issues.apache.org/jira/browse/HADOOP-1372) | DFS Clients should start using the org.apache.hadoop.fs.LocalDirAllocator | Major | . | Devaraj Das | dhruba borthakur |
-| [HADOOP-1367](https://issues.apache.org/jira/browse/HADOOP-1367) | Inconsistent synchronization of NetworkTopology.distFrom; locked 50% of time | Major | io | Nigel Daley | Hairong Kuang |
-| [HADOOP-1364](https://issues.apache.org/jira/browse/HADOOP-1364) | Inconsistent synchronization of SequenceFile$Reader.noBufferedValues; locked 66% of time | Minor | io | Nigel Daley | Owen O'Malley |
-| [HADOOP-1359](https://issues.apache.org/jira/browse/HADOOP-1359) | Variable dereferenced then later checked for null | Minor | . | Nigel Daley | Hairong Kuang |
-| [HADOOP-1357](https://issues.apache.org/jira/browse/HADOOP-1357) | Call to equals() comparing different types in CopyFiles.cleanup(Configuration, JobConf, String, String) | Minor | util | Nigel Daley | Arun C Murthy |
-| [HADOOP-1355](https://issues.apache.org/jira/browse/HADOOP-1355) | Possible null pointer dereference in TaskLogAppender.append(LoggingEvent) | Minor | . | Nigel Daley | Arun C Murthy |
-| [HADOOP-1344](https://issues.apache.org/jira/browse/HADOOP-1344) | getJobName not accessible from JobClient | Minor | . | Michael Bieniosek | |
-| [HADOOP-1335](https://issues.apache.org/jira/browse/HADOOP-1335) | C++ reducers under hadoop-pipes are not started when there are no key-value pairs to be reduced | Major | . | Christian Kunz | Owen O'Malley |
+| [HADOOP-1412](https://issues.apache.org/jira/browse/HADOOP-1412) | FindBugs: Dodgy bugs in fs, filecache, io, and util packages | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1479](https://issues.apache.org/jira/browse/HADOOP-1479) | NPE in HStore#get if StoreFile only has keys \< than passed key | Minor | . | stack | stack |
+| [HADOOP-1261](https://issues.apache.org/jira/browse/HADOOP-1261) | Restart of the same data-node should not generate edits log records. | Minor | . | Konstantin Shvachko | Raghu Angadi |
| [HADOOP-1311](https://issues.apache.org/jira/browse/HADOOP-1311) | Bug in BytesWritable.set(byte[] newData, int offset, int length) | Major | io | Srikanth Kakani | dhruba borthakur |
-| [HADOOP-1300](https://issues.apache.org/jira/browse/HADOOP-1300) | deletion of excess replicas does not take into account 'rack-locality' | Major | . | Koji Noguchi | Hairong Kuang |
-| [HADOOP-1285](https://issues.apache.org/jira/browse/HADOOP-1285) | ChecksumFileSystem : Can't read when io.file.buffer.size \< bytePerChecksum | Major | fs | Raghu Angadi | |
+| [HADOOP-1456](https://issues.apache.org/jira/browse/HADOOP-1456) | TestDecommission fails with assertion Number of replicas for block1 expected:\<3\> but was:\<2\> | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1396](https://issues.apache.org/jira/browse/HADOOP-1396) | FileNotFound exception on DFS block | Blocker | . | Devaraj Das | dhruba borthakur |
+| [HADOOP-1139](https://issues.apache.org/jira/browse/HADOOP-1139) | All block trasitions should be logged at log level INFO | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-1269](https://issues.apache.org/jira/browse/HADOOP-1269) | DFS Scalability: namenode throughput impacted becuase of global FSNamesystem lock | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1261](https://issues.apache.org/jira/browse/HADOOP-1261) | Restart of the same data-node should not generate edits log records. | Minor | . | Konstantin Shvachko | Raghu Angadi |
+| [HADOOP-1472](https://issues.apache.org/jira/browse/HADOOP-1472) | Timed-out tasks are marked as 'KILLED' rather than as 'FAILED' which means the framework doesn't fail a TIP with 4 or more timed-out attempts | Blocker | . | Arun C Murthy | Arun C Murthy |
| [HADOOP-1234](https://issues.apache.org/jira/browse/HADOOP-1234) | map tasks fail because they do not find application in file cache | Major | . | Christian Kunz | Arun C Murthy |
-| [HADOOP-1226](https://issues.apache.org/jira/browse/HADOOP-1226) | makeQualified should return an instance of a DfsPath when passed a DfsPath | Major | . | Koji Noguchi | dhruba borthakur |
-| [HADOOP-1207](https://issues.apache.org/jira/browse/HADOOP-1207) | hdfs -rm should NOT fail if one of the files to remove is missing | Minor | . | arkady borkovsky | Tsz Wo Nicholas Sze |
-| [HADOOP-1197](https://issues.apache.org/jira/browse/HADOOP-1197) | The misleading Configuration.set(String, Object) should be removed | Minor | conf | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1482](https://issues.apache.org/jira/browse/HADOOP-1482) | SecondaryNameNode does not roll ports | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1300](https://issues.apache.org/jira/browse/HADOOP-1300) | deletion of excess replicas does not take into account 'rack-locality' | Major | . | Koji Noguchi | Hairong Kuang |
+| [HADOOP-1459](https://issues.apache.org/jira/browse/HADOOP-1459) | FileSystem.getFileCacheHints returns IP addresses rather than hostnames, which breaks 'data-locality' in map-reduce | Blocker | . | Arun C Murthy | dhruba borthakur |
+| [HADOOP-1493](https://issues.apache.org/jira/browse/HADOOP-1493) | possible double setting of java.library.path introduced by HADOOP-838 | Major | . | Enis Soztutar | Enis Soztutar |
+| [HADOOP-1372](https://issues.apache.org/jira/browse/HADOOP-1372) | DFS Clients should start using the org.apache.hadoop.fs.LocalDirAllocator | Major | . | Devaraj Das | dhruba borthakur |
| [HADOOP-1193](https://issues.apache.org/jira/browse/HADOOP-1193) | Map/reduce job gets OutOfMemoryException when set map out to be compressed | Blocker | . | Hairong Kuang | Arun C Murthy |
-| [HADOOP-1139](https://issues.apache.org/jira/browse/HADOOP-1139) | All block trasitions should be logged at log level INFO | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1492](https://issues.apache.org/jira/browse/HADOOP-1492) | DataNode version mismatch during handshake() causes NullPointerException. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1442](https://issues.apache.org/jira/browse/HADOOP-1442) | Zero-byte input files are not included in InputSplit | Major | . | Milind Bhandarkar | Senthil Subramanian |
+| [HADOOP-1444](https://issues.apache.org/jira/browse/HADOOP-1444) | Block allocation method does not check pendingCreates for duplicate block ids | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1207](https://issues.apache.org/jira/browse/HADOOP-1207) | hdfs -rm should NOT fail if one of the files to remove is missing | Minor | . | arkady borkovsky | Tsz Wo Nicholas Sze |
+| [HADOOP-1503](https://issues.apache.org/jira/browse/HADOOP-1503) | Fix for broken build by HADOOP-1498 | Major | . | stack | stack |
+| [HADOOP-1475](https://issues.apache.org/jira/browse/HADOOP-1475) | local filecache disappears | Blocker | . | Christian Kunz | Owen O'Malley |
+| [HADOOP-1504](https://issues.apache.org/jira/browse/HADOOP-1504) | terminate-hadoop-cluster may be overzealous | Blocker | fs/s3 | Doug Cutting | Tom White |
+| [HADOOP-1453](https://issues.apache.org/jira/browse/HADOOP-1453) | exists() not necessary before DFS.open | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1489](https://issues.apache.org/jira/browse/HADOOP-1489) | Input file get truncated for text files with \\r\\n | Major | io | Bwolen Yang | |
+| [HADOOP-1501](https://issues.apache.org/jira/browse/HADOOP-1501) | Block reports from all datanodes arrive at the namenode within a small band of time | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1517](https://issues.apache.org/jira/browse/HADOOP-1517) | Three methods in FSNamesystem should not be synchronized. | Critical | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1512](https://issues.apache.org/jira/browse/HADOOP-1512) | TestTextInputFormat fails on Windows | Major | . | Konstantin Shvachko | |
+| [HADOOP-1514](https://issues.apache.org/jira/browse/HADOOP-1514) | Progress reporting not handled for the case where a reducer currently doesn't have anything to fetch | Blocker | . | Devaraj Das | Vivek Ratan |
+| [HADOOP-1367](https://issues.apache.org/jira/browse/HADOOP-1367) | Inconsistent synchronization of NetworkTopology.distFrom; locked 50% of time | Major | io | Nigel Daley | Hairong Kuang |
+| [HADOOP-1536](https://issues.apache.org/jira/browse/HADOOP-1536) | libhdfs tests failing | Blocker | . | Nigel Daley | dhruba borthakur |
+| [HADOOP-1520](https://issues.apache.org/jira/browse/HADOOP-1520) | IndexOutOfBoundsException in FSEditLog.processIOError | Blocker | . | Nigel Daley | dhruba borthakur |
+| [HADOOP-1542](https://issues.apache.org/jira/browse/HADOOP-1542) | Incorrect task/tip being scheduled (looks like speculative execution) | Blocker | . | Nigel Daley | Owen O'Malley |
+| [HADOOP-1513](https://issues.apache.org/jira/browse/HADOOP-1513) | A likely race condition between the creation of a directory and checking for its existence in the DiskChecker class | Critical | fs | Devaraj Das | Devaraj Das |
+| [HADOOP-1546](https://issues.apache.org/jira/browse/HADOOP-1546) | The DFS WebUI shows an incorrect column for file Creatin Time | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-690](https://issues.apache.org/jira/browse/HADOOP-690) | NPE in jobcontrol | Major | . | Johan Oskarsson | Owen O'Malley |
+| [HADOOP-1556](https://issues.apache.org/jira/browse/HADOOP-1556) | 9 unit test failures: file.out.index already exists | Major | . | Nigel Daley | Devaraj Das |
+| [HADOOP-1554](https://issues.apache.org/jira/browse/HADOOP-1554) | Fix the JobHistory to display things like the number of nodes the job ran on, the number of killed/failed tasks | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-1448](https://issues.apache.org/jira/browse/HADOOP-1448) | Setting the replication factor of a file too high causes namenode cpu overload | Major | . | dhruba borthakur | Hairong Kuang |
+| [HADOOP-1578](https://issues.apache.org/jira/browse/HADOOP-1578) | Data-nodes should send storage ID to the name-node during registration | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1584](https://issues.apache.org/jira/browse/HADOOP-1584) | Bug in readFields of GenericWritable | Minor | io | Espen Amble Kolstad | Espen Amble Kolstad |
+| [HADOOP-911](https://issues.apache.org/jira/browse/HADOOP-911) | Multithreading issue with libhdfs library | Blocker | . | Christian Kunz | Christian Kunz |
+| [HADOOP-1486](https://issues.apache.org/jira/browse/HADOOP-1486) | ReplicationMonitor thread goes away | Blocker | . | Koji Noguchi | dhruba borthakur |
+| [HADOOP-1590](https://issues.apache.org/jira/browse/HADOOP-1590) | Jobtracker web interface contains several absolute href links instead of relative ones | Major | . | Thomas Friol | |
+| [HADOOP-1596](https://issues.apache.org/jira/browse/HADOOP-1596) | TestSymLink is failing | Blocker | . | Doug Cutting | Owen O'Malley |
+| [HADOOP-1535](https://issues.apache.org/jira/browse/HADOOP-1535) | Wrong comparator used to merge files in Reduce phase | Major | . | Vivek Ratan | Vivek Ratan |
+| [HADOOP-1428](https://issues.apache.org/jira/browse/HADOOP-1428) | ChecksumFileSystem : some operations implicitly not supported. | Major | fs | Raghu Angadi | |
| [HADOOP-1124](https://issues.apache.org/jira/browse/HADOOP-1124) | ChecksumFileSystem does not handle ChecksumError correctly | Major | fs | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1576](https://issues.apache.org/jira/browse/HADOOP-1576) | web interface inconsistencies when using speculative execution | Blocker | . | Christian Kunz | Arun C Murthy |
+| [HADOOP-1524](https://issues.apache.org/jira/browse/HADOOP-1524) | Task Logs userlogs don't show up for a while | Major | . | Michael Bieniosek | Michael Bieniosek |
+| [HADOOP-1599](https://issues.apache.org/jira/browse/HADOOP-1599) | TestCopyFiles with IllegalArgumentException on Windows | Blocker | fs | Nigel Daley | Senthil Subramanian |
+| [HADOOP-1613](https://issues.apache.org/jira/browse/HADOOP-1613) | The dfs webui (dfshealth) shows "Last Contact" as a negative number | Minor | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1400](https://issues.apache.org/jira/browse/HADOOP-1400) | JobClient rpc times out getting job status | Blocker | . | Nigel Daley | Owen O'Malley |
+| [HADOOP-1564](https://issues.apache.org/jira/browse/HADOOP-1564) | Write unit tests to detect CRC corruption | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1285](https://issues.apache.org/jira/browse/HADOOP-1285) | ChecksumFileSystem : Can't read when io.file.buffer.size \< bytePerChecksum | Major | fs | Raghu Angadi | |
+| [HADOOP-1625](https://issues.apache.org/jira/browse/HADOOP-1625) | "could not move files" exception in DataXceiver | Blocker | . | Konstantin Shvachko | Raghu Angadi |
+| [HADOOP-1624](https://issues.apache.org/jira/browse/HADOOP-1624) | Unknown op code exception in DataXceiver. | Blocker | . | Konstantin Shvachko | Raghu Angadi |
| [HADOOP-1084](https://issues.apache.org/jira/browse/HADOOP-1084) | updating a hdfs file, doesn't cause the distributed file cache to update itself | Blocker | . | Owen O'Malley | Arun C Murthy |
-| [HADOOP-911](https://issues.apache.org/jira/browse/HADOOP-911) | Multithreading issue with libhdfs library | Blocker | . | Christian Kunz | Christian Kunz |
-| [HADOOP-690](https://issues.apache.org/jira/browse/HADOOP-690) | NPE in jobcontrol | Major | . | Johan Oskarsson | Owen O'Malley |
+| [HADOOP-1639](https://issues.apache.org/jira/browse/HADOOP-1639) | TestSymLink is failing fairly often and is blocking the regression | Major | . | Owen O'Malley | Mahadev konar |
+| [HADOOP-1623](https://issues.apache.org/jira/browse/HADOOP-1623) | dfs -cp infinite loop creating sub-directories | Blocker | . | Koji Noguchi | dhruba borthakur |
+| [HADOOP-1603](https://issues.apache.org/jira/browse/HADOOP-1603) | Replication gets set to 1 sometimes when Namenode restarted. | Blocker | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1635](https://issues.apache.org/jira/browse/HADOOP-1635) | Keypair Name Hardcoded | Minor | contrib/cloud | Stu Hood | |
+| [HADOOP-1634](https://issues.apache.org/jira/browse/HADOOP-1634) | EC2 launch-hadoop-cluster awk Problem | Minor | contrib/cloud | Stu Hood | |
+| [HADOOP-1638](https://issues.apache.org/jira/browse/HADOOP-1638) | Master node unable to bind to DNS hostname | Minor | contrib/cloud | Stu Hood | |
+| [HADOOP-1632](https://issues.apache.org/jira/browse/HADOOP-1632) | IllegalArgumentException in fsck | Blocker | . | Konstantin Shvachko | Hairong Kuang |
+| [HADOOP-1619](https://issues.apache.org/jira/browse/HADOOP-1619) | FSInputChecker attempts to seek past EOF | Blocker | fs | Nigel Daley | Hairong Kuang |
+| [HADOOP-1640](https://issues.apache.org/jira/browse/HADOOP-1640) | TestDecommission fails on Windows | Blocker | . | Nigel Daley | dhruba borthakur |
+| [HADOOP-1587](https://issues.apache.org/jira/browse/HADOOP-1587) | Tasks run by MiniMRCluster don't get sysprops from TestCases | Blocker | test | Alejandro Abdelnur | Devaraj Das |
+| [HADOOP-1551](https://issues.apache.org/jira/browse/HADOOP-1551) | libhdfs API is out of sync with Filesystem API | Blocker | . | Christian Kunz | Sameer Paranjpye |
+| [HADOOP-1647](https://issues.apache.org/jira/browse/HADOOP-1647) | DistributedFileSystem.getFileStatus() fails for path "/" | Blocker | . | Enis Soztutar | dhruba borthakur |
+| [HADOOP-1657](https://issues.apache.org/jira/browse/HADOOP-1657) | NNBench benchmark hangs with trunk | Blocker | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1666](https://issues.apache.org/jira/browse/HADOOP-1666) | The FsShell Object cannot be used for multiple fs commands. | Minor | fs | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1553](https://issues.apache.org/jira/browse/HADOOP-1553) | Extensive logging of C++ application can slow down task by an order of magnitude | Blocker | . | Christian Kunz | Owen O'Malley |
+| [HADOOP-1659](https://issues.apache.org/jira/browse/HADOOP-1659) | job id / job name mix-up | Blocker | . | Christian Kunz | Arun C Murthy |
+| [HADOOP-1665](https://issues.apache.org/jira/browse/HADOOP-1665) | DFS Trash feature bugs | Blocker | . | Nigel Daley | dhruba borthakur |
+| [HADOOP-1649](https://issues.apache.org/jira/browse/HADOOP-1649) | Performance regression with Block CRCs | Blocker | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1680](https://issues.apache.org/jira/browse/HADOOP-1680) | Improvements to Block CRC upgrade messages | Blocker | . | Raghu Angadi | Raghu Angadi |
| [HADOOP-71](https://issues.apache.org/jira/browse/HADOOP-71) | The SequenceFileRecordReader uses the default FileSystem rather than the supplied one | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1668](https://issues.apache.org/jira/browse/HADOOP-1668) | add INCOMPATIBLE CHANGES section to CHANGES.txt for Hadoop 0.14 | Blocker | documentation | Nigel Daley | Nigel Daley |
+| [HADOOP-1698](https://issues.apache.org/jira/browse/HADOOP-1698) | 7500+ reducers/partitions causes job to hang | Blocker | . | Srikanth Kakani | Devaraj Das |
+| [HADOOP-1716](https://issues.apache.org/jira/browse/HADOOP-1716) | TestPipes.testPipes fails | Blocker | . | Nigel Daley | Owen O'Malley |
+| [HADOOP-1714](https://issues.apache.org/jira/browse/HADOOP-1714) | TestDFSUpgradeFromImage fails on Windows | Blocker | test | Nigel Daley | Raghu Angadi |
+| [HADOOP-1663](https://issues.apache.org/jira/browse/HADOOP-1663) | streaming returning 0 when submitJob fails with Exception | Major | . | Koji Noguchi | Koji Noguchi |
+| [HADOOP-1712](https://issues.apache.org/jira/browse/HADOOP-1712) | Unhandled exception in Block CRC upgrade on datanode. | Blocker | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1717](https://issues.apache.org/jira/browse/HADOOP-1717) | TestDFSUpgradeFromImage fails on Solaris | Blocker | test | Nigel Daley | Raghu Angadi |
+| [HADOOP-1681](https://issues.apache.org/jira/browse/HADOOP-1681) | Re organize StreamJob::submitAndMonitorJob() Exception handling | Minor | . | Lohit Vijayarenu | |
### TESTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1629](https://issues.apache.org/jira/browse/HADOOP-1629) | Block CRC Unit Tests: upgrade test | Blocker | . | Nigel Daley | Raghu Angadi |
| [HADOOP-1628](https://issues.apache.org/jira/browse/HADOOP-1628) | Block CRC Unit Tests: protocol tests | Blocker | . | Nigel Daley | Raghu Angadi |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-1629](https://issues.apache.org/jira/browse/HADOOP-1629) | Block CRC Unit Tests: upgrade test | Blocker | . | Nigel Daley | Raghu Angadi |
### OTHER:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1449](https://issues.apache.org/jira/browse/HADOOP-1449) | Example for contrib/data\_join | Minor | . | Senthil Subramanian | Senthil Subramanian |
| [HADOOP-1336](https://issues.apache.org/jira/browse/HADOOP-1336) | turn on speculative execution by defaul | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1449](https://issues.apache.org/jira/browse/HADOOP-1449) | Example for contrib/data\_join | Minor | . | Senthil Subramanian | Senthil Subramanian |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.1/CHANGES.0.14.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.1/CHANGES.0.14.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.1/CHANGES.0.14.1.md
index 01cff1d..fe0412d 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.1/CHANGES.0.14.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.1/CHANGES.0.14.1.md
@@ -20,54 +20,14 @@
## Release 0.14.1 - 2007-09-03
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1798](https://issues.apache.org/jira/browse/HADOOP-1798) | The counts of currently running maps and reduces isn't maintained correctly when task trackers fail | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1790](https://issues.apache.org/jira/browse/HADOOP-1790) | hadoop seems not to support multi-homed installations | Blocker | . | Torsten Curdt | Doug Cutting |
| [HADOOP-1740](https://issues.apache.org/jira/browse/HADOOP-1740) | Certain Pipes tasks fail, after exiting the C++ application | Blocker | . | Srikanth Kakani | Devaraj Das |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-1790](https://issues.apache.org/jira/browse/HADOOP-1790) | hadoop seems not to support multi-homed installations | Blocker | . | Torsten Curdt | Doug Cutting |
+| [HADOOP-1798](https://issues.apache.org/jira/browse/HADOOP-1798) | The counts of currently running maps and reduces isn't maintained correctly when task trackers fail | Major | . | Owen O'Malley | Owen O'Malley |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.2/CHANGES.0.14.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.2/CHANGES.0.14.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.2/CHANGES.0.14.2.md
index 5e7d774..9dde8ff 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.2/CHANGES.0.14.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.2/CHANGES.0.14.2.md
@@ -20,61 +20,21 @@
## Release 0.14.2 - 2007-10-09
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1997](https://issues.apache.org/jira/browse/HADOOP-1997) | TestCheckpoint fails on Windows | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1978](https://issues.apache.org/jira/browse/HADOOP-1978) | Name-node should remove edits.new during startup rather than renaming it to edits. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1783](https://issues.apache.org/jira/browse/HADOOP-1783) | keyToPath in Jets3tFileSystemStore needs to return absolute path | Major | fs/s3 | Ahad Rana | Tom White |
+| [HADOOP-1948](https://issues.apache.org/jira/browse/HADOOP-1948) | Spurious error message during block crc upgrade. | Blocker | . | Raghu Angadi | Raghu Angadi |
| [HADOOP-1977](https://issues.apache.org/jira/browse/HADOOP-1977) | hadoop job -kill , -status causes NullPointerException | Blocker | . | Lohit Vijayarenu | Enis Soztutar |
| [HADOOP-1972](https://issues.apache.org/jira/browse/HADOOP-1972) | LzoCompressor.finished doesn't check whether the user actually wants to finish compressing | Blocker | . | Arun C Murthy | Arun C Murthy |
| [HADOOP-1970](https://issues.apache.org/jira/browse/HADOOP-1970) | tasktracker hang in reduce. Deadlock between main and comm thread | Blocker | . | Koji Noguchi | Vivek Ratan |
-| [HADOOP-1961](https://issues.apache.org/jira/browse/HADOOP-1961) | -get, -copyToLocal fail when single filename is passed | Blocker | . | Koji Noguchi | Raghu Angadi |
-| [HADOOP-1955](https://issues.apache.org/jira/browse/HADOOP-1955) | Corrupted block replication retries for ever | Blocker | . | Koji Noguchi | Raghu Angadi |
-| [HADOOP-1948](https://issues.apache.org/jira/browse/HADOOP-1948) | Spurious error message during block crc upgrade. | Blocker | . | Raghu Angadi | Raghu Angadi |
| [HADOOP-1862](https://issues.apache.org/jira/browse/HADOOP-1862) | reduces are getting stuck trying to find map outputs | Blocker | . | Owen O'Malley | Arun C Murthy |
-| [HADOOP-1783](https://issues.apache.org/jira/browse/HADOOP-1783) | keyToPath in Jets3tFileSystemStore needs to return absolute path | Major | fs/s3 | Ahad Rana | Tom White |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-1978](https://issues.apache.org/jira/browse/HADOOP-1978) | Name-node should remove edits.new during startup rather than renaming it to edits. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1955](https://issues.apache.org/jira/browse/HADOOP-1955) | Corrupted block replication retries for ever | Blocker | . | Koji Noguchi | Raghu Angadi |
+| [HADOOP-1961](https://issues.apache.org/jira/browse/HADOOP-1961) | -get, -copyToLocal fail when single filename is passed | Blocker | . | Koji Noguchi | Raghu Angadi |
+| [HADOOP-1997](https://issues.apache.org/jira/browse/HADOOP-1997) | TestCheckpoint fails on Windows | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.3/CHANGES.0.14.3.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.3/CHANGES.0.14.3.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.3/CHANGES.0.14.3.md
index e418744..77e2811 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.3/CHANGES.0.14.3.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.3/CHANGES.0.14.3.md
@@ -20,55 +20,15 @@
## Release 0.14.3 - 2007-10-19
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-2072](https://issues.apache.org/jira/browse/HADOOP-2072) | RawLocalFileStatus is causing Path problems | Major | fs | Dennis Kubes | |
+| [HADOOP-2036](https://issues.apache.org/jira/browse/HADOOP-2036) | NPE in JvmMetrics.doThreadUpdates | Blocker | metrics | Koji Noguchi | Nigel Daley |
| [HADOOP-2053](https://issues.apache.org/jira/browse/HADOOP-2053) | OutOfMemoryError : Java heap space errors in hadoop 0.14 | Blocker | . | Lohit Vijayarenu | Arun C Murthy |
| [HADOOP-2043](https://issues.apache.org/jira/browse/HADOOP-2043) | 0.14.2 release compiled with Java 1.6 instead of Java 1.5 | Blocker | build | Doug Cutting | Doug Cutting |
-| [HADOOP-2036](https://issues.apache.org/jira/browse/HADOOP-2036) | NPE in JvmMetrics.doThreadUpdates | Blocker | metrics | Koji Noguchi | Nigel Daley |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-2072](https://issues.apache.org/jira/browse/HADOOP-2072) | RawLocalFileStatus is causing Path problems | Major | fs | Dennis Kubes | |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.4/CHANGES.0.14.4.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.4/CHANGES.0.14.4.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.4/CHANGES.0.14.4.md
index f6bf9f1..a88d676 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.4/CHANGES.0.14.4.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.14.4/CHANGES.0.14.4.md
@@ -20,48 +20,14 @@
## Release 0.14.4 - 2007-11-26
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-2169](https://issues.apache.org/jira/browse/HADOOP-2169) | libhdfs makefile wrongly sets up DT\_SONAME field of libhdfs.so | Critical | . | Arun C Murthy | Arun C Murthy |
| [HADOOP-2001](https://issues.apache.org/jira/browse/HADOOP-2001) | Deadlock in jobtracker | Blocker | . | Michael Bieniosek | Arun C Murthy |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-2169](https://issues.apache.org/jira/browse/HADOOP-2169) | libhdfs makefile wrongly sets up DT\_SONAME field of libhdfs.so | Critical | . | Arun C Murthy | Arun C Murthy |
### OTHER:
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[42/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.4/CHANGES.0.18.4.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.4/CHANGES.0.18.4.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.4/CHANGES.0.18.4.md
index da4f4c1..6139716 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.4/CHANGES.0.18.4.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.18.4/CHANGES.0.18.4.md
@@ -18,44 +18,22 @@
-->
# Apache Hadoop Changelog
-## Release 0.18.4 - Unreleased (as of 2016-03-04)
+## Release 0.18.4 - Unreleased (as of 2017-08-28)
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-6017](https://issues.apache.org/jira/browse/HADOOP-6017) | NameNode and SecondaryNameNode fail to restart because of abnormal filenames. | Blocker | . | Raghu Angadi | Tsz Wo Nicholas Sze |
-| [HADOOP-5644](https://issues.apache.org/jira/browse/HADOOP-5644) | Namnode is stuck in safe mode | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-5557](https://issues.apache.org/jira/browse/HADOOP-5557) | Two minor problems in TestOverReplicatedBlocks | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-5465](https://issues.apache.org/jira/browse/HADOOP-5465) | Blocks remain under-replicated | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5412](https://issues.apache.org/jira/browse/HADOOP-5412) | TestInjectionForSimulatedStorage occasionally fails on timeout | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5311](https://issues.apache.org/jira/browse/HADOOP-5311) | Write pipeline recovery fails | Blocker | . | Hairong Kuang | dhruba borthakur |
| [HADOOP-5192](https://issues.apache.org/jira/browse/HADOOP-5192) | Block reciever should not remove a finalized block when block replication fails | Blocker | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-5134](https://issues.apache.org/jira/browse/HADOOP-5134) | FSNamesystem#commitBlockSynchronization adds under-construction block locations to blocksMap | Blocker | . | Hairong Kuang | dhruba borthakur |
+| [HADOOP-5412](https://issues.apache.org/jira/browse/HADOOP-5412) | TestInjectionForSimulatedStorage occasionally fails on timeout | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5311](https://issues.apache.org/jira/browse/HADOOP-5311) | Write pipeline recovery fails | Blocker | . | Hairong Kuang | dhruba borthakur |
+| [HADOOP-5465](https://issues.apache.org/jira/browse/HADOOP-5465) | Blocks remain under-replicated | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5557](https://issues.apache.org/jira/browse/HADOOP-5557) | Two minor problems in TestOverReplicatedBlocks | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-5644](https://issues.apache.org/jira/browse/HADOOP-5644) | Namnode is stuck in safe mode | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-6017](https://issues.apache.org/jira/browse/HADOOP-6017) | NameNode and SecondaryNameNode fail to restart because of abnormal filenames. | Blocker | . | Raghu Angadi | Tsz Wo Nicholas Sze |
### TESTS:
@@ -65,15 +43,3 @@
| [HADOOP-5114](https://issues.apache.org/jira/browse/HADOOP-5114) | A bunch of mapred unit tests are failing on Windows | Minor | test | Ramya Sunil | Raghu Angadi |
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[37/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.0/RELEASENOTES.0.20.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.0/RELEASENOTES.0.20.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.0/RELEASENOTES.0.20.0.md
index 4e13959..55f65c0 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.0/RELEASENOTES.0.20.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.0/RELEASENOTES.0.20.0.md
@@ -23,325 +23,325 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-5565](https://issues.apache.org/jira/browse/HADOOP-5565) | *Major* | **The job instrumentation API needs to have a method for finalizeJob,**
+* [HADOOP-4234](https://issues.apache.org/jira/browse/HADOOP-4234) | *Minor* | **KFS: Allow KFS layer to interface with multiple KFS namenodes**
-Add finalizeJob & terminateJob methods to JobTrackerInstrumentation class
+Changed KFS glue layer to allow applications to interface with multiple KFS metaservers.
---
-* [HADOOP-5548](https://issues.apache.org/jira/browse/HADOOP-5548) | *Blocker* | **Observed negative running maps on the job tracker**
+* [HADOOP-4210](https://issues.apache.org/jira/browse/HADOOP-4210) | *Major* | **Findbugs warnings are printed related to equals implementation of several classes**
-Adds synchronization for JobTracker methods in RecoveryManager.
+Changed public class org.apache.hadoop.mapreduce.ID to be an abstract class. Removed from class org.apache.hadoop.mapreduce.ID the methods public static ID read(DataInput in) and public static ID forName(String str).
---
-* [HADOOP-5531](https://issues.apache.org/jira/browse/HADOOP-5531) | *Blocker* | **Remove Chukwa on branch-0.20**
+* [HADOOP-4253](https://issues.apache.org/jira/browse/HADOOP-4253) | *Major* | **Fix warnings generated by FindBugs**
-Disabled Chukwa unit tests for 0.20 branch only.
+Removed from class org.apache.hadoop.fs.RawLocalFileSystem deprecated methods public String getName(), public void lock(Path p, boolean shared) and public void release(Path p).
---
-* [HADOOP-5521](https://issues.apache.org/jira/browse/HADOOP-5521) | *Major* | **Remove dependency of testcases on RESTART\_COUNT**
+* [HADOOP-4284](https://issues.apache.org/jira/browse/HADOOP-4284) | *Major* | **Support for user configurable global filters on HttpServer**
-This patch makes TestJobHistory and its dependent testcases independent of RESTART\_COUNT.
+Introduced HttpServer method to support global filters.
---
-* [HADOOP-5468](https://issues.apache.org/jira/browse/HADOOP-5468) | *Major* | **Change Hadoop doc menu to sub-menus**
+* [HADOOP-4454](https://issues.apache.org/jira/browse/HADOOP-4454) | *Minor* | **Support comments in 'slaves' file**
-Reformatted HTML documentation for Hadoop to use submenus at the left column.
+Changed processing of conf/slaves file to allow # to begin a comment.
---
-* [HADOOP-5030](https://issues.apache.org/jira/browse/HADOOP-5030) | *Major* | **Chukwa RPM build improvements**
+* [HADOOP-4572](https://issues.apache.org/jira/browse/HADOOP-4572) | *Major* | **INode and its sub-classes should be package private**
-Changed RPM install location to the value specified by build.properties file.
+Moved org.apache.hadoop.hdfs.{CreateEditsLog, NNThroughputBenchmark} to org.apache.hadoop.hdfs.server.namenode.
---
-* [HADOOP-4970](https://issues.apache.org/jira/browse/HADOOP-4970) | *Major* | **Use the full path when move files to .Trash/Current**
+* [HADOOP-4575](https://issues.apache.org/jira/browse/HADOOP-4575) | *Major* | **An independent HTTPS proxy for HDFS**
-Changed trash facility to use absolute path of the deleted file.
+Introduced independent HSFTP proxy server for authenticated access to clusters.
---
-* [HADOOP-4873](https://issues.apache.org/jira/browse/HADOOP-4873) | *Major* | **display minMaps/Reduces on advanced scheduler page**
+* [HADOOP-4618](https://issues.apache.org/jira/browse/HADOOP-4618) | *Major* | **Move http server from FSNamesystem into NameNode.**
-Changed fair scheduler UI to display minMaps and minReduces variables.
+Moved HTTP server from FSNameSystem to NameNode. Removed FSNamesystem.getNameNodeInfoPort(). Replaced FSNamesystem.getDFSNameNodeMachine() and FSNamesystem.getDFSNameNodePort() with new method FSNamesystem.getDFSNameNodeAddress(). Removed constructor NameNode(bindAddress, conf).
---
-* [HADOOP-4843](https://issues.apache.org/jira/browse/HADOOP-4843) | *Major* | **Collect Job History log file and Job Conf file into Chukwa**
+* [HADOOP-4567](https://issues.apache.org/jira/browse/HADOOP-4567) | *Major* | **GetFileBlockLocations should return the NetworkTopology information of the machines that hosts those blocks**
-Introduced Chuckwa collection of job history.
+Changed GetFileBlockLocations to return topology information for nodes that host the block replicas.
---
-* [HADOOP-4827](https://issues.apache.org/jira/browse/HADOOP-4827) | *Major* | **Improve data aggregation in database**
+* [HADOOP-4435](https://issues.apache.org/jira/browse/HADOOP-4435) | *Minor* | **The JobTracker should display the amount of heap memory used**
-Improved framework for data aggregation in Chuckwa.
+Changed JobTracker web status page to display the amount of heap memory in use. This changes the JobSubmissionProtocol.
---
-* [HADOOP-4826](https://issues.apache.org/jira/browse/HADOOP-4826) | *Major* | **Admin command saveNamespace.**
+* [HADOOP-3923](https://issues.apache.org/jira/browse/HADOOP-3923) | *Minor* | **Deprecate org.apache.hadoop.mapred.StatusHttpServer**
-Introduced new dfsadmin command saveNamespace to command the name service to do an immediate save of the file system image.
+Moved class org.apache.hadoop.mapred.StatusHttpServer to org.apache.hadoop.http.HttpServer.
---
-* [HADOOP-4789](https://issues.apache.org/jira/browse/HADOOP-4789) | *Minor* | **Change fair scheduler to share between pools by default, not between invidual jobs**
+* [HADOOP-4188](https://issues.apache.org/jira/browse/HADOOP-4188) | *Major* | **Remove Task's dependency on concrete file systems**
-Changed fair scheduler to divide resources equally between pools, not jobs.
+Removed Task's dependency on concrete file systems by taking list from FileSystem class. Added statistics table to FileSystem class. Deprecated FileSystem method getStatistics(Class\<? extends FileSystem\> cls).
---
-* [HADOOP-4783](https://issues.apache.org/jira/browse/HADOOP-4783) | *Blocker* | **History files are given world readable permissions.**
+* [HADOOP-4661](https://issues.apache.org/jira/browse/HADOOP-4661) | *Major* | **distch: a tool for distributed ch{mod,own}**
-Changed history directory permissions to 750 and history file permissions to 740.
+Introduced distch tool for parallel ch{mod, own, grp}.
---
-* [HADOOP-4749](https://issues.apache.org/jira/browse/HADOOP-4749) | *Major* | **reducer should output input data size when shuffling is done**
+* [HADOOP-1650](https://issues.apache.org/jira/browse/HADOOP-1650) | *Major* | **Upgrade Jetty to 6.x**
-Added a new counter REDUCE\_INPUT\_BYTES.
+Upgraded all core servers to use Jetty 6
---
-* [HADOOP-4661](https://issues.apache.org/jira/browse/HADOOP-4661) | *Major* | **distch: a tool for distributed ch{mod,own}**
+* [HADOOP-3986](https://issues.apache.org/jira/browse/HADOOP-3986) | *Major* | **JobClient should not have a static configuration**
-Introduced distch tool for parallel ch{mod, own, grp}.
+Removed classes org.apache.hadoop.mapred.JobShell and org.apache.hadoop.mapred.TestJobShell. Removed from JobClient methods static void setCommandLineConfig(Configuration conf) and public static Configuration getCommandLineConfig().
---
-* [HADOOP-4631](https://issues.apache.org/jira/browse/HADOOP-4631) | *Major* | **Split the default configurations into 3 parts**
+* [HADOOP-4422](https://issues.apache.org/jira/browse/HADOOP-4422) | *Major* | **S3 file systems should not create bucket**
-Split hadoop-default.xml into core-default.xml, hdfs-default.xml and mapreduce-default.xml.
+Modified Hadoop file system to no longer create S3 buckets. Applications can create buckets for their S3 file systems by other means, for example, using the JetS3t API.
---
-* [HADOOP-4618](https://issues.apache.org/jira/browse/HADOOP-4618) | *Major* | **Move http server from FSNamesystem into NameNode.**
+* [HADOOP-3422](https://issues.apache.org/jira/browse/HADOOP-3422) | *Major* | **Ganglia counter metrics are all reported with the metric name "value", so the counter values can not be seen**
-Moved HTTP server from FSNameSystem to NameNode. Removed FSNamesystem.getNameNodeInfoPort(). Replaced FSNamesystem.getDFSNameNodeMachine() and FSNamesystem.getDFSNameNodePort() with new method FSNamesystem.getDFSNameNodeAddress(). Removed constructor NameNode(bindAddress, conf).
+Changed names of ganglia metrics to avoid conflicts and to better identify source function.
---
-* [HADOOP-4576](https://issues.apache.org/jira/browse/HADOOP-4576) | *Major* | **Modify pending tasks count in the UI to pending jobs count in the UI**
+* [HADOOP-4035](https://issues.apache.org/jira/browse/HADOOP-4035) | *Blocker* | **Modify the capacity scheduler (HADOOP-3445) to schedule tasks based on memory requirements and task trackers free memory**
-Changed capacity scheduler UI to better present number of running and pending tasks.
+Changed capacity scheduler policy to take note of task memory requirements and task tracker memory availability.
---
-* [HADOOP-4575](https://issues.apache.org/jira/browse/HADOOP-4575) | *Major* | **An independent HTTPS proxy for HDFS**
+* [HADOOP-3750](https://issues.apache.org/jira/browse/HADOOP-3750) | *Major* | **Fix and enforce module dependencies**
-Introduced independent HSFTP proxy server for authenticated access to clusters.
+Removed deprecated method parseArgs from org.apache.hadoop.fs.FileSystem.
---
-* [HADOOP-4572](https://issues.apache.org/jira/browse/HADOOP-4572) | *Major* | **INode and its sub-classes should be package private**
+* [HADOOP-3497](https://issues.apache.org/jira/browse/HADOOP-3497) | *Major* | **File globbing with a PathFilter is too restrictive**
-Moved org.apache.hadoop.hdfs.{CreateEditsLog, NNThroughputBenchmark} to org.apache.hadoop.hdfs.server.namenode.
+Changed the semantics of file globbing with a PathFilter (using the globStatus method of FileSystem). Previously, the filtering was too restrictive, so that a glob of /\*/\* and a filter that only accepts /a/b would not have matched /a/b. With this change /a/b does match.
---
-* [HADOOP-4567](https://issues.apache.org/jira/browse/HADOOP-4567) | *Major* | **GetFileBlockLocations should return the NetworkTopology information of the machines that hosts those blocks**
+* [HADOOP-4576](https://issues.apache.org/jira/browse/HADOOP-4576) | *Major* | **Modify pending tasks count in the UI to pending jobs count in the UI**
-Changed GetFileBlockLocations to return topology information for nodes that host the block replicas.
+Changed capacity scheduler UI to better present number of running and pending tasks.
---
-* [HADOOP-4565](https://issues.apache.org/jira/browse/HADOOP-4565) | *Major* | **MultiFileInputSplit can use data locality information to create splits**
+* [HADOOP-4305](https://issues.apache.org/jira/browse/HADOOP-4305) | *Major* | **repeatedly blacklisted tasktrackers should get declared dead**
-Improved MultiFileInputFormat so that multiple blocks from the same node or same rack can be combined into a single split.
+Improved TaskTracker blacklisting strategy to better exclude faulty tracker from executing tasks.
---
-* [HADOOP-4454](https://issues.apache.org/jira/browse/HADOOP-4454) | *Minor* | **Support comments in 'slaves' file**
+* [HADOOP-4445](https://issues.apache.org/jira/browse/HADOOP-4445) | *Major* | **Wrong number of running map/reduce tasks are displayed in queue information.**
-Changed processing of conf/slaves file to allow # to begin a comment.
+Changed JobTracker UI to better present the number of active tasks.
---
-* [HADOOP-4445](https://issues.apache.org/jira/browse/HADOOP-4445) | *Major* | **Wrong number of running map/reduce tasks are displayed in queue information.**
+* [HADOOP-4179](https://issues.apache.org/jira/browse/HADOOP-4179) | *Major* | **Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs**
-Changed JobTracker UI to better present the number of active tasks.
+Introduced Vaidya rule based performance diagnostic tool for Map/Reduce jobs.
---
-* [HADOOP-4435](https://issues.apache.org/jira/browse/HADOOP-4435) | *Minor* | **The JobTracker should display the amount of heap memory used**
+* [HADOOP-4029](https://issues.apache.org/jira/browse/HADOOP-4029) | *Major* | **NameNode should report status and performance for each replica of image and log**
-Changed JobTracker web status page to display the amount of heap memory in use. This changes the JobSubmissionProtocol.
+Added name node storage information to the dfshealth page, and moved data node information to a separated page.
---
-* [HADOOP-4422](https://issues.apache.org/jira/browse/HADOOP-4422) | *Major* | **S3 file systems should not create bucket**
+* [HADOOP-4749](https://issues.apache.org/jira/browse/HADOOP-4749) | *Major* | **reducer should output input data size when shuffling is done**
-Modified Hadoop file system to no longer create S3 buckets. Applications can create buckets for their S3 file systems by other means, for example, using the JetS3t API.
+Added a new counter REDUCE\_INPUT\_BYTES.
---
-* [HADOOP-4374](https://issues.apache.org/jira/browse/HADOOP-4374) | *Major* | **JVM should not be killed but given an opportunity to exit gracefully**
+* [HADOOP-4826](https://issues.apache.org/jira/browse/HADOOP-4826) | *Major* | **Admin command saveNamespace.**
-This patch (1) Adds a shutdownHook that does syncLogs sothat logs of the current task are flushed and log.index is up to date in cases like System.exit(), or killed using signals(other than SIGKILL).
-(2) Changes writeToIndexFile() to write to a temporary index file first and then rename to log.index sothat updates to log.index file are atomic.
+Introduced new dfsadmin command saveNamespace to command the name service to do an immediate save of the file system image.
---
-* [HADOOP-4305](https://issues.apache.org/jira/browse/HADOOP-4305) | *Major* | **repeatedly blacklisted tasktrackers should get declared dead**
+* [HADOOP-3063](https://issues.apache.org/jira/browse/HADOOP-3063) | *Major* | **BloomMapFile - fail-fast version of MapFile for sparsely populated key space**
-Improved TaskTracker blacklisting strategy to better exclude faulty tracker from executing tasks.
+Introduced BloomMapFile subclass of MapFile that creates a Bloom filter from all keys.
---
-* [HADOOP-4284](https://issues.apache.org/jira/browse/HADOOP-4284) | *Major* | **Support for user configurable global filters on HttpServer**
+* [HADOOP-1230](https://issues.apache.org/jira/browse/HADOOP-1230) | *Major* | **Replace parameters with context objects in Mapper, Reducer, Partitioner, InputFormat, and OutputFormat classes**
-Introduced HttpServer method to support global filters.
+Replaced parameters with context obejcts in Mapper, Reducer, Partitioner, InputFormat, and OutputFormat classes.
---
-* [HADOOP-4253](https://issues.apache.org/jira/browse/HADOOP-4253) | *Major* | **Fix warnings generated by FindBugs**
+* [HADOOP-4631](https://issues.apache.org/jira/browse/HADOOP-4631) | *Major* | **Split the default configurations into 3 parts**
-Removed from class org.apache.hadoop.fs.RawLocalFileSystem deprecated methods public String getName(), public void lock(Path p, boolean shared) and public void release(Path p).
+Split hadoop-default.xml into core-default.xml, hdfs-default.xml and mapreduce-default.xml.
---
-* [HADOOP-4234](https://issues.apache.org/jira/browse/HADOOP-4234) | *Minor* | **KFS: Allow KFS layer to interface with multiple KFS namenodes**
+* [HADOOP-3344](https://issues.apache.org/jira/browse/HADOOP-3344) | *Major* | **libhdfs: always builds 32bit, even when x86\_64 Java used**
-Changed KFS glue layer to allow applications to interface with multiple KFS metaservers.
+Changed build procedure for libhdfs to build correctly for different platforms. Build instructions are in the Jira item.
---
-* [HADOOP-4210](https://issues.apache.org/jira/browse/HADOOP-4210) | *Major* | **Findbugs warnings are printed related to equals implementation of several classes**
+* [HADOOP-4827](https://issues.apache.org/jira/browse/HADOOP-4827) | *Major* | **Improve data aggregation in database**
-Changed public class org.apache.hadoop.mapreduce.ID to be an abstract class. Removed from class org.apache.hadoop.mapreduce.ID the methods public static ID read(DataInput in) and public static ID forName(String str).
+Improved framework for data aggregation in Chuckwa.
---
-* [HADOOP-4188](https://issues.apache.org/jira/browse/HADOOP-4188) | *Major* | **Remove Task's dependency on concrete file systems**
+* [HADOOP-4789](https://issues.apache.org/jira/browse/HADOOP-4789) | *Minor* | **Change fair scheduler to share between pools by default, not between invidual jobs**
-Removed Task's dependency on concrete file systems by taking list from FileSystem class. Added statistics table to FileSystem class. Deprecated FileSystem method getStatistics(Class\<? extends FileSystem\> cls).
+Changed fair scheduler to divide resources equally between pools, not jobs.
---
-* [HADOOP-4179](https://issues.apache.org/jira/browse/HADOOP-4179) | *Major* | **Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs**
+* [HADOOP-4843](https://issues.apache.org/jira/browse/HADOOP-4843) | *Major* | **Collect Job History log file and Job Conf file into Chukwa**
-Introduced Vaidya rule based performance diagnostic tool for Map/Reduce jobs.
+Introduced Chuckwa collection of job history.
---
-* [HADOOP-4103](https://issues.apache.org/jira/browse/HADOOP-4103) | *Major* | **Alert for missing blocks**
+* [HADOOP-5030](https://issues.apache.org/jira/browse/HADOOP-5030) | *Major* | **Chukwa RPM build improvements**
-Modified dfsadmin -report to report under replicated blocks. blocks with corrupt replicas, and missing blocks".
+Changed RPM install location to the value specified by build.properties file.
---
-* [HADOOP-4035](https://issues.apache.org/jira/browse/HADOOP-4035) | *Blocker* | **Modify the capacity scheduler (HADOOP-3445) to schedule tasks based on memory requirements and task trackers free memory**
+* [HADOOP-4970](https://issues.apache.org/jira/browse/HADOOP-4970) | *Major* | **Use the full path when move files to .Trash/Current**
-Changed capacity scheduler policy to take note of task memory requirements and task tracker memory availability.
+Changed trash facility to use absolute path of the deleted file.
---
-* [HADOOP-4029](https://issues.apache.org/jira/browse/HADOOP-4029) | *Major* | **NameNode should report status and performance for each replica of image and log**
+* [HADOOP-4565](https://issues.apache.org/jira/browse/HADOOP-4565) | *Major* | **MultiFileInputSplit can use data locality information to create splits**
-Added name node storage information to the dfshealth page, and moved data node information to a separated page.
+Improved MultiFileInputFormat so that multiple blocks from the same node or same rack can be combined into a single split.
---
-* [HADOOP-3986](https://issues.apache.org/jira/browse/HADOOP-3986) | *Major* | **JobClient should not have a static configuration**
+* [HADOOP-4873](https://issues.apache.org/jira/browse/HADOOP-4873) | *Major* | **display minMaps/Reduces on advanced scheduler page**
-Removed classes org.apache.hadoop.mapred.JobShell and org.apache.hadoop.mapred.TestJobShell. Removed from JobClient methods static void setCommandLineConfig(Configuration conf) and public static Configuration getCommandLineConfig().
+Changed fair scheduler UI to display minMaps and minReduces variables.
---
-* [HADOOP-3923](https://issues.apache.org/jira/browse/HADOOP-3923) | *Minor* | **Deprecate org.apache.hadoop.mapred.StatusHttpServer**
+* [HADOOP-4103](https://issues.apache.org/jira/browse/HADOOP-4103) | *Major* | **Alert for missing blocks**
-Moved class org.apache.hadoop.mapred.StatusHttpServer to org.apache.hadoop.http.HttpServer.
+Modified dfsadmin -report to report under replicated blocks. blocks with corrupt replicas, and missing blocks".
---
-* [HADOOP-3750](https://issues.apache.org/jira/browse/HADOOP-3750) | *Major* | **Fix and enforce module dependencies**
+* [HADOOP-4783](https://issues.apache.org/jira/browse/HADOOP-4783) | *Blocker* | **History files are given world readable permissions.**
-Removed deprecated method parseArgs from org.apache.hadoop.fs.FileSystem.
+Changed history directory permissions to 750 and history file permissions to 740.
---
-* [HADOOP-3497](https://issues.apache.org/jira/browse/HADOOP-3497) | *Major* | **File globbing with a PathFilter is too restrictive**
+* [HADOOP-5521](https://issues.apache.org/jira/browse/HADOOP-5521) | *Major* | **Remove dependency of testcases on RESTART\_COUNT**
-Changed the semantics of file globbing with a PathFilter (using the globStatus method of FileSystem). Previously, the filtering was too restrictive, so that a glob of /\*/\* and a filter that only accepts /a/b would not have matched /a/b. With this change /a/b does match.
+This patch makes TestJobHistory and its dependent testcases independent of RESTART\_COUNT.
---
-* [HADOOP-3422](https://issues.apache.org/jira/browse/HADOOP-3422) | *Major* | **Ganglia counter metrics are all reported with the metric name "value", so the counter values can not be seen**
+* [HADOOP-5468](https://issues.apache.org/jira/browse/HADOOP-5468) | *Major* | **Change Hadoop doc menu to sub-menus**
-Changed names of ganglia metrics to avoid conflicts and to better identify source function.
+Reformatted HTML documentation for Hadoop to use submenus at the left column.
---
-* [HADOOP-3344](https://issues.apache.org/jira/browse/HADOOP-3344) | *Major* | **libhdfs: always builds 32bit, even when x86\_64 Java used**
+* [HADOOP-5531](https://issues.apache.org/jira/browse/HADOOP-5531) | *Blocker* | **Remove Chukwa on branch-0.20**
-Changed build procedure for libhdfs to build correctly for different platforms. Build instructions are in the Jira item.
+Disabled Chukwa unit tests for 0.20 branch only.
---
-* [HADOOP-3063](https://issues.apache.org/jira/browse/HADOOP-3063) | *Major* | **BloomMapFile - fail-fast version of MapFile for sparsely populated key space**
+* [HADOOP-5565](https://issues.apache.org/jira/browse/HADOOP-5565) | *Major* | **The job instrumentation API needs to have a method for finalizeJob,**
-Introduced BloomMapFile subclass of MapFile that creates a Bloom filter from all keys.
+Add finalizeJob & terminateJob methods to JobTrackerInstrumentation class
---
-* [HADOOP-1650](https://issues.apache.org/jira/browse/HADOOP-1650) | *Major* | **Upgrade Jetty to 6.x**
+* [HADOOP-4374](https://issues.apache.org/jira/browse/HADOOP-4374) | *Major* | **JVM should not be killed but given an opportunity to exit gracefully**
-Upgraded all core servers to use Jetty 6
+This patch (1) Adds a shutdownHook that does syncLogs sothat logs of the current task are flushed and log.index is up to date in cases like System.exit(), or killed using signals(other than SIGKILL).
+(2) Changes writeToIndexFile() to write to a temporary index file first and then rename to log.index sothat updates to log.index file are atomic.
---
-* [HADOOP-1230](https://issues.apache.org/jira/browse/HADOOP-1230) | *Major* | **Replace parameters with context objects in Mapper, Reducer, Partitioner, InputFormat, and OutputFormat classes**
+* [HADOOP-5548](https://issues.apache.org/jira/browse/HADOOP-5548) | *Blocker* | **Observed negative running maps on the job tracker**
-Replaced parameters with context obejcts in Mapper, Reducer, Partitioner, InputFormat, and OutputFormat classes.
+Adds synchronization for JobTracker methods in RecoveryManager.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.1/CHANGES.0.20.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.1/CHANGES.0.20.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.1/CHANGES.0.20.1.md
index 45ca0d7..ceccdf5 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.1/CHANGES.0.20.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.1/CHANGES.0.20.1.md
@@ -24,110 +24,98 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-5881](https://issues.apache.org/jira/browse/HADOOP-5881) | Simplify configuration related to task-memory-monitoring and memory-based scheduling | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
| [HADOOP-5726](https://issues.apache.org/jira/browse/HADOOP-5726) | Remove pre-emption from the capacity scheduler code base | Major | . | Hemanth Yamijala | rahul k singh |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-5881](https://issues.apache.org/jira/browse/HADOOP-5881) | Simplify configuration related to task-memory-monitoring and memory-based scheduling | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-6080](https://issues.apache.org/jira/browse/HADOOP-6080) | Handling of Trash with quota | Major | fs | Koji Noguchi | Jakob Homan |
| [HADOOP-5714](https://issues.apache.org/jira/browse/HADOOP-5714) | Metric to show number of fs.exists (or number of getFileInfo) calls | Minor | metrics | Koji Noguchi | Jakob Homan |
| [HADOOP-3315](https://issues.apache.org/jira/browse/HADOOP-3315) | New binary file format | Major | io | Owen O'Malley | Hong Tang |
+| [HADOOP-6080](https://issues.apache.org/jira/browse/HADOOP-6080) | Handling of Trash with quota | Major | fs | Koji Noguchi | Jakob Homan |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HDFS-635](https://issues.apache.org/jira/browse/HDFS-635) | HDFS Project page does not show 0.20.1 documentation/release information. | Major | documentation | Andy Sautins | |
+| [MAPREDUCE-465](https://issues.apache.org/jira/browse/MAPREDUCE-465) | Deprecate org.apache.hadoop.mapred.lib.MultithreadedMapRunner | Minor | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
| [HDFS-527](https://issues.apache.org/jira/browse/HDFS-527) | Refactor DFSClient constructors | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [MAPREDUCE-767](https://issues.apache.org/jira/browse/MAPREDUCE-767) | to remove mapreduce dependency on commons-cli2 | Major | contrib/streaming | Giridharan Kesavan | Amar Kamat |
-| [MAPREDUCE-465](https://issues.apache.org/jira/browse/MAPREDUCE-465) | Deprecate org.apache.hadoop.mapred.lib.MultithreadedMapRunner | Minor | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HDFS-635](https://issues.apache.org/jira/browse/HDFS-635) | HDFS Project page does not show 0.20.1 documentation/release information. | Major | documentation | Andy Sautins | |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-6215](https://issues.apache.org/jira/browse/HADOOP-6215) | fix GenericOptionParser to deal with -D with '=' in the value | Major | . | Owen O'Malley | Amar Kamat |
-| [HADOOP-6145](https://issues.apache.org/jira/browse/HADOOP-6145) | No error message for deleting non-existant file or directory. | Major | fs | Suman Sehgal | Jakob Homan |
-| [HADOOP-6141](https://issues.apache.org/jira/browse/HADOOP-6141) | hadoop 0.20 branch "test-patch" is broken | Major | build | Hong Tang | Hong Tang |
-| [HADOOP-6139](https://issues.apache.org/jira/browse/HADOOP-6139) | Incomplete help message is displayed for rm and rmr options. | Minor | . | Suman Sehgal | Jakob Homan |
-| [HADOOP-6017](https://issues.apache.org/jira/browse/HADOOP-6017) | NameNode and SecondaryNameNode fail to restart because of abnormal filenames. | Blocker | . | Raghu Angadi | Tsz Wo Nicholas Sze |
-| [HADOOP-5951](https://issues.apache.org/jira/browse/HADOOP-5951) | StorageInfo needs Apache license header. | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-5937](https://issues.apache.org/jira/browse/HADOOP-5937) | Correct info message "Use hadoop dfs -safemode option" to " Use hdfs dfsadmin -safemode option" . | Minor | . | Ravi Phulari | Ravi Phulari |
-| [HADOOP-5932](https://issues.apache.org/jira/browse/HADOOP-5932) | MemoryMatcher logs 0 as freeMemOnTT even though there are free slots available on TaskTraker | Major | . | Karam Singh | Vinod Kumar Vavilapalli |
-| [HADOOP-5924](https://issues.apache.org/jira/browse/HADOOP-5924) | JT fails to recover the jobs after restart after HADOOP:4372 | Major | . | Ramya Sunil | Amar Kamat |
-| [HADOOP-5921](https://issues.apache.org/jira/browse/HADOOP-5921) | JobTracker does not come up because of NotReplicatedYetException | Major | . | Amareshwari Sriramadasu | Amar Kamat |
-| [HADOOP-5920](https://issues.apache.org/jira/browse/HADOOP-5920) | TestJobHistory fails some times. | Major | . | Amareshwari Sriramadasu | Amar Kamat |
-| [HADOOP-5908](https://issues.apache.org/jira/browse/HADOOP-5908) | ArithmeticException in heartbeats with zero map jobs | Major | . | Vinod Kumar Vavilapalli | Amar Kamat |
-| [HADOOP-5884](https://issues.apache.org/jira/browse/HADOOP-5884) | Capacity scheduler should account high memory jobs as using more capacity of the queue | Major | . | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-| [HADOOP-5883](https://issues.apache.org/jira/browse/HADOOP-5883) | TaskMemoryMonitorThread might shoot down tasks even if their processes momentarily exceed the requested memory | Major | . | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-5882](https://issues.apache.org/jira/browse/HADOOP-5882) | Progress is not updated when the New Reducer is running reduce phase | Blocker | . | Jothi Padmanabhan | Amareshwari Sriramadasu |
-| [HADOOP-5850](https://issues.apache.org/jira/browse/HADOOP-5850) | map/reduce doesn't run jobs with 0 maps | Critical | . | Owen O'Malley | Vinod Kumar Vavilapalli |
-| [HADOOP-5828](https://issues.apache.org/jira/browse/HADOOP-5828) | Use absolute path for JobTracker's mapred.local.dir in MiniMRCluster | Major | test | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-5746](https://issues.apache.org/jira/browse/HADOOP-5746) | Errors encountered in MROutputThread after the last map/reduce call can go undetected | Major | . | Devaraj Das | Amar Kamat |
-| [HADOOP-5736](https://issues.apache.org/jira/browse/HADOOP-5736) | Update CapacityScheduler documentation to reflect latest changes | Major | . | Sreekanth Ramakrishnan | Sreekanth Ramakrishnan |
-| [HADOOP-5719](https://issues.apache.org/jira/browse/HADOOP-5719) | Jobs failed during job initalization are never removed from Capacity Schedulers waiting list | Major | . | Sreekanth Ramakrishnan | Sreekanth Ramakrishnan |
-| [HADOOP-5718](https://issues.apache.org/jira/browse/HADOOP-5718) | Capacity Scheduler should not check for presence of default queue while starting up. | Major | . | Sreekanth Ramakrishnan | Sreekanth Ramakrishnan |
-| [HADOOP-5711](https://issues.apache.org/jira/browse/HADOOP-5711) | Change Namenode file close log to info | Minor | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-5691](https://issues.apache.org/jira/browse/HADOOP-5691) | org.apache.hadoop.mapreduce.Reducer should not be abstract. | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-5688](https://issues.apache.org/jira/browse/HADOOP-5688) | HftpFileSystem.getChecksum(..) does not work for the paths with scheme and authority | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-5655](https://issues.apache.org/jira/browse/HADOOP-5655) | TestMRServerPorts fails on java.net.BindException | Major | . | Hairong Kuang | Devaraj Das |
+| [HADOOP-5210](https://issues.apache.org/jira/browse/HADOOP-5210) | Reduce Task Progress shows \> 100% when the total size of map outputs (for a single reducer) is high | Minor | . | Jothi Padmanabhan | Ravi Gummadi |
| [HADOOP-5654](https://issues.apache.org/jira/browse/HADOOP-5654) | TestReplicationPolicy.\<init\> fails on java.net.BindException | Major | test | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5648](https://issues.apache.org/jira/browse/HADOOP-5648) | Not able to generate gridmix.jar on already compiled version of hadoop | Major | benchmarks | Suman Sehgal | Giridharan Kesavan |
-| [HADOOP-5646](https://issues.apache.org/jira/browse/HADOOP-5646) | TestQueueCapacities is failing Hudson tests for the last few builds | Major | . | Jothi Padmanabhan | Vinod Kumar Vavilapalli |
-| [HADOOP-5641](https://issues.apache.org/jira/browse/HADOOP-5641) | Possible NPE in CapacityScheduler's MemoryMatcher | Major | . | Vinod Kumar Vavilapalli | Hemanth Yamijala |
-| [HADOOP-5636](https://issues.apache.org/jira/browse/HADOOP-5636) | Job is left in Running state after a killJob | Critical | . | Amareshwari Sriramadasu | Amar Kamat |
-| [HADOOP-5539](https://issues.apache.org/jira/browse/HADOOP-5539) | o.a.h.mapred.Merger not maintaining map out compression on intermediate files | Blocker | . | Billy Pearson | Jothi Padmanabhan |
+| [HADOOP-5655](https://issues.apache.org/jira/browse/HADOOP-5655) | TestMRServerPorts fails on java.net.BindException | Major | . | Hairong Kuang | Devaraj Das |
| [HADOOP-5533](https://issues.apache.org/jira/browse/HADOOP-5533) | Recovery duration shown on the jobtracker webpage is inaccurate | Major | . | Amar Kamat | Amar Kamat |
-| [HADOOP-5349](https://issues.apache.org/jira/browse/HADOOP-5349) | When the size required for a path is -1, LocalDirAllocator.getLocalPathForWrite fails with a DiskCheckerException when the disk it selects is bad. | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [HADOOP-5213](https://issues.apache.org/jira/browse/HADOOP-5213) | BZip2CompressionOutputStream NullPointerException | Blocker | io | Zheng Shao | Zheng Shao |
-| [HADOOP-5210](https://issues.apache.org/jira/browse/HADOOP-5210) | Reduce Task Progress shows \> 100% when the total size of map outputs (for a single reducer) is high | Minor | . | Jothi Padmanabhan | Ravi Gummadi |
+| [HADOOP-5646](https://issues.apache.org/jira/browse/HADOOP-5646) | TestQueueCapacities is failing Hudson tests for the last few builds | Major | . | Jothi Padmanabhan | Vinod Kumar Vavilapalli |
+| [HADOOP-5691](https://issues.apache.org/jira/browse/HADOOP-5691) | org.apache.hadoop.mapreduce.Reducer should not be abstract. | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-5688](https://issues.apache.org/jira/browse/HADOOP-5688) | HftpFileSystem.getChecksum(..) does not work for the paths with scheme and authority | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-4674](https://issues.apache.org/jira/browse/HADOOP-4674) | hadoop fs -help should list detailed help info for the following commands: test, text, tail, stat & touchz | Trivial | fs | David NeSmith | Ravi Phulari |
+| [HADOOP-5711](https://issues.apache.org/jira/browse/HADOOP-5711) | Change Namenode file close log to info | Minor | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-5213](https://issues.apache.org/jira/browse/HADOOP-5213) | BZip2CompressionOutputStream NullPointerException | Blocker | io | Zheng Shao | Zheng Shao |
+| [HADOOP-5736](https://issues.apache.org/jira/browse/HADOOP-5736) | Update CapacityScheduler documentation to reflect latest changes | Major | . | Sreekanth Ramakrishnan | Sreekanth Ramakrishnan |
+| [HADOOP-5718](https://issues.apache.org/jira/browse/HADOOP-5718) | Capacity Scheduler should not check for presence of default queue while starting up. | Major | . | Sreekanth Ramakrishnan | Sreekanth Ramakrishnan |
+| [HADOOP-5719](https://issues.apache.org/jira/browse/HADOOP-5719) | Jobs failed during job initalization are never removed from Capacity Schedulers waiting list | Major | . | Sreekanth Ramakrishnan | Sreekanth Ramakrishnan |
+| [HADOOP-5349](https://issues.apache.org/jira/browse/HADOOP-5349) | When the size required for a path is -1, LocalDirAllocator.getLocalPathForWrite fails with a DiskCheckerException when the disk it selects is bad. | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [HADOOP-5636](https://issues.apache.org/jira/browse/HADOOP-5636) | Job is left in Running state after a killJob | Critical | . | Amareshwari Sriramadasu | Amar Kamat |
+| [HADOOP-5641](https://issues.apache.org/jira/browse/HADOOP-5641) | Possible NPE in CapacityScheduler's MemoryMatcher | Major | . | Vinod Kumar Vavilapalli | Hemanth Yamijala |
+| [HADOOP-5828](https://issues.apache.org/jira/browse/HADOOP-5828) | Use absolute path for JobTracker's mapred.local.dir in MiniMRCluster | Major | test | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-5850](https://issues.apache.org/jira/browse/HADOOP-5850) | map/reduce doesn't run jobs with 0 maps | Critical | . | Owen O'Malley | Vinod Kumar Vavilapalli |
| [HADOOP-4626](https://issues.apache.org/jira/browse/HADOOP-4626) | API link in forrest doc should point to the same version of hadoop. | Minor | documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1022](https://issues.apache.org/jira/browse/HDFS-1022) | Merge under-10-min tests specs into one file | Major | test | Erik Steffl | Erik Steffl |
-| [HDFS-525](https://issues.apache.org/jira/browse/HDFS-525) | ListPathsServlet.java uses static SimpleDateFormat that has threading issues | Major | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-438](https://issues.apache.org/jira/browse/HDFS-438) | Improve help message for quotas | Minor | . | Raghu Angadi | Raghu Angadi |
-| [HDFS-167](https://issues.apache.org/jira/browse/HDFS-167) | DFSClient continues to retry indefinitely | Minor | hdfs-client | Derek Wollenstein | Bill Zeller |
+| [HADOOP-5883](https://issues.apache.org/jira/browse/HADOOP-5883) | TaskMemoryMonitorThread might shoot down tasks even if their processes momentarily exceed the requested memory | Major | . | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-5539](https://issues.apache.org/jira/browse/HADOOP-5539) | o.a.h.mapred.Merger not maintaining map out compression on intermediate files | Blocker | . | Billy Pearson | Jothi Padmanabhan |
+| [HADOOP-5932](https://issues.apache.org/jira/browse/HADOOP-5932) | MemoryMatcher logs 0 as freeMemOnTT even though there are free slots available on TaskTraker | Major | . | Karam Singh | Vinod Kumar Vavilapalli |
+| [HADOOP-5951](https://issues.apache.org/jira/browse/HADOOP-5951) | StorageInfo needs Apache license header. | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-5648](https://issues.apache.org/jira/browse/HADOOP-5648) | Not able to generate gridmix.jar on already compiled version of hadoop | Major | benchmarks | Suman Sehgal | Giridharan Kesavan |
+| [HADOOP-5908](https://issues.apache.org/jira/browse/HADOOP-5908) | ArithmeticException in heartbeats with zero map jobs | Major | . | Vinod Kumar Vavilapalli | Amar Kamat |
+| [HADOOP-5924](https://issues.apache.org/jira/browse/HADOOP-5924) | JT fails to recover the jobs after restart after HADOOP:4372 | Major | . | Ramya Sunil | Amar Kamat |
+| [HADOOP-5882](https://issues.apache.org/jira/browse/HADOOP-5882) | Progress is not updated when the New Reducer is running reduce phase | Blocker | . | Jothi Padmanabhan | Amareshwari Sriramadasu |
+| [HADOOP-5746](https://issues.apache.org/jira/browse/HADOOP-5746) | Errors encountered in MROutputThread after the last map/reduce call can go undetected | Major | . | Devaraj Das | Amar Kamat |
+| [HADOOP-5884](https://issues.apache.org/jira/browse/HADOOP-5884) | Capacity scheduler should account high memory jobs as using more capacity of the queue | Major | . | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-5937](https://issues.apache.org/jira/browse/HADOOP-5937) | Correct info message "Use hadoop dfs -safemode option" to " Use hdfs dfsadmin -safemode option" . | Minor | . | Ravi Phulari | Ravi Phulari |
+| [HADOOP-5921](https://issues.apache.org/jira/browse/HADOOP-5921) | JobTracker does not come up because of NotReplicatedYetException | Major | . | Amareshwari Sriramadasu | Amar Kamat |
+| [HADOOP-6017](https://issues.apache.org/jira/browse/HADOOP-6017) | NameNode and SecondaryNameNode fail to restart because of abnormal filenames. | Blocker | . | Raghu Angadi | Tsz Wo Nicholas Sze |
+| [HADOOP-5920](https://issues.apache.org/jira/browse/HADOOP-5920) | TestJobHistory fails some times. | Major | . | Amareshwari Sriramadasu | Amar Kamat |
| [HDFS-26](https://issues.apache.org/jira/browse/HDFS-26) | HADOOP-5862 for version .20 (Namespace quota exceeded message unclear) | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [MAPREDUCE-924](https://issues.apache.org/jira/browse/MAPREDUCE-924) | TestPipes must not directly invoke 'main' of pipes as an exit from main could cause the testcase to crash. | Major | pipes | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [MAPREDUCE-911](https://issues.apache.org/jira/browse/MAPREDUCE-911) | TestTaskFail fail sometimes | Major | test | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HDFS-438](https://issues.apache.org/jira/browse/HDFS-438) | Improve help message for quotas | Minor | . | Raghu Angadi | Raghu Angadi |
+| [MAPREDUCE-2](https://issues.apache.org/jira/browse/MAPREDUCE-2) | ArrayOutOfIndex error in KeyFieldBasedPartitioner on empty key | Major | . | Amar Kamat | Amar Kamat |
+| [MAPREDUCE-130](https://issues.apache.org/jira/browse/MAPREDUCE-130) | Delete the jobconf copy from the log directory of the JobTracker when the job is retired | Major | . | Devaraj Das | Amar Kamat |
+| [MAPREDUCE-657](https://issues.apache.org/jira/browse/MAPREDUCE-657) | CompletedJobStatusStore hardcodes filesystem to hdfs | Major | jobtracker | Amar Kamat | Amar Kamat |
+| [MAPREDUCE-179](https://issues.apache.org/jira/browse/MAPREDUCE-179) | setProgress not called for new RecordReaders | Blocker | . | Chris Douglas | Chris Douglas |
+| [MAPREDUCE-124](https://issues.apache.org/jira/browse/MAPREDUCE-124) | When abortTask of OutputCommitter fails with an Exception for a map-only job, the task is marked as success | Major | . | Jothi Padmanabhan | Amareshwari Sriramadasu |
+| [HADOOP-6139](https://issues.apache.org/jira/browse/HADOOP-6139) | Incomplete help message is displayed for rm and rmr options. | Minor | . | Suman Sehgal | Jakob Homan |
+| [HADOOP-6141](https://issues.apache.org/jira/browse/HADOOP-6141) | hadoop 0.20 branch "test-patch" is broken | Major | build | Hong Tang | Hong Tang |
+| [HADOOP-6145](https://issues.apache.org/jira/browse/HADOOP-6145) | No error message for deleting non-existant file or directory. | Major | fs | Suman Sehgal | Jakob Homan |
+| [MAPREDUCE-565](https://issues.apache.org/jira/browse/MAPREDUCE-565) | Partitioner does not work with new API | Blocker | task | Jothi Padmanabhan | Owen O'Malley |
+| [MAPREDUCE-18](https://issues.apache.org/jira/browse/MAPREDUCE-18) | Under load the shuffle sometimes gets incorrect data | Blocker | . | Owen O'Malley | Ravi Gummadi |
+| [MAPREDUCE-735](https://issues.apache.org/jira/browse/MAPREDUCE-735) | ArrayIndexOutOfBoundsException is thrown by KeyFieldBasedPartitioner | Major | . | Suman Sehgal | Amar Kamat |
+| [MAPREDUCE-383](https://issues.apache.org/jira/browse/MAPREDUCE-383) | pipes combiner does not reset properly after a spill | Major | . | Christian Kunz | Christian Kunz |
+| [MAPREDUCE-40](https://issues.apache.org/jira/browse/MAPREDUCE-40) | Memory management variables need a backwards compatibility option after HADOOP-5881 | Blocker | . | Hemanth Yamijala | rahul k singh |
+| [MAPREDUCE-796](https://issues.apache.org/jira/browse/MAPREDUCE-796) | Encountered "ClassCastException" on tasktracker while running wordcount with MultithreadedMapRunner | Major | examples | Suman Sehgal | Amar Kamat |
| [MAPREDUCE-838](https://issues.apache.org/jira/browse/MAPREDUCE-838) | Task succeeds even when committer.commitTask fails with IOException | Blocker | task | Koji Noguchi | Amareshwari Sriramadasu |
-| [MAPREDUCE-834](https://issues.apache.org/jira/browse/MAPREDUCE-834) | When TaskTracker config use old memory management values its memory monitoring is diabled. | Major | . | Karam Singh | Sreekanth Ramakrishnan |
+| [MAPREDUCE-805](https://issues.apache.org/jira/browse/MAPREDUCE-805) | Deadlock in Jobtracker | Major | . | Michael Tamm | Amar Kamat |
+| [HDFS-167](https://issues.apache.org/jira/browse/HDFS-167) | DFSClient continues to retry indefinitely | Minor | hdfs-client | Derek Wollenstein | Bill Zeller |
| [MAPREDUCE-832](https://issues.apache.org/jira/browse/MAPREDUCE-832) | Too many WARN messages about deprecated memorty config variables in JobTacker log | Major | . | Karam Singh | rahul k singh |
+| [MAPREDUCE-745](https://issues.apache.org/jira/browse/MAPREDUCE-745) | TestRecoveryManager fails sometimes | Major | jobtracker | Amareshwari Sriramadasu | Amar Kamat |
+| [MAPREDUCE-834](https://issues.apache.org/jira/browse/MAPREDUCE-834) | When TaskTracker config use old memory management values its memory monitoring is diabled. | Major | . | Karam Singh | Sreekanth Ramakrishnan |
| [MAPREDUCE-818](https://issues.apache.org/jira/browse/MAPREDUCE-818) | org.apache.hadoop.mapreduce.Counters.getGroup returns null if the group name doesnt exist. | Minor | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
| [MAPREDUCE-807](https://issues.apache.org/jira/browse/MAPREDUCE-807) | Stray user files in mapred.system.dir with permissions other than 777 can prevent the jobtracker from starting up. | Blocker | jobtracker | Amar Kamat | Amar Kamat |
-| [MAPREDUCE-805](https://issues.apache.org/jira/browse/MAPREDUCE-805) | Deadlock in Jobtracker | Major | . | Michael Tamm | Amar Kamat |
-| [MAPREDUCE-796](https://issues.apache.org/jira/browse/MAPREDUCE-796) | Encountered "ClassCastException" on tasktracker while running wordcount with MultithreadedMapRunner | Major | examples | Suman Sehgal | Amar Kamat |
-| [MAPREDUCE-745](https://issues.apache.org/jira/browse/MAPREDUCE-745) | TestRecoveryManager fails sometimes | Major | jobtracker | Amareshwari Sriramadasu | Amar Kamat |
-| [MAPREDUCE-735](https://issues.apache.org/jira/browse/MAPREDUCE-735) | ArrayIndexOutOfBoundsException is thrown by KeyFieldBasedPartitioner | Major | . | Suman Sehgal | Amar Kamat |
-| [MAPREDUCE-687](https://issues.apache.org/jira/browse/MAPREDUCE-687) | TestMiniMRMapRedDebugScript fails sometimes | Major | test | Amar Kamat | Amareshwari Sriramadasu |
-| [MAPREDUCE-657](https://issues.apache.org/jira/browse/MAPREDUCE-657) | CompletedJobStatusStore hardcodes filesystem to hdfs | Major | jobtracker | Amar Kamat | Amar Kamat |
-| [MAPREDUCE-565](https://issues.apache.org/jira/browse/MAPREDUCE-565) | Partitioner does not work with new API | Blocker | task | Jothi Padmanabhan | Owen O'Malley |
| [MAPREDUCE-430](https://issues.apache.org/jira/browse/MAPREDUCE-430) | Task stuck in cleanup with OutOfMemoryErrors | Major | . | Amareshwari Sriramadasu | Amar Kamat |
+| [HADOOP-6215](https://issues.apache.org/jira/browse/HADOOP-6215) | fix GenericOptionParser to deal with -D with '=' in the value | Major | . | Owen O'Malley | Amar Kamat |
| [MAPREDUCE-421](https://issues.apache.org/jira/browse/MAPREDUCE-421) | mapred pipes might return exit code 0 even when failing | Major | pipes | Christian Kunz | Christian Kunz |
-| [MAPREDUCE-383](https://issues.apache.org/jira/browse/MAPREDUCE-383) | pipes combiner does not reset properly after a spill | Major | . | Christian Kunz | Christian Kunz |
-| [MAPREDUCE-179](https://issues.apache.org/jira/browse/MAPREDUCE-179) | setProgress not called for new RecordReaders | Blocker | . | Chris Douglas | Chris Douglas |
-| [MAPREDUCE-130](https://issues.apache.org/jira/browse/MAPREDUCE-130) | Delete the jobconf copy from the log directory of the JobTracker when the job is retired | Major | . | Devaraj Das | Amar Kamat |
-| [MAPREDUCE-124](https://issues.apache.org/jira/browse/MAPREDUCE-124) | When abortTask of OutputCommitter fails with an Exception for a map-only job, the task is marked as success | Major | . | Jothi Padmanabhan | Amareshwari Sriramadasu |
-| [MAPREDUCE-40](https://issues.apache.org/jira/browse/MAPREDUCE-40) | Memory management variables need a backwards compatibility option after HADOOP-5881 | Blocker | . | Hemanth Yamijala | rahul k singh |
-| [MAPREDUCE-18](https://issues.apache.org/jira/browse/MAPREDUCE-18) | Under load the shuffle sometimes gets incorrect data | Blocker | . | Owen O'Malley | Ravi Gummadi |
-| [MAPREDUCE-2](https://issues.apache.org/jira/browse/MAPREDUCE-2) | ArrayOutOfIndex error in KeyFieldBasedPartitioner on empty key | Major | . | Amar Kamat | Amar Kamat |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-525](https://issues.apache.org/jira/browse/HDFS-525) | ListPathsServlet.java uses static SimpleDateFormat that has threading issues | Major | namenode | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-911](https://issues.apache.org/jira/browse/MAPREDUCE-911) | TestTaskFail fail sometimes | Major | test | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [MAPREDUCE-687](https://issues.apache.org/jira/browse/MAPREDUCE-687) | TestMiniMRMapRedDebugScript fails sometimes | Major | test | Amar Kamat | Amareshwari Sriramadasu |
+| [MAPREDUCE-924](https://issues.apache.org/jira/browse/MAPREDUCE-924) | TestPipes must not directly invoke 'main' of pipes as an exit from main could cause the testcase to crash. | Major | pipes | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HDFS-1022](https://issues.apache.org/jira/browse/HDFS-1022) | Merge under-10-min tests specs into one file | Major | test | Erik Steffl | Erik Steffl |
### SUB-TASKS:
@@ -137,9 +125,3 @@
| [HADOOP-6213](https://issues.apache.org/jira/browse/HADOOP-6213) | Remove commons dependency on commons-cli2 | Blocker | util | Amar Kamat | Amar Kamat |
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.1/RELEASENOTES.0.20.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.1/RELEASENOTES.0.20.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.1/RELEASENOTES.0.20.1.md
index 953c100..cbc9762 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.1/RELEASENOTES.0.20.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.1/RELEASENOTES.0.20.1.md
@@ -23,37 +23,37 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-6213](https://issues.apache.org/jira/browse/HADOOP-6213) | *Blocker* | **Remove commons dependency on commons-cli2**
+* [HADOOP-5210](https://issues.apache.org/jira/browse/HADOOP-5210) | *Minor* | **Reduce Task Progress shows \> 100% when the total size of map outputs (for a single reducer) is high**
-GenericOptionsParser in branch 0.20 depends on commons-cli2. This jira removes the dependency of branch 0.20 on commons-cli2 completely. The problem is seen after 'ant binary' where all the library files are copied to '$hadoop-home/lib' which already has commons-cli2.
+This patch resets the variable totalBytesProcessed before the final merge sothat it will be used for calculating the progress of reducePhase(the 3rd phase of reduce task) correctly.
---
-* [HADOOP-6080](https://issues.apache.org/jira/browse/HADOOP-6080) | *Major* | **Handling of Trash with quota**
+* [HADOOP-5726](https://issues.apache.org/jira/browse/HADOOP-5726) | *Major* | **Remove pre-emption from the capacity scheduler code base**
-Provide a new option to rm and rmr, -skipTrash, which will immediately delete the files specified, rather than moving them to the trash.
+Removed pre-emption from capacity scheduler. The impact of this change is that capacities for queues can no longer be guaranteed within a given span of time. Also changed configuration variables to remove pre-emption related variables and better reflect the absence of guarantees.
---
-* [HADOOP-5924](https://issues.apache.org/jira/browse/HADOOP-5924) | *Major* | **JT fails to recover the jobs after restart after HADOOP:4372**
+* [HADOOP-5881](https://issues.apache.org/jira/browse/HADOOP-5881) | *Major* | **Simplify configuration related to task-memory-monitoring and memory-based scheduling**
-Post HADOOP-4372, empty job history files caused NPE. This issues fixes that by creating new files if no old file is found.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-5921](https://issues.apache.org/jira/browse/HADOOP-5921) | *Major* | **JobTracker does not come up because of NotReplicatedYetException**
+* [HADOOP-5924](https://issues.apache.org/jira/browse/HADOOP-5924) | *Major* | **JT fails to recover the jobs after restart after HADOOP:4372**
-Jobtracker crashes if it fails to create jobtracker.info file (i.e if sufficient datanodes are not up). With this patch it keeps on retrying on IOExceptions assuming IOExceptions in jobtracker.info creation implies that the hdfs is not in \*ready \*state.
+Post HADOOP-4372, empty job history files caused NPE. This issues fixes that by creating new files if no old file is found.
---
-* [HADOOP-5920](https://issues.apache.org/jira/browse/HADOOP-5920) | *Major* | **TestJobHistory fails some times.**
+* [HADOOP-5746](https://issues.apache.org/jira/browse/HADOOP-5746) | *Major* | **Errors encountered in MROutputThread after the last map/reduce call can go undetected**
-TestJobHistory fails as jobtracker is restarted very fast (within a minute) and history files from earlier testcases were not cleaned up. This patch cleans up the history-dir and mapred-system-dir after every test.
+If the child (streaming) process returns successfully and the MROutputThread throws an error, there was no way to detect that as all the IOExceptions was ignored. Such issues can occur when DFS clients were closed etc. Now a check for errors (in threads) is made before finishing off the task and an exception is thrown that fails he task.
---
@@ -66,153 +66,153 @@ take more slots proportionally with respect to a slot's default memory size.
---
-* [HADOOP-5881](https://issues.apache.org/jira/browse/HADOOP-5881) | *Major* | **Simplify configuration related to task-memory-monitoring and memory-based scheduling**
+* [HADOOP-5921](https://issues.apache.org/jira/browse/HADOOP-5921) | *Major* | **JobTracker does not come up because of NotReplicatedYetException**
-**WARNING: No release note provided for this incompatible change.**
+Jobtracker crashes if it fails to create jobtracker.info file (i.e if sufficient datanodes are not up). With this patch it keeps on retrying on IOExceptions assuming IOExceptions in jobtracker.info creation implies that the hdfs is not in \*ready \*state.
---
-* [HADOOP-5746](https://issues.apache.org/jira/browse/HADOOP-5746) | *Major* | **Errors encountered in MROutputThread after the last map/reduce call can go undetected**
+* [HADOOP-5920](https://issues.apache.org/jira/browse/HADOOP-5920) | *Major* | **TestJobHistory fails some times.**
-If the child (streaming) process returns successfully and the MROutputThread throws an error, there was no way to detect that as all the IOExceptions was ignored. Such issues can occur when DFS clients were closed etc. Now a check for errors (in threads) is made before finishing off the task and an exception is thrown that fails he task.
+TestJobHistory fails as jobtracker is restarted very fast (within a minute) and history files from earlier testcases were not cleaned up. This patch cleans up the history-dir and mapred-system-dir after every test.
---
-* [HADOOP-5726](https://issues.apache.org/jira/browse/HADOOP-5726) | *Major* | **Remove pre-emption from the capacity scheduler code base**
+* [HADOOP-3315](https://issues.apache.org/jira/browse/HADOOP-3315) | *Major* | **New binary file format**
-Removed pre-emption from capacity scheduler. The impact of this change is that capacities for queues can no longer be guaranteed within a given span of time. Also changed configuration variables to remove pre-emption related variables and better reflect the absence of guarantees.
+Add a new, binary file format TFile.
---
-* [HADOOP-5210](https://issues.apache.org/jira/browse/HADOOP-5210) | *Minor* | **Reduce Task Progress shows \> 100% when the total size of map outputs (for a single reducer) is high**
+* [MAPREDUCE-2](https://issues.apache.org/jira/browse/MAPREDUCE-2) | *Major* | **ArrayOutOfIndex error in KeyFieldBasedPartitioner on empty key**
-This patch resets the variable totalBytesProcessed before the final merge sothat it will be used for calculating the progress of reducePhase(the 3rd phase of reduce task) correctly.
+KeyFieldBasedPartitioner throws ArrayOutOfIndex when passed an empty key. This patch hashes empty key to 0 hashcode.
---
-* [HADOOP-3315](https://issues.apache.org/jira/browse/HADOOP-3315) | *Major* | **New binary file format**
+* [MAPREDUCE-130](https://issues.apache.org/jira/browse/MAPREDUCE-130) | *Major* | **Delete the jobconf copy from the log directory of the JobTracker when the job is retired**
-Add a new, binary file format TFile.
+When a job is initialized, it localizes the job conf to the logs dir. Without this patch I never gets deleted. Now when the job retires, the conf is deleted. This local copy is required to display on the webui.
---
-* [MAPREDUCE-838](https://issues.apache.org/jira/browse/MAPREDUCE-838) | *Blocker* | **Task succeeds even when committer.commitTask fails with IOException**
+* [MAPREDUCE-657](https://issues.apache.org/jira/browse/MAPREDUCE-657) | *Major* | **CompletedJobStatusStore hardcodes filesystem to hdfs**
-Fixed a bug in the way commit of task outputs happens. The bug was that if commit fails with IOException, the task would be declared as successful.
+CompletedJobStatusStore was hardcored to persist to hdfs. This patch allows to persist to local fs. Just qualify mapred.job.tracker.persist.jobstatus.dir with file://
---
-* [MAPREDUCE-834](https://issues.apache.org/jira/browse/MAPREDUCE-834) | *Major* | **When TaskTracker config use old memory management values its memory monitoring is diabled.**
+* [HADOOP-6080](https://issues.apache.org/jira/browse/HADOOP-6080) | *Major* | **Handling of Trash with quota**
-The tasktracker's startup code was modified to use deprecated memory management configuration variables, when specified, and enable memory monitoring of tasks.
+Provide a new option to rm and rmr, -skipTrash, which will immediately delete the files specified, rather than moving them to the trash.
---
-* [MAPREDUCE-832](https://issues.apache.org/jira/browse/MAPREDUCE-832) | *Major* | **Too many WARN messages about deprecated memorty config variables in JobTacker log**
+* [MAPREDUCE-18](https://issues.apache.org/jira/browse/MAPREDUCE-18) | *Blocker* | **Under load the shuffle sometimes gets incorrect data**
-Reduced the frequency of log messages printed when a deprecated memory management variable is found in configuration of a job.
+This patch adds the mapid and reduceid in the http header of mapoutput when being sent to reduce node. Also validates compressed length, decompressed length, mapid and reduceid from http header at reduce node.
---
-* [MAPREDUCE-818](https://issues.apache.org/jira/browse/MAPREDUCE-818) | *Minor* | **org.apache.hadoop.mapreduce.Counters.getGroup returns null if the group name doesnt exist.**
+* [MAPREDUCE-383](https://issues.apache.org/jira/browse/MAPREDUCE-383) | *Major* | **pipes combiner does not reset properly after a spill**
-Fixed a bug in the new org.apache.hadoop.mapreduce.Counters.getGroup() method to return an empty group if group name doesn't exist, instead of null, thus making sure that it is in sync with the Javadoc.
+Fixed a bug in Pipes combiner to reset the spilled bytes count after the spill.
---
-* [MAPREDUCE-807](https://issues.apache.org/jira/browse/MAPREDUCE-807) | *Blocker* | **Stray user files in mapred.system.dir with permissions other than 777 can prevent the jobtracker from starting up.**
+* [MAPREDUCE-40](https://issues.apache.org/jira/browse/MAPREDUCE-40) | *Blocker* | **Memory management variables need a backwards compatibility option after HADOOP-5881**
-The JobTracker tries to delete the mapred.system.dir when it is starting up (with the job recovery disabled). The fix provided by this jira is that JobTracker will fail (bail out) with AccessControlException if it fails to delete files/directories in mapred.system.dir due to access control issues.
+Fixed backwards compatibility by re-introducing and deprecating removed memory monitoring related configuration options.
---
-* [MAPREDUCE-805](https://issues.apache.org/jira/browse/MAPREDUCE-805) | *Major* | **Deadlock in Jobtracker**
-
-Job initialization process was changed to not change (run) states during initialization. The reason is two fold
-- this can lead to deadlock as state changes require circular locking (i.e JobInProgress requires JobTracker lock)
-- events were not raised as these state changes were not informed/propogated back to the JobTracker
+* [MAPREDUCE-796](https://issues.apache.org/jira/browse/MAPREDUCE-796) | *Major* | **Encountered "ClassCastException" on tasktracker while running wordcount with MultithreadedMapRunner**
-Now the JobTracker takes care of initializing/failing/killing the job and raising appropriate events. The simple rule that was enforced was that "The JobTracker lock is \*must\* before changing the run-state of a job".
+Multithreaded mapper was modified to create a new Runtime exception (object) from a throwable instead of casting a throwable into a RuntimeException, once the Multithreaded map encounters a fault.
---
-* [MAPREDUCE-796](https://issues.apache.org/jira/browse/MAPREDUCE-796) | *Major* | **Encountered "ClassCastException" on tasktracker while running wordcount with MultithreadedMapRunner**
+* [MAPREDUCE-838](https://issues.apache.org/jira/browse/MAPREDUCE-838) | *Blocker* | **Task succeeds even when committer.commitTask fails with IOException**
-Multithreaded mapper was modified to create a new Runtime exception (object) from a throwable instead of casting a throwable into a RuntimeException, once the Multithreaded map encounters a fault.
+Fixed a bug in the way commit of task outputs happens. The bug was that if commit fails with IOException, the task would be declared as successful.
---
-* [MAPREDUCE-767](https://issues.apache.org/jira/browse/MAPREDUCE-767) | *Major* | **to remove mapreduce dependency on commons-cli2**
+* [MAPREDUCE-805](https://issues.apache.org/jira/browse/MAPREDUCE-805) | *Major* | **Deadlock in Jobtracker**
-Removes the dependency of hadoop-mapred from commons-cli2 and uses commons-cli1.2 for command-line parsing.
+Job initialization process was changed to not change (run) states during initialization. The reason is two fold
+- this can lead to deadlock as state changes require circular locking (i.e JobInProgress requires JobTracker lock)
+- events were not raised as these state changes were not informed/propogated back to the JobTracker
+
+Now the JobTracker takes care of initializing/failing/killing the job and raising appropriate events. The simple rule that was enforced was that "The JobTracker lock is \*must\* before changing the run-state of a job".
---
-* [MAPREDUCE-745](https://issues.apache.org/jira/browse/MAPREDUCE-745) | *Major* | **TestRecoveryManager fails sometimes**
+* [MAPREDUCE-832](https://issues.apache.org/jira/browse/MAPREDUCE-832) | *Major* | **Too many WARN messages about deprecated memorty config variables in JobTacker log**
-JobTracker was changed to take an identifier as an argument. This helps in testcases where the jobtracker/mapred-cluster is (re)started in a short span of time and the chances of jobtracker identifier clashing are high. Also the RecoveryManager was modified to throw an exception if a job fails in init during the recovery process. The reason being that this event will trigger a job failure in the recovery process and will remove the failed job from further initialization and processing.
+Reduced the frequency of log messages printed when a deprecated memory management variable is found in configuration of a job.
---
-* [MAPREDUCE-657](https://issues.apache.org/jira/browse/MAPREDUCE-657) | *Major* | **CompletedJobStatusStore hardcodes filesystem to hdfs**
+* [MAPREDUCE-745](https://issues.apache.org/jira/browse/MAPREDUCE-745) | *Major* | **TestRecoveryManager fails sometimes**
-CompletedJobStatusStore was hardcored to persist to hdfs. This patch allows to persist to local fs. Just qualify mapred.job.tracker.persist.jobstatus.dir with file://
+JobTracker was changed to take an identifier as an argument. This helps in testcases where the jobtracker/mapred-cluster is (re)started in a short span of time and the chances of jobtracker identifier clashing are high. Also the RecoveryManager was modified to throw an exception if a job fails in init during the recovery process. The reason being that this event will trigger a job failure in the recovery process and will remove the failed job from further initialization and processing.
---
-* [MAPREDUCE-430](https://issues.apache.org/jira/browse/MAPREDUCE-430) | *Major* | **Task stuck in cleanup with OutOfMemoryErrors**
+* [MAPREDUCE-834](https://issues.apache.org/jira/browse/MAPREDUCE-834) | *Major* | **When TaskTracker config use old memory management values its memory monitoring is diabled.**
-Various code paths in the framework caught Throwable and tried to do inline cleanup. In case of OOM errors, such inline-cleanups can result into hung jvms. With this fix, the TaskTracker provides a api to report fatal errors (any throwable other than FSErrror and Exceptions). On catching a Throwable, Mapper/Reducer tries to inform the TT.
+The tasktracker's startup code was modified to use deprecated memory management configuration variables, when specified, and enable memory monitoring of tasks.
---
-* [MAPREDUCE-383](https://issues.apache.org/jira/browse/MAPREDUCE-383) | *Major* | **pipes combiner does not reset properly after a spill**
+* [MAPREDUCE-818](https://issues.apache.org/jira/browse/MAPREDUCE-818) | *Minor* | **org.apache.hadoop.mapreduce.Counters.getGroup returns null if the group name doesnt exist.**
-Fixed a bug in Pipes combiner to reset the spilled bytes count after the spill.
+Fixed a bug in the new org.apache.hadoop.mapreduce.Counters.getGroup() method to return an empty group if group name doesn't exist, instead of null, thus making sure that it is in sync with the Javadoc.
---
-* [MAPREDUCE-130](https://issues.apache.org/jira/browse/MAPREDUCE-130) | *Major* | **Delete the jobconf copy from the log directory of the JobTracker when the job is retired**
+* [MAPREDUCE-807](https://issues.apache.org/jira/browse/MAPREDUCE-807) | *Blocker* | **Stray user files in mapred.system.dir with permissions other than 777 can prevent the jobtracker from starting up.**
-When a job is initialized, it localizes the job conf to the logs dir. Without this patch I never gets deleted. Now when the job retires, the conf is deleted. This local copy is required to display on the webui.
+The JobTracker tries to delete the mapred.system.dir when it is starting up (with the job recovery disabled). The fix provided by this jira is that JobTracker will fail (bail out) with AccessControlException if it fails to delete files/directories in mapred.system.dir due to access control issues.
---
-* [MAPREDUCE-40](https://issues.apache.org/jira/browse/MAPREDUCE-40) | *Blocker* | **Memory management variables need a backwards compatibility option after HADOOP-5881**
+* [MAPREDUCE-767](https://issues.apache.org/jira/browse/MAPREDUCE-767) | *Major* | **to remove mapreduce dependency on commons-cli2**
-Fixed backwards compatibility by re-introducing and deprecating removed memory monitoring related configuration options.
+Removes the dependency of hadoop-mapred from commons-cli2 and uses commons-cli1.2 for command-line parsing.
---
-* [MAPREDUCE-18](https://issues.apache.org/jira/browse/MAPREDUCE-18) | *Blocker* | **Under load the shuffle sometimes gets incorrect data**
+* [HADOOP-6213](https://issues.apache.org/jira/browse/HADOOP-6213) | *Blocker* | **Remove commons dependency on commons-cli2**
-This patch adds the mapid and reduceid in the http header of mapoutput when being sent to reduce node. Also validates compressed length, decompressed length, mapid and reduceid from http header at reduce node.
+GenericOptionsParser in branch 0.20 depends on commons-cli2. This jira removes the dependency of branch 0.20 on commons-cli2 completely. The problem is seen after 'ant binary' where all the library files are copied to '$hadoop-home/lib' which already has commons-cli2.
---
-* [MAPREDUCE-2](https://issues.apache.org/jira/browse/MAPREDUCE-2) | *Major* | **ArrayOutOfIndex error in KeyFieldBasedPartitioner on empty key**
+* [MAPREDUCE-430](https://issues.apache.org/jira/browse/MAPREDUCE-430) | *Major* | **Task stuck in cleanup with OutOfMemoryErrors**
-KeyFieldBasedPartitioner throws ArrayOutOfIndex when passed an empty key. This patch hashes empty key to 0 hashcode.
+Various code paths in the framework caught Throwable and tried to do inline cleanup. In case of OOM errors, such inline-cleanups can result into hung jvms. With this fix, the TaskTracker provides a api to report fatal errors (any throwable other than FSErrror and Exceptions). On catching a Throwable, Mapper/Reducer tries to inform the TT.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.2/CHANGES.0.20.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.2/CHANGES.0.20.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.2/CHANGES.0.20.2.md
index 3ca5bdb..6a5151e 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.2/CHANGES.0.20.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.2/CHANGES.0.20.2.md
@@ -27,70 +27,58 @@
| [HDFS-793](https://issues.apache.org/jira/browse/HDFS-793) | DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet | Blocker | datanode | Hairong Kuang | Hairong Kuang |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1849](https://issues.apache.org/jira/browse/HADOOP-1849) | IPC server max queue size should be configurable | Major | ipc | Raghu Angadi | Konstantin Shvachko |
| [MAPREDUCE-623](https://issues.apache.org/jira/browse/MAPREDUCE-623) | Resolve javac warnings in mapred | Major | build | Jothi Padmanabhan | Jothi Padmanabhan |
+| [HADOOP-1849](https://issues.apache.org/jira/browse/HADOOP-1849) | IPC server max queue size should be configurable | Major | ipc | Raghu Angadi | Konstantin Shvachko |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-6576](https://issues.apache.org/jira/browse/HADOOP-6576) | TestStreamingStatus is failing on 0.20 branch | Major | . | Chris Douglas | Todd Lipcon |
-| [HADOOP-6575](https://issues.apache.org/jira/browse/HADOOP-6575) | Tests do not run on 0.20 branch | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-6524](https://issues.apache.org/jira/browse/HADOOP-6524) | Contrib tests are failing Clover'ed build | Major | build | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-6506](https://issues.apache.org/jira/browse/HADOOP-6506) | Failing tests prevent the rest of test targets from execution. | Major | build | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-6498](https://issues.apache.org/jira/browse/HADOOP-6498) | IPC client bug may cause rpc call hang | Blocker | ipc | Ruyue Ma | Ruyue Ma |
-| [HADOOP-6460](https://issues.apache.org/jira/browse/HADOOP-6460) | Namenode runs of out of memory due to memory leak in ipc Server | Blocker | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-6428](https://issues.apache.org/jira/browse/HADOOP-6428) | HttpServer sleeps with negative values | Major | . | Tsz Wo Nicholas Sze | Konstantin Boudnik |
-| [HADOOP-6315](https://issues.apache.org/jira/browse/HADOOP-6315) | GzipCodec should not represent BuiltInZlibInflater as decompressorType | Major | io | Aaron Kimball | Aaron Kimball |
-| [HADOOP-6269](https://issues.apache.org/jira/browse/HADOOP-6269) | Missing synchronization for defaultResources in Configuration.addResource | Major | conf | Todd Lipcon | Sreekanth Ramakrishnan |
+| [HADOOP-5759](https://issues.apache.org/jira/browse/HADOOP-5759) | IllegalArgumentException when CombineFileInputFormat is used as job InputFormat | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [MAPREDUCE-826](https://issues.apache.org/jira/browse/MAPREDUCE-826) | harchive doesn't use ToolRunner / harchive returns 0 even if the job fails with exception | Trivial | harchive | Koji Noguchi | Koji Noguchi |
+| [MAPREDUCE-112](https://issues.apache.org/jira/browse/MAPREDUCE-112) | Reduce Input Records and Reduce Output Records counters are not being set when using the new Mapreduce reducer API | Blocker | . | Jothi Padmanabhan | Jothi Padmanabhan |
| [HADOOP-6231](https://issues.apache.org/jira/browse/HADOOP-6231) | Allow caching of filesystem instances to be disabled on a per-instance basis | Major | fs | Tom White | Ben Slusky |
+| [MAPREDUCE-979](https://issues.apache.org/jira/browse/MAPREDUCE-979) | JobConf.getMemoryFor{Map\|Reduce}Task doesn't fallback to newer config knobs when mapred.taskmaxvmem is set to DISABLED\_MEMORY\_LIMIT of -1 | Blocker | jobtracker, tasktracker | Arun C Murthy | Sreekanth Ramakrishnan |
+| [HDFS-677](https://issues.apache.org/jira/browse/HDFS-677) | Rename failure due to quota results in deletion of src directory | Blocker | namenode | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-579](https://issues.apache.org/jira/browse/HDFS-579) | HADOOP-3792 update of DfsTask incomplete | Major | hdfs-client | Christian Kunz | Christian Kunz |
+| [MAPREDUCE-1070](https://issues.apache.org/jira/browse/MAPREDUCE-1070) | Deadlock in FairSchedulerServlet | Major | . | Todd Lipcon | Todd Lipcon |
| [HADOOP-6097](https://issues.apache.org/jira/browse/HADOOP-6097) | Multiple bugs w/ Hadoop archives | Major | fs | Ben Slusky | Ben Slusky |
-| [HADOOP-5759](https://issues.apache.org/jira/browse/HADOOP-5759) | IllegalArgumentException when CombineFileInputFormat is used as job InputFormat | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-5623](https://issues.apache.org/jira/browse/HADOOP-5623) | Streaming: process provided status messages are overwritten every 10 seoncds | Major | . | Rick Cox | Rick Cox |
-| [HADOOP-5612](https://issues.apache.org/jira/browse/HADOOP-5612) | Some c++ scripts are not chmodded before ant execution | Major | build | Todd Lipcon | Todd Lipcon |
-| [HADOOP-5611](https://issues.apache.org/jira/browse/HADOOP-5611) | C++ libraries do not build on Debian Lenny | Critical | . | Todd Lipcon | Todd Lipcon |
-| [HDFS-927](https://issues.apache.org/jira/browse/HDFS-927) | DFSInputStream retries too many times for new block locations | Critical | hdfs-client | Todd Lipcon | Todd Lipcon |
-| [HDFS-872](https://issues.apache.org/jira/browse/HDFS-872) | DFSClient 0.20.1 is incompatible with HDFS 0.20.2 | Major | datanode, hdfs-client | Bassam Tabbara | Todd Lipcon |
-| [HDFS-781](https://issues.apache.org/jira/browse/HDFS-781) | Metrics PendingDeletionBlocks is not decremented | Blocker | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-761](https://issues.apache.org/jira/browse/HDFS-761) | Failure to process rename operation from edits log due to quota verification | Major | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-745](https://issues.apache.org/jira/browse/HDFS-745) | TestFsck timeout on 0.20. | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-732](https://issues.apache.org/jira/browse/HDFS-732) | HDFS files are ending up truncated | Blocker | hdfs-client | Christian Kunz | Tsz Wo Nicholas Sze |
| [HDFS-723](https://issues.apache.org/jira/browse/HDFS-723) | Deadlock in DFSClient#DFSOutputStream | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HDFS-677](https://issues.apache.org/jira/browse/HDFS-677) | Rename failure due to quota results in deletion of src directory | Blocker | namenode | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-732](https://issues.apache.org/jira/browse/HDFS-732) | HDFS files are ending up truncated | Blocker | hdfs-client | Christian Kunz | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-1163](https://issues.apache.org/jira/browse/MAPREDUCE-1163) | hdfsJniHelper.h: Yahoo! specific paths are encoded | Trivial | . | Allen Wittenauer | Allen Wittenauer |
+| [HDFS-761](https://issues.apache.org/jira/browse/HDFS-761) | Failure to process rename operation from edits log due to quota verification | Major | namenode | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-1068](https://issues.apache.org/jira/browse/MAPREDUCE-1068) | In hadoop-0.20.0 streaming job do not throw proper verbose error message if file is not present | Major | contrib/streaming | Peeyush Bishnoi | Amareshwari Sriramadasu |
| [HDFS-596](https://issues.apache.org/jira/browse/HDFS-596) | Memory leak in libhdfs: hdfsFreeFileInfo() in libhdfs does not free memory for mOwner and mGroup | Blocker | fuse-dfs | Zhang Bingjun | Zhang Bingjun |
-| [HDFS-579](https://issues.apache.org/jira/browse/HDFS-579) | HADOOP-3792 update of DfsTask incomplete | Major | hdfs-client | Christian Kunz | Christian Kunz |
-| [HDFS-187](https://issues.apache.org/jira/browse/HDFS-187) | TestStartup fails if hdfs is running in the same machine | Major | test | Tsz Wo Nicholas Sze | Todd Lipcon |
+| [MAPREDUCE-1147](https://issues.apache.org/jira/browse/MAPREDUCE-1147) | Map output records counter missing for map-only jobs in new API | Blocker | . | Chris Douglas | Amar Kamat |
+| [HADOOP-6269](https://issues.apache.org/jira/browse/HADOOP-6269) | Missing synchronization for defaultResources in Configuration.addResource | Major | conf | Todd Lipcon | Sreekanth Ramakrishnan |
+| [MAPREDUCE-1182](https://issues.apache.org/jira/browse/MAPREDUCE-1182) | Reducers fail with OutOfMemoryError while copying Map outputs | Blocker | . | Chandra Prakash Bhagtani | Chandra Prakash Bhagtani |
+| [HDFS-781](https://issues.apache.org/jira/browse/HDFS-781) | Metrics PendingDeletionBlocks is not decremented | Blocker | namenode | Suresh Srinivas | Suresh Srinivas |
| [HDFS-185](https://issues.apache.org/jira/browse/HDFS-185) | Chown , chgrp , chmod operations allowed when namenode is in safemode . | Major | . | Ravi Phulari | Ravi Phulari |
+| [HADOOP-6428](https://issues.apache.org/jira/browse/HADOOP-6428) | HttpServer sleeps with negative values | Major | . | Tsz Wo Nicholas Sze | Konstantin Boudnik |
| [HDFS-101](https://issues.apache.org/jira/browse/HDFS-101) | DFS write pipeline : DFSClient sometimes does not detect second datanode failure | Blocker | datanode | Raghu Angadi | Hairong Kuang |
-| [MAPREDUCE-1251](https://issues.apache.org/jira/browse/MAPREDUCE-1251) | c++ utils doesn't compile | Major | . | Eli Collins | Eli Collins |
-| [MAPREDUCE-1182](https://issues.apache.org/jira/browse/MAPREDUCE-1182) | Reducers fail with OutOfMemoryError while copying Map outputs | Blocker | . | Chandra Prakash Bhagtani | Chandra Prakash Bhagtani |
-| [MAPREDUCE-1163](https://issues.apache.org/jira/browse/MAPREDUCE-1163) | hdfsJniHelper.h: Yahoo! specific paths are encoded | Trivial | . | Allen Wittenauer | Allen Wittenauer |
-| [MAPREDUCE-1147](https://issues.apache.org/jira/browse/MAPREDUCE-1147) | Map output records counter missing for map-only jobs in new API | Blocker | . | Chris Douglas | Amar Kamat |
-| [MAPREDUCE-1070](https://issues.apache.org/jira/browse/MAPREDUCE-1070) | Deadlock in FairSchedulerServlet | Major | . | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-1068](https://issues.apache.org/jira/browse/MAPREDUCE-1068) | In hadoop-0.20.0 streaming job do not throw proper verbose error message if file is not present | Major | contrib/streaming | Peeyush Bishnoi | Amareshwari Sriramadasu |
+| [HADOOP-6460](https://issues.apache.org/jira/browse/HADOOP-6460) | Namenode runs of out of memory due to memory leak in ipc Server | Blocker | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-5623](https://issues.apache.org/jira/browse/HADOOP-5623) | Streaming: process provided status messages are overwritten every 10 seoncds | Major | . | Rick Cox | Rick Cox |
+| [HADOOP-6315](https://issues.apache.org/jira/browse/HADOOP-6315) | GzipCodec should not represent BuiltInZlibInflater as decompressorType | Major | io | Aaron Kimball | Aaron Kimball |
+| [HDFS-187](https://issues.apache.org/jira/browse/HDFS-187) | TestStartup fails if hdfs is running in the same machine | Major | test | Tsz Wo Nicholas Sze | Todd Lipcon |
+| [HDFS-745](https://issues.apache.org/jira/browse/HDFS-745) | TestFsck timeout on 0.20. | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-433](https://issues.apache.org/jira/browse/MAPREDUCE-433) | TestReduceFetch failed. | Major | . | Tsz Wo Nicholas Sze | Chris Douglas |
+| [HADOOP-6498](https://issues.apache.org/jira/browse/HADOOP-6498) | IPC client bug may cause rpc call hang | Blocker | ipc | Ruyue Ma | Ruyue Ma |
+| [HDFS-872](https://issues.apache.org/jira/browse/HDFS-872) | DFSClient 0.20.1 is incompatible with HDFS 0.20.2 | Major | datanode, hdfs-client | Bassam Tabbara | Todd Lipcon |
| [MAPREDUCE-1010](https://issues.apache.org/jira/browse/MAPREDUCE-1010) | Adding tests for changes in archives. | Minor | harchive | Mahadev konar | Mahadev konar |
-| [MAPREDUCE-979](https://issues.apache.org/jira/browse/MAPREDUCE-979) | JobConf.getMemoryFor{Map\|Reduce}Task doesn't fallback to newer config knobs when mapred.taskmaxvmem is set to DISABLED\_MEMORY\_LIMIT of -1 | Blocker | jobtracker, tasktracker | Arun C Murthy | Sreekanth Ramakrishnan |
-| [MAPREDUCE-826](https://issues.apache.org/jira/browse/MAPREDUCE-826) | harchive doesn't use ToolRunner / harchive returns 0 even if the job fails with exception | Trivial | harchive | Koji Noguchi | Koji Noguchi |
+| [HADOOP-6506](https://issues.apache.org/jira/browse/HADOOP-6506) | Failing tests prevent the rest of test targets from execution. | Major | build | Konstantin Boudnik | Konstantin Boudnik |
+| [HADOOP-6524](https://issues.apache.org/jira/browse/HADOOP-6524) | Contrib tests are failing Clover'ed build | Major | build | Konstantin Boudnik | Konstantin Boudnik |
+| [HDFS-927](https://issues.apache.org/jira/browse/HDFS-927) | DFSInputStream retries too many times for new block locations | Critical | hdfs-client | Todd Lipcon | Todd Lipcon |
+| [HADOOP-5611](https://issues.apache.org/jira/browse/HADOOP-5611) | C++ libraries do not build on Debian Lenny | Critical | . | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-1251](https://issues.apache.org/jira/browse/MAPREDUCE-1251) | c++ utils doesn't compile | Major | . | Eli Collins | Eli Collins |
+| [HADOOP-5612](https://issues.apache.org/jira/browse/HADOOP-5612) | Some c++ scripts are not chmodded before ant execution | Major | build | Todd Lipcon | Todd Lipcon |
+| [HADOOP-6575](https://issues.apache.org/jira/browse/HADOOP-6575) | Tests do not run on 0.20 branch | Major | . | Chris Douglas | Chris Douglas |
+| [HADOOP-6576](https://issues.apache.org/jira/browse/HADOOP-6576) | TestStreamingStatus is failing on 0.20 branch | Major | . | Chris Douglas | Todd Lipcon |
| [MAPREDUCE-617](https://issues.apache.org/jira/browse/MAPREDUCE-617) | Streaming should not throw java.lang.RuntimeException and ERROR while displaying help | Minor | contrib/streaming | Karam Singh | |
-| [MAPREDUCE-433](https://issues.apache.org/jira/browse/MAPREDUCE-433) | TestReduceFetch failed. | Major | . | Tsz Wo Nicholas Sze | Chris Douglas |
-| [MAPREDUCE-112](https://issues.apache.org/jira/browse/MAPREDUCE-112) | Reduce Input Records and Reduce Output Records counters are not being set when using the new Mapreduce reducer API | Blocker | . | Jothi Padmanabhan | Jothi Padmanabhan |
### TESTS:
@@ -101,15 +89,3 @@
| [HDFS-907](https://issues.apache.org/jira/browse/HDFS-907) | Add tests for getBlockLocations and totalLoad metrics. | Minor | namenode | Ravi Phulari | Ravi Phulari |
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[10/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.0-beta/CHANGES.2.1.0-beta.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.0-beta/CHANGES.2.1.0-beta.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.0-beta/CHANGES.2.1.0-beta.md
index 192229f..3880304 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.0-beta/CHANGES.2.1.0-beta.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.1.0-beta/CHANGES.2.1.0-beta.md
@@ -24,895 +24,888 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9832](https://issues.apache.org/jira/browse/HADOOP-9832) | Add RPC header to client ping | Blocker | ipc | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9820](https://issues.apache.org/jira/browse/HADOOP-9820) | RPCv9 wire protocol is insufficient to support multiplexing | Blocker | ipc, security | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9698](https://issues.apache.org/jira/browse/HADOOP-9698) | RPCv9 client must honor server's SASL negotiate response | Blocker | ipc | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9683](https://issues.apache.org/jira/browse/HADOOP-9683) | Wrap IpcConnectionContext in RPC headers | Blocker | ipc | Luke Lu | Daryn Sharp |
-| [HADOOP-9649](https://issues.apache.org/jira/browse/HADOOP-9649) | Promote YARN service life-cycle libraries into Hadoop Common | Blocker | . | Zhijie Shen | Zhijie Shen |
-| [HADOOP-9630](https://issues.apache.org/jira/browse/HADOOP-9630) | Remove IpcSerializationType | Major | ipc | Luke Lu | Junping Du |
-| [HADOOP-9425](https://issues.apache.org/jira/browse/HADOOP-9425) | Add error codes to rpc-response | Major | ipc | Sanjay Radia | Sanjay Radia |
-| [HADOOP-9421](https://issues.apache.org/jira/browse/HADOOP-9421) | Convert SASL to use ProtoBuf and provide negotiation capabilities | Blocker | . | Sanjay Radia | Daryn Sharp |
-| [HADOOP-9380](https://issues.apache.org/jira/browse/HADOOP-9380) | Add totalLength to rpc response | Major | ipc | Sanjay Radia | Sanjay Radia |
-| [HADOOP-9194](https://issues.apache.org/jira/browse/HADOOP-9194) | RPC Support for QoS | Major | ipc | Luke Lu | Junping Du |
+| [HADOOP-8886](https://issues.apache.org/jira/browse/HADOOP-8886) | Remove KFS support | Major | fs | Eli Collins | Eli Collins |
| [HADOOP-9163](https://issues.apache.org/jira/browse/HADOOP-9163) | The rpc msg in ProtobufRpcEngine.proto should be moved out to avoid an extra copy | Major | ipc | Sanjay Radia | Sanjay Radia |
| [HADOOP-9151](https://issues.apache.org/jira/browse/HADOOP-9151) | Include RPC error info in RpcResponseHeader instead of sending it separately | Major | ipc | Sanjay Radia | Sanjay Radia |
-| [HADOOP-8886](https://issues.apache.org/jira/browse/HADOOP-8886) | Remove KFS support | Major | fs | Eli Collins | Eli Collins |
-| [HDFS-5083](https://issues.apache.org/jira/browse/HDFS-5083) | Update the HDFS compatibility version range | Blocker | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-4866](https://issues.apache.org/jira/browse/HDFS-4866) | Protocol buffer support cannot compile under C | Blocker | namenode | Ralph Castain | Arpit Agarwal |
+| [YARN-396](https://issues.apache.org/jira/browse/YARN-396) | Rationalize AllocateResponse in RM scheduler API | Major | . | Bikas Saha | Zhijie Shen |
+| [HADOOP-9380](https://issues.apache.org/jira/browse/HADOOP-9380) | Add totalLength to rpc response | Major | ipc | Sanjay Radia | Sanjay Radia |
+| [YARN-439](https://issues.apache.org/jira/browse/YARN-439) | Flatten NodeHeartbeatResponse | Major | . | Siddharth Seth | Xuan Gong |
+| [YARN-440](https://issues.apache.org/jira/browse/YARN-440) | Flatten RegisterNodeManagerResponse | Major | . | Siddharth Seth | Xuan Gong |
+| [HADOOP-9194](https://issues.apache.org/jira/browse/HADOOP-9194) | RPC Support for QoS | Major | ipc | Luke Lu | Junping Du |
+| [YARN-536](https://issues.apache.org/jira/browse/YARN-536) | Remove ContainerStatus, ContainerState from Container api interface as they will not be called by the container object | Major | . | Xuan Gong | Xuan Gong |
+| [YARN-561](https://issues.apache.org/jira/browse/YARN-561) | Nodemanager should set some key information into the environment of every container that it launches. | Major | . | Hitesh Shah | Xuan Gong |
+| [MAPREDUCE-4737](https://issues.apache.org/jira/browse/MAPREDUCE-4737) | Hadoop does not close output file / does not call Mapper.cleanup if exception in map | Major | . | Daniel Dai | Arun C Murthy |
+| [HDFS-4305](https://issues.apache.org/jira/browse/HDFS-4305) | Add a configurable limit on number of blocks per file, and min block size | Minor | namenode | Todd Lipcon | Andrew Wang |
+| [YARN-579](https://issues.apache.org/jira/browse/YARN-579) | Make ApplicationToken part of Container's token list to help RM-restart | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
| [HDFS-4659](https://issues.apache.org/jira/browse/HDFS-4659) | Support setting execution bit for regular files | Major | namenode | Brandon Li | Brandon Li |
| [HDFS-4434](https://issues.apache.org/jira/browse/HDFS-4434) | Provide a mapping from INodeId to INode | Major | namenode | Brandon Li | Suresh Srinivas |
-| [HDFS-4305](https://issues.apache.org/jira/browse/HDFS-4305) | Add a configurable limit on number of blocks per file, and min block size | Minor | namenode | Todd Lipcon | Andrew Wang |
-| [HDFS-2802](https://issues.apache.org/jira/browse/HDFS-2802) | Support for RW/RO snapshots in HDFS | Major | namenode | Hari Mankude | Tsz Wo Nicholas Sze |
-| [MAPREDUCE-5304](https://issues.apache.org/jira/browse/MAPREDUCE-5304) | mapreduce.Job killTask/failTask/getTaskCompletionEvents methods have incompatible signature changes | Blocker | . | Alejandro Abdelnur | Karthik Kambatla |
-| [MAPREDUCE-5300](https://issues.apache.org/jira/browse/MAPREDUCE-5300) | Two function signature changes in filecache.DistributedCache | Major | . | Zhijie Shen | Zhijie Shen |
-| [MAPREDUCE-5237](https://issues.apache.org/jira/browse/MAPREDUCE-5237) | ClusterStatus incompatiblity issues with MR1 | Major | . | Zhijie Shen | Zhijie Shen |
+| [HADOOP-9425](https://issues.apache.org/jira/browse/HADOOP-9425) | Add error codes to rpc-response | Major | ipc | Sanjay Radia | Sanjay Radia |
+| [YARN-629](https://issues.apache.org/jira/browse/YARN-629) | Make YarnRemoteException not be rooted at IOException | Major | . | Xuan Gong | Xuan Gong |
+| [YARN-633](https://issues.apache.org/jira/browse/YARN-633) | Change RMAdminProtocol api to throw IOException and YarnRemoteException | Major | . | Xuan Gong | Xuan Gong |
+| [YARN-632](https://issues.apache.org/jira/browse/YARN-632) | Change ContainerManager api to throw IOException and YarnRemoteException | Major | . | Xuan Gong | Xuan Gong |
+| [YARN-631](https://issues.apache.org/jira/browse/YARN-631) | Change ClientRMProtocol api to throw IOException and YarnRemoteException | Major | . | Xuan Gong | Xuan Gong |
+| [YARN-630](https://issues.apache.org/jira/browse/YARN-630) | Change AMRMProtocol api to throw IOException and YarnRemoteException | Major | . | Xuan Gong | Xuan Gong |
+| [MAPREDUCE-4067](https://issues.apache.org/jira/browse/MAPREDUCE-4067) | Replace YarnRemoteException with IOException in MRv2 APIs | Critical | . | Jitendra Nath Pandey | Xuan Gong |
+| [YARN-615](https://issues.apache.org/jira/browse/YARN-615) | ContainerLaunchContext.containerTokens should simply be called tokens | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
| [MAPREDUCE-5234](https://issues.apache.org/jira/browse/MAPREDUCE-5234) | Signature changes for getTaskId of TaskReport in mapred | Major | . | Zhijie Shen | Mayank Bansal |
+| [MAPREDUCE-5156](https://issues.apache.org/jira/browse/MAPREDUCE-5156) | Hadoop-examples-1.x.x.jar cannot run on Yarn | Blocker | . | Zhijie Shen | Zhijie Shen |
| [MAPREDUCE-5233](https://issues.apache.org/jira/browse/MAPREDUCE-5233) | Functions are changed or removed from Job in jobcontrol | Major | . | Zhijie Shen | Mayank Bansal |
+| [YARN-571](https://issues.apache.org/jira/browse/YARN-571) | User should not be part of ContainerLaunchContext | Major | . | Hitesh Shah | Omkar Vinit Joshi |
+| [MAPREDUCE-5237](https://issues.apache.org/jira/browse/MAPREDUCE-5237) | ClusterStatus incompatiblity issues with MR1 | Major | . | Zhijie Shen | Zhijie Shen |
+| [YARN-716](https://issues.apache.org/jira/browse/YARN-716) | Make ApplicationID immutable | Major | . | Siddharth Seth | Siddharth Seth |
+| [YARN-684](https://issues.apache.org/jira/browse/YARN-684) | ContainerManager.startContainer needs to only have ContainerTokenIdentifier instead of the whole Container | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
| [MAPREDUCE-5176](https://issues.apache.org/jira/browse/MAPREDUCE-5176) | Preemptable annotations (to support preemption in MR) | Major | mrv2 | Carlo Curino | Carlo Curino |
-| [MAPREDUCE-5156](https://issues.apache.org/jira/browse/MAPREDUCE-5156) | Hadoop-examples-1.x.x.jar cannot run on Yarn | Blocker | . | Zhijie Shen | Zhijie Shen |
+| [YARN-735](https://issues.apache.org/jira/browse/YARN-735) | Make ApplicationAttemptID, ContainerID, NodeID immutable | Major | . | Jian He | Jian He |
+| [YARN-749](https://issues.apache.org/jira/browse/YARN-749) | Rename ResourceRequest (get,set)HostName to (get,set)ResourceName | Major | . | Arun C Murthy | Arun C Murthy |
+| [YARN-720](https://issues.apache.org/jira/browse/YARN-720) | container-log4j.properties should not refer to mapreduce properties | Major | . | Siddharth Seth | Zhijie Shen |
+| [MAPREDUCE-5300](https://issues.apache.org/jira/browse/MAPREDUCE-5300) | Two function signature changes in filecache.DistributedCache | Major | . | Zhijie Shen | Zhijie Shen |
+| [YARN-748](https://issues.apache.org/jira/browse/YARN-748) | Move BuilderUtils from yarn-common to yarn-server-common | Major | . | Jian He | Jian He |
+| [YARN-635](https://issues.apache.org/jira/browse/YARN-635) | Rename YarnRemoteException to YarnException | Major | . | Xuan Gong | Siddharth Seth |
+| [YARN-755](https://issues.apache.org/jira/browse/YARN-755) | Rename AllocateResponse.reboot to AllocateResponse.resync | Major | . | Bikas Saha | Bikas Saha |
+| [YARN-756](https://issues.apache.org/jira/browse/YARN-756) | Move PreemptionContainer/PremptionContract/PreemptionMessage/StrictPreemptionContract/PreemptionResourceRequest to api.records | Major | . | Jian He | Jian He |
+| [YARN-753](https://issues.apache.org/jira/browse/YARN-753) | Add individual factory method for api protocol records | Major | . | Jian He | Jian He |
+| [YARN-724](https://issues.apache.org/jira/browse/YARN-724) | Move ProtoBase from api.records to api.records.impl.pb | Major | . | Jian He | Jian He |
+| [YARN-777](https://issues.apache.org/jira/browse/YARN-777) | Remove unreferenced objects from proto | Major | . | Jian He | Jian He |
+| [YARN-642](https://issues.apache.org/jira/browse/YARN-642) | Fix up /nodes REST API to have 1 param and be consistent with the Java API | Major | api, resourcemanager | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9630](https://issues.apache.org/jira/browse/HADOOP-9630) | Remove IpcSerializationType | Major | ipc | Luke Lu | Junping Du |
+| [MAPREDUCE-5304](https://issues.apache.org/jira/browse/MAPREDUCE-5304) | mapreduce.Job killTask/failTask/getTaskCompletionEvents methods have incompatible signature changes | Blocker | . | Alejandro Abdelnur | Karthik Kambatla |
+| [YARN-530](https://issues.apache.org/jira/browse/YARN-530) | Define Service model strictly, implement AbstractService for robust subclassing, migrate yarn-common services | Major | . | Steve Loughran | Steve Loughran |
+| [YARN-746](https://issues.apache.org/jira/browse/YARN-746) | rename Service.register() and Service.unregister() to registerServiceListener() & unregisterServiceListener() respectively | Major | . | Steve Loughran | Steve Loughran |
+| [YARN-792](https://issues.apache.org/jira/browse/YARN-792) | Move NodeHealthStatus from yarn.api.record to yarn.server.api.record | Major | . | Jian He | Jian He |
+| [YARN-806](https://issues.apache.org/jira/browse/YARN-806) | Move ContainerExitStatus from yarn.api to yarn.api.records | Major | . | Jian He | Jian He |
| [MAPREDUCE-4942](https://issues.apache.org/jira/browse/MAPREDUCE-4942) | mapreduce.Job has a bunch of methods that throw InterruptedException so its incompatible with MR1 | Major | mrv2 | Robert Kanter | Robert Kanter |
-| [MAPREDUCE-4737](https://issues.apache.org/jira/browse/MAPREDUCE-4737) | Hadoop does not close output file / does not call Mapper.cleanup if exception in map | Major | . | Daniel Dai | Arun C Murthy |
-| [MAPREDUCE-4067](https://issues.apache.org/jira/browse/MAPREDUCE-4067) | Replace YarnRemoteException with IOException in MRv2 APIs | Critical | . | Jitendra Nath Pandey | Xuan Gong |
-| [YARN-1056](https://issues.apache.org/jira/browse/YARN-1056) | Fix configs yarn.resourcemanager.resourcemanager.connect.{max.wait.secs\|retry\_interval.secs} | Trivial | . | Karthik Kambatla | Karthik Kambatla |
-| [YARN-926](https://issues.apache.org/jira/browse/YARN-926) | ContainerManagerProtcol APIs should take in requests for multiple containers | Blocker | . | Vinod Kumar Vavilapalli | Jian He |
-| [YARN-918](https://issues.apache.org/jira/browse/YARN-918) | ApplicationMasterProtocol doesn't need ApplicationAttemptId in the payload after YARN-701 | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [YARN-869](https://issues.apache.org/jira/browse/YARN-869) | ResourceManagerAdministrationProtocol should neither be public(yet) nor in yarn.api | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [YARN-851](https://issues.apache.org/jira/browse/YARN-851) | Share NMTokens using NMTokenCache (api-based) instead of memory based approach which is used currently. | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
-| [YARN-841](https://issues.apache.org/jira/browse/YARN-841) | Annotate and document AuxService APIs | Major | . | Siddharth Seth | Vinod Kumar Vavilapalli |
-| [YARN-840](https://issues.apache.org/jira/browse/YARN-840) | Move ProtoUtils to yarn.api.records.pb.impl | Major | . | Jian He | Jian He |
-| [YARN-837](https://issues.apache.org/jira/browse/YARN-837) | ClusterInfo.java doesn't seem to belong to org.apache.hadoop.yarn | Major | . | Zhijie Shen | Zhijie Shen |
-| [YARN-834](https://issues.apache.org/jira/browse/YARN-834) | Review/fix annotations for yarn-client module and clearly differentiate \*Async apis | Blocker | . | Arun C Murthy | Zhijie Shen |
-| [YARN-831](https://issues.apache.org/jira/browse/YARN-831) | Remove resource min from GetNewApplicationResponse | Blocker | . | Jian He | Jian He |
+| [HDFS-4866](https://issues.apache.org/jira/browse/HDFS-4866) | Protocol buffer support cannot compile under C | Blocker | namenode | Ralph Castain | Arpit Agarwal |
+| [YARN-821](https://issues.apache.org/jira/browse/YARN-821) | Rename FinishApplicationMasterRequest.setFinishApplicationStatus to setFinalApplicationStatus to be consistent with getter | Major | . | Jian He | Jian He |
+| [YARN-787](https://issues.apache.org/jira/browse/YARN-787) | Remove resource min from Yarn client API | Blocker | api | Alejandro Abdelnur | Alejandro Abdelnur |
| [YARN-829](https://issues.apache.org/jira/browse/YARN-829) | Rename RMTokenSelector to be RMDelegationTokenSelector | Major | . | Zhijie Shen | Zhijie Shen |
| [YARN-828](https://issues.apache.org/jira/browse/YARN-828) | Remove YarnVersionAnnotation | Major | . | Zhijie Shen | Zhijie Shen |
-| [YARN-826](https://issues.apache.org/jira/browse/YARN-826) | Move Clock/SystemClock to util package | Major | . | Zhijie Shen | Zhijie Shen |
-| [YARN-824](https://issues.apache.org/jira/browse/YARN-824) | Add static factory to yarn client lib interface and change it to abstract class | Major | . | Jian He | Jian He |
| [YARN-823](https://issues.apache.org/jira/browse/YARN-823) | Move RMAdmin from yarn.client to yarn.client.cli and rename as RMAdminCLI | Major | . | Jian He | Jian He |
+| [YARN-387](https://issues.apache.org/jira/browse/YARN-387) | Fix inconsistent protocol naming | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [YARN-831](https://issues.apache.org/jira/browse/YARN-831) | Remove resource min from GetNewApplicationResponse | Blocker | . | Jian He | Jian He |
+| [YARN-824](https://issues.apache.org/jira/browse/YARN-824) | Add static factory to yarn client lib interface and change it to abstract class | Major | . | Jian He | Jian He |
+| [YARN-826](https://issues.apache.org/jira/browse/YARN-826) | Move Clock/SystemClock to util package | Major | . | Zhijie Shen | Zhijie Shen |
+| [HADOOP-9649](https://issues.apache.org/jira/browse/HADOOP-9649) | Promote YARN service life-cycle libraries into Hadoop Common | Blocker | . | Zhijie Shen | Zhijie Shen |
+| [YARN-837](https://issues.apache.org/jira/browse/YARN-837) | ClusterInfo.java doesn't seem to belong to org.apache.hadoop.yarn | Major | . | Zhijie Shen | Zhijie Shen |
| [YARN-822](https://issues.apache.org/jira/browse/YARN-822) | Rename ApplicationToken to AMRMToken | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
-| [YARN-821](https://issues.apache.org/jira/browse/YARN-821) | Rename FinishApplicationMasterRequest.setFinishApplicationStatus to setFinalApplicationStatus to be consistent with getter | Major | . | Jian He | Jian He |
-| [YARN-806](https://issues.apache.org/jira/browse/YARN-806) | Move ContainerExitStatus from yarn.api to yarn.api.records | Major | . | Jian He | Jian He |
-| [YARN-792](https://issues.apache.org/jira/browse/YARN-792) | Move NodeHealthStatus from yarn.api.record to yarn.server.api.record | Major | . | Jian He | Jian He |
-| [YARN-791](https://issues.apache.org/jira/browse/YARN-791) | Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API | Blocker | api, resourcemanager | Sandy Ryza | Sandy Ryza |
-| [YARN-787](https://issues.apache.org/jira/browse/YARN-787) | Remove resource min from Yarn client API | Blocker | api | Alejandro Abdelnur | Alejandro Abdelnur |
-| [YARN-777](https://issues.apache.org/jira/browse/YARN-777) | Remove unreferenced objects from proto | Major | . | Jian He | Jian He |
-| [YARN-756](https://issues.apache.org/jira/browse/YARN-756) | Move PreemptionContainer/PremptionContract/PreemptionMessage/StrictPreemptionContract/PreemptionResourceRequest to api.records | Major | . | Jian He | Jian He |
-| [YARN-755](https://issues.apache.org/jira/browse/YARN-755) | Rename AllocateResponse.reboot to AllocateResponse.resync | Major | . | Bikas Saha | Bikas Saha |
-| [YARN-753](https://issues.apache.org/jira/browse/YARN-753) | Add individual factory method for api protocol records | Major | . | Jian He | Jian He |
-| [YARN-749](https://issues.apache.org/jira/browse/YARN-749) | Rename ResourceRequest (get,set)HostName to (get,set)ResourceName | Major | . | Arun C Murthy | Arun C Murthy |
-| [YARN-748](https://issues.apache.org/jira/browse/YARN-748) | Move BuilderUtils from yarn-common to yarn-server-common | Major | . | Jian He | Jian He |
-| [YARN-746](https://issues.apache.org/jira/browse/YARN-746) | rename Service.register() and Service.unregister() to registerServiceListener() & unregisterServiceListener() respectively | Major | . | Steve Loughran | Steve Loughran |
-| [YARN-735](https://issues.apache.org/jira/browse/YARN-735) | Make ApplicationAttemptID, ContainerID, NodeID immutable | Major | . | Jian He | Jian He |
-| [YARN-724](https://issues.apache.org/jira/browse/YARN-724) | Move ProtoBase from api.records to api.records.impl.pb | Major | . | Jian He | Jian He |
-| [YARN-720](https://issues.apache.org/jira/browse/YARN-720) | container-log4j.properties should not refer to mapreduce properties | Major | . | Siddharth Seth | Zhijie Shen |
-| [YARN-716](https://issues.apache.org/jira/browse/YARN-716) | Make ApplicationID immutable | Major | . | Siddharth Seth | Siddharth Seth |
-| [YARN-701](https://issues.apache.org/jira/browse/YARN-701) | ApplicationTokens should be used irrespective of kerberos | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [YARN-694](https://issues.apache.org/jira/browse/YARN-694) | Start using NMTokens to authenticate all communication with NM | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
-| [YARN-684](https://issues.apache.org/jira/browse/YARN-684) | ContainerManager.startContainer needs to only have ContainerTokenIdentifier instead of the whole Container | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [YARN-642](https://issues.apache.org/jira/browse/YARN-642) | Fix up /nodes REST API to have 1 param and be consistent with the Java API | Major | api, resourcemanager | Sandy Ryza | Sandy Ryza |
-| [YARN-635](https://issues.apache.org/jira/browse/YARN-635) | Rename YarnRemoteException to YarnException | Major | . | Xuan Gong | Siddharth Seth |
-| [YARN-633](https://issues.apache.org/jira/browse/YARN-633) | Change RMAdminProtocol api to throw IOException and YarnRemoteException | Major | . | Xuan Gong | Xuan Gong |
-| [YARN-632](https://issues.apache.org/jira/browse/YARN-632) | Change ContainerManager api to throw IOException and YarnRemoteException | Major | . | Xuan Gong | Xuan Gong |
-| [YARN-631](https://issues.apache.org/jira/browse/YARN-631) | Change ClientRMProtocol api to throw IOException and YarnRemoteException | Major | . | Xuan Gong | Xuan Gong |
-| [YARN-630](https://issues.apache.org/jira/browse/YARN-630) | Change AMRMProtocol api to throw IOException and YarnRemoteException | Major | . | Xuan Gong | Xuan Gong |
-| [YARN-629](https://issues.apache.org/jira/browse/YARN-629) | Make YarnRemoteException not be rooted at IOException | Major | . | Xuan Gong | Xuan Gong |
-| [YARN-615](https://issues.apache.org/jira/browse/YARN-615) | ContainerLaunchContext.containerTokens should simply be called tokens | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
| [YARN-610](https://issues.apache.org/jira/browse/YARN-610) | ClientToken (ClientToAMToken) should not be set in the environment | Blocker | . | Siddharth Seth | Omkar Vinit Joshi |
-| [YARN-579](https://issues.apache.org/jira/browse/YARN-579) | Make ApplicationToken part of Container's token list to help RM-restart | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [YARN-571](https://issues.apache.org/jira/browse/YARN-571) | User should not be part of ContainerLaunchContext | Major | . | Hitesh Shah | Omkar Vinit Joshi |
-| [YARN-561](https://issues.apache.org/jira/browse/YARN-561) | Nodemanager should set some key information into the environment of every container that it launches. | Major | . | Hitesh Shah | Xuan Gong |
+| [YARN-834](https://issues.apache.org/jira/browse/YARN-834) | Review/fix annotations for yarn-client module and clearly differentiate \*Async apis | Blocker | . | Arun C Murthy | Zhijie Shen |
+| [YARN-840](https://issues.apache.org/jira/browse/YARN-840) | Move ProtoUtils to yarn.api.records.pb.impl | Major | . | Jian He | Jian He |
+| [YARN-841](https://issues.apache.org/jira/browse/YARN-841) | Annotate and document AuxService APIs | Major | . | Siddharth Seth | Vinod Kumar Vavilapalli |
+| [YARN-694](https://issues.apache.org/jira/browse/YARN-694) | Start using NMTokens to authenticate all communication with NM | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
| [YARN-553](https://issues.apache.org/jira/browse/YARN-553) | Have YarnClient generate a directly usable ApplicationSubmissionContext | Minor | client | Harsh J | Karthik Kambatla |
-| [YARN-536](https://issues.apache.org/jira/browse/YARN-536) | Remove ContainerStatus, ContainerState from Container api interface as they will not be called by the container object | Major | . | Xuan Gong | Xuan Gong |
-| [YARN-530](https://issues.apache.org/jira/browse/YARN-530) | Define Service model strictly, implement AbstractService for robust subclassing, migrate yarn-common services | Major | . | Steve Loughran | Steve Loughran |
-| [YARN-440](https://issues.apache.org/jira/browse/YARN-440) | Flatten RegisterNodeManagerResponse | Major | . | Siddharth Seth | Xuan Gong |
-| [YARN-439](https://issues.apache.org/jira/browse/YARN-439) | Flatten NodeHeartbeatResponse | Major | . | Siddharth Seth | Xuan Gong |
-| [YARN-396](https://issues.apache.org/jira/browse/YARN-396) | Rationalize AllocateResponse in RM scheduler API | Major | . | Bikas Saha | Zhijie Shen |
-| [YARN-387](https://issues.apache.org/jira/browse/YARN-387) | Fix inconsistent protocol naming | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [YARN-851](https://issues.apache.org/jira/browse/YARN-851) | Share NMTokens using NMTokenCache (api-based) instead of memory based approach which is used currently. | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
+| [HADOOP-9421](https://issues.apache.org/jira/browse/HADOOP-9421) | Convert SASL to use ProtoBuf and provide negotiation capabilities | Blocker | . | Sanjay Radia | Daryn Sharp |
+| [YARN-869](https://issues.apache.org/jira/browse/YARN-869) | ResourceManagerAdministrationProtocol should neither be public(yet) nor in yarn.api | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [YARN-791](https://issues.apache.org/jira/browse/YARN-791) | Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API | Blocker | api, resourcemanager | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9683](https://issues.apache.org/jira/browse/HADOOP-9683) | Wrap IpcConnectionContext in RPC headers | Blocker | ipc | Luke Lu | Daryn Sharp |
+| [YARN-701](https://issues.apache.org/jira/browse/YARN-701) | ApplicationTokens should be used irrespective of kerberos | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [YARN-918](https://issues.apache.org/jira/browse/YARN-918) | ApplicationMasterProtocol doesn't need ApplicationAttemptId in the payload after YARN-701 | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [YARN-926](https://issues.apache.org/jira/browse/YARN-926) | ContainerManagerProtcol APIs should take in requests for multiple containers | Blocker | . | Vinod Kumar Vavilapalli | Jian He |
+| [HADOOP-9698](https://issues.apache.org/jira/browse/HADOOP-9698) | RPCv9 client must honor server's SASL negotiate response | Blocker | ipc | Daryn Sharp | Daryn Sharp |
+| [HADOOP-9832](https://issues.apache.org/jira/browse/HADOOP-9832) | Add RPC header to client ping | Blocker | ipc | Daryn Sharp | Daryn Sharp |
+| [HADOOP-9820](https://issues.apache.org/jira/browse/HADOOP-9820) | RPCv9 wire protocol is insufficient to support multiplexing | Blocker | ipc, security | Daryn Sharp | Daryn Sharp |
+| [HDFS-5083](https://issues.apache.org/jira/browse/HDFS-5083) | Update the HDFS compatibility version range | Blocker | . | Kihwal Lee | Kihwal Lee |
+| [YARN-1056](https://issues.apache.org/jira/browse/YARN-1056) | Fix configs yarn.resourcemanager.resourcemanager.connect.{max.wait.secs\|retry\_interval.secs} | Trivial | . | Karthik Kambatla | Karthik Kambatla |
+| [HDFS-2802](https://issues.apache.org/jira/browse/HDFS-2802) | Support for RW/RO snapshots in HDFS | Major | namenode | Hari Mankude | Tsz Wo Nicholas Sze |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9763](https://issues.apache.org/jira/browse/HADOOP-9763) | Extends LightWeightGSet to support eviction of expired elements | Major | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-9515](https://issues.apache.org/jira/browse/HADOOP-9515) | Add general interface for NFS and Mount | Major | . | Brandon Li | Brandon Li |
-| [HADOOP-9509](https://issues.apache.org/jira/browse/HADOOP-9509) | Implement ONCRPC and XDR | Major | . | Brandon Li | Brandon Li |
+| [HDFS-4124](https://issues.apache.org/jira/browse/HDFS-4124) | Refactor INodeDirectory#getExistingPathINodes() to enable returning more than INode array | Minor | . | Jing Zhao | Jing Zhao |
| [HADOOP-9283](https://issues.apache.org/jira/browse/HADOOP-9283) | Add support for running the Hadoop client on AIX | Major | security | Aaron T. Myers | Aaron T. Myers |
| [HADOOP-9209](https://issues.apache.org/jira/browse/HADOOP-9209) | Add shell command to dump file checksums | Major | fs, tools | Todd Lipcon | Todd Lipcon |
+| [HDFS-1804](https://issues.apache.org/jira/browse/HDFS-1804) | Add a new block-volume device choosing policy that looks at free space | Minor | datanode | Harsh J | Aaron T. Myers |
+| [MAPREDUCE-5129](https://issues.apache.org/jira/browse/MAPREDUCE-5129) | Add tag info to JH files | Minor | . | Billie Rinaldi | Billie Rinaldi |
+| [HDFS-2576](https://issues.apache.org/jira/browse/HDFS-2576) | Namenode should have a favored nodes hint to enable clients to have control over block placement. | Major | hdfs-client, namenode | Pritam Damania | Devaraj Das |
| [HADOOP-8562](https://issues.apache.org/jira/browse/HADOOP-8562) | Enhancements to support Hadoop on Windows Server and Windows Azure environments | Major | . | Bikas Saha | Bikas Saha |
-| [HADOOP-8040](https://issues.apache.org/jira/browse/HADOOP-8040) | Add symlink support to FileSystem | Major | fs | Eli Collins | Andrew Wang |
-| [HDFS-4249](https://issues.apache.org/jira/browse/HDFS-4249) | Add status NameNode startup to webUI | Major | namenode | Suresh Srinivas | Chris Nauroth |
-| [HDFS-4124](https://issues.apache.org/jira/browse/HDFS-4124) | Refactor INodeDirectory#getExistingPathINodes() to enable returning more than INode array | Minor | . | Jing Zhao | Jing Zhao |
| [HDFS-3601](https://issues.apache.org/jira/browse/HDFS-3601) | Implementation of ReplicaPlacementPolicyNodeGroup to support 4-layer network topology | Major | namenode | Junping Du | Junping Du |
| [HDFS-3495](https://issues.apache.org/jira/browse/HDFS-3495) | Update Balancer to support new NetworkTopology with NodeGroup | Major | balancer & mover | Junping Du | Junping Du |
-| [HDFS-3278](https://issues.apache.org/jira/browse/HDFS-3278) | Umbrella Jira for HDFS-HA Phase 2 | Major | . | Sanjay Radia | Todd Lipcon |
-| [HDFS-2576](https://issues.apache.org/jira/browse/HDFS-2576) | Namenode should have a favored nodes hint to enable clients to have control over block placement. | Major | hdfs-client, namenode | Pritam Damania | Devaraj Das |
-| [HDFS-1804](https://issues.apache.org/jira/browse/HDFS-1804) | Add a new block-volume device choosing policy that looks at free space | Minor | datanode | Harsh J | Aaron T. Myers |
-| [MAPREDUCE-5298](https://issues.apache.org/jira/browse/MAPREDUCE-5298) | Move MapReduce services to YARN-117 stricter lifecycle | Major | applicationmaster | Steve Loughran | Steve Loughran |
-| [MAPREDUCE-5129](https://issues.apache.org/jira/browse/MAPREDUCE-5129) | Add tag info to JH files | Minor | . | Billie Rinaldi | Billie Rinaldi |
| [YARN-326](https://issues.apache.org/jira/browse/YARN-326) | Add multi-resource scheduling to the fair scheduler | Major | scheduler | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9509](https://issues.apache.org/jira/browse/HADOOP-9509) | Implement ONCRPC and XDR | Major | . | Brandon Li | Brandon Li |
+| [MAPREDUCE-5298](https://issues.apache.org/jira/browse/MAPREDUCE-5298) | Move MapReduce services to YARN-117 stricter lifecycle | Major | applicationmaster | Steve Loughran | Steve Loughran |
+| [HADOOP-9515](https://issues.apache.org/jira/browse/HADOOP-9515) | Add general interface for NFS and Mount | Major | . | Brandon Li | Brandon Li |
+| [HDFS-4249](https://issues.apache.org/jira/browse/HDFS-4249) | Add status NameNode startup to webUI | Major | namenode | Suresh Srinivas | Chris Nauroth |
+| [HADOOP-8040](https://issues.apache.org/jira/browse/HADOOP-8040) | Add symlink support to FileSystem | Major | fs | Eli Collins | Andrew Wang |
+| [HADOOP-9763](https://issues.apache.org/jira/browse/HADOOP-9763) | Extends LightWeightGSet to support eviction of expired elements | Major | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-3278](https://issues.apache.org/jira/browse/HDFS-3278) | Umbrella Jira for HDFS-HA Phase 2 | Major | . | Sanjay Radia | Todd Lipcon |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9845](https://issues.apache.org/jira/browse/HADOOP-9845) | Update protobuf to 2.5 from 2.4.x | Blocker | performance | stack | Alejandro Abdelnur |
-| [HADOOP-9792](https://issues.apache.org/jira/browse/HADOOP-9792) | Retry the methods that are tagged @AtMostOnce along with @Idempotent | Major | ipc | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-9770](https://issues.apache.org/jira/browse/HADOOP-9770) | Make RetryCache#state non volatile | Minor | util | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-9762](https://issues.apache.org/jira/browse/HADOOP-9762) | RetryCache utility for implementing RPC retries | Major | util | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-9760](https://issues.apache.org/jira/browse/HADOOP-9760) | Move GSet and LightWeightGSet to hadoop-common | Major | util | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-9756](https://issues.apache.org/jira/browse/HADOOP-9756) | Additional cleanup RPC code | Minor | ipc | Junping Du | Junping Du |
-| [HADOOP-9754](https://issues.apache.org/jira/browse/HADOOP-9754) | Clean up RPC code | Minor | ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-9751](https://issues.apache.org/jira/browse/HADOOP-9751) | Add clientId and retryCount to RpcResponseHeaderProto | Major | ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-9734](https://issues.apache.org/jira/browse/HADOOP-9734) | Common protobuf definitions for GetUserMappingsProtocol, RefreshAuthorizationPolicyProtocol and RefreshUserMappingsProtocol | Minor | ipc | Jason Lowe | Jason Lowe |
-| [HADOOP-9717](https://issues.apache.org/jira/browse/HADOOP-9717) | Add retry attempt count to the RPC requests | Major | ipc | Suresh Srinivas | Jing Zhao |
-| [HADOOP-9716](https://issues.apache.org/jira/browse/HADOOP-9716) | Move the Rpc request call ID generation to client side InvocationHandler | Major | ipc | Suresh Srinivas | Tsz Wo Nicholas Sze |
-| [HADOOP-9691](https://issues.apache.org/jira/browse/HADOOP-9691) | RPC clients can generate call ID using AtomicInteger instead of synchronizing on the Client instance. | Minor | ipc | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9688](https://issues.apache.org/jira/browse/HADOOP-9688) | Add globally unique Client ID to RPC requests | Blocker | ipc | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-9676](https://issues.apache.org/jira/browse/HADOOP-9676) | make maximum RPC buffer size configurable | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-9673](https://issues.apache.org/jira/browse/HADOOP-9673) | NetworkTopology: when a node can't be added, print out its location for diagnostic purposes | Trivial | net | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-9661](https://issues.apache.org/jira/browse/HADOOP-9661) | Allow metrics sources to be extended | Major | metrics | Sandy Ryza | Sandy Ryza |
-| [HADOOP-9625](https://issues.apache.org/jira/browse/HADOOP-9625) | HADOOP\_OPTS not picked up by hadoop command | Minor | bin, conf | Paul Han | Paul Han |
-| [HADOOP-9605](https://issues.apache.org/jira/browse/HADOOP-9605) | Update junit dependency | Major | build | Timothy St. Clair | |
-| [HADOOP-9604](https://issues.apache.org/jira/browse/HADOOP-9604) | Wrong Javadoc of FSDataOutputStream | Minor | fs | Jingguo Yao | Jingguo Yao |
-| [HADOOP-9560](https://issues.apache.org/jira/browse/HADOOP-9560) | metrics2#JvmMetrics should have max memory size of JVM | Minor | metrics | Tsuyoshi Ozawa | Tsuyoshi Ozawa |
-| [HADOOP-9523](https://issues.apache.org/jira/browse/HADOOP-9523) | Provide a generic IBM java vendor flag in PlatformName.java to support non-Sun JREs | Major | . | Tian Hong Wang | Tian Hong Wang |
-| [HADOOP-9511](https://issues.apache.org/jira/browse/HADOOP-9511) | Adding support for additional input streams (FSDataInputStream and RandomAccessFile) in SecureIOUtils. | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
-| [HADOOP-9503](https://issues.apache.org/jira/browse/HADOOP-9503) | Remove sleep between IPC client connect timeouts | Minor | ipc | Varun Sharma | Varun Sharma |
-| [HADOOP-9483](https://issues.apache.org/jira/browse/HADOOP-9483) | winutils support for readlink command | Major | util | Chris Nauroth | Arpit Agarwal |
-| [HADOOP-9450](https://issues.apache.org/jira/browse/HADOOP-9450) | HADOOP\_USER\_CLASSPATH\_FIRST is not honored; CLASSPATH is PREpended instead of APpended | Major | scripts | Mitch Wyle | Harsh J |
-| [HADOOP-9401](https://issues.apache.org/jira/browse/HADOOP-9401) | CodecPool: Add counters for number of (de)compressors leased out | Major | . | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-9379](https://issues.apache.org/jira/browse/HADOOP-9379) | capture the ulimit info after printing the log to the console | Trivial | . | Arpit Gupta | Arpit Gupta |
+| [HDFS-2572](https://issues.apache.org/jira/browse/HDFS-2572) | Unnecessary double-check in DN#getHostName | Trivial | datanode | Harsh J | Harsh J |
+| [HDFS-2857](https://issues.apache.org/jira/browse/HDFS-2857) | Cleanup BlockInfo class | Major | namenode | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-3787](https://issues.apache.org/jira/browse/MAPREDUCE-3787) | [Gridmix] Improve STRESS mode | Major | contrib/gridmix | Amar Kamat | Amar Kamat |
+| [HDFS-3163](https://issues.apache.org/jira/browse/HDFS-3163) | TestHDFSCLI.testAll fails if the user name is not all lowercase | Trivial | test | Brandon Li | Brandon Li |
+| [HADOOP-8415](https://issues.apache.org/jira/browse/HADOOP-8415) | getDouble() and setDouble() in org.apache.hadoop.conf.Configuration | Minor | conf | Jan van der Lugt | Jan van der Lugt |
+| [HADOOP-8711](https://issues.apache.org/jira/browse/HADOOP-8711) | provide an option for IPC server users to avoid printing stack information for certain exceptions | Major | ipc | Brandon Li | Brandon Li |
+| [HDFS-3817](https://issues.apache.org/jira/browse/HDFS-3817) | avoid printing stack information for SafeModeException | Major | namenode | Brandon Li | Brandon Li |
+| [HDFS-3880](https://issues.apache.org/jira/browse/HDFS-3880) | Use Builder to get RPC server in HDFS | Minor | datanode, ha, namenode, security | Brandon Li | Brandon Li |
+| [YARN-84](https://issues.apache.org/jira/browse/YARN-84) | Use Builder to get RPC server in YARN | Minor | . | Brandon Li | Brandon Li |
+| [HDFS-4053](https://issues.apache.org/jira/browse/HDFS-4053) | Increase the default block size | Major | . | Eli Collins | Eli Collins |
+| [HDFS-4151](https://issues.apache.org/jira/browse/HDFS-4151) | Passing INodesInPath instead of INode[] in FSDirectory | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-4152](https://issues.apache.org/jira/browse/HDFS-4152) | Add a new class for the parameter in INode.collectSubtreeBlocksAndClear(..) | Minor | namenode | Tsz Wo Nicholas Sze | Jing Zhao |
+| [HDFS-4206](https://issues.apache.org/jira/browse/HDFS-4206) | Change the fields in INode and its subclasses to private | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-4215](https://issues.apache.org/jira/browse/HDFS-4215) | Improvements on INode and image loading | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-4234](https://issues.apache.org/jira/browse/HDFS-4234) | Use the generic code for choosing datanode in Balancer | Minor | balancer & mover | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-8924](https://issues.apache.org/jira/browse/HADOOP-8924) | Add maven plugin alternative to shell script to save package-info.java | Major | build | Chris Nauroth | Chris Nauroth |
+| [YARN-385](https://issues.apache.org/jira/browse/YARN-385) | ResourceRequestPBImpl's toString() is missing location and # containers | Major | api | Sandy Ryza | Sandy Ryza |
+| [MAPREDUCE-4989](https://issues.apache.org/jira/browse/MAPREDUCE-4989) | JSONify DataTables input data for Attempts page | Major | jobhistoryserver, mr-am | Ravi Prakash | Ravi Prakash |
+| [YARN-249](https://issues.apache.org/jira/browse/YARN-249) | Capacity Scheduler web page should show list of active users per queue like it used to (in 1.x) | Major | capacityscheduler | Ravi Prakash | Ravi Prakash |
+| [YARN-391](https://issues.apache.org/jira/browse/YARN-391) | detabify LCEResourcesHandler classes | Trivial | nodemanager | Steve Loughran | Steve Loughran |
+| [HADOOP-9117](https://issues.apache.org/jira/browse/HADOOP-9117) | replace protoc ant plugin exec with a maven plugin | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-4846](https://issues.apache.org/jira/browse/MAPREDUCE-4846) | Some JobQueueInfo methods are public in MR1 but protected in MR2 | Major | client | Sandy Ryza | Sandy Ryza |
+| [HDFS-4304](https://issues.apache.org/jira/browse/HDFS-4304) | Make FSEditLogOp.MAX\_OP\_SIZE configurable | Major | namenode | Todd Lipcon | Colin P. McCabe |
+| [HADOOP-9279](https://issues.apache.org/jira/browse/HADOOP-9279) | Document the need to build hadoop-maven-plugins for eclipse and separate project builds | Major | build, documentation | Tsuyoshi Ozawa | Tsuyoshi Ozawa |
+| [HADOOP-9334](https://issues.apache.org/jira/browse/HADOOP-9334) | Update netty version | Minor | build | Nicolas Liochon | Nicolas Liochon |
+| [MAPREDUCE-5033](https://issues.apache.org/jira/browse/MAPREDUCE-5033) | mapred shell script should respect usage flags (--help -help -h) | Minor | . | Andrew Wang | Andrew Wang |
+| [HADOOP-9336](https://issues.apache.org/jira/browse/HADOOP-9336) | Allow UGI of current connection to be queried | Critical | ipc | Daryn Sharp | Daryn Sharp |
+| [YARN-406](https://issues.apache.org/jira/browse/YARN-406) | TestRackResolver fails when local network resolves "host1" to a valid host | Minor | . | Hitesh Shah | Hitesh Shah |
| [HADOOP-9352](https://issues.apache.org/jira/browse/HADOOP-9352) | Expose UGI.setLoginUser for tests | Major | security | Daryn Sharp | Daryn Sharp |
| [HADOOP-9343](https://issues.apache.org/jira/browse/HADOOP-9343) | Allow additional exceptions through the RPC layer | Major | . | Siddharth Seth | Siddharth Seth |
-| [HADOOP-9338](https://issues.apache.org/jira/browse/HADOOP-9338) | FsShell Copy Commands Should Optionally Preserve File Attributes | Major | fs | Nick White | Nick White |
-| [HADOOP-9336](https://issues.apache.org/jira/browse/HADOOP-9336) | Allow UGI of current connection to be queried | Critical | ipc | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9334](https://issues.apache.org/jira/browse/HADOOP-9334) | Update netty version | Minor | build | Nicolas Liochon | Nicolas Liochon |
-| [HADOOP-9322](https://issues.apache.org/jira/browse/HADOOP-9322) | LdapGroupsMapping doesn't seem to set a timeout for its directory search | Minor | security | Harsh J | Harsh J |
-| [HADOOP-9318](https://issues.apache.org/jira/browse/HADOOP-9318) | when exiting on a signal, print the signal name first | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-9279](https://issues.apache.org/jira/browse/HADOOP-9279) | Document the need to build hadoop-maven-plugins for eclipse and separate project builds | Major | build, documentation | Tsuyoshi Ozawa | Tsuyoshi Ozawa |
-| [HADOOP-9253](https://issues.apache.org/jira/browse/HADOOP-9253) | Capture ulimit info in the logs at service start time | Major | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-9227](https://issues.apache.org/jira/browse/HADOOP-9227) | FileSystemContractBaseTest doesn't test filesystem's mkdir/isDirectory() logic rigorously enough | Trivial | fs | Steve Loughran | Steve Loughran |
-| [HADOOP-9164](https://issues.apache.org/jira/browse/HADOOP-9164) | Print paths of loaded native libraries in NativeLibraryChecker | Minor | native | Binglin Chang | Binglin Chang |
-| [HADOOP-9117](https://issues.apache.org/jira/browse/HADOOP-9117) | replace protoc ant plugin exec with a maven plugin | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8924](https://issues.apache.org/jira/browse/HADOOP-8924) | Add maven plugin alternative to shell script to save package-info.java | Major | build | Chris Nauroth | Chris Nauroth |
-| [HADOOP-8711](https://issues.apache.org/jira/browse/HADOOP-8711) | provide an option for IPC server users to avoid printing stack information for certain exceptions | Major | ipc | Brandon Li | Brandon Li |
-| [HADOOP-8608](https://issues.apache.org/jira/browse/HADOOP-8608) | Add Configuration API for parsing time durations | Minor | conf | Todd Lipcon | Chris Douglas |
| [HADOOP-8462](https://issues.apache.org/jira/browse/HADOOP-8462) | Native-code implementation of bzip2 codec | Major | io | Govind Kamat | Govind Kamat |
-| [HADOOP-8415](https://issues.apache.org/jira/browse/HADOOP-8415) | getDouble() and setDouble() in org.apache.hadoop.conf.Configuration | Minor | conf | Jan van der Lugt | Jan van der Lugt |
-| [HDFS-5027](https://issues.apache.org/jira/browse/HDFS-5027) | On startup, DN should scan volumes in parallel | Major | datanode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-5020](https://issues.apache.org/jira/browse/HDFS-5020) | Make DatanodeProtocol#blockReceivedAndDeleted idempotent | Major | namenode | Jing Zhao | Jing Zhao |
-| [HDFS-5010](https://issues.apache.org/jira/browse/HDFS-5010) | Reduce the frequency of getCurrentUser() calls from namenode | Major | namenode, performance | Kihwal Lee | Kihwal Lee |
-| [HDFS-5008](https://issues.apache.org/jira/browse/HDFS-5008) | Make ClientProtocol#abandonBlock() idempotent | Major | namenode | Suresh Srinivas | Jing Zhao |
-| [HDFS-5007](https://issues.apache.org/jira/browse/HDFS-5007) | Replace hard-coded property keys with DFSConfigKeys fields | Minor | . | Kousuke Saruta | Kousuke Saruta |
-| [HDFS-4996](https://issues.apache.org/jira/browse/HDFS-4996) | ClientProtocol#metaSave can be made idempotent by overwriting the output file instead of appending to it | Minor | namenode | Chris Nauroth | Chris Nauroth |
-| [HDFS-4992](https://issues.apache.org/jira/browse/HDFS-4992) | Make balancer's thread count configurable | Major | balancer & mover | Max Lapan | Max Lapan |
-| [HDFS-4978](https://issues.apache.org/jira/browse/HDFS-4978) | Make disallowSnapshot idempotent | Major | . | Jing Zhao | Jing Zhao |
-| [HDFS-4942](https://issues.apache.org/jira/browse/HDFS-4942) | Add retry cache support in Namenode | Major | ha, namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-4932](https://issues.apache.org/jira/browse/HDFS-4932) | Avoid a wide line on the name node webUI if we have more Journal nodes | Minor | ha, namenode | Fengdong Yu | Fengdong Yu |
-| [HDFS-4914](https://issues.apache.org/jira/browse/HDFS-4914) | When possible, Use DFSClient.Conf instead of Configuration | Minor | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-4912](https://issues.apache.org/jira/browse/HDFS-4912) | Cleanup FSNamesystem#startFileInternal | Major | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-4903](https://issues.apache.org/jira/browse/HDFS-4903) | Print trash configuration and trash emptier state in namenode log | Minor | namenode | Suresh Srinivas | Arpit Agarwal |
-| [HDFS-4848](https://issues.apache.org/jira/browse/HDFS-4848) | copyFromLocal and renaming a file to ".snapshot" should output that ".snapshot" is a reserved name | Minor | snapshots | Stephen Chu | Jing Zhao |
-| [HDFS-4804](https://issues.apache.org/jira/browse/HDFS-4804) | WARN when users set the block balanced preference percent below 0.5 or above 1.0 | Minor | . | Stephen Chu | Stephen Chu |
-| [HDFS-4787](https://issues.apache.org/jira/browse/HDFS-4787) | Create a new HdfsConfiguration before each TestDFSClientRetries testcases | Major | . | Tian Hong Wang | Tian Hong Wang |
-| [HDFS-4772](https://issues.apache.org/jira/browse/HDFS-4772) | Add number of children in HdfsFileStatus | Minor | namenode | Brandon Li | Brandon Li |
-| [HDFS-4721](https://issues.apache.org/jira/browse/HDFS-4721) | Speed up lease/block recovery when DN fails and a block goes into recovery | Major | namenode | Varun Sharma | Varun Sharma |
-| [HDFS-4698](https://issues.apache.org/jira/browse/HDFS-4698) | provide client-side metrics for remote reads, local reads, and short-circuit reads | Minor | hdfs-client | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-4679](https://issues.apache.org/jira/browse/HDFS-4679) | Namenode operation checks should be done in a consistent manner | Major | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-4645](https://issues.apache.org/jira/browse/HDFS-4645) | Move from randomly generated block ID to sequentially generated block ID | Major | namenode | Suresh Srinivas | Arpit Agarwal |
-| [HDFS-4635](https://issues.apache.org/jira/browse/HDFS-4635) | Move BlockManager#computeCapacity to LightWeightGSet | Major | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-4569](https://issues.apache.org/jira/browse/HDFS-4569) | Small image transfer related cleanups. | Trivial | . | Andrew Wang | Andrew Wang |
| [HDFS-4565](https://issues.apache.org/jira/browse/HDFS-4565) | use DFSUtil.getSpnegoKeytabKey() to get the spnego keytab key in secondary namenode and namenode http server | Minor | security | Arpit Gupta | Arpit Gupta |
-| [HDFS-4521](https://issues.apache.org/jira/browse/HDFS-4521) | invalid network topologies should not be cached | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-4465](https://issues.apache.org/jira/browse/HDFS-4465) | Optimize datanode ReplicasMap and ReplicaInfo | Major | datanode | Suresh Srinivas | Aaron T. Myers |
-| [HDFS-4461](https://issues.apache.org/jira/browse/HDFS-4461) | DirectoryScanner: volume path prefix takes up memory for every block that is scanned | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-4304](https://issues.apache.org/jira/browse/HDFS-4304) | Make FSEditLogOp.MAX\_OP\_SIZE configurable | Major | namenode | Todd Lipcon | Colin Patrick McCabe |
-| [HDFS-4246](https://issues.apache.org/jira/browse/HDFS-4246) | The exclude node list should be more forgiving, for each output stream | Minor | hdfs-client | Harsh J | Harsh J |
-| [HDFS-4234](https://issues.apache.org/jira/browse/HDFS-4234) | Use the generic code for choosing datanode in Balancer | Minor | balancer & mover | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-4215](https://issues.apache.org/jira/browse/HDFS-4215) | Improvements on INode and image loading | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-4206](https://issues.apache.org/jira/browse/HDFS-4206) | Change the fields in INode and its subclasses to private | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-4152](https://issues.apache.org/jira/browse/HDFS-4152) | Add a new class for the parameter in INode.collectSubtreeBlocksAndClear(..) | Minor | namenode | Tsz Wo Nicholas Sze | Jing Zhao |
-| [HDFS-4151](https://issues.apache.org/jira/browse/HDFS-4151) | Passing INodesInPath instead of INode[] in FSDirectory | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-4053](https://issues.apache.org/jira/browse/HDFS-4053) | Increase the default block size | Major | . | Eli Collins | Eli Collins |
+| [HDFS-4569](https://issues.apache.org/jira/browse/HDFS-4569) | Small image transfer related cleanups. | Trivial | . | Andrew Wang | Andrew Wang |
+| [HADOOP-9379](https://issues.apache.org/jira/browse/HADOOP-9379) | capture the ulimit info after printing the log to the console | Trivial | . | Arpit Gupta | Arpit Gupta |
+| [YARN-198](https://issues.apache.org/jira/browse/YARN-198) | If we are navigating to Nodemanager UI from Resourcemanager,then there is not link to navigate back to Resource manager | Minor | nodemanager | Ramgopal N | Jian He |
+| [YARN-237](https://issues.apache.org/jira/browse/YARN-237) | Refreshing the RM page forgets how many rows I had in my Datatables | Major | resourcemanager | Ravi Prakash | Jian He |
+| [HADOOP-9318](https://issues.apache.org/jira/browse/HADOOP-9318) | when exiting on a signal, print the signal name first | Minor | . | Colin P. McCabe | Colin P. McCabe |
+| [MAPREDUCE-4990](https://issues.apache.org/jira/browse/MAPREDUCE-4990) | Construct debug strings conditionally in ShuffleHandler.Shuffle#sendMapOutput() | Trivial | . | Karthik Kambatla | Karthik Kambatla |
+| [YARN-297](https://issues.apache.org/jira/browse/YARN-297) | Improve hashCode implementations for PB records | Major | . | Arun C Murthy | Xuan Gong |
+| [HDFS-4246](https://issues.apache.org/jira/browse/HDFS-4246) | The exclude node list should be more forgiving, for each output stream | Minor | hdfs-client | Harsh J | Harsh J |
+| [HADOOP-9227](https://issues.apache.org/jira/browse/HADOOP-9227) | FileSystemContractBaseTest doesn't test filesystem's mkdir/isDirectory() logic rigorously enough | Trivial | fs | Steve Loughran | Steve Loughran |
+| [HDFS-4635](https://issues.apache.org/jira/browse/HDFS-4635) | Move BlockManager#computeCapacity to LightWeightGSet | Major | namenode | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-9253](https://issues.apache.org/jira/browse/HADOOP-9253) | Capture ulimit info in the logs at service start time | Major | . | Arpit Gupta | Arpit Gupta |
+| [YARN-447](https://issues.apache.org/jira/browse/YARN-447) | applicationComparator improvement for CS | Minor | scheduler | Nemon Lou | Nemon Lou |
+| [YARN-382](https://issues.apache.org/jira/browse/YARN-382) | SchedulerUtils improve way normalizeRequest sets the resource capabilities | Major | scheduler | Thomas Graves | Zhijie Shen |
+| [YARN-381](https://issues.apache.org/jira/browse/YARN-381) | Improve FS docs | Minor | documentation | Eli Collins | Sandy Ryza |
+| [YARN-538](https://issues.apache.org/jira/browse/YARN-538) | RM address DNS lookup can cause unnecessary slowness on every JHS page load | Major | . | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9401](https://issues.apache.org/jira/browse/HADOOP-9401) | CodecPool: Add counters for number of (de)compressors leased out | Major | . | Karthik Kambatla | Karthik Kambatla |
+| [YARN-525](https://issues.apache.org/jira/browse/YARN-525) | make CS node-locality-delay refreshable | Major | capacityscheduler | Thomas Graves | Thomas Graves |
| [HDFS-3940](https://issues.apache.org/jira/browse/HDFS-3940) | Add Gset#clear method and clear the block map when namenode is shutdown | Minor | . | Eli Collins | Suresh Srinivas |
-| [HDFS-3880](https://issues.apache.org/jira/browse/HDFS-3880) | Use Builder to get RPC server in HDFS | Minor | datanode, ha, namenode, security | Brandon Li | Brandon Li |
-| [HDFS-3817](https://issues.apache.org/jira/browse/HDFS-3817) | avoid printing stack information for SafeModeException | Major | namenode | Brandon Li | Brandon Li |
-| [HDFS-3498](https://issues.apache.org/jira/browse/HDFS-3498) | Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass | Major | namenode | Junping Du | Junping Du |
-| [HDFS-3163](https://issues.apache.org/jira/browse/HDFS-3163) | TestHDFSCLI.testAll fails if the user name is not all lowercase | Trivial | test | Brandon Li | Brandon Li |
-| [HDFS-2857](https://issues.apache.org/jira/browse/HDFS-2857) | Cleanup BlockInfo class | Major | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-2572](https://issues.apache.org/jira/browse/HDFS-2572) | Unnecessary double-check in DN#getHostName | Trivial | datanode | Harsh J | Harsh J |
-| [HDFS-2042](https://issues.apache.org/jira/browse/HDFS-2042) | Require c99 when building libhdfs | Minor | libhdfs | Eli Collins | |
-| [HDFS-347](https://issues.apache.org/jira/browse/HDFS-347) | DFS read performance suboptimal when client co-located on nodes with data | Major | datanode, hdfs-client, performance | George Porter | Colin Patrick McCabe |
-| [MAPREDUCE-5398](https://issues.apache.org/jira/browse/MAPREDUCE-5398) | MR changes for YARN-513 | Major | . | Bikas Saha | Jian He |
-| [MAPREDUCE-5352](https://issues.apache.org/jira/browse/MAPREDUCE-5352) | Optimize node local splits generated by CombineFileInputFormat | Major | . | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-5283](https://issues.apache.org/jira/browse/MAPREDUCE-5283) | Over 10 different tests have near identical implementations of AppContext | Major | applicationmaster, test | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5268](https://issues.apache.org/jira/browse/MAPREDUCE-5268) | Improve history server startup performance | Major | jobhistoryserver | Jason Lowe | Karthik Kambatla |
-| [MAPREDUCE-5246](https://issues.apache.org/jira/browse/MAPREDUCE-5246) | Adding application type to submission context | Major | . | Mayank Bansal | Mayank Bansal |
-| [MAPREDUCE-5171](https://issues.apache.org/jira/browse/MAPREDUCE-5171) | Expose blacklisted nodes from the MR AM REST API | Major | applicationmaster | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5128](https://issues.apache.org/jira/browse/MAPREDUCE-5128) | mapred-default.xml is missing a bunch of history server configs | Major | documentation, jobhistoryserver | Sandy Ryza | Sandy Ryza |
+| [HDFS-4679](https://issues.apache.org/jira/browse/HDFS-4679) | Namenode operation checks should be done in a consistent manner | Major | namenode | Suresh Srinivas | Suresh Srinivas |
| [MAPREDUCE-5079](https://issues.apache.org/jira/browse/MAPREDUCE-5079) | Recovery should restore task state from job history info directly | Critical | mr-am | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-5069](https://issues.apache.org/jira/browse/MAPREDUCE-5069) | add concrete common implementations of CombineFileInputFormat | Minor | mrv1, mrv2 | Sangjin Lee | Sangjin Lee |
-| [MAPREDUCE-5033](https://issues.apache.org/jira/browse/MAPREDUCE-5033) | mapred shell script should respect usage flags (--help -help -h) | Minor | . | Andrew Wang | Andrew Wang |
-| [MAPREDUCE-4990](https://issues.apache.org/jira/browse/MAPREDUCE-4990) | Construct debug strings conditionally in ShuffleHandler.Shuffle#sendMapOutput() | Trivial | . | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-4989](https://issues.apache.org/jira/browse/MAPREDUCE-4989) | JSONify DataTables input data for Attempts page | Major | jobhistoryserver, mr-am | Ravi Prakash | Ravi Prakash |
| [MAPREDUCE-4974](https://issues.apache.org/jira/browse/MAPREDUCE-4974) | Optimising the LineRecordReader initialize() method | Major | mrv1, mrv2, performance | Arun A K | Gelesh |
-| [MAPREDUCE-4846](https://issues.apache.org/jira/browse/MAPREDUCE-4846) | Some JobQueueInfo methods are public in MR1 but protected in MR2 | Major | client | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-3787](https://issues.apache.org/jira/browse/MAPREDUCE-3787) | [Gridmix] Improve STRESS mode | Major | contrib/gridmix | Amar Kamat | Amar Kamat |
+| [YARN-518](https://issues.apache.org/jira/browse/YARN-518) | Fair Scheduler's document link could be added to the hadoop 2.x main doc page | Major | documentation | Dapeng Sun | Sandy Ryza |
+| [MAPREDUCE-5128](https://issues.apache.org/jira/browse/MAPREDUCE-5128) | mapred-default.xml is missing a bunch of history server configs | Major | documentation, jobhistoryserver | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9450](https://issues.apache.org/jira/browse/HADOOP-9450) | HADOOP\_USER\_CLASSPATH\_FIRST is not honored; CLASSPATH is PREpended instead of APpended | Major | scripts | Mitch Wyle | Harsh J |
+| [MAPREDUCE-5069](https://issues.apache.org/jira/browse/MAPREDUCE-5069) | add concrete common implementations of CombineFileInputFormat | Minor | mrv1, mrv2 | Sangjin Lee | Sangjin Lee |
+| [HADOOP-9503](https://issues.apache.org/jira/browse/HADOOP-9503) | Remove sleep between IPC client connect timeouts | Minor | ipc | Varun Sharma | Varun Sharma |
+| [HDFS-4721](https://issues.apache.org/jira/browse/HDFS-4721) | Speed up lease/block recovery when DN fails and a block goes into recovery | Major | namenode | Varun Sharma | Varun Sharma |
+| [HADOOP-9322](https://issues.apache.org/jira/browse/HADOOP-9322) | LdapGroupsMapping doesn't seem to set a timeout for its directory search | Minor | security | Harsh J | Harsh J |
+| [HADOOP-9338](https://issues.apache.org/jira/browse/HADOOP-9338) | FsShell Copy Commands Should Optionally Preserve File Attributes | Major | fs | Nick White | Nick White |
+| [HADOOP-8608](https://issues.apache.org/jira/browse/HADOOP-8608) | Add Configuration API for parsing time durations | Minor | conf | Todd Lipcon | Chris Douglas |
+| [HADOOP-9483](https://issues.apache.org/jira/browse/HADOOP-9483) | winutils support for readlink command | Major | util | Chris Nauroth | Arpit Agarwal |
+| [HADOOP-9511](https://issues.apache.org/jira/browse/HADOOP-9511) | Adding support for additional input streams (FSDataInputStream and RandomAccessFile) in SecureIOUtils. | Major | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
+| [HDFS-4804](https://issues.apache.org/jira/browse/HDFS-4804) | WARN when users set the block balanced preference percent below 0.5 or above 1.0 | Minor | . | Stephen Chu | Stephen Chu |
+| [YARN-598](https://issues.apache.org/jira/browse/YARN-598) | Add virtual cores to queue metrics | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza |
+| [YARN-590](https://issues.apache.org/jira/browse/YARN-590) | Add an optional mesage to RegisterNodeManagerResponse as to why NM is being asked to resync or shutdown | Major | . | Vinod Kumar Vavilapalli | Mayank Bansal |
+| [HADOOP-9560](https://issues.apache.org/jira/browse/HADOOP-9560) | metrics2#JvmMetrics should have max memory size of JVM | Minor | metrics | Tsuyoshi Ozawa | Tsuyoshi Ozawa |
+| [HADOOP-9523](https://issues.apache.org/jira/browse/HADOOP-9523) | Provide a generic IBM java vendor flag in PlatformName.java to support non-Sun JREs | Major | . | Tian Hong Wang | Tian Hong Wang |
+| [HDFS-4698](https://issues.apache.org/jira/browse/HDFS-4698) | provide client-side metrics for remote reads, local reads, and short-circuit reads | Minor | hdfs-client | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-347](https://issues.apache.org/jira/browse/HDFS-347) | DFS read performance suboptimal when client co-located on nodes with data | Major | datanode, hdfs-client, performance | George Porter | Colin P. McCabe |
+| [HDFS-4787](https://issues.apache.org/jira/browse/HDFS-4787) | Create a new HdfsConfiguration before each TestDFSClientRetries testcases | Major | . | Tian Hong Wang | Tian Hong Wang |
+| [MAPREDUCE-5246](https://issues.apache.org/jira/browse/MAPREDUCE-5246) | Adding application type to submission context | Major | . | Mayank Bansal | Mayank Bansal |
+| [HDFS-4848](https://issues.apache.org/jira/browse/HDFS-4848) | copyFromLocal and renaming a file to ".snapshot" should output that ".snapshot" is a reserved name | Minor | snapshots | Stephen Chu | Jing Zhao |
+| [HADOOP-9605](https://issues.apache.org/jira/browse/HADOOP-9605) | Update junit dependency | Major | build | Timothy St. Clair | |
+| [HDFS-3498](https://issues.apache.org/jira/browse/HDFS-3498) | Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass | Major | namenode | Junping Du | Junping Du |
+| [MAPREDUCE-5268](https://issues.apache.org/jira/browse/MAPREDUCE-5268) | Improve history server startup performance | Major | jobhistoryserver | Jason Lowe | Karthik Kambatla |
+| [MAPREDUCE-5283](https://issues.apache.org/jira/browse/MAPREDUCE-5283) | Over 10 different tests have near identical implementations of AppContext | Major | applicationmaster, test | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9604](https://issues.apache.org/jira/browse/HADOOP-9604) | Wrong Javadoc of FSDataOutputStream | Minor | fs | Jingguo Yao | Jingguo Yao |
+| [HADOOP-9625](https://issues.apache.org/jira/browse/HADOOP-9625) | HADOOP\_OPTS not picked up by hadoop command | Minor | bin, conf | Paul Han | Paul Han |
+| [YARN-600](https://issues.apache.org/jira/browse/YARN-600) | Hook up cgroups CPU settings to the number of virtual cores allocated | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza |
+| [YARN-117](https://issues.apache.org/jira/browse/YARN-117) | Enhance YARN service model | Major | . | Steve Loughran | Steve Loughran |
+| [YARN-782](https://issues.apache.org/jira/browse/YARN-782) | vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way | Critical | nodemanager | Sandy Ryza | Sandy Ryza |
| [MAPREDUCE-3533](https://issues.apache.org/jira/browse/MAPREDUCE-3533) | have the service interface extend Closeable and use close() as its shutdown operation | Minor | mrv2 | Steve Loughran | |
-| [YARN-1045](https://issues.apache.org/jira/browse/YARN-1045) | Improve toString implementation for PBImpls | Major | . | Siddharth Seth | Jian He |
-| [YARN-883](https://issues.apache.org/jira/browse/YARN-883) | Expose Fair Scheduler-specific queue metrics | Major | scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-865](https://issues.apache.org/jira/browse/YARN-865) | RM webservices can't query based on application Types | Major | . | Xuan Gong | Xuan Gong |
| [YARN-803](https://issues.apache.org/jira/browse/YARN-803) | factor out scheduler config validation from the ResourceManager to each scheduler implementation | Major | resourcemanager, scheduler | Alejandro Abdelnur | Alejandro Abdelnur |
| [YARN-789](https://issues.apache.org/jira/browse/YARN-789) | Enable zero capabilities resource requests in fair scheduler | Major | scheduler | Alejandro Abdelnur | Alejandro Abdelnur |
-| [YARN-782](https://issues.apache.org/jira/browse/YARN-782) | vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way | Critical | nodemanager | Sandy Ryza | Sandy Ryza |
| [YARN-752](https://issues.apache.org/jira/browse/YARN-752) | In AMRMClient, automatically add corresponding rack requests for requested nodes | Major | api, applications | Sandy Ryza | Sandy Ryza |
+| [MAPREDUCE-5171](https://issues.apache.org/jira/browse/MAPREDUCE-5171) | Expose blacklisted nodes from the MR AM REST API | Major | applicationmaster | Sandy Ryza | Sandy Ryza |
+| [HDFS-4461](https://issues.apache.org/jira/browse/HDFS-4461) | DirectoryScanner: volume path prefix takes up memory for every block that is scanned | Minor | . | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-4914](https://issues.apache.org/jira/browse/HDFS-4914) | When possible, Use DFSClient.Conf instead of Configuration | Minor | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-4772](https://issues.apache.org/jira/browse/HDFS-4772) | Add number of children in HdfsFileStatus | Minor | namenode | Brandon Li | Brandon Li |
| [YARN-736](https://issues.apache.org/jira/browse/YARN-736) | Add a multi-resource fair sharing metric | Major | scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-600](https://issues.apache.org/jira/browse/YARN-600) | Hook up cgroups CPU settings to the number of virtual cores allocated | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-598](https://issues.apache.org/jira/browse/YARN-598) | Add virtual cores to queue metrics | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-590](https://issues.apache.org/jira/browse/YARN-590) | Add an optional mesage to RegisterNodeManagerResponse as to why NM is being asked to resync or shutdown | Major | . | Vinod Kumar Vavilapalli | Mayank Bansal |
-| [YARN-538](https://issues.apache.org/jira/browse/YARN-538) | RM address DNS lookup can cause unnecessary slowness on every JHS page load | Major | . | Sandy Ryza | Sandy Ryza |
-| [YARN-525](https://issues.apache.org/jira/browse/YARN-525) | make CS node-locality-delay refreshable | Major | capacityscheduler | Thomas Graves | Thomas Graves |
-| [YARN-518](https://issues.apache.org/jira/browse/YARN-518) | Fair Scheduler's document link could be added to the hadoop 2.x main doc page | Major | documentation | Dapeng Sun | Sandy Ryza |
-| [YARN-447](https://issues.apache.org/jira/browse/YARN-447) | applicationComparator improvement for CS | Minor | scheduler | Nemon Lou | Nemon Lou |
-| [YARN-406](https://issues.apache.org/jira/browse/YARN-406) | TestRackResolver fails when local network resolves "host1" to a valid host | Minor | . | Hitesh Shah | Hitesh Shah |
-| [YARN-391](https://issues.apache.org/jira/browse/YARN-391) | detabify LCEResourcesHandler classes | Trivial | nodemanager | Steve Loughran | Steve Loughran |
-| [YARN-385](https://issues.apache.org/jira/browse/YARN-385) | ResourceRequestPBImpl's toString() is missing location and # containers | Major | api | Sandy Ryza | Sandy Ryza |
-| [YARN-382](https://issues.apache.org/jira/browse/YARN-382) | SchedulerUtils improve way normalizeRequest sets the resource capabilities | Major | scheduler | Thomas Graves | Zhijie Shen |
-| [YARN-381](https://issues.apache.org/jira/browse/YARN-381) | Improve FS docs | Minor | documentation | Eli Collins | Sandy Ryza |
+| [HADOOP-9661](https://issues.apache.org/jira/browse/HADOOP-9661) | Allow metrics sources to be extended | Major | metrics | Sandy Ryza | Sandy Ryza |
+| [HDFS-4932](https://issues.apache.org/jira/browse/HDFS-4932) | Avoid a wide line on the name node webUI if we have more Journal nodes | Minor | ha, namenode | Fengdong Yu | Fengdong Yu |
+| [HADOOP-9673](https://issues.apache.org/jira/browse/HADOOP-9673) | NetworkTopology: when a node can't be added, print out its location for diagnostic purposes | Trivial | net | Colin P. McCabe | Colin P. McCabe |
+| [YARN-883](https://issues.apache.org/jira/browse/YARN-883) | Expose Fair Scheduler-specific queue metrics | Major | scheduler | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9676](https://issues.apache.org/jira/browse/HADOOP-9676) | make maximum RPC buffer size configurable | Minor | . | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-4465](https://issues.apache.org/jira/browse/HDFS-4465) | Optimize datanode ReplicasMap and ReplicaInfo | Major | datanode | Suresh Srinivas | Aaron T. Myers |
+| [HDFS-4645](https://issues.apache.org/jira/browse/HDFS-4645) | Move from randomly generated block ID to sequentially generated block ID | Major | namenode | Suresh Srinivas | Arpit Agarwal |
+| [HDFS-4978](https://issues.apache.org/jira/browse/HDFS-4978) | Make disallowSnapshot idempotent | Major | . | Jing Zhao | Jing Zhao |
+| [HDFS-4912](https://issues.apache.org/jira/browse/HDFS-4912) | Cleanup FSNamesystem#startFileInternal | Major | namenode | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-4521](https://issues.apache.org/jira/browse/HDFS-4521) | invalid network topologies should not be cached | Minor | . | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-2042](https://issues.apache.org/jira/browse/HDFS-2042) | Require c99 when building libhdfs | Minor | libhdfs | Eli Collins | |
+| [HDFS-4992](https://issues.apache.org/jira/browse/HDFS-4992) | Make balancer's thread count configurable | Major | balancer & mover | Max Lapan | Max Lapan |
+| [MAPREDUCE-5398](https://issues.apache.org/jira/browse/MAPREDUCE-5398) | MR changes for YARN-513 | Major | . | Bikas Saha | Jian He |
+| [HADOOP-9734](https://issues.apache.org/jira/browse/HADOOP-9734) | Common protobuf definitions for GetUserMappingsProtocol, RefreshAuthorizationPolicyProtocol and RefreshUserMappingsProtocol | Minor | ipc | Jason Lowe | Jason Lowe |
+| [HDFS-4903](https://issues.apache.org/jira/browse/HDFS-4903) | Print trash configuration and trash emptier state in namenode log | Minor | namenode | Suresh Srinivas | Arpit Agarwal |
+| [YARN-865](https://issues.apache.org/jira/browse/YARN-865) | RM webservices can't query based on application Types | Major | . | Xuan Gong | Xuan Gong |
+| [HDFS-4996](https://issues.apache.org/jira/browse/HDFS-4996) | ClientProtocol#metaSave can be made idempotent by overwriting the output file instead of appending to it | Minor | namenode | Chris Nauroth | Chris Nauroth |
+| [HADOOP-9164](https://issues.apache.org/jira/browse/HADOOP-9164) | Print paths of loaded native libraries in NativeLibraryChecker | Minor | native | Binglin Chang | Binglin Chang |
+| [HADOOP-9717](https://issues.apache.org/jira/browse/HADOOP-9717) | Add retry attempt count to the RPC requests | Major | ipc | Suresh Srinivas | Jing Zhao |
+| [HDFS-5007](https://issues.apache.org/jira/browse/HDFS-5007) | Replace hard-coded property keys with DFSConfigKeys fields | Minor | . | Kousuke Saruta | Kousuke Saruta |
+| [HDFS-5010](https://issues.apache.org/jira/browse/HDFS-5010) | Reduce the frequency of getCurrentUser() calls from namenode | Major | namenode, performance | Kihwal Lee | Kihwal Lee |
+| [HADOOP-9688](https://issues.apache.org/jira/browse/HADOOP-9688) | Add globally unique Client ID to RPC requests | Blocker | ipc | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-9691](https://issues.apache.org/jira/browse/HADOOP-9691) | RPC clients can generate call ID using AtomicInteger instead of synchronizing on the Client instance. | Minor | ipc | Chris Nauroth | Chris Nauroth |
+| [HADOOP-9716](https://issues.apache.org/jira/browse/HADOOP-9716) | Move the Rpc request call ID generation to client side InvocationHandler | Major | ipc | Suresh Srinivas | Tsz Wo Nicholas Sze |
+| [HADOOP-9751](https://issues.apache.org/jira/browse/HADOOP-9751) | Add clientId and retryCount to RpcResponseHeaderProto | Major | ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-9754](https://issues.apache.org/jira/browse/HADOOP-9754) | Clean up RPC code | Minor | ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-5008](https://issues.apache.org/jira/browse/HDFS-5008) | Make ClientProtocol#abandonBlock() idempotent | Major | namenode | Suresh Srinivas | Jing Zhao |
+| [HADOOP-9760](https://issues.apache.org/jira/browse/HADOOP-9760) | Move GSet and LightWeightGSet to hadoop-common | Major | util | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-5020](https://issues.apache.org/jira/browse/HDFS-5020) | Make DatanodeProtocol#blockReceivedAndDeleted idempotent | Major | namenode | Jing Zhao | Jing Zhao |
+| [HADOOP-9762](https://issues.apache.org/jira/browse/HADOOP-9762) | RetryCache utility for implementing RPC retries | Major | util | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-9770](https://issues.apache.org/jira/browse/HADOOP-9770) | Make RetryCache#state non volatile | Minor | util | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-9756](https://issues.apache.org/jira/browse/HADOOP-9756) | Additional cleanup RPC code | Minor | ipc | Junping Du | Junping Du |
| [YARN-347](https://issues.apache.org/jira/browse/YARN-347) | YARN CLI should show CPU info besides memory info in node status | Major | client | Junping Du | Junping Du |
-| [YARN-297](https://issues.apache.org/jira/browse/YARN-297) | Improve hashCode implementations for PB records | Major | . | Arun C Murthy | Xuan Gong |
-| [YARN-249](https://issues.apache.org/jira/browse/YARN-249) | Capacity Scheduler web page should show list of active users per queue like it used to (in 1.x) | Major | capacityscheduler | Ravi Prakash | Ravi Prakash |
-| [YARN-237](https://issues.apache.org/jira/browse/YARN-237) | Refreshing the RM page forgets how many rows I had in my Datatables | Major | resourcemanager | Ravi Prakash | Jian He |
-| [YARN-198](https://issues.apache.org/jira/browse/YARN-198) | If we are navigating to Nodemanager UI from Resourcemanager,then there is not link to navigate back to Resource manager | Minor | nodemanager | Ramgopal N | Jian He |
-| [YARN-117](https://issues.apache.org/jira/browse/YARN-117) | Enhance YARN service model | Major | . | Steve Loughran | Steve Loughran |
-| [YARN-84](https://issues.apache.org/jira/browse/YARN-84) | Use Builder to get RPC server in YARN | Minor | . | Brandon Li | Brandon Li |
+| [HDFS-5027](https://issues.apache.org/jira/browse/HDFS-5027) | On startup, DN should scan volumes in parallel | Major | datanode | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-9792](https://issues.apache.org/jira/browse/HADOOP-9792) | Retry the methods that are tagged @AtMostOnce along with @Idempotent | Major | ipc | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-5352](https://issues.apache.org/jira/browse/MAPREDUCE-5352) | Optimize node local splits generated by CombineFileInputFormat | Major | . | Siddharth Seth | Siddharth Seth |
+| [HADOOP-9845](https://issues.apache.org/jira/browse/HADOOP-9845) | Update protobuf to 2.5 from 2.4.x | Blocker | performance | stack | Alejandro Abdelnur |
+| [YARN-1045](https://issues.apache.org/jira/browse/YARN-1045) | Improve toString implementation for PBImpls | Major | . | Siddharth Seth | Jian He |
+| [HDFS-4942](https://issues.apache.org/jira/browse/HDFS-4942) | Add retry cache support in Namenode | Major | ha, namenode | Suresh Srinivas | Suresh Srinivas |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9872](https://issues.apache.org/jira/browse/HADOOP-9872) | Improve protoc version handling and detection | Blocker | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-9850](https://issues.apache.org/jira/browse/HADOOP-9850) | RPC kerberos errors don't trigger relogin | Blocker | ipc | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9816](https://issues.apache.org/jira/browse/HADOOP-9816) | RPC Sasl QOP is broken | Blocker | ipc, security | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9787](https://issues.apache.org/jira/browse/HADOOP-9787) | ShutdownHelper util to shutdown threads and threadpools | Major | util | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-9786](https://issues.apache.org/jira/browse/HADOOP-9786) | RetryInvocationHandler#isRpcInvocation should support ProtocolTranslator | Major | . | Jing Zhao | Jing Zhao |
-| [HADOOP-9773](https://issues.apache.org/jira/browse/HADOOP-9773) | TestLightWeightCache fails | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-9759](https://issues.apache.org/jira/browse/HADOOP-9759) | Add support for NativeCodeLoader#getLibraryName on Windows | Critical | . | Chuan Liu | Chuan Liu |
-| [HADOOP-9738](https://issues.apache.org/jira/browse/HADOOP-9738) | TestDistCh fails | Major | tools | Kihwal Lee | Jing Zhao |
-| [HADOOP-9707](https://issues.apache.org/jira/browse/HADOOP-9707) | Fix register lists for crc32c inline assembly | Minor | util | Todd Lipcon | Todd Lipcon |
-| [HADOOP-9701](https://issues.apache.org/jira/browse/HADOOP-9701) | mvn site ambiguous links in hadoop-common | Minor | documentation | Steve Loughran | Karthik Kambatla |
-| [HADOOP-9681](https://issues.apache.org/jira/browse/HADOOP-9681) | FileUtil.unTarUsingJava() should close the InputStream upon finishing | Minor | . | Chuan Liu | Chuan Liu |
-| [HADOOP-9678](https://issues.apache.org/jira/browse/HADOOP-9678) | TestRPC#testStopsAllThreads intermittently fails on Windows | Major | . | Ivan Mitic | Ivan Mitic |
-| [HADOOP-9665](https://issues.apache.org/jira/browse/HADOOP-9665) | BlockDecompressorStream#decompress will throw EOFException instead of return -1 when EOF | Critical | . | Zhijie Shen | Zhijie Shen |
-| [HADOOP-9656](https://issues.apache.org/jira/browse/HADOOP-9656) | Gridmix unit tests fail on Windows and Linux | Minor | test, tools | Chuan Liu | Chuan Liu |
-| [HADOOP-9643](https://issues.apache.org/jira/browse/HADOOP-9643) | org.apache.hadoop.security.SecurityUtil calls toUpperCase(Locale.getDefault()) as well as toLowerCase(Locale.getDefault()) on hadoop.security.authentication value. | Minor | security | Mark Miller | Mark Miller |
-| [HADOOP-9638](https://issues.apache.org/jira/browse/HADOOP-9638) | parallel test changes caused invalid test path for several HDFS tests on Windows | Major | test | Chris Nauroth | Andrey Klochkov |
-| [HADOOP-9637](https://issues.apache.org/jira/browse/HADOOP-9637) | Adding Native Fstat for Windows as needed by YARN | Major | . | Chuan Liu | Chuan Liu |
-| [HADOOP-9632](https://issues.apache.org/jira/browse/HADOOP-9632) | TestShellCommandFencer will fail if there is a 'host' machine in the network | Minor | . | Chuan Liu | Chuan Liu |
-| [HADOOP-9607](https://issues.apache.org/jira/browse/HADOOP-9607) | Fixes in Javadoc build | Minor | documentation | Timothy St. Clair | |
-| [HADOOP-9599](https://issues.apache.org/jira/browse/HADOOP-9599) | hadoop-config.cmd doesn't set JAVA\_LIBRARY\_PATH correctly | Major | . | Mostafa Elhemali | Mostafa Elhemali |
-| [HADOOP-9593](https://issues.apache.org/jira/browse/HADOOP-9593) | stack trace printed at ERROR for all yarn clients without hadoop.home set | Major | util | Steve Loughran | Steve Loughran |
-| [HADOOP-9581](https://issues.apache.org/jira/browse/HADOOP-9581) | hadoop --config non-existent directory should result in error | Major | scripts | Ashwin Shankar | Ashwin Shankar |
-| [HADOOP-9574](https://issues.apache.org/jira/browse/HADOOP-9574) | Add new methods in AbstractDelegationTokenSecretManager for restoring RMDelegationTokens on RMRestart | Major | . | Jian He | Jian He |
-| [HADOOP-9566](https://issues.apache.org/jira/browse/HADOOP-9566) | Performing direct read using libhdfs sometimes raises SIGPIPE (which in turn throws SIGABRT) causing client crashes | Major | native | Lenni Kuff | Colin Patrick McCabe |
-| [HADOOP-9563](https://issues.apache.org/jira/browse/HADOOP-9563) | Fix incompatibility introduced by HADOOP-9523 | Major | util | Kihwal Lee | Tian Hong Wang |
-| [HADOOP-9556](https://issues.apache.org/jira/browse/HADOOP-9556) | disable HA tests on Windows that fail due to ZooKeeper client connection management bug | Major | ha, test | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9553](https://issues.apache.org/jira/browse/HADOOP-9553) | TestAuthenticationToken fails on Windows | Major | test | Arpit Agarwal | Arpit Agarwal |
-| [HADOOP-9550](https://issues.apache.org/jira/browse/HADOOP-9550) | Remove aspectj dependency | Major | . | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-9549](https://issues.apache.org/jira/browse/HADOOP-9549) | WebHdfsFileSystem hangs on close() | Blocker | security | Kihwal Lee | Daryn Sharp |
-| [HADOOP-9532](https://issues.apache.org/jira/browse/HADOOP-9532) | HADOOP\_CLIENT\_OPTS is appended twice by Windows cmd scripts | Minor | bin | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9527](https://issues.apache.org/jira/browse/HADOOP-9527) | Add symlink support to LocalFileSystem on Windows | Major | fs, test | Arpit Agarwal | Arpit Agarwal |
-| [HADOOP-9526](https://issues.apache.org/jira/browse/HADOOP-9526) | TestShellCommandFencer and TestShell fail on Windows | Major | test | Arpit Agarwal | Arpit Agarwal |
-| [HADOOP-9524](https://issues.apache.org/jira/browse/HADOOP-9524) | Fix ShellCommandFencer to work on Windows | Major | ha | Arpit Agarwal | Arpit Agarwal |
-| [HADOOP-9517](https://issues.apache.org/jira/browse/HADOOP-9517) | Document Hadoop Compatibility | Blocker | documentation | Arun C Murthy | Karthik Kambatla |
-| [HADOOP-9507](https://issues.apache.org/jira/browse/HADOOP-9507) | LocalFileSystem rename() is broken in some cases when destination exists | Minor | fs | Mostafa Elhemali | Chris Nauroth |
-| [HADOOP-9504](https://issues.apache.org/jira/browse/HADOOP-9504) | MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo | Critical | metrics | Liang Xie | Liang Xie |
-| [HADOOP-9500](https://issues.apache.org/jira/browse/HADOOP-9500) | TestUserGroupInformation#testGetServerSideGroups fails on Windows due to failure to find winutils.exe | Major | test | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9496](https://issues.apache.org/jira/browse/HADOOP-9496) | Bad merge of HADOOP-9450 on branch-2 breaks all bin/hadoop calls that need HADOOP\_CLASSPATH | Critical | bin | Gopal V | Harsh J |
-| [HADOOP-9490](https://issues.apache.org/jira/browse/HADOOP-9490) | LocalFileSystem#reportChecksumFailure not closing the checksum file handle before rename | Major | fs | Ivan Mitic | Ivan Mitic |
-| [HADOOP-9488](https://issues.apache.org/jira/browse/HADOOP-9488) | FileUtil#createJarWithClassPath only substitutes environment variables from current process environment/does not support overriding when launching new process | Major | fs | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9486](https://issues.apache.org/jira/browse/HADOOP-9486) | Promote Windows and Shell related utils from YARN to Hadoop Common | Major | . | Vinod Kumar Vavilapalli | Chris Nauroth |
-| [HADOOP-9485](https://issues.apache.org/jira/browse/HADOOP-9485) | No default value in the code for hadoop.rpc.socket.factory.class.default | Minor | net | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-9481](https://issues.apache.org/jira/browse/HADOOP-9481) | Broken conditional logic with HADOOP\_SNAPPY\_LIBRARY | Minor | . | Vadim Bondarev | Vadim Bondarev |
-| [HADOOP-9473](https://issues.apache.org/jira/browse/HADOOP-9473) | typo in FileUtil copy() method | Trivial | fs | Glen Mazza | |
-| [HADOOP-9469](https://issues.apache.org/jira/browse/HADOOP-9469) | mapreduce/yarn source jars not included in dist tarball | Major | . | Thomas Graves | Robert Parker |
-| [HADOOP-9459](https://issues.apache.org/jira/browse/HADOOP-9459) | ActiveStandbyElector can join election even before Service HEALTHY, and results in null data at ActiveBreadCrumb | Critical | ha | Vinayakumar B | Vinayakumar B |
-| [HADOOP-9455](https://issues.apache.org/jira/browse/HADOOP-9455) | HADOOP\_CLIENT\_OPTS appended twice causes JVM failures | Minor | bin | Sangjin Lee | Chris Nauroth |
-| [HADOOP-9451](https://issues.apache.org/jira/browse/HADOOP-9451) | Node with one topology layer should be handled as fault topology when NodeGroup layer is enabled | Major | net | Junping Du | Junping Du |
-| [HADOOP-9443](https://issues.apache.org/jira/browse/HADOOP-9443) | Port winutils static code analysis change to trunk | Major | . | Chuan Liu | Chuan Liu |
-| [HADOOP-9439](https://issues.apache.org/jira/browse/HADOOP-9439) | JniBasedUnixGroupsMapping: fix some crash bugs | Minor | native | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-9437](https://issues.apache.org/jira/browse/HADOOP-9437) | TestNativeIO#testRenameTo fails on Windows due to assumption that POSIX errno is embedded in NativeIOException | Major | test | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9430](https://issues.apache.org/jira/browse/HADOOP-9430) | TestSSLFactory fails on IBM JVM | Major | security | Amir Sanjar | |
-| [HADOOP-9429](https://issues.apache.org/jira/browse/HADOOP-9429) | TestConfiguration fails with IBM JAVA | Major | test | Amir Sanjar | |
-| [HADOOP-9413](https://issues.apache.org/jira/browse/HADOOP-9413) | Introduce common utils for File#setReadable/Writable/Executable and File#canRead/Write/Execute that work cross-platform | Major | . | Ivan Mitic | Ivan Mitic |
-| [HADOOP-9408](https://issues.apache.org/jira/browse/HADOOP-9408) | misleading description for net.topology.table.file.name property in core-default.xml | Minor | conf | rajeshbabu | rajeshbabu |
-| [HADOOP-9407](https://issues.apache.org/jira/browse/HADOOP-9407) | commons-daemon 1.0.3 dependency has bad group id causing build issues | Major | build | Sangjin Lee | Sangjin Lee |
-| [HADOOP-9397](https://issues.apache.org/jira/browse/HADOOP-9397) | Incremental dist tar build fails | Major | build | Jason Lowe | Chris Nauroth |
-| [HADOOP-9388](https://issues.apache.org/jira/browse/HADOOP-9388) | TestFsShellCopy fails on Windows | Major | . | Ivan Mitic | Ivan Mitic |
-| [HADOOP-9387](https://issues.apache.org/jira/browse/HADOOP-9387) | TestDFVariations fails on Windows after the merge | Minor | fs | Ivan Mitic | Ivan Mitic |
-| [HADOOP-9376](https://issues.apache.org/jira/browse/HADOOP-9376) | TestProxyUserFromEnv fails on a Windows domain joined machine | Major | . | Ivan Mitic | Ivan Mitic |
-| [HADOOP-9373](https://issues.apache.org/jira/browse/HADOOP-9373) | Merge CHANGES.branch-trunk-win.txt to CHANGES.txt | Minor | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-9372](https://issues.apache.org/jira/browse/HADOOP-9372) | Fix bad timeout annotations on tests | Major | . | Arpit Agarwal | Arpit Agarwal |
-| [HADOOP-9369](https://issues.apache.org/jira/browse/HADOOP-9369) | DNS#reverseDns() can return hostname with . appended at the end | Major | net | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-9365](https://issues.apache.org/jira/browse/HADOOP-9365) | TestHAZKUtil fails
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[20/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.9.0/CHANGES.0.9.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.9.0/CHANGES.0.9.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.9.0/CHANGES.0.9.0.md
index 2b0e48c..ea968d6 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.9.0/CHANGES.0.9.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.9.0/CHANGES.0.9.0.md
@@ -20,16 +20,6 @@
## Release 0.9.0 - 2006-12-01
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
@@ -43,61 +33,61 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-725](https://issues.apache.org/jira/browse/HADOOP-725) | chooseTargets method in FSNamesystem is very inefficient | Major | . | Milind Bhandarkar | Milind Bhandarkar |
-| [HADOOP-721](https://issues.apache.org/jira/browse/HADOOP-721) | jobconf.jsp shouldn't find the jobconf.xsl via http | Major | . | Owen O'Malley | Arun C Murthy |
-| [HADOOP-689](https://issues.apache.org/jira/browse/HADOOP-689) | hadoop should provide a common way to wrap instances with different types into one type | Major | io | Feng Jiang | |
-| [HADOOP-688](https://issues.apache.org/jira/browse/HADOOP-688) | move dfs administrative interfaces to a separate command | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-677](https://issues.apache.org/jira/browse/HADOOP-677) | RPC should send a fixed header and version at the start of connection | Major | ipc | Owen O'Malley | Owen O'Malley |
-| [HADOOP-668](https://issues.apache.org/jira/browse/HADOOP-668) | improvement to DFS browsing WI | Minor | . | Yoram Arnon | Hairong Kuang |
-| [HADOOP-661](https://issues.apache.org/jira/browse/HADOOP-661) | JobConf for a job should be viewable from the web/ui | Major | . | Owen O'Malley | Arun C Murthy |
| [HADOOP-655](https://issues.apache.org/jira/browse/HADOOP-655) | remove deprecations | Minor | . | Doug Cutting | Doug Cutting |
-| [HADOOP-613](https://issues.apache.org/jira/browse/HADOOP-613) | The final merge on the reduces should feed the reduce directly | Major | . | Owen O'Malley | Devaraj Das |
| [HADOOP-565](https://issues.apache.org/jira/browse/HADOOP-565) | Upgrade Jetty to 6.x | Major | . | Owen O'Malley | Sanjay Dahiya |
-| [HADOOP-538](https://issues.apache.org/jira/browse/HADOOP-538) | Implement a nio's 'direct buffer' based wrapper over zlib to improve performance of java.util.zip.{De\|In}flater as a 'custom codec' | Major | io | Arun C Murthy | Arun C Murthy |
+| [HADOOP-688](https://issues.apache.org/jira/browse/HADOOP-688) | move dfs administrative interfaces to a separate command | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-613](https://issues.apache.org/jira/browse/HADOOP-613) | The final merge on the reduces should feed the reduce directly | Major | . | Owen O'Malley | Devaraj Das |
+| [HADOOP-661](https://issues.apache.org/jira/browse/HADOOP-661) | JobConf for a job should be viewable from the web/ui | Major | . | Owen O'Malley | Arun C Murthy |
| [HADOOP-489](https://issues.apache.org/jira/browse/HADOOP-489) | Seperating user logs from system logs in map reduce | Minor | . | Mahadev konar | Arun C Murthy |
+| [HADOOP-668](https://issues.apache.org/jira/browse/HADOOP-668) | improvement to DFS browsing WI | Minor | . | Yoram Arnon | Hairong Kuang |
+| [HADOOP-538](https://issues.apache.org/jira/browse/HADOOP-538) | Implement a nio's 'direct buffer' based wrapper over zlib to improve performance of java.util.zip.{De\|In}flater as a 'custom codec' | Major | io | Arun C Murthy | Arun C Murthy |
+| [HADOOP-721](https://issues.apache.org/jira/browse/HADOOP-721) | jobconf.jsp shouldn't find the jobconf.xsl via http | Major | . | Owen O'Malley | Arun C Murthy |
+| [HADOOP-725](https://issues.apache.org/jira/browse/HADOOP-725) | chooseTargets method in FSNamesystem is very inefficient | Major | . | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-677](https://issues.apache.org/jira/browse/HADOOP-677) | RPC should send a fixed header and version at the start of connection | Major | ipc | Owen O'Malley | Owen O'Malley |
| [HADOOP-76](https://issues.apache.org/jira/browse/HADOOP-76) | Implement speculative re-execution of reduces | Minor | . | Doug Cutting | Sanjay Dahiya |
+| [HADOOP-689](https://issues.apache.org/jira/browse/HADOOP-689) | hadoop should provide a common way to wrap instances with different types into one type | Major | io | Feng Jiang | |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-750](https://issues.apache.org/jira/browse/HADOOP-750) | race condition on stalled map output fetches | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-749](https://issues.apache.org/jira/browse/HADOOP-749) | The jobfailures.jsp gets a NullPointerException after a task tracker has been lost | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-747](https://issues.apache.org/jira/browse/HADOOP-747) | RecordIO compiler does not produce correct Java code when buffer is used as key or value in map | Major | record | Milind Bhandarkar | Milind Bhandarkar |
-| [HADOOP-741](https://issues.apache.org/jira/browse/HADOOP-741) | Fix average progress calculation in speculative execution of maps + fix pending issues in speculative execution of reduces | Major | . | Sanjay Dahiya | Sanjay Dahiya |
-| [HADOOP-739](https://issues.apache.org/jira/browse/HADOOP-739) | TestIPC occassionally fails with BindException | Minor | test | Nigel Daley | Nigel Daley |
-| [HADOOP-736](https://issues.apache.org/jira/browse/HADOOP-736) | Roll back Jetty6.0.1 to Jetty5.1.4 | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-734](https://issues.apache.org/jira/browse/HADOOP-734) | Link to the FAQ in the "Documentation" section of the hadoop website | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-733](https://issues.apache.org/jira/browse/HADOOP-733) | dfs shell has inconsistent exit codes | Major | . | Christian Kunz | dhruba borthakur |
-| [HADOOP-729](https://issues.apache.org/jira/browse/HADOOP-729) | packageNativeHadoop.sh has non-standard sh code | Critical | scripts | Arun C Murthy | Arun C Murthy |
-| [HADOOP-728](https://issues.apache.org/jira/browse/HADOOP-728) | Map-reduce task does not produce correct results when -reducer NONE is specified through streaming | Major | . | dhruba borthakur | Sanjay Dahiya |
-| [HADOOP-724](https://issues.apache.org/jira/browse/HADOOP-724) | bin/hadoop:111 uses java directly, it should use JAVA\_HOME | Minor | scripts | Sanjay Dahiya | Arun C Murthy |
-| [HADOOP-723](https://issues.apache.org/jira/browse/HADOOP-723) | Race condition exists in the method MapOutputLocation.getFile | Major | . | Devaraj Das | Owen O'Malley |
-| [HADOOP-722](https://issues.apache.org/jira/browse/HADOOP-722) | native-hadoop deficiencies | Critical | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-682](https://issues.apache.org/jira/browse/HADOOP-682) | hadoop namenode -format doesnt work anymore if target directory doesnt exist | Major | . | Sanjay Dahiya | |
+| [HADOOP-687](https://issues.apache.org/jira/browse/HADOOP-687) | Upgrade to Jetty 6 does not patch bin/hadoop | Critical | scripts | Sameer Paranjpye | Sameer Paranjpye |
+| [HADOOP-683](https://issues.apache.org/jira/browse/HADOOP-683) | bin/hadoop.sh doesn't work for /bin/dash (eg ubuntu 6.10b) | Trivial | scripts | James Todd | |
+| [HADOOP-604](https://issues.apache.org/jira/browse/HADOOP-604) | DataNodes get NullPointerException and become unresponsive on 50010 | Major | . | Christian Kunz | Raghu Angadi |
+| [HADOOP-459](https://issues.apache.org/jira/browse/HADOOP-459) | libhdfs leaks memory when writing to files | Major | . | Christian Kunz | Sameer Paranjpye |
+| [HADOOP-694](https://issues.apache.org/jira/browse/HADOOP-694) | jobtracker expireluanching tasks throws out Nullpointer exceptions | Minor | . | Mahadev konar | Mahadev konar |
+| [HADOOP-637](https://issues.apache.org/jira/browse/HADOOP-637) | ipc.Server has memory leak -- serious issue for namenode server | Major | ipc | Christian Kunz | Raghu Angadi |
+| [HADOOP-696](https://issues.apache.org/jira/browse/HADOOP-696) | TestTextInputFormat fails on some platforms due to non-determinism in format.getSplits() | Minor | test | Sameer Paranjpye | Sameer Paranjpye |
+| [HADOOP-708](https://issues.apache.org/jira/browse/HADOOP-708) | test-libhdfs.sh does not properly capture and return error status | Major | test | Nigel Daley | Nigel Daley |
+| [HADOOP-646](https://issues.apache.org/jira/browse/HADOOP-646) | name node server does not load large (\> 2^31 bytes) edits file | Critical | . | Christian Kunz | Milind Bhandarkar |
+| [HADOOP-705](https://issues.apache.org/jira/browse/HADOOP-705) | IOException: job.xml already exists | Major | . | Nigel Daley | Mahadev konar |
+| [HADOOP-712](https://issues.apache.org/jira/browse/HADOOP-712) | Record-IO XML serialization is broken for control characters | Major | record | Milind Bhandarkar | Milind Bhandarkar |
| [HADOOP-716](https://issues.apache.org/jira/browse/HADOOP-716) | Javadoc warning in SequenceFile.java | Minor | io | Devaraj Das | Devaraj Das |
| [HADOOP-715](https://issues.apache.org/jira/browse/HADOOP-715) | build.xml sets up wrong 'hadoop.log.dir' property for 'ant test' | Minor | test | Arun C Murthy | Arun C Murthy |
-| [HADOOP-712](https://issues.apache.org/jira/browse/HADOOP-712) | Record-IO XML serialization is broken for control characters | Major | record | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-722](https://issues.apache.org/jira/browse/HADOOP-722) | native-hadoop deficiencies | Critical | . | Arun C Murthy | Arun C Murthy |
| [HADOOP-710](https://issues.apache.org/jira/browse/HADOOP-710) | block size isn't honored | Major | . | Nigel Daley | Milind Bhandarkar |
-| [HADOOP-709](https://issues.apache.org/jira/browse/HADOOP-709) | streaming job with Control characters in the command causes runtime exception in the job tracker | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-708](https://issues.apache.org/jira/browse/HADOOP-708) | test-libhdfs.sh does not properly capture and return error status | Major | test | Nigel Daley | Nigel Daley |
-| [HADOOP-705](https://issues.apache.org/jira/browse/HADOOP-705) | IOException: job.xml already exists | Major | . | Nigel Daley | Mahadev konar |
-| [HADOOP-699](https://issues.apache.org/jira/browse/HADOOP-699) | "Browse the filesystem" link on Name Node redirects to wrong port on DataNode | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-698](https://issues.apache.org/jira/browse/HADOOP-698) | When DFS client fails to read from a datanode, the failed datanode is not excluded from target reselection | Major | . | Hairong Kuang | Milind Bhandarkar |
-| [HADOOP-696](https://issues.apache.org/jira/browse/HADOOP-696) | TestTextInputFormat fails on some platforms due to non-determinism in format.getSplits() | Minor | test | Sameer Paranjpye | Sameer Paranjpye |
| [HADOOP-695](https://issues.apache.org/jira/browse/HADOOP-695) | Unexpected NPE from the next method of StreamLineRecordReader fails map/reduce jobs | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-694](https://issues.apache.org/jira/browse/HADOOP-694) | jobtracker expireluanching tasks throws out Nullpointer exceptions | Minor | . | Mahadev konar | Mahadev konar |
-| [HADOOP-687](https://issues.apache.org/jira/browse/HADOOP-687) | Upgrade to Jetty 6 does not patch bin/hadoop | Critical | scripts | Sameer Paranjpye | Sameer Paranjpye |
-| [HADOOP-683](https://issues.apache.org/jira/browse/HADOOP-683) | bin/hadoop.sh doesn't work for /bin/dash (eg ubuntu 6.10b) | Trivial | scripts | James Todd | |
-| [HADOOP-682](https://issues.apache.org/jira/browse/HADOOP-682) | hadoop namenode -format doesnt work anymore if target directory doesnt exist | Major | . | Sanjay Dahiya | |
-| [HADOOP-652](https://issues.apache.org/jira/browse/HADOOP-652) | Not all Datastructures are updated when a block is deleted | Major | . | Raghu Angadi | |
-| [HADOOP-646](https://issues.apache.org/jira/browse/HADOOP-646) | name node server does not load large (\> 2^31 bytes) edits file | Critical | . | Christian Kunz | Milind Bhandarkar |
| [HADOOP-645](https://issues.apache.org/jira/browse/HADOOP-645) | Map-reduce task does not finish correctly when -reducer NONE is specified | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-637](https://issues.apache.org/jira/browse/HADOOP-637) | ipc.Server has memory leak -- serious issue for namenode server | Major | ipc | Christian Kunz | Raghu Angadi |
-| [HADOOP-604](https://issues.apache.org/jira/browse/HADOOP-604) | DataNodes get NullPointerException and become unresponsive on 50010 | Major | . | Christian Kunz | Raghu Angadi |
-| [HADOOP-459](https://issues.apache.org/jira/browse/HADOOP-459) | libhdfs leaks memory when writing to files | Major | . | Christian Kunz | Sameer Paranjpye |
+| [HADOOP-729](https://issues.apache.org/jira/browse/HADOOP-729) | packageNativeHadoop.sh has non-standard sh code | Critical | scripts | Arun C Murthy | Arun C Murthy |
+| [HADOOP-652](https://issues.apache.org/jira/browse/HADOOP-652) | Not all Datastructures are updated when a block is deleted | Major | . | Raghu Angadi | |
+| [HADOOP-723](https://issues.apache.org/jira/browse/HADOOP-723) | Race condition exists in the method MapOutputLocation.getFile | Major | . | Devaraj Das | Owen O'Malley |
| [HADOOP-447](https://issues.apache.org/jira/browse/HADOOP-447) | DistributedFileSystem.getBlockSize(Path) does not resolve absolute path | Major | . | Benjamin Reed | Raghu Angadi |
+| [HADOOP-724](https://issues.apache.org/jira/browse/HADOOP-724) | bin/hadoop:111 uses java directly, it should use JAVA\_HOME | Minor | scripts | Sanjay Dahiya | Arun C Murthy |
+| [HADOOP-733](https://issues.apache.org/jira/browse/HADOOP-733) | dfs shell has inconsistent exit codes | Major | . | Christian Kunz | dhruba borthakur |
+| [HADOOP-734](https://issues.apache.org/jira/browse/HADOOP-734) | Link to the FAQ in the "Documentation" section of the hadoop website | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-709](https://issues.apache.org/jira/browse/HADOOP-709) | streaming job with Control characters in the command causes runtime exception in the job tracker | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-699](https://issues.apache.org/jira/browse/HADOOP-699) | "Browse the filesystem" link on Name Node redirects to wrong port on DataNode | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-736](https://issues.apache.org/jira/browse/HADOOP-736) | Roll back Jetty6.0.1 to Jetty5.1.4 | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-739](https://issues.apache.org/jira/browse/HADOOP-739) | TestIPC occassionally fails with BindException | Minor | test | Nigel Daley | Nigel Daley |
+| [HADOOP-741](https://issues.apache.org/jira/browse/HADOOP-741) | Fix average progress calculation in speculative execution of maps + fix pending issues in speculative execution of reduces | Major | . | Sanjay Dahiya | Sanjay Dahiya |
+| [HADOOP-749](https://issues.apache.org/jira/browse/HADOOP-749) | The jobfailures.jsp gets a NullPointerException after a task tracker has been lost | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-747](https://issues.apache.org/jira/browse/HADOOP-747) | RecordIO compiler does not produce correct Java code when buffer is used as key or value in map | Major | record | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-698](https://issues.apache.org/jira/browse/HADOOP-698) | When DFS client fails to read from a datanode, the failed datanode is not excluded from target reselection | Major | . | Hairong Kuang | Milind Bhandarkar |
| [HADOOP-430](https://issues.apache.org/jira/browse/HADOOP-430) | http server should die if the Datanode fails. | Major | . | Konstantin Shvachko | Wendy Chien |
+| [HADOOP-750](https://issues.apache.org/jira/browse/HADOOP-750) | race condition on stalled map output fetches | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-728](https://issues.apache.org/jira/browse/HADOOP-728) | Map-reduce task does not produce correct results when -reducer NONE is specified through streaming | Major | . | dhruba borthakur | Sanjay Dahiya |
### TESTS:
@@ -107,15 +97,3 @@
| [HADOOP-382](https://issues.apache.org/jira/browse/HADOOP-382) | add a unit test for multiple datanodes in a machine | Major | . | Yoram Arnon | Milind Bhandarkar |
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.9.1/CHANGES.0.9.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.9.1/CHANGES.0.9.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.9.1/CHANGES.0.9.1.md
index 8a3de80..c810ef6 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.9.1/CHANGES.0.9.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.9.1/CHANGES.0.9.1.md
@@ -20,28 +20,6 @@
## Release 0.9.1 - 2006-12-06
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
@@ -52,21 +30,3 @@
| [HADOOP-779](https://issues.apache.org/jira/browse/HADOOP-779) | Hadoop streaming does not work with gzipped input | Major | . | Hairong Kuang | Hairong Kuang |
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.9.2/CHANGES.0.9.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.9.2/CHANGES.0.9.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.9.2/CHANGES.0.9.2.md
index ab1426f..8fba16c 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.9.2/CHANGES.0.9.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.9.2/CHANGES.0.9.2.md
@@ -20,54 +20,14 @@
## Release 0.9.2 - 2006-12-15
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-639](https://issues.apache.org/jira/browse/HADOOP-639) | task cleanup messages can get lost, causing task trackers to keep tasks forever | Major | . | Owen O'Malley | Arun C Murthy |
| [HADOOP-827](https://issues.apache.org/jira/browse/HADOOP-827) | turn off speculative execution by default | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-791](https://issues.apache.org/jira/browse/HADOOP-791) | deadlock issue in taskstracker. | Major | . | Mahadev konar | Mahadev konar |
-| [HADOOP-639](https://issues.apache.org/jira/browse/HADOOP-639) | task cleanup messages can get lost, causing task trackers to keep tasks forever | Major | . | Owen O'Malley | Arun C Murthy |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.0/CHANGES.1.0.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.0/CHANGES.1.0.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.0/CHANGES.1.0.0.md
index eb9a382..7e8741f 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.0/CHANGES.1.0.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.0/CHANGES.1.0.0.md
@@ -27,103 +27,91 @@
| [HDFS-617](https://issues.apache.org/jira/browse/HDFS-617) | Support for non-recursive create() in HDFS | Major | hdfs-client, namenode | Kan Zhang | Kan Zhang |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HDFS-2316](https://issues.apache.org/jira/browse/HDFS-2316) | [umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTP | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HDFS-2137](https://issues.apache.org/jira/browse/HDFS-2137) | Datanode Disk Fail Inplace | Major | datanode | Bharath Mundlapudi | |
+| [HDFS-2316](https://issues.apache.org/jira/browse/HDFS-2316) | [umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTP | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7804](https://issues.apache.org/jira/browse/HADOOP-7804) | enable hadoop config generator to set dfs.block.local-path-access.user to enable short circuit read | Major | conf | Arpit Gupta | Arpit Gupta |
+| [HADOOP-5124](https://issues.apache.org/jira/browse/HADOOP-5124) | A few optimizations to FsNamesystem#RecentInvalidateSets | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-7710](https://issues.apache.org/jira/browse/HADOOP-7710) | create a script to setup application in order to create root directories for application such hbase, hcat, hive etc | Major | . | Arpit Gupta | Arpit Gupta |
| [HADOOP-7664](https://issues.apache.org/jira/browse/HADOOP-7664) | o.a.h.conf.Configuration complains of overriding final parameter even if the value with which its attempting to override is the same. | Minor | conf | Ravi Prakash | Ravi Prakash |
+| [MAPREDUCE-3169](https://issues.apache.org/jira/browse/MAPREDUCE-3169) | Create a new MiniMRCluster equivalent which only provides client APIs cross MR1 and MR2 | Major | mrv1, mrv2, test | Todd Lipcon | Ahmed Radwan |
+| [HDFS-2246](https://issues.apache.org/jira/browse/HDFS-2246) | Shortcut a local client reads to a Datanodes files directly | Major | . | Sanjay Radia | Jitendra Nath Pandey |
+| [HADOOP-7804](https://issues.apache.org/jira/browse/HADOOP-7804) | enable hadoop config generator to set dfs.block.local-path-access.user to enable short circuit read | Major | conf | Arpit Gupta | Arpit Gupta |
+| [HDFS-2604](https://issues.apache.org/jira/browse/HDFS-2604) | Add a log message to show if WebHDFS is enabled | Minor | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-6886](https://issues.apache.org/jira/browse/HADOOP-6886) | LocalFileSystem Needs createNonRecursive API | Minor | fs | Nicolas Spiegelberg | Nicolas Spiegelberg |
| [HADOOP-6840](https://issues.apache.org/jira/browse/HADOOP-6840) | Support non-recursive create() in FileSystem & SequenceFile.Writer | Minor | fs, io | Nicolas Spiegelberg | Nicolas Spiegelberg |
-| [HADOOP-5124](https://issues.apache.org/jira/browse/HADOOP-5124) | A few optimizations to FsNamesystem#RecentInvalidateSets | Major | . | Hairong Kuang | Hairong Kuang |
-| [HDFS-2604](https://issues.apache.org/jira/browse/HDFS-2604) | Add a log message to show if WebHDFS is enabled | Minor | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2246](https://issues.apache.org/jira/browse/HDFS-2246) | Shortcut a local client reads to a Datanodes files directly | Major | . | Sanjay Radia | Jitendra Nath Pandey |
-| [MAPREDUCE-3169](https://issues.apache.org/jira/browse/MAPREDUCE-3169) | Create a new MiniMRCluster equivalent which only provides client APIs cross MR1 and MR2 | Major | mrv1, mrv2, test | Todd Lipcon | Ahmed Radwan |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9128](https://issues.apache.org/jira/browse/HADOOP-9128) | MetricsDynamicMBeanBase can cause high cpu load | Major | metrics | Nate Putnam | |
-| [HADOOP-8389](https://issues.apache.org/jira/browse/HADOOP-8389) | MetricsDynamicMBeanBase throws IllegalArgumentException for empty attribute list | Major | metrics | Elias Ross | |
-| [HADOOP-8067](https://issues.apache.org/jira/browse/HADOOP-8067) | Errors building hadoop-gpl-compression with Hadoop 1.0.0 and HBase 0.92.0 | Major | build | John Lewis | |
-| [HADOOP-7903](https://issues.apache.org/jira/browse/HADOOP-7903) | hadoop artifacts do not contain 64 bit libhdfs native lib | Major | build | Arpit Gupta | Matt Foley |
-| [HADOOP-7869](https://issues.apache.org/jira/browse/HADOOP-7869) | HADOOP\_HOME warning happens all of the time | Critical | scripts | Owen O'Malley | Owen O'Malley |
-| [HADOOP-7865](https://issues.apache.org/jira/browse/HADOOP-7865) | Test Failures in 1.0.0 hdfs/common | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-7854](https://issues.apache.org/jira/browse/HADOOP-7854) | UGI getCurrentUser is not synchronized | Critical | security | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7816](https://issues.apache.org/jira/browse/HADOOP-7816) | Allow HADOOP\_HOME deprecated warning suppression based on config specified in hadoop-env.sh | Major | . | Dave Thompson | Dave Thompson |
-| [HADOOP-7815](https://issues.apache.org/jira/browse/HADOOP-7815) | Map memory mb is being incorrectly set by hadoop-setup-conf.sh | Minor | conf | Ramya Sunil | Ramya Sunil |
-| [HADOOP-7784](https://issues.apache.org/jira/browse/HADOOP-7784) | secure datanodes fail to come up stating jsvc not found | Major | . | Arpit Gupta | Eric Yang |
-| [HADOOP-7765](https://issues.apache.org/jira/browse/HADOOP-7765) | Debian package contain both system and tar ball layout | Major | build | Eric Yang | Eric Yang |
-| [HADOOP-7740](https://issues.apache.org/jira/browse/HADOOP-7740) | security audit logger is not on by default, fix the log4j properties to enable the logger | Minor | conf | Arpit Gupta | Arpit Gupta |
+| [HDFS-611](https://issues.apache.org/jira/browse/HDFS-611) | Heartbeats times from Datanodes increase when there are plenty of blocks to delete | Major | datanode | dhruba borthakur | Zheng Shao |
+| [HDFS-1257](https://issues.apache.org/jira/browse/HDFS-1257) | Race condition on FSNamesystem#recentInvalidateSets introduced by HADOOP-5124 | Major | namenode | Ramkumar Vadali | Eric Payne |
| [HADOOP-7728](https://issues.apache.org/jira/browse/HADOOP-7728) | hadoop-setup-conf.sh should be modified to enable task memory manager | Major | conf | Ramya Sunil | Ramya Sunil |
-| [HADOOP-7461](https://issues.apache.org/jira/browse/HADOOP-7461) | Jackson Dependency Not Declared in Hadoop POM | Major | build | Ron Bodkin | Giridharan Kesavan |
-| [HADOOP-7116](https://issues.apache.org/jira/browse/HADOOP-7116) | raise contrib junit test jvm memory size to 512mb | Major | test | Owen O'Malley | Owen O'Malley |
-| [HDFS-2673](https://issues.apache.org/jira/browse/HDFS-2673) | While Namenode processing the blocksBeingWrittenReport, it will log incorrect number blocks count | Trivial | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HDFS-2590](https://issues.apache.org/jira/browse/HDFS-2590) | Some links in WebHDFS forrest doc do not work | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2589](https://issues.apache.org/jira/browse/HDFS-2589) | unnecessary hftp token fetch and renewal thread | Major | security | Daryn Sharp | Daryn Sharp |
+| [HADOOP-7765](https://issues.apache.org/jira/browse/HADOOP-7765) | Debian package contain both system and tar ball layout | Major | build | Eric Yang | Eric Yang |
| [HDFS-2450](https://issues.apache.org/jira/browse/HDFS-2450) | Only complete hostname is supported to access data via hdfs:// | Major | . | Rajit Saha | Daryn Sharp |
-| [HDFS-2346](https://issues.apache.org/jira/browse/HDFS-2346) | TestHost2NodesMap & TestReplicasMap will fail depending upon execution order of test methods | Blocker | test | Uma Maheswara Rao G | Laxman |
+| [HADOOP-7740](https://issues.apache.org/jira/browse/HADOOP-7740) | security audit logger is not on by default, fix the log4j properties to enable the logger | Minor | conf | Arpit Gupta | Arpit Gupta |
| [HDFS-2065](https://issues.apache.org/jira/browse/HDFS-2065) | Fix NPE in DFSClient.getFileChecksum | Major | . | Bharath Mundlapudi | Uma Maheswara Rao G |
+| [HADOOP-7784](https://issues.apache.org/jira/browse/HADOOP-7784) | secure datanodes fail to come up stating jsvc not found | Major | . | Arpit Gupta | Eric Yang |
| [HDFS-1943](https://issues.apache.org/jira/browse/HDFS-1943) | fail to start datanode while start-dfs.sh is executed by root user | Blocker | scripts | Wei Yongjun | Matt Foley |
-| [HDFS-1257](https://issues.apache.org/jira/browse/HDFS-1257) | Race condition on FSNamesystem#recentInvalidateSets introduced by HADOOP-5124 | Major | namenode | Ramkumar Vadali | Eric Payne |
-| [HDFS-838](https://issues.apache.org/jira/browse/HDFS-838) | libhdfs causes a segfault due to race condition | Major | libhdfs | Brian Bockelman | |
-| [HDFS-611](https://issues.apache.org/jira/browse/HDFS-611) | Heartbeats times from Datanodes increase when there are plenty of blocks to delete | Major | datanode | dhruba borthakur | Zheng Shao |
-| [MAPREDUCE-4935](https://issues.apache.org/jira/browse/MAPREDUCE-4935) | Support timeout limitation to MRv1 job end notifications | Major | jobtracker, mrv1 | Olga Shen | Brad Liu |
-| [MAPREDUCE-3480](https://issues.apache.org/jira/browse/MAPREDUCE-3480) | TestJvmReuse fails in 1.0 | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [MAPREDUCE-3475](https://issues.apache.org/jira/browse/MAPREDUCE-3475) | JT can't renew its own tokens | Major | jobtracker | Daryn Sharp | Daryn Sharp |
| [MAPREDUCE-3374](https://issues.apache.org/jira/browse/MAPREDUCE-3374) | src/c++/task-controller/configure is not set executable in the tarball and that prevents task-controller from rebuilding | Major | task-controller | Roman Shaposhnik | |
+| [HDFS-2346](https://issues.apache.org/jira/browse/HDFS-2346) | TestHost2NodesMap & TestReplicasMap will fail depending upon execution order of test methods | Blocker | test | Uma Maheswara Rao G | Laxman |
+| [HADOOP-7816](https://issues.apache.org/jira/browse/HADOOP-7816) | Allow HADOOP\_HOME deprecated warning suppression based on config specified in hadoop-env.sh | Major | . | Dave Thompson | Dave Thompson |
+| [HDFS-2590](https://issues.apache.org/jira/browse/HDFS-2590) | Some links in WebHDFS forrest doc do not work | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-7815](https://issues.apache.org/jira/browse/HADOOP-7815) | Map memory mb is being incorrectly set by hadoop-setup-conf.sh | Minor | conf | Ramya Sunil | Ramya Sunil |
+| [MAPREDUCE-3480](https://issues.apache.org/jira/browse/MAPREDUCE-3480) | TestJvmReuse fails in 1.0 | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HADOOP-7865](https://issues.apache.org/jira/browse/HADOOP-7865) | Test Failures in 1.0.0 hdfs/common | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HADOOP-7854](https://issues.apache.org/jira/browse/HADOOP-7854) | UGI getCurrentUser is not synchronized | Critical | security | Daryn Sharp | Daryn Sharp |
+| [HADOOP-7869](https://issues.apache.org/jira/browse/HADOOP-7869) | HADOOP\_HOME warning happens all of the time | Critical | scripts | Owen O'Malley | Owen O'Malley |
+| [HADOOP-7461](https://issues.apache.org/jira/browse/HADOOP-7461) | Jackson Dependency Not Declared in Hadoop POM | Major | build | Ron Bodkin | Giridharan Kesavan |
+| [HDFS-2589](https://issues.apache.org/jira/browse/HDFS-2589) | unnecessary hftp token fetch and renewal thread | Major | security | Daryn Sharp | Daryn Sharp |
| [MAPREDUCE-3319](https://issues.apache.org/jira/browse/MAPREDUCE-3319) | multifilewc from hadoop examples seems to be broken in 0.20.205.0 | Blocker | examples | Roman Shaposhnik | Subroto Sanyal |
+| [HDFS-2673](https://issues.apache.org/jira/browse/HDFS-2673) | While Namenode processing the blocksBeingWrittenReport, it will log incorrect number blocks count | Trivial | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [HADOOP-7903](https://issues.apache.org/jira/browse/HADOOP-7903) | hadoop artifacts do not contain 64 bit libhdfs native lib | Major | build | Arpit Gupta | Matt Foley |
| [MAPREDUCE-1744](https://issues.apache.org/jira/browse/MAPREDUCE-1744) | DistributedCache creates its own FileSytem instance when adding a file/archive to the path | Major | . | Dick King | Dick King |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-7116](https://issues.apache.org/jira/browse/HADOOP-7116) | raise contrib junit test jvm memory size to 512mb | Major | test | Owen O'Malley | Owen O'Malley |
+| [HADOOP-8067](https://issues.apache.org/jira/browse/HADOOP-8067) | Errors building hadoop-gpl-compression with Hadoop 1.0.0 and HBase 0.92.0 | Major | build | John Lewis | |
+| [HDFS-838](https://issues.apache.org/jira/browse/HDFS-838) | libhdfs causes a segfault due to race condition | Major | libhdfs | Brian Bockelman | |
+| [HADOOP-9128](https://issues.apache.org/jira/browse/HADOOP-9128) | MetricsDynamicMBeanBase can cause high cpu load | Major | metrics | Nate Putnam | |
+| [HADOOP-8389](https://issues.apache.org/jira/browse/HADOOP-8389) | MetricsDynamicMBeanBase throws IllegalArgumentException for empty attribute list | Major | metrics | Elias Ross | |
+| [MAPREDUCE-4935](https://issues.apache.org/jira/browse/MAPREDUCE-4935) | Support timeout limitation to MRv1 job end notifications | Major | jobtracker, mrv1 | Olga Shen | Brad Liu |
+| [MAPREDUCE-3475](https://issues.apache.org/jira/browse/MAPREDUCE-3475) | JT can't renew its own tokens | Major | jobtracker | Daryn Sharp | Daryn Sharp |
### SUB-TASKS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HDFS-2540](https://issues.apache.org/jira/browse/HDFS-2540) | Change WebHdfsFileSystem to two-step create/append | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2539](https://issues.apache.org/jira/browse/HDFS-2539) | Support doAs and GETHOMEDIRECTORY in webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2528](https://issues.apache.org/jira/browse/HDFS-2528) | webhdfs rest call to a secure dn fails when a token is sent | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
-| [HDFS-2527](https://issues.apache.org/jira/browse/HDFS-2527) | Remove the use of Range header from webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2501](https://issues.apache.org/jira/browse/HDFS-2501) | add version prefix and root methods to webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2494](https://issues.apache.org/jira/browse/HDFS-2494) | [webhdfs] When Getting the file using OP=OPEN with DN http address, ESTABLISHED sockets are growing. | Major | webhdfs | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HDFS-2453](https://issues.apache.org/jira/browse/HDFS-2453) | tail using a webhdfs uri throws an error | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
| [HDFS-2441](https://issues.apache.org/jira/browse/HDFS-2441) | webhdfs returns two content-type headers | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
-| [HDFS-2439](https://issues.apache.org/jira/browse/HDFS-2439) | webhdfs open an invalid path leads to a 500 which states a npe, we should return a 404 with appropriate error message | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
-| [HDFS-2432](https://issues.apache.org/jira/browse/HDFS-2432) | webhdfs setreplication api should return a 403 when called on a directory | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
| [HDFS-2428](https://issues.apache.org/jira/browse/HDFS-2428) | webhdfs api parameter validation should be better | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
-| [HDFS-2427](https://issues.apache.org/jira/browse/HDFS-2427) | webhdfs mkdirs api call creates path with 777 permission, we should default it to 755 | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
| [HDFS-2424](https://issues.apache.org/jira/browse/HDFS-2424) | webhdfs liststatus json does not convert to a valid xml document | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
+| [HDFS-2439](https://issues.apache.org/jira/browse/HDFS-2439) | webhdfs open an invalid path leads to a 500 which states a npe, we should return a 404 with appropriate error message | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
+| [HDFS-2453](https://issues.apache.org/jira/browse/HDFS-2453) | tail using a webhdfs uri throws an error | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
+| [HDFS-2427](https://issues.apache.org/jira/browse/HDFS-2427) | webhdfs mkdirs api call creates path with 777 permission, we should default it to 755 | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
+| [HDFS-2501](https://issues.apache.org/jira/browse/HDFS-2501) | add version prefix and root methods to webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-2494](https://issues.apache.org/jira/browse/HDFS-2494) | [webhdfs] When Getting the file using OP=OPEN with DN http address, ESTABLISHED sockets are growing. | Major | webhdfs | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [HDFS-2432](https://issues.apache.org/jira/browse/HDFS-2432) | webhdfs setreplication api should return a 403 when called on a directory | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
| [HDFS-2416](https://issues.apache.org/jira/browse/HDFS-2416) | distcp with a webhdfs uri on a secure cluster fails | Major | webhdfs | Arpit Gupta | Jitendra Nath Pandey |
+| [HDFS-2527](https://issues.apache.org/jira/browse/HDFS-2527) | Remove the use of Range header from webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-2528](https://issues.apache.org/jira/browse/HDFS-2528) | webhdfs rest call to a secure dn fails when a token is sent | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
+| [HDFS-2540](https://issues.apache.org/jira/browse/HDFS-2540) | Change WebHdfsFileSystem to two-step create/append | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-2539](https://issues.apache.org/jira/browse/HDFS-2539) | Support doAs and GETHOMEDIRECTORY in webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
### OTHER:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7923](https://issues.apache.org/jira/browse/HADOOP-7923) | Automatically update doc versions | Major | build, documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HDFS-2552](https://issues.apache.org/jira/browse/HDFS-2552) | Add WebHdfs Forrest doc | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-7923](https://issues.apache.org/jira/browse/HADOOP-7923) | Automatically update doc versions | Major | build, documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.0/RELEASENOTES.1.0.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.0/RELEASENOTES.1.0.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.0/RELEASENOTES.1.0.0.md
index 1aa12cb..92492c6 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.0/RELEASENOTES.1.0.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.0/RELEASENOTES.1.0.0.md
@@ -23,16 +23,9 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-7923](https://issues.apache.org/jira/browse/HADOOP-7923) | *Major* | **Automatically update doc versions**
-
-Docs version number is now automatically updated by reference to the build number.
-
-
----
-
-* [HADOOP-7740](https://issues.apache.org/jira/browse/HADOOP-7740) | *Minor* | **security audit logger is not on by default, fix the log4j properties to enable the logger**
+* [HDFS-617](https://issues.apache.org/jira/browse/HDFS-617) | *Major* | **Support for non-recursive create() in HDFS**
-Fixed security audit logger configuration. (Arpit Gupta via Eric Yang)
+New DFSClient.create(...) allows option of not creating missing parent(s).
---
@@ -44,10 +37,9 @@ Enable task memory management to be configurable via hadoop config setup script.
---
-* [HDFS-2316](https://issues.apache.org/jira/browse/HDFS-2316) | *Major* | **[umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTP**
+* [HADOOP-7740](https://issues.apache.org/jira/browse/HADOOP-7740) | *Minor* | **security audit logger is not on by default, fix the log4j properties to enable the logger**
-Provide WebHDFS as a complete FileSystem implementation for accessing HDFS over HTTP.
-Previous hftp feature was a read-only FileSystem and does not provide "write" accesses.
+Fixed security audit logger configuration. (Arpit Gupta via Eric Yang)
---
@@ -64,9 +56,17 @@ c. dfs.client.read.shortcircuit.skip.checksum is the key to bypass checksum chec
---
-* [HDFS-617](https://issues.apache.org/jira/browse/HDFS-617) | *Major* | **Support for non-recursive create() in HDFS**
+* [HADOOP-7923](https://issues.apache.org/jira/browse/HADOOP-7923) | *Major* | **Automatically update doc versions**
-New DFSClient.create(...) allows option of not creating missing parent(s).
+Docs version number is now automatically updated by reference to the build number.
+
+
+---
+
+* [HDFS-2316](https://issues.apache.org/jira/browse/HDFS-2316) | *Major* | **[umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTP**
+
+Provide WebHDFS as a complete FileSystem implementation for accessing HDFS over HTTP.
+Previous hftp feature was a read-only FileSystem and does not provide "write" accesses.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.1/CHANGES.1.0.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.1/CHANGES.1.0.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.1/CHANGES.1.0.1.md
index 912958b..c2bfc76 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.1/CHANGES.1.0.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.1/CHANGES.1.0.1.md
@@ -24,61 +24,31 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8037](https://issues.apache.org/jira/browse/HADOOP-8037) | Binary tarball does not preserve platform info for native builds, and RPMs fail to provide needed symlinks for libhadoop.so | Blocker | build | Matt Foley | Matt Foley |
| [HADOOP-7470](https://issues.apache.org/jira/browse/HADOOP-7470) | move up to Jackson 1.8.8 | Minor | util | Steve Loughran | Enis Soztutar |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-8037](https://issues.apache.org/jira/browse/HADOOP-8037) | Binary tarball does not preserve platform info for native builds, and RPMs fail to provide needed symlinks for libhadoop.so | Blocker | build | Matt Foley | Matt Foley |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8009](https://issues.apache.org/jira/browse/HADOOP-8009) | Create hadoop-client and hadoop-minicluster artifacts for downstream projects | Critical | build | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-3184](https://issues.apache.org/jira/browse/MAPREDUCE-3184) | Improve handling of fetch failures when a tasktracker is not responding on HTTP | Major | jobtracker | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-3607](https://issues.apache.org/jira/browse/MAPREDUCE-3607) | Port missing new API mapreduce lib classes to 1.x | Major | client | Tom White | Tom White |
| [HADOOP-7987](https://issues.apache.org/jira/browse/HADOOP-7987) | Support setting the run-as user in unsecure mode | Major | security | Devaraj Das | Jitendra Nath Pandey |
| [HDFS-2814](https://issues.apache.org/jira/browse/HDFS-2814) | NamenodeMXBean does not account for svn revision in the version information | Minor | . | Hitesh Shah | Hitesh Shah |
-| [MAPREDUCE-3607](https://issues.apache.org/jira/browse/MAPREDUCE-3607) | Port missing new API mapreduce lib classes to 1.x | Major | client | Tom White | Tom White |
-| [MAPREDUCE-3184](https://issues.apache.org/jira/browse/MAPREDUCE-3184) | Improve handling of fetch failures when a tasktracker is not responding on HTTP | Major | jobtracker | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8009](https://issues.apache.org/jira/browse/HADOOP-8009) | Create hadoop-client and hadoop-minicluster artifacts for downstream projects | Critical | build | Alejandro Abdelnur | Alejandro Abdelnur |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8052](https://issues.apache.org/jira/browse/HADOOP-8052) | Hadoop Metrics2 should emit Float.MAX\_VALUE (instead of Double.MAX\_VALUE) to avoid making Ganglia's gmetad core | Major | metrics | Varun Kapoor | Varun Kapoor |
-| [HADOOP-8010](https://issues.apache.org/jira/browse/HADOOP-8010) | hadoop-config.sh spews error message when HADOOP\_HOME\_WARN\_SUPPRESS is set to true and HADOOP\_HOME is present | Minor | scripts | Roman Shaposhnik | Roman Shaposhnik |
-| [HADOOP-7988](https://issues.apache.org/jira/browse/HADOOP-7988) | Upper case in hostname part of the principals doesn't work with kerberos. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-7964](https://issues.apache.org/jira/browse/HADOOP-7964) | Deadlock in class init. | Blocker | security, util | Kihwal Lee | Daryn Sharp |
+| [MAPREDUCE-3343](https://issues.apache.org/jira/browse/MAPREDUCE-3343) | TaskTracker Out of Memory because of distributed cache | Major | mrv1 | Ahmed Radwan | yunjiong zhao |
| [HADOOP-7960](https://issues.apache.org/jira/browse/HADOOP-7960) | Port HADOOP-5203 to branch-1, build version comparison is too restrictive | Major | . | Giridharan Kesavan | Matt Foley |
+| [HADOOP-7964](https://issues.apache.org/jira/browse/HADOOP-7964) | Deadlock in class init. | Blocker | security, util | Kihwal Lee | Daryn Sharp |
+| [HADOOP-7988](https://issues.apache.org/jira/browse/HADOOP-7988) | Upper case in hostname part of the principals doesn't work with kerberos. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HADOOP-8010](https://issues.apache.org/jira/browse/HADOOP-8010) | hadoop-config.sh spews error message when HADOOP\_HOME\_WARN\_SUPPRESS is set to true and HADOOP\_HOME is present | Minor | scripts | Roman Shaposhnik | Roman Shaposhnik |
| [HDFS-2379](https://issues.apache.org/jira/browse/HDFS-2379) | 0.20: Allow block reports to proceed without holding FSDataset lock | Critical | datanode | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-3343](https://issues.apache.org/jira/browse/MAPREDUCE-3343) | TaskTracker Out of Memory because of distributed cache | Major | mrv1 | Ahmed Radwan | zhaoyunjiong |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-8052](https://issues.apache.org/jira/browse/HADOOP-8052) | Hadoop Metrics2 should emit Float.MAX\_VALUE (instead of Double.MAX\_VALUE) to avoid making Ganglia's gmetad core | Major | metrics | Varun Kapoor | Varun Kapoor |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.1/RELEASENOTES.1.0.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.1/RELEASENOTES.1.0.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.1/RELEASENOTES.1.0.1.md
index 01a464c..6457ea8 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.1/RELEASENOTES.1.0.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.1/RELEASENOTES.1.0.1.md
@@ -23,30 +23,30 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-8037](https://issues.apache.org/jira/browse/HADOOP-8037) | *Blocker* | **Binary tarball does not preserve platform info for native builds, and RPMs fail to provide needed symlinks for libhadoop.so**
+* [MAPREDUCE-3184](https://issues.apache.org/jira/browse/MAPREDUCE-3184) | *Major* | **Improve handling of fetch failures when a tasktracker is not responding on HTTP**
-This fix is marked "incompatible" only because it changes the bin-tarball directory structure to be consistent with the source tarball directory structure. The source tarball is unchanged. RPMs and DEBs now use an intermediate bin-tarball with an "${os.arch}" tag (like the packages themselves). The un-tagged bin-tarball is now multi-platform and retains the structure of the source tarball; it is in fact generated by target "tar", not by target "binary". Finally, in the 64-bit RPMs and DEBs, the native libs go in the "lib64" directory instead of "lib".
+The TaskTracker now has a thread which monitors for a known Jetty bug in which the selector thread starts spinning and map output can no longer be served. If the bug is detected, the TaskTracker will shut itself down. This feature can be disabled by setting mapred.tasktracker.jetty.cpu.check.enabled to false.
---
-* [HADOOP-8009](https://issues.apache.org/jira/browse/HADOOP-8009) | *Critical* | **Create hadoop-client and hadoop-minicluster artifacts for downstream projects**
+* [HADOOP-7470](https://issues.apache.org/jira/browse/HADOOP-7470) | *Minor* | **move up to Jackson 1.8.8**
-Generate integration artifacts "org.apache.hadoop:hadoop-client" and "org.apache.hadoop:hadoop-minicluster" containing all the jars needed to use Hadoop client APIs, and to run Hadoop MiniClusters, respectively. Push these artifacts to the maven repository when mvn-deploy, along with existing artifacts.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-7470](https://issues.apache.org/jira/browse/HADOOP-7470) | *Minor* | **move up to Jackson 1.8.8**
+* [HADOOP-8037](https://issues.apache.org/jira/browse/HADOOP-8037) | *Blocker* | **Binary tarball does not preserve platform info for native builds, and RPMs fail to provide needed symlinks for libhadoop.so**
-**WARNING: No release note provided for this incompatible change.**
+This fix is marked "incompatible" only because it changes the bin-tarball directory structure to be consistent with the source tarball directory structure. The source tarball is unchanged. RPMs and DEBs now use an intermediate bin-tarball with an "${os.arch}" tag (like the packages themselves). The un-tagged bin-tarball is now multi-platform and retains the structure of the source tarball; it is in fact generated by target "tar", not by target "binary". Finally, in the 64-bit RPMs and DEBs, the native libs go in the "lib64" directory instead of "lib".
---
-* [MAPREDUCE-3184](https://issues.apache.org/jira/browse/MAPREDUCE-3184) | *Major* | **Improve handling of fetch failures when a tasktracker is not responding on HTTP**
+* [HADOOP-8009](https://issues.apache.org/jira/browse/HADOOP-8009) | *Critical* | **Create hadoop-client and hadoop-minicluster artifacts for downstream projects**
-The TaskTracker now has a thread which monitors for a known Jetty bug in which the selector thread starts spinning and map output can no longer be served. If the bug is detected, the TaskTracker will shut itself down. This feature can be disabled by setting mapred.tasktracker.jetty.cpu.check.enabled to false.
+Generate integration artifacts "org.apache.hadoop:hadoop-client" and "org.apache.hadoop:hadoop-minicluster" containing all the jars needed to use Hadoop client APIs, and to run Hadoop MiniClusters, respectively. Push these artifacts to the maven repository when mvn-deploy, along with existing artifacts.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.2/CHANGES.1.0.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.2/CHANGES.1.0.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.2/CHANGES.1.0.2.md
index 7854534..ca4c1e8 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.2/CHANGES.1.0.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.2/CHANGES.1.0.2.md
@@ -20,16 +20,6 @@
## Release 1.0.2 - 2012-04-03
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
@@ -43,45 +33,27 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8090](https://issues.apache.org/jira/browse/HADOOP-8090) | rename hadoop 64 bit rpm/deb package name | Major | . | Giridharan Kesavan | Giridharan Kesavan |
-| [HADOOP-5450](https://issues.apache.org/jira/browse/HADOOP-5450) | Add support for application-specific typecodes to typed bytes | Blocker | . | Klaas Bosteels | Klaas Bosteels |
| [HADOOP-1722](https://issues.apache.org/jira/browse/HADOOP-1722) | Make streaming to handle non-utf8 byte array | Major | . | Runping Qi | Klaas Bosteels |
-| [HDFS-3075](https://issues.apache.org/jira/browse/HDFS-3075) | Backport HADOOP-4885 to branch-1 | Major | namenode | Brandon Li | Brandon Li |
+| [HADOOP-5450](https://issues.apache.org/jira/browse/HADOOP-5450) | Add support for application-specific typecodes to typed bytes | Blocker | . | Klaas Bosteels | Klaas Bosteels |
| [HDFS-2701](https://issues.apache.org/jira/browse/HDFS-2701) | Cleanup FS\* processIOError methods | Major | namenode | Eli Collins | Eli Collins |
+| [HDFS-3075](https://issues.apache.org/jira/browse/HDFS-3075) | Backport HADOOP-4885 to branch-1 | Major | namenode | Brandon Li | Brandon Li |
+| [HADOOP-8090](https://issues.apache.org/jira/browse/HADOOP-8090) | rename hadoop 64 bit rpm/deb package name | Major | . | Giridharan Kesavan | Giridharan Kesavan |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8201](https://issues.apache.org/jira/browse/HADOOP-8201) | create the configure script for native compilation as part of the build | Blocker | build | Giridharan Kesavan | Giridharan Kesavan |
-| [HADOOP-8132](https://issues.apache.org/jira/browse/HADOOP-8132) | 64bit secure datanodes do not start as the jsvc path is wrong | Major | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-8050](https://issues.apache.org/jira/browse/HADOOP-8050) | Deadlock in metrics | Major | metrics | Kihwal Lee | Kihwal Lee |
-| [HDFS-3101](https://issues.apache.org/jira/browse/HDFS-3101) | cannot read empty file using webhdfs | Major | webhdfs | Zhanwei Wang | Tsz Wo Nicholas Sze |
-| [HDFS-3006](https://issues.apache.org/jira/browse/HDFS-3006) | Webhdfs "SETOWNER" call returns incorrect content-type | Major | webhdfs | bc Wong | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-764](https://issues.apache.org/jira/browse/MAPREDUCE-764) | TypedBytesInput's readRaw() does not preserve custom type codes | Blocker | contrib/streaming | Klaas Bosteels | Klaas Bosteels |
| [HDFS-2703](https://issues.apache.org/jira/browse/HDFS-2703) | removedStorageDirs is not updated everywhere we remove a storage dir | Major | namenode | Eli Collins | Eli Collins |
| [HDFS-2702](https://issues.apache.org/jira/browse/HDFS-2702) | A single failed name dir can cause the NN to exit | Critical | namenode | Eli Collins | Eli Collins |
-| [MAPREDUCE-3851](https://issues.apache.org/jira/browse/MAPREDUCE-3851) | Allow more aggressive action on detection of the jetty issue | Major | tasktracker | Kihwal Lee | Thomas Graves |
| [MAPREDUCE-3824](https://issues.apache.org/jira/browse/MAPREDUCE-3824) | Distributed caches are not removed properly | Critical | distributed-cache | Allen Wittenauer | Thomas Graves |
+| [HADOOP-8050](https://issues.apache.org/jira/browse/HADOOP-8050) | Deadlock in metrics | Major | metrics | Kihwal Lee | Kihwal Lee |
| [MAPREDUCE-3583](https://issues.apache.org/jira/browse/MAPREDUCE-3583) | ProcfsBasedProcessTree#constructProcessInfo() may throw NumberFormatException | Critical | . | Ted Yu | Ted Yu |
-| [MAPREDUCE-764](https://issues.apache.org/jira/browse/MAPREDUCE-764) | TypedBytesInput's readRaw() does not preserve custom type codes | Blocker | contrib/streaming | Klaas Bosteels | Klaas Bosteels |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-3006](https://issues.apache.org/jira/browse/HDFS-3006) | Webhdfs "SETOWNER" call returns incorrect content-type | Major | webhdfs | bc Wong | Tsz Wo Nicholas Sze |
+| [HDFS-3101](https://issues.apache.org/jira/browse/HDFS-3101) | cannot read empty file using webhdfs | Major | webhdfs | Zhanwei Wang | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-3851](https://issues.apache.org/jira/browse/MAPREDUCE-3851) | Allow more aggressive action on detection of the jetty issue | Major | tasktracker | Kihwal Lee | Thomas Graves |
+| [HADOOP-8132](https://issues.apache.org/jira/browse/HADOOP-8132) | 64bit secure datanodes do not start as the jsvc path is wrong | Major | . | Arpit Gupta | Arpit Gupta |
+| [HADOOP-8201](https://issues.apache.org/jira/browse/HADOOP-8201) | create the configure script for native compilation as part of the build | Blocker | build | Giridharan Kesavan | Giridharan Kesavan |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.3/CHANGES.1.0.3.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.3/CHANGES.1.0.3.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.3/CHANGES.1.0.3.md
index 49b0172..cfc91bf 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.3/CHANGES.1.0.3.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.3/CHANGES.1.0.3.md
@@ -20,16 +20,6 @@
## Release 1.0.3 - 2012-05-07
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
@@ -43,54 +33,36 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8352](https://issues.apache.org/jira/browse/HADOOP-8352) | We should always generate a new configure script for the c++ code | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-8188](https://issues.apache.org/jira/browse/HADOOP-8188) | Fix the build process to do with jsvc, with IBM's JDK as the underlying jdk | Major | . | Devaraj Das | Devaraj Das |
| [HADOOP-8027](https://issues.apache.org/jira/browse/HADOOP-8027) | Visiting /jmx on the daemon web interfaces may print unnecessary error in logs | Minor | metrics | Harsh J | Aaron T. Myers |
+| [HADOOP-8188](https://issues.apache.org/jira/browse/HADOOP-8188) | Fix the build process to do with jsvc, with IBM's JDK as the underlying jdk | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-8352](https://issues.apache.org/jira/browse/HADOOP-8352) | We should always generate a new configure script for the c++ code | Major | . | Owen O'Malley | Owen O'Malley |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8346](https://issues.apache.org/jira/browse/HADOOP-8346) | Changes to support Kerberos with non Sun JVM (HADOOP-6941) broke SPNEGO | Blocker | security | Alejandro Abdelnur | Devaraj Das |
-| [HADOOP-8338](https://issues.apache.org/jira/browse/HADOOP-8338) | Can't renew or cancel HDFS delegation tokens over secure RPC | Major | security | Owen O'Malley | Owen O'Malley |
-| [HADOOP-8294](https://issues.apache.org/jira/browse/HADOOP-8294) | IPC Connection becomes unusable even if server address was temporarilly unresolvable | Critical | ipc | Kihwal Lee | Kihwal Lee |
-| [HADOOP-8293](https://issues.apache.org/jira/browse/HADOOP-8293) | The native library's Makefile.am doesn't include JNI path | Major | build | Owen O'Malley | Owen O'Malley |
-| [HADOOP-8251](https://issues.apache.org/jira/browse/HADOOP-8251) | SecurityUtil.fetchServiceTicket broken after HADOOP-6941 | Blocker | security | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8151](https://issues.apache.org/jira/browse/HADOOP-8151) | Error handling in snappy decompressor throws invalid exceptions | Major | io, native | Todd Lipcon | Matt Foley |
-| [HADOOP-7381](https://issues.apache.org/jira/browse/HADOOP-7381) | FindBugs OutOfMemoryError | Major | build | Joep Rottinghuis | Joep Rottinghuis |
-| [HADOOP-6941](https://issues.apache.org/jira/browse/HADOOP-6941) | Support non-SUN JREs in UserGroupInformation | Major | . | Stephen Watt | Devaraj Das |
+| [HDFS-119](https://issues.apache.org/jira/browse/HDFS-119) | logSync() may block NameNode forever. | Major | namenode | Konstantin Shvachko | Suresh Srinivas |
+| [HDFS-1041](https://issues.apache.org/jira/browse/HDFS-1041) | DFSClient does not retry in getFileChecksum(..) | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-6924](https://issues.apache.org/jira/browse/HADOOP-6924) | Build fails with non-Sun JREs due to different pathing to the operating system architecture shared libraries | Major | . | Stephen Watt | Devaraj Das |
-| [HDFS-3374](https://issues.apache.org/jira/browse/HDFS-3374) | hdfs' TestDelegationToken fails intermittently with a race condition | Major | namenode | Owen O'Malley | Owen O'Malley |
-| [HDFS-3310](https://issues.apache.org/jira/browse/HDFS-3310) | Make sure that we abort when no edit log directories are left | Major | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3265](https://issues.apache.org/jira/browse/HDFS-3265) | PowerPc Build error. | Major | build | Kumar Ravi | Kumar Ravi |
+| [HADOOP-6941](https://issues.apache.org/jira/browse/HADOOP-6941) | Support non-SUN JREs in UserGroupInformation | Major | . | Stephen Watt | Devaraj Das |
| [HDFS-3127](https://issues.apache.org/jira/browse/HDFS-3127) | failure in recovering removed storage directories should not stop checkpoint process | Major | namenode | Brandon Li | Brandon Li |
-| [HDFS-3061](https://issues.apache.org/jira/browse/HDFS-3061) | Backport HDFS-1487 to branch-1 | Blocker | namenode | Alex Holmes | Kihwal Lee |
-| [HDFS-1041](https://issues.apache.org/jira/browse/HDFS-1041) | DFSClient does not retry in getFileChecksum(..) | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-119](https://issues.apache.org/jira/browse/HDFS-119) | logSync() may block NameNode forever. | Major | namenode | Konstantin Shvachko | Suresh Srinivas |
-| [MAPREDUCE-4207](https://issues.apache.org/jira/browse/MAPREDUCE-4207) | Remove System.out.println() in FileInputFormat | Major | mrv1 | Kihwal Lee | Kihwal Lee |
-| [MAPREDUCE-4154](https://issues.apache.org/jira/browse/MAPREDUCE-4154) | streaming MR job succeeds even if the streaming command fails | Major | . | Thejas M Nair | Devaraj Das |
-| [MAPREDUCE-4003](https://issues.apache.org/jira/browse/MAPREDUCE-4003) | log.index (No such file or directory) AND Task process exit with nonzero status of 126 | Major | task-controller, tasktracker | toughman | Koji Noguchi |
-| [MAPREDUCE-3857](https://issues.apache.org/jira/browse/MAPREDUCE-3857) | Grep example ignores mapred.job.queue.name | Major | examples | Jonathan Eagles | Jonathan Eagles |
| [MAPREDUCE-3377](https://issues.apache.org/jira/browse/MAPREDUCE-3377) | Compatibility issue with 0.20.203. | Major | . | Jane Chen | Jane Chen |
+| [HADOOP-8251](https://issues.apache.org/jira/browse/HADOOP-8251) | SecurityUtil.fetchServiceTicket broken after HADOOP-6941 | Blocker | security | Todd Lipcon | Todd Lipcon |
| [MAPREDUCE-1238](https://issues.apache.org/jira/browse/MAPREDUCE-1238) | mapred metrics shows negative count of waiting maps and reduces | Major | jobtracker | Ramya Sunil | Thomas Graves |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [MAPREDUCE-4003](https://issues.apache.org/jira/browse/MAPREDUCE-4003) | log.index (No such file or directory) AND Task process exit with nonzero status of 126 | Major | task-controller, tasktracker | toughman | Koji Noguchi |
+| [MAPREDUCE-4154](https://issues.apache.org/jira/browse/MAPREDUCE-4154) | streaming MR job succeeds even if the streaming command fails | Major | . | Thejas M Nair | Devaraj Das |
+| [HADOOP-8293](https://issues.apache.org/jira/browse/HADOOP-8293) | The native library's Makefile.am doesn't include JNI path | Major | build | Owen O'Malley | Owen O'Malley |
+| [HADOOP-8294](https://issues.apache.org/jira/browse/HADOOP-8294) | IPC Connection becomes unusable even if server address was temporarilly unresolvable | Critical | ipc | Kihwal Lee | Kihwal Lee |
+| [HDFS-3310](https://issues.apache.org/jira/browse/HDFS-3310) | Make sure that we abort when no edit log directories are left | Major | . | Colin P. McCabe | Colin P. McCabe |
+| [MAPREDUCE-4207](https://issues.apache.org/jira/browse/MAPREDUCE-4207) | Remove System.out.println() in FileInputFormat | Major | mrv1 | Kihwal Lee | Kihwal Lee |
+| [HDFS-3265](https://issues.apache.org/jira/browse/HDFS-3265) | PowerPc Build error. | Major | build | Kumar Ravi | Kumar Ravi |
+| [HADOOP-8338](https://issues.apache.org/jira/browse/HADOOP-8338) | Can't renew or cancel HDFS delegation tokens over secure RPC | Major | security | Owen O'Malley | Owen O'Malley |
+| [HADOOP-8346](https://issues.apache.org/jira/browse/HADOOP-8346) | Changes to support Kerberos with non Sun JVM (HADOOP-6941) broke SPNEGO | Blocker | security | Alejandro Abdelnur | Devaraj Das |
+| [HDFS-3061](https://issues.apache.org/jira/browse/HDFS-3061) | Backport HDFS-1487 to branch-1 | Blocker | namenode | Alex Holmes | Kihwal Lee |
+| [HADOOP-7381](https://issues.apache.org/jira/browse/HADOOP-7381) | FindBugs OutOfMemoryError | Major | build | Joep Rottinghuis | Joep Rottinghuis |
+| [MAPREDUCE-3857](https://issues.apache.org/jira/browse/MAPREDUCE-3857) | Grep example ignores mapred.job.queue.name | Major | examples | Jonathan Eagles | Jonathan Eagles |
+| [HDFS-3374](https://issues.apache.org/jira/browse/HDFS-3374) | hdfs' TestDelegationToken fails intermittently with a race condition | Major | namenode | Owen O'Malley | Owen O'Malley |
+| [HADOOP-8151](https://issues.apache.org/jira/browse/HADOOP-8151) | Error handling in snappy decompressor throws invalid exceptions | Major | io, native | Todd Lipcon | Matt Foley |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.3/RELEASENOTES.1.0.3.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.3/RELEASENOTES.1.0.3.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.3/RELEASENOTES.1.0.3.md
index e94bbf9..440f69b 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.3/RELEASENOTES.1.0.3.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.3/RELEASENOTES.1.0.3.md
@@ -23,17 +23,17 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-8352](https://issues.apache.org/jira/browse/HADOOP-8352) | *Major* | **We should always generate a new configure script for the c++ code**
+* [HADOOP-5528](https://issues.apache.org/jira/browse/HADOOP-5528) | *Major* | **Binary partitioner**
-If you are compiling c++, the configure script will now be automatically regenerated as it should be.
-This requires autoconf version 2.61 or greater.
+New BinaryPartitioner that partitions BinaryComparable keys by hashing a configurable part of the bytes array corresponding to the key.
---
-* [HADOOP-5528](https://issues.apache.org/jira/browse/HADOOP-5528) | *Major* | **Binary partitioner**
+* [HADOOP-8352](https://issues.apache.org/jira/browse/HADOOP-8352) | *Major* | **We should always generate a new configure script for the c++ code**
-New BinaryPartitioner that partitions BinaryComparable keys by hashing a configurable part of the bytes array corresponding to the key.
+If you are compiling c++, the configure script will now be automatically regenerated as it should be.
+This requires autoconf version 2.61 or greater.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.4/CHANGES.1.0.4.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.4/CHANGES.1.0.4.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.4/CHANGES.1.0.4.md
index bcda2d0..fa388a0 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.4/CHANGES.1.0.4.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.0.4/CHANGES.1.0.4.md
@@ -20,22 +20,6 @@
## Release 1.0.4 - 2012-10-12
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### IMPROVEMENTS:
@@ -53,21 +37,3 @@
| [MAPREDUCE-4399](https://issues.apache.org/jira/browse/MAPREDUCE-4399) | Fix performance regression in shuffle | Major | performance, tasktracker | Luke Lu | Luke Lu |
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[26/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.1/RELEASENOTES.0.23.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.1/RELEASENOTES.0.23.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.1/RELEASENOTES.0.23.1.md
index 569e1ed..19364d3 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.1/RELEASENOTES.0.23.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.1/RELEASENOTES.0.23.1.md
@@ -23,285 +23,280 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-8013](https://issues.apache.org/jira/browse/HADOOP-8013) | *Major* | **ViewFileSystem does not honor setVerifyChecksum**
+* [MAPREDUCE-2784](https://issues.apache.org/jira/browse/MAPREDUCE-2784) | *Major* | **[Gridmix] TestGridmixSummary fails with NPE when run in DEBUG mode.**
-**WARNING: No release note provided for this incompatible change.**
+Fixed bugs in ExecutionSummarizer and ResourceUsageMatcher.
---
-* [HADOOP-8009](https://issues.apache.org/jira/browse/HADOOP-8009) | *Critical* | **Create hadoop-client and hadoop-minicluster artifacts for downstream projects**
+* [MAPREDUCE-2950](https://issues.apache.org/jira/browse/MAPREDUCE-2950) | *Major* | **[Gridmix] TestUserResolve fails in trunk**
-Generate integration artifacts "org.apache.hadoop:hadoop-client" and "org.apache.hadoop:hadoop-minicluster" containing all the jars needed to use Hadoop client APIs, and to run Hadoop MiniClusters, respectively. Push these artifacts to the maven repository when mvn-deploy, along with existing artifacts.
+Fixes bug in TestUserResolve.
---
-* [HADOOP-7986](https://issues.apache.org/jira/browse/HADOOP-7986) | *Major* | **Add config for History Server protocol in hadoop-policy for service level authorization.**
+* [HDFS-2130](https://issues.apache.org/jira/browse/HDFS-2130) | *Major* | **Switch default checksum to CRC32C**
-Adding config for MapReduce History Server protocol in hadoop-policy.xml for service level authorization.
+The default checksum algorithm used on HDFS is now CRC32C. Data from previous versions of Hadoop can still be read backwards-compatibly.
---
-* [HADOOP-7963](https://issues.apache.org/jira/browse/HADOOP-7963) | *Blocker* | **test failures: TestViewFileSystemWithAuthorityLocalFileSystem and TestViewFileSystemLocalFileSystem**
+* [HDFS-2129](https://issues.apache.org/jira/browse/HDFS-2129) | *Major* | **Simplify BlockReader to not inherit from FSInputChecker**
-Fix ViewFS to catch a null canonical service-name and pass tests TestViewFileSystem\*
+BlockReader has been reimplemented to use direct byte buffers. If you use a custom socket factory, it must generate sockets that have associated Channels.
---
-* [HADOOP-7851](https://issues.apache.org/jira/browse/HADOOP-7851) | *Major* | **Configuration.getClasses() never returns the default value.**
+* [MAPREDUCE-3297](https://issues.apache.org/jira/browse/MAPREDUCE-3297) | *Major* | **Move Log Related components from yarn-server-nodemanager to yarn-common**
-Fixed Configuration.getClasses() API to return the default value if the key is not set.
+Moved log related components into yarn-common so that HistoryServer and clients can use them without depending on the yarn-server-nodemanager module.
---
-* [HADOOP-7802](https://issues.apache.org/jira/browse/HADOOP-7802) | *Major* | **Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh.**
+* [MAPREDUCE-3221](https://issues.apache.org/jira/browse/MAPREDUCE-3221) | *Minor* | **ant test TestSubmitJob failing on trunk**
-Here is a patch to enable this behavior
+Fixed a bug in TestSubmitJob.
---
-* [HADOOP-7470](https://issues.apache.org/jira/browse/HADOOP-7470) | *Minor* | **move up to Jackson 1.8.8**
+* [MAPREDUCE-3215](https://issues.apache.org/jira/browse/MAPREDUCE-3215) | *Minor* | **org.apache.hadoop.mapreduce.TestNoJobSetupCleanup failing on trunk**
-**WARNING: No release note provided for this incompatible change.**
+Reneabled and fixed bugs in the failing test TestNoJobSetupCleanup.
---
-* [HADOOP-7348](https://issues.apache.org/jira/browse/HADOOP-7348) | *Major* | **Modify the option of FsShell getmerge from [addnl] to [-nl] for consistency**
+* [MAPREDUCE-3219](https://issues.apache.org/jira/browse/MAPREDUCE-3219) | *Minor* | **ant test TestDelegationToken failing on trunk**
-The 'fs -getmerge' tool now uses a -nl flag to determine if adding a newline at end of each file is required, in favor of the 'addnl' boolean flag that was used earlier.
+Reenabled and fixed bugs in the failing test TestDelegationToken.
---
-* [HDFS-2316](https://issues.apache.org/jira/browse/HDFS-2316) | *Major* | **[umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTP**
+* [MAPREDUCE-3217](https://issues.apache.org/jira/browse/MAPREDUCE-3217) | *Minor* | **ant test TestAuditLogger fails on trunk**
-Provide WebHDFS as a complete FileSystem implementation for accessing HDFS over HTTP.
-Previous hftp feature was a read-only FileSystem and does not provide "write" accesses.
+Reenabled and fixed bugs in the failing ant test TestAuditLogger.
---
-* [HDFS-2246](https://issues.apache.org/jira/browse/HDFS-2246) | *Major* | **Shortcut a local client reads to a Datanodes files directly**
+* [MAPREDUCE-3342](https://issues.apache.org/jira/browse/MAPREDUCE-3342) | *Critical* | **JobHistoryServer doesn't show job queue**
-1. New configurations
-a. dfs.block.local-path-access.user is the key in datanode configuration to specify the user allowed to do short circuit read.
-b. dfs.client.read.shortcircuit is the key to enable short circuit read at the client side configuration.
-c. dfs.client.read.shortcircuit.skip.checksum is the key to bypass checksum check at the client side.
-2. By default none of the above are enabled and short circuit read will not kick in.
-3. If security is on, the feature can be used only for user that has kerberos credentials at the client, therefore map reduce tasks cannot benefit from it in general.
+Fixed JobHistoryServer to also show the job's queue name.
---
-* [HDFS-2130](https://issues.apache.org/jira/browse/HDFS-2130) | *Major* | **Switch default checksum to CRC32C**
+* [MAPREDUCE-3345](https://issues.apache.org/jira/browse/MAPREDUCE-3345) | *Major* | **Race condition in ResourceManager causing TestContainerManagerSecurity to fail sometimes**
-The default checksum algorithm used on HDFS is now CRC32C. Data from previous versions of Hadoop can still be read backwards-compatibly.
+Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes.
---
-* [HDFS-2129](https://issues.apache.org/jira/browse/HDFS-2129) | *Major* | **Simplify BlockReader to not inherit from FSInputChecker**
+* [MAPREDUCE-3368](https://issues.apache.org/jira/browse/MAPREDUCE-3368) | *Critical* | **compile-mapred-test fails**
-BlockReader has been reimplemented to use direct byte buffers. If you use a custom socket factory, it must generate sockets that have associated Channels.
+Fixed ant test compilation.
---
-* [HDFS-1314](https://issues.apache.org/jira/browse/HDFS-1314) | *Minor* | **dfs.blocksize accepts only absolute value**
+* [MAPREDUCE-2733](https://issues.apache.org/jira/browse/MAPREDUCE-2733) | *Major* | **Gridmix v3 cpu emulation system tests.**
-The default blocksize property 'dfs.blocksize' now accepts unit symbols to be used instead of byte length. Values such as "10k", "128m", "1g" are now OK to provide instead of just no. of bytes as was before.
+Adds system tests for the CPU emulation feature in Gridmix3.
---
-* [MAPREDUCE-3854](https://issues.apache.org/jira/browse/MAPREDUCE-3854) | *Major* | **Reinstate environment variable tests in TestMiniMRChildTask**
+* [MAPREDUCE-3333](https://issues.apache.org/jira/browse/MAPREDUCE-3333) | *Blocker* | **MR AM for sort-job going out of memory**
-Fixed and reenabled tests related to MR child JVM's environmental variables in TestMiniMRChildTask.
+Fixed bugs in ContainerLauncher of MR AppMaster due to which per-container connections to NodeManager were lingering long enough to hit the ulimits on number of processes.
---
-* [MAPREDUCE-3846](https://issues.apache.org/jira/browse/MAPREDUCE-3846) | *Critical* | **Restarted+Recovered AM hangs in some corner cases**
+* [MAPREDUCE-3280](https://issues.apache.org/jira/browse/MAPREDUCE-3280) | *Major* | **MR AM should not read the username from configuration**
-Addressed MR AM hanging issues during AM restart and then the recovery.
+Removed the unnecessary job user-name configuration in mapred-site.xml.
---
-* [MAPREDUCE-3834](https://issues.apache.org/jira/browse/MAPREDUCE-3834) | *Critical* | **If multiple hosts for a split belong to the same rack, the rack is added multiple times in the AM request table**
+* [MAPREDUCE-3392](https://issues.apache.org/jira/browse/MAPREDUCE-3392) | *Blocker* | **Cluster.getDelegationToken() throws NPE if client.getDelegationToken() returns null.**
-Changed MR AM to not add the same rack entry multiple times into the container request table when multiple hosts for a split happen to be on the same rack
+Fixed Cluster's getDelegationToken's API to return null when there isn't a supported token.
---
-* [MAPREDUCE-3815](https://issues.apache.org/jira/browse/MAPREDUCE-3815) | *Critical* | **Data Locality suffers if the AM asks for containers using IPs instead of hostnames**
+* [MAPREDUCE-3379](https://issues.apache.org/jira/browse/MAPREDUCE-3379) | *Major* | **LocalResourceTracker should not tracking deleted cache entries**
-Fixed MR AM to always use hostnames and never IPs when requesting containers so that scheduler can give off data local containers correctly.
+Fixed LocalResourceTracker in NodeManager to remove deleted cache entries correctly.
---
-* [MAPREDUCE-3808](https://issues.apache.org/jira/browse/MAPREDUCE-3808) | *Blocker* | **NPE in FileOutputCommitter when running a 0 reduce job**
+* [MAPREDUCE-3325](https://issues.apache.org/jira/browse/MAPREDUCE-3325) | *Major* | **Improvements to CapacityScheduler doc**
-Fixed an NPE in FileOutputCommitter for jobs with maps but no reduces.
+document changes only.
---
-* [MAPREDUCE-3804](https://issues.apache.org/jira/browse/MAPREDUCE-3804) | *Major* | **yarn webapp interface vulnerable to cross scripting attacks**
+* [MAPREDUCE-3375](https://issues.apache.org/jira/browse/MAPREDUCE-3375) | *Major* | **Memory Emulation system tests.**
-fix cross scripting attacks vulnerability through webapp interface.
+Added system tests to test the memory emulation feature in Gridmix.
---
-* [MAPREDUCE-3802](https://issues.apache.org/jira/browse/MAPREDUCE-3802) | *Critical* | **If an MR AM dies twice it looks like the process freezes**
+* [MAPREDUCE-3102](https://issues.apache.org/jira/browse/MAPREDUCE-3102) | *Major* | **NodeManager should fail fast with wrong configuration or permissions for LinuxContainerExecutor**
-Added test to validate that AM can crash multiple times and still can recover successfully after MAPREDUCE-3846.
+Changed NodeManager to fail fast when LinuxContainerExecutor has wrong configuration or permissions.
---
-* [MAPREDUCE-3784](https://issues.apache.org/jira/browse/MAPREDUCE-3784) | *Major* | **maxActiveApplications(\|PerUser) per queue is too low for small clusters**
+* [MAPREDUCE-3355](https://issues.apache.org/jira/browse/MAPREDUCE-3355) | *Blocker* | **AM scheduling hangs frequently with sort job on 350 nodes**
-Fixed CapacityScheduler so that maxActiveApplication and maxActiveApplicationsPerUser per queue are not too low for small clusters.
+Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly.
---
-* [MAPREDUCE-3774](https://issues.apache.org/jira/browse/MAPREDUCE-3774) | *Major* | **yarn-default.xml should be moved to hadoop-yarn-common.**
+* [MAPREDUCE-3407](https://issues.apache.org/jira/browse/MAPREDUCE-3407) | *Minor* | **Wrong jar getting used in TestMR\*Jobs\* for MiniMRYarnCluster**
-MAPREDUCE-3774. Moved yarn-default.xml to hadoop-yarn-common from hadoop-server-common.
+Fixed pom files to refer to the correct MR app-jar needed by the integration tests.
---
-* [MAPREDUCE-3760](https://issues.apache.org/jira/browse/MAPREDUCE-3760) | *Major* | **Blacklisted NMs should not appear in Active nodes list**
+* [HADOOP-7802](https://issues.apache.org/jira/browse/HADOOP-7802) | *Major* | **Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh.**
-Changed active nodes list to not contain unhealthy nodes on the webUI and metrics.
+Here is a patch to enable this behavior
---
-* [MAPREDUCE-3754](https://issues.apache.org/jira/browse/MAPREDUCE-3754) | *Major* | **RM webapp should have pages filtered based on App-state**
+* [MAPREDUCE-3412](https://issues.apache.org/jira/browse/MAPREDUCE-3412) | *Major* | **'ant docs' is broken**
-Modified RM UI to filter applications based on state of the applications.
+Fixes 'ant docs' by removing stale references to capacity-scheduler docs.
---
-* [MAPREDUCE-3752](https://issues.apache.org/jira/browse/MAPREDUCE-3752) | *Blocker* | **Headroom should be capped by queue max-cap**
+* [HDFS-2246](https://issues.apache.org/jira/browse/HDFS-2246) | *Major* | **Shortcut a local client reads to a Datanodes files directly**
-Modified application limits to include queue max-capacities besides the usual user limits.
+1. New configurations
+a. dfs.block.local-path-access.user is the key in datanode configuration to specify the user allowed to do short circuit read.
+b. dfs.client.read.shortcircuit is the key to enable short circuit read at the client side configuration.
+c. dfs.client.read.shortcircuit.skip.checksum is the key to bypass checksum check at the client side.
+2. By default none of the above are enabled and short circuit read will not kick in.
+3. If security is on, the feature can be used only for user that has kerberos credentials at the client, therefore map reduce tasks cannot benefit from it in general.
---
-* [MAPREDUCE-3732](https://issues.apache.org/jira/browse/MAPREDUCE-3732) | *Blocker* | **CS should only use 'activeUsers with pending requests' for computing user-limits**
+* [HADOOP-7851](https://issues.apache.org/jira/browse/HADOOP-7851) | *Major* | **Configuration.getClasses() never returns the default value.**
-Modified CapacityScheduler to use only users with pending requests for computing user-limits.
+Fixed Configuration.getClasses() API to return the default value if the key is not set.
---
-* [MAPREDUCE-3720](https://issues.apache.org/jira/browse/MAPREDUCE-3720) | *Major* | **Command line listJobs should not visit each AM**
-
-Changed bin/mapred job -list to not print job-specific information not available at RM.
+* [MAPREDUCE-3519](https://issues.apache.org/jira/browse/MAPREDUCE-3519) | *Blocker* | **Deadlock in LocalDirsHandlerService and ShuffleHandler**
-Very minor incompatibility in cmd-line output, inevitable due to MRv2 architecture.
+Fixed a deadlock in NodeManager LocalDirectories's handling service.
---
-* [MAPREDUCE-3716](https://issues.apache.org/jira/browse/MAPREDUCE-3716) | *Blocker* | **java.io.File.createTempFile fails in map/reduce tasks**
+* [MAPREDUCE-2863](https://issues.apache.org/jira/browse/MAPREDUCE-2863) | *Blocker* | **Support web-services for RM & NM**
-Fixing YARN+MR to allow MR jobs to be able to use java.io.File.createTempFile to create temporary files as part of their tasks.
+Support for web-services in YARN and MR components.
---
-* [MAPREDUCE-3714](https://issues.apache.org/jira/browse/MAPREDUCE-3714) | *Blocker* | **Reduce hangs in a corner case**
+* [MAPREDUCE-3426](https://issues.apache.org/jira/browse/MAPREDUCE-3426) | *Blocker* | **uber-jobs tried to write outputs into wrong dir**
-Fixed EventFetcher and Fetcher threads to shut-down properly so that reducers don't hang in corner cases.
+Fixed MR AM in uber mode to write map intermediate outputs in the correct directory to work properly in secure mode.
---
-* [MAPREDUCE-3713](https://issues.apache.org/jira/browse/MAPREDUCE-3713) | *Blocker* | **Incorrect headroom reported to jobs**
+* [MAPREDUCE-3398](https://issues.apache.org/jira/browse/MAPREDUCE-3398) | *Blocker* | **Log Aggregation broken in Secure Mode**
-Fixed the way head-room is allocated to applications by CapacityScheduler so that it deducts current-usage per user and not per-application.
+Fixed log aggregation to work correctly in secure mode. Contributed by Siddharth Seth.
---
-* [MAPREDUCE-3711](https://issues.apache.org/jira/browse/MAPREDUCE-3711) | *Blocker* | **AppMaster recovery for Medium to large jobs take long time**
+* [MAPREDUCE-3530](https://issues.apache.org/jira/browse/MAPREDUCE-3530) | *Blocker* | **Sometimes NODE\_UPDATE to the scheduler throws an NPE causing the scheduling to stop**
-Fixed MR AM recovery so that only single selected task output is recovered and thus reduce the unnecessarily bloated recovery time.
+Fixed an NPE occuring during scheduling in the ResourceManager.
---
-* [MAPREDUCE-3710](https://issues.apache.org/jira/browse/MAPREDUCE-3710) | *Major* | **last split generated by FileInputFormat.getSplits may not have the best locality**
+* [MAPREDUCE-3484](https://issues.apache.org/jira/browse/MAPREDUCE-3484) | *Major* | **JobEndNotifier is getting interrupted before completing all its retries.**
-Improved FileInputFormat to return better locality for the last split.
+Fixed JobEndNotifier to not get interrupted before completing all its retries.
---
-* [MAPREDUCE-3703](https://issues.apache.org/jira/browse/MAPREDUCE-3703) | *Critical* | **ResourceManager should provide node lists in JMX output**
-
-New JMX Bean in ResourceManager to provide list of live node managers:
+* [MAPREDUCE-3487](https://issues.apache.org/jira/browse/MAPREDUCE-3487) | *Critical* | **jobhistory web ui task counters no longer links to singletakecounter page**
-Hadoop:service=ResourceManager,name=RMNMInfo LiveNodeManagers
+Fixed JobHistory web-UI to display links to single task's counters' page.
---
-* [MAPREDUCE-3699](https://issues.apache.org/jira/browse/MAPREDUCE-3699) | *Major* | **Default RPC handlers are very low for YARN servers**
+* [MAPREDUCE-3564](https://issues.apache.org/jira/browse/MAPREDUCE-3564) | *Blocker* | **TestStagingCleanup and TestJobEndNotifier are failing on trunk.**
-Increased RPC handlers for all YARN servers to reasonable values for working at scale.
+Fixed failures in TestStagingCleanup and TestJobEndNotifier tests.
---
-* [MAPREDUCE-3656](https://issues.apache.org/jira/browse/MAPREDUCE-3656) | *Blocker* | **Sort job on 350 scale is consistently failing with latest MRV2 code**
+* [MAPREDUCE-778](https://issues.apache.org/jira/browse/MAPREDUCE-778) | *Major* | **[Rumen] Need a standalone JobHistory log anonymizer**
-Fixed a race condition in MR AM which is failing the sort benchmark consistently.
+Added an anonymizer tool to Rumen. Anonymizer takes a Rumen trace file and/or topology as input. It supports persistence and plugins to override the default behavior.
---
-* [MAPREDUCE-3641](https://issues.apache.org/jira/browse/MAPREDUCE-3641) | *Blocker* | **CapacityScheduler should be more conservative assigning off-switch requests**
+* [MAPREDUCE-3387](https://issues.apache.org/jira/browse/MAPREDUCE-3387) | *Critical* | **A tracking URL of N/A before the app master is launched breaks oozie**
-Making CapacityScheduler more conservative so as to assign only one off-switch container in a single scheduling iteration.
+Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution.
---
-* [MAPREDUCE-3639](https://issues.apache.org/jira/browse/MAPREDUCE-3639) | *Blocker* | **TokenCache likely broken for FileSystems which don't issue delegation tokens**
+* [MAPREDUCE-3339](https://issues.apache.org/jira/browse/MAPREDUCE-3339) | *Blocker* | **Job is getting hanged indefinitely,if the child processes are killed on the NM. KILL\_CONTAINER eventtype is continuosly sent to the containers that are not existing**
-Fixed TokenCache to work with absent FileSystem canonical service-names.
+Fixed MR AM to stop considering node blacklisting after the number of nodes blacklisted crosses a threshold.
---
-* [MAPREDUCE-3630](https://issues.apache.org/jira/browse/MAPREDUCE-3630) | *Critical* | **NullPointerException running teragen**
+* [MAPREDUCE-3349](https://issues.apache.org/jira/browse/MAPREDUCE-3349) | *Blocker* | **No rack-name logged in JobHistory for unsuccessful tasks**
-Committed to trunk and branch-0.23. Thanks Mahadev.
+Unsuccessful tasks now log hostname and rackname to job history.
---
-* [MAPREDUCE-3618](https://issues.apache.org/jira/browse/MAPREDUCE-3618) | *Major* | **TaskHeartbeatHandler holds a global lock for all task-updates**
+* [MAPREDUCE-3586](https://issues.apache.org/jira/browse/MAPREDUCE-3586) | *Blocker* | **Lots of AMs hanging around in PIG testing**
-Fixed TaskHeartbeatHandler to not hold a global lock for all task-updates.
+Modified CompositeService to avoid duplicate stop operations thereby solving race conditions in MR AM shutdown.
---
@@ -313,9 +308,9 @@ Rumen now provides {{Parsed\*}} objects. These objects provide extra information
---
-* [MAPREDUCE-3586](https://issues.apache.org/jira/browse/MAPREDUCE-3586) | *Blocker* | **Lots of AMs hanging around in PIG testing**
+* [MAPREDUCE-3399](https://issues.apache.org/jira/browse/MAPREDUCE-3399) | *Blocker* | **ContainerLocalizer should request new resources after completing the current one**
-Modified CompositeService to avoid duplicate stop operations thereby solving race conditions in MR AM shutdown.
+Modified ContainerLocalizer to send a heartbeat to NM immediately after downloading a resource instead of always waiting for a second.
---
@@ -327,351 +322,356 @@ Optimized Job's progress calculations in MR AM.
---
-* [MAPREDUCE-3564](https://issues.apache.org/jira/browse/MAPREDUCE-3564) | *Blocker* | **TestStagingCleanup and TestJobEndNotifier are failing on trunk.**
+* [HADOOP-7348](https://issues.apache.org/jira/browse/HADOOP-7348) | *Major* | **Modify the option of FsShell getmerge from [addnl] to [-nl] for consistency**
-Fixed failures in TestStagingCleanup and TestJobEndNotifier tests.
+The 'fs -getmerge' tool now uses a -nl flag to determine if adding a newline at end of each file is required, in favor of the 'addnl' boolean flag that was used earlier.
---
-* [MAPREDUCE-3549](https://issues.apache.org/jira/browse/MAPREDUCE-3549) | *Blocker* | **write api documentation for web service apis for RM, NM, mapreduce app master, and job history server**
-
-new files added: A hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/WebServicesIntro.apt.vm
-A hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/NodeManagerRest.apt.vm
-A hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ResourceManagerRest.apt.vm
-A hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/MapredAppMasterRest.apt.vm
-A hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/HistoryServerRest.apt.vm
+* [MAPREDUCE-3462](https://issues.apache.org/jira/browse/MAPREDUCE-3462) | *Blocker* | **Job submission failing in JUnit tests**
-The hadoop-project/src/site/site.xml is split into separate patch.
+Fixed failing JUnit tests in Gridmix.
---
-* [MAPREDUCE-3532](https://issues.apache.org/jira/browse/MAPREDUCE-3532) | *Critical* | **When 0 is provided as port number in yarn.nodemanager.webapp.address, NMs webserver component picks up random port, NM keeps on Reporting 0 port to RM**
+* [HDFS-1314](https://issues.apache.org/jira/browse/HDFS-1314) | *Minor* | **dfs.blocksize accepts only absolute value**
-Modified NM to report correct http address when an ephemeral web port is configured.
+The default blocksize property 'dfs.blocksize' now accepts unit symbols to be used instead of byte length. Values such as "10k", "128m", "1g" are now OK to provide instead of just no. of bytes as was before.
---
-* [MAPREDUCE-3530](https://issues.apache.org/jira/browse/MAPREDUCE-3530) | *Blocker* | **Sometimes NODE\_UPDATE to the scheduler throws an NPE causing the scheduling to stop**
+* [MAPREDUCE-3490](https://issues.apache.org/jira/browse/MAPREDUCE-3490) | *Blocker* | **RMContainerAllocator counts failed maps towards Reduce ramp up**
-Fixed an NPE occuring during scheduling in the ResourceManager.
+Fixed MapReduce AM to count failed maps also towards Reduce ramp up.
---
-* [MAPREDUCE-3528](https://issues.apache.org/jira/browse/MAPREDUCE-3528) | *Major* | **The task timeout check interval should be configurable independent of mapreduce.task.timeout**
+* [MAPREDUCE-3511](https://issues.apache.org/jira/browse/MAPREDUCE-3511) | *Blocker* | **Counters occupy a good part of AM heap**
-Fixed TaskHeartBeatHandler to use a new configuration for the thread loop interval separate from task-timeout configuration property.
+Removed a multitude of cloned/duplicate counters in the AM thereby reducing the AM heap size and preventing full GCs.
---
-* [MAPREDUCE-3519](https://issues.apache.org/jira/browse/MAPREDUCE-3519) | *Blocker* | **Deadlock in LocalDirsHandlerService and ShuffleHandler**
+* [HADOOP-7963](https://issues.apache.org/jira/browse/HADOOP-7963) | *Blocker* | **test failures: TestViewFileSystemWithAuthorityLocalFileSystem and TestViewFileSystemLocalFileSystem**
-Fixed a deadlock in NodeManager LocalDirectories's handling service.
+Fix ViewFS to catch a null canonical service-name and pass tests TestViewFileSystem\*
---
-* [MAPREDUCE-3512](https://issues.apache.org/jira/browse/MAPREDUCE-3512) | *Blocker* | **Batch jobHistory disk flushes**
+* [MAPREDUCE-3528](https://issues.apache.org/jira/browse/MAPREDUCE-3528) | *Major* | **The task timeout check interval should be configurable independent of mapreduce.task.timeout**
-Batching JobHistory flushing to DFS so that we don't flush for every event slowing down AM.
+Fixed TaskHeartBeatHandler to use a new configuration for the thread loop interval separate from task-timeout configuration property.
---
-* [MAPREDUCE-3511](https://issues.apache.org/jira/browse/MAPREDUCE-3511) | *Blocker* | **Counters occupy a good part of AM heap**
+* [MAPREDUCE-3639](https://issues.apache.org/jira/browse/MAPREDUCE-3639) | *Blocker* | **TokenCache likely broken for FileSystems which don't issue delegation tokens**
-Removed a multitude of cloned/duplicate counters in the AM thereby reducing the AM heap size and preventing full GCs.
+Fixed TokenCache to work with absent FileSystem canonical service-names.
---
-* [MAPREDUCE-3490](https://issues.apache.org/jira/browse/MAPREDUCE-3490) | *Blocker* | **RMContainerAllocator counts failed maps towards Reduce ramp up**
+* [MAPREDUCE-3312](https://issues.apache.org/jira/browse/MAPREDUCE-3312) | *Major* | **Make MR AM not send a stopContainer w/o corresponding start container**
-Fixed MapReduce AM to count failed maps also towards Reduce ramp up.
+Modified MR AM to not send a stop-container request for a container that isn't launched at all.
---
-* [MAPREDUCE-3487](https://issues.apache.org/jira/browse/MAPREDUCE-3487) | *Critical* | **jobhistory web ui task counters no longer links to singletakecounter page**
+* [MAPREDUCE-3382](https://issues.apache.org/jira/browse/MAPREDUCE-3382) | *Critical* | **Network ACLs can prevent AMs to ping the Job-end notification URL**
-Fixed JobHistory web-UI to display links to single task's counters' page.
+Enhanced MR AM to use a proxy to ping the job-end notification URL.
---
-* [MAPREDUCE-3484](https://issues.apache.org/jira/browse/MAPREDUCE-3484) | *Major* | **JobEndNotifier is getting interrupted before completing all its retries.**
+* [MAPREDUCE-3299](https://issues.apache.org/jira/browse/MAPREDUCE-3299) | *Minor* | **Add AMInfo table to the AM job page**
-Fixed JobEndNotifier to not get interrupted before completing all its retries.
+Added AMInfo table to the MR AM job pages to list all the job-attempts when AM restarts and recovers.
---
-* [MAPREDUCE-3481](https://issues.apache.org/jira/browse/MAPREDUCE-3481) | *Major* | **[Gridmix] Improve STRESS mode locking**
+* [MAPREDUCE-3618](https://issues.apache.org/jira/browse/MAPREDUCE-3618) | *Major* | **TaskHeartbeatHandler holds a global lock for all task-updates**
-Modified Gridmix STRESS mode locking structure. The submitted thread and the polling thread now run simultaneously without blocking each other.
+Fixed TaskHeartbeatHandler to not hold a global lock for all task-updates.
---
-* [MAPREDUCE-3462](https://issues.apache.org/jira/browse/MAPREDUCE-3462) | *Blocker* | **Job submission failing in JUnit tests**
+* [MAPREDUCE-3512](https://issues.apache.org/jira/browse/MAPREDUCE-3512) | *Blocker* | **Batch jobHistory disk flushes**
-Fixed failing JUnit tests in Gridmix.
+Batching JobHistory flushing to DFS so that we don't flush for every event slowing down AM.
---
-* [MAPREDUCE-3426](https://issues.apache.org/jira/browse/MAPREDUCE-3426) | *Blocker* | **uber-jobs tried to write outputs into wrong dir**
+* [MAPREDUCE-3656](https://issues.apache.org/jira/browse/MAPREDUCE-3656) | *Blocker* | **Sort job on 350 scale is consistently failing with latest MRV2 code**
-Fixed MR AM in uber mode to write map intermediate outputs in the correct directory to work properly in secure mode.
+Fixed a race condition in MR AM which is failing the sort benchmark consistently.
---
-* [MAPREDUCE-3417](https://issues.apache.org/jira/browse/MAPREDUCE-3417) | *Blocker* | **job access controls not working app master and job history UI's**
+* [MAPREDUCE-3532](https://issues.apache.org/jira/browse/MAPREDUCE-3532) | *Critical* | **When 0 is provided as port number in yarn.nodemanager.webapp.address, NMs webserver component picks up random port, NM keeps on Reporting 0 port to RM**
-Fixed job-access-controls to work with MR AM and JobHistoryServer web-apps.
+Modified NM to report correct http address when an ephemeral web port is configured.
---
-* [MAPREDUCE-3412](https://issues.apache.org/jira/browse/MAPREDUCE-3412) | *Major* | **'ant docs' is broken**
+* [MAPREDUCE-3404](https://issues.apache.org/jira/browse/MAPREDUCE-3404) | *Critical* | **Speculative Execution: speculative map tasks launched even if -Dmapreduce.map.speculative=false**
-Fixes 'ant docs' by removing stale references to capacity-scheduler docs.
+Corrected MR AM to honor speculative configuration and enable speculating either maps or reduces.
---
-* [MAPREDUCE-3407](https://issues.apache.org/jira/browse/MAPREDUCE-3407) | *Minor* | **Wrong jar getting used in TestMR\*Jobs\* for MiniMRYarnCluster**
+* [MAPREDUCE-3641](https://issues.apache.org/jira/browse/MAPREDUCE-3641) | *Blocker* | **CapacityScheduler should be more conservative assigning off-switch requests**
-Fixed pom files to refer to the correct MR app-jar needed by the integration tests.
+Making CapacityScheduler more conservative so as to assign only one off-switch container in a single scheduling iteration.
---
-* [MAPREDUCE-3404](https://issues.apache.org/jira/browse/MAPREDUCE-3404) | *Critical* | **Speculative Execution: speculative map tasks launched even if -Dmapreduce.map.speculative=false**
+* [HADOOP-7986](https://issues.apache.org/jira/browse/HADOOP-7986) | *Major* | **Add config for History Server protocol in hadoop-policy for service level authorization.**
-Corrected MR AM to honor speculative configuration and enable speculating either maps or reduces.
+Adding config for MapReduce History Server protocol in hadoop-policy.xml for service level authorization.
---
-* [MAPREDUCE-3399](https://issues.apache.org/jira/browse/MAPREDUCE-3399) | *Blocker* | **ContainerLocalizer should request new resources after completing the current one**
+* [MAPREDUCE-3549](https://issues.apache.org/jira/browse/MAPREDUCE-3549) | *Blocker* | **write api documentation for web service apis for RM, NM, mapreduce app master, and job history server**
-Modified ContainerLocalizer to send a heartbeat to NM immediately after downloading a resource instead of always waiting for a second.
+new files added: A hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/WebServicesIntro.apt.vm
+A hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/NodeManagerRest.apt.vm
+A hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ResourceManagerRest.apt.vm
+A hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/MapredAppMasterRest.apt.vm
+A hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/HistoryServerRest.apt.vm
+
+The hadoop-project/src/site/site.xml is split into separate patch.
---
-* [MAPREDUCE-3398](https://issues.apache.org/jira/browse/MAPREDUCE-3398) | *Blocker* | **Log Aggregation broken in Secure Mode**
+* [MAPREDUCE-3710](https://issues.apache.org/jira/browse/MAPREDUCE-3710) | *Major* | **last split generated by FileInputFormat.getSplits may not have the best locality**
-Fixed log aggregation to work correctly in secure mode. Contributed by Siddharth Seth.
+Improved FileInputFormat to return better locality for the last split.
---
-* [MAPREDUCE-3392](https://issues.apache.org/jira/browse/MAPREDUCE-3392) | *Blocker* | **Cluster.getDelegationToken() throws NPE if client.getDelegationToken() returns null.**
+* [MAPREDUCE-3714](https://issues.apache.org/jira/browse/MAPREDUCE-3714) | *Blocker* | **Reduce hangs in a corner case**
-Fixed Cluster's getDelegationToken's API to return null when there isn't a supported token.
+Fixed EventFetcher and Fetcher threads to shut-down properly so that reducers don't hang in corner cases.
---
-* [MAPREDUCE-3387](https://issues.apache.org/jira/browse/MAPREDUCE-3387) | *Critical* | **A tracking URL of N/A before the app master is launched breaks oozie**
+* [MAPREDUCE-3630](https://issues.apache.org/jira/browse/MAPREDUCE-3630) | *Critical* | **NullPointerException running teragen**
-Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution.
+Committed to trunk and branch-0.23. Thanks Mahadev.
---
-* [MAPREDUCE-3382](https://issues.apache.org/jira/browse/MAPREDUCE-3382) | *Critical* | **Network ACLs can prevent AMs to ping the Job-end notification URL**
+* [MAPREDUCE-3713](https://issues.apache.org/jira/browse/MAPREDUCE-3713) | *Blocker* | **Incorrect headroom reported to jobs**
-Enhanced MR AM to use a proxy to ping the job-end notification URL.
+Fixed the way head-room is allocated to applications by CapacityScheduler so that it deducts current-usage per user and not per-application.
---
-* [MAPREDUCE-3379](https://issues.apache.org/jira/browse/MAPREDUCE-3379) | *Major* | **LocalResourceTracker should not tracking deleted cache entries**
+* [MAPREDUCE-2765](https://issues.apache.org/jira/browse/MAPREDUCE-2765) | *Major* | **DistCp Rewrite**
-Fixed LocalResourceTracker in NodeManager to remove deleted cache entries correctly.
+DistCpV2 added to hadoop-tools.
---
-* [MAPREDUCE-3375](https://issues.apache.org/jira/browse/MAPREDUCE-3375) | *Major* | **Memory Emulation system tests.**
+* [MAPREDUCE-3699](https://issues.apache.org/jira/browse/MAPREDUCE-3699) | *Major* | **Default RPC handlers are very low for YARN servers**
-Added system tests to test the memory emulation feature in Gridmix.
+Increased RPC handlers for all YARN servers to reasonable values for working at scale.
---
-* [MAPREDUCE-3368](https://issues.apache.org/jira/browse/MAPREDUCE-3368) | *Critical* | **compile-mapred-test fails**
+* [MAPREDUCE-3360](https://issues.apache.org/jira/browse/MAPREDUCE-3360) | *Critical* | **Provide information about lost nodes in the UI.**
-Fixed ant test compilation.
+Added information about lost/rebooted/decommissioned nodes on the webapps.
---
-* [MAPREDUCE-3360](https://issues.apache.org/jira/browse/MAPREDUCE-3360) | *Critical* | **Provide information about lost nodes in the UI.**
+* [MAPREDUCE-3720](https://issues.apache.org/jira/browse/MAPREDUCE-3720) | *Major* | **Command line listJobs should not visit each AM**
-Added information about lost/rebooted/decommissioned nodes on the webapps.
+Changed bin/mapred job -list to not print job-specific information not available at RM.
+
+Very minor incompatibility in cmd-line output, inevitable due to MRv2 architecture.
---
-* [MAPREDUCE-3355](https://issues.apache.org/jira/browse/MAPREDUCE-3355) | *Blocker* | **AM scheduling hangs frequently with sort job on 350 nodes**
+* [MAPREDUCE-3732](https://issues.apache.org/jira/browse/MAPREDUCE-3732) | *Blocker* | **CS should only use 'activeUsers with pending requests' for computing user-limits**
-Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly.
+Modified CapacityScheduler to use only users with pending requests for computing user-limits.
---
-* [MAPREDUCE-3349](https://issues.apache.org/jira/browse/MAPREDUCE-3349) | *Blocker* | **No rack-name logged in JobHistory for unsuccessful tasks**
+* [MAPREDUCE-3481](https://issues.apache.org/jira/browse/MAPREDUCE-3481) | *Major* | **[Gridmix] Improve STRESS mode locking**
-Unsuccessful tasks now log hostname and rackname to job history.
+Modified Gridmix STRESS mode locking structure. The submitted thread and the polling thread now run simultaneously without blocking each other.
---
-* [MAPREDUCE-3345](https://issues.apache.org/jira/browse/MAPREDUCE-3345) | *Major* | **Race condition in ResourceManager causing TestContainerManagerSecurity to fail sometimes**
+* [MAPREDUCE-3703](https://issues.apache.org/jira/browse/MAPREDUCE-3703) | *Critical* | **ResourceManager should provide node lists in JMX output**
-Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes.
+New JMX Bean in ResourceManager to provide list of live node managers:
+
+Hadoop:service=ResourceManager,name=RMNMInfo LiveNodeManagers
---
-* [MAPREDUCE-3342](https://issues.apache.org/jira/browse/MAPREDUCE-3342) | *Critical* | **JobHistoryServer doesn't show job queue**
+* [MAPREDUCE-3716](https://issues.apache.org/jira/browse/MAPREDUCE-3716) | *Blocker* | **java.io.File.createTempFile fails in map/reduce tasks**
-Fixed JobHistoryServer to also show the job's queue name.
+Fixing YARN+MR to allow MR jobs to be able to use java.io.File.createTempFile to create temporary files as part of their tasks.
---
-* [MAPREDUCE-3339](https://issues.apache.org/jira/browse/MAPREDUCE-3339) | *Blocker* | **Job is getting hanged indefinitely,if the child processes are killed on the NM. KILL\_CONTAINER eventtype is continuosly sent to the containers that are not existing**
+* [MAPREDUCE-3754](https://issues.apache.org/jira/browse/MAPREDUCE-3754) | *Major* | **RM webapp should have pages filtered based on App-state**
-Fixed MR AM to stop considering node blacklisting after the number of nodes blacklisted crosses a threshold.
+Modified RM UI to filter applications based on state of the applications.
---
-* [MAPREDUCE-3333](https://issues.apache.org/jira/browse/MAPREDUCE-3333) | *Blocker* | **MR AM for sort-job going out of memory**
+* [MAPREDUCE-3774](https://issues.apache.org/jira/browse/MAPREDUCE-3774) | *Major* | **yarn-default.xml should be moved to hadoop-yarn-common.**
-Fixed bugs in ContainerLauncher of MR AppMaster due to which per-container connections to NodeManager were lingering long enough to hit the ulimits on number of processes.
+MAPREDUCE-3774. Moved yarn-default.xml to hadoop-yarn-common from hadoop-server-common.
---
-* [MAPREDUCE-3325](https://issues.apache.org/jira/browse/MAPREDUCE-3325) | *Major* | **Improvements to CapacityScheduler doc**
+* [HADOOP-7470](https://issues.apache.org/jira/browse/HADOOP-7470) | *Minor* | **move up to Jackson 1.8.8**
-document changes only.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-3312](https://issues.apache.org/jira/browse/MAPREDUCE-3312) | *Major* | **Make MR AM not send a stopContainer w/o corresponding start container**
+* [MAPREDUCE-3752](https://issues.apache.org/jira/browse/MAPREDUCE-3752) | *Blocker* | **Headroom should be capped by queue max-cap**
-Modified MR AM to not send a stop-container request for a container that isn't launched at all.
+Modified application limits to include queue max-capacities besides the usual user limits.
---
-* [MAPREDUCE-3299](https://issues.apache.org/jira/browse/MAPREDUCE-3299) | *Minor* | **Add AMInfo table to the AM job page**
+* [MAPREDUCE-3784](https://issues.apache.org/jira/browse/MAPREDUCE-3784) | *Major* | **maxActiveApplications(\|PerUser) per queue is too low for small clusters**
-Added AMInfo table to the MR AM job pages to list all the job-attempts when AM restarts and recovers.
+Fixed CapacityScheduler so that maxActiveApplication and maxActiveApplicationsPerUser per queue are not too low for small clusters.
---
-* [MAPREDUCE-3297](https://issues.apache.org/jira/browse/MAPREDUCE-3297) | *Major* | **Move Log Related components from yarn-server-nodemanager to yarn-common**
+* [HADOOP-8013](https://issues.apache.org/jira/browse/HADOOP-8013) | *Major* | **ViewFileSystem does not honor setVerifyChecksum**
-Moved log related components into yarn-common so that HistoryServer and clients can use them without depending on the yarn-server-nodemanager module.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-3280](https://issues.apache.org/jira/browse/MAPREDUCE-3280) | *Major* | **MR AM should not read the username from configuration**
+* [MAPREDUCE-3711](https://issues.apache.org/jira/browse/MAPREDUCE-3711) | *Blocker* | **AppMaster recovery for Medium to large jobs take long time**
-Removed the unnecessary job user-name configuration in mapred-site.xml.
+Fixed MR AM recovery so that only single selected task output is recovered and thus reduce the unnecessarily bloated recovery time.
---
-* [MAPREDUCE-3221](https://issues.apache.org/jira/browse/MAPREDUCE-3221) | *Minor* | **ant test TestSubmitJob failing on trunk**
+* [MAPREDUCE-3760](https://issues.apache.org/jira/browse/MAPREDUCE-3760) | *Major* | **Blacklisted NMs should not appear in Active nodes list**
-Fixed a bug in TestSubmitJob.
+Changed active nodes list to not contain unhealthy nodes on the webUI and metrics.
---
-* [MAPREDUCE-3219](https://issues.apache.org/jira/browse/MAPREDUCE-3219) | *Minor* | **ant test TestDelegationToken failing on trunk**
+* [MAPREDUCE-3417](https://issues.apache.org/jira/browse/MAPREDUCE-3417) | *Blocker* | **job access controls not working app master and job history UI's**
-Reenabled and fixed bugs in the failing test TestDelegationToken.
+Fixed job-access-controls to work with MR AM and JobHistoryServer web-apps.
---
-* [MAPREDUCE-3217](https://issues.apache.org/jira/browse/MAPREDUCE-3217) | *Minor* | **ant test TestAuditLogger fails on trunk**
+* [MAPREDUCE-3808](https://issues.apache.org/jira/browse/MAPREDUCE-3808) | *Blocker* | **NPE in FileOutputCommitter when running a 0 reduce job**
-Reenabled and fixed bugs in the failing ant test TestAuditLogger.
+Fixed an NPE in FileOutputCommitter for jobs with maps but no reduces.
---
-* [MAPREDUCE-3215](https://issues.apache.org/jira/browse/MAPREDUCE-3215) | *Minor* | **org.apache.hadoop.mapreduce.TestNoJobSetupCleanup failing on trunk**
+* [MAPREDUCE-3804](https://issues.apache.org/jira/browse/MAPREDUCE-3804) | *Major* | **yarn webapp interface vulnerable to cross scripting attacks**
-Reneabled and fixed bugs in the failing test TestNoJobSetupCleanup.
+fix cross scripting attacks vulnerability through webapp interface.
---
-* [MAPREDUCE-3102](https://issues.apache.org/jira/browse/MAPREDUCE-3102) | *Major* | **NodeManager should fail fast with wrong configuration or permissions for LinuxContainerExecutor**
+* [MAPREDUCE-3815](https://issues.apache.org/jira/browse/MAPREDUCE-3815) | *Critical* | **Data Locality suffers if the AM asks for containers using IPs instead of hostnames**
-Changed NodeManager to fail fast when LinuxContainerExecutor has wrong configuration or permissions.
+Fixed MR AM to always use hostnames and never IPs when requesting containers so that scheduler can give off data local containers correctly.
---
-* [MAPREDUCE-2950](https://issues.apache.org/jira/browse/MAPREDUCE-2950) | *Major* | **[Gridmix] TestUserResolve fails in trunk**
+* [MAPREDUCE-3834](https://issues.apache.org/jira/browse/MAPREDUCE-3834) | *Critical* | **If multiple hosts for a split belong to the same rack, the rack is added multiple times in the AM request table**
-Fixes bug in TestUserResolve.
+Changed MR AM to not add the same rack entry multiple times into the container request table when multiple hosts for a split happen to be on the same rack
---
-* [MAPREDUCE-2863](https://issues.apache.org/jira/browse/MAPREDUCE-2863) | *Blocker* | **Support web-services for RM & NM**
+* [MAPREDUCE-3846](https://issues.apache.org/jira/browse/MAPREDUCE-3846) | *Critical* | **Restarted+Recovered AM hangs in some corner cases**
-Support for web-services in YARN and MR components.
+Addressed MR AM hanging issues during AM restart and then the recovery.
---
-* [MAPREDUCE-2784](https://issues.apache.org/jira/browse/MAPREDUCE-2784) | *Major* | **[Gridmix] TestGridmixSummary fails with NPE when run in DEBUG mode.**
+* [HADOOP-8009](https://issues.apache.org/jira/browse/HADOOP-8009) | *Critical* | **Create hadoop-client and hadoop-minicluster artifacts for downstream projects**
-Fixed bugs in ExecutionSummarizer and ResourceUsageMatcher.
+Generate integration artifacts "org.apache.hadoop:hadoop-client" and "org.apache.hadoop:hadoop-minicluster" containing all the jars needed to use Hadoop client APIs, and to run Hadoop MiniClusters, respectively. Push these artifacts to the maven repository when mvn-deploy, along with existing artifacts.
---
-* [MAPREDUCE-2765](https://issues.apache.org/jira/browse/MAPREDUCE-2765) | *Major* | **DistCp Rewrite**
+* [MAPREDUCE-3802](https://issues.apache.org/jira/browse/MAPREDUCE-3802) | *Critical* | **If an MR AM dies twice it looks like the process freezes**
-DistCpV2 added to hadoop-tools.
+Added test to validate that AM can crash multiple times and still can recover successfully after MAPREDUCE-3846.
---
-* [MAPREDUCE-2733](https://issues.apache.org/jira/browse/MAPREDUCE-2733) | *Major* | **Gridmix v3 cpu emulation system tests.**
+* [MAPREDUCE-3854](https://issues.apache.org/jira/browse/MAPREDUCE-3854) | *Major* | **Reinstate environment variable tests in TestMiniMRChildTask**
-Adds system tests for the CPU emulation feature in Gridmix3.
+Fixed and reenabled tests related to MR child JVM's environmental variables in TestMiniMRChildTask.
---
-* [MAPREDUCE-778](https://issues.apache.org/jira/browse/MAPREDUCE-778) | *Major* | **[Rumen] Need a standalone JobHistory log anonymizer**
+* [HDFS-2316](https://issues.apache.org/jira/browse/HDFS-2316) | *Major* | **[umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTP**
-Added an anonymizer tool to Rumen. Anonymizer takes a Rumen trace file and/or topology as input. It supports persistence and plugins to override the default behavior.
+Provide WebHDFS as a complete FileSystem implementation for accessing HDFS over HTTP.
+Previous hftp feature was a read-only FileSystem and does not provide "write" accesses.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.10/CHANGES.0.23.10.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.10/CHANGES.0.23.10.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.10/CHANGES.0.23.10.md
index 75b818f..c94968f 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.10/CHANGES.0.23.10.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.10/CHANGES.0.23.10.md
@@ -27,112 +27,94 @@
| [YARN-707](https://issues.apache.org/jira/browse/YARN-707) | Add user info in the YARN ClientToken | Blocker | . | Bikas Saha | Jason Lowe |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9686](https://issues.apache.org/jira/browse/HADOOP-9686) | Easy access to final parameters in Configuration | Major | conf | Jason Lowe | Jason Lowe |
-| [HADOOP-8704](https://issues.apache.org/jira/browse/HADOOP-8704) | add request logging to jetty/httpserver | Major | . | Thomas Graves | Jonathan Eagles |
| [HDFS-5010](https://issues.apache.org/jira/browse/HDFS-5010) | Reduce the frequency of getCurrentUser() calls from namenode | Major | namenode, performance | Kihwal Lee | Kihwal Lee |
-| [MAPREDUCE-5640](https://issues.apache.org/jira/browse/MAPREDUCE-5640) | Rename TestLineRecordReader in jobclient module | Trivial | test | Jason Lowe | Jason Lowe |
| [MAPREDUCE-1981](https://issues.apache.org/jira/browse/MAPREDUCE-1981) | Improve getSplits performance by using listLocatedStatus | Major | job submission | Hairong Kuang | Hairong Kuang |
| [YARN-985](https://issues.apache.org/jira/browse/YARN-985) | Nodemanager should log where a resource was localized | Major | nodemanager | Ravi Prakash | Ravi Prakash |
+| [HADOOP-9686](https://issues.apache.org/jira/browse/HADOOP-9686) | Easy access to final parameters in Configuration | Major | conf | Jason Lowe | Jason Lowe |
+| [HADOOP-8704](https://issues.apache.org/jira/browse/HADOOP-8704) | add request logging to jetty/httpserver | Major | . | Thomas Graves | Jonathan Eagles |
+| [MAPREDUCE-5640](https://issues.apache.org/jira/browse/MAPREDUCE-5640) | Rename TestLineRecordReader in jobclient module | Trivial | test | Jason Lowe | Jason Lowe |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10091](https://issues.apache.org/jira/browse/HADOOP-10091) | Job with a har archive as input fails on 0.23 | Blocker | fs | Jason Lowe | Jason Lowe |
-| [HADOOP-9757](https://issues.apache.org/jira/browse/HADOOP-9757) | Har metadata cache can grow without limit | Major | fs | Jason Lowe | Cristina L. Abad |
-| [HADOOP-9476](https://issues.apache.org/jira/browse/HADOOP-9476) | Some test cases in TestUserGroupInformation fail if ran after testSetLoginUser. | Major | security, test | Kihwal Lee | Robert Parker |
-| [HDFS-5558](https://issues.apache.org/jira/browse/HDFS-5558) | LeaseManager monitor thread can crash if the last block is complete but another block is not. | Major | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-5557](https://issues.apache.org/jira/browse/HDFS-5557) | Write pipeline recovery for the last packet in the block may cause rejection of valid replicas | Critical | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-5526](https://issues.apache.org/jira/browse/HDFS-5526) | Datanode cannot roll back to previous layout version | Blocker | datanode | Tsz Wo Nicholas Sze | Kihwal Lee |
-| [HDFS-5438](https://issues.apache.org/jira/browse/HDFS-5438) | Flaws in block report processing can cause data loss | Critical | namenode | Kihwal Lee | Kihwal Lee |
-| [HDFS-5346](https://issues.apache.org/jira/browse/HDFS-5346) | Avoid unnecessary call to getNumLiveDataNodes() for each block during IBR processing | Major | namenode, performance | Kihwal Lee | Ravi Prakash |
-| [HDFS-5047](https://issues.apache.org/jira/browse/HDFS-5047) | Supress logging of full stack trace of quota and lease exceptions | Major | namenode | Kihwal Lee | Robert Parker |
-| [HDFS-5028](https://issues.apache.org/jira/browse/HDFS-5028) | LeaseRenewer throw java.util.ConcurrentModificationException when timeout | Major | . | zhaoyunjiong | zhaoyunjiong |
-| [HDFS-4998](https://issues.apache.org/jira/browse/HDFS-4998) | TestUnderReplicatedBlocks fails intermittently | Major | test | Kihwal Lee | Kihwal Lee |
-| [HDFS-4995](https://issues.apache.org/jira/browse/HDFS-4995) | Make getContentSummary() less expensive | Major | namenode | Kihwal Lee | Kihwal Lee |
-| [HDFS-4994](https://issues.apache.org/jira/browse/HDFS-4994) | Audit log getContentSummary() calls | Minor | namenode | Kihwal Lee | Robert Parker |
-| [HDFS-4993](https://issues.apache.org/jira/browse/HDFS-4993) | fsck can fail if a file is renamed or deleted | Major | . | Kihwal Lee | Robert Parker |
+| [HDFS-3020](https://issues.apache.org/jira/browse/HDFS-3020) | Auto-logSync based on edit log buffer size broken | Critical | namenode | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-4579](https://issues.apache.org/jira/browse/MAPREDUCE-4579) | TestTaskAttempt fails jdk7 | Major | . | Thomas Graves | Thomas Graves |
+| [HDFS-3970](https://issues.apache.org/jira/browse/HDFS-3970) | BlockPoolSliceStorage#doRollback(..) should use BlockPoolSliceStorage instead of DataStorage to read prev version file. | Major | datanode | Vinayakumar B | Vinayakumar B |
+| [HDFS-4482](https://issues.apache.org/jira/browse/HDFS-4482) | ReplicationMonitor thread can exit with NPE due to the race between delete and replication of same file. | Blocker | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [MAPREDUCE-4571](https://issues.apache.org/jira/browse/MAPREDUCE-4571) | TestHsWebServicesJobs fails on jdk7 | Major | webapps | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4716](https://issues.apache.org/jira/browse/MAPREDUCE-4716) | TestHsWebServicesJobsQuery.testJobsQueryStateInvalid fails with jdk7 | Major | jobhistoryserver | Thomas Graves | Thomas Graves |
+| [HDFS-4943](https://issues.apache.org/jira/browse/HDFS-4943) | WebHdfsFileSystem does not work when original file path has encoded chars | Minor | webhdfs | Jerry He | Jerry He |
+| [MAPREDUCE-3193](https://issues.apache.org/jira/browse/MAPREDUCE-3193) | FileInputFormat doesn't read files recursively in the input path dir | Major | mrv1, mrv2 | Ramgopal N | Devaraj K |
| [HDFS-4984](https://issues.apache.org/jira/browse/HDFS-4984) | Incorrect Quota counting in INodeFile | Major | namenode | Kihwal Lee | Jing Zhao |
| [HDFS-4972](https://issues.apache.org/jira/browse/HDFS-4972) | [branch-0.23] permission check and operation are done in a separate lock for getBlockLocations() | Major | namenode | Kihwal Lee | Kihwal Lee |
-| [HDFS-4943](https://issues.apache.org/jira/browse/HDFS-4943) | WebHdfsFileSystem does not work when original file path has encoded chars | Minor | webhdfs | Jerry He | Jerry He |
-| [HDFS-4482](https://issues.apache.org/jira/browse/HDFS-4482) | ReplicationMonitor thread can exit with NPE due to the race between delete and replication of same file. | Blocker | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HDFS-4329](https://issues.apache.org/jira/browse/HDFS-4329) | DFSShell issues with directories with spaces in name | Major | hdfs-client | Andy Isaacson | Cristina L. Abad |
-| [HDFS-3970](https://issues.apache.org/jira/browse/HDFS-3970) | BlockPoolSliceStorage#doRollback(..) should use BlockPoolSliceStorage instead of DataStorage to read prev version file. | Major | datanode | Vinayakumar B | Vinayakumar B |
-| [HDFS-3020](https://issues.apache.org/jira/browse/HDFS-3020) | Auto-logSync based on edit log buffer size broken | Critical | namenode | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-5587](https://issues.apache.org/jira/browse/MAPREDUCE-5587) | TestTextOutputFormat fails on JDK7 | Major | . | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-5586](https://issues.apache.org/jira/browse/MAPREDUCE-5586) | TestCopyMapper#testCopyFailOnBlockSizeDifference fails when run from hadoop-tools/hadoop-distcp directory | Major | . | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-5585](https://issues.apache.org/jira/browse/MAPREDUCE-5585) | TestCopyCommitter#testNoCommitAction Fails on JDK7 | Major | . | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-5569](https://issues.apache.org/jira/browse/MAPREDUCE-5569) | FloatSplitter is not generating correct splits | Major | . | Nathan Roberts | Nathan Roberts |
-| [MAPREDUCE-5561](https://issues.apache.org/jira/browse/MAPREDUCE-5561) | org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk | Critical | . | Cindy Li | Karthik Kambatla |
-| [MAPREDUCE-5543](https://issues.apache.org/jira/browse/MAPREDUCE-5543) | In-memory map outputs can be leaked after shuffle completes in 0.23 | Blocker | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-5513](https://issues.apache.org/jira/browse/MAPREDUCE-5513) | ConcurrentModificationException in JobControl | Major | . | Jason Lowe | Robert Parker |
-| [MAPREDUCE-5504](https://issues.apache.org/jira/browse/MAPREDUCE-5504) | mapred queue -info inconsistent with types | Major | client | Thomas Graves | Kousuke Saruta |
-| [MAPREDUCE-5475](https://issues.apache.org/jira/browse/MAPREDUCE-5475) | MRClientService does not verify ACLs properly | Blocker | mr-am, mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-5468](https://issues.apache.org/jira/browse/MAPREDUCE-5468) | AM recovery does not work for map only jobs | Blocker | . | Yesha Vora | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-5440](https://issues.apache.org/jira/browse/MAPREDUCE-5440) | TestCopyCommitter Fails on JDK7 | Major | mrv2 | Robert Parker | Robert Parker |
-| [MAPREDUCE-5425](https://issues.apache.org/jira/browse/MAPREDUCE-5425) | Junit in TestJobHistoryServer failing in jdk 7 | Major | jobhistoryserver | Ashwin Shankar | Robert Parker |
-| [MAPREDUCE-5419](https://issues.apache.org/jira/browse/MAPREDUCE-5419) | TestSlive is getting FileNotFound Exception | Major | mrv2 | Robert Parker | Robert Parker |
-| [MAPREDUCE-5414](https://issues.apache.org/jira/browse/MAPREDUCE-5414) | TestTaskAttempt fails jdk7 with NullPointerException | Major | test | Nemon Lou | Nemon Lou |
| [MAPREDUCE-5380](https://issues.apache.org/jira/browse/MAPREDUCE-5380) | Invalid mapred command should return non-zero exit code | Major | . | Stephen Chu | Stephen Chu |
-| [MAPREDUCE-5373](https://issues.apache.org/jira/browse/MAPREDUCE-5373) | TestFetchFailure.testFetchFailureMultipleReduces could fail intermittently | Major | . | Chuan Liu | Jonathan Eagles |
+| [HDFS-4998](https://issues.apache.org/jira/browse/HDFS-4998) | TestUnderReplicatedBlocks fails intermittently | Major | test | Kihwal Lee | Kihwal Lee |
| [MAPREDUCE-5317](https://issues.apache.org/jira/browse/MAPREDUCE-5317) | Stale files left behind for failed jobs | Major | mrv2 | Ravi Prakash | Ravi Prakash |
+| [YARN-949](https://issues.apache.org/jira/browse/YARN-949) | Failed log aggregation can leave a file open. | Major | nodemanager | Kihwal Lee | Kihwal Lee |
| [MAPREDUCE-5251](https://issues.apache.org/jira/browse/MAPREDUCE-5251) | Reducer should not implicate map attempt if it has insufficient space to fetch map output | Major | mrv2 | Jason Lowe | Ashwin Shankar |
-| [MAPREDUCE-5001](https://issues.apache.org/jira/browse/MAPREDUCE-5001) | LocalJobRunner has race condition resulting in job failures | Major | . | Brock Noland | Sandy Ryza |
-| [MAPREDUCE-4716](https://issues.apache.org/jira/browse/MAPREDUCE-4716) | TestHsWebServicesJobsQuery.testJobsQueryStateInvalid fails with jdk7 | Major | jobhistoryserver | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4579](https://issues.apache.org/jira/browse/MAPREDUCE-4579) | TestTaskAttempt fails jdk7 | Major | . | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4571](https://issues.apache.org/jira/browse/MAPREDUCE-4571) | TestHsWebServicesJobs fails on jdk7 | Major | webapps | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3193](https://issues.apache.org/jira/browse/MAPREDUCE-3193) | FileInputFormat doesn't read files recursively in the input path dir | Major | mrv1, mrv2 | Ramgopal N | Devaraj K |
-| [YARN-1419](https://issues.apache.org/jira/browse/YARN-1419) | TestFifoScheduler.testAppAttemptMetrics fails intermittently under jdk7 | Minor | scheduler | Jonathan Eagles | Jonathan Eagles |
-| [YARN-1386](https://issues.apache.org/jira/browse/YARN-1386) | NodeManager mistakenly loses resources and relocalizes them | Critical | nodemanager | Jason Lowe | Jason Lowe |
-| [YARN-1243](https://issues.apache.org/jira/browse/YARN-1243) | ResourceManager: Error in handling event type NODE\_UPDATE to the scheduler - NPE at SchedulerApp.java:411 | Major | capacityscheduler | Sanjay Upadhyay | Jason Lowe |
-| [YARN-1176](https://issues.apache.org/jira/browse/YARN-1176) | RM web services ClusterMetricsInfo total nodes doesn't include unhealthy nodes | Critical | resourcemanager | Thomas Graves | Jonathan Eagles |
-| [YARN-1101](https://issues.apache.org/jira/browse/YARN-1101) | Active nodes can be decremented below 0 | Major | resourcemanager | Robert Parker | Robert Parker |
+| [MAPREDUCE-5419](https://issues.apache.org/jira/browse/MAPREDUCE-5419) | TestSlive is getting FileNotFound Exception | Major | mrv2 | Robert Parker | Robert Parker |
+| [HDFS-5028](https://issues.apache.org/jira/browse/HDFS-5028) | LeaseRenewer throw java.util.ConcurrentModificationException when timeout | Major | . | yunjiong zhao | yunjiong zhao |
+| [MAPREDUCE-5440](https://issues.apache.org/jira/browse/MAPREDUCE-5440) | TestCopyCommitter Fails on JDK7 | Major | mrv2 | Robert Parker | Robert Parker |
+| [HADOOP-9476](https://issues.apache.org/jira/browse/HADOOP-9476) | Some test cases in TestUserGroupInformation fail if ran after testSetLoginUser. | Major | security, test | Kihwal Lee | Robert Parker |
+| [MAPREDUCE-5425](https://issues.apache.org/jira/browse/MAPREDUCE-5425) | Junit in TestJobHistoryServer failing in jdk 7 | Major | jobhistoryserver | Ashwin Shankar | Robert Parker |
+| [HDFS-5047](https://issues.apache.org/jira/browse/HDFS-5047) | Supress logging of full stack trace of quota and lease exceptions | Major | namenode | Kihwal Lee | Robert Parker |
+| [HDFS-4993](https://issues.apache.org/jira/browse/HDFS-4993) | fsck can fail if a file is renamed or deleted | Major | . | Kihwal Lee | Robert Parker |
+| [HADOOP-9757](https://issues.apache.org/jira/browse/HADOOP-9757) | Har metadata cache can grow without limit | Major | fs | Jason Lowe | Cristina L. Abad |
| [YARN-1036](https://issues.apache.org/jira/browse/YARN-1036) | Distributed Cache gives inconsistent result if cache files get deleted from task tracker | Major | nodemanager | Ravi Prakash | Ravi Prakash |
-| [YARN-1031](https://issues.apache.org/jira/browse/YARN-1031) | JQuery UI components reference external css in branch-23 | Major | . | Jonathan Eagles | Jonathan Eagles |
-| [YARN-949](https://issues.apache.org/jira/browse/YARN-949) | Failed log aggregation can leave a file open. | Major | nodemanager | Kihwal Lee | Kihwal Lee |
| [YARN-337](https://issues.apache.org/jira/browse/YARN-337) | RM handles killed application tracking URL poorly | Major | resourcemanager | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-5001](https://issues.apache.org/jira/browse/MAPREDUCE-5001) | LocalJobRunner has race condition resulting in job failures | Major | . | Brock Noland | Sandy Ryza |
+| [HDFS-4994](https://issues.apache.org/jira/browse/HDFS-4994) | Audit log getContentSummary() calls | Minor | namenode | Kihwal Lee | Robert Parker |
+| [MAPREDUCE-5468](https://issues.apache.org/jira/browse/MAPREDUCE-5468) | AM recovery does not work for map only jobs | Blocker | . | Yesha Vora | Vinod Kumar Vavilapalli |
+| [HDFS-4329](https://issues.apache.org/jira/browse/HDFS-4329) | DFSShell issues with directories with spaces in name | Major | hdfs-client | Andy Isaacson | Cristina L. Abad |
+| [YARN-1101](https://issues.apache.org/jira/browse/YARN-1101) | Active nodes can be decremented below 0 | Major | resourcemanager | Robert Parker | Robert Parker |
+| [MAPREDUCE-5475](https://issues.apache.org/jira/browse/MAPREDUCE-5475) | MRClientService does not verify ACLs properly | Blocker | mr-am, mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-5414](https://issues.apache.org/jira/browse/MAPREDUCE-5414) | TestTaskAttempt fails jdk7 with NullPointerException | Major | test | Nemon Lou | Nemon Lou |
+| [YARN-1176](https://issues.apache.org/jira/browse/YARN-1176) | RM web services ClusterMetricsInfo total nodes doesn't include unhealthy nodes | Critical | resourcemanager | Thomas Graves | Jonathan Eagles |
+| [MAPREDUCE-5504](https://issues.apache.org/jira/browse/MAPREDUCE-5504) | mapred queue -info inconsistent with types | Major | client | Thomas Graves | Kousuke Saruta |
+| [YARN-1243](https://issues.apache.org/jira/browse/YARN-1243) | ResourceManager: Error in handling event type NODE\_UPDATE to the scheduler - NPE at SchedulerApp.java:411 | Major | capacityscheduler | Sanjay Upadhyay | Jason Lowe |
+| [MAPREDUCE-5543](https://issues.apache.org/jira/browse/MAPREDUCE-5543) | In-memory map outputs can be leaked after shuffle completes in 0.23 | Blocker | mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-5513](https://issues.apache.org/jira/browse/MAPREDUCE-5513) | ConcurrentModificationException in JobControl | Major | . | Jason Lowe | Robert Parker |
+| [MAPREDUCE-5569](https://issues.apache.org/jira/browse/MAPREDUCE-5569) | FloatSplitter is not generating correct splits | Major | . | Nathan Roberts | Nathan Roberts |
| [YARN-155](https://issues.apache.org/jira/browse/YARN-155) | TestAppManager intermittently fails with jdk7 | Major | . | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-5585](https://issues.apache.org/jira/browse/MAPREDUCE-5585) | TestCopyCommitter#testNoCommitAction Fails on JDK7 | Major | . | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-5586](https://issues.apache.org/jira/browse/MAPREDUCE-5586) | TestCopyMapper#testCopyFailOnBlockSizeDifference fails when run from hadoop-tools/hadoop-distcp directory | Major | . | Jonathan Eagles | Jonathan Eagles |
+| [HDFS-5346](https://issues.apache.org/jira/browse/HDFS-5346) | Avoid unnecessary call to getNumLiveDataNodes() for each block during IBR processing | Major | namenode, performance | Kihwal Lee | Ravi Prakash |
+| [MAPREDUCE-5587](https://issues.apache.org/jira/browse/MAPREDUCE-5587) | TestTextOutputFormat fails on JDK7 | Major | . | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-5561](https://issues.apache.org/jira/browse/MAPREDUCE-5561) | org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk | Critical | . | Cindy Li | Karthik Kambatla |
+| [YARN-1031](https://issues.apache.org/jira/browse/YARN-1031) | JQuery UI components reference external css in branch-23 | Major | . | Jonathan Eagles | Jonathan Eagles |
+| [YARN-1386](https://issues.apache.org/jira/browse/YARN-1386) | NodeManager mistakenly loses resources and relocalizes them | Critical | nodemanager | Jason Lowe | Jason Lowe |
+| [HADOOP-10091](https://issues.apache.org/jira/browse/HADOOP-10091) | Job with a har archive as input fails on 0.23 | Blocker | fs | Jason Lowe | Jason Lowe |
+| [HDFS-4995](https://issues.apache.org/jira/browse/HDFS-4995) | Make getContentSummary() less expensive | Major | namenode | Kihwal Lee | Kihwal Lee |
+| [HDFS-5438](https://issues.apache.org/jira/browse/HDFS-5438) | Flaws in block report processing can cause data loss | Critical | namenode | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-5373](https://issues.apache.org/jira/browse/MAPREDUCE-5373) | TestFetchFailure.testFetchFailureMultipleReduces could fail intermittently | Major | . | Chuan Liu | Jonathan Eagles |
+| [YARN-1419](https://issues.apache.org/jira/browse/YARN-1419) | TestFifoScheduler.testAppAttemptMetrics fails intermittently under jdk7 | Minor | scheduler | Jonathan Eagles | Jonathan Eagles |
+| [HDFS-5557](https://issues.apache.org/jira/browse/HDFS-5557) | Write pipeline recovery for the last packet in the block may cause rejection of valid replicas | Critical | . | Kihwal Lee | Kihwal Lee |
+| [HDFS-5526](https://issues.apache.org/jira/browse/HDFS-5526) | Datanode cannot roll back to previous layout version | Blocker | datanode | Tsz Wo Nicholas Sze | Kihwal Lee |
+| [HDFS-5558](https://issues.apache.org/jira/browse/HDFS-5558) | LeaseManager monitor thread can crash if the last block is complete but another block is not. | Major | . | Kihwal Lee | Kihwal Lee |
### TESTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [MAPREDUCE-5610](https://issues.apache.org/jira/browse/MAPREDUCE-5610) | TestSleepJob fails in jdk7 | Major | . | Jonathan Eagles | Jonathan Eagles |
| [YARN-1119](https://issues.apache.org/jira/browse/YARN-1119) | Add ClusterMetrics checks to tho TestRMNodeTransitions tests | Major | resourcemanager | Robert Parker | Mit Desai |
+| [MAPREDUCE-5610](https://issues.apache.org/jira/browse/MAPREDUCE-5610) | TestSleepJob fails in jdk7 | Major | . | Jonathan Eagles | Jonathan Eagles |
### SUB-TASKS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9956](https://issues.apache.org/jira/browse/HADOOP-9956) | RPC listener inefficiently assigns connections to readers | Major | ipc | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9955](https://issues.apache.org/jira/browse/HADOOP-9955) | RPC idle connection closing is extremely inefficient | Major | ipc | Daryn Sharp | Daryn Sharp |
| [HADOOP-9748](https://issues.apache.org/jira/browse/HADOOP-9748) | Reduce blocking on UGI.ensureInitialized | Critical | security | Daryn Sharp | Daryn Sharp |
-| [HDFS-5239](https://issues.apache.org/jira/browse/HDFS-5239) | Allow FSNamesystem lock fairness to be configurable | Major | namenode | Daryn Sharp | Daryn Sharp |
| [YARN-573](https://issues.apache.org/jira/browse/YARN-573) | Shared data structures in Public Localizer and Private Localizer are not Thread safe. | Critical | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-5239](https://issues.apache.org/jira/browse/HDFS-5239) | Allow FSNamesystem lock fairness to be configurable | Major | namenode | Daryn Sharp | Daryn Sharp |
+| [HADOOP-9956](https://issues.apache.org/jira/browse/HADOOP-9956) | RPC listener inefficiently assigns connections to readers | Major | ipc | Daryn Sharp | Daryn Sharp |
+| [HADOOP-9955](https://issues.apache.org/jira/browse/HADOOP-9955) | RPC idle connection closing is extremely inefficient | Major | ipc | Daryn Sharp | Daryn Sharp |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.10/RELEASENOTES.0.23.10.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.10/RELEASENOTES.0.23.10.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.10/RELEASENOTES.0.23.10.md
index be5dc41..6a28435 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.10/RELEASENOTES.0.23.10.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.10/RELEASENOTES.0.23.10.md
@@ -25,7 +25,7 @@ These release notes cover new developer and user-facing incompatibilities, impor
* [YARN-707](https://issues.apache.org/jira/browse/YARN-707) | *Blocker* | **Add user info in the YARN ClientToken**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.11/CHANGES.0.23.11.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.11/CHANGES.0.23.11.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.11/CHANGES.0.23.11.md
index 8313a69..436bb1b 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.11/CHANGES.0.23.11.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.11/CHANGES.0.23.11.md
@@ -20,79 +20,57 @@
## Release 0.23.11 - 2014-06-25
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10454](https://issues.apache.org/jira/browse/HADOOP-10454) | Provide FileContext version of har file system | Major | . | Kihwal Lee | Kihwal Lee |
-| [HADOOP-10164](https://issues.apache.org/jira/browse/HADOOP-10164) | Allow UGI to login with a known Subject | Major | . | Robert Joseph Evans | Robert Joseph Evans |
| [HADOOP-7688](https://issues.apache.org/jira/browse/HADOOP-7688) | When a servlet filter throws an exception in init(..), the Jetty server failed silently. | Major | . | Tsz Wo Nicholas Sze | Uma Maheswara Rao G |
-| [HDFS-6191](https://issues.apache.org/jira/browse/HDFS-6191) | Disable quota checks when replaying edit log. | Major | namenode | Kihwal Lee | Kihwal Lee |
+| [HDFS-4461](https://issues.apache.org/jira/browse/HDFS-4461) | DirectoryScanner: volume path prefix takes up memory for every block that is scanned | Minor | . | Colin P. McCabe | Colin P. McCabe |
| [HDFS-5637](https://issues.apache.org/jira/browse/HDFS-5637) | try to refeatchToken while local read InvalidToken occurred | Major | hdfs-client, security | Liang Xie | Liang Xie |
-| [HDFS-4461](https://issues.apache.org/jira/browse/HDFS-4461) | DirectoryScanner: volume path prefix takes up memory for every block that is scanned | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
+| [HADOOP-10164](https://issues.apache.org/jira/browse/HADOOP-10164) | Allow UGI to login with a known Subject | Major | . | Robert Joseph Evans | Robert Joseph Evans |
+| [HADOOP-10454](https://issues.apache.org/jira/browse/HADOOP-10454) | Provide FileContext version of har file system | Major | . | Kihwal Lee | Kihwal Lee |
+| [HDFS-6191](https://issues.apache.org/jira/browse/HDFS-6191) | Disable quota checks when replaying edit log. | Major | namenode | Kihwal Lee | Kihwal Lee |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10588](https://issues.apache.org/jira/browse/HADOOP-10588) | Workaround for jetty6 acceptor startup issue | Major | . | Kihwal Lee | Kihwal Lee |
-| [HADOOP-10332](https://issues.apache.org/jira/browse/HADOOP-10332) | HttpServer's jetty audit log always logs 200 OK | Major | . | Daryn Sharp | Jonathan Eagles |
-| [HADOOP-10146](https://issues.apache.org/jira/browse/HADOOP-10146) | Workaround JDK7 Process fd close bug | Critical | util | Daryn Sharp | Daryn Sharp |
+| [HADOOP-9230](https://issues.apache.org/jira/browse/HADOOP-9230) | TestUniformSizeInputFormat fails intermittently | Major | test | Karthik Kambatla | Karthik Kambatla |
+| [YARN-500](https://issues.apache.org/jira/browse/YARN-500) | ResourceManager webapp is using next port if configured port is already in use | Major | resourcemanager | Nishan Shetty | Kenji Kikushima |
+| [YARN-853](https://issues.apache.org/jira/browse/YARN-853) | maximum-am-resource-percent doesn't work after refreshQueues command | Major | capacityscheduler | Devaraj K | Devaraj K |
+| [MAPREDUCE-5454](https://issues.apache.org/jira/browse/MAPREDUCE-5454) | TestDFSIO fails intermittently on JDK7 | Major | test | Karthik Kambatla | Karthik Kambatla |
+| [YARN-1053](https://issues.apache.org/jira/browse/YARN-1053) | Diagnostic message from ContainerExitEvent is ignored in ContainerImpl | Blocker | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
| [HADOOP-10129](https://issues.apache.org/jira/browse/HADOOP-10129) | Distcp may succeed when it fails | Critical | tools/distcp | Daryn Sharp | Daryn Sharp |
-| [HADOOP-10112](https://issues.apache.org/jira/browse/HADOOP-10112) | har file listing doesn't work with wild card | Major | tools | Brandon Li | Brandon Li |
-| [HADOOP-10110](https://issues.apache.org/jira/browse/HADOOP-10110) | hadoop-auth has a build break due to missing dependency | Blocker | build | Chuan Liu | Chuan Liu |
| [HADOOP-10081](https://issues.apache.org/jira/browse/HADOOP-10081) | Client.setupIOStreams can leak socket resources on exception or error | Critical | ipc | Jason Lowe | Tsuyoshi Ozawa |
-| [HADOOP-9230](https://issues.apache.org/jira/browse/HADOOP-9230) | TestUniformSizeInputFormat fails intermittently | Major | test | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-8826](https://issues.apache.org/jira/browse/HADOOP-8826) | Docs still refer to 0.20.205 as stable line | Minor | . | Robert Joseph Evans | Mit Desai |
-| [HDFS-6449](https://issues.apache.org/jira/browse/HDFS-6449) | Incorrect counting in ContentSummaryComputationContext in 0.23. | Critical | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-6166](https://issues.apache.org/jira/browse/HDFS-6166) | revisit balancer so\_timeout | Blocker | balancer & mover | Nathan Roberts | Nathan Roberts |
-| [HDFS-5881](https://issues.apache.org/jira/browse/HDFS-5881) | Fix skip() of the short-circuit local reader (legacy). | Critical | . | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-5623](https://issues.apache.org/jira/browse/MAPREDUCE-5623) | TestJobCleanup fails because of RejectedExecutionException and NPE. | Major | . | Tsuyoshi Ozawa | Jason Lowe |
+| [YARN-1145](https://issues.apache.org/jira/browse/YARN-1145) | Potential file handle leak in aggregated logs web ui | Major | . | Rohith Sharma K S | Rohith Sharma K S |
+| [YARN-1180](https://issues.apache.org/jira/browse/YARN-1180) | Update capacity scheduler docs to include types on the configs | Trivial | capacityscheduler | Thomas Graves | Chen He |
+| [MAPREDUCE-5689](https://issues.apache.org/jira/browse/MAPREDUCE-5689) | MRAppMaster does not preempt reducers when scheduled maps cannot be fulfilled | Critical | . | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-10146](https://issues.apache.org/jira/browse/HADOOP-10146) | Workaround JDK7 Process fd close bug | Critical | util | Daryn Sharp | Daryn Sharp |
+| [YARN-1592](https://issues.apache.org/jira/browse/YARN-1592) | CapacityScheduler tries to reserve more than a node's total memory on branch-0.23 | Major | capacityscheduler | Thomas Graves | Thomas Graves |
+| [HADOOP-10110](https://issues.apache.org/jira/browse/HADOOP-10110) | hadoop-auth has a build break due to missing dependency | Blocker | build | Chuan Liu | Chuan Liu |
| [HDFS-5806](https://issues.apache.org/jira/browse/HDFS-5806) | balancer should set SoTimeout to avoid indefinite hangs | Major | balancer & mover | Nathan Roberts | Nathan Roberts |
| [HDFS-5728](https://issues.apache.org/jira/browse/HDFS-5728) | [Diskfull] Block recovery will fail if the metafile does not have crc for all chunks of the block | Critical | datanode | Vinayakumar B | Vinayakumar B |
-| [HDFS-4576](https://issues.apache.org/jira/browse/HDFS-4576) | Webhdfs authentication issues | Major | webhdfs | Daryn Sharp | Daryn Sharp |
-| [MAPREDUCE-5789](https://issues.apache.org/jira/browse/MAPREDUCE-5789) | Average Reduce time is incorrect on Job Overview page | Major | jobhistoryserver, webapps | Rushabh S Shah | Rushabh S Shah |
-| [MAPREDUCE-5778](https://issues.apache.org/jira/browse/MAPREDUCE-5778) | JobSummary does not escape newlines in the job name | Major | jobhistoryserver | Jason Lowe | Akira AJISAKA |
-| [MAPREDUCE-5757](https://issues.apache.org/jira/browse/MAPREDUCE-5757) | ConcurrentModificationException in JobControl.toList | Major | client | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-5746](https://issues.apache.org/jira/browse/MAPREDUCE-5746) | Job diagnostics can implicate wrong task for a failed job | Major | jobhistoryserver | Jason Lowe | Jason Lowe |
+| [HDFS-5881](https://issues.apache.org/jira/browse/HDFS-5881) | Fix skip() of the short-circuit local reader (legacy). | Critical | . | Kihwal Lee | Kihwal Lee |
+| [HADOOP-10112](https://issues.apache.org/jira/browse/HADOOP-10112) | har file listing doesn't work with wild card | Major | tools | Brandon Li | Brandon Li |
| [MAPREDUCE-5744](https://issues.apache.org/jira/browse/MAPREDUCE-5744) | Job hangs because RMContainerAllocator$AssignedRequests.preemptReduce() violates the comparator contract | Blocker | . | Sangjin Lee | Gera Shegalov |
-| [MAPREDUCE-5689](https://issues.apache.org/jira/browse/MAPREDUCE-5689) | MRAppMaster does not preempt reducers when scheduled maps cannot be fulfilled | Critical | . | Lohit Vijayarenu | Lohit Vijayarenu |
-| [MAPREDUCE-5623](https://issues.apache.org/jira/browse/MAPREDUCE-5623) | TestJobCleanup fails because of RejectedExecutionException and NPE. | Major | . | Tsuyoshi Ozawa | Jason Lowe |
-| [MAPREDUCE-5454](https://issues.apache.org/jira/browse/MAPREDUCE-5454) | TestDFSIO fails intermittently on JDK7 | Major | test | Karthik Kambatla | Karthik Kambatla |
+| [MAPREDUCE-5746](https://issues.apache.org/jira/browse/MAPREDUCE-5746) | Job diagnostics can implicate wrong task for a failed job | Major | jobhistoryserver | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-5757](https://issues.apache.org/jira/browse/MAPREDUCE-5757) | ConcurrentModificationException in JobControl.toList | Major | client | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-5778](https://issues.apache.org/jira/browse/MAPREDUCE-5778) | JobSummary does not escape newlines in the job name | Major | jobhistoryserver | Jason Lowe | Akira Ajisaka |
+| [MAPREDUCE-5789](https://issues.apache.org/jira/browse/MAPREDUCE-5789) | Average Reduce time is incorrect on Job Overview page | Major | jobhistoryserver, webapps | Rushabh S Shah | Rushabh S Shah |
+| [HADOOP-10332](https://issues.apache.org/jira/browse/HADOOP-10332) | HttpServer's jetty audit log always logs 200 OK | Major | . | Daryn Sharp | Jonathan Eagles |
+| [YARN-1670](https://issues.apache.org/jira/browse/YARN-1670) | aggregated log writer can write more log data then it says is the log length | Critical | . | Thomas Graves | Mit Desai |
+| [HDFS-6166](https://issues.apache.org/jira/browse/HDFS-6166) | revisit balancer so\_timeout | Blocker | balancer & mover | Nathan Roberts | Nathan Roberts |
+| [HADOOP-8826](https://issues.apache.org/jira/browse/HADOOP-8826) | Docs still refer to 0.20.205 as stable line | Minor | . | Robert Joseph Evans | Mit Desai |
+| [HDFS-4576](https://issues.apache.org/jira/browse/HDFS-4576) | Webhdfs authentication issues | Major | webhdfs | Daryn Sharp | Daryn Sharp |
| [MAPREDUCE-3191](https://issues.apache.org/jira/browse/MAPREDUCE-3191) | docs for map output compression incorrectly reference SequenceFile | Trivial | . | Todd Lipcon | Chen He |
-| [YARN-3829](https://issues.apache.org/jira/browse/YARN-3829) | The History Tracking UI is broken for Tez application on ResourceManager WebUI | Critical | applications | Irina Easterling | |
| [YARN-1932](https://issues.apache.org/jira/browse/YARN-1932) | Javascript injection on the job status page | Blocker | . | Mit Desai | Mit Desai |
-| [YARN-1670](https://issues.apache.org/jira/browse/YARN-1670) | aggregated log writer can write more log data then it says is the log length | Critical | . | Thomas Graves | Mit Desai |
-| [YARN-1592](https://issues.apache.org/jira/browse/YARN-1592) | CapacityScheduler tries to reserve more than a node's total memory on branch-0.23 | Major | capacityscheduler | Thomas Graves | Thomas Graves |
-| [YARN-1180](https://issues.apache.org/jira/browse/YARN-1180) | Update capacity scheduler docs to include types on the configs | Trivial | capacityscheduler | Thomas Graves | Chen He |
-| [YARN-1145](https://issues.apache.org/jira/browse/YARN-1145) | Potential file handle leak in aggregated logs web ui | Major | . | Rohith Sharma K S | Rohith Sharma K S |
-| [YARN-1053](https://issues.apache.org/jira/browse/YARN-1053) | Diagnostic message from ContainerExitEvent is ignored in ContainerImpl | Blocker | . | Omkar Vinit Joshi | Omkar Vinit Joshi |
-| [YARN-853](https://issues.apache.org/jira/browse/YARN-853) | maximum-am-resource-percent doesn't work after refreshQueues command | Major | capacityscheduler | Devaraj K | Devaraj K |
-| [YARN-500](https://issues.apache.org/jira/browse/YARN-500) | ResourceManager webapp is using next port if configured port is already in use | Major | resourcemanager | Nishan Shetty | Kenji Kikushima |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-10588](https://issues.apache.org/jira/browse/HADOOP-10588) | Workaround for jetty6 acceptor startup issue | Major | . | Kihwal Lee | Kihwal Lee |
+| [HDFS-6449](https://issues.apache.org/jira/browse/HDFS-6449) | Incorrect counting in ContentSummaryComputationContext in 0.23. | Critical | . | Kihwal Lee | Kihwal Lee |
+| [YARN-3829](https://issues.apache.org/jira/browse/YARN-3829) | The History Tracking UI is broken for Tez application on ResourceManager WebUI | Critical | applications | Irina Easterling | |
### SUB-TASKS:
@@ -103,9 +81,3 @@
| [YARN-1575](https://issues.apache.org/jira/browse/YARN-1575) | Public localizer crashes with "Localized unkown resource" | Critical | nodemanager | Jason Lowe | Jason Lowe |
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[41/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.0/CHANGES.0.19.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.0/CHANGES.0.19.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.0/CHANGES.0.19.0.md
index 29e9ab9..a27ce33 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.0/CHANGES.0.19.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.0/CHANGES.0.19.0.md
@@ -24,395 +24,389 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-4430](https://issues.apache.org/jira/browse/HADOOP-4430) | Namenode Web UI capacity report is inconsistent with Balancer | Blocker | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-4293](https://issues.apache.org/jira/browse/HADOOP-4293) | Remove WritableJobConf | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-4281](https://issues.apache.org/jira/browse/HADOOP-4281) | Capacity reported in some of the commands is not consistent with the Web UI reported data | Blocker | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-4227](https://issues.apache.org/jira/browse/HADOOP-4227) | Remove the deprecated, unused class ShellCommand. | Minor | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4190](https://issues.apache.org/jira/browse/HADOOP-4190) | Changes to JobHistory makes it backward incompatible | Blocker | . | Amar Kamat | Amar Kamat |
-| [HADOOP-4116](https://issues.apache.org/jira/browse/HADOOP-4116) | Balancer should provide better resource management | Blocker | . | Raghu Angadi | Hairong Kuang |
-| [HADOOP-3981](https://issues.apache.org/jira/browse/HADOOP-3981) | Need a distributed file checksum algorithm for HDFS | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3963](https://issues.apache.org/jira/browse/HADOOP-3963) | libhdfs should never exit on its own but rather return errors to the calling application | Minor | . | Pete Wyckoff | Pete Wyckoff |
-| [HADOOP-3938](https://issues.apache.org/jira/browse/HADOOP-3938) | Quotas for disk space management | Major | . | Robert Chansler | Raghu Angadi |
-| [HADOOP-3911](https://issues.apache.org/jira/browse/HADOOP-3911) | ' -blocks ' option not being recognized | Minor | fs, util | Koji Noguchi | Lohit Vijayarenu |
-| [HADOOP-3889](https://issues.apache.org/jira/browse/HADOOP-3889) | distcp: Better Error Message should be thrown when accessing source files/directory with no read permission | Minor | . | Peeyush Bishnoi | Tsz Wo Nicholas Sze |
-| [HADOOP-3837](https://issues.apache.org/jira/browse/HADOOP-3837) | hadop streaming does not use progress reporting to detect hung tasks | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-3796](https://issues.apache.org/jira/browse/HADOOP-3796) | fuse-dfs should take rw,ro,trashon,trashoff,protected=blah mount arguments rather than them being compiled in | Major | . | Pete Wyckoff | Pete Wyckoff |
-| [HADOOP-3792](https://issues.apache.org/jira/browse/HADOOP-3792) | exit code from "hadoop dfs -test ..." is wrong for Unix shell | Minor | fs | Ben Slusky | Ben Slusky |
-| [HADOOP-3722](https://issues.apache.org/jira/browse/HADOOP-3722) | Provide a unified way to pass jobconf options from bin/hadoop | Minor | conf | Matei Zaharia | Enis Soztutar |
+| [HADOOP-3595](https://issues.apache.org/jira/browse/HADOOP-3595) | Remove deprecated mapred.combine.once functionality | Major | . | Chris Douglas | Chris Douglas |
| [HADOOP-3667](https://issues.apache.org/jira/browse/HADOOP-3667) | Remove deprecated methods in JobConf | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
| [HADOOP-3652](https://issues.apache.org/jira/browse/HADOOP-3652) | Remove deprecated class OutputFormatBase | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-3595](https://issues.apache.org/jira/browse/HADOOP-3595) | Remove deprecated mapred.combine.once functionality | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-3245](https://issues.apache.org/jira/browse/HADOOP-3245) | Provide ability to persist running jobs (extend HADOOP-1876) | Major | . | Devaraj Das | Amar Kamat |
-| [HADOOP-3150](https://issues.apache.org/jira/browse/HADOOP-3150) | Move task file promotion into the task | Major | . | Owen O'Malley | Amareshwari Sriramadasu |
-| [HADOOP-3062](https://issues.apache.org/jira/browse/HADOOP-3062) | Need to capture the metrics for the network ios generate by dfs reads/writes and map/reduce shuffling and break them down by racks | Major | metrics | Runping Qi | Chris Douglas |
-| [HADOOP-2816](https://issues.apache.org/jira/browse/HADOOP-2816) | Cluster summary at name node web has confusing report for space utilization | Major | . | Robert Chansler | Suresh Srinivas |
| [HADOOP-2325](https://issues.apache.org/jira/browse/HADOOP-2325) | Require Java 6 | Major | build | Doug Cutting | Doug Cutting |
-| [HADOOP-1869](https://issues.apache.org/jira/browse/HADOOP-1869) | access times of HDFS files | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-1700](https://issues.apache.org/jira/browse/HADOOP-1700) | Append to files in HDFS | Major | . | stack | dhruba borthakur |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-3796](https://issues.apache.org/jira/browse/HADOOP-3796) | fuse-dfs should take rw,ro,trashon,trashoff,protected=blah mount arguments rather than them being compiled in | Major | . | Pete Wyckoff | Pete Wyckoff |
+| [HADOOP-3837](https://issues.apache.org/jira/browse/HADOOP-3837) | hadop streaming does not use progress reporting to detect hung tasks | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-3792](https://issues.apache.org/jira/browse/HADOOP-3792) | exit code from "hadoop dfs -test ..." is wrong for Unix shell | Minor | fs | Ben Slusky | Ben Slusky |
+| [HADOOP-3889](https://issues.apache.org/jira/browse/HADOOP-3889) | distcp: Better Error Message should be thrown when accessing source files/directory with no read permission | Minor | . | Peeyush Bishnoi | Tsz Wo Nicholas Sze |
+| [HADOOP-3062](https://issues.apache.org/jira/browse/HADOOP-3062) | Need to capture the metrics for the network ios generate by dfs reads/writes and map/reduce shuffling and break them down by racks | Major | metrics | Runping Qi | Chris Douglas |
+| [HADOOP-3150](https://issues.apache.org/jira/browse/HADOOP-3150) | Move task file promotion into the task | Major | . | Owen O'Malley | Amareshwari Sriramadasu |
+| [HADOOP-3963](https://issues.apache.org/jira/browse/HADOOP-3963) | libhdfs should never exit on its own but rather return errors to the calling application | Minor | . | Pete Wyckoff | Pete Wyckoff |
+| [HADOOP-1869](https://issues.apache.org/jira/browse/HADOOP-1869) | access times of HDFS files | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-3981](https://issues.apache.org/jira/browse/HADOOP-3981) | Need a distributed file checksum algorithm for HDFS | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3245](https://issues.apache.org/jira/browse/HADOOP-3245) | Provide ability to persist running jobs (extend HADOOP-1876) | Major | . | Devaraj Das | Amar Kamat |
+| [HADOOP-3911](https://issues.apache.org/jira/browse/HADOOP-3911) | ' -blocks ' option not being recognized | Minor | fs, util | Koji Noguchi | Lohit Vijayarenu |
+| [HADOOP-3722](https://issues.apache.org/jira/browse/HADOOP-3722) | Provide a unified way to pass jobconf options from bin/hadoop | Minor | conf | Matei Zaharia | Enis Soztutar |
+| [HADOOP-2816](https://issues.apache.org/jira/browse/HADOOP-2816) | Cluster summary at name node web has confusing report for space utilization | Major | . | Robert Chansler | Suresh Srinivas |
+| [HADOOP-4227](https://issues.apache.org/jira/browse/HADOOP-4227) | Remove the deprecated, unused class ShellCommand. | Minor | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3938](https://issues.apache.org/jira/browse/HADOOP-3938) | Quotas for disk space management | Major | . | Robert Chansler | Raghu Angadi |
+| [HADOOP-4116](https://issues.apache.org/jira/browse/HADOOP-4116) | Balancer should provide better resource management | Blocker | . | Raghu Angadi | Hairong Kuang |
+| [HADOOP-4190](https://issues.apache.org/jira/browse/HADOOP-4190) | Changes to JobHistory makes it backward incompatible | Blocker | . | Amar Kamat | Amar Kamat |
+| [HADOOP-4293](https://issues.apache.org/jira/browse/HADOOP-4293) | Remove WritableJobConf | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-4281](https://issues.apache.org/jira/browse/HADOOP-4281) | Capacity reported in some of the commands is not consistent with the Web UI reported data | Blocker | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-4430](https://issues.apache.org/jira/browse/HADOOP-4430) | Namenode Web UI capacity report is inconsistent with Balancer | Blocker | . | Suresh Srinivas | Suresh Srinivas |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-4406](https://issues.apache.org/jira/browse/HADOOP-4406) | Make TCTLSeparatedProtocol configurable and have DynamicSerDe initialize, initialize the SerDe | Major | . | Pete Wyckoff | Pete Wyckoff |
-| [HADOOP-4301](https://issues.apache.org/jira/browse/HADOOP-4301) | Forrest doc for skip bad records feature | Blocker | documentation | Sharad Agarwal | Sharad Agarwal |
-| [HADOOP-4260](https://issues.apache.org/jira/browse/HADOOP-4260) | support show partitions in hive | Major | . | Ashish Thusoo | Ashish Thusoo |
-| [HADOOP-4176](https://issues.apache.org/jira/browse/HADOOP-4176) | Implement getFileChecksum(Path) in HftpFileSystem | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4120](https://issues.apache.org/jira/browse/HADOOP-4120) | [Hive] print time taken by query in interactive shell | Minor | . | Raghotham Murthy | Raghotham Murthy |
-| [HADOOP-4106](https://issues.apache.org/jira/browse/HADOOP-4106) | add time, permission and user attribute support to fuse-dfs | Major | . | Pete Wyckoff | Pete Wyckoff |
-| [HADOOP-4104](https://issues.apache.org/jira/browse/HADOOP-4104) | add time, permission and user attribute support to libhdfs | Major | . | Pete Wyckoff | Pete Wyckoff |
-| [HADOOP-4095](https://issues.apache.org/jira/browse/HADOOP-4095) | [Hive] enhance describe table & partition | Major | . | Prasad Chakka | Namit Jain |
-| [HADOOP-4086](https://issues.apache.org/jira/browse/HADOOP-4086) | Add limit to Hive QL | Major | . | Ashish Thusoo | Namit Jain |
-| [HADOOP-4084](https://issues.apache.org/jira/browse/HADOOP-4084) | Add explain plan capabilities to Hive QL | Major | . | Ashish Thusoo | Ashish Thusoo |
-| [HADOOP-4070](https://issues.apache.org/jira/browse/HADOOP-4070) | [Hive] Provide a mechanism for registering UDFs from the query language | Major | . | Tom White | Tom White |
-| [HADOOP-3992](https://issues.apache.org/jira/browse/HADOOP-3992) | Synthetic Load Generator for NameNode testing | Major | . | Robert Chansler | Hairong Kuang |
-| [HADOOP-3941](https://issues.apache.org/jira/browse/HADOOP-3941) | Extend FileSystem API to return file-checksums/file-digests | Major | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3939](https://issues.apache.org/jira/browse/HADOOP-3939) | DistCp should support an option for deleting non-existing files. | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3924](https://issues.apache.org/jira/browse/HADOOP-3924) | Add a 'Killed' job status | Critical | . | Alejandro Abdelnur | Subru Krishnan |
+| [HADOOP-2664](https://issues.apache.org/jira/browse/HADOOP-2664) | lzop-compatible CompresionCodec | Major | io | Chris Douglas | Chris Douglas |
+| [HADOOP-3402](https://issues.apache.org/jira/browse/HADOOP-3402) | Add example code to support run terasort on hadoop | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-3479](https://issues.apache.org/jira/browse/HADOOP-3479) | Implement configuration items useful for Hadoop resource manager (v1) | Major | conf | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-3695](https://issues.apache.org/jira/browse/HADOOP-3695) | [HOD] Have an ability to run multiple slaves per node | Major | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-3149](https://issues.apache.org/jira/browse/HADOOP-3149) | supporting multiple outputs for M/R jobs | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-3714](https://issues.apache.org/jira/browse/HADOOP-3714) | Bash tab completion support | Trivial | scripts | Chris Smith | Chris Smith |
+| [HADOOP-3730](https://issues.apache.org/jira/browse/HADOOP-3730) | add new JobConf constructor that disables loading default configurations | Major | conf | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-372](https://issues.apache.org/jira/browse/HADOOP-372) | should allow to specify different inputformat classes for different input dirs for Map/Reduce jobs | Major | . | Runping Qi | Chris Smith |
+| [HADOOP-3485](https://issues.apache.org/jira/browse/HADOOP-3485) | fix writes | Minor | . | Pete Wyckoff | Pete Wyckoff |
+| [HADOOP-153](https://issues.apache.org/jira/browse/HADOOP-153) | skip records that fail Task | Major | . | Doug Cutting | Sharad Agarwal |
| [HADOOP-3873](https://issues.apache.org/jira/browse/HADOOP-3873) | DistCp should have an option for limiting the number of files/bytes being copied | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3585](https://issues.apache.org/jira/browse/HADOOP-3585) | Hardware Failure Monitoring in large clusters running Hadoop/HDFS | Minor | metrics | Ioannis Koltsidas | Ioannis Koltsidas |
+| [HADOOP-1480](https://issues.apache.org/jira/browse/HADOOP-1480) | pipes should be able to set user counters | Major | . | Owen O'Malley | Arun C Murthy |
| [HADOOP-3854](https://issues.apache.org/jira/browse/HADOOP-3854) | org.apache.hadoop.http.HttpServer should support user configurable filter | Major | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3829](https://issues.apache.org/jira/browse/HADOOP-3829) | Narrown down skipped records based on user acceptable value | Major | . | Sharad Agarwal | Sharad Agarwal |
-| [HADOOP-3828](https://issues.apache.org/jira/browse/HADOOP-3828) | Write skipped records' bytes to DFS | Major | . | Sharad Agarwal | Sharad Agarwal |
-| [HADOOP-3754](https://issues.apache.org/jira/browse/HADOOP-3754) | Support a Thrift Interface to access files/directories in HDFS | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-3746](https://issues.apache.org/jira/browse/HADOOP-3746) | A fair sharing job scheduler | Minor | . | Matei Zaharia | Matei Zaharia |
-| [HADOOP-3730](https://issues.apache.org/jira/browse/HADOOP-3730) | add new JobConf constructor that disables loading default configurations | Major | conf | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-3714](https://issues.apache.org/jira/browse/HADOOP-3714) | Bash tab completion support | Trivial | scripts | Chris Smith | Chris Smith |
-| [HADOOP-3702](https://issues.apache.org/jira/browse/HADOOP-3702) | add support for chaining Maps in a single Map and after a Reduce [M\*/RM\*] | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-3754](https://issues.apache.org/jira/browse/HADOOP-3754) | Support a Thrift Interface to access files/directories in HDFS | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-3828](https://issues.apache.org/jira/browse/HADOOP-3828) | Write skipped records' bytes to DFS | Major | . | Sharad Agarwal | Sharad Agarwal |
+| [HADOOP-3939](https://issues.apache.org/jira/browse/HADOOP-3939) | DistCp should support an option for deleting non-existing files. | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-3698](https://issues.apache.org/jira/browse/HADOOP-3698) | Implement access control for submitting jobs to queues in the JobTracker | Major | . | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-3695](https://issues.apache.org/jira/browse/HADOOP-3695) | [HOD] Have an ability to run multiple slaves per node | Major | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-| [HADOOP-3585](https://issues.apache.org/jira/browse/HADOOP-3585) | Hardware Failure Monitoring in large clusters running Hadoop/HDFS | Minor | metrics | Ioannis Koltsidas | Ioannis Koltsidas |
-| [HADOOP-3485](https://issues.apache.org/jira/browse/HADOOP-3485) | fix writes | Minor | . | Pete Wyckoff | Pete Wyckoff |
-| [HADOOP-3479](https://issues.apache.org/jira/browse/HADOOP-3479) | Implement configuration items useful for Hadoop resource manager (v1) | Major | conf | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-3445](https://issues.apache.org/jira/browse/HADOOP-3445) | Implementing core scheduler functionality in Resource Manager (V1) for Hadoop | Major | . | Vivek Ratan | Vivek Ratan |
-| [HADOOP-3402](https://issues.apache.org/jira/browse/HADOOP-3402) | Add example code to support run terasort on hadoop | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-3941](https://issues.apache.org/jira/browse/HADOOP-3941) | Extend FileSystem API to return file-checksums/file-digests | Major | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-3361](https://issues.apache.org/jira/browse/HADOOP-3361) | Implement renames for NativeS3FileSystem | Major | fs/s3 | Tom White | Tom White |
-| [HADOOP-3149](https://issues.apache.org/jira/browse/HADOOP-3149) | supporting multiple outputs for M/R jobs | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-3702](https://issues.apache.org/jira/browse/HADOOP-3702) | add support for chaining Maps in a single Map and after a Reduce [M\*/RM\*] | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-3445](https://issues.apache.org/jira/browse/HADOOP-3445) | Implementing core scheduler functionality in Resource Manager (V1) for Hadoop | Major | . | Vivek Ratan | Vivek Ratan |
+| [HADOOP-3992](https://issues.apache.org/jira/browse/HADOOP-3992) | Synthetic Load Generator for NameNode testing | Major | . | Robert Chansler | Hairong Kuang |
+| [HADOOP-3829](https://issues.apache.org/jira/browse/HADOOP-3829) | Narrown down skipped records based on user acceptable value | Major | . | Sharad Agarwal | Sharad Agarwal |
+| [HADOOP-4084](https://issues.apache.org/jira/browse/HADOOP-4084) | Add explain plan capabilities to Hive QL | Major | . | Ashish Thusoo | Ashish Thusoo |
+| [HADOOP-4104](https://issues.apache.org/jira/browse/HADOOP-4104) | add time, permission and user attribute support to libhdfs | Major | . | Pete Wyckoff | Pete Wyckoff |
+| [HADOOP-4106](https://issues.apache.org/jira/browse/HADOOP-4106) | add time, permission and user attribute support to fuse-dfs | Major | . | Pete Wyckoff | Pete Wyckoff |
+| [HADOOP-4176](https://issues.apache.org/jira/browse/HADOOP-4176) | Implement getFileChecksum(Path) in HftpFileSystem | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4070](https://issues.apache.org/jira/browse/HADOOP-4070) | [Hive] Provide a mechanism for registering UDFs from the query language | Major | . | Tom White | Tom White |
+| [HADOOP-2536](https://issues.apache.org/jira/browse/HADOOP-2536) | MapReduce for MySQL | Minor | . | Fredrik Hedberg | Fredrik Hedberg |
| [HADOOP-3019](https://issues.apache.org/jira/browse/HADOOP-3019) | want input sampler & sorted partitioner | Major | . | Doug Cutting | Chris Douglas |
-| [HADOOP-2664](https://issues.apache.org/jira/browse/HADOOP-2664) | lzop-compatible CompresionCodec | Major | io | Chris Douglas | Chris Douglas |
+| [HADOOP-3924](https://issues.apache.org/jira/browse/HADOOP-3924) | Add a 'Killed' job status | Critical | . | Alejandro Abdelnur | Subru Krishnan |
+| [HADOOP-4120](https://issues.apache.org/jira/browse/HADOOP-4120) | [Hive] print time taken by query in interactive shell | Minor | . | Raghotham Murthy | Raghotham Murthy |
+| [HADOOP-4301](https://issues.apache.org/jira/browse/HADOOP-4301) | Forrest doc for skip bad records feature | Blocker | documentation | Sharad Agarwal | Sharad Agarwal |
+| [HADOOP-4260](https://issues.apache.org/jira/browse/HADOOP-4260) | support show partitions in hive | Major | . | Ashish Thusoo | Ashish Thusoo |
+| [HADOOP-4095](https://issues.apache.org/jira/browse/HADOOP-4095) | [Hive] enhance describe table & partition | Major | . | Prasad Chakka | Namit Jain |
+| [HADOOP-4086](https://issues.apache.org/jira/browse/HADOOP-4086) | Add limit to Hive QL | Major | . | Ashish Thusoo | Namit Jain |
| [HADOOP-2658](https://issues.apache.org/jira/browse/HADOOP-2658) | Design and Implement a Test Plan to support appends to HDFS files | Blocker | test | dhruba borthakur | dhruba borthakur |
-| [HADOOP-2536](https://issues.apache.org/jira/browse/HADOOP-2536) | MapReduce for MySQL | Minor | . | Fredrik Hedberg | Fredrik Hedberg |
+| [HADOOP-4406](https://issues.apache.org/jira/browse/HADOOP-4406) | Make TCTLSeparatedProtocol configurable and have DynamicSerDe initialize, initialize the SerDe | Major | . | Pete Wyckoff | Pete Wyckoff |
| [HADOOP-1823](https://issues.apache.org/jira/browse/HADOOP-1823) | want InputFormat for bzip2 files | Major | . | Doug Cutting | |
-| [HADOOP-1480](https://issues.apache.org/jira/browse/HADOOP-1480) | pipes should be able to set user counters | Major | . | Owen O'Malley | Arun C Murthy |
-| [HADOOP-372](https://issues.apache.org/jira/browse/HADOOP-372) | should allow to specify different inputformat classes for different input dirs for Map/Reduce jobs | Major | . | Runping Qi | Chris Smith |
-| [HADOOP-153](https://issues.apache.org/jira/browse/HADOOP-153) | skip records that fail Task | Major | . | Doug Cutting | Sharad Agarwal |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-4433](https://issues.apache.org/jira/browse/HADOOP-4433) | Improve data loader for collecting metrics and log files from hadoop and system | Major | . | Eric Yang | Eric Yang |
-| [HADOOP-4431](https://issues.apache.org/jira/browse/HADOOP-4431) | Add versionning/tags to Chukwa Chunk | Major | . | Jerome Boulon | Jerome Boulon |
-| [HADOOP-4424](https://issues.apache.org/jira/browse/HADOOP-4424) | menu layout change for Hadoop documentation | Blocker | documentation | Boris Shkolnik | Boris Shkolnik |
-| [HADOOP-4353](https://issues.apache.org/jira/browse/HADOOP-4353) | enable multi-line query from Hive CLI | Minor | . | Prasad Chakka | Prasad Chakka |
-| [HADOOP-4345](https://issues.apache.org/jira/browse/HADOOP-4345) | Hive: Check that partitioning predicate is present when hive.partition.pruning = strict | Major | . | Ashish Thusoo | Ashish Thusoo |
-| [HADOOP-4307](https://issues.apache.org/jira/browse/HADOOP-4307) | add an option to describe table to show extended properties of the table such as serialization/deserialization properties | Major | . | Prasad Chakka | Prasad Chakka |
-| [HADOOP-4279](https://issues.apache.org/jira/browse/HADOOP-4279) | write the random number generator seed to log in the append-related tests | Blocker | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4252](https://issues.apache.org/jira/browse/HADOOP-4252) | Catch Ctrl-C in Hive CLI so that corresponding hadoop jobs can be killed | Minor | . | Prasad Chakka | Pete Wyckoff |
-| [HADOOP-4231](https://issues.apache.org/jira/browse/HADOOP-4231) | Hive: converting complex objects to JSON failed. | Minor | . | Zheng Shao | Zheng Shao |
-| [HADOOP-4230](https://issues.apache.org/jira/browse/HADOOP-4230) | Hive: GroupBy should not pass the whole row from mapper to reducer | Blocker | . | Zheng Shao | Ashish Thusoo |
-| [HADOOP-4205](https://issues.apache.org/jira/browse/HADOOP-4205) | [Hive] metastore and ql to use the refactored SerDe library | Major | . | Zheng Shao | Zheng Shao |
-| [HADOOP-4194](https://issues.apache.org/jira/browse/HADOOP-4194) | Add JobConf and JobID to job related methods in JobTrackerInstrumentation | Major | . | Mac Yang | Mac Yang |
-| [HADOOP-4181](https://issues.apache.org/jira/browse/HADOOP-4181) | some minor things to make Hadoop friendlier to git | Major | build | Owen O'Malley | Owen O'Malley |
-| [HADOOP-4174](https://issues.apache.org/jira/browse/HADOOP-4174) | Move non-client methods ou of ClientProtocol | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-4151](https://issues.apache.org/jira/browse/HADOOP-4151) | Add a memcmp-compatible interface for key types | Minor | . | Chris Douglas | Chris Douglas |
-| [HADOOP-4138](https://issues.apache.org/jira/browse/HADOOP-4138) | [Hive] refactor the SerDe library | Major | . | Zheng Shao | Zheng Shao |
-| [HADOOP-4124](https://issues.apache.org/jira/browse/HADOOP-4124) | Changing priority of a job should be available in CLI and available on the web UI only along with the Kill Job actions | Major | . | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-4117](https://issues.apache.org/jira/browse/HADOOP-4117) | Improve configurability of Hadoop EC2 instances | Major | contrib/cloud | Tom White | Tom White |
-| [HADOOP-4113](https://issues.apache.org/jira/browse/HADOOP-4113) | libhdfs should never exit on its own but rather return errors to the calling application - missing diff files | Minor | . | Pete Wyckoff | Pete Wyckoff |
-| [HADOOP-4094](https://issues.apache.org/jira/browse/HADOOP-4094) | [Hive]implement hive-site.xml similar to hadoop-site.xml | Minor | . | Prasad Chakka | Prasad Chakka |
-| [HADOOP-4090](https://issues.apache.org/jira/browse/HADOOP-4090) | The configuration file lists two paths to hadoop directories (bin and conf). Startup should check that these are valid directories and give appropriate messages. | Minor | . | Ashish Thusoo | Raghotham Murthy |
-| [HADOOP-4083](https://issues.apache.org/jira/browse/HADOOP-4083) | change new config attribute queue.name to mapred.job.queue.name | Major | . | Owen O'Malley | Hemanth Yamijala |
-| [HADOOP-4075](https://issues.apache.org/jira/browse/HADOOP-4075) | test-patch.sh should output the ant commands that it runs | Major | build | Nigel Daley | Ramya Sunil |
-| [HADOOP-4062](https://issues.apache.org/jira/browse/HADOOP-4062) | IPC client does not need to be synchronized on the output stream when a connection is closed | Major | ipc | Hairong Kuang | Hairong Kuang |
-| [HADOOP-4053](https://issues.apache.org/jira/browse/HADOOP-4053) | Schedulers need to know when a job has completed | Blocker | . | Vivek Ratan | Amar Kamat |
-| [HADOOP-3975](https://issues.apache.org/jira/browse/HADOOP-3975) | test-patch can report the modifications found in the workspace along with the error message | Minor | test | Hemanth Yamijala | Ramya Sunil |
-| [HADOOP-3965](https://issues.apache.org/jira/browse/HADOOP-3965) | Make DataBlockScanner package private | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-3948](https://issues.apache.org/jira/browse/HADOOP-3948) | Separate Namenodes edits and fsimage | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3944](https://issues.apache.org/jira/browse/HADOOP-3944) | TupleWritable listed as public class but cannot be used without methods private to the package | Trivial | documentation | Michael Andrews | Chris Douglas |
-| [HADOOP-3943](https://issues.apache.org/jira/browse/HADOOP-3943) | NetworkTopology.pseudoSortByDistance does not need to be a synchronized method | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-3935](https://issues.apache.org/jira/browse/HADOOP-3935) | Extract classes from DataNode.java | Trivial | . | Johan Oskarsson | Johan Oskarsson |
-| [HADOOP-3930](https://issues.apache.org/jira/browse/HADOOP-3930) | Decide how to integrate scheduler info into CLI and job tracker web page | Major | . | Matei Zaharia | Sreekanth Ramakrishnan |
-| [HADOOP-3908](https://issues.apache.org/jira/browse/HADOOP-3908) | Better error message if llibhdfs.so doesn't exist | Minor | . | Pete Wyckoff | Pete Wyckoff |
-| [HADOOP-3905](https://issues.apache.org/jira/browse/HADOOP-3905) | Create a generic interface for edits log. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-3892](https://issues.apache.org/jira/browse/HADOOP-3892) | Include Unix group name in JobConf | Trivial | conf | Matei Zaharia | Matei Zaharia |
-| [HADOOP-3866](https://issues.apache.org/jira/browse/HADOOP-3866) | Improve Hadoop Jobtracker Admin | Major | scripts | craig weisenfluh | craig weisenfluh |
+| [HADOOP-3563](https://issues.apache.org/jira/browse/HADOOP-3563) | Seperate out datanode and namenode functionality of generation stamp upgrade process | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-3577](https://issues.apache.org/jira/browse/HADOOP-3577) | Tools to inject blocks into name node and simulated data nodes for testing | Minor | . | Sanjay Radia | Sanjay Radia |
+| [HADOOP-3341](https://issues.apache.org/jira/browse/HADOOP-3341) | make key-value separators in hadoop streaming fully configurable | Major | . | Zheng Shao | Zheng Shao |
+| [HADOOP-3556](https://issues.apache.org/jira/browse/HADOOP-3556) | Substitute the synchronized code in MD5Hash to avoid lock contention. Use ThreadLocal instead. | Major | io | Iván de Prado | Iván de Prado |
+| [HADOOP-3655](https://issues.apache.org/jira/browse/HADOOP-3655) | provide more control options for the junit run | Minor | build | Steve Loughran | Steve Loughran |
+| [HADOOP-3660](https://issues.apache.org/jira/browse/HADOOP-3660) | Add replication factor for injecting blocks in the data node cluster | Major | benchmarks | Sanjay Radia | Sanjay Radia |
+| [HADOOP-3328](https://issues.apache.org/jira/browse/HADOOP-3328) | DFS write pipeline : only the last datanode needs to verify checksum | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-3684](https://issues.apache.org/jira/browse/HADOOP-3684) | The data\_join should allow the user to implement a customer cloning function | Major | . | Runping Qi | Runping Qi |
+| [HADOOP-3721](https://issues.apache.org/jira/browse/HADOOP-3721) | CompositeRecordReader::next is unnecessarily complex | Major | . | Chris Douglas | Chris Douglas |
+| [HADOOP-3478](https://issues.apache.org/jira/browse/HADOOP-3478) | The algorithm to decide map re-execution on fetch failures can be improved | Major | . | Jothi Padmanabhan | Jothi Padmanabhan |
+| [HADOOP-1627](https://issues.apache.org/jira/browse/HADOOP-1627) | DFSAdmin incorrectly reports cluster data. | Minor | . | Konstantin Shvachko | Raghu Angadi |
+| [HADOOP-3617](https://issues.apache.org/jira/browse/HADOOP-3617) | Writes from map serialization include redundant checks for accounting space | Major | . | Chris Douglas | Chris Douglas |
+| [HADOOP-3412](https://issues.apache.org/jira/browse/HADOOP-3412) | Refactor the scheduler out of the JobTracker | Minor | . | Brice Arnould | Brice Arnould |
+| [HADOOP-3624](https://issues.apache.org/jira/browse/HADOOP-3624) | CreateEditsLog could be improved to create tree directory structure | Minor | test | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3747](https://issues.apache.org/jira/browse/HADOOP-3747) | Add counter support to MultipleOutputs | Minor | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-3661](https://issues.apache.org/jira/browse/HADOOP-3661) | Normalize fuse-dfs handling of moving things to trash wrt the way hadoop dfs does it (only when non posix trash flag is enabled in compile) | Major | . | Pete Wyckoff | Pete Wyckoff |
+| [HADOOP-3169](https://issues.apache.org/jira/browse/HADOOP-3169) | LeaseChecker daemon should not be started in DFSClient constructor | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3646](https://issues.apache.org/jira/browse/HADOOP-3646) | Providing bzip2 as codec | Major | conf, io | Abdul Qadeer | Abdul Qadeer |
| [HADOOP-3861](https://issues.apache.org/jira/browse/HADOOP-3861) | Make MapFile.Reader and Writer implement java.io.Closeable | Major | io | Tom White | Tom White |
+| [HADOOP-3694](https://issues.apache.org/jira/browse/HADOOP-3694) | if MiniDFS startup time could be improved, testing time would be reduced | Major | test | Steve Loughran | Doug Cutting |
+| [HADOOP-3620](https://issues.apache.org/jira/browse/HADOOP-3620) | Namenode should synchronously resolve a datanode's network location when the datanode registers | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-3860](https://issues.apache.org/jira/browse/HADOOP-3860) | Compare name-node performance when journaling is performed into local hard-drives or nfs. | Major | benchmarks | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-3853](https://issues.apache.org/jira/browse/HADOOP-3853) | Move multiple input format extension to library package | Major | . | Tom White | Tom White |
-| [HADOOP-3852](https://issues.apache.org/jira/browse/HADOOP-3852) | If ShellCommandExecutor had a toString() operator that listed the command run, its error messages may be more meaningful | Minor | util | Steve Loughran | Steve Loughran |
-| [HADOOP-3844](https://issues.apache.org/jira/browse/HADOOP-3844) | include message of local exception in Client call failures | Minor | ipc | Steve Loughran | Steve Loughran |
| [HADOOP-3805](https://issues.apache.org/jira/browse/HADOOP-3805) | improve fuse-dfs write performance which is 33% slower than hadoop dfs -copyFromLocal | Minor | . | Pete Wyckoff | |
+| [HADOOP-2302](https://issues.apache.org/jira/browse/HADOOP-2302) | Streaming should provide an option for numerical sort of keys | Major | . | Lohit Vijayarenu | Devaraj Das |
+| [HADOOP-3892](https://issues.apache.org/jira/browse/HADOOP-3892) | Include Unix group name in JobConf | Trivial | conf | Matei Zaharia | Matei Zaharia |
+| [HADOOP-3853](https://issues.apache.org/jira/browse/HADOOP-3853) | Move multiple input format extension to library package | Major | . | Tom White | Tom White |
+| [HADOOP-657](https://issues.apache.org/jira/browse/HADOOP-657) | Free temporary space should be modelled better | Major | . | Owen O'Malley | Ari Rabkin |
+| [HADOOP-3202](https://issues.apache.org/jira/browse/HADOOP-3202) | Deprecate org.apache.hadoop.fs.FileUtil.fullyDelete(FileSystem fs, Path dir) | Major | fs | Tsz Wo Nicholas Sze | Amareshwari Sriramadasu |
+| [HADOOP-3368](https://issues.apache.org/jira/browse/HADOOP-3368) | Can commons-logging.properties be pulled from hadoop-core? | Major | build | Steve Loughran | Steve Loughran |
| [HADOOP-3780](https://issues.apache.org/jira/browse/HADOOP-3780) | JobTracker should synchronously resolve the tasktracker's network location when the tracker registers | Major | . | Amar Kamat | Amar Kamat |
-| [HADOOP-3769](https://issues.apache.org/jira/browse/HADOOP-3769) | expose static SampleMapper and SampleReducer classes of GenericMRLoadGenerator class for gridmix reuse | Major | test | Lingyun Yang | Lingyun Yang |
-| [HADOOP-3759](https://issues.apache.org/jira/browse/HADOOP-3759) | Provide ability to run memory intensive jobs without affecting other running tasks on the nodes | Major | . | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-3747](https://issues.apache.org/jira/browse/HADOOP-3747) | Add counter support to MultipleOutputs | Minor | . | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-3721](https://issues.apache.org/jira/browse/HADOOP-3721) | CompositeRecordReader::next is unnecessarily complex | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-3719](https://issues.apache.org/jira/browse/HADOOP-3719) | Chukwa | Major | . | Ari Rabkin | Ari Rabkin |
-| [HADOOP-3694](https://issues.apache.org/jira/browse/HADOOP-3694) | if MiniDFS startup time could be improved, testing time would be reduced | Major | test | Steve Loughran | Doug Cutting |
-| [HADOOP-3684](https://issues.apache.org/jira/browse/HADOOP-3684) | The data\_join should allow the user to implement a customer cloning function | Major | . | Runping Qi | Runping Qi |
+| [HADOOP-3852](https://issues.apache.org/jira/browse/HADOOP-3852) | If ShellCommandExecutor had a toString() operator that listed the command run, its error messages may be more meaningful | Minor | util | Steve Loughran | Steve Loughran |
| [HADOOP-3664](https://issues.apache.org/jira/browse/HADOOP-3664) | Remove deprecated methods introduced in changes to validating input paths (HADOOP-3095) | Major | . | Tom White | Tom White |
-| [HADOOP-3661](https://issues.apache.org/jira/browse/HADOOP-3661) | Normalize fuse-dfs handling of moving things to trash wrt the way hadoop dfs does it (only when non posix trash flag is enabled in compile) | Major | . | Pete Wyckoff | Pete Wyckoff |
-| [HADOOP-3660](https://issues.apache.org/jira/browse/HADOOP-3660) | Add replication factor for injecting blocks in the data node cluster | Major | benchmarks | Sanjay Radia | Sanjay Radia |
-| [HADOOP-3655](https://issues.apache.org/jira/browse/HADOOP-3655) | provide more control options for the junit run | Minor | build | Steve Loughran | Steve Loughran |
-| [HADOOP-3646](https://issues.apache.org/jira/browse/HADOOP-3646) | Providing bzip2 as codec | Major | conf, io | Abdul Qadeer | Abdul Qadeer |
-| [HADOOP-3638](https://issues.apache.org/jira/browse/HADOOP-3638) | Cache the iFile index files in memory to reduce seeks during map output serving | Major | . | Devaraj Das | Jothi Padmanabhan |
-| [HADOOP-3624](https://issues.apache.org/jira/browse/HADOOP-3624) | CreateEditsLog could be improved to create tree directory structure | Minor | test | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3620](https://issues.apache.org/jira/browse/HADOOP-3620) | Namenode should synchronously resolve a datanode's network location when the datanode registers | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-3617](https://issues.apache.org/jira/browse/HADOOP-3617) | Writes from map serialization include redundant checks for accounting space | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-3605](https://issues.apache.org/jira/browse/HADOOP-3605) | Added an abort on unset AWS\_ACCOUNT\_ID to luanch-hadoop-master | Minor | contrib/cloud | Al Hoang | Al Hoang |
-| [HADOOP-3581](https://issues.apache.org/jira/browse/HADOOP-3581) | Prevent memory intensive user tasks from taking down nodes | Major | . | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-| [HADOOP-3577](https://issues.apache.org/jira/browse/HADOOP-3577) | Tools to inject blocks into name node and simulated data nodes for testing | Minor | . | Sanjay Radia | Sanjay Radia |
-| [HADOOP-3563](https://issues.apache.org/jira/browse/HADOOP-3563) | Seperate out datanode and namenode functionality of generation stamp upgrade process | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-3556](https://issues.apache.org/jira/browse/HADOOP-3556) | Substitute the synchronized code in MD5Hash to avoid lock contention. Use ThreadLocal instead. | Major | io | Iván de Prado | Iván de Prado |
+| [HADOOP-3719](https://issues.apache.org/jira/browse/HADOOP-3719) | Chukwa | Major | . | Ari Rabkin | Ari Rabkin |
+| [HADOOP-3935](https://issues.apache.org/jira/browse/HADOOP-3935) | Extract classes from DataNode.java | Trivial | . | Johan Oskarsson | Johan Oskarsson |
+| [HADOOP-3905](https://issues.apache.org/jira/browse/HADOOP-3905) | Create a generic interface for edits log. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
| [HADOOP-3549](https://issues.apache.org/jira/browse/HADOOP-3549) | meaningful errno values in libhdfs | Major | . | Ben Slusky | Ben Slusky |
-| [HADOOP-3514](https://issues.apache.org/jira/browse/HADOOP-3514) | Reduce seeks during shuffle, by inline crcs | Major | . | Devaraj Das | Jothi Padmanabhan |
+| [HADOOP-2130](https://issues.apache.org/jira/browse/HADOOP-2130) | Pipes submit job should be Non-blocking | Critical | . | Srikanth Kakani | Arun C Murthy |
+| [HADOOP-3944](https://issues.apache.org/jira/browse/HADOOP-3944) | TupleWritable listed as public class but cannot be used without methods private to the package | Trivial | documentation | Michael Andrews | Chris Douglas |
+| [HADOOP-3759](https://issues.apache.org/jira/browse/HADOOP-3759) | Provide ability to run memory intensive jobs without affecting other running tasks on the nodes | Major | . | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-3965](https://issues.apache.org/jira/browse/HADOOP-3965) | Make DataBlockScanner package private | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-2330](https://issues.apache.org/jira/browse/HADOOP-2330) | Preallocate transaction log to improve namenode transaction logging performance | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-3908](https://issues.apache.org/jira/browse/HADOOP-3908) | Better error message if llibhdfs.so doesn't exist | Minor | . | Pete Wyckoff | Pete Wyckoff |
+| [HADOOP-3342](https://issues.apache.org/jira/browse/HADOOP-3342) | Better safety of killing jobs via web interface | Minor | . | Daniel Naber | Enis Soztutar |
+| [HADOOP-3769](https://issues.apache.org/jira/browse/HADOOP-3769) | expose static SampleMapper and SampleReducer classes of GenericMRLoadGenerator class for gridmix reuse | Major | test | Lingyun Yang | Lingyun Yang |
+| [HADOOP-3948](https://issues.apache.org/jira/browse/HADOOP-3948) | Separate Namenodes edits and fsimage | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3866](https://issues.apache.org/jira/browse/HADOOP-3866) | Improve Hadoop Jobtracker Admin | Major | scripts | craig weisenfluh | craig weisenfluh |
+| [HADOOP-3943](https://issues.apache.org/jira/browse/HADOOP-3943) | NetworkTopology.pseudoSortByDistance does not need to be a synchronized method | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-3498](https://issues.apache.org/jira/browse/HADOOP-3498) | File globbing alternation should be able to span path components | Major | fs | Tom White | Tom White |
-| [HADOOP-3478](https://issues.apache.org/jira/browse/HADOOP-3478) | The algorithm to decide map re-execution on fetch failures can be improved | Major | . | Jothi Padmanabhan | Jothi Padmanabhan |
+| [HADOOP-3581](https://issues.apache.org/jira/browse/HADOOP-3581) | Prevent memory intensive user tasks from taking down nodes | Major | . | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-3605](https://issues.apache.org/jira/browse/HADOOP-3605) | Added an abort on unset AWS\_ACCOUNT\_ID to luanch-hadoop-master | Minor | contrib/cloud | Al Hoang | Al Hoang |
+| [HADOOP-3514](https://issues.apache.org/jira/browse/HADOOP-3514) | Reduce seeks during shuffle, by inline crcs | Major | . | Devaraj Das | Jothi Padmanabhan |
+| [HADOOP-4113](https://issues.apache.org/jira/browse/HADOOP-4113) | libhdfs should never exit on its own but rather return errors to the calling application - missing diff files | Minor | . | Pete Wyckoff | Pete Wyckoff |
| [HADOOP-3446](https://issues.apache.org/jira/browse/HADOOP-3446) | The reduce task should not flush the in memory file system before starting the reducer | Critical | . | Owen O'Malley | Chris Douglas |
-| [HADOOP-3412](https://issues.apache.org/jira/browse/HADOOP-3412) | Refactor the scheduler out of the JobTracker | Minor | . | Brice Arnould | Brice Arnould |
-| [HADOOP-3368](https://issues.apache.org/jira/browse/HADOOP-3368) | Can commons-logging.properties be pulled from hadoop-core? | Major | build | Steve Loughran | Steve Loughran |
-| [HADOOP-3342](https://issues.apache.org/jira/browse/HADOOP-3342) | Better safety of killing jobs via web interface | Minor | . | Daniel Naber | Enis Soztutar |
-| [HADOOP-3341](https://issues.apache.org/jira/browse/HADOOP-3341) | make key-value separators in hadoop streaming fully configurable | Major | . | Zheng Shao | Zheng Shao |
-| [HADOOP-3328](https://issues.apache.org/jira/browse/HADOOP-3328) | DFS write pipeline : only the last datanode needs to verify checksum | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-3202](https://issues.apache.org/jira/browse/HADOOP-3202) | Deprecate org.apache.hadoop.fs.FileUtil.fullyDelete(FileSystem fs, Path dir) | Major | fs | Tsz Wo Nicholas Sze | Amareshwari Sriramadasu |
-| [HADOOP-3169](https://issues.apache.org/jira/browse/HADOOP-3169) | LeaseChecker daemon should not be started in DFSClient constructor | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4094](https://issues.apache.org/jira/browse/HADOOP-4094) | [Hive]implement hive-site.xml similar to hadoop-site.xml | Minor | . | Prasad Chakka | Prasad Chakka |
+| [HADOOP-4151](https://issues.apache.org/jira/browse/HADOOP-4151) | Add a memcmp-compatible interface for key types | Minor | . | Chris Douglas | Chris Douglas |
+| [HADOOP-4174](https://issues.apache.org/jira/browse/HADOOP-4174) | Move non-client methods ou of ClientProtocol | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-4138](https://issues.apache.org/jira/browse/HADOOP-4138) | [Hive] refactor the SerDe library | Major | . | Zheng Shao | Zheng Shao |
+| [HADOOP-4075](https://issues.apache.org/jira/browse/HADOOP-4075) | test-patch.sh should output the ant commands that it runs | Major | build | Nigel Daley | Ramya Sunil |
+| [HADOOP-4117](https://issues.apache.org/jira/browse/HADOOP-4117) | Improve configurability of Hadoop EC2 instances | Major | contrib/cloud | Tom White | Tom White |
| [HADOOP-2411](https://issues.apache.org/jira/browse/HADOOP-2411) | Add support for larger EC2 instance types | Major | contrib/cloud | Tom White | Chris K Wensel |
-| [HADOOP-2330](https://issues.apache.org/jira/browse/HADOOP-2330) | Preallocate transaction log to improve namenode transaction logging performance | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-2302](https://issues.apache.org/jira/browse/HADOOP-2302) | Streaming should provide an option for numerical sort of keys | Major | . | Lohit Vijayarenu | Devaraj Das |
-| [HADOOP-2165](https://issues.apache.org/jira/browse/HADOOP-2165) | Augment JobHistory to store tasks' userlogs | Major | . | Arun C Murthy | Vinod Kumar Vavilapalli |
-| [HADOOP-2130](https://issues.apache.org/jira/browse/HADOOP-2130) | Pipes submit job should be Non-blocking | Critical | . | Srikanth Kakani | Arun C Murthy |
-| [HADOOP-1627](https://issues.apache.org/jira/browse/HADOOP-1627) | DFSAdmin incorrectly reports cluster data. | Minor | . | Konstantin Shvachko | Raghu Angadi |
-| [HADOOP-657](https://issues.apache.org/jira/browse/HADOOP-657) | Free temporary space should be modelled better | Major | . | Owen O'Malley | Ari Rabkin |
+| [HADOOP-3930](https://issues.apache.org/jira/browse/HADOOP-3930) | Decide how to integrate scheduler info into CLI and job tracker web page | Major | . | Matei Zaharia | Sreekanth Ramakrishnan |
+| [HADOOP-4083](https://issues.apache.org/jira/browse/HADOOP-4083) | change new config attribute queue.name to mapred.job.queue.name | Major | . | Owen O'Malley | Hemanth Yamijala |
+| [HADOOP-4194](https://issues.apache.org/jira/browse/HADOOP-4194) | Add JobConf and JobID to job related methods in JobTrackerInstrumentation | Major | . | Mac Yang | Mac Yang |
| [HADOOP-249](https://issues.apache.org/jira/browse/HADOOP-249) | Improving Map -\> Reduce performance and Task JVM reuse | Major | . | Benjamin Reed | Devaraj Das |
+| [HADOOP-3638](https://issues.apache.org/jira/browse/HADOOP-3638) | Cache the iFile index files in memory to reduce seeks during map output serving | Major | . | Devaraj Das | Jothi Padmanabhan |
+| [HADOOP-3975](https://issues.apache.org/jira/browse/HADOOP-3975) | test-patch can report the modifications found in the workspace along with the error message | Minor | test | Hemanth Yamijala | Ramya Sunil |
+| [HADOOP-4124](https://issues.apache.org/jira/browse/HADOOP-4124) | Changing priority of a job should be available in CLI and available on the web UI only along with the Kill Job actions | Major | . | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-2165](https://issues.apache.org/jira/browse/HADOOP-2165) | Augment JobHistory to store tasks' userlogs | Major | . | Arun C Murthy | Vinod Kumar Vavilapalli |
+| [HADOOP-4062](https://issues.apache.org/jira/browse/HADOOP-4062) | IPC client does not need to be synchronized on the output stream when a connection is closed | Major | ipc | Hairong Kuang | Hairong Kuang |
+| [HADOOP-4181](https://issues.apache.org/jira/browse/HADOOP-4181) | some minor things to make Hadoop friendlier to git | Major | build | Owen O'Malley | Owen O'Malley |
+| [HADOOP-4090](https://issues.apache.org/jira/browse/HADOOP-4090) | The configuration file lists two paths to hadoop directories (bin and conf). Startup should check that these are valid directories and give appropriate messages. | Minor | . | Ashish Thusoo | Raghotham Murthy |
+| [HADOOP-4205](https://issues.apache.org/jira/browse/HADOOP-4205) | [Hive] metastore and ql to use the refactored SerDe library | Major | . | Zheng Shao | Zheng Shao |
+| [HADOOP-4279](https://issues.apache.org/jira/browse/HADOOP-4279) | write the random number generator seed to log in the append-related tests | Blocker | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4053](https://issues.apache.org/jira/browse/HADOOP-4053) | Schedulers need to know when a job has completed | Blocker | . | Vivek Ratan | Amar Kamat |
+| [HADOOP-4424](https://issues.apache.org/jira/browse/HADOOP-4424) | menu layout change for Hadoop documentation | Blocker | documentation | Boris Shkolnik | Boris Shkolnik |
+| [HADOOP-4230](https://issues.apache.org/jira/browse/HADOOP-4230) | Hive: GroupBy should not pass the whole row from mapper to reducer | Blocker | . | Zheng Shao | Ashish Thusoo |
+| [HADOOP-4231](https://issues.apache.org/jira/browse/HADOOP-4231) | Hive: converting complex objects to JSON failed. | Minor | . | Zheng Shao | Zheng Shao |
+| [HADOOP-4252](https://issues.apache.org/jira/browse/HADOOP-4252) | Catch Ctrl-C in Hive CLI so that corresponding hadoop jobs can be killed | Minor | . | Prasad Chakka | Pete Wyckoff |
+| [HADOOP-4353](https://issues.apache.org/jira/browse/HADOOP-4353) | enable multi-line query from Hive CLI | Minor | . | Prasad Chakka | Prasad Chakka |
+| [HADOOP-4307](https://issues.apache.org/jira/browse/HADOOP-4307) | add an option to describe table to show extended properties of the table such as serialization/deserialization properties | Major | . | Prasad Chakka | Prasad Chakka |
+| [HADOOP-4345](https://issues.apache.org/jira/browse/HADOOP-4345) | Hive: Check that partitioning predicate is present when hive.partition.pruning = strict | Major | . | Ashish Thusoo | Ashish Thusoo |
+| [HADOOP-4431](https://issues.apache.org/jira/browse/HADOOP-4431) | Add versionning/tags to Chukwa Chunk | Major | . | Jerome Boulon | Jerome Boulon |
+| [HADOOP-4433](https://issues.apache.org/jira/browse/HADOOP-4433) | Improve data loader for collecting metrics and log files from hadoop and system | Major | . | Eric Yang | Eric Yang |
+| [HADOOP-3844](https://issues.apache.org/jira/browse/HADOOP-3844) | include message of local exception in Client call failures | Minor | ipc | Steve Loughran | Steve Loughran |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-4595](https://issues.apache.org/jira/browse/HADOOP-4595) | JVM Reuse triggers RuntimeException("Invalid state") | Major | . | Aaron Kimball | Devaraj Das |
-| [HADOOP-4552](https://issues.apache.org/jira/browse/HADOOP-4552) | Deadlock in RPC Server | Major | ipc | Raghu Angadi | Raghu Angadi |
-| [HADOOP-4525](https://issues.apache.org/jira/browse/HADOOP-4525) | config ipc.server.tcpnodelay is no loger being respected | Major | ipc | Clint Morgan | Clint Morgan |
-| [HADOOP-4510](https://issues.apache.org/jira/browse/HADOOP-4510) | FileOutputFormat protects getTaskOutputPath | Blocker | . | Chris K Wensel | Chris K Wensel |
-| [HADOOP-4500](https://issues.apache.org/jira/browse/HADOOP-4500) | multifilesplit is using job default filesystem incorrectly | Major | . | Joydeep Sen Sarma | Joydeep Sen Sarma |
-| [HADOOP-4498](https://issues.apache.org/jira/browse/HADOOP-4498) | JobHistory does not escape literal jobName when used in a regex pattern | Blocker | . | Chris K Wensel | Chris K Wensel |
-| [HADOOP-4471](https://issues.apache.org/jira/browse/HADOOP-4471) | Capacity Scheduler should maintain the right ordering of jobs in its running queue | Blocker | . | Vivek Ratan | Amar Kamat |
-| [HADOOP-4466](https://issues.apache.org/jira/browse/HADOOP-4466) | SequenceFileOutputFormat is coupled to WritableComparable and Writable | Blocker | io | Chris K Wensel | Chris K Wensel |
-| [HADOOP-4457](https://issues.apache.org/jira/browse/HADOOP-4457) | Input split logging in history is broken in 0.19 | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-4455](https://issues.apache.org/jira/browse/HADOOP-4455) | Upload the derby.jar and TestSeDe.jar needed for fixes to 0.19 bugs | Blocker | . | Ashish Thusoo | Ashish Thusoo |
-| [HADOOP-4449](https://issues.apache.org/jira/browse/HADOOP-4449) | Minor formatting changes to quota related commands | Trivial | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-4446](https://issues.apache.org/jira/browse/HADOOP-4446) | Update Scheduling Information display in Web UI | Major | . | Karam Singh | Sreekanth Ramakrishnan |
-| [HADOOP-4439](https://issues.apache.org/jira/browse/HADOOP-4439) | Cleanup memory related resource management | Blocker | . | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-4438](https://issues.apache.org/jira/browse/HADOOP-4438) | Add new/missing dfs commands in forrest | Blocker | documentation | Hemanth Yamijala | Suresh Srinivas |
-| [HADOOP-4427](https://issues.apache.org/jira/browse/HADOOP-4427) | Add new/missing commands in forrest | Blocker | documentation | Sharad Agarwal | Sreekanth Ramakrishnan |
-| [HADOOP-4425](https://issues.apache.org/jira/browse/HADOOP-4425) | Edits log takes much longer to load | Blocker | . | Chris Douglas | Chris Douglas |
-| [HADOOP-4423](https://issues.apache.org/jira/browse/HADOOP-4423) | FSDataset.getStoredBlock(id) should not return corrupted information | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4418](https://issues.apache.org/jira/browse/HADOOP-4418) | Update documentation in forrest for Mapred, streaming and pipes | Blocker | documentation | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-4410](https://issues.apache.org/jira/browse/HADOOP-4410) | TestMiniMRDebugScript fails on trunk | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-4405](https://issues.apache.org/jira/browse/HADOOP-4405) | all creation of hadoop dfs queries from with in hive shell | Minor | . | Prasad Chakka | Prasad Chakka |
-| [HADOOP-4404](https://issues.apache.org/jira/browse/HADOOP-4404) | saveFSImage() should remove files from a storage directory that do not correspond to its type. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-4400](https://issues.apache.org/jira/browse/HADOOP-4400) | Add "hdfs://" to fs.default.name on quickstart.html | Trivial | documentation | Jeff Hammerbacher | Jeff Hammerbacher |
-| [HADOOP-4393](https://issues.apache.org/jira/browse/HADOOP-4393) | Merge AccessControlException and AccessControlIOException into one exception class | Blocker | fs | Owen O'Malley | Owen O'Malley |
-| [HADOOP-4387](https://issues.apache.org/jira/browse/HADOOP-4387) | TestHDFSFileSystemContract fails on windows | Blocker | test | Raghu Angadi | Raghu Angadi |
-| [HADOOP-4380](https://issues.apache.org/jira/browse/HADOOP-4380) | Make new classes in mapred package private instead of public | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-4378](https://issues.apache.org/jira/browse/HADOOP-4378) | TestJobQueueInformation fails regularly | Blocker | test | Tsz Wo Nicholas Sze | Sreekanth Ramakrishnan |
-| [HADOOP-4376](https://issues.apache.org/jira/browse/HADOOP-4376) | Fix line formatting in hadoop-default.xml for hadoop.http.filter.initializers | Blocker | conf | Enis Soztutar | Enis Soztutar |
-| [HADOOP-4373](https://issues.apache.org/jira/browse/HADOOP-4373) | Guaranteed Capacity calculation is not calculated correctly | Blocker | . | Karam Singh | Hemanth Yamijala |
-| [HADOOP-4367](https://issues.apache.org/jira/browse/HADOOP-4367) | Hive: UDAF functions cannot handle NULL values | Major | . | Zheng Shao | Zheng Shao |
-| [HADOOP-4366](https://issues.apache.org/jira/browse/HADOOP-4366) | Provide way to replace existing column names for columnSet tables | Major | . | Prasad Chakka | Prasad Chakka |
-| [HADOOP-4361](https://issues.apache.org/jira/browse/HADOOP-4361) | Corner cases in killJob from command line | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-4358](https://issues.apache.org/jira/browse/HADOOP-4358) | NPE from CreateEditsLog | Blocker | test | Chris Douglas | Raghu Angadi |
-| [HADOOP-4356](https://issues.apache.org/jira/browse/HADOOP-4356) | [Hive] for a 2-stage map-reduce job, number of reducers not set correctly | Major | . | Namit Jain | Namit Jain |
-| [HADOOP-4355](https://issues.apache.org/jira/browse/HADOOP-4355) | hive 2 case sensitivity issues | Major | . | Zheng Shao | |
-| [HADOOP-4344](https://issues.apache.org/jira/browse/HADOOP-4344) | Hive: Partition pruning causes semantic exception with joins | Major | . | Ashish Thusoo | Ashish Thusoo |
-| [HADOOP-4342](https://issues.apache.org/jira/browse/HADOOP-4342) | [hive] bug in partition pruning | Major | . | Namit Jain | Namit Jain |
-| [HADOOP-4336](https://issues.apache.org/jira/browse/HADOOP-4336) | fix sampling bug in fractional bucket case | Minor | . | Prasad Chakka | Prasad Chakka |
-| [HADOOP-4335](https://issues.apache.org/jira/browse/HADOOP-4335) | FsShell -ls fails for file systems without owners or groups | Major | scripts | David Phillips | David Phillips |
-| [HADOOP-4333](https://issues.apache.org/jira/browse/HADOOP-4333) | add ability to drop partitions through DDL | Minor | . | Prasad Chakka | Prasad Chakka |
-| [HADOOP-4330](https://issues.apache.org/jira/browse/HADOOP-4330) | Hive: AS clause with subqueries having group bys is not propogated to the outer query block | Major | . | Ashish Thusoo | Ashish Thusoo |
-| [HADOOP-4329](https://issues.apache.org/jira/browse/HADOOP-4329) | Hive: [] operator with maps does not work | Major | . | Ashish Thusoo | Ashish Thusoo |
-| [HADOOP-4327](https://issues.apache.org/jira/browse/HADOOP-4327) | Create table hive does not set delimeters | Major | . | Edward Capriolo | Namit Jain |
-| [HADOOP-4321](https://issues.apache.org/jira/browse/HADOOP-4321) | Document the capacity scheduler in Forrest | Blocker | documentation | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-4320](https://issues.apache.org/jira/browse/HADOOP-4320) | [Hive] TCTLSeparatedProtocol implement maps/lists/sets read/writes | Major | . | Pete Wyckoff | |
-| [HADOOP-4319](https://issues.apache.org/jira/browse/HADOOP-4319) | fuse-dfs dfs\_read function may return less than the requested #of bytes even if EOF not reached | Blocker | . | Pete Wyckoff | Pete Wyckoff |
-| [HADOOP-4316](https://issues.apache.org/jira/browse/HADOOP-4316) | [Hive] extra new lines at output | Major | . | Namit Jain | Namit Jain |
-| [HADOOP-4315](https://issues.apache.org/jira/browse/HADOOP-4315) | Hive: Cleanup temporary files once the job is done | Major | . | Ashish Thusoo | Ashish Thusoo |
-| [HADOOP-4309](https://issues.apache.org/jira/browse/HADOOP-4309) | eclipse-plugin no longer compiles on trunk | Blocker | contrib/eclipse-plugin | Chris Douglas | Chris Douglas |
-| [HADOOP-4303](https://issues.apache.org/jira/browse/HADOOP-4303) | Hive: trim and rtrim UDFs behaviors are reversed | Major | . | Ashish Thusoo | Ashish Thusoo |
-| [HADOOP-4302](https://issues.apache.org/jira/browse/HADOOP-4302) | TestReduceFetch fails intermittently | Blocker | . | Devaraj Das | Chris Douglas |
-| [HADOOP-4299](https://issues.apache.org/jira/browse/HADOOP-4299) | Unable to access a file by a different user in the same group when permissions is set to 770 or when permissions is turned OFF | Blocker | . | Ramya Sunil | Hairong Kuang |
-| [HADOOP-4296](https://issues.apache.org/jira/browse/HADOOP-4296) | Spasm of JobClient failures on successful jobs every once in a while | Blocker | . | Joydeep Sen Sarma | dhruba borthakur |
-| [HADOOP-4294](https://issues.apache.org/jira/browse/HADOOP-4294) | Hive: Parser should pass field schema to SerDe | Major | . | Zheng Shao | |
-| [HADOOP-4288](https://issues.apache.org/jira/browse/HADOOP-4288) | java.lang.NullPointerException is observed in Jobtracker log while call heartbeat | Blocker | . | Karam Singh | Amar Kamat |
-| [HADOOP-4287](https://issues.apache.org/jira/browse/HADOOP-4287) | [mapred] jobqueue\_details.jsp shows negative count of running and waiting reduces with CapacityTaskScheduler. | Blocker | . | Vinod Kumar Vavilapalli | Sreekanth Ramakrishnan |
-| [HADOOP-4282](https://issues.apache.org/jira/browse/HADOOP-4282) | User configurable filter fails to filter accesses to certain directories | Blocker | . | Kan Zhang | Tsz Wo Nicholas Sze |
-| [HADOOP-4280](https://issues.apache.org/jira/browse/HADOOP-4280) | test-libhdfs consistently fails on trunk | Blocker | . | Raghu Angadi | Pete Wyckoff |
-| [HADOOP-4278](https://issues.apache.org/jira/browse/HADOOP-4278) | TestDatanodeDeath failed occasionally | Blocker | . | Tsz Wo Nicholas Sze | dhruba borthakur |
-| [HADOOP-4275](https://issues.apache.org/jira/browse/HADOOP-4275) | New public methods added to the \*ID classes | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-4274](https://issues.apache.org/jira/browse/HADOOP-4274) | Capacity scheduler's implementation of getJobs modifies the list of running jobs inadvertently | Blocker | . | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-4273](https://issues.apache.org/jira/browse/HADOOP-4273) | [Hive] job submission exception if input is null | Major | . | Namit Jain | Namit Jain |
-| [HADOOP-4272](https://issues.apache.org/jira/browse/HADOOP-4272) | Hive: metadataTypedColumnsetSerDe should check if SERIALIZATION.LIB is old columnsetSerDe | Major | . | Zheng Shao | Prasad Chakka |
-| [HADOOP-4269](https://issues.apache.org/jira/browse/HADOOP-4269) | LineRecordReader.LineReader should use util.LineReader | Major | util | Chris Douglas | Chris Douglas |
-| [HADOOP-4267](https://issues.apache.org/jira/browse/HADOOP-4267) | TestDBJob failed on Linux | Blocker | . | Raghu Angadi | Enis Soztutar |
-| [HADOOP-4266](https://issues.apache.org/jira/browse/HADOOP-4266) | Hive: Support "IS NULL", "IS NOT NULL", and size(x) for map and list | Major | . | Zheng Shao | Zheng Shao |
-| [HADOOP-4265](https://issues.apache.org/jira/browse/HADOOP-4265) | [Hive] error when user specifies the delimiter | Major | . | Namit Jain | Namit Jain |
-| [HADOOP-4261](https://issues.apache.org/jira/browse/HADOOP-4261) | Jobs failing in the init stage will never cleanup | Blocker | . | Amar Kamat | Amareshwari Sriramadasu |
-| [HADOOP-4256](https://issues.apache.org/jira/browse/HADOOP-4256) | Remove Completed and Failed Job tables from jobqueue\_details.jsp | Blocker | . | Sreekanth Ramakrishnan | Sreekanth Ramakrishnan |
-| [HADOOP-4254](https://issues.apache.org/jira/browse/HADOOP-4254) | Cannot setSpaceQuota to 1TB | Blocker | . | Tsz Wo Nicholas Sze | Raghu Angadi |
-| [HADOOP-4250](https://issues.apache.org/jira/browse/HADOOP-4250) | Remove short names of serdes from Deserializer, Serializer & SerDe interface and relevant code. | Major | . | Prasad Chakka | Prasad Chakka |
-| [HADOOP-4249](https://issues.apache.org/jira/browse/HADOOP-4249) | Declare hsqldb.jar in eclipse plugin | Blocker | contrib/eclipse-plugin | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4248](https://issues.apache.org/jira/browse/HADOOP-4248) | Remove HADOOP-1230 API from 0.19 | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-4247](https://issues.apache.org/jira/browse/HADOOP-4247) | hadoop jar throwing exception when running examples | Blocker | . | Hemanth Yamijala | Owen O'Malley |
-| [HADOOP-4246](https://issues.apache.org/jira/browse/HADOOP-4246) | Reduce task copy errors may not kill it eventually | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-4242](https://issues.apache.org/jira/browse/HADOOP-4242) | Remove an extra ";" in FSDirectory | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4241](https://issues.apache.org/jira/browse/HADOOP-4241) | -hiveconf config parameters in hive cli should override all config variables | Major | . | Joydeep Sen Sarma | Joydeep Sen Sarma |
-| [HADOOP-4236](https://issues.apache.org/jira/browse/HADOOP-4236) | JobTracker.killJob() fails to kill a job if the job is not yet initialized | Blocker | . | Amar Kamat | Sharad Agarwal |
-| [HADOOP-4232](https://issues.apache.org/jira/browse/HADOOP-4232) | Race condition in JVM reuse when more than one slot becomes free | Blocker | . | Devaraj Das | Devaraj Das |
-| [HADOOP-4225](https://issues.apache.org/jira/browse/HADOOP-4225) | FSEditLog logs modification time instead of access time. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-4213](https://issues.apache.org/jira/browse/HADOOP-4213) | NPE in TestLimitTasksPerJobTaskScheduler | Major | test | Tsz Wo Nicholas Sze | Sreekanth Ramakrishnan |
-| [HADOOP-4209](https://issues.apache.org/jira/browse/HADOOP-4209) | The TaskAttemptID should not have the JobTracker start time | Blocker | . | Owen O'Malley | Amar Kamat |
-| [HADOOP-4200](https://issues.apache.org/jira/browse/HADOOP-4200) | Hadoop-Patch build is failing | Major | build | Ramya Sunil | Ramya Sunil |
-| [HADOOP-4197](https://issues.apache.org/jira/browse/HADOOP-4197) | Need to update DATA\_TRANSFER\_VERSION | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4195](https://issues.apache.org/jira/browse/HADOOP-4195) | SequenceFile.Writer close() uses compressor after returning it to CodecPool. | Major | io | Hong Tang | Arun C Murthy |
-| [HADOOP-4189](https://issues.apache.org/jira/browse/HADOOP-4189) | HADOOP-3245 is incomplete | Blocker | . | Amar Kamat | Amar Kamat |
-| [HADOOP-4183](https://issues.apache.org/jira/browse/HADOOP-4183) | select \* to console issues in Hive | Major | . | Joydeep Sen Sarma | |
-| [HADOOP-4175](https://issues.apache.org/jira/browse/HADOOP-4175) | Incorporate metastore server review comments | Major | . | Prasad Chakka | Prasad Chakka |
-| [HADOOP-4173](https://issues.apache.org/jira/browse/HADOOP-4173) | TestProcfsBasedProcessTree failing on Windows machine | Major | test, util | Ramya Sunil | Vinod Kumar Vavilapalli |
-| [HADOOP-4169](https://issues.apache.org/jira/browse/HADOOP-4169) | 'compressed' keyword in DDL syntax misleading and does not compress | Major | . | Joydeep Sen Sarma | Joydeep Sen Sarma |
-| [HADOOP-4163](https://issues.apache.org/jira/browse/HADOOP-4163) | If a reducer failed at shuffling stage, the task should fail, not just logging an exception | Blocker | . | Runping Qi | Sharad Agarwal |
-| [HADOOP-4155](https://issues.apache.org/jira/browse/HADOOP-4155) | JobHisotry::JOBTRACKER\_START\_TIME is not initialized properly | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3528](https://issues.apache.org/jira/browse/HADOOP-3528) | Metrics FilesCreated and files\_deleted metrics do not match. | Blocker | metrics | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3542](https://issues.apache.org/jira/browse/HADOOP-3542) | Hadoop archives should not create \_logs file in the final archive directory. | Blocker | . | Mahadev konar | Mahadev konar |
+| [HADOOP-3560](https://issues.apache.org/jira/browse/HADOOP-3560) | Archvies sometimes create empty part files. | Blocker | . | Mahadev konar | Mahadev konar |
+| [HADOOP-3076](https://issues.apache.org/jira/browse/HADOOP-3076) | [HOD] If a cluster directory is specified as a relative path, an existing script.exitcode file will not be deleted. | Blocker | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-3543](https://issues.apache.org/jira/browse/HADOOP-3543) | Need to increment the year field for the copyright notice | Trivial | documentation | Chris Douglas | Chris Douglas |
+| [HADOOP-3640](https://issues.apache.org/jira/browse/HADOOP-3640) | NativeS3FsInputStream read() method for reading a single byte is incorrect | Major | fs/s3 | Tom White | Tom White |
+| [HADOOP-3711](https://issues.apache.org/jira/browse/HADOOP-3711) | Streaming input is not parsed properly to find the separator | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-3725](https://issues.apache.org/jira/browse/HADOOP-3725) | TestMiniMRMapRedDebugScript loses exception details | Minor | test | Steve Loughran | Steve Loughran |
+| [HADOOP-3726](https://issues.apache.org/jira/browse/HADOOP-3726) | TestCLI loses exception details on setup/teardown | Minor | test | Steve Loughran | Steve Loughran |
+| [HADOOP-3732](https://issues.apache.org/jira/browse/HADOOP-3732) | Block scanner should read block information during initialization. | Blocker | . | Konstantin Shvachko | Raghu Angadi |
+| [HADOOP-3720](https://issues.apache.org/jira/browse/HADOOP-3720) | dfsadmin -refreshNodes should re-read the config file. | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3723](https://issues.apache.org/jira/browse/HADOOP-3723) | libhdfs only accepts O\_WRONLY and O\_RDONLY so does not accept things like O\_WRONLY \| O\_CREAT | Minor | . | Pete Wyckoff | Pi Song |
+| [HADOOP-3643](https://issues.apache.org/jira/browse/HADOOP-3643) | jobtasks.jsp when called for running tasks should ignore completed TIPs | Major | . | Amar Kamat | Amar Kamat |
+| [HADOOP-3777](https://issues.apache.org/jira/browse/HADOOP-3777) | Failure to load native lzo libraries causes job failure | Major | . | Chris Douglas | Chris Douglas |
+| [HADOOP-3728](https://issues.apache.org/jira/browse/HADOOP-3728) | Cannot run more than one instance of examples.SleepJob at the same time. | Minor | . | Brice Arnould | Brice Arnould |
+| [HADOOP-3795](https://issues.apache.org/jira/browse/HADOOP-3795) | NameNode does not save image if different dfs.name.dir have different checkpoint stamps | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3778](https://issues.apache.org/jira/browse/HADOOP-3778) | seek(long) in DFSInputStream should catch socket exception for retry later | Minor | . | Luo Ning | Luo Ning |
+| [HADOOP-3756](https://issues.apache.org/jira/browse/HADOOP-3756) | dfs.client.buffer.dir isn't used in hdfs, but it's still in conf/hadoop-default.xml | Trivial | . | Michael Bieniosek | Raghu Angadi |
+| [HADOOP-3776](https://issues.apache.org/jira/browse/HADOOP-3776) | NPE in NameNode with unknown blocks | Blocker | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-3820](https://issues.apache.org/jira/browse/HADOOP-3820) | gridmix-env has a syntax error, and wrongly defines USE\_REAL\_DATASET by default | Major | benchmarks | Arun C Murthy | Arun C Murthy |
+| [HADOOP-3819](https://issues.apache.org/jira/browse/HADOOP-3819) | can not get svn revision # at build time if locale is not english | Minor | build | Rong-En Fan | Rong-En Fan |
+| [HADOOP-3848](https://issues.apache.org/jira/browse/HADOOP-3848) | TaskTracker.localizeJob calls getSystemDir for each task rather than caching it | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-3863](https://issues.apache.org/jira/browse/HADOOP-3863) | Use a thread-local rather than static ENCODER/DECODER variables in Text for synchronization | Critical | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-3131](https://issues.apache.org/jira/browse/HADOOP-3131) | enabling BLOCK compression for map outputs breaks the reduce progress counters | Major | . | Colin Evans | Matei Zaharia |
+| [HADOOP-3836](https://issues.apache.org/jira/browse/HADOOP-3836) | TestMultipleOutputs will fail if it is ran more than one times | Major | test | Tsz Wo Nicholas Sze | Alejandro Abdelnur |
+| [HADOOP-3846](https://issues.apache.org/jira/browse/HADOOP-3846) | CreateEditsLog used for benchmark misses creating parent directories | Minor | benchmarks | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3904](https://issues.apache.org/jira/browse/HADOOP-3904) | A few tests still using old hdfs package name | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3319](https://issues.apache.org/jira/browse/HADOOP-3319) | [HOD]checknodes prints errors messages on stdout | Major | contrib/hod | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [HADOOP-3907](https://issues.apache.org/jira/browse/HADOOP-3907) | INodeDirectoryWithQuota should be in its own .java file | Minor | . | Steve Loughran | Tsz Wo Nicholas Sze |
+| [HADOOP-3919](https://issues.apache.org/jira/browse/HADOOP-3919) | hadoop conf got slightly mangled by 3772 | Minor | . | Ari Rabkin | Ari Rabkin |
+| [HADOOP-3875](https://issues.apache.org/jira/browse/HADOOP-3875) | Fix TaskTracker's heartbeat timer to note the time the hearbeat RPC returned to decide next heartbeat time | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-3864](https://issues.apache.org/jira/browse/HADOOP-3864) | JobTracker lockup due to JobInProgress.initTasks taking significant time for large jobs on large clusters | Critical | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-9](https://issues.apache.org/jira/browse/HADOOP-9) | mapred.local.dir temp dir. space allocation limited by smallest area | Minor | . | Paul Baclace | Ari Rabkin |
+| [HADOOP-3851](https://issues.apache.org/jira/browse/HADOOP-3851) | spelling error in FSNamesystemMetrics log message | Trivial | . | Steve Loughran | Steve Loughran |
+| [HADOOP-3816](https://issues.apache.org/jira/browse/HADOOP-3816) | KFS changes for faster directory listing | Minor | fs | Sriram Rao | Sriram Rao |
+| [HADOOP-3773](https://issues.apache.org/jira/browse/HADOOP-3773) | Setting the conf twice in Pipes Submitter | Trivial | . | Koji Noguchi | Koji Noguchi |
+| [HADOOP-3952](https://issues.apache.org/jira/browse/HADOOP-3952) | TestDataJoin references dfs.MiniDFSCluster instead of hdfs.MiniDFSCluster | Major | test | Owen O'Malley | Owen O'Malley |
+| [HADOOP-3951](https://issues.apache.org/jira/browse/HADOOP-3951) | The package name used in FSNamesystem is incorrect | Trivial | . | Tsz Wo Nicholas Sze | Chris Douglas |
+| [HADOOP-3946](https://issues.apache.org/jira/browse/HADOOP-3946) | TestMapRed fails on trunk | Blocker | test | Amareshwari Sriramadasu | Tom White |
+| [HADOOP-3949](https://issues.apache.org/jira/browse/HADOOP-3949) | javadoc warnings: Multiple sources of package comments found for package | Major | build, documentation | Tsz Wo Nicholas Sze | Jerome Boulon |
+| [HADOOP-3933](https://issues.apache.org/jira/browse/HADOOP-3933) | DataNode's BlockSender sends more data than necessary | Minor | . | Ning Li | Ning Li |
+| [HADOOP-3962](https://issues.apache.org/jira/browse/HADOOP-3962) | Shell command "fs -count" should support paths with different file systsms | Major | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3957](https://issues.apache.org/jira/browse/HADOOP-3957) | Fix javac warnings in DistCp and the corresponding tests | Minor | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3958](https://issues.apache.org/jira/browse/HADOOP-3958) | TestMapRed ignores failures of the test case | Major | test | Owen O'Malley | Owen O'Malley |
+| [HADOOP-3658](https://issues.apache.org/jira/browse/HADOOP-3658) | Incorrect destination IP logged for receiving blocks | Minor | . | Koji Noguchi | Chris Douglas |
+| [HADOOP-3985](https://issues.apache.org/jira/browse/HADOOP-3985) | TestHDFSServerPorts fails on trunk | Major | . | Amar Kamat | Hairong Kuang |
+| [HADOOP-3964](https://issues.apache.org/jira/browse/HADOOP-3964) | javadoc warnings by failmon | Major | build | Tsz Wo Nicholas Sze | dhruba borthakur |
+| [HADOOP-3785](https://issues.apache.org/jira/browse/HADOOP-3785) | FileSystem cache should be case-insensitive | Major | fs | Doug Cutting | Bill de hOra |
+| [HADOOP-3506](https://issues.apache.org/jira/browse/HADOOP-3506) | Occasional NPE in Jets3tFileSystemStore | Major | fs/s3 | Robert | Tom White |
+| [HADOOP-3705](https://issues.apache.org/jira/browse/HADOOP-3705) | CompositeInputFormat is unable to parse InputFormat classes with names containing '\_' or '$' | Major | . | Jingkei Ly | Chris Douglas |
+| [HADOOP-4023](https://issues.apache.org/jira/browse/HADOOP-4023) | javadoc warnings: incorrect references | Major | documentation | Tsz Wo Nicholas Sze | Owen O'Malley |
+| [HADOOP-4030](https://issues.apache.org/jira/browse/HADOOP-4030) | LzopCodec shouldn't be in the default list of codecs i.e. io.compression.codecs | Major | io | Arun C Murthy | Arun C Murthy |
+| [HADOOP-3961](https://issues.apache.org/jira/browse/HADOOP-3961) | resource estimation works badly in some cases | Blocker | . | Ari Rabkin | Ari Rabkin |
+| [HADOOP-4036](https://issues.apache.org/jira/browse/HADOOP-4036) | Increment InterTrackerProtocol version number due to changes in HADOOP-3759 | Major | . | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-2168](https://issues.apache.org/jira/browse/HADOOP-2168) | Pipes with a C++ record reader does not update progress in the map until it is 100% | Major | . | Owen O'Malley | Arun C Murthy |
+| [HADOOP-3488](https://issues.apache.org/jira/browse/HADOOP-3488) | the rsync command in hadoop-daemon.sh also rsync the logs folder from the master, what deletes the datanode / tasktracker log files. | Critical | scripts | Stefan Groschupf | Craig Macdonald |
+| [HADOOP-3937](https://issues.apache.org/jira/browse/HADOOP-3937) | Job history may get disabled due to overly long job names | Major | . | Matei Zaharia | Matei Zaharia |
+| [HADOOP-3950](https://issues.apache.org/jira/browse/HADOOP-3950) | TestMapRed and TestMiniMRDFSSort failed on trunk | Major | test | Tsz Wo Nicholas Sze | Enis Soztutar |
+| [HADOOP-3910](https://issues.apache.org/jira/browse/HADOOP-3910) | Are ClusterTestDFSNamespaceLogging and ClusterTestDFS still valid tests? | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3954](https://issues.apache.org/jira/browse/HADOOP-3954) | Skip records enabled as default. | Critical | . | Koji Noguchi | Sharad Agarwal |
+| [HADOOP-4050](https://issues.apache.org/jira/browse/HADOOP-4050) | TestFairScheduler failed on Linux | Major | . | Tsz Wo Nicholas Sze | Matei Zaharia |
+| [HADOOP-4078](https://issues.apache.org/jira/browse/HADOOP-4078) | TestKosmosFileSystem fails on trunk | Blocker | fs | Amareshwari Sriramadasu | Lohit Vijayarenu |
+| [HADOOP-3968](https://issues.apache.org/jira/browse/HADOOP-3968) | test-libhdfs fails on trunk | Major | . | Lohit Vijayarenu | Pete Wyckoff |
+| [HADOOP-4100](https://issues.apache.org/jira/browse/HADOOP-4100) | Scheduler.assignTasks should not be dealing with cleanupTask | Major | . | Devaraj Das | Amareshwari Sriramadasu |
+| [HADOOP-3970](https://issues.apache.org/jira/browse/HADOOP-3970) | Counters written to the job history cannot be recovered back | Major | . | Amar Kamat | Amar Kamat |
+| [HADOOP-4097](https://issues.apache.org/jira/browse/HADOOP-4097) | Hive interaction with speculative execution is broken | Critical | . | Joydeep Sen Sarma | Joydeep Sen Sarma |
| [HADOOP-4154](https://issues.apache.org/jira/browse/HADOOP-4154) | Fix javac warning in WritableUtils | Minor | io | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4149](https://issues.apache.org/jira/browse/HADOOP-4149) | JobQueueJobInProgressListener.jobUpdated() might not work as expected | Blocker | . | Amar Kamat | Amar Kamat |
+| [HADOOP-4054](https://issues.apache.org/jira/browse/HADOOP-4054) | During edit log loading, an underconstruction file's lease gets removed twice | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-4071](https://issues.apache.org/jira/browse/HADOOP-4071) | FSNameSystem.isReplicationInProgress should add an underReplicated block to the neededReplication queue using method "add" not "update" | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-4147](https://issues.apache.org/jira/browse/HADOOP-4147) | Remove JobWithTaskContext from JobInProgress | Trivial | . | Amar Kamat | Amareshwari Sriramadasu |
-| [HADOOP-4146](https://issues.apache.org/jira/browse/HADOOP-4146) | [Hive] null pointer exception on a join | Major | . | Namit Jain | Namit Jain |
-| [HADOOP-4139](https://issues.apache.org/jira/browse/HADOOP-4139) | [Hive] multi group by statement is not optimized | Major | . | Namit Jain | Namit Jain |
-| [HADOOP-4135](https://issues.apache.org/jira/browse/HADOOP-4135) | change max length of database columns for metastore to 767 | Minor | . | Prasad Chakka | Prasad Chakka |
| [HADOOP-4133](https://issues.apache.org/jira/browse/HADOOP-4133) | remove derby.log files form repository and also change the location where these files get created | Minor | . | Prasad Chakka | Prasad Chakka |
-| [HADOOP-4129](https://issues.apache.org/jira/browse/HADOOP-4129) | Memory limits of TaskTracker and Tasks should be in kiloBytes. | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [HADOOP-4125](https://issues.apache.org/jira/browse/HADOOP-4125) | Reduce cleanup tip web ui is does not show attempts | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-4121](https://issues.apache.org/jira/browse/HADOOP-4121) | HistoryViewer initialization failure should log exception trace | Trivial | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
| [HADOOP-4112](https://issues.apache.org/jira/browse/HADOOP-4112) | Got ArrayOutOfBound exception while analyzing the job history | Major | . | Amar Kamat | Amareshwari Sriramadasu |
-| [HADOOP-4100](https://issues.apache.org/jira/browse/HADOOP-4100) | Scheduler.assignTasks should not be dealing with cleanupTask | Major | . | Devaraj Das | Amareshwari Sriramadasu |
+| [HADOOP-3831](https://issues.apache.org/jira/browse/HADOOP-3831) | slow-reading dfs clients do not recover from datanode-write-timeouts | Major | . | Christian Kunz | Raghu Angadi |
+| [HADOOP-4155](https://issues.apache.org/jira/browse/HADOOP-4155) | JobHisotry::JOBTRACKER\_START\_TIME is not initialized properly | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
| [HADOOP-4099](https://issues.apache.org/jira/browse/HADOOP-4099) | HFTP interface compatibility with older releases broken | Blocker | fs | Kan Zhang | dhruba borthakur |
-| [HADOOP-4097](https://issues.apache.org/jira/browse/HADOOP-4097) | Hive interaction with speculative execution is broken | Critical | . | Joydeep Sen Sarma | Joydeep Sen Sarma |
-| [HADOOP-4093](https://issues.apache.org/jira/browse/HADOOP-4093) | [Hive]unify Table.getCols() & get\_fields() | Major | . | Prasad Chakka | Prasad Chakka |
-| [HADOOP-4089](https://issues.apache.org/jira/browse/HADOOP-4089) | Check if the tmp file used in the CLI exists before using it. | Major | . | Ashish Thusoo | |
+| [HADOOP-3570](https://issues.apache.org/jira/browse/HADOOP-3570) | Including user specified jar files in the client side classpath path in Hadoop 0.17 streaming | Major | . | Suhas Gogate | Sharad Agarwal |
+| [HADOOP-4129](https://issues.apache.org/jira/browse/HADOOP-4129) | Memory limits of TaskTracker and Tasks should be in kiloBytes. | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [HADOOP-4139](https://issues.apache.org/jira/browse/HADOOP-4139) | [Hive] multi group by statement is not optimized | Major | . | Namit Jain | Namit Jain |
+| [HADOOP-3623](https://issues.apache.org/jira/browse/HADOOP-3623) | LeaseManager needs refactoring. | Major | . | Konstantin Shvachko | Tsz Wo Nicholas Sze |
+| [HADOOP-4125](https://issues.apache.org/jira/browse/HADOOP-4125) | Reduce cleanup tip web ui is does not show attempts | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
| [HADOOP-4087](https://issues.apache.org/jira/browse/HADOOP-4087) | Make Hive metastore server to work for PHP & Python clients | Major | . | Prasad Chakka | Prasad Chakka |
-| [HADOOP-4078](https://issues.apache.org/jira/browse/HADOOP-4078) | TestKosmosFileSystem fails on trunk | Blocker | fs | Amareshwari Sriramadasu | Lohit Vijayarenu |
+| [HADOOP-4197](https://issues.apache.org/jira/browse/HADOOP-4197) | Need to update DATA\_TRANSFER\_VERSION | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4195](https://issues.apache.org/jira/browse/HADOOP-4195) | SequenceFile.Writer close() uses compressor after returning it to CodecPool. | Major | io | Hong Tang | Arun C Murthy |
+| [HADOOP-3959](https://issues.apache.org/jira/browse/HADOOP-3959) | [HOD] --resource\_manager.options is not passed to qsub | Major | contrib/hod | Craig Macdonald | Vinod Kumar Vavilapalli |
+| [HADOOP-3783](https://issues.apache.org/jira/browse/HADOOP-3783) | "deprecated filesystem name" warning on EC2 | Minor | contrib/cloud | Stuart Sierra | Tom White |
+| [HADOOP-3991](https://issues.apache.org/jira/browse/HADOOP-3991) | updates to hadoop-ec2-env.sh for 0.18.0 | Minor | contrib/cloud | Karl Anderson | Tom White |
+| [HADOOP-2403](https://issues.apache.org/jira/browse/HADOOP-2403) | JobHistory log files contain data that cannot be parsed by org.apache.hadoop.mapred.JobHistory | Critical | . | Runping Qi | Amareshwari Sriramadasu |
+| [HADOOP-4200](https://issues.apache.org/jira/browse/HADOOP-4200) | Hadoop-Patch build is failing | Major | build | Ramya Sunil | Ramya Sunil |
+| [HADOOP-4121](https://issues.apache.org/jira/browse/HADOOP-4121) | HistoryViewer initialization failure should log exception trace | Trivial | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-4213](https://issues.apache.org/jira/browse/HADOOP-4213) | NPE in TestLimitTasksPerJobTaskScheduler | Major | test | Tsz Wo Nicholas Sze | Sreekanth Ramakrishnan |
| [HADOOP-4077](https://issues.apache.org/jira/browse/HADOOP-4077) | Access permissions for setting access times and modification times for files | Blocker | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-4071](https://issues.apache.org/jira/browse/HADOOP-4071) | FSNameSystem.isReplicationInProgress should add an underReplicated block to the neededReplication queue using method "add" not "update" | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-4054](https://issues.apache.org/jira/browse/HADOOP-4054) | During edit log loading, an underconstruction file's lease gets removed twice | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-4050](https://issues.apache.org/jira/browse/HADOOP-4050) | TestFairScheduler failed on Linux | Major | . | Tsz Wo Nicholas Sze | Matei Zaharia |
-| [HADOOP-4036](https://issues.apache.org/jira/browse/HADOOP-4036) | Increment InterTrackerProtocol version number due to changes in HADOOP-3759 | Major | . | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-4030](https://issues.apache.org/jira/browse/HADOOP-4030) | LzopCodec shouldn't be in the default list of codecs i.e. io.compression.codecs | Major | io | Arun C Murthy | Arun C Murthy |
+| [HADOOP-3592](https://issues.apache.org/jira/browse/HADOOP-3592) | org.apache.hadoop.fs.FileUtil.copy() will leak input streams if the destination can't be opened | Minor | fs | Steve Loughran | Bill de hOra |
+| [HADOOP-4169](https://issues.apache.org/jira/browse/HADOOP-4169) | 'compressed' keyword in DDL syntax misleading and does not compress | Major | . | Joydeep Sen Sarma | Joydeep Sen Sarma |
+| [HADOOP-4175](https://issues.apache.org/jira/browse/HADOOP-4175) | Incorporate metastore server review comments | Major | . | Prasad Chakka | Prasad Chakka |
| [HADOOP-4027](https://issues.apache.org/jira/browse/HADOOP-4027) | When streaming utility is run without specifying mapper/reducer/input/output options, it returns 0. | Major | . | Ramya Sunil | |
-| [HADOOP-4023](https://issues.apache.org/jira/browse/HADOOP-4023) | javadoc warnings: incorrect references | Major | documentation | Tsz Wo Nicholas Sze | Owen O'Malley |
+| [HADOOP-4242](https://issues.apache.org/jira/browse/HADOOP-4242) | Remove an extra ";" in FSDirectory | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4248](https://issues.apache.org/jira/browse/HADOOP-4248) | Remove HADOOP-1230 API from 0.19 | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-4249](https://issues.apache.org/jira/browse/HADOOP-4249) | Declare hsqldb.jar in eclipse plugin | Blocker | contrib/eclipse-plugin | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4247](h
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[39/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.2.0/CHANGES.0.2.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.2.0/CHANGES.0.2.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.2.0/CHANGES.0.2.0.md
index 72e7d42..04ccabb 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.2.0/CHANGES.0.2.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.2.0/CHANGES.0.2.0.md
@@ -20,49 +20,39 @@
## Release 0.2.0 - 2006-05-05
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-191](https://issues.apache.org/jira/browse/HADOOP-191) | add hadoopStreaming to src/contrib | Major | . | Michel Tourn | Doug Cutting |
-| [HADOOP-189](https://issues.apache.org/jira/browse/HADOOP-189) | Add job jar lib, classes, etc. to CLASSPATH when in standalone mode | Major | . | stack | Doug Cutting |
+| [HADOOP-51](https://issues.apache.org/jira/browse/HADOOP-51) | per-file replication counts | Major | . | Doug Cutting | Konstantin Shvachko |
| [HADOOP-148](https://issues.apache.org/jira/browse/HADOOP-148) | add a failure count to task trackers | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-132](https://issues.apache.org/jira/browse/HADOOP-132) | An API for reporting performance metrics | Major | . | David Bowen | |
+| [HADOOP-189](https://issues.apache.org/jira/browse/HADOOP-189) | Add job jar lib, classes, etc. to CLASSPATH when in standalone mode | Major | . | stack | Doug Cutting |
| [HADOOP-65](https://issues.apache.org/jira/browse/HADOOP-65) | add a record I/O framework to hadoop | Minor | io, ipc | Sameer Paranjpye | |
-| [HADOOP-51](https://issues.apache.org/jira/browse/HADOOP-51) | per-file replication counts | Major | . | Doug Cutting | Konstantin Shvachko |
+| [HADOOP-191](https://issues.apache.org/jira/browse/HADOOP-191) | add hadoopStreaming to src/contrib | Major | . | Michel Tourn | Doug Cutting |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-198](https://issues.apache.org/jira/browse/HADOOP-198) | adding owen's examples to exampledriver | Minor | . | Mahadev konar | Mahadev konar |
-| [HADOOP-178](https://issues.apache.org/jira/browse/HADOOP-178) | piggyback block work requests to heartbeats and move block replication/deletion startup delay from datanodes to namenode | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-177](https://issues.apache.org/jira/browse/HADOOP-177) | improvement to browse through the map/reduce tasks | Minor | . | Mahadev konar | Mahadev konar |
-| [HADOOP-173](https://issues.apache.org/jira/browse/HADOOP-173) | optimize allocation of tasks w/ local data | Major | . | Doug Cutting | Doug Cutting |
-| [HADOOP-170](https://issues.apache.org/jira/browse/HADOOP-170) | setReplication and related bug fixes | Major | fs | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-167](https://issues.apache.org/jira/browse/HADOOP-167) | reducing the number of Configuration & JobConf objects created | Major | conf | Owen O'Malley | Owen O'Malley |
-| [HADOOP-166](https://issues.apache.org/jira/browse/HADOOP-166) | IPC is unable to invoke methods that use interfaces as parameter | Minor | ipc | Stefan Groschupf | Doug Cutting |
-| [HADOOP-150](https://issues.apache.org/jira/browse/HADOOP-150) | tip and task names should reflect the job name | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-144](https://issues.apache.org/jira/browse/HADOOP-144) | the dfs client id isn't relatable to the map/reduce task ids | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-142](https://issues.apache.org/jira/browse/HADOOP-142) | failed tasks should be rescheduled on different hosts after other jobs | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-138](https://issues.apache.org/jira/browse/HADOOP-138) | stop all tasks | Trivial | . | Stefan Groschupf | Doug Cutting |
+| [HADOOP-116](https://issues.apache.org/jira/browse/HADOOP-116) | cleaning up /tmp/hadoop/mapred/system | Major | . | raghavendra prabhu | Doug Cutting |
| [HADOOP-131](https://issues.apache.org/jira/browse/HADOOP-131) | Separate start/stop-dfs.sh and start/stop-mapred.sh scripts | Minor | . | Chris A. Mattmann | Doug Cutting |
| [HADOOP-129](https://issues.apache.org/jira/browse/HADOOP-129) | FileSystem should not name files with java.io.File | Major | fs | Doug Cutting | Doug Cutting |
-| [HADOOP-116](https://issues.apache.org/jira/browse/HADOOP-116) | cleaning up /tmp/hadoop/mapred/system | Major | . | raghavendra prabhu | Doug Cutting |
+| [HADOOP-144](https://issues.apache.org/jira/browse/HADOOP-144) | the dfs client id isn't relatable to the map/reduce task ids | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-114](https://issues.apache.org/jira/browse/HADOOP-114) | Non-informative error message | Trivial | . | Rod Taylor | Doug Cutting |
+| [HADOOP-142](https://issues.apache.org/jira/browse/HADOOP-142) | failed tasks should be rescheduled on different hosts after other jobs | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-138](https://issues.apache.org/jira/browse/HADOOP-138) | stop all tasks | Trivial | . | Stefan Groschupf | Doug Cutting |
+| [HADOOP-150](https://issues.apache.org/jira/browse/HADOOP-150) | tip and task names should reflect the job name | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-166](https://issues.apache.org/jira/browse/HADOOP-166) | IPC is unable to invoke methods that use interfaces as parameter | Minor | ipc | Stefan Groschupf | Doug Cutting |
+| [HADOOP-170](https://issues.apache.org/jira/browse/HADOOP-170) | setReplication and related bug fixes | Major | fs | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-173](https://issues.apache.org/jira/browse/HADOOP-173) | optimize allocation of tasks w/ local data | Major | . | Doug Cutting | Doug Cutting |
+| [HADOOP-167](https://issues.apache.org/jira/browse/HADOOP-167) | reducing the number of Configuration & JobConf objects created | Major | conf | Owen O'Malley | Owen O'Malley |
+| [HADOOP-177](https://issues.apache.org/jira/browse/HADOOP-177) | improvement to browse through the map/reduce tasks | Minor | . | Mahadev konar | Mahadev konar |
+| [HADOOP-178](https://issues.apache.org/jira/browse/HADOOP-178) | piggyback block work requests to heartbeats and move block replication/deletion startup delay from datanodes to namenode | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-198](https://issues.apache.org/jira/browse/HADOOP-198) | adding owen's examples to exampledriver | Minor | . | Mahadev konar | Mahadev konar |
| [HADOOP-96](https://issues.apache.org/jira/browse/HADOOP-96) | name server should log decisions that affect data: block creation, removal, replication | Critical | . | Yoram Arnon | Hairong Kuang |
@@ -70,34 +60,34 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-192](https://issues.apache.org/jira/browse/HADOOP-192) | Trivial JRE 1.5 versus 1.4 bug | Blocker | . | David Bowen | |
-| [HADOOP-190](https://issues.apache.org/jira/browse/HADOOP-190) | Job fails though task succeeded if we fail to exit | Major | . | stack | |
-| [HADOOP-188](https://issues.apache.org/jira/browse/HADOOP-188) | more unprotected RPC calls in JobClient.runJob allow loss of job due to timeout | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-186](https://issues.apache.org/jira/browse/HADOOP-186) | communication problems in the task tracker cause long latency | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-185](https://issues.apache.org/jira/browse/HADOOP-185) | tasks are lost during pollForNewTask | Critical | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-183](https://issues.apache.org/jira/browse/HADOOP-183) | adjust file replication factor when loading image and edits according to replication.min and replication.max | Minor | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-182](https://issues.apache.org/jira/browse/HADOOP-182) | lost task trackers should not update status of completed jobs | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-174](https://issues.apache.org/jira/browse/HADOOP-174) | jobclient kills job for one timeout | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-172](https://issues.apache.org/jira/browse/HADOOP-172) | rpc doesn't handle returning null for a String[] | Blocker | ipc | Owen O'Malley | Owen O'Malley |
-| [HADOOP-169](https://issues.apache.org/jira/browse/HADOOP-169) | a single failure from locateMapOutputs kills the entire job | Critical | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-168](https://issues.apache.org/jira/browse/HADOOP-168) | JobSubmissionProtocol and InterTrackerProtocol don't include "throws IOException" on all methods | Minor | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-162](https://issues.apache.org/jira/browse/HADOOP-162) | concurrent modification exception in FSNamesystem.Lease.releaseLocks | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-160](https://issues.apache.org/jira/browse/HADOOP-160) | sleeping with locks held | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-157](https://issues.apache.org/jira/browse/HADOOP-157) | job fails because pendingCreates is not cleaned up after a task fails | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-151](https://issues.apache.org/jira/browse/HADOOP-151) | RPC code has socket leak? | Major | ipc | p sutter | Doug Cutting |
-| [HADOOP-143](https://issues.apache.org/jira/browse/HADOOP-143) | exception call stacks are word wrapped in webapp | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-117](https://issues.apache.org/jira/browse/HADOOP-117) | mapred temporary files not deleted | Blocker | . | raghavendra prabhu | Doug Cutting |
+| [HADOOP-125](https://issues.apache.org/jira/browse/HADOOP-125) | LocalFileSystem.makeAbsolute bug on Windows | Minor | fs | p sutter | Doug Cutting |
+| [HADOOP-126](https://issues.apache.org/jira/browse/HADOOP-126) | "hadoop dfs -cp" does not copy crc files | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-92](https://issues.apache.org/jira/browse/HADOOP-92) | Error Reporting/logging in MapReduce | Minor | . | Mahadev konar | Mahadev konar |
+| [HADOOP-128](https://issues.apache.org/jira/browse/HADOOP-128) | Failure to replicate dfs block kills client | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-118](https://issues.apache.org/jira/browse/HADOOP-118) | Namenode does not always clean up pendingCreates | Critical | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-139](https://issues.apache.org/jira/browse/HADOOP-139) | Deadlock in LocalFileSystem lock/release | Major | fs | Igor Bolotin | Doug Cutting |
-| [HADOOP-137](https://issues.apache.org/jira/browse/HADOOP-137) | Different TaskTrackers may get the same task tracker id, thus cause many problems. | Critical | . | Runping Qi | Owen O'Malley |
| [HADOOP-134](https://issues.apache.org/jira/browse/HADOOP-134) | JobTracker trapped in a loop if it fails to localize a task | Major | . | Runping Qi | Owen O'Malley |
| [HADOOP-133](https://issues.apache.org/jira/browse/HADOOP-133) | the TaskTracker.Child.ping thread calls exit | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-128](https://issues.apache.org/jira/browse/HADOOP-128) | Failure to replicate dfs block kills client | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-126](https://issues.apache.org/jira/browse/HADOOP-126) | "hadoop dfs -cp" does not copy crc files | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-125](https://issues.apache.org/jira/browse/HADOOP-125) | LocalFileSystem.makeAbsolute bug on Windows | Minor | fs | p sutter | Doug Cutting |
-| [HADOOP-118](https://issues.apache.org/jira/browse/HADOOP-118) | Namenode does not always clean up pendingCreates | Critical | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-117](https://issues.apache.org/jira/browse/HADOOP-117) | mapred temporary files not deleted | Blocker | . | raghavendra prabhu | Doug Cutting |
-| [HADOOP-92](https://issues.apache.org/jira/browse/HADOOP-92) | Error Reporting/logging in MapReduce | Minor | . | Mahadev konar | Mahadev konar |
+| [HADOOP-143](https://issues.apache.org/jira/browse/HADOOP-143) | exception call stacks are word wrapped in webapp | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-151](https://issues.apache.org/jira/browse/HADOOP-151) | RPC code has socket leak? | Major | ipc | p sutter | Doug Cutting |
| [HADOOP-69](https://issues.apache.org/jira/browse/HADOOP-69) | Unchecked lookup value causes NPE in FSNamesystemgetDatanodeHints | Major | . | Bryan Pendleton | |
| [HADOOP-68](https://issues.apache.org/jira/browse/HADOOP-68) | "Cannot abandon block during write to \<file\>" and "Cannot obtain additional block for file \<file\>" errors during dfs write test | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-157](https://issues.apache.org/jira/browse/HADOOP-157) | job fails because pendingCreates is not cleaned up after a task fails | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-162](https://issues.apache.org/jira/browse/HADOOP-162) | concurrent modification exception in FSNamesystem.Lease.releaseLocks | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-160](https://issues.apache.org/jira/browse/HADOOP-160) | sleeping with locks held | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-168](https://issues.apache.org/jira/browse/HADOOP-168) | JobSubmissionProtocol and InterTrackerProtocol don't include "throws IOException" on all methods | Minor | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-169](https://issues.apache.org/jira/browse/HADOOP-169) | a single failure from locateMapOutputs kills the entire job | Critical | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-172](https://issues.apache.org/jira/browse/HADOOP-172) | rpc doesn't handle returning null for a String[] | Blocker | ipc | Owen O'Malley | Owen O'Malley |
+| [HADOOP-174](https://issues.apache.org/jira/browse/HADOOP-174) | jobclient kills job for one timeout | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-183](https://issues.apache.org/jira/browse/HADOOP-183) | adjust file replication factor when loading image and edits according to replication.min and replication.max | Minor | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-137](https://issues.apache.org/jira/browse/HADOOP-137) | Different TaskTrackers may get the same task tracker id, thus cause many problems. | Critical | . | Runping Qi | Owen O'Malley |
+| [HADOOP-186](https://issues.apache.org/jira/browse/HADOOP-186) | communication problems in the task tracker cause long latency | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-188](https://issues.apache.org/jira/browse/HADOOP-188) | more unprotected RPC calls in JobClient.runJob allow loss of job due to timeout | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-185](https://issues.apache.org/jira/browse/HADOOP-185) | tasks are lost during pollForNewTask | Critical | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-190](https://issues.apache.org/jira/browse/HADOOP-190) | Job fails though task succeeded if we fail to exit | Major | . | stack | |
+| [HADOOP-192](https://issues.apache.org/jira/browse/HADOOP-192) | Trivial JRE 1.5 versus 1.4 bug | Blocker | . | David Bowen | |
+| [HADOOP-182](https://issues.apache.org/jira/browse/HADOOP-182) | lost task trackers should not update status of completed jobs | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-63](https://issues.apache.org/jira/browse/HADOOP-63) | problem with webapp when start a jobtracker | Minor | . | Hairong Kuang | Hairong Kuang |
@@ -105,21 +95,9 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-194](https://issues.apache.org/jira/browse/HADOOP-194) | Distributed checkup of the file system consistency. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-193](https://issues.apache.org/jira/browse/HADOOP-193) | DFS i/o benchmark. | Major | fs | Konstantin Shvachko | |
| [HADOOP-187](https://issues.apache.org/jira/browse/HADOOP-187) | simple distributed dfs random data writer & sort example applications | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-184](https://issues.apache.org/jira/browse/HADOOP-184) | hadoop nightly build and regression test on a cluster | Minor | . | Mahadev konar | Mahadev konar |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-193](https://issues.apache.org/jira/browse/HADOOP-193) | DFS i/o benchmark. | Major | fs | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-194](https://issues.apache.org/jira/browse/HADOOP-194) | Distributed checkup of the file system consistency. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.2.1/CHANGES.0.2.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.2.1/CHANGES.0.2.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.2.1/CHANGES.0.2.1.md
index f236e84..42a1a20 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.2.1/CHANGES.0.2.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.2.1/CHANGES.0.2.1.md
@@ -20,54 +20,14 @@
## Release 0.2.1 - 2006-05-12
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-207](https://issues.apache.org/jira/browse/HADOOP-207) | Patch to HADOOP-96 uses long deprecated call | Critical | . | Bryan Pendleton | Hairong Kuang |
-| [HADOOP-201](https://issues.apache.org/jira/browse/HADOOP-201) | hadoop dfs -report throws exception | Minor | . | Johan Oskarsson | Doug Cutting |
| [HADOOP-199](https://issues.apache.org/jira/browse/HADOOP-199) | reduce copy progress not updating | Minor | . | Owen O'Malley | Owen O'Malley |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-201](https://issues.apache.org/jira/browse/HADOOP-201) | hadoop dfs -report throws exception | Minor | . | Johan Oskarsson | Doug Cutting |
+| [HADOOP-207](https://issues.apache.org/jira/browse/HADOOP-207) | Patch to HADOOP-96 uses long deprecated call | Critical | . | Bryan Pendleton | Hairong Kuang |
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[23/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.3/RELEASENOTES.0.23.3.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.3/RELEASENOTES.0.23.3.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.3/RELEASENOTES.0.23.3.md
index 48e4473..23d60eb 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.3/RELEASENOTES.0.23.3.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.3/RELEASENOTES.0.23.3.md
@@ -23,93 +23,93 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-8703](https://issues.apache.org/jira/browse/HADOOP-8703) | *Major* | **distcpV2: turn CRC checking off for 0 byte size**
+* [MAPREDUCE-3348](https://issues.apache.org/jira/browse/MAPREDUCE-3348) | *Major* | **mapred job -status fails to give info even if the job is present in History**
-distcp skips CRC on 0 byte files.
+Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app.
---
-* [HADOOP-8551](https://issues.apache.org/jira/browse/HADOOP-8551) | *Major* | **fs -mkdir creates parent directories without the -p option**
+* [MAPREDUCE-4072](https://issues.apache.org/jira/browse/MAPREDUCE-4072) | *Major* | **User set java.library.path seems to overwrite default creating problems native lib loading**
-FsShell's "mkdir" no longer implicitly creates all non-existent parent directories. The command adopts the posix compliant behavior of requiring the "-p" flag to auto-create parent directories.
+-Djava.library.path in mapred.child.java.opts can cause issues with native libraries. LD\_LIBRARY\_PATH through mapred.child.env should be used instead.
---
-* [HADOOP-8327](https://issues.apache.org/jira/browse/HADOOP-8327) | *Major* | **distcpv2 and distcpv1 jars should not coexist**
+* [MAPREDUCE-4017](https://issues.apache.org/jira/browse/MAPREDUCE-4017) | *Trivial* | **Add jobname to jobsummary log**
-Resolve sporadic distcp issue due to having two DistCp classes (v1 & v2) in the classpath.
+The Job Summary log may contain commas in values that are escaped by a '\\' character. This was true before, but is more likely to be exposed now.
---
-* [HDFS-3318](https://issues.apache.org/jira/browse/HDFS-3318) | *Blocker* | **Hftp hangs on transfers \>2GB**
+* [MAPREDUCE-3812](https://issues.apache.org/jira/browse/MAPREDUCE-3812) | *Major* | **Lower default allocation sizes, fix allocation configurations and document them**
+
+Removes two sets of previously available config properties:
-**WARNING: No release note provided for this incompatible change.**
+1. ( yarn.scheduler.fifo.minimum-allocation-mb and yarn.scheduler.fifo.maximum-allocation-mb ) and,
+2. ( yarn.scheduler.capacity.minimum-allocation-mb and yarn.scheduler.capacity.maximum-allocation-mb )
+In favor of two new, generically named properties:
----
+1. yarn.scheduler.minimum-allocation-mb - This acts as the floor value of memory resource requests for containers.
+2. yarn.scheduler.maximum-allocation-mb - This acts as the ceiling value of memory resource requests for containers.
-* [MAPREDUCE-4311](https://issues.apache.org/jira/browse/MAPREDUCE-4311) | *Major* | **Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings**
+Both these properties need to be set at the ResourceManager (RM) to take effect, as the RM is where the scheduler resides.
-**WARNING: No release note provided for this incompatible change.**
+Also changes the default minimum and maximums to 128 MB and 10 GB respectively.
---
-* [MAPREDUCE-4072](https://issues.apache.org/jira/browse/MAPREDUCE-4072) | *Major* | **User set java.library.path seems to overwrite default creating problems native lib loading**
+* [HDFS-3318](https://issues.apache.org/jira/browse/HDFS-3318) | *Blocker* | **Hftp hangs on transfers \>2GB**
--Djava.library.path in mapred.child.java.opts can cause issues with native libraries. LD\_LIBRARY\_PATH through mapred.child.env should be used instead.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-4017](https://issues.apache.org/jira/browse/MAPREDUCE-4017) | *Trivial* | **Add jobname to jobsummary log**
+* [HADOOP-8327](https://issues.apache.org/jira/browse/HADOOP-8327) | *Major* | **distcpv2 and distcpv1 jars should not coexist**
-The Job Summary log may contain commas in values that are escaped by a '\' character. This was true before, but is more likely to be exposed now.
+Resolve sporadic distcp issue due to having two DistCp classes (v1 & v2) in the classpath.
---
-* [MAPREDUCE-3940](https://issues.apache.org/jira/browse/MAPREDUCE-3940) | *Major* | **ContainerTokens should have an expiry interval**
+* [MAPREDUCE-3543](https://issues.apache.org/jira/browse/MAPREDUCE-3543) | *Critical* | **Mavenize Gridmix.**
-ContainerTokens now have an expiry interval so that stale tokens cannot be used for launching containers.
+Note that to apply this you should first run the script - ./MAPREDUCE-3543v3.sh svn, then apply the patch.
+If this is merged to more then trunk, the version inside of hadoop-tools/hadoop-gridmix/pom.xml will need to be udpated accordingly.
----
-* [MAPREDUCE-3812](https://issues.apache.org/jira/browse/MAPREDUCE-3812) | *Major* | **Lower default allocation sizes, fix allocation configurations and document them**
+---
-Removes two sets of previously available config properties:
+* [MAPREDUCE-4311](https://issues.apache.org/jira/browse/MAPREDUCE-4311) | *Major* | **Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings**
-1. ( yarn.scheduler.fifo.minimum-allocation-mb and yarn.scheduler.fifo.maximum-allocation-mb ) and,
-2. ( yarn.scheduler.capacity.minimum-allocation-mb and yarn.scheduler.capacity.maximum-allocation-mb )
+**WARNING: No release note provided for this change.**
-In favor of two new, generically named properties:
-1. yarn.scheduler.minimum-allocation-mb - This acts as the floor value of memory resource requests for containers.
-2. yarn.scheduler.maximum-allocation-mb - This acts as the ceiling value of memory resource requests for containers.
+---
-Both these properties need to be set at the ResourceManager (RM) to take effect, as the RM is where the scheduler resides.
+* [MAPREDUCE-3940](https://issues.apache.org/jira/browse/MAPREDUCE-3940) | *Major* | **ContainerTokens should have an expiry interval**
-Also changes the default minimum and maximums to 128 MB and 10 GB respectively.
+ContainerTokens now have an expiry interval so that stale tokens cannot be used for launching containers.
---
-* [MAPREDUCE-3543](https://issues.apache.org/jira/browse/MAPREDUCE-3543) | *Critical* | **Mavenize Gridmix.**
-
-Note that to apply this you should first run the script - ./MAPREDUCE-3543v3.sh svn, then apply the patch.
+* [HADOOP-8551](https://issues.apache.org/jira/browse/HADOOP-8551) | *Major* | **fs -mkdir creates parent directories without the -p option**
-If this is merged to more then trunk, the version inside of hadoop-tools/hadoop-gridmix/pom.xml will need to be udpated accordingly.
+FsShell's "mkdir" no longer implicitly creates all non-existent parent directories. The command adopts the posix compliant behavior of requiring the "-p" flag to auto-create parent directories.
---
-* [MAPREDUCE-3348](https://issues.apache.org/jira/browse/MAPREDUCE-3348) | *Major* | **mapred job -status fails to give info even if the job is present in History**
+* [HADOOP-8703](https://issues.apache.org/jira/browse/HADOOP-8703) | *Major* | **distcpV2: turn CRC checking off for 0 byte size**
-Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app.
+distcp skips CRC on 0 byte files.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.4/CHANGES.0.23.4.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.4/CHANGES.0.23.4.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.4/CHANGES.0.23.4.md
index b9b7eee..05fba6f 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.4/CHANGES.0.23.4.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.4/CHANGES.0.23.4.md
@@ -20,16 +20,6 @@
## Release 0.23.4 - 2012-10-15
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
@@ -44,59 +34,41 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8623](https://issues.apache.org/jira/browse/HADOOP-8623) | hadoop jar command should respect HADOOP\_OPTS | Minor | scripts | Steven Willis | Steven Willis |
| [HADOOP-8183](https://issues.apache.org/jira/browse/HADOOP-8183) | Stop using "mapred.used.genericoptionsparser" to avoid unnecessary warnings | Minor | util | Harsh J | Harsh J |
-| [MAPREDUCE-4645](https://issues.apache.org/jira/browse/MAPREDUCE-4645) | Providing a random seed to Slive should make the sequence of filenames completely deterministic | Major | performance, test | Ravi Prakash | Ravi Prakash |
+| [HADOOP-8623](https://issues.apache.org/jira/browse/HADOOP-8623) | hadoop jar command should respect HADOOP\_OPTS | Minor | scripts | Steven Willis | Steven Willis |
| [MAPREDUCE-4408](https://issues.apache.org/jira/browse/MAPREDUCE-4408) | allow jobs to set a JAR that is in the distributed cached | Major | mrv1, mrv2 | Alejandro Abdelnur | Robert Kanter |
| [MAPREDUCE-2786](https://issues.apache.org/jira/browse/MAPREDUCE-2786) | TestDFSIO should also test compression reading/writing from command-line. | Minor | benchmarks | Plamen Jeliazkov | Plamen Jeliazkov |
-| [YARN-137](https://issues.apache.org/jira/browse/YARN-137) | Change the default scheduler to the CapacityScheduler | Major | scheduler | Siddharth Seth | Siddharth Seth |
| [YARN-57](https://issues.apache.org/jira/browse/YARN-57) | Plugable process tree | Major | nodemanager | Radim Kolar | Radim Kolar |
+| [MAPREDUCE-4645](https://issues.apache.org/jira/browse/MAPREDUCE-4645) | Providing a random seed to Slive should make the sequence of filenames completely deterministic | Major | performance, test | Ravi Prakash | Ravi Prakash |
+| [YARN-137](https://issues.apache.org/jira/browse/YARN-137) | Change the default scheduler to the CapacityScheduler | Major | scheduler | Siddharth Seth | Siddharth Seth |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8843](https://issues.apache.org/jira/browse/HADOOP-8843) | Old trash directories are never deleted on upgrade from 1.x | Critical | . | Robert Joseph Evans | Jason Lowe |
-| [HADOOP-8822](https://issues.apache.org/jira/browse/HADOOP-8822) | relnotes.py was deleted post mavenization | Major | . | Robert Joseph Evans | Robert Joseph Evans |
-| [HADOOP-8684](https://issues.apache.org/jira/browse/HADOOP-8684) | Deadlock between WritableComparator and WritableComparable | Minor | io | Hiroshi Ikeda | Jing Zhao |
+| [MAPREDUCE-4193](https://issues.apache.org/jira/browse/MAPREDUCE-4193) | broken doc link for yarn-default.xml in site.xml | Major | documentation | Patrick Hunt | Patrick Hunt |
| [HADOOP-8310](https://issues.apache.org/jira/browse/HADOOP-8310) | FileContext#checkPath should handle URIs with no port | Major | fs | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3922](https://issues.apache.org/jira/browse/HDFS-3922) | 0.22 and 0.23 namenode throws away blocks under construction on restart | Critical | namenode | Kihwal Lee | Kihwal Lee |
| [HDFS-3860](https://issues.apache.org/jira/browse/HDFS-3860) | HeartbeatManager#Monitor may wrongly hold the writelock of namesystem | Major | . | Jing Zhao | Jing Zhao |
+| [HADOOP-8684](https://issues.apache.org/jira/browse/HADOOP-8684) | Deadlock between WritableComparator and WritableComparable | Minor | io | Hiroshi Ikeda | Jing Zhao |
+| [YARN-42](https://issues.apache.org/jira/browse/YARN-42) | Node Manager throws NPE on startup | Major | nodemanager | Devaraj K | Devaraj K |
+| [YARN-75](https://issues.apache.org/jira/browse/YARN-75) | RMContainer should handle a RELEASE event while RUNNING | Major | . | Siddharth Seth | Siddharth Seth |
+| [MAPREDUCE-4646](https://issues.apache.org/jira/browse/MAPREDUCE-4646) | client does not receive job diagnostics for failed jobs | Major | mrv2 | Jason Lowe | Jason Lowe |
+| [YARN-93](https://issues.apache.org/jira/browse/YARN-93) | Diagnostics missing from applications that have finished but failed | Major | resourcemanager | Jason Lowe | Jason Lowe |
+| [YARN-108](https://issues.apache.org/jira/browse/YARN-108) | FSDownload can create cache directories with the wrong permissions | Critical | nodemanager | Jason Lowe | Jason Lowe |
+| [YARN-88](https://issues.apache.org/jira/browse/YARN-88) | DefaultContainerExecutor can fail to set proper permissions | Major | nodemanager | Jason Lowe | Jason Lowe |
+| [HADOOP-8822](https://issues.apache.org/jira/browse/HADOOP-8822) | relnotes.py was deleted post mavenization | Major | . | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4647](https://issues.apache.org/jira/browse/MAPREDUCE-4647) | We should only unjar jobjar if there is a lib directory in it. | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [HADOOP-8843](https://issues.apache.org/jira/browse/HADOOP-8843) | Old trash directories are never deleted on upgrade from 1.x | Critical | . | Robert Joseph Evans | Jason Lowe |
| [HDFS-3831](https://issues.apache.org/jira/browse/HDFS-3831) | Failure to renew tokens due to test-sources left in classpath | Critical | security | Jason Lowe | Jason Lowe |
+| [HDFS-3922](https://issues.apache.org/jira/browse/HDFS-3922) | 0.22 and 0.23 namenode throws away blocks under construction on restart | Critical | namenode | Kihwal Lee | Kihwal Lee |
| [HDFS-3731](https://issues.apache.org/jira/browse/HDFS-3731) | 2.0 release upgrade must handle blocks being written from 1.0 | Blocker | datanode | Suresh Srinivas | Kihwal Lee |
-| [HDFS-3626](https://issues.apache.org/jira/browse/HDFS-3626) | Creating file with invalid path can corrupt edit log | Blocker | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-3553](https://issues.apache.org/jira/browse/HDFS-3553) | Hftp proxy tokens are broken | Blocker | . | Daryn Sharp | Daryn Sharp |
| [HDFS-3373](https://issues.apache.org/jira/browse/HDFS-3373) | FileContext HDFS implementation can leak socket caches | Major | hdfs-client | Todd Lipcon | John George |
+| [YARN-106](https://issues.apache.org/jira/browse/YARN-106) | Nodemanager needs to set permissions of local directories | Major | nodemanager | Jason Lowe | Jason Lowe |
| [MAPREDUCE-4691](https://issues.apache.org/jira/browse/MAPREDUCE-4691) | Historyserver can report "Unknown job" after RM says job has completed | Critical | jobhistoryserver, mrv2 | Jason Lowe | Robert Joseph Evans |
| [MAPREDUCE-4689](https://issues.apache.org/jira/browse/MAPREDUCE-4689) | JobClient.getMapTaskReports on failed job results in NPE | Major | client | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4647](https://issues.apache.org/jira/browse/MAPREDUCE-4647) | We should only unjar jobjar if there is a lib directory in it. | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4646](https://issues.apache.org/jira/browse/MAPREDUCE-4646) | client does not receive job diagnostics for failed jobs | Major | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4193](https://issues.apache.org/jira/browse/MAPREDUCE-4193) | broken doc link for yarn-default.xml in site.xml | Major | documentation | Patrick Hunt | Patrick Hunt |
| [YARN-138](https://issues.apache.org/jira/browse/YARN-138) | Improve default config values for YARN | Major | resourcemanager, scheduler | Arun C Murthy | Harsh J |
-| [YARN-108](https://issues.apache.org/jira/browse/YARN-108) | FSDownload can create cache directories with the wrong permissions | Critical | nodemanager | Jason Lowe | Jason Lowe |
-| [YARN-106](https://issues.apache.org/jira/browse/YARN-106) | Nodemanager needs to set permissions of local directories | Major | nodemanager | Jason Lowe | Jason Lowe |
-| [YARN-93](https://issues.apache.org/jira/browse/YARN-93) | Diagnostics missing from applications that have finished but failed | Major | resourcemanager | Jason Lowe | Jason Lowe |
-| [YARN-88](https://issues.apache.org/jira/browse/YARN-88) | DefaultContainerExecutor can fail to set proper permissions | Major | nodemanager | Jason Lowe | Jason Lowe |
-| [YARN-75](https://issues.apache.org/jira/browse/YARN-75) | RMContainer should handle a RELEASE event while RUNNING | Major | . | Siddharth Seth | Siddharth Seth |
-| [YARN-42](https://issues.apache.org/jira/browse/YARN-42) | Node Manager throws NPE on startup | Major | nodemanager | Devaraj K | Devaraj K |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-3626](https://issues.apache.org/jira/browse/HDFS-3626) | Creating file with invalid path can corrupt edit log | Blocker | namenode | Todd Lipcon | Todd Lipcon |
+| [HDFS-3553](https://issues.apache.org/jira/browse/HDFS-3553) | Hftp proxy tokens are broken | Blocker | . | Daryn Sharp | Daryn Sharp |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.5/CHANGES.0.23.5.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.5/CHANGES.0.23.5.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.5/CHANGES.0.23.5.md
index 0e76124..d21e0da 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.5/CHANGES.0.23.5.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.5/CHANGES.0.23.5.md
@@ -27,124 +27,106 @@
| [HDFS-4080](https://issues.apache.org/jira/browse/HDFS-4080) | Add a separate logger for block state change logs to enable turning off those logs | Major | namenode | Kihwal Lee | Kihwal Lee |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8932](https://issues.apache.org/jira/browse/HADOOP-8932) | JNI-based user-group mapping modules can be too chatty on lookup failures | Major | security | Kihwal Lee | Kihwal Lee |
-| [HADOOP-8930](https://issues.apache.org/jira/browse/HADOOP-8930) | Cumulative code coverage calculation | Major | test | Andrey Klochkov | Andrey Klochkov |
-| [HADOOP-8926](https://issues.apache.org/jira/browse/HADOOP-8926) | hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data | Major | util | Gopal V | Gopal V |
-| [HADOOP-8889](https://issues.apache.org/jira/browse/HADOOP-8889) | Upgrade to Surefire 2.12.3 | Major | build, test | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8851](https://issues.apache.org/jira/browse/HADOOP-8851) | Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests | Minor | test | Ivan A. Veselovsky | Ivan A. Veselovsky |
| [HADOOP-8789](https://issues.apache.org/jira/browse/HADOOP-8789) | Tests setLevel(Level.OFF) should be Level.ERROR | Minor | test | Andy Isaacson | Andy Isaacson |
| [HADOOP-8755](https://issues.apache.org/jira/browse/HADOOP-8755) | Print thread dump when tests fail due to timeout | Major | test | Andrey Klochkov | Andrey Klochkov |
+| [HADOOP-8851](https://issues.apache.org/jira/browse/HADOOP-8851) | Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests | Minor | test | Ivan A. Veselovsky | Ivan A. Veselovsky |
| [HDFS-3483](https://issues.apache.org/jira/browse/HDFS-3483) | Better error message when hdfs fsck is run against a ViewFS config | Major | . | Stephen Chu | Stephen Fritz |
-| [MAPREDUCE-4802](https://issues.apache.org/jira/browse/MAPREDUCE-4802) | Takes a long time to load the task list on the AM for large jobs | Major | mr-am, mrv2, webapps | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-4763](https://issues.apache.org/jira/browse/MAPREDUCE-4763) | repair test org.apache.hadoop.mapreduce.security.TestUmbilicalProtocolWithJobToken | Minor | . | Ivan A. Veselovsky | |
+| [HADOOP-8889](https://issues.apache.org/jira/browse/HADOOP-8889) | Upgrade to Surefire 2.12.3 | Major | build, test | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8932](https://issues.apache.org/jira/browse/HADOOP-8932) | JNI-based user-group mapping modules can be too chatty on lookup failures | Major | security | Kihwal Lee | Kihwal Lee |
+| [HADOOP-8926](https://issues.apache.org/jira/browse/HADOOP-8926) | hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data | Major | util | Gopal V | Gopal V |
+| [HADOOP-8930](https://issues.apache.org/jira/browse/HADOOP-8930) | Cumulative code coverage calculation | Major | test | Andrey Klochkov | Andrey Klochkov |
+| [MAPREDUCE-4229](https://issues.apache.org/jira/browse/MAPREDUCE-4229) | Counter names' memory usage can be decreased by interning | Major | jobtracker | Todd Lipcon | Miomir Boljanovic |
| [MAPREDUCE-4752](https://issues.apache.org/jira/browse/MAPREDUCE-4752) | Reduce MR AM memory usage through String Interning | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [YARN-165](https://issues.apache.org/jira/browse/YARN-165) | RM should point tracking URL to RM web page for app when AM fails | Blocker | resourcemanager | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4763](https://issues.apache.org/jira/browse/MAPREDUCE-4763) | repair test org.apache.hadoop.mapreduce.security.TestUmbilicalProtocolWithJobToken | Minor | . | Ivan A. Veselovsky | |
| [MAPREDUCE-4666](https://issues.apache.org/jira/browse/MAPREDUCE-4666) | JVM metrics for history server | Minor | jobhistoryserver | Jason Lowe | Jason Lowe |
| [MAPREDUCE-4517](https://issues.apache.org/jira/browse/MAPREDUCE-4517) | Too many INFO messages written out during AM to RM heartbeat | Minor | applicationmaster | James Kinley | Jason Lowe |
-| [MAPREDUCE-4229](https://issues.apache.org/jira/browse/MAPREDUCE-4229) | Counter names' memory usage can be decreased by interning | Major | jobtracker | Todd Lipcon | Miomir Boljanovic |
| [YARN-216](https://issues.apache.org/jira/browse/YARN-216) | Remove jquery theming support | Major | . | Todd Lipcon | Robert Joseph Evans |
-| [YARN-165](https://issues.apache.org/jira/browse/YARN-165) | RM should point tracking URL to RM web page for app when AM fails | Blocker | resourcemanager | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4802](https://issues.apache.org/jira/browse/MAPREDUCE-4802) | Takes a long time to load the task list on the AM for large jobs | Major | mr-am, mrv2, webapps | Ravi Prakash | Ravi Prakash |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9025](https://issues.apache.org/jira/browse/HADOOP-9025) | org.apache.hadoop.tools.TestCopyListing failing | Major | . | Robert Joseph Evans | Jonathan Eagles |
-| [HADOOP-9022](https://issues.apache.org/jira/browse/HADOOP-9022) | Hadoop distcp tool fails to copy file if -m 0 specified | Major | . | Haiyang Jiang | Jonathan Eagles |
-| [HADOOP-8986](https://issues.apache.org/jira/browse/HADOOP-8986) | Server$Call object is never released after it is sent | Critical | ipc | Robert Joseph Evans | Robert Joseph Evans |
-| [HADOOP-8962](https://issues.apache.org/jira/browse/HADOOP-8962) | RawLocalFileSystem.listStatus fails when a child filename contains a colon | Critical | fs | Jason Lowe | Jason Lowe |
-| [HADOOP-8906](https://issues.apache.org/jira/browse/HADOOP-8906) | paths with multiple globs are unreliable | Critical | fs | Daryn Sharp | Daryn Sharp |
+| [HADOOP-8775](https://issues.apache.org/jira/browse/HADOOP-8775) | MR2 distcp permits non-positive value to -bandwidth option which causes job never to complete | Major | . | Sandy Ryza | Sandy Ryza |
+| [HDFS-3919](https://issues.apache.org/jira/browse/HDFS-3919) | MiniDFSCluster:waitClusterUp can hang forever | Minor | test | Andy Isaacson | Andy Isaacson |
| [HADOOP-8819](https://issues.apache.org/jira/browse/HADOOP-8819) | Should use && instead of & in a few places in FTPFileSystem,FTPInputStream,S3InputStream,ViewFileSystem,ViewFs | Major | fs | Brandon Li | Brandon Li |
+| [YARN-28](https://issues.apache.org/jira/browse/YARN-28) | TestCompositeService fails on jdk7 | Major | . | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4674](https://issues.apache.org/jira/browse/MAPREDUCE-4674) | Hadoop examples secondarysort has a typo "secondarysrot" in the usage | Minor | . | Robert Justice | Robert Justice |
| [HADOOP-8791](https://issues.apache.org/jira/browse/HADOOP-8791) | rm "Only deletes non empty directory and files." | Major | documentation | Bertrand Dechoux | Jing Zhao |
-| [HADOOP-8775](https://issues.apache.org/jira/browse/HADOOP-8775) | MR2 distcp permits non-positive value to -bandwidth option which causes job never to complete | Major | . | Sandy Ryza | Sandy Ryza |
| [HADOOP-8386](https://issues.apache.org/jira/browse/HADOOP-8386) | hadoop script doesn't work if 'cd' prints to stdout (default behavior in Ubuntu) | Major | scripts | Christopher Berner | Christopher Berner |
-| [HDFS-4186](https://issues.apache.org/jira/browse/HDFS-4186) | logSync() is called with the write lock held while releasing lease | Critical | namenode | Kihwal Lee | Kihwal Lee |
-| [HDFS-4182](https://issues.apache.org/jira/browse/HDFS-4182) | SecondaryNameNode leaks NameCache entries | Critical | namenode | Todd Lipcon | Robert Joseph Evans |
-| [HDFS-4181](https://issues.apache.org/jira/browse/HDFS-4181) | LeaseManager tries to double remove and prints extra messages | Critical | namenode | Kihwal Lee | Kihwal Lee |
-| [HDFS-4172](https://issues.apache.org/jira/browse/HDFS-4172) | namenode does not URI-encode parameters when building URI for datanode request | Minor | namenode | Derek Dagit | Derek Dagit |
-| [HDFS-4162](https://issues.apache.org/jira/browse/HDFS-4162) | Some malformed and unquoted HTML strings are returned from datanode web ui | Minor | datanode | Derek Dagit | Derek Dagit |
-| [HDFS-4090](https://issues.apache.org/jira/browse/HDFS-4090) | getFileChecksum() result incompatible when called against zero-byte files. | Critical | hdfs-client | Kihwal Lee | Kihwal Lee |
-| [HDFS-4075](https://issues.apache.org/jira/browse/HDFS-4075) | Reduce recommissioning overhead | Critical | namenode | Kihwal Lee | Kihwal Lee |
-| [HDFS-4016](https://issues.apache.org/jira/browse/HDFS-4016) | back-port HDFS-3582 to branch-0.23 | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
-| [HDFS-3996](https://issues.apache.org/jira/browse/HDFS-3996) | Add debug log removed in HDFS-3873 back | Minor | . | Eli Collins | Eli Collins |
-| [HDFS-3990](https://issues.apache.org/jira/browse/HDFS-3990) | NN's health report has severe performance problems | Critical | namenode | Daryn Sharp | Daryn Sharp |
-| [HDFS-3919](https://issues.apache.org/jira/browse/HDFS-3919) | MiniDFSCluster:waitClusterUp can hang forever | Minor | test | Andy Isaacson | Andy Isaacson |
+| [YARN-116](https://issues.apache.org/jira/browse/YARN-116) | RM is missing ability to add include/exclude files without a restart | Major | resourcemanager | xieguiming | xieguiming |
+| [YARN-131](https://issues.apache.org/jira/browse/YARN-131) | Incorrect ACL properties in capacity scheduler documentation | Major | capacityscheduler | Ahmed Radwan | Ahmed Radwan |
| [HDFS-3905](https://issues.apache.org/jira/browse/HDFS-3905) | Secure cluster cannot use hftp to an insecure cluster | Critical | hdfs-client, security | Daryn Sharp | Daryn Sharp |
+| [YARN-102](https://issues.apache.org/jira/browse/YARN-102) | Move the apache licence header to the top of the file in MemStore.java | Trivial | resourcemanager | Devaraj K | Devaraj K |
+| [HDFS-3996](https://issues.apache.org/jira/browse/HDFS-3996) | Add debug log removed in HDFS-3873 back | Minor | . | Eli Collins | Eli Collins |
| [HDFS-3829](https://issues.apache.org/jira/browse/HDFS-3829) | TestHftpURLTimeouts fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
+| [MAPREDUCE-4554](https://issues.apache.org/jira/browse/MAPREDUCE-4554) | Job Credentials are not transmitted if security is turned off | Major | job submission, security | Benoy Antony | Benoy Antony |
+| [MAPREDUCE-4705](https://issues.apache.org/jira/browse/MAPREDUCE-4705) | Historyserver links expire before the history data does | Critical | jobhistoryserver, mrv2 | Jason Lowe | Jason Lowe |
+| [YARN-30](https://issues.apache.org/jira/browse/YARN-30) | TestNMWebServicesApps, TestRMWebServicesApps and TestRMWebServicesNodes fail on jdk7 | Major | . | Thomas Graves | Thomas Graves |
| [HDFS-3824](https://issues.apache.org/jira/browse/HDFS-3824) | TestHftpDelegationToken fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
| [HDFS-3224](https://issues.apache.org/jira/browse/HDFS-3224) | Bug in check for DN re-registration with different storage ID | Minor | . | Eli Collins | Jason Lowe |
-| [MAPREDUCE-4801](https://issues.apache.org/jira/browse/MAPREDUCE-4801) | ShuffleHandler can generate large logs due to prematurely closed channels | Critical | . | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4797](https://issues.apache.org/jira/browse/MAPREDUCE-4797) | LocalContainerAllocator can loop forever trying to contact the RM | Major | applicationmaster | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4787](https://issues.apache.org/jira/browse/MAPREDUCE-4787) | TestJobMonitorAndPrint is broken | Major | test | Ravi Prakash | Robert Parker |
-| [MAPREDUCE-4786](https://issues.apache.org/jira/browse/MAPREDUCE-4786) | Job End Notification retry interval is 5 milliseconds by default | Major | mrv2 | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-4782](https://issues.apache.org/jira/browse/MAPREDUCE-4782) | NLineInputFormat skips first line of last InputSplit | Blocker | client | Mark Fuhs | Mark Fuhs |
-| [MAPREDUCE-4774](https://issues.apache.org/jira/browse/MAPREDUCE-4774) | JobImpl does not handle asynchronous task events in FAILED state | Major | applicationmaster, mrv2 | Ivan A. Veselovsky | Jason Lowe |
-| [MAPREDUCE-4772](https://issues.apache.org/jira/browse/MAPREDUCE-4772) | Fetch failures can take way too long for a map to be restarted | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4771](https://issues.apache.org/jira/browse/MAPREDUCE-4771) | KeyFieldBasedPartitioner not partitioning properly when configured | Major | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4751](https://issues.apache.org/jira/browse/MAPREDUCE-4751) | AM stuck in KILL\_WAIT for days | Major | . | Ravi Prakash | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-4748](https://issues.apache.org/jira/browse/MAPREDUCE-4748) | Invalid event: T\_ATTEMPT\_SUCCEEDED at SUCCEEDED | Blocker | mrv2 | Robert Joseph Evans | Jason Lowe |
-| [MAPREDUCE-4746](https://issues.apache.org/jira/browse/MAPREDUCE-4746) | The MR Application Master does not have a config to set environment variables | Major | applicationmaster | Robert Parker | Robert Parker |
-| [MAPREDUCE-4741](https://issues.apache.org/jira/browse/MAPREDUCE-4741) | WARN and ERROR messages logged during normal AM shutdown | Minor | applicationmaster, mrv2 | Jason Lowe | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-4740](https://issues.apache.org/jira/browse/MAPREDUCE-4740) | only .jars can be added to the Distributed Cache classpath | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [HADOOP-8906](https://issues.apache.org/jira/browse/HADOOP-8906) | paths with multiple globs are unreliable | Critical | fs | Daryn Sharp | Daryn Sharp |
+| [HDFS-4016](https://issues.apache.org/jira/browse/HDFS-4016) | back-port HDFS-3582 to branch-0.23 | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
+| [MAPREDUCE-4521](https://issues.apache.org/jira/browse/MAPREDUCE-4521) | mapreduce.user.classpath.first incompatibility with 0.20/1.x | Major | mrv2 | Jason Lowe | Ravi Prakash |
+| [YARN-161](https://issues.apache.org/jira/browse/YARN-161) | Yarn Common has multiple compiler warnings for unchecked operations | Major | api | Chris Nauroth | Chris Nauroth |
+| [YARN-43](https://issues.apache.org/jira/browse/YARN-43) | TestResourceTrackerService fail intermittently on jdk7 | Major | . | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4721](https://issues.apache.org/jira/browse/MAPREDUCE-4721) | Task startup time in JHS is same as job startup time. | Major | jobhistoryserver | Ravi Prakash | Ravi Prakash |
+| [YARN-32](https://issues.apache.org/jira/browse/YARN-32) | TestApplicationTokens fails intermintently on jdk7 | Major | . | Thomas Graves | Vinod Kumar Vavilapalli |
+| [YARN-163](https://issues.apache.org/jira/browse/YARN-163) | Retrieving container log via NM webapp can hang with multibyte characters in log | Major | nodemanager | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4479](https://issues.apache.org/jira/browse/MAPREDUCE-4479) | Fix parameter order in assertEquals() in TestCombineInputFileFormat.java | Major | test | Mariappan Asokan | Mariappan Asokan |
| [MAPREDUCE-4733](https://issues.apache.org/jira/browse/MAPREDUCE-4733) | Reducer can fail to make progress during shuffle if too many reducers complete consecutively | Major | applicationmaster, mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4740](https://issues.apache.org/jira/browse/MAPREDUCE-4740) | only .jars can be added to the Distributed Cache classpath | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [YARN-174](https://issues.apache.org/jira/browse/YARN-174) | TestNodeStatusUpdater is failing in trunk | Major | nodemanager | Robert Joseph Evans | Vinod Kumar Vavilapalli |
+| [HDFS-4090](https://issues.apache.org/jira/browse/HDFS-4090) | getFileChecksum() result incompatible when called against zero-byte files. | Critical | hdfs-client | Kihwal Lee | Kihwal Lee |
+| [HADOOP-8962](https://issues.apache.org/jira/browse/HADOOP-8962) | RawLocalFileSystem.listStatus fails when a child filename contains a colon | Critical | fs | Jason Lowe | Jason Lowe |
+| [YARN-177](https://issues.apache.org/jira/browse/YARN-177) | CapacityScheduler - adding a queue while the RM is running has wacky results | Critical | capacityscheduler | Thomas Graves | Arun C Murthy |
+| [YARN-178](https://issues.apache.org/jira/browse/YARN-178) | Fix custom ProcessTree instance creation | Critical | . | Radim Kolar | Radim Kolar |
+| [YARN-180](https://issues.apache.org/jira/browse/YARN-180) | Capacity scheduler - containers that get reserved create container token to early | Critical | capacityscheduler | Thomas Graves | Arun C Murthy |
+| [YARN-139](https://issues.apache.org/jira/browse/YARN-139) | Interrupted Exception within AsyncDispatcher leads to user confusion | Major | api | Nathan Roberts | Vinod Kumar Vavilapalli |
+| [MAPREDUCE-4741](https://issues.apache.org/jira/browse/MAPREDUCE-4741) | WARN and ERROR messages logged during normal AM shutdown | Minor | applicationmaster, mrv2 | Jason Lowe | Vinod Kumar Vavilapalli |
| [MAPREDUCE-4730](https://issues.apache.org/jira/browse/MAPREDUCE-4730) | AM crashes due to OOM while serving up map task completion events | Blocker | applicationmaster, mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4729](https://issues.apache.org/jira/browse/MAPREDUCE-4729) | job history UI not showing all job attempts | Major | jobhistoryserver | Thomas Graves | Vinod Kumar Vavilapalli |
+| [MAPREDUCE-4748](https://issues.apache.org/jira/browse/MAPREDUCE-4748) | Invalid event: T\_ATTEMPT\_SUCCEEDED at SUCCEEDED | Blocker | mrv2 | Robert Joseph Evans | Jason Lowe |
+| [MAPREDUCE-1806](https://issues.apache.org/jira/browse/MAPREDUCE-1806) | CombineFileInputFormat does not work with paths not on default FS | Major | harchive | Paul Yang | Gera Shegalov |
+| [HADOOP-8986](https://issues.apache.org/jira/browse/HADOOP-8986) | Server$Call object is never released after it is sent | Critical | ipc | Robert Joseph Evans | Robert Joseph Evans |
+| [YARN-159](https://issues.apache.org/jira/browse/YARN-159) | RM web ui applications page should be sorted to display last app first | Major | resourcemanager | Thomas Graves | Thomas Graves |
+| [YARN-166](https://issues.apache.org/jira/browse/YARN-166) | capacity scheduler doesn't allow capacity \< 1.0 | Major | capacityscheduler | Thomas Graves | Thomas Graves |
| [MAPREDUCE-4724](https://issues.apache.org/jira/browse/MAPREDUCE-4724) | job history web ui applications page should be sorted to display last app first | Major | jobhistoryserver | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4721](https://issues.apache.org/jira/browse/MAPREDUCE-4721) | Task startup time in JHS is same as job startup time. | Major | jobhistoryserver | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-4720](https://issues.apache.org/jira/browse/MAPREDUCE-4720) | Browser thinks History Server main page JS is taking too long | Major | . | Robert Joseph Evans | Ravi Prakash |
-| [MAPREDUCE-4705](https://issues.apache.org/jira/browse/MAPREDUCE-4705) | Historyserver links expire before the history data does | Critical | jobhistoryserver, mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4674](https://issues.apache.org/jira/browse/MAPREDUCE-4674) | Hadoop examples secondarysort has a typo "secondarysrot" in the usage | Minor | . | Robert Justice | Robert Justice |
-| [MAPREDUCE-4554](https://issues.apache.org/jira/browse/MAPREDUCE-4554) | Job Credentials are not transmitted if security is turned off | Major | job submission, security | Benoy Antony | Benoy Antony |
-| [MAPREDUCE-4549](https://issues.apache.org/jira/browse/MAPREDUCE-4549) | Distributed cache conflicts breaks backwards compatability | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4521](https://issues.apache.org/jira/browse/MAPREDUCE-4521) | mapreduce.user.classpath.first incompatibility with 0.20/1.x | Major | mrv2 | Jason Lowe | Ravi Prakash |
-| [MAPREDUCE-4479](https://issues.apache.org/jira/browse/MAPREDUCE-4479) | Fix parameter order in assertEquals() in TestCombineInputFileFormat.java | Major | test | Mariappan Asokan | Mariappan Asokan |
+| [YARN-189](https://issues.apache.org/jira/browse/YARN-189) | deadlock in RM - AMResponse object | Blocker | resourcemanager | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4746](https://issues.apache.org/jira/browse/MAPREDUCE-4746) | The MR Application Master does not have a config to set environment variables | Major | applicationmaster | Robert Parker | Robert Parker |
+| [MAPREDUCE-4729](https://issues.apache.org/jira/browse/MAPREDUCE-4729) | job history UI not showing all job attempts | Major | jobhistoryserver | Thomas Graves | Vinod Kumar Vavilapalli |
+| [MAPREDUCE-4771](https://issues.apache.org/jira/browse/MAPREDUCE-4771) | KeyFieldBasedPartitioner not partitioning properly when configured | Major | mrv2 | Jason Lowe | Jason Lowe |
+| [HDFS-4075](https://issues.apache.org/jira/browse/HDFS-4075) | Reduce recommissioning overhead | Critical | namenode | Kihwal Lee | Kihwal Lee |
+| [YARN-201](https://issues.apache.org/jira/browse/YARN-201) | CapacityScheduler can take a very long time to schedule containers if requests are off cluster | Critical | capacityscheduler | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4772](https://issues.apache.org/jira/browse/MAPREDUCE-4772) | Fetch failures can take way too long for a map to be restarted | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [HDFS-3990](https://issues.apache.org/jira/browse/HDFS-3990) | NN's health report has severe performance problems | Critical | namenode | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4782](https://issues.apache.org/jira/browse/MAPREDUCE-4782) | NLineInputFormat skips first line of last InputSplit | Blocker | client | Mark Fuhs | Mark Fuhs |
+| [HDFS-4162](https://issues.apache.org/jira/browse/HDFS-4162) | Some malformed and unquoted HTML strings are returned from datanode web ui | Minor | datanode | Derek Dagit | Derek Dagit |
+| [MAPREDUCE-4774](https://issues.apache.org/jira/browse/MAPREDUCE-4774) | JobImpl does not handle asynchronous task events in FAILED state | Major | applicationmaster, mrv2 | Ivan A. Veselovsky | Jason Lowe |
+| [YARN-206](https://issues.apache.org/jira/browse/YARN-206) | TestApplicationCleanup.testContainerCleanup occasionally fails | Major | resourcemanager | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4751](https://issues.apache.org/jira/browse/MAPREDUCE-4751) | AM stuck in KILL\_WAIT for days | Major | . | Ravi Prakash | Vinod Kumar Vavilapalli |
+| [MAPREDUCE-4787](https://issues.apache.org/jira/browse/MAPREDUCE-4787) | TestJobMonitorAndPrint is broken | Major | test | Ravi Prakash | Robert Parker |
+| [HDFS-4172](https://issues.apache.org/jira/browse/HDFS-4172) | namenode does not URI-encode parameters when building URI for datanode request | Minor | namenode | Derek Dagit | Derek Dagit |
| [MAPREDUCE-4425](https://issues.apache.org/jira/browse/MAPREDUCE-4425) | Speculation + Fetch failures can lead to a hung job | Critical | mrv2 | Siddharth Seth | Jason Lowe |
-| [MAPREDUCE-1806](https://issues.apache.org/jira/browse/MAPREDUCE-1806) | CombineFileInputFormat does not work with paths not on default FS | Major | harchive | Paul Yang | Gera Shegalov |
-| [YARN-214](https://issues.apache.org/jira/browse/YARN-214) | RMContainerImpl does not handle event EXPIRE at state RUNNING | Major | resourcemanager | Jason Lowe | Jonathan Eagles |
+| [MAPREDUCE-4786](https://issues.apache.org/jira/browse/MAPREDUCE-4786) | Job End Notification retry interval is 5 milliseconds by default | Major | mrv2 | Ravi Prakash | Ravi Prakash |
+| [HADOOP-9022](https://issues.apache.org/jira/browse/HADOOP-9022) | Hadoop distcp tool fails to copy file if -m 0 specified | Major | . | Haiyang Jiang | Jonathan Eagles |
+| [HADOOP-9025](https://issues.apache.org/jira/browse/HADOOP-9025) | org.apache.hadoop.tools.TestCopyListing failing | Major | . | Robert Joseph Evans | Jonathan Eagles |
+| [HDFS-4181](https://issues.apache.org/jira/browse/HDFS-4181) | LeaseManager tries to double remove and prints extra messages | Critical | namenode | Kihwal Lee | Kihwal Lee |
| [YARN-212](https://issues.apache.org/jira/browse/YARN-212) | NM state machine ignores an APPLICATION\_CONTAINER\_FINISHED event when it shouldn't | Blocker | nodemanager | Nathan Roberts | Nathan Roberts |
-| [YARN-206](https://issues.apache.org/jira/browse/YARN-206) | TestApplicationCleanup.testContainerCleanup occasionally fails | Major | resourcemanager | Jason Lowe | Jason Lowe |
-| [YARN-201](https://issues.apache.org/jira/browse/YARN-201) | CapacityScheduler can take a very long time to schedule containers if requests are off cluster | Critical | capacityscheduler | Jason Lowe | Jason Lowe |
-| [YARN-189](https://issues.apache.org/jira/browse/YARN-189) | deadlock in RM - AMResponse object | Blocker | resourcemanager | Thomas Graves | Thomas Graves |
-| [YARN-180](https://issues.apache.org/jira/browse/YARN-180) | Capacity scheduler - containers that get reserved create container token to early | Critical | capacityscheduler | Thomas Graves | Arun C Murthy |
-| [YARN-178](https://issues.apache.org/jira/browse/YARN-178) | Fix custom ProcessTree instance creation | Critical | . | Radim Kolar | Radim Kolar |
-| [YARN-177](https://issues.apache.org/jira/browse/YARN-177) | CapacityScheduler - adding a queue while the RM is running has wacky results | Critical | capacityscheduler | Thomas Graves | Arun C Murthy |
-| [YARN-174](https://issues.apache.org/jira/browse/YARN-174) | TestNodeStatusUpdater is failing in trunk | Major | nodemanager | Robert Joseph Evans | Vinod Kumar Vavilapalli |
-| [YARN-166](https://issues.apache.org/jira/browse/YARN-166) | capacity scheduler doesn't allow capacity \< 1.0 | Major | capacityscheduler | Thomas Graves | Thomas Graves |
-| [YARN-163](https://issues.apache.org/jira/browse/YARN-163) | Retrieving container log via NM webapp can hang with multibyte characters in log | Major | nodemanager | Jason Lowe | Jason Lowe |
-| [YARN-161](https://issues.apache.org/jira/browse/YARN-161) | Yarn Common has multiple compiler warnings for unchecked operations | Major | api | Chris Nauroth | Chris Nauroth |
-| [YARN-159](https://issues.apache.org/jira/browse/YARN-159) | RM web ui applications page should be sorted to display last app first | Major | resourcemanager | Thomas Graves | Thomas Graves |
-| [YARN-151](https://issues.apache.org/jira/browse/YARN-151) | Browser thinks RM main page JS is taking too long | Major | . | Robert Joseph Evans | Ravi Prakash |
| [YARN-144](https://issues.apache.org/jira/browse/YARN-144) | MiniMRYarnCluster launches RM and JHS on default ports | Major | . | Robert Parker | Robert Parker |
-| [YARN-139](https://issues.apache.org/jira/browse/YARN-139) | Interrupted Exception within AsyncDispatcher leads to user confusion | Major | api | Nathan Roberts | Vinod Kumar Vavilapalli |
-| [YARN-131](https://issues.apache.org/jira/browse/YARN-131) | Incorrect ACL properties in capacity scheduler documentation | Major | capacityscheduler | Ahmed Radwan | Ahmed Radwan |
-| [YARN-116](https://issues.apache.org/jira/browse/YARN-116) | RM is missing ability to add include/exclude files without a restart | Major | resourcemanager | xieguiming | xieguiming |
-| [YARN-102](https://issues.apache.org/jira/browse/YARN-102) | Move the apache licence header to the top of the file in MemStore.java | Trivial | resourcemanager | Devaraj K | Devaraj K |
-| [YARN-43](https://issues.apache.org/jira/browse/YARN-43) | TestResourceTrackerService fail intermittently on jdk7 | Major | . | Thomas Graves | Thomas Graves |
-| [YARN-32](https://issues.apache.org/jira/browse/YARN-32) | TestApplicationTokens fails intermintently on jdk7 | Major | . | Thomas Graves | Vinod Kumar Vavilapalli |
-| [YARN-30](https://issues.apache.org/jira/browse/YARN-30) | TestNMWebServicesApps, TestRMWebServicesApps and TestRMWebServicesNodes fail on jdk7 | Major | . | Thomas Graves | Thomas Graves |
-| [YARN-28](https://issues.apache.org/jira/browse/YARN-28) | TestCompositeService fails on jdk7 | Major | . | Thomas Graves | Thomas Graves |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-4182](https://issues.apache.org/jira/browse/HDFS-4182) | SecondaryNameNode leaks NameCache entries | Critical | namenode | Todd Lipcon | Robert Joseph Evans |
+| [MAPREDUCE-4797](https://issues.apache.org/jira/browse/MAPREDUCE-4797) | LocalContainerAllocator can loop forever trying to contact the RM | Major | applicationmaster | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4720](https://issues.apache.org/jira/browse/MAPREDUCE-4720) | Browser thinks History Server main page JS is taking too long | Major | . | Robert Joseph Evans | Ravi Prakash |
+| [HDFS-4186](https://issues.apache.org/jira/browse/HDFS-4186) | logSync() is called with the write lock held while releasing lease | Critical | namenode | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-4801](https://issues.apache.org/jira/browse/MAPREDUCE-4801) | ShuffleHandler can generate large logs due to prematurely closed channels | Critical | . | Jason Lowe | Jason Lowe |
+| [YARN-214](https://issues.apache.org/jira/browse/YARN-214) | RMContainerImpl does not handle event EXPIRE at state RUNNING | Major | resourcemanager | Jason Lowe | Jonathan Eagles |
+| [YARN-151](https://issues.apache.org/jira/browse/YARN-151) | Browser thinks RM main page JS is taking too long | Major | . | Robert Joseph Evans | Ravi Prakash |
+| [MAPREDUCE-4549](https://issues.apache.org/jira/browse/MAPREDUCE-4549) | Distributed cache conflicts breaks backwards compatability | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
### SUB-TASKS:
@@ -152,19 +134,19 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
| [MAPREDUCE-4107](https://issues.apache.org/jira/browse/MAPREDUCE-4107) | Fix tests in org.apache.hadoop.ipc.TestSocketFactory | Major | mrv2 | Devaraj K | Devaraj K |
-| [YARN-219](https://issues.apache.org/jira/browse/YARN-219) | NM should aggregate logs when application finishes. | Critical | nodemanager | Robert Joseph Evans | Robert Joseph Evans |
| [YARN-202](https://issues.apache.org/jira/browse/YARN-202) | Log Aggregation generates a storm of fsync() for namenode | Critical | . | Kihwal Lee | Kihwal Lee |
-| [YARN-188](https://issues.apache.org/jira/browse/YARN-188) | Coverage fixing for CapacityScheduler | Major | capacityscheduler | Aleksey Gorshkov | Aleksey Gorshkov |
| [YARN-186](https://issues.apache.org/jira/browse/YARN-186) | Coverage fixing LinuxContainerExecutor | Major | resourcemanager, scheduler | Aleksey Gorshkov | Aleksey Gorshkov |
+| [YARN-188](https://issues.apache.org/jira/browse/YARN-188) | Coverage fixing for CapacityScheduler | Major | capacityscheduler | Aleksey Gorshkov | Aleksey Gorshkov |
+| [YARN-219](https://issues.apache.org/jira/browse/YARN-219) | NM should aggregate logs when application finishes. | Critical | nodemanager | Robert Joseph Evans | Robert Joseph Evans |
### OTHER:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8860](https://issues.apache.org/jira/browse/HADOOP-8860) | Split MapReduce and YARN sections in documentation navigation | Major | documentation | Tom White | Tom White |
| [MAPREDUCE-4596](https://issues.apache.org/jira/browse/MAPREDUCE-4596) | Split StateMachine state from states seen by MRClientProtocol (for Job, Task, TaskAttempt) | Major | applicationmaster, mrv2 | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-4266](https://issues.apache.org/jira/browse/MAPREDUCE-4266) | remove Ant remnants from MR | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
| [YARN-154](https://issues.apache.org/jira/browse/YARN-154) | Create Yarn trunk and commit jobs | Major | . | Eli Collins | Robert Joseph Evans |
+| [MAPREDUCE-4266](https://issues.apache.org/jira/browse/MAPREDUCE-4266) | remove Ant remnants from MR | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-8860](https://issues.apache.org/jira/browse/HADOOP-8860) | Split MapReduce and YARN sections in documentation navigation | Major | documentation | Tom White | Tom White |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.6/CHANGES.0.23.6.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.6/CHANGES.0.23.6.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.6/CHANGES.0.23.6.md
index 6ac205f..c6fe9ae 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.6/CHANGES.0.23.6.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.6/CHANGES.0.23.6.md
@@ -20,106 +20,90 @@
## Release 0.23.6 - 2013-02-06
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8992](https://issues.apache.org/jira/browse/HADOOP-8992) | Enhance unit-test coverage of class HarFileSystem | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
+| [YARN-80](https://issues.apache.org/jira/browse/YARN-80) | Support delay scheduling for node locality in MR2's capacity scheduler | Major | capacityscheduler | Todd Lipcon | Arun C Murthy |
| [HADOOP-8931](https://issues.apache.org/jira/browse/HADOOP-8931) | Add Java version to startup message | Trivial | . | Eli Collins | Eli Collins |
-| [HADOOP-8561](https://issues.apache.org/jira/browse/HADOOP-8561) | Introduce HADOOP\_PROXY\_USER for secure impersonation in child hadoop client processes | Major | security | Luke Lu | Yu Gao |
-| [MAPREDUCE-4899](https://issues.apache.org/jira/browse/MAPREDUCE-4899) | Provide a plugin to the Yarn Web App Proxy to generate tracking links for M/R appllications given the ID | Major | . | Derek Dagit | Derek Dagit |
-| [MAPREDUCE-4845](https://issues.apache.org/jira/browse/MAPREDUCE-4845) | ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2 | Major | client | Sandy Ryza | Sandy Ryza |
| [MAPREDUCE-4811](https://issues.apache.org/jira/browse/MAPREDUCE-4811) | JobHistoryServer should show when it was started in WebUI About page | Minor | jobhistoryserver, mrv2 | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-4810](https://issues.apache.org/jira/browse/MAPREDUCE-4810) | Add admin command options for ApplicationMaster | Minor | applicationmaster | Jason Lowe | Jerry Chen |
| [MAPREDUCE-4764](https://issues.apache.org/jira/browse/MAPREDUCE-4764) | repair test org.apache.hadoop.mapreduce.security.TestBinaryTokenFile | Major | . | Ivan A. Veselovsky | |
+| [HADOOP-8992](https://issues.apache.org/jira/browse/HADOOP-8992) | Enhance unit-test coverage of class HarFileSystem | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
+| [HADOOP-8561](https://issues.apache.org/jira/browse/HADOOP-8561) | Introduce HADOOP\_PROXY\_USER for secure impersonation in child hadoop client processes | Major | security | Luke Lu | Yu Gao |
+| [MAPREDUCE-4845](https://issues.apache.org/jira/browse/MAPREDUCE-4845) | ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2 | Major | client | Sandy Ryza | Sandy Ryza |
| [YARN-285](https://issues.apache.org/jira/browse/YARN-285) | RM should be able to provide a tracking link for apps that have already been purged | Major | . | Derek Dagit | Derek Dagit |
-| [YARN-80](https://issues.apache.org/jira/browse/YARN-80) | Support delay scheduling for node locality in MR2's capacity scheduler | Major | capacityscheduler | Todd Lipcon | Arun C Murthy |
+| [MAPREDUCE-4899](https://issues.apache.org/jira/browse/MAPREDUCE-4899) | Provide a plugin to the Yarn Web App Proxy to generate tracking links for M/R appllications given the ID | Major | . | Derek Dagit | Derek Dagit |
+| [MAPREDUCE-4810](https://issues.apache.org/jira/browse/MAPREDUCE-4810) | Add admin command options for ApplicationMaster | Minor | applicationmaster | Jason Lowe | Jerry Chen |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9255](https://issues.apache.org/jira/browse/HADOOP-9255) | relnotes.py missing last jira | Critical | scripts | Thomas Graves | Thomas Graves |
-| [HADOOP-9242](https://issues.apache.org/jira/browse/HADOOP-9242) | Duplicate surefire plugin config in hadoop-common | Major | test | Andrey Klochkov | Andrey Klochkov |
-| [HADOOP-9181](https://issues.apache.org/jira/browse/HADOOP-9181) | Set daemon flag for HttpServer's QueuedThreadPool | Major | . | Liang Xie | Liang Xie |
-| [HADOOP-9169](https://issues.apache.org/jira/browse/HADOOP-9169) | Bring branch-0.23 ExitUtil up to same level as branch-2 | Major | . | Robert Joseph Evans | Robert Joseph Evans |
-| [HADOOP-9152](https://issues.apache.org/jira/browse/HADOOP-9152) | HDFS can report negative DFS Used on clusters with very small amounts of data | Minor | fs | Brock Noland | Brock Noland |
-| [HADOOP-9135](https://issues.apache.org/jira/browse/HADOOP-9135) | JniBasedUnixGroupsMappingWithFallback should log at debug rather than info during fallback | Trivial | security | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-9108](https://issues.apache.org/jira/browse/HADOOP-9108) | Add a method to clear terminateCalled to ExitUtil for test cases | Major | util | Kihwal Lee | Kihwal Lee |
-| [HADOOP-9105](https://issues.apache.org/jira/browse/HADOOP-9105) | FsShell -moveFromLocal erroneously fails | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9097](https://issues.apache.org/jira/browse/HADOOP-9097) | Maven RAT plugin is not checking all source files | Critical | build | Tom White | Thomas Graves |
-| [HADOOP-9072](https://issues.apache.org/jira/browse/HADOOP-9072) | Hadoop-Common-0.23-Build Fails to build in Jenkins | Major | . | Robert Parker | Robert Parker |
| [HADOOP-7868](https://issues.apache.org/jira/browse/HADOOP-7868) | Hadoop native fails to compile when default linker option is -Wl,--as-needed | Major | native | James Page | Trevor Robinson |
-| [HDFS-4426](https://issues.apache.org/jira/browse/HDFS-4426) | Secondary namenode shuts down immediately after startup | Blocker | namenode | Jason Lowe | Arpit Agarwal |
-| [HDFS-4385](https://issues.apache.org/jira/browse/HDFS-4385) | Maven RAT plugin is not checking all source files | Critical | build | Thomas Graves | Thomas Graves |
-| [HDFS-4315](https://issues.apache.org/jira/browse/HDFS-4315) | DNs with multiple BPs can have BPOfferServices fail to start due to unsynchronized map access | Major | datanode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-4270](https://issues.apache.org/jira/browse/HDFS-4270) | Replications of the highest priority should be allowed to choose a source datanode that has reached its max replication limit | Minor | namenode | Derek Dagit | Derek Dagit |
-| [HDFS-4254](https://issues.apache.org/jira/browse/HDFS-4254) | testAllEditsDirsFailOnFlush makes subsequent test cases fail (0.23.6 only) | Major | test | Kihwal Lee | Kihwal Lee |
+| [HDFS-2757](https://issues.apache.org/jira/browse/HDFS-2757) | Cannot read a local block that's being written to when using the local read short circuit | Major | . | Jean-Daniel Cryans | Jean-Daniel Cryans |
+| [HDFS-4186](https://issues.apache.org/jira/browse/HDFS-4186) | logSync() is called with the write lock held while releasing lease | Critical | namenode | Kihwal Lee | Kihwal Lee |
+| [HADOOP-9072](https://issues.apache.org/jira/browse/HADOOP-9072) | Hadoop-Common-0.23-Build Fails to build in Jenkins | Major | . | Robert Parker | Robert Parker |
+| [MAPREDUCE-4825](https://issues.apache.org/jira/browse/MAPREDUCE-4825) | JobImpl.finished doesn't expect ERROR as a final job state | Major | mr-am | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4817](https://issues.apache.org/jira/browse/MAPREDUCE-4817) | Hardcoded task ping timeout kills tasks localizing large amounts of data | Critical | applicationmaster, mr-am | Jason Lowe | Thomas Graves |
| [HDFS-4242](https://issues.apache.org/jira/browse/HDFS-4242) | Map.Entry is incorrectly used in LeaseManager | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-9108](https://issues.apache.org/jira/browse/HADOOP-9108) | Add a method to clear terminateCalled to ExitUtil for test cases | Major | util | Kihwal Lee | Kihwal Lee |
| [HDFS-4233](https://issues.apache.org/jira/browse/HDFS-4233) | NN keeps serving even after no journals started while rolling edit | Blocker | namenode | Kihwal Lee | Kihwal Lee |
-| [HDFS-4232](https://issues.apache.org/jira/browse/HDFS-4232) | NN fails to write a fsimage with stale leases | Blocker | namenode | Daryn Sharp | Daryn Sharp |
-| [HDFS-4186](https://issues.apache.org/jira/browse/HDFS-4186) | logSync() is called with the write lock held while releasing lease | Critical | namenode | Kihwal Lee | Kihwal Lee |
-| [HDFS-2757](https://issues.apache.org/jira/browse/HDFS-2757) | Cannot read a local block that's being written to when using the local read short circuit | Major | . | Jean-Daniel Cryans | Jean-Daniel Cryans |
-| [MAPREDUCE-4934](https://issues.apache.org/jira/browse/MAPREDUCE-4934) | Maven RAT plugin is not checking all source files | Critical | build | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4925](https://issues.apache.org/jira/browse/MAPREDUCE-4925) | The pentomino option parser may be buggy | Major | examples | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-4921](https://issues.apache.org/jira/browse/MAPREDUCE-4921) | JobClient should acquire HS token with RM principal | Blocker | client | Daryn Sharp | Daryn Sharp |
-| [MAPREDUCE-4913](https://issues.apache.org/jira/browse/MAPREDUCE-4913) | TestMRAppMaster#testMRAppMasterMissingStaging occasionally exits | Major | mr-am | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4902](https://issues.apache.org/jira/browse/MAPREDUCE-4902) | Fix typo "receievd" should be "received" in log output | Trivial | . | Albert Chu | Albert Chu |
-| [MAPREDUCE-4895](https://issues.apache.org/jira/browse/MAPREDUCE-4895) | Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators | Major | . | Dennis Y | Dennis Y |
-| [MAPREDUCE-4894](https://issues.apache.org/jira/browse/MAPREDUCE-4894) | Renewal / cancellation of JobHistory tokens | Blocker | jobhistoryserver, mrv2 | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-4890](https://issues.apache.org/jira/browse/MAPREDUCE-4890) | Invalid TaskImpl state transitions when task fails while speculating | Critical | mr-am | Jason Lowe | Jason Lowe |
+| [YARN-251](https://issues.apache.org/jira/browse/YARN-251) | Proxy URI generation fails for blank tracking URIs | Major | resourcemanager | Tom White | Tom White |
+| [MAPREDUCE-4836](https://issues.apache.org/jira/browse/MAPREDUCE-4836) | Elapsed time for running tasks on AM web UI tasks page is 0 | Major | . | Ravi Prakash | Ravi Prakash |
+| [HDFS-4254](https://issues.apache.org/jira/browse/HDFS-4254) | testAllEditsDirsFailOnFlush makes subsequent test cases fail (0.23.6 only) | Major | test | Kihwal Lee | Kihwal Lee |
+| [YARN-72](https://issues.apache.org/jira/browse/YARN-72) | NM should handle cleaning up containers when it shuts down | Major | nodemanager | Hitesh Shah | Sandy Ryza |
+| [YARN-258](https://issues.apache.org/jira/browse/YARN-258) | RM web page UI shows Invalid Date for start and finish times | Major | resourcemanager | Ravi Prakash | Ravi Prakash |
+| [YARN-266](https://issues.apache.org/jira/browse/YARN-266) | RM and JHS Web UIs are blank because AppsBlock is not escaping string properly | Critical | resourcemanager | Ravi Prakash | Ravi Prakash |
| [MAPREDUCE-4861](https://issues.apache.org/jira/browse/MAPREDUCE-4861) | Cleanup: Remove unused mapreduce.security.token.DelegationTokenRenewal | Major | . | Karthik Kambatla | Karthik Kambatla |
| [MAPREDUCE-4856](https://issues.apache.org/jira/browse/MAPREDUCE-4856) | TestJobOutputCommitter uses same directory as TestJobCleanup | Major | test | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4848](https://issues.apache.org/jira/browse/MAPREDUCE-4848) | TaskAttemptContext cast error during AM recovery | Major | mr-am | Jason Lowe | Jerry Chen |
+| [HADOOP-9135](https://issues.apache.org/jira/browse/HADOOP-9135) | JniBasedUnixGroupsMappingWithFallback should log at debug rather than info during fallback | Trivial | security | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-4315](https://issues.apache.org/jira/browse/HDFS-4315) | DNs with multiple BPs can have BPOfferServices fail to start due to unsynchronized map access | Major | datanode | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-4232](https://issues.apache.org/jira/browse/HDFS-4232) | NN fails to write a fsimage with stale leases | Blocker | namenode | Daryn Sharp | Daryn Sharp |
+| [HADOOP-9152](https://issues.apache.org/jira/browse/HADOOP-9152) | HDFS can report negative DFS Used on clusters with very small amounts of data | Minor | fs | Brock Noland | Brock Noland |
+| [YARN-223](https://issues.apache.org/jira/browse/YARN-223) | Change processTree interface to work better with native code | Critical | . | Radim Kolar | Radim Kolar |
+| [MAPREDUCE-4895](https://issues.apache.org/jira/browse/MAPREDUCE-4895) | Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators | Major | . | Dennis Y | Dennis Y |
+| [HADOOP-9105](https://issues.apache.org/jira/browse/HADOOP-9105) | FsShell -moveFromLocal erroneously fails | Major | fs | Daryn Sharp | Daryn Sharp |
| [MAPREDUCE-4842](https://issues.apache.org/jira/browse/MAPREDUCE-4842) | Shuffle race can hang reducer | Blocker | mrv2 | Jason Lowe | Mariappan Asokan |
-| [MAPREDUCE-4836](https://issues.apache.org/jira/browse/MAPREDUCE-4836) | Elapsed time for running tasks on AM web UI tasks page is 0 | Major | . | Ravi Prakash | Ravi Prakash |
| [MAPREDUCE-4833](https://issues.apache.org/jira/browse/MAPREDUCE-4833) | Task can get stuck in FAIL\_CONTAINER\_CLEANUP | Critical | applicationmaster, mrv2 | Robert Joseph Evans | Robert Parker |
+| [MAPREDUCE-4890](https://issues.apache.org/jira/browse/MAPREDUCE-4890) | Invalid TaskImpl state transitions when task fails while speculating | Critical | mr-am | Jason Lowe | Jason Lowe |
+| [HADOOP-9169](https://issues.apache.org/jira/browse/HADOOP-9169) | Bring branch-0.23 ExitUtil up to same level as branch-2 | Major | . | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4902](https://issues.apache.org/jira/browse/MAPREDUCE-4902) | Fix typo "receievd" should be "received" in log output | Trivial | . | Albert Chu | Albert Chu |
+| [YARN-225](https://issues.apache.org/jira/browse/YARN-225) | Proxy Link in RM UI thows NPE in Secure mode | Critical | resourcemanager | Devaraj K | Devaraj K |
+| [MAPREDUCE-4813](https://issues.apache.org/jira/browse/MAPREDUCE-4813) | AM timing out during job commit | Critical | applicationmaster | Jason Lowe | Jason Lowe |
+| [YARN-293](https://issues.apache.org/jira/browse/YARN-293) | Node Manager leaks LocalizerRunner object for every Container | Critical | nodemanager | Devaraj K | Robert Joseph Evans |
+| [MAPREDUCE-4279](https://issues.apache.org/jira/browse/MAPREDUCE-4279) | getClusterStatus() fails with null pointer exception when running jobs in local mode | Major | jobtracker | Rahul Jain | Devaraj K |
+| [HDFS-4270](https://issues.apache.org/jira/browse/HDFS-4270) | Replications of the highest priority should be allowed to choose a source datanode that has reached its max replication limit | Minor | namenode | Derek Dagit | Derek Dagit |
| [MAPREDUCE-4832](https://issues.apache.org/jira/browse/MAPREDUCE-4832) | MR AM can get in a split brain situation | Critical | applicationmaster | Robert Joseph Evans | Jason Lowe |
-| [MAPREDUCE-4825](https://issues.apache.org/jira/browse/MAPREDUCE-4825) | JobImpl.finished doesn't expect ERROR as a final job state | Major | mr-am | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4894](https://issues.apache.org/jira/browse/MAPREDUCE-4894) | Renewal / cancellation of JobHistory tokens | Blocker | jobhistoryserver, mrv2 | Siddharth Seth | Siddharth Seth |
| [MAPREDUCE-4819](https://issues.apache.org/jira/browse/MAPREDUCE-4819) | AM can rerun job after reporting final job status to the client | Blocker | mr-am | Jason Lowe | Bikas Saha |
-| [MAPREDUCE-4817](https://issues.apache.org/jira/browse/MAPREDUCE-4817) | Hardcoded task ping timeout kills tasks localizing large amounts of data | Critical | applicationmaster, mr-am | Jason Lowe | Thomas Graves |
-| [MAPREDUCE-4813](https://issues.apache.org/jira/browse/MAPREDUCE-4813) | AM timing out during job commit | Critical | applicationmaster | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4913](https://issues.apache.org/jira/browse/MAPREDUCE-4913) | TestMRAppMaster#testMRAppMasterMissingStaging occasionally exits | Major | mr-am | Jason Lowe | Jason Lowe |
+| [YARN-170](https://issues.apache.org/jira/browse/YARN-170) | NodeManager stop() gets called twice on shutdown | Major | nodemanager | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9181](https://issues.apache.org/jira/browse/HADOOP-9181) | Set daemon flag for HttpServer's QueuedThreadPool | Major | . | Liang Xie | Liang Xie |
+| [YARN-320](https://issues.apache.org/jira/browse/YARN-320) | RM should always be able to renew its own tokens | Blocker | resourcemanager | Daryn Sharp | Daryn Sharp |
+| [YARN-325](https://issues.apache.org/jira/browse/YARN-325) | RM CapacityScheduler can deadlock when getQueueInfo() is called and a container is completing | Blocker | capacityscheduler | Jason Lowe | Arun C Murthy |
+| [MAPREDUCE-4848](https://issues.apache.org/jira/browse/MAPREDUCE-4848) | TaskAttemptContext cast error during AM recovery | Major | mr-am | Jason Lowe | Jerry Chen |
+| [HADOOP-9097](https://issues.apache.org/jira/browse/HADOOP-9097) | Maven RAT plugin is not checking all source files | Critical | build | Tom White | Thomas Graves |
+| [HDFS-4385](https://issues.apache.org/jira/browse/HDFS-4385) | Maven RAT plugin is not checking all source files | Critical | build | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4934](https://issues.apache.org/jira/browse/MAPREDUCE-4934) | Maven RAT plugin is not checking all source files | Critical | build | Thomas Graves | Thomas Graves |
+| [YARN-334](https://issues.apache.org/jira/browse/YARN-334) | Maven RAT plugin is not checking all source files | Critical | . | Thomas Graves | Thomas Graves |
| [MAPREDUCE-4678](https://issues.apache.org/jira/browse/MAPREDUCE-4678) | Running the Pentomino example with defaults throws java.lang.NegativeArraySizeException | Minor | examples | Chris McConnell | Chris McConnell |
-| [MAPREDUCE-4279](https://issues.apache.org/jira/browse/MAPREDUCE-4279) | getClusterStatus() fails with null pointer exception when running jobs in local mode | Major | jobtracker | Rahul Jain | Devaraj K |
+| [MAPREDUCE-4925](https://issues.apache.org/jira/browse/MAPREDUCE-4925) | The pentomino option parser may be buggy | Major | examples | Karthik Kambatla | Karthik Kambatla |
+| [MAPREDUCE-4921](https://issues.apache.org/jira/browse/MAPREDUCE-4921) | JobClient should acquire HS token with RM principal | Blocker | client | Daryn Sharp | Daryn Sharp |
+| [HDFS-4426](https://issues.apache.org/jira/browse/HDFS-4426) | Secondary namenode shuts down immediately after startup | Blocker | namenode | Jason Lowe | Arpit Agarwal |
| [YARN-354](https://issues.apache.org/jira/browse/YARN-354) | WebAppProxyServer exits immediately after startup | Blocker | . | Liang Xie | Liang Xie |
-| [YARN-334](https://issues.apache.org/jira/browse/YARN-334) | Maven RAT plugin is not checking all source files | Critical | . | Thomas Graves | Thomas Graves |
-| [YARN-325](https://issues.apache.org/jira/browse/YARN-325) | RM CapacityScheduler can deadlock when getQueueInfo() is called and a container is completing | Blocker | capacityscheduler | Jason Lowe | Arun C Murthy |
-| [YARN-320](https://issues.apache.org/jira/browse/YARN-320) | RM should always be able to renew its own tokens | Blocker | resourcemanager | Daryn Sharp | Daryn Sharp |
-| [YARN-293](https://issues.apache.org/jira/browse/YARN-293) | Node Manager leaks LocalizerRunner object for every Container | Critical | nodemanager | Devaraj K | Robert Joseph Evans |
-| [YARN-266](https://issues.apache.org/jira/browse/YARN-266) | RM and JHS Web UIs are blank because AppsBlock is not escaping string properly | Critical | resourcemanager | Ravi Prakash | Ravi Prakash |
-| [YARN-258](https://issues.apache.org/jira/browse/YARN-258) | RM web page UI shows Invalid Date for start and finish times | Major | resourcemanager | Ravi Prakash | Ravi Prakash |
-| [YARN-251](https://issues.apache.org/jira/browse/YARN-251) | Proxy URI generation fails for blank tracking URIs | Major | resourcemanager | Tom White | Tom White |
-| [YARN-225](https://issues.apache.org/jira/browse/YARN-225) | Proxy Link in RM UI thows NPE in Secure mode | Critical | resourcemanager | Devaraj K | Devaraj K |
-| [YARN-223](https://issues.apache.org/jira/browse/YARN-223) | Change processTree interface to work better with native code | Critical | . | Radim Kolar | Radim Kolar |
-| [YARN-170](https://issues.apache.org/jira/browse/YARN-170) | NodeManager stop() gets called twice on shutdown | Major | nodemanager | Sandy Ryza | Sandy Ryza |
-| [YARN-72](https://issues.apache.org/jira/browse/YARN-72) | NM should handle cleaning up containers when it shuts down | Major | nodemanager | Hitesh Shah | Sandy Ryza |
+| [HADOOP-9242](https://issues.apache.org/jira/browse/HADOOP-9242) | Duplicate surefire plugin config in hadoop-common | Major | test | Andrey Klochkov | Andrey Klochkov |
+| [HADOOP-9255](https://issues.apache.org/jira/browse/HADOOP-9255) | relnotes.py missing last jira | Critical | scripts | Thomas Graves | Thomas Graves |
### TESTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9217](https://issues.apache.org/jira/browse/HADOOP-9217) | Print thread dumps when hadoop-common tests fail | Major | test | Andrey Klochkov | Andrey Klochkov |
| [HADOOP-9038](https://issues.apache.org/jira/browse/HADOOP-9038) | provide unit-test coverage of class org.apache.hadoop.fs.LocalDirAllocator.AllocatorPerContext.PathIterator | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
+| [HADOOP-9217](https://issues.apache.org/jira/browse/HADOOP-9217) | Print thread dumps when hadoop-common tests fail | Major | test | Andrey Klochkov | Andrey Klochkov |
### SUB-TASKS:
@@ -127,10 +111,10 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
| [HADOOP-9020](https://issues.apache.org/jira/browse/HADOOP-9020) | Add a SASL PLAIN server | Major | ipc, security | Daryn Sharp | Daryn Sharp |
-| [HDFS-4248](https://issues.apache.org/jira/browse/HDFS-4248) | Renames may remove file leases | Blocker | namenode | Daryn Sharp | Daryn Sharp |
+| [YARN-204](https://issues.apache.org/jira/browse/YARN-204) | test coverage for org.apache.hadoop.tools | Major | applications | Aleksey Gorshkov | Aleksey Gorshkov |
| [HDFS-4247](https://issues.apache.org/jira/browse/HDFS-4247) | saveNamespace should be tolerant of dangling lease | Blocker | namenode | Daryn Sharp | Daryn Sharp |
+| [HDFS-4248](https://issues.apache.org/jira/browse/HDFS-4248) | Renames may remove file leases | Blocker | namenode | Daryn Sharp | Daryn Sharp |
| [YARN-280](https://issues.apache.org/jira/browse/YARN-280) | RM does not reject app submission with invalid tokens | Major | resourcemanager | Daryn Sharp | Daryn Sharp |
-| [YARN-204](https://issues.apache.org/jira/browse/YARN-204) | test coverage for org.apache.hadoop.tools | Major | applications | Aleksey Gorshkov | Aleksey Gorshkov |
| [YARN-50](https://issues.apache.org/jira/browse/YARN-50) | Implement renewal / cancellation of Delegation Tokens | Blocker | . | Siddharth Seth | Siddharth Seth |
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[40/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.0/RELEASENOTES.0.19.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.0/RELEASENOTES.0.19.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.0/RELEASENOTES.0.19.0.md
index 187b087..a7c0fb2 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.0/RELEASENOTES.0.19.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.0/RELEASENOTES.0.19.0.md
@@ -23,281 +23,284 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-4466](https://issues.apache.org/jira/browse/HADOOP-4466) | *Blocker* | **SequenceFileOutputFormat is coupled to WritableComparable and Writable**
+* [HADOOP-3595](https://issues.apache.org/jira/browse/HADOOP-3595) | *Major* | **Remove deprecated mapred.combine.once functionality**
-Ensure that SequenceFileOutputFormat isn't tied to Writables and can be used with other Serialization frameworks.
+ Removed deprecated methods for mapred.combine.once functionality.
---
-* [HADOOP-4433](https://issues.apache.org/jira/browse/HADOOP-4433) | *Major* | **Improve data loader for collecting metrics and log files from hadoop and system**
+* [HADOOP-2664](https://issues.apache.org/jira/browse/HADOOP-2664) | *Major* | **lzop-compatible CompresionCodec**
-- Added startup and shutdown script
-- Added torque metrics data loader
-- Improve handling of Exec Plugin
-- Added Test cases for File Tailing Adaptors
-- Added Test cases for Start streaming at specific offset
+Introduced LZOP codec.
---
-* [HADOOP-4430](https://issues.apache.org/jira/browse/HADOOP-4430) | *Blocker* | **Namenode Web UI capacity report is inconsistent with Balancer**
+* [HADOOP-3667](https://issues.apache.org/jira/browse/HADOOP-3667) | *Major* | **Remove deprecated methods in JobConf**
-Changed reporting in the NameNode Web UI to more closely reflect the behavior of the re-balancer. Removed no longer used config parameter dfs.datanode.du.pct from hadoop-default.xml.
+Removed the following deprecated methods from JobConf:
+ addInputPath(Path)
+ getInputPaths()
+ getMapOutputCompressionType()
+ getOutputPath()
+ getSystemDir()
+ setInputPath(Path)
+ setMapOutputCompressionType(CompressionType style)
+ setOutputPath(Path)
---
-* [HADOOP-4293](https://issues.apache.org/jira/browse/HADOOP-4293) | *Major* | **Remove WritableJobConf**
+* [HADOOP-3652](https://issues.apache.org/jira/browse/HADOOP-3652) | *Major* | **Remove deprecated class OutputFormatBase**
-Made Configuration Writable and rename the old write method to writeXml.
+Removed deprecated org.apache.hadoop.mapred.OutputFormatBase.
---
-* [HADOOP-4281](https://issues.apache.org/jira/browse/HADOOP-4281) | *Blocker* | **Capacity reported in some of the commands is not consistent with the Web UI reported data**
+* [HADOOP-2325](https://issues.apache.org/jira/browse/HADOOP-2325) | *Major* | **Require Java 6**
-Changed command "hadoop dfsadmin -report" to be consistent with Web UI for both Namenode and Datanode reports. "Total raw bytes" is changed to "Configured Capacity". "Present Capacity" is newly added to indicate the present capacity of the DFS. "Remaining raw bytes" is changed to "DFS Remaining". "Used raw bytes" is changed to "DFS Used". "% used" is changed to "DFS Used%". Applications that parse command output should be reviewed.
+Hadoop now requires Java 6.
---
-* [HADOOP-4227](https://issues.apache.org/jira/browse/HADOOP-4227) | *Minor* | **Remove the deprecated, unused class ShellCommand.**
+* [HADOOP-3695](https://issues.apache.org/jira/browse/HADOOP-3695) | *Major* | **[HOD] Have an ability to run multiple slaves per node**
-Removed the deprecated class org.apache.hadoop.fs.ShellCommand.
+Added an ability in HOD to start multiple workers (TaskTrackers and/or DataNodes) per node to assist testing and simulation of scale. A configuration variable ringmaster.workers\_per\_ring was added to specify the number of workers to start.
---
-* [HADOOP-4205](https://issues.apache.org/jira/browse/HADOOP-4205) | *Major* | **[Hive] metastore and ql to use the refactored SerDe library**
+* [HADOOP-3149](https://issues.apache.org/jira/browse/HADOOP-3149) | *Major* | **supporting multiple outputs for M/R jobs**
-Improved Hive metastore and ql to use the refactored SerDe library.
+Introduced MultipleOutputs class so Map/Reduce jobs can write data to different output files. Each output can use a different OutputFormat. Outpufiles are created within the job output directory. FileOutputFormat.getPathForCustomFile() creates a filename under the outputdir that is named with the task ID and task type (i.e. myfile-r-00001).
---
-* [HADOOP-4190](https://issues.apache.org/jira/browse/HADOOP-4190) | *Blocker* | **Changes to JobHistory makes it backward incompatible**
+* [HADOOP-3684](https://issues.apache.org/jira/browse/HADOOP-3684) | *Major* | **The data\_join should allow the user to implement a customer cloning function**
-Changed job history format to add a dot at end of each line.
+Allowed user to overwrite clone function in a subclass of TaggedMapOutput class.
---
-* [HADOOP-4176](https://issues.apache.org/jira/browse/HADOOP-4176) | *Major* | **Implement getFileChecksum(Path) in HftpFileSystem**
+* [HADOOP-3478](https://issues.apache.org/jira/browse/HADOOP-3478) | *Major* | **The algorithm to decide map re-execution on fetch failures can be improved**
-Implemented getFileChecksum(Path) in HftpFileSystemfor distcp support.
+Changed reducers to fetch maps in the same order for a given host to speed up identification of the faulty maps; reducers still randomize the host selection to distribute load.
---
-* [HADOOP-4138](https://issues.apache.org/jira/browse/HADOOP-4138) | *Major* | **[Hive] refactor the SerDe library**
+* [HADOOP-3714](https://issues.apache.org/jira/browse/HADOOP-3714) | *Trivial* | **Bash tab completion support**
-Introduced new SerDe library for src/contrib/hive.
+Adds a new contrib, bash-tab-completion, which enables bash tab completion for the bin/hadoop script. See the README file in the contrib directory for the installation.
---
-* [HADOOP-4117](https://issues.apache.org/jira/browse/HADOOP-4117) | *Major* | **Improve configurability of Hadoop EC2 instances**
+* [HADOOP-3730](https://issues.apache.org/jira/browse/HADOOP-3730) | *Major* | **add new JobConf constructor that disables loading default configurations**
-Changed scripts to pass initialization script for EC2 instances at boot time (as EC2 user data) rather than embedding initialization information in the EC2 image. This change makes it easy to customize the hadoop-site.xml file for your cluster before launch, by editing the hadoop-ec2-init-remote.sh script, or by setting the environment variable USER\_DATA\_FILE in hadoop-ec2-env.sh to run a script of your choice.
+ Added a JobConf constructor that disables loading default configurations so as to take all default values from the JobTracker's configuration.
---
-* [HADOOP-4116](https://issues.apache.org/jira/browse/HADOOP-4116) | *Blocker* | **Balancer should provide better resource management**
+* [HADOOP-3485](https://issues.apache.org/jira/browse/HADOOP-3485) | *Minor* | **fix writes**
-Changed DataNode protocol version without impact to clients other than to compel use of current version of client application.
+Introduce write support for Fuse; requires Linux kernel 2.6.15 or better.
---
-* [HADOOP-4106](https://issues.apache.org/jira/browse/HADOOP-4106) | *Major* | **add time, permission and user attribute support to fuse-dfs**
+* [HADOOP-3412](https://issues.apache.org/jira/browse/HADOOP-3412) | *Minor* | **Refactor the scheduler out of the JobTracker**
-Added time, permission and user attribute support to libhdfs.
+Added the ability to chose between many schedulers, and to limit the number of running tasks per job.
---
-* [HADOOP-4086](https://issues.apache.org/jira/browse/HADOOP-4086) | *Major* | **Add limit to Hive QL**
+* [HADOOP-1700](https://issues.apache.org/jira/browse/HADOOP-1700) | *Major* | **Append to files in HDFS**
-Added LIMIT to Hive query language.
+Introduced append operation for HDFS files.
---
-* [HADOOP-4084](https://issues.apache.org/jira/browse/HADOOP-4084) | *Major* | **Add explain plan capabilities to Hive QL**
+* [HADOOP-3646](https://issues.apache.org/jira/browse/HADOOP-3646) | *Major* | **Providing bzip2 as codec**
-Introduced "EXPLAIN" plan for Hive.
+Introduced support for bzip2 compressed files.
---
-* [HADOOP-4018](https://issues.apache.org/jira/browse/HADOOP-4018) | *Major* | **limit memory usage in jobtracker**
+* [HADOOP-3796](https://issues.apache.org/jira/browse/HADOOP-3796) | *Major* | **fuse-dfs should take rw,ro,trashon,trashoff,protected=blah mount arguments rather than them being compiled in**
-Introduced new configuration parameter mapred.max.tasks.per.job to specifie the maximum number of tasks per job.
+Changed Fuse configuration to use mount options.
---
-* [HADOOP-3992](https://issues.apache.org/jira/browse/HADOOP-3992) | *Major* | **Synthetic Load Generator for NameNode testing**
+* [HADOOP-3837](https://issues.apache.org/jira/browse/HADOOP-3837) | *Major* | **hadop streaming does not use progress reporting to detect hung tasks**
-Added a synthetic load generation facility to the test directory.
+Changed streaming tasks to adhere to task timeout value specified in the job configuration.
---
-* [HADOOP-3981](https://issues.apache.org/jira/browse/HADOOP-3981) | *Major* | **Need a distributed file checksum algorithm for HDFS**
-
-Implemented MD5-of-xxxMD5-of-yyyCRC32 which is a distributed file checksum algorithm for HDFS, where xxx is the number of CRCs per block and yyy is the number of bytes per CRC.
+* [HADOOP-3792](https://issues.apache.org/jira/browse/HADOOP-3792) | *Minor* | **exit code from "hadoop dfs -test ..." is wrong for Unix shell**
-Changed DistCp to use file checksum for comparing files if both source and destination FileSystem(s) support getFileChecksum(...).
+Changed exit code from hadoop.fs.FsShell -test to match the usual Unix convention.
---
-* [HADOOP-3970](https://issues.apache.org/jira/browse/HADOOP-3970) | *Major* | **Counters written to the job history cannot be recovered back**
+* [HADOOP-2302](https://issues.apache.org/jira/browse/HADOOP-2302) | *Major* | ** Streaming should provide an option for numerical sort of keys**
-Added getEscapedCompactString() and fromEscapedCompactString() to Counters.java to represent counters as Strings and to reconstruct the counters from the Strings.
+Introduced numerical key comparison for streaming.
---
-* [HADOOP-3963](https://issues.apache.org/jira/browse/HADOOP-3963) | *Minor* | **libhdfs should never exit on its own but rather return errors to the calling application**
+* [HADOOP-153](https://issues.apache.org/jira/browse/HADOOP-153) | *Major* | **skip records that fail Task**
-Modified libhdfs to return NULL or error code when unrecoverable error occurs rather than exiting itself.
+Introduced record skipping where tasks fail on certain records. (org.apache.hadoop.mapred.SkipBadRecords)
---
-* [HADOOP-3941](https://issues.apache.org/jira/browse/HADOOP-3941) | *Major* | **Extend FileSystem API to return file-checksums/file-digests**
+* [HADOOP-3719](https://issues.apache.org/jira/browse/HADOOP-3719) | *Major* | **Chukwa**
-Added new FileSystem APIs: FileChecksum and FileSystem.getFileChecksum(Path).
+Introduced Chukwa data collection and analysis framework.
---
-* [HADOOP-3939](https://issues.apache.org/jira/browse/HADOOP-3939) | *Major* | **DistCp should support an option for deleting non-existing files.**
+* [HADOOP-3873](https://issues.apache.org/jira/browse/HADOOP-3873) | *Major* | **DistCp should have an option for limiting the number of files/bytes being copied**
-Added a new option -delete to DistCp so that if the files/directories exist in dst but not in src will be deleted. It uses FsShell to do delete, so that it will use trash if the trash is enable.
+Added two new options -filelimit \<n\> and -sizelimit \<n\> to DistCp for limiting the total number of files and the total size in bytes, respectively.
---
-* [HADOOP-3938](https://issues.apache.org/jira/browse/HADOOP-3938) | *Major* | **Quotas for disk space management**
+* [HADOOP-3889](https://issues.apache.org/jira/browse/HADOOP-3889) | *Minor* | **distcp: Better Error Message should be thrown when accessing source files/directory with no read permission**
-Introducted byte space quotas for directories. The count shell command modified to report both name and byte quotas.
+Changed DistCp error messages when there is a RemoteException. Changed the corresponding return value from -999 to -3.
---
-* [HADOOP-3930](https://issues.apache.org/jira/browse/HADOOP-3930) | *Major* | **Decide how to integrate scheduler info into CLI and job tracker web page**
+* [HADOOP-3585](https://issues.apache.org/jira/browse/HADOOP-3585) | *Minor* | **Hardware Failure Monitoring in large clusters running Hadoop/HDFS**
-Changed TaskScheduler to expose API for Web UI and Command Line Tool.
+Added FailMon as a contrib project for hardware failure monitoring and analysis, under /src/contrib/failmon. Created User Manual and Quick Start Guide.
---
-* [HADOOP-3911](https://issues.apache.org/jira/browse/HADOOP-3911) | *Minor* | **' -blocks ' option not being recognized**
+* [HADOOP-3549](https://issues.apache.org/jira/browse/HADOOP-3549) | *Major* | **meaningful errno values in libhdfs**
-Added a check to fsck options to make sure -files is not the first option so as to resolve conflicts with GenericOptionsParser.
+Improved error reporting for libhdfs so permission problems now return EACCES.
---
-* [HADOOP-3908](https://issues.apache.org/jira/browse/HADOOP-3908) | *Minor* | **Better error message if llibhdfs.so doesn't exist**
+* [HADOOP-3062](https://issues.apache.org/jira/browse/HADOOP-3062) | *Major* | **Need to capture the metrics for the network ios generate by dfs reads/writes and map/reduce shuffling and break them down by racks**
-Improved Fuse-dfs better error message if llibhdfs.so doesn't exist.
+Introduced additional log records for data transfers.
---
-* [HADOOP-3889](https://issues.apache.org/jira/browse/HADOOP-3889) | *Minor* | **distcp: Better Error Message should be thrown when accessing source files/directory with no read permission**
+* [HADOOP-3854](https://issues.apache.org/jira/browse/HADOOP-3854) | *Major* | **org.apache.hadoop.http.HttpServer should support user configurable filter**
-Changed DistCp error messages when there is a RemoteException. Changed the corresponding return value from -999 to -3.
+Added a configuration property hadoop.http.filter.initializers and a class org.apache.hadoop.http.FilterInitializer for supporting servlet filter. Cluster administrator could possibly configure customized filters for their web site.
---
-* [HADOOP-3873](https://issues.apache.org/jira/browse/HADOOP-3873) | *Major* | **DistCp should have an option for limiting the number of files/bytes being copied**
+* [HADOOP-3908](https://issues.apache.org/jira/browse/HADOOP-3908) | *Minor* | **Better error message if llibhdfs.so doesn't exist**
-Added two new options -filelimit \<n\> and -sizelimit \<n\> to DistCp for limiting the total number of files and the total size in bytes, respectively.
+Improved Fuse-dfs better error message if llibhdfs.so doesn't exist.
---
-* [HADOOP-3854](https://issues.apache.org/jira/browse/HADOOP-3854) | *Major* | **org.apache.hadoop.http.HttpServer should support user configurable filter**
+* [HADOOP-3746](https://issues.apache.org/jira/browse/HADOOP-3746) | *Minor* | **A fair sharing job scheduler**
-Added a configuration property hadoop.http.filter.initializers and a class org.apache.hadoop.http.FilterInitializer for supporting servlet filter. Cluster administrator could possibly configure customized filters for their web site.
+Introduced Fair Scheduler.
---
-* [HADOOP-3837](https://issues.apache.org/jira/browse/HADOOP-3837) | *Major* | **hadop streaming does not use progress reporting to detect hung tasks**
+* [HADOOP-3828](https://issues.apache.org/jira/browse/HADOOP-3828) | *Major* | **Write skipped records' bytes to DFS**
-Changed streaming tasks to adhere to task timeout value specified in the job configuration.
+Skipped records can optionally be written to the HDFS. Refer org.apache.hadoop.mapred.SkipBadRecords.setSkipOutputPath for setting the output path.
---
-* [HADOOP-3829](https://issues.apache.org/jira/browse/HADOOP-3829) | *Major* | **Narrown down skipped records based on user acceptable value**
+* [HADOOP-3939](https://issues.apache.org/jira/browse/HADOOP-3939) | *Major* | **DistCp should support an option for deleting non-existing files.**
-Introduced new config parameter org.apache.hadoop.mapred.SkipBadRecords.setMapperMaxSkipRecords to set range of records to be skipped in the neighborhood of a failed record.
+Added a new option -delete to DistCp so that if the files/directories exist in dst but not in src will be deleted. It uses FsShell to do delete, so that it will use trash if the trash is enable.
---
-* [HADOOP-3828](https://issues.apache.org/jira/browse/HADOOP-3828) | *Major* | **Write skipped records' bytes to DFS**
+* [HADOOP-3601](https://issues.apache.org/jira/browse/HADOOP-3601) | *Minor* | **Hive as a contrib project**
-Skipped records can optionally be written to the HDFS. Refer org.apache.hadoop.mapred.SkipBadRecords.setSkipOutputPath for setting the output path.
+Introduced Hive Data Warehouse built on top of Hadoop that enables structuring Hadoop files as tables and partitions and allows users to query this data through a SQL like language using a command line interface.
---
-* [HADOOP-3796](https://issues.apache.org/jira/browse/HADOOP-3796) | *Major* | **fuse-dfs should take rw,ro,trashon,trashoff,protected=blah mount arguments rather than them being compiled in**
+* [HADOOP-3498](https://issues.apache.org/jira/browse/HADOOP-3498) | *Major* | **File globbing alternation should be able to span path components**
-Changed Fuse configuration to use mount options.
+Extended file globbing alternation to cross path components. For example, {/a/b,/c/d} expands to a path that matches the files /a/b and /c/d.
---
-* [HADOOP-3792](https://issues.apache.org/jira/browse/HADOOP-3792) | *Minor* | **exit code from "hadoop dfs -test ..." is wrong for Unix shell**
+* [HADOOP-3150](https://issues.apache.org/jira/browse/HADOOP-3150) | *Major* | **Move task file promotion into the task**
-Changed exit code from hadoop.fs.FsShell -test to match the usual Unix convention.
+Moved task file promotion to the Task. When the task has finished, it will do a commit and is declared SUCCEDED. Job cleanup is done by a separate task. Job is declared SUCCEDED/FAILED after the cleanup task has finished. Added public classes org.apache.hadoop.mapred.JobContext, TaskAttemptContext, OutputCommitter and FileOutputCommiitter. Added public APIs: public OutputCommitter getOutputCommitter() and
+public void setOutputCommitter(Class\<? extends OutputCommitter\> theClass) in org.apache.hadoop.mapred.JobConf
---
-* [HADOOP-3746](https://issues.apache.org/jira/browse/HADOOP-3746) | *Minor* | **A fair sharing job scheduler**
+* [HADOOP-3941](https://issues.apache.org/jira/browse/HADOOP-3941) | *Major* | **Extend FileSystem API to return file-checksums/file-digests**
-Introduced Fair Scheduler.
+Added new FileSystem APIs: FileChecksum and FileSystem.getFileChecksum(Path).
---
-* [HADOOP-3730](https://issues.apache.org/jira/browse/HADOOP-3730) | *Major* | **add new JobConf constructor that disables loading default configurations**
+* [HADOOP-3963](https://issues.apache.org/jira/browse/HADOOP-3963) | *Minor* | **libhdfs should never exit on its own but rather return errors to the calling application**
- Added a JobConf constructor that disables loading default configurations so as to take all default values from the JobTracker's configuration.
+Modified libhdfs to return NULL or error code when unrecoverable error occurs rather than exiting itself.
---
-* [HADOOP-3722](https://issues.apache.org/jira/browse/HADOOP-3722) | *Minor* | **Provide a unified way to pass jobconf options from bin/hadoop**
+* [HADOOP-1869](https://issues.apache.org/jira/browse/HADOOP-1869) | *Major* | **access times of HDFS files**
-Changed streaming StreamJob and Submitter to implement Tool and Configurable, and to use GenericOptionsParser arguments -fs, -jt, -conf, -D, -libjars, -files, and -archives. Deprecated -jobconf, -cacheArchive, -dfs, -cacheArchive, -additionalconfspec, from streaming and pipes in favor of the generic options. Removed from streaming -config, -mapred.job.tracker, and -cluster.
+Added HDFS file access times. By default, access times will be precise to the most recent hour boundary. A configuration parameter dfs.access.time.precision (milliseconds) is used to control this precision. Setting a value of 0 will disable persisting access times for HDFS files.
---
-* [HADOOP-3719](https://issues.apache.org/jira/browse/HADOOP-3719) | *Major* | **Chukwa**
+* [HADOOP-3581](https://issues.apache.org/jira/browse/HADOOP-3581) | *Major* | **Prevent memory intensive user tasks from taking down nodes**
-Introduced Chukwa data collection and analysis framework.
+Added the ability to kill process trees transgressing memory limits. TaskTracker uses the configuration parameters introduced in HADOOP-3759. In addition, mapred.tasktracker.taskmemorymanager.monitoring-interval specifies the interval for which TT waits between cycles of monitoring tasks' memory usage, and mapred.tasktracker.procfsbasedprocesstree.sleeptime-before-sigkill specifies the time TT waits for sending a SIGKILL to a process-tree that has overrun memory limits, after it has been sent a SIGTERM.
---
-* [HADOOP-3714](https://issues.apache.org/jira/browse/HADOOP-3714) | *Trivial* | **Bash tab completion support**
+* [HADOOP-3970](https://issues.apache.org/jira/browse/HADOOP-3970) | *Major* | **Counters written to the job history cannot be recovered back**
-Adds a new contrib, bash-tab-completion, which enables bash tab completion for the bin/hadoop script. See the README file in the contrib directory for the installation.
+Added getEscapedCompactString() and fromEscapedCompactString() to Counters.java to represent counters as Strings and to reconstruct the counters from the Strings.
---
@@ -309,221 +312,218 @@ Introduced ChainMapper and the ChainReducer classes to allow composing chains of
---
-* [HADOOP-3695](https://issues.apache.org/jira/browse/HADOOP-3695) | *Major* | **[HOD] Have an ability to run multiple slaves per node**
+* [HADOOP-3445](https://issues.apache.org/jira/browse/HADOOP-3445) | *Major* | **Implementing core scheduler functionality in Resource Manager (V1) for Hadoop**
-Added an ability in HOD to start multiple workers (TaskTrackers and/or DataNodes) per node to assist testing and simulation of scale. A configuration variable ringmaster.workers\_per\_ring was added to specify the number of workers to start.
+Introduced Capacity Task Scheduler.
---
-* [HADOOP-3684](https://issues.apache.org/jira/browse/HADOOP-3684) | *Major* | **The data\_join should allow the user to implement a customer cloning function**
+* [HADOOP-3992](https://issues.apache.org/jira/browse/HADOOP-3992) | *Major* | **Synthetic Load Generator for NameNode testing**
-Allowed user to overwrite clone function in a subclass of TaggedMapOutput class.
+Added a synthetic load generation facility to the test directory.
---
-* [HADOOP-3667](https://issues.apache.org/jira/browse/HADOOP-3667) | *Major* | **Remove deprecated methods in JobConf**
+* [HADOOP-3981](https://issues.apache.org/jira/browse/HADOOP-3981) | *Major* | **Need a distributed file checksum algorithm for HDFS**
-Removed the following deprecated methods from JobConf:
- addInputPath(Path)
- getInputPaths()
- getMapOutputCompressionType()
- getOutputPath()
- getSystemDir()
- setInputPath(Path)
- setMapOutputCompressionType(CompressionType style)
- setOutputPath(Path)
+Implemented MD5-of-xxxMD5-of-yyyCRC32 which is a distributed file checksum algorithm for HDFS, where xxx is the number of CRCs per block and yyy is the number of bytes per CRC.
+
+Changed DistCp to use file checksum for comparing files if both source and destination FileSystem(s) support getFileChecksum(...).
---
-* [HADOOP-3652](https://issues.apache.org/jira/browse/HADOOP-3652) | *Major* | **Remove deprecated class OutputFormatBase**
+* [HADOOP-3245](https://issues.apache.org/jira/browse/HADOOP-3245) | *Major* | **Provide ability to persist running jobs (extend HADOOP-1876)**
-Removed deprecated org.apache.hadoop.mapred.OutputFormatBase.
+Introduced recovery of jobs when JobTracker restarts. This facility is off by default. Introduced config parameters mapred.jobtracker.restart.recover, mapred.jobtracker.job.history.block.size, and mapred.jobtracker.job.history.buffer.size.
---
-* [HADOOP-3646](https://issues.apache.org/jira/browse/HADOOP-3646) | *Major* | **Providing bzip2 as codec**
+* [HADOOP-3911](https://issues.apache.org/jira/browse/HADOOP-3911) | *Minor* | **' -blocks ' option not being recognized**
-Introduced support for bzip2 compressed files.
+Added a check to fsck options to make sure -files is not the first option so as to resolve conflicts with GenericOptionsParser.
---
-* [HADOOP-3601](https://issues.apache.org/jira/browse/HADOOP-3601) | *Minor* | **Hive as a contrib project**
+* [HADOOP-4138](https://issues.apache.org/jira/browse/HADOOP-4138) | *Major* | **[Hive] refactor the SerDe library**
-Introduced Hive Data Warehouse built on top of Hadoop that enables structuring Hadoop files as tables and partitions and allows users to query this data through a SQL like language using a command line interface.
+Introduced new SerDe library for src/contrib/hive.
---
-* [HADOOP-3595](https://issues.apache.org/jira/browse/HADOOP-3595) | *Major* | **Remove deprecated mapred.combine.once functionality**
+* [HADOOP-3722](https://issues.apache.org/jira/browse/HADOOP-3722) | *Minor* | **Provide a unified way to pass jobconf options from bin/hadoop**
- Removed deprecated methods for mapred.combine.once functionality.
+Changed streaming StreamJob and Submitter to implement Tool and Configurable, and to use GenericOptionsParser arguments -fs, -jt, -conf, -D, -libjars, -files, and -archives. Deprecated -jobconf, -cacheArchive, -dfs, -cacheArchive, -additionalconfspec, from streaming and pipes in favor of the generic options. Removed from streaming -config, -mapred.job.tracker, and -cluster.
---
-* [HADOOP-3585](https://issues.apache.org/jira/browse/HADOOP-3585) | *Minor* | **Hardware Failure Monitoring in large clusters running Hadoop/HDFS**
+* [HADOOP-4117](https://issues.apache.org/jira/browse/HADOOP-4117) | *Major* | **Improve configurability of Hadoop EC2 instances**
-Added FailMon as a contrib project for hardware failure monitoring and analysis, under /src/contrib/failmon. Created User Manual and Quick Start Guide.
+Changed scripts to pass initialization script for EC2 instances at boot time (as EC2 user data) rather than embedding initialization information in the EC2 image. This change makes it easy to customize the hadoop-site.xml file for your cluster before launch, by editing the hadoop-ec2-init-remote.sh script, or by setting the environment variable USER\_DATA\_FILE in hadoop-ec2-env.sh to run a script of your choice.
---
-* [HADOOP-3581](https://issues.apache.org/jira/browse/HADOOP-3581) | *Major* | **Prevent memory intensive user tasks from taking down nodes**
+* [HADOOP-2411](https://issues.apache.org/jira/browse/HADOOP-2411) | *Major* | **Add support for larger EC2 instance types**
-Added the ability to kill process trees transgressing memory limits. TaskTracker uses the configuration parameters introduced in HADOOP-3759. In addition, mapred.tasktracker.taskmemorymanager.monitoring-interval specifies the interval for which TT waits between cycles of monitoring tasks' memory usage, and mapred.tasktracker.procfsbasedprocesstree.sleeptime-before-sigkill specifies the time TT waits for sending a SIGKILL to a process-tree that has overrun memory limits, after it has been sent a SIGTERM.
+Added support for c1.\* instance types and associated kernels for EC2.
---
-* [HADOOP-3549](https://issues.apache.org/jira/browse/HADOOP-3549) | *Major* | **meaningful errno values in libhdfs**
+* [HADOOP-3829](https://issues.apache.org/jira/browse/HADOOP-3829) | *Major* | **Narrown down skipped records based on user acceptable value**
-Improved error reporting for libhdfs so permission problems now return EACCES.
+Introduced new config parameter org.apache.hadoop.mapred.SkipBadRecords.setMapperMaxSkipRecords to set range of records to be skipped in the neighborhood of a failed record.
---
-* [HADOOP-3498](https://issues.apache.org/jira/browse/HADOOP-3498) | *Major* | **File globbing alternation should be able to span path components**
+* [HADOOP-4084](https://issues.apache.org/jira/browse/HADOOP-4084) | *Major* | **Add explain plan capabilities to Hive QL**
-Extended file globbing alternation to cross path components. For example, {/a/b,/c/d} expands to a path that matches the files /a/b and /c/d.
+Introduced "EXPLAIN" plan for Hive.
---
-* [HADOOP-3485](https://issues.apache.org/jira/browse/HADOOP-3485) | *Minor* | **fix writes**
+* [HADOOP-3930](https://issues.apache.org/jira/browse/HADOOP-3930) | *Major* | **Decide how to integrate scheduler info into CLI and job tracker web page**
-Introduce write support for Fuse; requires Linux kernel 2.6.15 or better.
+Changed TaskScheduler to expose API for Web UI and Command Line Tool.
---
-* [HADOOP-3478](https://issues.apache.org/jira/browse/HADOOP-3478) | *Major* | **The algorithm to decide map re-execution on fetch failures can be improved**
+* [HADOOP-4106](https://issues.apache.org/jira/browse/HADOOP-4106) | *Major* | **add time, permission and user attribute support to fuse-dfs**
-Changed reducers to fetch maps in the same order for a given host to speed up identification of the faulty maps; reducers still randomize the host selection to distribute load.
+Added time, permission and user attribute support to libhdfs.
---
-* [HADOOP-3445](https://issues.apache.org/jira/browse/HADOOP-3445) | *Major* | **Implementing core scheduler functionality in Resource Manager (V1) for Hadoop**
+* [HADOOP-4176](https://issues.apache.org/jira/browse/HADOOP-4176) | *Major* | **Implement getFileChecksum(Path) in HftpFileSystem**
-Introduced Capacity Task Scheduler.
+Implemented getFileChecksum(Path) in HftpFileSystemfor distcp support.
---
-* [HADOOP-3412](https://issues.apache.org/jira/browse/HADOOP-3412) | *Minor* | **Refactor the scheduler out of the JobTracker**
+* [HADOOP-249](https://issues.apache.org/jira/browse/HADOOP-249) | *Major* | **Improving Map -\> Reduce performance and Task JVM reuse**
-Added the ability to chose between many schedulers, and to limit the number of running tasks per job.
+Enabled task JVMs to be reused via the job config mapred.job.reuse.jvm.num.tasks.
---
-* [HADOOP-3245](https://issues.apache.org/jira/browse/HADOOP-3245) | *Major* | **Provide ability to persist running jobs (extend HADOOP-1876)**
+* [HADOOP-2816](https://issues.apache.org/jira/browse/HADOOP-2816) | *Major* | **Cluster summary at name node web has confusing report for space utilization**
-Introduced recovery of jobs when JobTracker restarts. This facility is off by default. Introduced config parameters mapred.jobtracker.restart.recover, mapred.jobtracker.job.history.block.size, and mapred.jobtracker.job.history.buffer.size.
+Improved space reporting for NameNode Web UI. Applications that parse the Web UI output should be reviewed.
---
-* [HADOOP-3150](https://issues.apache.org/jira/browse/HADOOP-3150) | *Major* | **Move task file promotion into the task**
+* [HADOOP-4227](https://issues.apache.org/jira/browse/HADOOP-4227) | *Minor* | **Remove the deprecated, unused class ShellCommand.**
-Moved task file promotion to the Task. When the task has finished, it will do a commit and is declared SUCCEDED. Job cleanup is done by a separate task. Job is declared SUCCEDED/FAILED after the cleanup task has finished. Added public classes org.apache.hadoop.mapred.JobContext, TaskAttemptContext, OutputCommitter and FileOutputCommiitter. Added public APIs: public OutputCommitter getOutputCommitter() and
-public void setOutputCommitter(Class\<? extends OutputCommitter\> theClass) in org.apache.hadoop.mapred.JobConf
+Removed the deprecated class org.apache.hadoop.fs.ShellCommand.
---
-* [HADOOP-3149](https://issues.apache.org/jira/browse/HADOOP-3149) | *Major* | **supporting multiple outputs for M/R jobs**
+* [HADOOP-3019](https://issues.apache.org/jira/browse/HADOOP-3019) | *Major* | **want input sampler & sorted partitioner**
-Introduced MultipleOutputs class so Map/Reduce jobs can write data to different output files. Each output can use a different OutputFormat. Outpufiles are created within the job output directory. FileOutputFormat.getPathForCustomFile() creates a filename under the outputdir that is named with the task ID and task type (i.e. myfile-r-00001).
+Added a partitioner that effects a total order of output data, and an input sampler for generating the partition keyset for TotalOrderPartitioner for when the map's input keytype and distribution approximates its output.
---
-* [HADOOP-3062](https://issues.apache.org/jira/browse/HADOOP-3062) | *Major* | **Need to capture the metrics for the network ios generate by dfs reads/writes and map/reduce shuffling and break them down by racks**
+* [HADOOP-3938](https://issues.apache.org/jira/browse/HADOOP-3938) | *Major* | **Quotas for disk space management**
-Introduced additional log records for data transfers.
+Introducted byte space quotas for directories. The count shell command modified to report both name and byte quotas.
---
-* [HADOOP-3019](https://issues.apache.org/jira/browse/HADOOP-3019) | *Major* | **want input sampler & sorted partitioner**
+* [HADOOP-4205](https://issues.apache.org/jira/browse/HADOOP-4205) | *Major* | **[Hive] metastore and ql to use the refactored SerDe library**
-Added a partitioner that effects a total order of output data, and an input sampler for generating the partition keyset for TotalOrderPartitioner for when the map's input keytype and distribution approximates its output.
+Improved Hive metastore and ql to use the refactored SerDe library.
---
-* [HADOOP-2816](https://issues.apache.org/jira/browse/HADOOP-2816) | *Major* | **Cluster summary at name node web has confusing report for space utilization**
+* [HADOOP-4116](https://issues.apache.org/jira/browse/HADOOP-4116) | *Blocker* | **Balancer should provide better resource management**
-Improved space reporting for NameNode Web UI. Applications that parse the Web UI output should be reviewed.
+Changed DataNode protocol version without impact to clients other than to compel use of current version of client application.
---
-* [HADOOP-2664](https://issues.apache.org/jira/browse/HADOOP-2664) | *Major* | **lzop-compatible CompresionCodec**
+* [HADOOP-4190](https://issues.apache.org/jira/browse/HADOOP-4190) | *Blocker* | **Changes to JobHistory makes it backward incompatible**
-Introduced LZOP codec.
+Changed job history format to add a dot at end of each line.
---
-* [HADOOP-2411](https://issues.apache.org/jira/browse/HADOOP-2411) | *Major* | **Add support for larger EC2 instance types**
+* [HADOOP-4293](https://issues.apache.org/jira/browse/HADOOP-4293) | *Major* | **Remove WritableJobConf**
-Added support for c1.\* instance types and associated kernels for EC2.
+Made Configuration Writable and rename the old write method to writeXml.
---
-* [HADOOP-2325](https://issues.apache.org/jira/browse/HADOOP-2325) | *Major* | **Require Java 6**
+* [HADOOP-4281](https://issues.apache.org/jira/browse/HADOOP-4281) | *Blocker* | **Capacity reported in some of the commands is not consistent with the Web UI reported data**
-Hadoop now requires Java 6.
+Changed command "hadoop dfsadmin -report" to be consistent with Web UI for both Namenode and Datanode reports. "Total raw bytes" is changed to "Configured Capacity". "Present Capacity" is newly added to indicate the present capacity of the DFS. "Remaining raw bytes" is changed to "DFS Remaining". "Used raw bytes" is changed to "DFS Used". "% used" is changed to "DFS Used%". Applications that parse command output should be reviewed.
---
-* [HADOOP-2302](https://issues.apache.org/jira/browse/HADOOP-2302) | *Major* | ** Streaming should provide an option for numerical sort of keys**
+* [HADOOP-4018](https://issues.apache.org/jira/browse/HADOOP-4018) | *Major* | **limit memory usage in jobtracker**
-Introduced numerical key comparison for streaming.
+Introduced new configuration parameter mapred.max.tasks.per.job to specifie the maximum number of tasks per job.
---
-* [HADOOP-1869](https://issues.apache.org/jira/browse/HADOOP-1869) | *Major* | **access times of HDFS files**
+* [HADOOP-4430](https://issues.apache.org/jira/browse/HADOOP-4430) | *Blocker* | **Namenode Web UI capacity report is inconsistent with Balancer**
-Added HDFS file access times. By default, access times will be precise to the most recent hour boundary. A configuration parameter dfs.access.time.precision (milliseconds) is used to control this precision. Setting a value of 0 will disable persisting access times for HDFS files.
+Changed reporting in the NameNode Web UI to more closely reflect the behavior of the re-balancer. Removed no longer used config parameter dfs.datanode.du.pct from hadoop-default.xml.
---
-* [HADOOP-1823](https://issues.apache.org/jira/browse/HADOOP-1823) | *Major* | **want InputFormat for bzip2 files**
+* [HADOOP-4086](https://issues.apache.org/jira/browse/HADOOP-4086) | *Major* | **Add limit to Hive QL**
-bzip2 provided as codec in 0.19.0 https://issues.apache.org/jira/browse/HADOOP-3646
+Added LIMIT to Hive query language.
---
-* [HADOOP-1700](https://issues.apache.org/jira/browse/HADOOP-1700) | *Major* | **Append to files in HDFS**
+* [HADOOP-4466](https://issues.apache.org/jira/browse/HADOOP-4466) | *Blocker* | **SequenceFileOutputFormat is coupled to WritableComparable and Writable**
-Introduced append operation for HDFS files.
+Ensure that SequenceFileOutputFormat isn't tied to Writables and can be used with other Serialization frameworks.
---
-* [HADOOP-249](https://issues.apache.org/jira/browse/HADOOP-249) | *Major* | **Improving Map -\> Reduce performance and Task JVM reuse**
+* [HADOOP-4433](https://issues.apache.org/jira/browse/HADOOP-4433) | *Major* | **Improve data loader for collecting metrics and log files from hadoop and system**
-Enabled task JVMs to be reused via the job config mapred.job.reuse.jvm.num.tasks.
+- Added startup and shutdown script
+- Added torque metrics data loader
+- Improve handling of Exec Plugin
+- Added Test cases for File Tailing Adaptors
+- Added Test cases for Start streaming at specific offset
---
-* [HADOOP-153](https://issues.apache.org/jira/browse/HADOOP-153) | *Major* | **skip records that fail Task**
+* [HADOOP-1823](https://issues.apache.org/jira/browse/HADOOP-1823) | *Major* | **want InputFormat for bzip2 files**
-Introduced record skipping where tasks fail on certain records. (org.apache.hadoop.mapred.SkipBadRecords)
+bzip2 provided as codec in 0.19.0 https://issues.apache.org/jira/browse/HADOOP-3646
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.1/CHANGES.0.19.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.1/CHANGES.0.19.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.1/CHANGES.0.19.1.md
index fcc53f1..c9751c9 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.1/CHANGES.0.19.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.1/CHANGES.0.19.1.md
@@ -24,15 +24,9 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-4061](https://issues.apache.org/jira/browse/HADOOP-4061) | Large number of decommission freezes the Namenode | Major | . | Koji Noguchi | Tsz Wo Nicholas Sze |
| [HADOOP-5225](https://issues.apache.org/jira/browse/HADOOP-5225) | workaround for tmp file handling on DataNodes in 0.19.1 (HADOOP-4663) | Blocker | . | Nigel Daley | Raghu Angadi |
| [HADOOP-5224](https://issues.apache.org/jira/browse/HADOOP-5224) | Disable append | Blocker | . | Nigel Daley | |
-| [HADOOP-4061](https://issues.apache.org/jira/browse/HADOOP-4061) | Large number of decommission freezes the Namenode | Major | . | Koji Noguchi | Tsz Wo Nicholas Sze |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
@@ -46,73 +40,55 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-5127](https://issues.apache.org/jira/browse/HADOOP-5127) | FSDirectory should not have public methods. | Major | . | Konstantin Shvachko | Jakob Homan |
-| [HADOOP-5086](https://issues.apache.org/jira/browse/HADOOP-5086) | Trash URI semantics can be relaxed | Minor | fs | Chris Douglas | Chris Douglas |
| [HADOOP-4739](https://issues.apache.org/jira/browse/HADOOP-4739) | Minor enhancements to some sections of the Map/Reduce tutorial | Trivial | . | Vivek Ratan | Vivek Ratan |
| [HADOOP-3894](https://issues.apache.org/jira/browse/HADOOP-3894) | DFSClient chould log errors better, and provide better diagnostics | Trivial | . | Steve Loughran | Steve Loughran |
+| [HADOOP-5086](https://issues.apache.org/jira/browse/HADOOP-5086) | Trash URI semantics can be relaxed | Minor | fs | Chris Douglas | Chris Douglas |
+| [HADOOP-5127](https://issues.apache.org/jira/browse/HADOOP-5127) | FSDirectory should not have public methods. | Major | . | Konstantin Shvachko | Jakob Homan |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-5665](https://issues.apache.org/jira/browse/HADOOP-5665) | Namenode could not be formatted because the "whoami" program could not be run. | Major | . | Evelyn Sylvia | |
-| [HADOOP-5268](https://issues.apache.org/jira/browse/HADOOP-5268) | Using MultipleOutputFormat and setting reducers to 0 causes org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException and job to fail | Major | . | Thibaut | |
-| [HADOOP-5193](https://issues.apache.org/jira/browse/HADOOP-5193) | SecondaryNameNode does not rollImage because of incorrect calculation of edits modification time. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-5192](https://issues.apache.org/jira/browse/HADOOP-5192) | Block reciever should not remove a finalized block when block replication fails | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5166](https://issues.apache.org/jira/browse/HADOOP-5166) | JobTracker fails to restart if recovery and ACLs are enabled | Blocker | . | Karam Singh | Amar Kamat |
-| [HADOOP-5161](https://issues.apache.org/jira/browse/HADOOP-5161) | Accepted sockets do not get placed in DataXceiverServer#childSockets | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5156](https://issues.apache.org/jira/browse/HADOOP-5156) | TestHeartbeatHandling uses MiniDFSCluster.getNamesystem() which does not exist in branch 0.20 | Major | test | Konstantin Shvachko | Hairong Kuang |
-| [HADOOP-5134](https://issues.apache.org/jira/browse/HADOOP-5134) | FSNamesystem#commitBlockSynchronization adds under-construction block locations to blocksMap | Blocker | . | Hairong Kuang | dhruba borthakur |
-| [HADOOP-5067](https://issues.apache.org/jira/browse/HADOOP-5067) | Failed/Killed attempts column in jobdetails.jsp does not show the number of failed/killed attempts correctly | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-5009](https://issues.apache.org/jira/browse/HADOOP-5009) | DataNode#shutdown sometimes leaves data block scanner verification log unclosed | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5008](https://issues.apache.org/jira/browse/HADOOP-5008) | TestReplication#testPendingReplicationRetry leaves an opened fd unclosed | Major | test | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5002](https://issues.apache.org/jira/browse/HADOOP-5002) | 2 core tests TestFileOutputFormat and TestHarFileSystem are failing in branch 19 | Blocker | . | Ravi Gummadi | Amareshwari Sriramadasu |
+| [HADOOP-4616](https://issues.apache.org/jira/browse/HADOOP-4616) | assertion makes fuse-dfs exit when reading incomplete data | Blocker | . | Marc-Olivier Fleury | Pete Wyckoff |
+| [HADOOP-4697](https://issues.apache.org/jira/browse/HADOOP-4697) | KFS::getBlockLocations() fails with files having multiple blocks | Major | fs | Lohit Vijayarenu | Sriram Rao |
+| [HADOOP-4720](https://issues.apache.org/jira/browse/HADOOP-4720) | docs/api does not contain the hdfs directory after building | Major | build | Ramya Sunil | |
+| [HADOOP-4635](https://issues.apache.org/jira/browse/HADOOP-4635) | Memory leak ? | Blocker | . | Marc-Olivier Fleury | Pete Wyckoff |
+| [HADOOP-4420](https://issues.apache.org/jira/browse/HADOOP-4420) | JobTracker.killJob() doesn't check for the JobID being valid | Minor | . | Steve Loughran | Aaron Kimball |
+| [HADOOP-4632](https://issues.apache.org/jira/browse/HADOOP-4632) | TestJobHistoryVersion should not create directory in current dir. | Major | . | Amareshwari Sriramadasu | Amar Kamat |
+| [HADOOP-4508](https://issues.apache.org/jira/browse/HADOOP-4508) | FSDataOutputStream.getPos() == 0when appending to existing file and should be file length | Major | fs | Pete Wyckoff | dhruba borthakur |
+| [HADOOP-4727](https://issues.apache.org/jira/browse/HADOOP-4727) | Groups do not work for fuse-dfs out of the box on 0.19.0 | Blocker | . | Brian Bockelman | Brian Bockelman |
+| [HADOOP-4731](https://issues.apache.org/jira/browse/HADOOP-4731) | Job is not removed from the waiting jobs queue upon completion. | Major | . | Hemanth Yamijala | Amar Kamat |
+| [HADOOP-4836](https://issues.apache.org/jira/browse/HADOOP-4836) | Minor typos in documentation and comments | Trivial | documentation | Jordà Polo | Jordà Polo |
+| [HADOOP-4821](https://issues.apache.org/jira/browse/HADOOP-4821) | Usage description in the Quotas guide documentations are incorrect | Minor | documentation | Boris Shkolnik | Boris Shkolnik |
+| [HADOOP-4797](https://issues.apache.org/jira/browse/HADOOP-4797) | RPC Server can leave a lot of direct buffers | Blocker | ipc | Raghu Angadi | Raghu Angadi |
+| [HADOOP-4924](https://issues.apache.org/jira/browse/HADOOP-4924) | Race condition in re-init of TaskTracker | Blocker | . | Devaraj Das | Devaraj Das |
+| [HADOOP-4847](https://issues.apache.org/jira/browse/HADOOP-4847) | OutputCommitter is loaded in the TaskTracker in localizeConfiguration | Blocker | . | Owen O'Malley | Amareshwari Sriramadasu |
+| [HADOOP-4966](https://issues.apache.org/jira/browse/HADOOP-4966) | Setup tasks are not removed from JobTracker's taskIdToTIPMap even after the job completes | Major | . | Amar Kamat | Amareshwari Sriramadasu |
| [HADOOP-4992](https://issues.apache.org/jira/browse/HADOOP-4992) | TestCustomOutputCommitter fails on hadoop-0.19 | Blocker | . | Amar Kamat | Amareshwari Sriramadasu |
-| [HADOOP-4983](https://issues.apache.org/jira/browse/HADOOP-4983) | Job counters sometimes go down as tasks run without task failures | Critical | . | Owen O'Malley | Amareshwari Sriramadasu |
| [HADOOP-4982](https://issues.apache.org/jira/browse/HADOOP-4982) | TestFsck does not run in Eclipse. | Major | test | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-4967](https://issues.apache.org/jira/browse/HADOOP-4967) | Inconsistent state in JVM manager | Major | . | Amareshwari Sriramadasu | Devaraj Das |
-| [HADOOP-4966](https://issues.apache.org/jira/browse/HADOOP-4966) | Setup tasks are not removed from JobTracker's taskIdToTIPMap even after the job completes | Major | . | Amar Kamat | Amareshwari Sriramadasu |
-| [HADOOP-4965](https://issues.apache.org/jira/browse/HADOOP-4965) | DFSClient should log instead of printing into std err. | Major | test | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-4955](https://issues.apache.org/jira/browse/HADOOP-4955) | Make DBOutputFormat us column names from setOutput(...) | Major | . | Kevin Peterson | Kevin Peterson |
+| [HADOOP-5008](https://issues.apache.org/jira/browse/HADOOP-5008) | TestReplication#testPendingReplicationRetry leaves an opened fd unclosed | Major | test | Hairong Kuang | Hairong Kuang |
| [HADOOP-4943](https://issues.apache.org/jira/browse/HADOOP-4943) | fair share scheduler does not utilize all slots if the task trackers are configured heterogeneously | Major | . | Zheng Shao | Zheng Shao |
-| [HADOOP-4924](https://issues.apache.org/jira/browse/HADOOP-4924) | Race condition in re-init of TaskTracker | Blocker | . | Devaraj Das | Devaraj Das |
-| [HADOOP-4918](https://issues.apache.org/jira/browse/HADOOP-4918) | Fix bzip2 work with SequenceFile | Major | io | Zheng Shao | Zheng Shao |
| [HADOOP-4906](https://issues.apache.org/jira/browse/HADOOP-4906) | TaskTracker running out of memory after running several tasks | Blocker | . | Arun C Murthy | Sharad Agarwal |
+| [HADOOP-4918](https://issues.apache.org/jira/browse/HADOOP-4918) | Fix bzip2 work with SequenceFile | Major | io | Zheng Shao | Zheng Shao |
+| [HADOOP-4965](https://issues.apache.org/jira/browse/HADOOP-4965) | DFSClient should log instead of printing into std err. | Major | test | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-4967](https://issues.apache.org/jira/browse/HADOOP-4967) | Inconsistent state in JVM manager | Major | . | Amareshwari Sriramadasu | Devaraj Das |
+| [HADOOP-5002](https://issues.apache.org/jira/browse/HADOOP-5002) | 2 core tests TestFileOutputFormat and TestHarFileSystem are failing in branch 19 | Blocker | . | Ravi Gummadi | Amareshwari Sriramadasu |
+| [HADOOP-4983](https://issues.apache.org/jira/browse/HADOOP-4983) | Job counters sometimes go down as tasks run without task failures | Critical | . | Owen O'Malley | Amareshwari Sriramadasu |
+| [HADOOP-5009](https://issues.apache.org/jira/browse/HADOOP-5009) | DataNode#shutdown sometimes leaves data block scanner verification log unclosed | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-4955](https://issues.apache.org/jira/browse/HADOOP-4955) | Make DBOutputFormat us column names from setOutput(...) | Major | . | Kevin Peterson | Kevin Peterson |
| [HADOOP-4862](https://issues.apache.org/jira/browse/HADOOP-4862) | A spurious IOException log on DataNode is not completely removed | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-4847](https://issues.apache.org/jira/browse/HADOOP-4847) | OutputCommitter is loaded in the TaskTracker in localizeConfiguration | Blocker | . | Owen O'Malley | Amareshwari Sriramadasu |
-| [HADOOP-4836](https://issues.apache.org/jira/browse/HADOOP-4836) | Minor typos in documentation and comments | Trivial | documentation | Jordà Polo | Jordà Polo |
-| [HADOOP-4821](https://issues.apache.org/jira/browse/HADOOP-4821) | Usage description in the Quotas guide documentations are incorrect | Minor | documentation | Boris Shkolnik | Boris Shkolnik |
-| [HADOOP-4797](https://issues.apache.org/jira/browse/HADOOP-4797) | RPC Server can leave a lot of direct buffers | Blocker | ipc | Raghu Angadi | Raghu Angadi |
-| [HADOOP-4760](https://issues.apache.org/jira/browse/HADOOP-4760) | HDFS streams should not throw exceptions when closed twice | Major | fs, fs/s3 | Alejandro Abdelnur | Enis Soztutar |
+| [HADOOP-5156](https://issues.apache.org/jira/browse/HADOOP-5156) | TestHeartbeatHandling uses MiniDFSCluster.getNamesystem() which does not exist in branch 0.20 | Major | test | Konstantin Shvachko | Hairong Kuang |
| [HADOOP-4759](https://issues.apache.org/jira/browse/HADOOP-4759) | HADOOP-4654 to be fixed for branches \>= 0.19 | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-4731](https://issues.apache.org/jira/browse/HADOOP-4731) | Job is not removed from the waiting jobs queue upon completion. | Major | . | Hemanth Yamijala | Amar Kamat |
-| [HADOOP-4727](https://issues.apache.org/jira/browse/HADOOP-4727) | Groups do not work for fuse-dfs out of the box on 0.19.0 | Blocker | . | Brian Bockelman | Brian Bockelman |
-| [HADOOP-4720](https://issues.apache.org/jira/browse/HADOOP-4720) | docs/api does not contain the hdfs directory after building | Major | build | Ramya Sunil | |
-| [HADOOP-4697](https://issues.apache.org/jira/browse/HADOOP-4697) | KFS::getBlockLocations() fails with files having multiple blocks | Major | fs | Lohit Vijayarenu | Sriram Rao |
-| [HADOOP-4635](https://issues.apache.org/jira/browse/HADOOP-4635) | Memory leak ? | Blocker | . | Marc-Olivier Fleury | Pete Wyckoff |
-| [HADOOP-4632](https://issues.apache.org/jira/browse/HADOOP-4632) | TestJobHistoryVersion should not create directory in current dir. | Major | . | Amareshwari Sriramadasu | Amar Kamat |
-| [HADOOP-4616](https://issues.apache.org/jira/browse/HADOOP-4616) | assertion makes fuse-dfs exit when reading incomplete data | Blocker | . | Marc-Olivier Fleury | Pete Wyckoff |
-| [HADOOP-4508](https://issues.apache.org/jira/browse/HADOOP-4508) | FSDataOutputStream.getPos() == 0when appending to existing file and should be file length | Major | fs | Pete Wyckoff | dhruba borthakur |
+| [HADOOP-5161](https://issues.apache.org/jira/browse/HADOOP-5161) | Accepted sockets do not get placed in DataXceiverServer#childSockets | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5193](https://issues.apache.org/jira/browse/HADOOP-5193) | SecondaryNameNode does not rollImage because of incorrect calculation of edits modification time. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
| [HADOOP-4494](https://issues.apache.org/jira/browse/HADOOP-4494) | libhdfs does not call FileSystem.append when O\_APPEND passed to hdfsOpenFile | Major | . | Pete Wyckoff | Pete Wyckoff |
-| [HADOOP-4420](https://issues.apache.org/jira/browse/HADOOP-4420) | JobTracker.killJob() doesn't check for the JobID being valid | Minor | . | Steve Loughran | Aaron Kimball |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-5166](https://issues.apache.org/jira/browse/HADOOP-5166) | JobTracker fails to restart if recovery and ACLs are enabled | Blocker | . | Karam Singh | Amar Kamat |
+| [HADOOP-5192](https://issues.apache.org/jira/browse/HADOOP-5192) | Block reciever should not remove a finalized block when block replication fails | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5067](https://issues.apache.org/jira/browse/HADOOP-5067) | Failed/Killed attempts column in jobdetails.jsp does not show the number of failed/killed attempts correctly | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-4760](https://issues.apache.org/jira/browse/HADOOP-4760) | HDFS streams should not throw exceptions when closed twice | Major | fs, fs/s3 | Alejandro Abdelnur | Enis Soztutar |
+| [HADOOP-5134](https://issues.apache.org/jira/browse/HADOOP-5134) | FSNamesystem#commitBlockSynchronization adds under-construction block locations to blocksMap | Blocker | . | Hairong Kuang | dhruba borthakur |
+| [HADOOP-5268](https://issues.apache.org/jira/browse/HADOOP-5268) | Using MultipleOutputFormat and setting reducers to 0 causes org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException and job to fail | Major | . | Thibaut | |
+| [HADOOP-5665](https://issues.apache.org/jira/browse/HADOOP-5665) | Namenode could not be formatted because the "whoami" program could not be run. | Major | . | Evelyn Sylvia | |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.1/RELEASENOTES.0.19.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.1/RELEASENOTES.0.19.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.1/RELEASENOTES.0.19.1.md
index f236710..a40576c 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.1/RELEASENOTES.0.19.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.1/RELEASENOTES.0.19.1.md
@@ -23,44 +23,44 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-5225](https://issues.apache.org/jira/browse/HADOOP-5225) | *Blocker* | **workaround for tmp file handling on DataNodes in 0.19.1 (HADOOP-4663)**
+* [HADOOP-4061](https://issues.apache.org/jira/browse/HADOOP-4061) | *Major* | **Large number of decommission freezes the Namenode**
-Work around for tmp file handling. sync() does not work as a result.
+Added a new conf property dfs.namenode.decommission.nodes.per.interval so that NameNode checks decommission status of x nodes for every y seconds, where x is the value of dfs.namenode.decommission.nodes.per.interval and y is the value of dfs.namenode.decommission.interval.
---
-* [HADOOP-5224](https://issues.apache.org/jira/browse/HADOOP-5224) | *Blocker* | **Disable append**
+* [HADOOP-4635](https://issues.apache.org/jira/browse/HADOOP-4635) | *Blocker* | **Memory leak ?**
-HDFS append() is disabled. It throws UnsupportedOperationException.
+fix memory leak of user/group information in fuse-dfs
---
-* [HADOOP-5034](https://issues.apache.org/jira/browse/HADOOP-5034) | *Major* | **NameNode should send both replication and deletion requests to DataNode in one reply to a heartbeat**
+* [HADOOP-4797](https://issues.apache.org/jira/browse/HADOOP-4797) | *Blocker* | **RPC Server can leave a lot of direct buffers**
-This patch changes the DatanodeProtocoal version number from 18 to 19. The patch allows NameNode to send both block replication and deletion request to a DataNode in response to a heartbeat.
+Improve how RPC server reads and writes large buffers. Avoids soft-leak of direct buffers and excess copies in NIO layer.
---
-* [HADOOP-5002](https://issues.apache.org/jira/browse/HADOOP-5002) | *Blocker* | **2 core tests TestFileOutputFormat and TestHarFileSystem are failing in branch 19**
+* [HADOOP-4943](https://issues.apache.org/jira/browse/HADOOP-4943) | *Major* | **fair share scheduler does not utilize all slots if the task trackers are configured heterogeneously**
-This patch solves the null pointer exception issue in the 2 core tests TestFileOutputFormat and TestHarFileSystem in branch 19.
+HADOOP-4943: Fixed fair share scheduler to utilize all slots when the task trackers are configured heterogeneously.
---
-* [HADOOP-4943](https://issues.apache.org/jira/browse/HADOOP-4943) | *Major* | **fair share scheduler does not utilize all slots if the task trackers are configured heterogeneously**
+* [HADOOP-4906](https://issues.apache.org/jira/browse/HADOOP-4906) | *Blocker* | **TaskTracker running out of memory after running several tasks**
-HADOOP-4943: Fixed fair share scheduler to utilize all slots when the task trackers are configured heterogeneously.
+Fix the tasktracker for OOM exception by sharing the jobconf properties across tasks of the same job. Earlier a new instance was held for each task. With this fix, the job level configuration properties are shared across tasks of the same job.
---
-* [HADOOP-4906](https://issues.apache.org/jira/browse/HADOOP-4906) | *Blocker* | **TaskTracker running out of memory after running several tasks**
+* [HADOOP-5002](https://issues.apache.org/jira/browse/HADOOP-5002) | *Blocker* | **2 core tests TestFileOutputFormat and TestHarFileSystem are failing in branch 19**
-Fix the tasktracker for OOM exception by sharing the jobconf properties across tasks of the same job. Earlier a new instance was held for each task. With this fix, the job level configuration properties are shared across tasks of the same job.
+This patch solves the null pointer exception issue in the 2 core tests TestFileOutputFormat and TestHarFileSystem in branch 19.
---
@@ -72,30 +72,30 @@ Minor : HADOOP-3678 did not remove all the cases of spurious IOExceptions logged
---
-* [HADOOP-4797](https://issues.apache.org/jira/browse/HADOOP-4797) | *Blocker* | **RPC Server can leave a lot of direct buffers**
+* [HADOOP-5034](https://issues.apache.org/jira/browse/HADOOP-5034) | *Major* | **NameNode should send both replication and deletion requests to DataNode in one reply to a heartbeat**
-Improve how RPC server reads and writes large buffers. Avoids soft-leak of direct buffers and excess copies in NIO layer.
+This patch changes the DatanodeProtocoal version number from 18 to 19. The patch allows NameNode to send both block replication and deletion request to a DataNode in response to a heartbeat.
---
-* [HADOOP-4635](https://issues.apache.org/jira/browse/HADOOP-4635) | *Blocker* | **Memory leak ?**
+* [HADOOP-4494](https://issues.apache.org/jira/browse/HADOOP-4494) | *Major* | **libhdfs does not call FileSystem.append when O\_APPEND passed to hdfsOpenFile**
-fix memory leak of user/group information in fuse-dfs
+libhdfs supports O\_APPEND flag
---
-* [HADOOP-4494](https://issues.apache.org/jira/browse/HADOOP-4494) | *Major* | **libhdfs does not call FileSystem.append when O\_APPEND passed to hdfsOpenFile**
+* [HADOOP-5225](https://issues.apache.org/jira/browse/HADOOP-5225) | *Blocker* | **workaround for tmp file handling on DataNodes in 0.19.1 (HADOOP-4663)**
-libhdfs supports O\_APPEND flag
+Work around for tmp file handling. sync() does not work as a result.
---
-* [HADOOP-4061](https://issues.apache.org/jira/browse/HADOOP-4061) | *Major* | **Large number of decommission freezes the Namenode**
+* [HADOOP-5224](https://issues.apache.org/jira/browse/HADOOP-5224) | *Blocker* | **Disable append**
-Added a new conf property dfs.namenode.decommission.nodes.per.interval so that NameNode checks decommission status of x nodes for every y seconds, where x is the value of dfs.namenode.decommission.nodes.per.interval and y is the value of dfs.namenode.decommission.interval.
+HDFS append() is disabled. It throws UnsupportedOperationException.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.2/CHANGES.0.19.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.2/CHANGES.0.19.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.2/CHANGES.0.19.2.md
index 2071806..e83c766 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.2/CHANGES.0.19.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.19.2/CHANGES.0.19.2.md
@@ -27,18 +27,6 @@
| [HADOOP-5332](https://issues.apache.org/jira/browse/HADOOP-5332) | Make support for file append API configurable | Blocker | . | Nigel Daley | dhruba borthakur |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
@@ -50,61 +38,43 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-6017](https://issues.apache.org/jira/browse/HADOOP-6017) | NameNode and SecondaryNameNode fail to restart because of abnormal filenames. | Blocker | . | Raghu Angadi | Tsz Wo Nicholas Sze |
-| [HADOOP-5951](https://issues.apache.org/jira/browse/HADOOP-5951) | StorageInfo needs Apache license header. | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-5816](https://issues.apache.org/jira/browse/HADOOP-5816) | ArrayIndexOutOfBoundsException when using KeyFieldBasedComparator | Minor | . | Min Zhou | He Yongqiang |
-| [HADOOP-5728](https://issues.apache.org/jira/browse/HADOOP-5728) | FSEditLog.printStatistics may cause IndexOutOfBoundsException | Major | . | Wang Xu | Wang Xu |
-| [HADOOP-5671](https://issues.apache.org/jira/browse/HADOOP-5671) | DistCp.sameFile(..) should return true if src fs does not support checksum | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-5644](https://issues.apache.org/jira/browse/HADOOP-5644) | Namnode is stuck in safe mode | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-5579](https://issues.apache.org/jira/browse/HADOOP-5579) | libhdfs does not set errno correctly | Major | . | Brian Bockelman | Brian Bockelman |
-| [HADOOP-5557](https://issues.apache.org/jira/browse/HADOOP-5557) | Two minor problems in TestOverReplicatedBlocks | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-5554](https://issues.apache.org/jira/browse/HADOOP-5554) | DataNodeCluster should create blocks with the same generation stamp as the blocks created in CreateEditsLog | Major | test | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5551](https://issues.apache.org/jira/browse/HADOOP-5551) | Namenode permits directory destruction on overwrite | Critical | . | Brian Bockelman | Brian Bockelman |
-| [HADOOP-5549](https://issues.apache.org/jira/browse/HADOOP-5549) | ReplicationMonitor should schedule both replication and deletion work in one iteration | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5522](https://issues.apache.org/jira/browse/HADOOP-5522) | Document job setup/cleaup tasks and task cleanup tasks in mapred tutorial | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-5479](https://issues.apache.org/jira/browse/HADOOP-5479) | NameNode should not send empty block replication request to DataNode | Critical | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5465](https://issues.apache.org/jira/browse/HADOOP-5465) | Blocks remain under-replicated | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5449](https://issues.apache.org/jira/browse/HADOOP-5449) | Verify if JobHistory.HistoryCleaner works as expected | Blocker | . | Amar Kamat | Amareshwari Sriramadasu |
-| [HADOOP-5446](https://issues.apache.org/jira/browse/HADOOP-5446) | TaskTracker metrics are disabled | Major | metrics | Chris Douglas | Chris Douglas |
-| [HADOOP-5440](https://issues.apache.org/jira/browse/HADOOP-5440) | Successful taskid are not removed from TaskMemoryManager | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-5421](https://issues.apache.org/jira/browse/HADOOP-5421) | HADOOP-4638 has broken 0.19 compilation | Blocker | . | Amar Kamat | Devaraj Das |
-| [HADOOP-5392](https://issues.apache.org/jira/browse/HADOOP-5392) | JobTracker crashes during recovery if job files are garbled | Blocker | . | Amar Kamat | Amar Kamat |
-| [HADOOP-5384](https://issues.apache.org/jira/browse/HADOOP-5384) | DataNodeCluster should not create blocks with generationStamp == 1 | Blocker | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-5376](https://issues.apache.org/jira/browse/HADOOP-5376) | JobInProgress.obtainTaskCleanupTask() throws an ArrayIndexOutOfBoundsException | Blocker | . | Vinod Kumar Vavilapalli | Amareshwari Sriramadasu |
-| [HADOOP-5374](https://issues.apache.org/jira/browse/HADOOP-5374) | NPE in JobTracker.getTasksToSave() method | Major | . | Vinod Kumar Vavilapalli | Amareshwari Sriramadasu |
-| [HADOOP-5333](https://issues.apache.org/jira/browse/HADOOP-5333) | The libhdfs append API is not coded correctly | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-5326](https://issues.apache.org/jira/browse/HADOOP-5326) | bzip2 codec (CBZip2OutputStream) creates corrupted output file for some inputs | Major | io | Rodrigo Schmidt | Rodrigo Schmidt |
-| [HADOOP-5285](https://issues.apache.org/jira/browse/HADOOP-5285) | JobTracker hangs for long periods of time | Blocker | . | Vinod Kumar Vavilapalli | Devaraj Das |
-| [HADOOP-5280](https://issues.apache.org/jira/browse/HADOOP-5280) | When expiring a lost launched task, JT doesn't remove the attempt from the taskidToTIPMap. | Blocker | . | Vinod Kumar Vavilapalli | Devaraj Das |
| [HADOOP-5269](https://issues.apache.org/jira/browse/HADOOP-5269) | TaskTracker.runningTasks holding FAILED\_UNCLEAN and KILLED\_UNCLEAN taskStatuses forever in some cases. | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-5233](https://issues.apache.org/jira/browse/HADOOP-5233) | Reducer not Succeded after 100% | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
| [HADOOP-5247](https://issues.apache.org/jira/browse/HADOOP-5247) | NPEs in JobTracker and JobClient when mapred.jobtracker.completeuserjobs.maximum is set to zero. | Blocker | . | Vinod Kumar Vavilapalli | Amar Kamat |
+| [HADOOP-5285](https://issues.apache.org/jira/browse/HADOOP-5285) | JobTracker hangs for long periods of time | Blocker | . | Vinod Kumar Vavilapalli | Devaraj Das |
| [HADOOP-5241](https://issues.apache.org/jira/browse/HADOOP-5241) | Reduce tasks get stuck because of over-estimated task size (regression from 0.18) | Blocker | . | Andy Pavlo | Sharad Agarwal |
-| [HADOOP-5233](https://issues.apache.org/jira/browse/HADOOP-5233) | Reducer not Succeded after 100% | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-5231](https://issues.apache.org/jira/browse/HADOOP-5231) | Negative number of maps in cluster summary | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-5213](https://issues.apache.org/jira/browse/HADOOP-5213) | BZip2CompressionOutputStream NullPointerException | Blocker | io | Zheng Shao | Zheng Shao |
+| [HADOOP-5280](https://issues.apache.org/jira/browse/HADOOP-5280) | When expiring a lost launched task, JT doesn't remove the attempt from the taskidToTIPMap. | Blocker | . | Vinod Kumar Vavilapalli | Devaraj Das |
| [HADOOP-5154](https://issues.apache.org/jira/browse/HADOOP-5154) | 4-way deadlock in FairShare scheduler | Blocker | . | Vinod Kumar Vavilapalli | Matei Zaharia |
| [HADOOP-5146](https://issues.apache.org/jira/browse/HADOOP-5146) | LocalDirAllocator misses files on the local filesystem | Blocker | . | Arun C Murthy | Devaraj Das |
-| [HADOOP-4780](https://issues.apache.org/jira/browse/HADOOP-4780) | Task Tracker burns a lot of cpu in calling getLocalCache | Major | . | Runping Qi | He Yongqiang |
-| [HADOOP-4719](https://issues.apache.org/jira/browse/HADOOP-4719) | The ls shell command documentation is out-dated | Major | documentation | Tsz Wo Nicholas Sze | Ravi Phulari |
+| [HADOOP-5326](https://issues.apache.org/jira/browse/HADOOP-5326) | bzip2 codec (CBZip2OutputStream) creates corrupted output file for some inputs | Major | io | Rodrigo Schmidt | Rodrigo Schmidt |
| [HADOOP-4638](https://issues.apache.org/jira/browse/HADOOP-4638) | Exception thrown in/from RecoveryManager.recover() should be caught and handled | Blocker | . | Amar Kamat | Amar Kamat |
+| [HADOOP-5384](https://issues.apache.org/jira/browse/HADOOP-5384) | DataNodeCluster should not create blocks with generationStamp == 1 | Blocker | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-5376](https://issues.apache.org/jira/browse/HADOOP-5376) | JobInProgress.obtainTaskCleanupTask() throws an ArrayIndexOutOfBoundsException | Blocker | . | Vinod Kumar Vavilapalli | Amareshwari Sriramadasu |
+| [HADOOP-5421](https://issues.apache.org/jira/browse/HADOOP-5421) | HADOOP-4638 has broken 0.19 compilation | Blocker | . | Amar Kamat | Devaraj Das |
+| [HADOOP-5392](https://issues.apache.org/jira/browse/HADOOP-5392) | JobTracker crashes during recovery if job files are garbled | Blocker | . | Amar Kamat | Amar Kamat |
+| [HADOOP-5333](https://issues.apache.org/jira/browse/HADOOP-5333) | The libhdfs append API is not coded correctly | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-3998](https://issues.apache.org/jira/browse/HADOOP-3998) | Got an exception from ClientFinalizer when the JT is terminated | Blocker | . | Amar Kamat | dhruba borthakur |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-5440](https://issues.apache.org/jira/browse/HADOOP-5440) | Successful taskid are not removed from TaskMemoryManager | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-5446](https://issues.apache.org/jira/browse/HADOOP-5446) | TaskTracker metrics are disabled | Major | metrics | Chris Douglas | Chris Douglas |
+| [HADOOP-5449](https://issues.apache.org/jira/browse/HADOOP-5449) | Verify if JobHistory.HistoryCleaner works as expected | Blocker | . | Amar Kamat | Amareshwari Sriramadasu |
+| [HADOOP-5465](https://issues.apache.org/jira/browse/HADOOP-5465) | Blocks remain under-replicated | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5479](https://issues.apache.org/jira/browse/HADOOP-5479) | NameNode should not send empty block replication request to DataNode | Critical | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5522](https://issues.apache.org/jira/browse/HADOOP-5522) | Document job setup/cleaup tasks and task cleanup tasks in mapred tutorial | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-5549](https://issues.apache.org/jira/browse/HADOOP-5549) | ReplicationMonitor should schedule both replication and deletion work in one iteration | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5554](https://issues.apache.org/jira/browse/HADOOP-5554) | DataNodeCluster should create blocks with the same generation stamp as the blocks created in CreateEditsLog | Major | test | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5557](https://issues.apache.org/jira/browse/HADOOP-5557) | Two minor problems in TestOverReplicatedBlocks | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-5231](https://issues.apache.org/jira/browse/HADOOP-5231) | Negative number of maps in cluster summary | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-4719](https://issues.apache.org/jira/browse/HADOOP-4719) | The ls shell command documentation is out-dated | Major | documentation | Tsz Wo Nicholas Sze | Ravi Phulari |
+| [HADOOP-5374](https://issues.apache.org/jira/browse/HADOOP-5374) | NPE in JobTracker.getTasksToSave() method | Major | . | Vinod Kumar Vavilapalli | Amareshwari Sriramadasu |
+| [HADOOP-4780](https://issues.apache.org/jira/browse/HADOOP-4780) | Task Tracker burns a lot of cpu in calling getLocalCache | Major | . | Runping Qi | He Yongqiang |
+| [HADOOP-5551](https://issues.apache.org/jira/browse/HADOOP-5551) | Namenode permits directory destruction on overwrite | Critical | . | Brian Bockelman | Brian Bockelman |
+| [HADOOP-5644](https://issues.apache.org/jira/browse/HADOOP-5644) | Namnode is stuck in safe mode | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-5671](https://issues.apache.org/jira/browse/HADOOP-5671) | DistCp.sameFile(..) should return true if src fs does not support checksum | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-5213](https://issues.apache.org/jira/browse/HADOOP-5213) | BZip2CompressionOutputStream NullPointerException | Blocker | io | Zheng Shao | Zheng Shao |
+| [HADOOP-5579](https://issues.apache.org/jira/browse/HADOOP-5579) | libhdfs does not set errno correctly | Major | . | Brian Bockelman | Brian Bockelman |
+| [HADOOP-5728](https://issues.apache.org/jira/browse/HADOOP-5728) | FSEditLog.printStatistics may cause IndexOutOfBoundsException | Major | . | Wang Xu | Wang Xu |
+| [HADOOP-5816](https://issues.apache.org/jira/browse/HADOOP-5816) | ArrayIndexOutOfBoundsException when using KeyFieldBasedComparator | Minor | . | Min Zhou | He Yongqiang |
+| [HADOOP-5951](https://issues.apache.org/jira/browse/HADOOP-5951) | StorageInfo needs Apache license header. | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-6017](https://issues.apache.org/jira/browse/HADOOP-6017) | NameNode and SecondaryNameNode fail to restart because of abnormal filenames. | Blocker | . | Raghu Angadi | Tsz Wo Nicholas Sze |
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[46/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.4/CHANGES.0.16.4.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.4/CHANGES.0.16.4.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.4/CHANGES.0.16.4.md
index 3eac7ed..8e45328 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.4/CHANGES.0.16.4.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.4/CHANGES.0.16.4.md
@@ -20,55 +20,15 @@
## Release 0.16.4 - 2008-05-05
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-3304](https://issues.apache.org/jira/browse/HADOOP-3304) | [HOD] logcondense fails if DFS has files that are not log files, but match a certain pattern | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-3294](https://issues.apache.org/jira/browse/HADOOP-3294) | distcp leaves empty blocks afte successful execution | Blocker | util | Christian Kunz | Tsz Wo Nicholas Sze |
-| [HADOOP-3186](https://issues.apache.org/jira/browse/HADOOP-3186) | Incorrect permission checking on mv | Blocker | . | Koji Noguchi | Tsz Wo Nicholas Sze |
| [HADOOP-3138](https://issues.apache.org/jira/browse/HADOOP-3138) | distcp fail copying to /user/\<username\>/\<newtarget\> (with permission on) | Blocker | . | Koji Noguchi | Raghu Angadi |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-3186](https://issues.apache.org/jira/browse/HADOOP-3186) | Incorrect permission checking on mv | Blocker | . | Koji Noguchi | Tsz Wo Nicholas Sze |
+| [HADOOP-3294](https://issues.apache.org/jira/browse/HADOOP-3294) | distcp leaves empty blocks afte successful execution | Blocker | util | Christian Kunz | Tsz Wo Nicholas Sze |
+| [HADOOP-3304](https://issues.apache.org/jira/browse/HADOOP-3304) | [HOD] logcondense fails if DFS has files that are not log files, but match a certain pattern | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.0/CHANGES.0.17.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.0/CHANGES.0.17.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.0/CHANGES.0.17.0.md
index bbf3d23..f88162a 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.0/CHANGES.0.17.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.0/CHANGES.0.17.0.md
@@ -24,242 +24,230 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-3280](https://issues.apache.org/jira/browse/HADOOP-3280) | virtual address space limits break streaming apps | Blocker | . | Rick Cox | Arun C Murthy |
-| [HADOOP-3266](https://issues.apache.org/jira/browse/HADOOP-3266) | Remove HOD changes from CHANGES.txt, as they are now inside src/contrib/hod | Major | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-3239](https://issues.apache.org/jira/browse/HADOOP-3239) | exists() calls logs FileNotFoundException in namenode log | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3137](https://issues.apache.org/jira/browse/HADOOP-3137) | [HOD] Update hod version number | Major | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-3091](https://issues.apache.org/jira/browse/HADOOP-3091) | hadoop dfs -put should support multiple src | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-3060](https://issues.apache.org/jira/browse/HADOOP-3060) | MiniMRCluster is ignoring parameter taskTrackerFirst | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-2345](https://issues.apache.org/jira/browse/HADOOP-2345) | new transactions to support HDFS Appends | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-2178](https://issues.apache.org/jira/browse/HADOOP-2178) | Job history on HDFS | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-2192](https://issues.apache.org/jira/browse/HADOOP-2192) | dfs mv command differs from POSIX standards | Major | . | Mukund Madhugiri | Mahadev konar |
| [HADOOP-2873](https://issues.apache.org/jira/browse/HADOOP-2873) | Namenode fails to re-start after cluster shutdown - DFSClient: Could not obtain blocks even all datanodes were up & live | Major | . | André Martin | dhruba borthakur |
-| [HADOOP-2854](https://issues.apache.org/jira/browse/HADOOP-2854) | Remove the deprecated ipc.Server.getUserInfo() | Blocker | . | Tsz Wo Nicholas Sze | Lohit Vijayarenu |
-| [HADOOP-2839](https://issues.apache.org/jira/browse/HADOOP-2839) | Remove deprecated methods in FileSystem | Blocker | fs | Hairong Kuang | Lohit Vijayarenu |
-| [HADOOP-2831](https://issues.apache.org/jira/browse/HADOOP-2831) | Remove the deprecated INode.getAbsoluteName() | Blocker | . | Tsz Wo Nicholas Sze | Lohit Vijayarenu |
-| [HADOOP-2828](https://issues.apache.org/jira/browse/HADOOP-2828) | Remove deprecated methods in Configuration.java | Major | conf | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-2826](https://issues.apache.org/jira/browse/HADOOP-2826) | FileSplit.getFile(), LineRecordReader. readLine() need to be removed | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-1985](https://issues.apache.org/jira/browse/HADOOP-1985) | Abstract node to switch mapping into a topology service class used by namenode and jobtracker | Major | . | eric baldeschwieler | Devaraj Das |
+| [HADOOP-1986](https://issues.apache.org/jira/browse/HADOOP-1986) | Add support for a general serialization mechanism for Map Reduce | Major | . | Tom White | Tom White |
+| [HADOOP-2219](https://issues.apache.org/jira/browse/HADOOP-2219) | du like command to count number of files under a given directory | Major | . | Koji Noguchi | Tsz Wo Nicholas Sze |
+| [HADOOP-2820](https://issues.apache.org/jira/browse/HADOOP-2820) | Remove deprecated classes in streaming | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-2819](https://issues.apache.org/jira/browse/HADOOP-2819) | Remove deprecated methods in JobConf() | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-2821](https://issues.apache.org/jira/browse/HADOOP-2821) | Remove deprecated classes in util | Major | util | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-771](https://issues.apache.org/jira/browse/HADOOP-771) | Namenode should return error when trying to delete non-empty directory | Major | . | Milind Bhandarkar | Mahadev konar |
+| [HADOOP-2765](https://issues.apache.org/jira/browse/HADOOP-2765) | setting memory limits for tasks | Major | . | Joydeep Sen Sarma | Amareshwari Sriramadasu |
+| [HADOOP-2399](https://issues.apache.org/jira/browse/HADOOP-2399) | Input key and value to combiner and reducer should be reused | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-2470](https://issues.apache.org/jira/browse/HADOOP-2470) | Open and isDir should be removed from ClientProtocol | Major | . | Hairong Kuang | Tsz Wo Nicholas Sze |
| [HADOOP-2825](https://issues.apache.org/jira/browse/HADOOP-2825) | MapOutputLocation.getFile() needs to be removed | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-2822](https://issues.apache.org/jira/browse/HADOOP-2822) | Remove deprecated classes in mapred | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-2027](https://issues.apache.org/jira/browse/HADOOP-2027) | FileSystem should provide byte ranges for file locations | Major | fs | Owen O'Malley | Lohit Vijayarenu |
+| [HADOOP-2116](https://issues.apache.org/jira/browse/HADOOP-2116) | Job.local.dir to be exposed to tasks | Major | . | Milind Bhandarkar | Amareshwari Sriramadasu |
+| [HADOOP-2828](https://issues.apache.org/jira/browse/HADOOP-2828) | Remove deprecated methods in Configuration.java | Major | conf | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
| [HADOOP-2824](https://issues.apache.org/jira/browse/HADOOP-2824) | One of MiniMRCluster constructors needs tobe removed | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
| [HADOOP-2823](https://issues.apache.org/jira/browse/HADOOP-2823) | SimpleCharStream.getColumn(), getLine() methods to be removed. | Major | record | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-2822](https://issues.apache.org/jira/browse/HADOOP-2822) | Remove deprecated classes in mapred | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-2821](https://issues.apache.org/jira/browse/HADOOP-2821) | Remove deprecated classes in util | Major | util | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-2820](https://issues.apache.org/jira/browse/HADOOP-2820) | Remove deprecated classes in streaming | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-2819](https://issues.apache.org/jira/browse/HADOOP-2819) | Remove deprecated methods in JobConf() | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-3091](https://issues.apache.org/jira/browse/HADOOP-3091) | hadoop dfs -put should support multiple src | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3060](https://issues.apache.org/jira/browse/HADOOP-3060) | MiniMRCluster is ignoring parameter taskTrackerFirst | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-2854](https://issues.apache.org/jira/browse/HADOOP-2854) | Remove the deprecated ipc.Server.getUserInfo() | Blocker | . | Tsz Wo Nicholas Sze | Lohit Vijayarenu |
+| [HADOOP-2563](https://issues.apache.org/jira/browse/HADOOP-2563) | Remove deprecated FileSystem#listPaths() | Blocker | fs | Doug Cutting | Lohit Vijayarenu |
| [HADOOP-2818](https://issues.apache.org/jira/browse/HADOOP-2818) | Remove deprecated Counters.getDisplayName(), getCounterNames(), getCounter(String counterName) | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-2765](https://issues.apache.org/jira/browse/HADOOP-2765) | setting memory limits for tasks | Major | . | Joydeep Sen Sarma | Amareshwari Sriramadasu |
+| [HADOOP-2831](https://issues.apache.org/jira/browse/HADOOP-2831) | Remove the deprecated INode.getAbsoluteName() | Blocker | . | Tsz Wo Nicholas Sze | Lohit Vijayarenu |
+| [HADOOP-3137](https://issues.apache.org/jira/browse/HADOOP-3137) | [HOD] Update hod version number | Major | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-2839](https://issues.apache.org/jira/browse/HADOOP-2839) | Remove deprecated methods in FileSystem | Blocker | fs | Hairong Kuang | Lohit Vijayarenu |
| [HADOOP-2634](https://issues.apache.org/jira/browse/HADOOP-2634) | Deprecate exists() and isDir() to simplify ClientProtocol. | Blocker | . | Konstantin Shvachko | Lohit Vijayarenu |
-| [HADOOP-2563](https://issues.apache.org/jira/browse/HADOOP-2563) | Remove deprecated FileSystem#listPaths() | Blocker | fs | Doug Cutting | Lohit Vijayarenu |
-| [HADOOP-2470](https://issues.apache.org/jira/browse/HADOOP-2470) | Open and isDir should be removed from ClientProtocol | Major | . | Hairong Kuang | Tsz Wo Nicholas Sze |
| [HADOOP-2410](https://issues.apache.org/jira/browse/HADOOP-2410) | Make EC2 cluster nodes more independent of each other | Major | contrib/cloud | Tom White | Chris K Wensel |
-| [HADOOP-2399](https://issues.apache.org/jira/browse/HADOOP-2399) | Input key and value to combiner and reducer should be reused | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-2345](https://issues.apache.org/jira/browse/HADOOP-2345) | new transactions to support HDFS Appends | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-2219](https://issues.apache.org/jira/browse/HADOOP-2219) | du like command to count number of files under a given directory | Major | . | Koji Noguchi | Tsz Wo Nicholas Sze |
-| [HADOOP-2192](https://issues.apache.org/jira/browse/HADOOP-2192) | dfs mv command differs from POSIX standards | Major | . | Mukund Madhugiri | Mahadev konar |
-| [HADOOP-2178](https://issues.apache.org/jira/browse/HADOOP-2178) | Job history on HDFS | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-2116](https://issues.apache.org/jira/browse/HADOOP-2116) | Job.local.dir to be exposed to tasks | Major | . | Milind Bhandarkar | Amareshwari Sriramadasu |
-| [HADOOP-2027](https://issues.apache.org/jira/browse/HADOOP-2027) | FileSystem should provide byte ranges for file locations | Major | fs | Owen O'Malley | Lohit Vijayarenu |
-| [HADOOP-1986](https://issues.apache.org/jira/browse/HADOOP-1986) | Add support for a general serialization mechanism for Map Reduce | Major | . | Tom White | Tom White |
-| [HADOOP-1985](https://issues.apache.org/jira/browse/HADOOP-1985) | Abstract node to switch mapping into a topology service class used by namenode and jobtracker | Major | . | eric baldeschwieler | Devaraj Das |
-| [HADOOP-771](https://issues.apache.org/jira/browse/HADOOP-771) | Namenode should return error when trying to delete non-empty directory | Major | . | Milind Bhandarkar | Mahadev konar |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-2826](https://issues.apache.org/jira/browse/HADOOP-2826) | FileSplit.getFile(), LineRecordReader. readLine() need to be removed | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-3239](https://issues.apache.org/jira/browse/HADOOP-3239) | exists() calls logs FileNotFoundException in namenode log | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-3266](https://issues.apache.org/jira/browse/HADOOP-3266) | Remove HOD changes from CHANGES.txt, as they are now inside src/contrib/hod | Major | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-3280](https://issues.apache.org/jira/browse/HADOOP-3280) | virtual address space limits break streaming apps | Blocker | . | Rick Cox | Arun C Murthy |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-3152](https://issues.apache.org/jira/browse/HADOOP-3152) | Make index interval configuable when using MapFileOutputFormat for map-reduce job | Minor | io | Rong-En Fan | Doug Cutting |
-| [HADOOP-3048](https://issues.apache.org/jira/browse/HADOOP-3048) | Stringifier | Blocker | io | Enis Soztutar | Enis Soztutar |
-| [HADOOP-3001](https://issues.apache.org/jira/browse/HADOOP-3001) | FileSystems should track how many bytes are read and written | Blocker | fs | Owen O'Malley | Owen O'Malley |
-| [HADOOP-2951](https://issues.apache.org/jira/browse/HADOOP-2951) | contrib package provides a utility to build or update an index
-A contrib package to update an index using Map/Reduce | Major | . | Ning Li | Doug Cutting |
+| [HADOOP-1593](https://issues.apache.org/jira/browse/HADOOP-1593) | FsShell should work with paths in non-default FileSystem | Major | fs | Doug Cutting | Mahadev konar |
+| [HADOOP-2063](https://issues.apache.org/jira/browse/HADOOP-2063) | Command to pull corrupted files | Blocker | fs | Koji Noguchi | Tsz Wo Nicholas Sze |
| [HADOOP-2906](https://issues.apache.org/jira/browse/HADOOP-2906) | output format classes that can write to different files depending on keys and/or config variable | Major | . | Runping Qi | Runping Qi |
| [HADOOP-2657](https://issues.apache.org/jira/browse/HADOOP-2657) | Enhancements to DFSClient to support flushing data at any point in time | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-2063](https://issues.apache.org/jira/browse/HADOOP-2063) | Command to pull corrupted files | Blocker | fs | Koji Noguchi | Tsz Wo Nicholas Sze |
+| [HADOOP-2951](https://issues.apache.org/jira/browse/HADOOP-2951) | contrib package provides a utility to build or update an index
+A contrib package to update an index using Map/Reduce | Major | . | Ning Li | Doug Cutting |
| [HADOOP-2055](https://issues.apache.org/jira/browse/HADOOP-2055) | JobConf should have a setInputPathFilter method | Minor | . | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-1593](https://issues.apache.org/jira/browse/HADOOP-1593) | FsShell should work with paths in non-default FileSystem | Major | fs | Doug Cutting | Mahadev konar |
+| [HADOOP-3001](https://issues.apache.org/jira/browse/HADOOP-3001) | FileSystems should track how many bytes are read and written | Blocker | fs | Owen O'Malley | Owen O'Malley |
+| [HADOOP-3048](https://issues.apache.org/jira/browse/HADOOP-3048) | Stringifier | Blocker | io | Enis Soztutar | Enis Soztutar |
+| [HADOOP-3152](https://issues.apache.org/jira/browse/HADOOP-3152) | Make index interval configuable when using MapFileOutputFormat for map-reduce job | Minor | io | Rong-En Fan | Doug Cutting |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-3174](https://issues.apache.org/jira/browse/HADOOP-3174) | Improve documentation and supply an example for MultiFileInputFormat | Major | documentation | Enis Soztutar | Enis Soztutar |
-| [HADOOP-3143](https://issues.apache.org/jira/browse/HADOOP-3143) | Decrease the number of slaves in TestMiniMRDFSSort to 3. | Major | test | Owen O'Malley | Nigel Daley |
-| [HADOOP-3123](https://issues.apache.org/jira/browse/HADOOP-3123) | Build native libraries on Solaris | Major | build | Tom White | Tom White |
-| [HADOOP-3099](https://issues.apache.org/jira/browse/HADOOP-3099) | Need new options in distcp for preserving ower, group and permission | Blocker | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3092](https://issues.apache.org/jira/browse/HADOOP-3092) | Show counter values from "job -status" command | Major | scripts | Tom White | Tom White |
-| [HADOOP-3046](https://issues.apache.org/jira/browse/HADOOP-3046) | Text and BytesWritable's raw comparators should use the lengths provided instead of rebuilding them from scratch using readInt | Blocker | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-2996](https://issues.apache.org/jira/browse/HADOOP-2996) | StreamUtils abuses StringBuffers | Trivial | . | Dave Brosius | Dave Brosius |
-| [HADOOP-2994](https://issues.apache.org/jira/browse/HADOOP-2994) | DFSClient calls toString on strings. | Trivial | . | Dave Brosius | Dave Brosius |
-| [HADOOP-2993](https://issues.apache.org/jira/browse/HADOOP-2993) | Specify which JAVA\_HOME should be set | Major | documentation | Jason Rennie | Arun C Murthy |
-| [HADOOP-2947](https://issues.apache.org/jira/browse/HADOOP-2947) | [HOD] Hod should redirect stderr and stdout of Hadoop daemons to assist debugging | Blocker | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-| [HADOOP-2939](https://issues.apache.org/jira/browse/HADOOP-2939) | Make the Hudson patch process an executable ant target | Minor | test | Nigel Daley | Nigel Daley |
-| [HADOOP-2919](https://issues.apache.org/jira/browse/HADOOP-2919) | Create fewer copies of buffer data during sort/spill | Blocker | . | Chris Douglas | Chris Douglas |
-| [HADOOP-2902](https://issues.apache.org/jira/browse/HADOOP-2902) | replace accesss of "fs.default.name" with FileSystem accessor methods | Major | fs | Doug Cutting | Doug Cutting |
+| [HADOOP-2555](https://issues.apache.org/jira/browse/HADOOP-2555) | Refactor the HTable#get and HTable#getRow methods to avoid repetition of retry-on-failure logic | Minor | . | Peter Dolan | Bryan Duxbury |
+| [HADOOP-2690](https://issues.apache.org/jira/browse/HADOOP-2690) | Adding support into build.xml to build a special hadoop jar file that has the MiniDFSCluster and MiniMRCluster classes among others necessary for building and running the unit tests of Pig on the local mini cluster | Major | build | Xu Zhang | Enis Soztutar |
+| [HADOOP-1677](https://issues.apache.org/jira/browse/HADOOP-1677) | improve semantics of the hadoop dfs command | Minor | . | Nigel Daley | Mahadev konar |
| [HADOOP-2895](https://issues.apache.org/jira/browse/HADOOP-2895) | String for configuring profiling should be customizable | Major | . | Martin Traverso | Martin Traverso |
-| [HADOOP-2888](https://issues.apache.org/jira/browse/HADOOP-2888) | Enhancements to gridmix scripts | Major | test | Mukund Madhugiri | Mukund Madhugiri |
-| [HADOOP-2886](https://issues.apache.org/jira/browse/HADOOP-2886) | Track individual RPC metrics. | Major | metrics | girish vaitheeswaran | dhruba borthakur |
-| [HADOOP-2841](https://issues.apache.org/jira/browse/HADOOP-2841) | Dfs methods should not throw RemoteException | Major | . | Hairong Kuang | Konstantin Shvachko |
+| [HADOOP-910](https://issues.apache.org/jira/browse/HADOOP-910) | Reduces can do merges for the on-disk map output files in parallel with their copying | Major | . | Devaraj Das | Amar Kamat |
+| [HADOOP-2758](https://issues.apache.org/jira/browse/HADOOP-2758) | Reduce memory copies when data is read from DFS | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-730](https://issues.apache.org/jira/browse/HADOOP-730) | Local file system uses copy to implement rename | Major | fs | Owen O'Malley | Chris Douglas |
| [HADOOP-2810](https://issues.apache.org/jira/browse/HADOOP-2810) | Need new Hadoop Core logo | Minor | documentation | Nigel Daley | Nigel Daley |
+| [HADOOP-2057](https://issues.apache.org/jira/browse/HADOOP-2057) | streaming should optionally treat a non-zero exit status of a child process as a failed task | Major | . | Rick Cox | Rick Cox |
+| [HADOOP-2888](https://issues.apache.org/jira/browse/HADOOP-2888) | Enhancements to gridmix scripts | Major | test | Mukund Madhugiri | Mukund Madhugiri |
+| [HADOOP-2996](https://issues.apache.org/jira/browse/HADOOP-2996) | StreamUtils abuses StringBuffers | Trivial | . | Dave Brosius | Dave Brosius |
+| [HADOOP-2994](https://issues.apache.org/jira/browse/HADOOP-2994) | DFSClient calls toString on strings. | Trivial | . | Dave Brosius | Dave Brosius |
+| [HADOOP-2423](https://issues.apache.org/jira/browse/HADOOP-2423) | The codes in FSDirectory.mkdirs(...) is inefficient. | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-2804](https://issues.apache.org/jira/browse/HADOOP-2804) | Formatable changes log as html | Minor | documentation | Nigel Daley | Nigel Daley |
-| [HADOOP-2796](https://issues.apache.org/jira/browse/HADOOP-2796) | For script option hod should exit with distinguishable exit codes for script code and hod exit code. | Major | contrib/hod | Karam Singh | Hemanth Yamijala |
-| [HADOOP-2758](https://issues.apache.org/jira/browse/HADOOP-2758) | Reduce memory copies when data is read from DFS | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-2690](https://issues.apache.org/jira/browse/HADOOP-2690) | Adding support into build.xml to build a special hadoop jar file that has the MiniDFSCluster and MiniMRCluster classes among others necessary for building and running the unit tests of Pig on the local mini cluster | Major | build | Xu Zhang | Enis Soztutar |
| [HADOOP-2559](https://issues.apache.org/jira/browse/HADOOP-2559) | DFS should place one replica per rack | Major | . | Runping Qi | Lohit Vijayarenu |
-| [HADOOP-2555](https://issues.apache.org/jira/browse/HADOOP-2555) | Refactor the HTable#get and HTable#getRow methods to avoid repetition of retry-on-failure logic | Minor | . | Peter Dolan | Bryan Duxbury |
-| [HADOOP-2551](https://issues.apache.org/jira/browse/HADOOP-2551) | hadoop-env.sh needs finer granularity | Blocker | scripts | Allen Wittenauer | Raghu Angadi |
-| [HADOOP-2473](https://issues.apache.org/jira/browse/HADOOP-2473) | EC2 termination script should support termination by group | Major | contrib/cloud | Tom White | Chris K Wensel |
-| [HADOOP-2423](https://issues.apache.org/jira/browse/HADOOP-2423) | The codes in FSDirectory.mkdirs(...) is inefficient. | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-2939](https://issues.apache.org/jira/browse/HADOOP-2939) | Make the Hudson patch process an executable ant target | Minor | test | Nigel Daley | Nigel Daley |
| [HADOOP-2239](https://issues.apache.org/jira/browse/HADOOP-2239) | Security: Need to be able to encrypt Hadoop socket connections | Major | . | Allen Wittenauer | Chris Douglas |
| [HADOOP-2148](https://issues.apache.org/jira/browse/HADOOP-2148) | Inefficient FSDataset.getBlockFile() | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-2057](https://issues.apache.org/jira/browse/HADOOP-2057) | streaming should optionally treat a non-zero exit status of a child process as a failed task | Major | . | Rick Cox | Rick Cox |
-| [HADOOP-1677](https://issues.apache.org/jira/browse/HADOOP-1677) | improve semantics of the hadoop dfs command | Minor | . | Nigel Daley | Mahadev konar |
+| [HADOOP-2886](https://issues.apache.org/jira/browse/HADOOP-2886) | Track individual RPC metrics. | Major | metrics | girish vaitheeswaran | dhruba borthakur |
+| [HADOOP-2796](https://issues.apache.org/jira/browse/HADOOP-2796) | For script option hod should exit with distinguishable exit codes for script code and hod exit code. | Major | contrib/hod | Karam Singh | Hemanth Yamijala |
+| [HADOOP-2902](https://issues.apache.org/jira/browse/HADOOP-2902) | replace accesss of "fs.default.name" with FileSystem accessor methods | Major | fs | Doug Cutting | Doug Cutting |
+| [HADOOP-3046](https://issues.apache.org/jira/browse/HADOOP-3046) | Text and BytesWritable's raw comparators should use the lengths provided instead of rebuilding them from scratch using readInt | Blocker | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-1622](https://issues.apache.org/jira/browse/HADOOP-1622) | Hadoop should provide a way to allow the user to specify jar file(s) the user job depends on | Major | . | Runping Qi | Mahadev konar |
+| [HADOOP-3092](https://issues.apache.org/jira/browse/HADOOP-3092) | Show counter values from "job -status" command | Major | scripts | Tom White | Tom White |
| [HADOOP-1228](https://issues.apache.org/jira/browse/HADOOP-1228) | Eclipse project files | Minor | build | Albert Strasheim | Tom White |
-| [HADOOP-910](https://issues.apache.org/jira/browse/HADOOP-910) | Reduces can do merges for the on-disk map output files in parallel with their copying | Major | . | Devaraj Das | Amar Kamat |
-| [HADOOP-730](https://issues.apache.org/jira/browse/HADOOP-730) | Local file system uses copy to implement rename | Major | fs | Owen O'Malley | Chris Douglas |
+| [HADOOP-2919](https://issues.apache.org/jira/browse/HADOOP-2919) | Create fewer copies of buffer data during sort/spill | Blocker | . | Chris Douglas | Chris Douglas |
+| [HADOOP-2947](https://issues.apache.org/jira/browse/HADOOP-2947) | [HOD] Hod should redirect stderr and stdout of Hadoop daemons to assist debugging | Blocker | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-2551](https://issues.apache.org/jira/browse/HADOOP-2551) | hadoop-env.sh needs finer granularity | Blocker | scripts | Allen Wittenauer | Raghu Angadi |
+| [HADOOP-3099](https://issues.apache.org/jira/browse/HADOOP-3099) | Need new options in distcp for preserving ower, group and permission | Blocker | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3123](https://issues.apache.org/jira/browse/HADOOP-3123) | Build native libraries on Solaris | Major | build | Tom White | Tom White |
+| [HADOOP-2473](https://issues.apache.org/jira/browse/HADOOP-2473) | EC2 termination script should support termination by group | Major | contrib/cloud | Tom White | Chris K Wensel |
+| [HADOOP-2841](https://issues.apache.org/jira/browse/HADOOP-2841) | Dfs methods should not throw RemoteException | Major | . | Hairong Kuang | Konstantin Shvachko |
+| [HADOOP-3143](https://issues.apache.org/jira/browse/HADOOP-3143) | Decrease the number of slaves in TestMiniMRDFSSort to 3. | Major | test | Owen O'Malley | Nigel Daley |
+| [HADOOP-3174](https://issues.apache.org/jira/browse/HADOOP-3174) | Improve documentation and supply an example for MultiFileInputFormat | Major | documentation | Enis Soztutar | Enis Soztutar |
+| [HADOOP-2993](https://issues.apache.org/jira/browse/HADOOP-2993) | Specify which JAVA\_HOME should be set | Major | documentation | Jason Rennie | Arun C Murthy |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-3701](https://issues.apache.org/jira/browse/HADOOP-3701) | Too many trash sockets and trash pipes opened | Major | . | He Yongqiang | |
-| [HADOOP-3382](https://issues.apache.org/jira/browse/HADOOP-3382) | Memory leak when files are not cleanly closed | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-3372](https://issues.apache.org/jira/browse/HADOOP-3372) | TestUlimit fails on LINUX | Blocker | . | Lohit Vijayarenu | Arun C Murthy |
-| [HADOOP-3322](https://issues.apache.org/jira/browse/HADOOP-3322) | Hadoop rpc metrics do not get pushed to the MetricsRecord | Blocker | metrics | girish vaitheeswaran | girish vaitheeswaran |
-| [HADOOP-3286](https://issues.apache.org/jira/browse/HADOOP-3286) | Gridmix jobs' output dir names may collide | Major | test | Runping Qi | Runping Qi |
-| [HADOOP-3285](https://issues.apache.org/jira/browse/HADOOP-3285) | map tasks with node local splits do not always read from local nodes | Blocker | . | Runping Qi | Owen O'Malley |
-| [HADOOP-3279](https://issues.apache.org/jira/browse/HADOOP-3279) | TaskTracker should check for SUCCEEDED task status in addition to COMMIT\_PENDING status when it fails maps due to lost map outputs | Blocker | . | Devaraj Das | Devaraj Das |
-| [HADOOP-3263](https://issues.apache.org/jira/browse/HADOOP-3263) | job history browser throws exception if job name or user name is null. | Blocker | . | Amareshwari Sriramadasu | Arun C Murthy |
-| [HADOOP-3256](https://issues.apache.org/jira/browse/HADOOP-3256) | JobHistory file on HDFS should not use the 'job name' | Blocker | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-3251](https://issues.apache.org/jira/browse/HADOOP-3251) | WARN message on command line when a hadoop jar command is executed | Blocker | . | Mukund Madhugiri | Arun C Murthy |
-| [HADOOP-3247](https://issues.apache.org/jira/browse/HADOOP-3247) | gridmix scripts have a few bugs | Major | test | Runping Qi | Runping Qi |
-| [HADOOP-3242](https://issues.apache.org/jira/browse/HADOOP-3242) | SequenceFileAsBinaryRecordReader seems always to read from the start of a file, not the start of the split. | Major | . | Runping Qi | Chris Douglas |
-| [HADOOP-3237](https://issues.apache.org/jira/browse/HADOOP-3237) | Unit test failed on windows: TestDFSShell.testErrOutPut | Blocker | . | Mukund Madhugiri | Mahadev konar |
-| [HADOOP-3229](https://issues.apache.org/jira/browse/HADOOP-3229) | Map OutputCollector does not report progress on writes | Major | . | Alejandro Abdelnur | Doug Cutting |
-| [HADOOP-3225](https://issues.apache.org/jira/browse/HADOOP-3225) | FsShell showing null instead of a error message | Blocker | . | Tsz Wo Nicholas Sze | Mahadev konar |
-| [HADOOP-3224](https://issues.apache.org/jira/browse/HADOOP-3224) | hadoop dfs -du /dirPath does not work with hadoop-0.17 branch | Blocker | . | Runping Qi | Lohit Vijayarenu |
-| [HADOOP-3223](https://issues.apache.org/jira/browse/HADOOP-3223) | Hadoop dfs -help for permissions contains a typo | Blocker | . | Milind Bhandarkar | Raghu Angadi |
-| [HADOOP-3220](https://issues.apache.org/jira/browse/HADOOP-3220) | Safemode log message need to be corrected. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-3208](https://issues.apache.org/jira/browse/HADOOP-3208) | WritableDeserializer does not pass the Configuration to deserialized Writables | Blocker | . | Enis Soztutar | Enis Soztutar |
-| [HADOOP-3204](https://issues.apache.org/jira/browse/HADOOP-3204) | LocalFSMerger needs to catch throwable | Blocker | . | Koji Noguchi | Amar Kamat |
-| [HADOOP-3183](https://issues.apache.org/jira/browse/HADOOP-3183) | Unit test fails on Windows: TestJobShell.testJobShell | Blocker | . | Mukund Madhugiri | Mahadev konar |
-| [HADOOP-3178](https://issues.apache.org/jira/browse/HADOOP-3178) | gridmix scripts for small and medium jobs need to be changed to handle input paths differently | Blocker | test | Mukund Madhugiri | Mukund Madhugiri |
-| [HADOOP-3175](https://issues.apache.org/jira/browse/HADOOP-3175) | "-get file -" does not work | Blocker | fs | Raghu Angadi | Edward J. Yoon |
-| [HADOOP-3168](https://issues.apache.org/jira/browse/HADOOP-3168) | reduce amount of logging in hadoop streaming | Major | . | Joydeep Sen Sarma | Zheng Shao |
-| [HADOOP-3166](https://issues.apache.org/jira/browse/HADOOP-3166) | SpillThread throws ArrayIndexOutOfBoundsException, which is ignored by MapTask | Blocker | . | Chris Douglas | Chris Douglas |
-| [HADOOP-3165](https://issues.apache.org/jira/browse/HADOOP-3165) | FsShell no longer accepts stdin as a source for -put/-copyFromLocal | Blocker | . | Chris Douglas | Lohit Vijayarenu |
-| [HADOOP-3162](https://issues.apache.org/jira/browse/HADOOP-3162) | Map/reduce stops working with comma separated input paths | Blocker | . | Runping Qi | Amareshwari Sriramadasu |
-| [HADOOP-3161](https://issues.apache.org/jira/browse/HADOOP-3161) | TestFileAppend fails on Mac since HADOOP-2655 was committed | Minor | test | Nigel Daley | Nigel Daley |
-| [HADOOP-3157](https://issues.apache.org/jira/browse/HADOOP-3157) | TestMiniMRLocalFS fails in trunk on Windows | Blocker | test | Lohit Vijayarenu | Doug Cutting |
-| [HADOOP-3153](https://issues.apache.org/jira/browse/HADOOP-3153) | [HOD] Hod should deallocate cluster if there's a problem in writing information to the state file | Major | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-| [HADOOP-3146](https://issues.apache.org/jira/browse/HADOOP-3146) | DFSOutputStream.flush should be renamed as DFSOutputStream.fsync | Blocker | . | Runping Qi | dhruba borthakur |
-| [HADOOP-3140](https://issues.apache.org/jira/browse/HADOOP-3140) | JobTracker should not try to promote a (map) task if it does not write to DFS at all | Major | . | Runping Qi | Amar Kamat |
-| [HADOOP-3124](https://issues.apache.org/jira/browse/HADOOP-3124) | DFS data node should not use hard coded 10 minutes as write timeout. | Major | . | Runping Qi | Raghu Angadi |
-| [HADOOP-3118](https://issues.apache.org/jira/browse/HADOOP-3118) | Namenode NPE while loading fsimage after a cluster upgrade from older disk format | Blocker | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-3114](https://issues.apache.org/jira/browse/HADOOP-3114) | TestDFSShell fails on Windows. | Major | fs | Konstantin Shvachko | Lohit Vijayarenu |
-| [HADOOP-3106](https://issues.apache.org/jira/browse/HADOOP-3106) | Update documentation in mapred\_tutorial to add Debugging | Major | documentation | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-3094](https://issues.apache.org/jira/browse/HADOOP-3094) | BytesWritable.toString prints bytes above 0x80 as FFFFFF80 | Major | io | Owen O'Malley | Owen O'Malley |
-| [HADOOP-3093](https://issues.apache.org/jira/browse/HADOOP-3093) | ma/reduce throws the following exception if "io.serializations" is not set: | Major | . | Runping Qi | Amareshwari Sriramadasu |
-| [HADOOP-3089](https://issues.apache.org/jira/browse/HADOOP-3089) | streaming should accept stderr from task before first key arrives | Major | . | Rick Cox | Rick Cox |
-| [HADOOP-3087](https://issues.apache.org/jira/browse/HADOOP-3087) | JobInfo session object is not refreshed in loadHistory.jsp if same job is accessed again. | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-3086](https://issues.apache.org/jira/browse/HADOOP-3086) | Test case was missed in commit of HADOOP-3040 | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-3083](https://issues.apache.org/jira/browse/HADOOP-3083) | Remove lease when file is renamed | Blocker | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-3080](https://issues.apache.org/jira/browse/HADOOP-3080) | Remove flush calls from JobHistory | Blocker | . | Devaraj Das | Amareshwari Sriramadasu |
-| [HADOOP-3073](https://issues.apache.org/jira/browse/HADOOP-3073) | SocketOutputStream.close() should close the channel. | Blocker | ipc | Raghu Angadi | Raghu Angadi |
-| [HADOOP-3067](https://issues.apache.org/jira/browse/HADOOP-3067) | DFSInputStream 'pread' does not close its sockets | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-3066](https://issues.apache.org/jira/browse/HADOOP-3066) | Should not require superuser privilege to query if hdfs is in safe mode | Major | . | Jim Kellerman | Jim Kellerman |
-| [HADOOP-3065](https://issues.apache.org/jira/browse/HADOOP-3065) | Namenode does not process block report if the rack-location script is not provided on namenode | Blocker | . | dhruba borthakur | Devaraj Das |
-| [HADOOP-3064](https://issues.apache.org/jira/browse/HADOOP-3064) | Exception with file globbing closures | Major | . | Tom White | Hairong Kuang |
-| [HADOOP-3050](https://issues.apache.org/jira/browse/HADOOP-3050) | Cluster fall into infinite loop trying to replicate a block to a target that aready has this replica. | Blocker | . | Konstantin Shvachko | Hairong Kuang |
-| [HADOOP-3044](https://issues.apache.org/jira/browse/HADOOP-3044) | NNBench does not use the right configuration for the mapper | Major | test | Hairong Kuang | Hairong Kuang |
-| [HADOOP-3041](https://issues.apache.org/jira/browse/HADOOP-3041) | Within a task, the value ofJobConf.getOutputPath() method is modified | Blocker | . | Alejandro Abdelnur | Amareshwari Sriramadasu |
-| [HADOOP-3040](https://issues.apache.org/jira/browse/HADOOP-3040) | Streaming should assume an empty key if the first character on a line is the seperator (stream.map.output.field.separator, by default, tab) | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-3036](https://issues.apache.org/jira/browse/HADOOP-3036) | Fix findBugs warnings in UpgradeUtilities. | Major | test | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-3031](https://issues.apache.org/jira/browse/HADOOP-3031) | Remove compiler warnings for ant test | Minor | . | Amareshwari Sriramadasu | Chris Douglas |
-| [HADOOP-3030](https://issues.apache.org/jira/browse/HADOOP-3030) | InMemoryFileSystem.reserveSpaceWithChecksum does not look at failures while reserving space for the file in question | Major | fs | Devaraj Das | Devaraj Das |
-| [HADOOP-3029](https://issues.apache.org/jira/browse/HADOOP-3029) | Misleading log message "firstbadlink" printed by datanodes | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-3025](https://issues.apache.org/jira/browse/HADOOP-3025) | ChecksumFileSystem needs to support the new delete method | Blocker | fs | Devaraj Das | Mahadev konar |
-| [HADOOP-3018](https://issues.apache.org/jira/browse/HADOOP-3018) | Eclipse plugin fails to compile due to missing RPC.stopClient() method | Blocker | contrib/eclipse-plugin | Tom White | Christophe Taton |
-| [HADOOP-3012](https://issues.apache.org/jira/browse/HADOOP-3012) | dfs -mv file to user home directory fails silently if the user home directory does not exist | Blocker | fs | Mukund Madhugiri | Mahadev konar |
-| [HADOOP-3009](https://issues.apache.org/jira/browse/HADOOP-3009) | TestFileCreation fails while restarting cluster | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-3008](https://issues.apache.org/jira/browse/HADOOP-3008) | SocketIOWithTimeout does not handle thread interruption | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-3006](https://issues.apache.org/jira/browse/HADOOP-3006) | DataNode sends wrong length in header while pipelining. | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-2995](https://issues.apache.org/jira/browse/HADOOP-2995) | StreamBaseRecordReader's getProgress returns just 0 or 1 | Minor | . | Dave Brosius | Dave Brosius |
-| [HADOOP-2992](https://issues.apache.org/jira/browse/HADOOP-2992) | Sequential distributed upgrades. | Major | test | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-2983](https://issues.apache.org/jira/browse/HADOOP-2983) | [HOD] local\_fqdn() returns None when gethostbyname\_ex doesnt return any FQDNs. | Blocker | contrib/hod | Craig Macdonald | Hemanth Yamijala |
-| [HADOOP-2982](https://issues.apache.org/jira/browse/HADOOP-2982) | [HOD] checknodes should look for free nodes without the jobs attribute | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-2976](https://issues.apache.org/jira/browse/HADOOP-2976) | Blocks staying underreplicated (for unclosed file) | Minor | . | Koji Noguchi | dhruba borthakur |
-| [HADOOP-2974](https://issues.apache.org/jira/browse/HADOOP-2974) | ipc unit tests fail due to connection errors | Blocker | ipc | Mukund Madhugiri | Raghu Angadi |
+| [HADOOP-2738](https://issues.apache.org/jira/browse/HADOOP-2738) | Text is not subclassable because set(Text) and compareTo(Object) access the other instance's private members directly | Minor | io | Jim Kellerman | Jim Kellerman |
+| [HADOOP-2779](https://issues.apache.org/jira/browse/HADOOP-2779) | build scripts broken by moving hbase to subproject | Major | build | Owen O'Malley | Owen O'Malley |
+| [HADOOP-2194](https://issues.apache.org/jira/browse/HADOOP-2194) | dfs cat on a file that does not exist throws a java IOException | Major | . | Mukund Madhugiri | Mahadev konar |
+| [HADOOP-2767](https://issues.apache.org/jira/browse/HADOOP-2767) | org.apache.hadoop.net.NetworkTopology.InnerNode#getLeaf does not return the last node on a rack when used with an excluded node | Minor | . | Mark Butler | Hairong Kuang |
+| [HADOOP-2193](https://issues.apache.org/jira/browse/HADOOP-2193) | dfs rm and rmr commands differ from POSIX standards | Major | . | Mukund Madhugiri | Mahadev konar |
+| [HADOOP-2191](https://issues.apache.org/jira/browse/HADOOP-2191) | dfs du and dus commands differ from POSIX standards | Major | . | Mukund Madhugiri | Mahadev konar |
+| [HADOOP-2190](https://issues.apache.org/jira/browse/HADOOP-2190) | dfs ls and lsr commands differ from POSIX standards | Major | . | Mukund Madhugiri | Mahadev konar |
+| [HADOOP-2832](https://issues.apache.org/jira/browse/HADOOP-2832) | bad code indentation in DFSClient | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-2195](https://issues.apache.org/jira/browse/HADOOP-2195) | dfs mkdir command differs from POSIX standards | Major | . | Mukund Madhugiri | Mahadev konar |
+| [HADOOP-2844](https://issues.apache.org/jira/browse/HADOOP-2844) | A SequenceFile.Reader object is not closed properly in CopyFiles | Major | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-2727](https://issues.apache.org/jira/browse/HADOOP-2727) | Web UI links to Hadoop homepage has to change to new hadoop homepage | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-1902](https://issues.apache.org/jira/browse/HADOOP-1902) | du command throws an exception when the directory is not specified | Major | . | Mukund Madhugiri | Mahadev konar |
+| [HADOOP-2655](https://issues.apache.org/jira/browse/HADOOP-2655) | Copy on write for data and metadata files in the presence of snapshots | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-2871](https://issues.apache.org/jira/browse/HADOOP-2871) | Unit tests (16) fail on Windows due to java.lang.IllegalArgumentException causing MiniMRCluster to not start up | Blocker | . | Mukund Madhugiri | Amareshwari Sriramadasu |
+| [HADOOP-2800](https://issues.apache.org/jira/browse/HADOOP-2800) | SetFile.Writer deprecated by mistake? | Trivial | io | Johan Oskarsson | Johan Oskarsson |
+| [HADOOP-2891](https://issues.apache.org/jira/browse/HADOOP-2891) | The dfsclient on exit deletes files that are open and not closed. | Major | . | Mahadev konar | dhruba borthakur |
+| [HADOOP-2845](https://issues.apache.org/jira/browse/HADOOP-2845) | dfsadmin disk utilization report on Solaris is wrong | Major | fs | Martin Traverso | Martin Traverso |
+| [HADOOP-1967](https://issues.apache.org/jira/browse/HADOOP-1967) | hadoop dfs -ls, -get, -mv command's source/destination URI are inconsistent | Major | . | Lohit Vijayarenu | Doug Cutting |
+| [HADOOP-2790](https://issues.apache.org/jira/browse/HADOOP-2790) | TaskInProgress.hasSpeculativeTask is very inefficient | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-2912](https://issues.apache.org/jira/browse/HADOOP-2912) | Unit test fails: org.apache.hadoop.dfs.TestFsck.testFsck. This is a regression | Blocker | . | Mukund Madhugiri | Mahadev konar |
+| [HADOOP-2817](https://issues.apache.org/jira/browse/HADOOP-2817) | Remove deprecated mapred.tasktracker.tasks.maximum and clusterStatus.getMaxTasks() | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-2934](https://issues.apache.org/jira/browse/HADOOP-2934) | NPE while loading FSImage | Major | . | Raghu Angadi | dhruba borthakur |
+| [HADOOP-2346](https://issues.apache.org/jira/browse/HADOOP-2346) | DataNode should have timeout on socket writes. | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-2938](https://issues.apache.org/jira/browse/HADOOP-2938) | some of the fs commands don't globPaths. | Major | fs | Raghu Angadi | Tsz Wo Nicholas Sze |
+| [HADOOP-2943](https://issues.apache.org/jira/browse/HADOOP-2943) | Compression for intermediate map output is broken | Major | . | Chris Douglas | Chris Douglas |
+| [HADOOP-2870](https://issues.apache.org/jira/browse/HADOOP-2870) | Datanode.shutdown() and Namenode.stop() should close all rpc connections | Major | ipc | Hairong Kuang | Hairong Kuang |
| [HADOOP-2973](https://issues.apache.org/jira/browse/HADOOP-2973) | Unit test fails on Windows: org.apache.hadoop.dfs.TestLocalDFS.testWorkingDirectory | Blocker | . | Mukund Madhugiri | Tsz Wo Nicholas Sze |
-| [HADOOP-2972](https://issues.apache.org/jira/browse/HADOOP-2972) | org.apache.hadoop.dfs.TestDFSShell.testErrOutPut fails on Windows with NullPointerException | Blocker | . | Mukund Madhugiri | Mahadev konar |
| [HADOOP-2971](https://issues.apache.org/jira/browse/HADOOP-2971) | SocketTimeoutException in unit tests | Major | io | Raghu Angadi | Raghu Angadi |
-| [HADOOP-2970](https://issues.apache.org/jira/browse/HADOOP-2970) | Wrong class definition for hodlib/Hod/hod.py for Python \< 2.5.1 | Major | contrib/hod | Luca Telloli | Vinod Kumar Vavilapalli |
| [HADOOP-2955](https://issues.apache.org/jira/browse/HADOOP-2955) | ant test fail for TestCrcCorruption with OutofMemory. | Blocker | . | Mahadev konar | Raghu Angadi |
-| [HADOOP-2943](https://issues.apache.org/jira/browse/HADOOP-2943) | Compression for intermediate map output is broken | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-2938](https://issues.apache.org/jira/browse/HADOOP-2938) | some of the fs commands don't globPaths. | Major | fs | Raghu Angadi | Tsz Wo Nicholas Sze |
-| [HADOOP-2936](https://issues.apache.org/jira/browse/HADOOP-2936) | HOD should generate hdfs://host:port on the client side configs. | Major | contrib/hod | Mahadev konar | Vinod Kumar Vavilapalli |
-| [HADOOP-2934](https://issues.apache.org/jira/browse/HADOOP-2934) | NPE while loading FSImage | Major | . | Raghu Angadi | dhruba borthakur |
-| [HADOOP-2932](https://issues.apache.org/jira/browse/HADOOP-2932) | Trash initialization generates "deprecated filesystem name" warning even if the name is correct. | Blocker | conf, fs | Konstantin Shvachko | Mahadev konar |
-| [HADOOP-2927](https://issues.apache.org/jira/browse/HADOOP-2927) | Unit test fails on Windows: org.apache.hadoop.fs.TestDU.testDU | Blocker | fs | Mukund Madhugiri | Konstantin Shvachko |
-| [HADOOP-2924](https://issues.apache.org/jira/browse/HADOOP-2924) | HOD is trying to bring up task tracker on port which is already in close\_wait state | Critical | contrib/hod | Aroop Maliakkal | Vinod Kumar Vavilapalli |
-| [HADOOP-2912](https://issues.apache.org/jira/browse/HADOOP-2912) | Unit test fails: org.apache.hadoop.dfs.TestFsck.testFsck. This is a regression | Blocker | . | Mukund Madhugiri | Mahadev konar |
+| [HADOOP-2974](https://issues.apache.org/jira/browse/HADOOP-2974) | ipc unit tests fail due to connection errors | Blocker | ipc | Mukund Madhugiri | Raghu Angadi |
+| [HADOOP-2995](https://issues.apache.org/jira/browse/HADOOP-2995) | StreamBaseRecordReader's getProgress returns just 0 or 1 | Minor | . | Dave Brosius | Dave Brosius |
+| [HADOOP-2972](https://issues.apache.org/jira/browse/HADOOP-2972) | org.apache.hadoop.dfs.TestDFSShell.testErrOutPut fails on Windows with NullPointerException | Blocker | . | Mukund Madhugiri | Mahadev konar |
| [HADOOP-2908](https://issues.apache.org/jira/browse/HADOOP-2908) | forrest docs for dfs shell commands and semantics. | Major | documentation | Mahadev konar | Mahadev konar |
+| [HADOOP-3009](https://issues.apache.org/jira/browse/HADOOP-3009) | TestFileCreation fails while restarting cluster | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-2992](https://issues.apache.org/jira/browse/HADOOP-2992) | Sequential distributed upgrades. | Major | test | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-2863](https://issues.apache.org/jira/browse/HADOOP-2863) | FSDataOutputStream should not flush() inside close(). | Major | fs | Raghu Angadi | Raghu Angadi |
+| [HADOOP-2679](https://issues.apache.org/jira/browse/HADOOP-2679) | There is a small typeo in hdfs\_test.c when testing the success of the local hadoop initialization | Trivial | . | Jason | dhruba borthakur |
+| [HADOOP-2976](https://issues.apache.org/jira/browse/HADOOP-2976) | Blocks staying underreplicated (for unclosed file) | Minor | . | Koji Noguchi | dhruba borthakur |
| [HADOOP-2901](https://issues.apache.org/jira/browse/HADOOP-2901) | the job tracker should not start 2 info servers | Blocker | . | Owen O'Malley | Amareshwari Sriramadasu |
-| [HADOOP-2899](https://issues.apache.org/jira/browse/HADOOP-2899) | [HOD] hdfs:///mapredsystem directory not cleaned up after deallocation | Major | contrib/hod | Luca Telloli | Hemanth Yamijala |
-| [HADOOP-2891](https://issues.apache.org/jira/browse/HADOOP-2891) | The dfsclient on exit deletes files that are open and not closed. | Major | . | Mahadev konar | dhruba borthakur |
| [HADOOP-2890](https://issues.apache.org/jira/browse/HADOOP-2890) | HDFS should recover when replicas of block have different sizes (due to corrupted block) | Major | . | Lohit Vijayarenu | dhruba borthakur |
-| [HADOOP-2871](https://issues.apache.org/jira/browse/HADOOP-2871) | Unit tests (16) fail on Windows due to java.lang.IllegalArgumentException causing MiniMRCluster to not start up | Blocker | . | Mukund Madhugiri | Amareshwari Sriramadasu |
-| [HADOOP-2870](https://issues.apache.org/jira/browse/HADOOP-2870) | Datanode.shutdown() and Namenode.stop() should close all rpc connections | Major | ipc | Hairong Kuang | Hairong Kuang |
-| [HADOOP-2863](https://issues.apache.org/jira/browse/HADOOP-2863) | FSDataOutputStream should not flush() inside close(). | Major | fs | Raghu Angadi | Raghu Angadi |
-| [HADOOP-2855](https://issues.apache.org/jira/browse/HADOOP-2855) | [HOD] HOD fails to allocate a cluster if the tarball specified is a relative path | Blocker | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-| [HADOOP-2848](https://issues.apache.org/jira/browse/HADOOP-2848) | [HOD] If a cluster directory is deleted, hod -o list must show it, and deallocate should work. | Major | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-2845](https://issues.apache.org/jira/browse/HADOOP-2845) | dfsadmin disk utilization report on Solaris is wrong | Major | fs | Martin Traverso | Martin Traverso |
-| [HADOOP-2844](https://issues.apache.org/jira/browse/HADOOP-2844) | A SequenceFile.Reader object is not closed properly in CopyFiles | Major | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-2832](https://issues.apache.org/jira/browse/HADOOP-2832) | bad code indentation in DFSClient | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-2817](https://issues.apache.org/jira/browse/HADOOP-2817) | Remove deprecated mapred.tasktracker.tasks.maximum and clusterStatus.getMaxTasks() | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
| [HADOOP-2806](https://issues.apache.org/jira/browse/HADOOP-2806) | Streaming has no way to force entire record (or null) as key | Minor | . | Marco Nicosia | Amareshwari Sriramadasu |
-| [HADOOP-2800](https://issues.apache.org/jira/browse/HADOOP-2800) | SetFile.Writer deprecated by mistake? | Trivial | io | Johan Oskarsson | Johan Oskarsson |
-| [HADOOP-2790](https://issues.apache.org/jira/browse/HADOOP-2790) | TaskInProgress.hasSpeculativeTask is very inefficient | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-2783](https://issues.apache.org/jira/browse/HADOOP-2783) | hod/hodlib/Common/xmlrpc.py uses HodInterruptException without importing it | Minor | contrib/hod | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [HADOOP-2779](https://issues.apache.org/jira/browse/HADOOP-2779) | build scripts broken by moving hbase to subproject | Major | build | Owen O'Malley | Owen O'Malley |
-| [HADOOP-2767](https://issues.apache.org/jira/browse/HADOOP-2767) | org.apache.hadoop.net.NetworkTopology.InnerNode#getLeaf does not return the last node on a rack when used with an excluded node | Minor | . | Mark Butler | Hairong Kuang |
-| [HADOOP-2738](https://issues.apache.org/jira/browse/HADOOP-2738) | Text is not subclassable because set(Text) and compareTo(Object) access the other instance's private members directly | Minor | io | Jim Kellerman | Jim Kellerman |
-| [HADOOP-2727](https://issues.apache.org/jira/browse/HADOOP-2727) | Web UI links to Hadoop homepage has to change to new hadoop homepage | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-2679](https://issues.apache.org/jira/browse/HADOOP-2679) | There is a small typeo in hdfs\_test.c when testing the success of the local hadoop initialization | Trivial | . | Jason | dhruba borthakur |
-| [HADOOP-2655](https://issues.apache.org/jira/browse/HADOOP-2655) | Copy on write for data and metadata files in the presence of snapshots | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-2924](https://issues.apache.org/jira/browse/HADOOP-2924) | HOD is trying to bring up task tracker on port which is already in close\_wait state | Critical | contrib/hod | Aroop Maliakkal | Vinod Kumar Vavilapalli |
+| [HADOOP-2970](https://issues.apache.org/jira/browse/HADOOP-2970) | Wrong class definition for hodlib/Hod/hod.py for Python \< 2.5.1 | Major | contrib/hod | Luca Telloli | Vinod Kumar Vavilapalli |
+| [HADOOP-3008](https://issues.apache.org/jira/browse/HADOOP-3008) | SocketIOWithTimeout does not handle thread interruption | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-3006](https://issues.apache.org/jira/browse/HADOOP-3006) | DataNode sends wrong length in header while pipelining. | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-3029](https://issues.apache.org/jira/browse/HADOOP-3029) | Misleading log message "firstbadlink" printed by datanodes | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-2606](https://issues.apache.org/jira/browse/HADOOP-2606) | Namenode unstable when replicating 500k blocks at once | Major | . | Koji Noguchi | Konstantin Shvachko |
+| [HADOOP-3030](https://issues.apache.org/jira/browse/HADOOP-3030) | InMemoryFileSystem.reserveSpaceWithChecksum does not look at failures while reserving space for the file in question | Major | fs | Devaraj Das | Devaraj Das |
+| [HADOOP-3036](https://issues.apache.org/jira/browse/HADOOP-3036) | Fix findBugs warnings in UpgradeUtilities. | Major | test | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-2848](https://issues.apache.org/jira/browse/HADOOP-2848) | [HOD] If a cluster directory is deleted, hod -o list must show it, and deallocate should work. | Major | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-2783](https://issues.apache.org/jira/browse/HADOOP-2783) | hod/hodlib/Common/xmlrpc.py uses HodInterruptException without importing it | Minor | contrib/hod | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [HADOOP-2936](https://issues.apache.org/jira/browse/HADOOP-2936) | HOD should generate hdfs://host:port on the client side configs. | Major | contrib/hod | Mahadev konar | Vinod Kumar Vavilapalli |
+| [HADOOP-2899](https://issues.apache.org/jira/browse/HADOOP-2899) | [HOD] hdfs:///mapredsystem directory not cleaned up after deallocation | Major | contrib/hod | Luca Telloli | Hemanth Yamijala |
+| [HADOOP-3025](https://issues.apache.org/jira/browse/HADOOP-3025) | ChecksumFileSystem needs to support the new delete method | Blocker | fs | Devaraj Das | Mahadev konar |
+| [HADOOP-3012](https://issues.apache.org/jira/browse/HADOOP-3012) | dfs -mv file to user home directory fails silently if the user home directory does not exist | Blocker | fs | Mukund Madhugiri | Mahadev konar |
| [HADOOP-2373](https://issues.apache.org/jira/browse/HADOOP-2373) | Name node silently changes state | Major | . | Robert Chansler | Konstantin Shvachko |
-| [HADOOP-2346](https://issues.apache.org/jira/browse/HADOOP-2346) | DataNode should have timeout on socket writes. | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-2195](https://issues.apache.org/jira/browse/HADOOP-2195) | dfs mkdir command differs from POSIX standards | Major | . | Mukund Madhugiri | Mahadev konar |
-| [HADOOP-2194](https://issues.apache.org/jira/browse/HADOOP-2194) | dfs cat on a file that does not exist throws a java IOException | Major | . | Mukund Madhugiri | Mahadev konar |
-| [HADOOP-2193](https://issues.apache.org/jira/browse/HADOOP-2193) | dfs rm and rmr commands differ from POSIX standards | Major | . | Mukund Madhugiri | Mahadev konar |
-| [HADOOP-2191](https://issues.apache.org/jira/browse/HADOOP-2191) | dfs du and dus commands differ from POSIX standards | Major | . | Mukund Madhugiri | Mahadev konar |
-| [HADOOP-2190](https://issues.apache.org/jira/browse/HADOOP-2190) | dfs ls and lsr commands differ from POSIX standards | Major | . | Mukund Madhugiri | Mahadev konar |
+| [HADOOP-3066](https://issues.apache.org/jira/browse/HADOOP-3066) | Should not require superuser privilege to query if hdfs is in safe mode | Major | . | Jim Kellerman | Jim Kellerman |
+| [HADOOP-3040](https://issues.apache.org/jira/browse/HADOOP-3040) | Streaming should assume an empty key if the first character on a line is the seperator (stream.map.output.field.separator, by default, tab) | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-3080](https://issues.apache.org/jira/browse/HADOOP-3080) | Remove flush calls from JobHistory | Blocker | . | Devaraj Das | Amareshwari Sriramadasu |
+| [HADOOP-3086](https://issues.apache.org/jira/browse/HADOOP-3086) | Test case was missed in commit of HADOOP-3040 | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-2983](https://issues.apache.org/jira/browse/HADOOP-2983) | [HOD] local\_fqdn() returns None when gethostbyname\_ex doesnt return any FQDNs. | Blocker | contrib/hod | Craig Macdonald | Hemanth Yamijala |
| [HADOOP-2119](https://issues.apache.org/jira/browse/HADOOP-2119) | JobTracker becomes non-responsive if the task trackers finish task too fast | Critical | . | Runping Qi | Amar Kamat |
-| [HADOOP-1967](https://issues.apache.org/jira/browse/HADOOP-1967) | hadoop dfs -ls, -get, -mv command's source/destination URI are inconsistent | Major | . | Lohit Vijayarenu | Doug Cutting |
+| [HADOOP-3094](https://issues.apache.org/jira/browse/HADOOP-3094) | BytesWritable.toString prints bytes above 0x80 as FFFFFF80 | Major | io | Owen O'Malley | Owen O'Malley |
+| [HADOOP-3067](https://issues.apache.org/jira/browse/HADOOP-3067) | DFSInputStream 'pread' does not close its sockets | Blocker | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-3073](https://issues.apache.org/jira/browse/HADOOP-3073) | SocketOutputStream.close() should close the channel. | Blocker | ipc | Raghu Angadi | Raghu Angadi |
+| [HADOOP-3087](https://issues.apache.org/jira/browse/HADOOP-3087) | JobInfo session object is not refreshed in loadHistory.jsp if same job is accessed again. | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-2982](https://issues.apache.org/jira/browse/HADOOP-2982) | [HOD] checknodes should look for free nodes without the jobs attribute | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-3065](https://issues.apache.org/jira/browse/HADOOP-3065) | Namenode does not process block report if the rack-location script is not provided on namenode | Blocker | . | dhruba borthakur | Devaraj Das |
+| [HADOOP-3064](https://issues.apache.org/jira/browse/HADOOP-3064) | Exception with file globbing closures | Major | . | Tom White | Hairong Kuang |
+| [HADOOP-3114](https://issues.apache.org/jira/browse/HADOOP-3114) | TestDFSShell fails on Windows. | Major | fs | Konstantin Shvachko | Lohit Vijayarenu |
+| [HADOOP-2855](https://issues.apache.org/jira/browse/HADOOP-2855) | [HOD] HOD fails to allocate a cluster if the tarball specified is a relative path | Blocker | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-3093](https://issues.apache.org/jira/browse/HADOOP-3093) | ma/reduce throws the following exception if "io.serializations" is not set: | Major | . | Runping Qi | Amareshwari Sriramadasu |
+| [HADOOP-3106](https://issues.apache.org/jira/browse/HADOOP-3106) | Update documentation in mapred\_tutorial to add Debugging | Major | documentation | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-2932](https://issues.apache.org/jira/browse/HADOOP-2932) | Trash initialization generates "deprecated filesystem name" warning even if the name is correct. | Blocker | conf, fs | Konstantin Shvachko | Mahadev konar |
+| [HADOOP-3118](https://issues.apache.org/jira/browse/HADOOP-3118) | Namenode NPE while loading fsimage after a cluster upgrade from older disk format | Blocker | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-3161](https://issues.apache.org/jira/browse/HADOOP-3161) | TestFileAppend fails on Mac since HADOOP-2655 was committed | Minor | test | Nigel Daley | Nigel Daley |
+| [HADOOP-2927](https://issues.apache.org/jira/browse/HADOOP-2927) | Unit test fails on Windows: org.apache.hadoop.fs.TestDU.testDU | Blocker | fs | Mukund Madhugiri | Konstantin Shvachko |
+| [HADOOP-3089](https://issues.apache.org/jira/browse/HADOOP-3089) | streaming should accept stderr from task before first key arrives | Major | . | Rick Cox | Rick Cox |
+| [HADOOP-3140](https://issues.apache.org/jira/browse/HADOOP-3140) | JobTracker should not try to promote a (map) task if it does not write to DFS at all | Major | . | Runping Qi | Amar Kamat |
+| [HADOOP-3146](https://issues.apache.org/jira/browse/HADOOP-3146) | DFSOutputStream.flush should be renamed as DFSOutputStream.fsync | Blocker | . | Runping Qi | dhruba borthakur |
+| [HADOOP-3165](https://issues.apache.org/jira/browse/HADOOP-3165) | FsShell no longer accepts stdin as a source for -put/-copyFromLocal | Blocker | . | Chris Douglas | Lohit Vijayarenu |
+| [HADOOP-3041](https://issues.apache.org/jira/browse/HADOOP-3041) | Within a task, the value ofJobConf.getOutputPath() method is modified | Blocker | . | Alejandro Abdelnur | Amareshwari Sriramadasu |
+| [HADOOP-3083](https://issues.apache.org/jira/browse/HADOOP-3083) | Remove lease when file is renamed | Blocker | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-3168](https://issues.apache.org/jira/browse/HADOOP-3168) | reduce amount of logging in hadoop streaming | Major | . | Joydeep Sen Sarma | Zheng Shao |
+| [HADOOP-3166](https://issues.apache.org/jira/browse/HADOOP-3166) | SpillThread throws ArrayIndexOutOfBoundsException, which is ignored by MapTask | Blocker | . | Chris Douglas | Chris Douglas |
+| [HADOOP-3050](https://issues.apache.org/jira/browse/HADOOP-3050) | Cluster fall into infinite loop trying to replicate a block to a target that aready has this replica. | Blocker | . | Konstantin Shvachko | Hairong Kuang |
+| [HADOOP-3044](https://issues.apache.org/jira/browse/HADOOP-3044) | NNBench does not use the right configuration for the mapper | Major | test | Hairong Kuang | Hairong Kuang |
+| [HADOOP-3178](https://issues.apache.org/jira/browse/HADOOP-3178) | gridmix scripts for small and medium jobs need to be changed to handle input paths differently | Blocker | test | Mukund Madhugiri | Mukund Madhugiri |
| [HADOOP-1911](https://issues.apache.org/jira/browse/HADOOP-1911) | infinite loop in dfs -cat command. | Blocker | . | Koji Noguchi | Chris Douglas |
-| [HADOOP-1902](https://issues.apache.org/jira/browse/HADOOP-1902) | du command throws an exception when the directory is not specified | Major | . | Mukund Madhugiri | Mahadev konar |
+| [HADOOP-3157](https://issues.apache.org/jira/browse/HADOOP-3157) | TestMiniMRLocalFS fails in trunk on Windows | Blocker | test | Lohit Vijayarenu | Doug Cutting |
+| [HADOOP-3018](https://issues.apache.org/jira/browse/HADOOP-3018) | Eclipse plugin fails to compile due to missing RPC.stopClient() method | Blocker | contrib/eclipse-plugin | Tom White | Christophe Taton |
+| [HADOOP-3183](https://issues.apache.org/jira/browse/HADOOP-3183) | Unit test fails on Windows: TestJobShell.testJobShell | Blocker | . | Mukund Madhugiri | Mahadev konar |
+| [HADOOP-3175](https://issues.apache.org/jira/browse/HADOOP-3175) | "-get file -" does not work | Blocker | fs | Raghu Angadi | Edward J. Yoon |
+| [HADOOP-3220](https://issues.apache.org/jira/browse/HADOOP-3220) | Safemode log message need to be corrected. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-3208](https://issues.apache.org/jira/browse/HADOOP-3208) | WritableDeserializer does not pass the Configuration to deserialized Writables | Blocker | . | Enis Soztutar | Enis Soztutar |
+| [HADOOP-3224](https://issues.apache.org/jira/browse/HADOOP-3224) | hadoop dfs -du /dirPath does not work with hadoop-0.17 branch | Blocker | . | Runping Qi | Lohit Vijayarenu |
+| [HADOOP-3223](https://issues.apache.org/jira/browse/HADOOP-3223) | Hadoop dfs -help for permissions contains a typo | Blocker | . | Milind Bhandarkar | Raghu Angadi |
| [HADOOP-1373](https://issues.apache.org/jira/browse/HADOOP-1373) | checkPath() throws IllegalArgumentException | Blocker | fs | Konstantin Shvachko | Edward J. Yoon |
+| [HADOOP-3204](https://issues.apache.org/jira/browse/HADOOP-3204) | LocalFSMerger needs to catch throwable | Blocker | . | Koji Noguchi | Amar Kamat |
+| [HADOOP-3153](https://issues.apache.org/jira/browse/HADOOP-3153) | [HOD] Hod should deallocate cluster if there's a problem in writing information to the state file | Major | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-3229](https://issues.apache.org/jira/browse/HADOOP-3229) | Map OutputCollector does not report progress on writes | Major | . | Alejandro Abdelnur | Doug Cutting |
+| [HADOOP-3225](https://issues.apache.org/jira/browse/HADOOP-3225) | FsShell showing null instead of a error message | Blocker | . | Tsz Wo Nicholas Sze | Mahadev konar |
+| [HADOOP-3247](https://issues.apache.org/jira/browse/HADOOP-3247) | gridmix scripts have a few bugs | Major | test | Runping Qi | Runping Qi |
+| [HADOOP-3242](https://issues.apache.org/jira/browse/HADOOP-3242) | SequenceFileAsBinaryRecordReader seems always to read from the start of a file, not the start of the split. | Major | . | Runping Qi | Chris Douglas |
+| [HADOOP-3256](https://issues.apache.org/jira/browse/HADOOP-3256) | JobHistory file on HDFS should not use the 'job name' | Blocker | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-3162](https://issues.apache.org/jira/browse/HADOOP-3162) | Map/reduce stops working with comma separated input paths | Blocker | . | Runping Qi | Amareshwari Sriramadasu |
+| [HADOOP-3124](https://issues.apache.org/jira/browse/HADOOP-3124) | DFS data node should not use hard coded 10 minutes as write timeout. | Major | . | Runping Qi | Raghu Angadi |
+| [HADOOP-3263](https://issues.apache.org/jira/browse/HADOOP-3263) | job history browser throws exception if job name or user name is null. | Blocker | . | Amareshwari Sriramadasu | Arun C Murthy |
+| [HADOOP-3251](https://issues.apache.org/jira/browse/HADOOP-3251) | WARN message on command line when a hadoop jar command is executed | Blocker | . | Mukund Madhugiri | Arun C Murthy |
+| [HADOOP-3237](https://issues.apache.org/jira/browse/HADOOP-3237) | Unit test failed on windows: TestDFSShell.testErrOutPut | Blocker | . | Mukund Madhugiri | Mahadev konar |
+| [HADOOP-3279](https://issues.apache.org/jira/browse/HADOOP-3279) | TaskTracker should check for SUCCEEDED task status in addition to COMMIT\_PENDING status when it fails maps due to lost map outputs | Blocker | . | Devaraj Das | Devaraj Das |
+| [HADOOP-3286](https://issues.apache.org/jira/browse/HADOOP-3286) | Gridmix jobs' output dir names may collide | Major | test | Runping Qi | Runping Qi |
+| [HADOOP-3285](https://issues.apache.org/jira/browse/HADOOP-3285) | map tasks with node local splits do not always read from local nodes | Blocker | . | Runping Qi | Owen O'Malley |
+| [HADOOP-3031](https://issues.apache.org/jira/browse/HADOOP-3031) | Remove compiler warnings for ant test | Minor | . | Amareshwari Sriramadasu | Chris Douglas |
+| [HADOOP-3372](https://issues.apache.org/jira/browse/HADOOP-3372) | TestUlimit fails on LINUX | Blocker | . | Lohit Vijayarenu | Arun C Murthy |
+| [HADOOP-3322](https://issues.apache.org/jira/browse/HADOOP-3322) | Hadoop rpc metrics do not get pushed to the MetricsRecord | Blocker | metrics | girish vaitheeswaran | girish vaitheeswaran |
+| [HADOOP-3382](https://issues.apache.org/jira/browse/HADOOP-3382) | Memory leak when files are not cleanly closed | Blocker | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-3701](https://issues.apache.org/jira/browse/HADOOP-3701) | Too many trash sockets and trash pipes opened | Major | . | He Yongqiang | |
### TESTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-2997](https://issues.apache.org/jira/browse/HADOOP-2997) | Add test for non-writable serializer | Blocker | . | Tom White | Tom White |
| [HADOOP-2775](https://issues.apache.org/jira/browse/HADOOP-2775) | [HOD] Put in place unit test framework for HOD | Major | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-2997](https://issues.apache.org/jira/browse/HADOOP-2997) | Add test for non-writable serializer | Blocker | . | Tom White | Tom White |
### OTHER:
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[36/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.2/RELEASENOTES.0.20.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.2/RELEASENOTES.0.20.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.2/RELEASENOTES.0.20.2.md
index 2ebfdc0..5243c7e 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.2/RELEASENOTES.0.20.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.2/RELEASENOTES.0.20.2.md
@@ -23,23 +23,16 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-6498](https://issues.apache.org/jira/browse/HADOOP-6498) | *Blocker* | **IPC client bug may cause rpc call hang**
-
-Correct synchronization error in IPC where handler thread could hang if request reader got an error.
-
-
----
-
-* [HADOOP-6460](https://issues.apache.org/jira/browse/HADOOP-6460) | *Blocker* | **Namenode runs of out of memory due to memory leak in ipc Server**
+* [MAPREDUCE-826](https://issues.apache.org/jira/browse/MAPREDUCE-826) | *Trivial* | **harchive doesn't use ToolRunner / harchive returns 0 even if the job fails with exception**
-If an IPC server response buffer has grown to than 1MB, it is replaced by a smaller buffer to free up the Java heap that was used. This will improve the longevity of the name service.
+Use ToolRunner for archives job and return non zero error code on failure.
---
-* [HADOOP-6428](https://issues.apache.org/jira/browse/HADOOP-6428) | *Major* | **HttpServer sleeps with negative values**
+* [MAPREDUCE-112](https://issues.apache.org/jira/browse/MAPREDUCE-112) | *Blocker* | **Reduce Input Records and Reduce Output Records counters are not being set when using the new Mapreduce reducer API**
-Corrected arithmetic error that made sleep times less than zero.
+Updates of counters for reduce input and output records were added in the new API so they are available for jobs using the new API.
---
@@ -51,23 +44,23 @@ Allow a general mechanism to disable the cache on a per filesystem basis by usin
---
-* [HADOOP-6097](https://issues.apache.org/jira/browse/HADOOP-6097) | *Major* | **Multiple bugs w/ Hadoop archives**
+* [MAPREDUCE-979](https://issues.apache.org/jira/browse/MAPREDUCE-979) | *Blocker* | **JobConf.getMemoryFor{Map\|Reduce}Task doesn't fallback to newer config knobs when mapred.taskmaxvmem is set to DISABLED\_MEMORY\_LIMIT of -1**
-Bugs fixed for Hadoop archives: character escaping in paths, LineReader and file system caching.
+Added support to fallback to new task memory configuration when deprecated memory configuration values are set to disabled.
---
-* [HDFS-793](https://issues.apache.org/jira/browse/HDFS-793) | *Blocker* | **DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet**
+* [HDFS-677](https://issues.apache.org/jira/browse/HDFS-677) | *Blocker* | **Rename failure due to quota results in deletion of src directory**
-**WARNING: No release note provided for this incompatible change.**
+Rename properly considers the case where both source and destination are over quota; operation will fail with error indication.
---
-* [HDFS-781](https://issues.apache.org/jira/browse/HDFS-781) | *Blocker* | **Metrics PendingDeletionBlocks is not decremented**
+* [HADOOP-6097](https://issues.apache.org/jira/browse/HADOOP-6097) | *Major* | **Multiple bugs w/ Hadoop archives**
-Correct PendingDeletionBlocks metric to properly decrement counts.
+Bugs fixed for Hadoop archives: character escaping in paths, LineReader and file system caching.
---
@@ -79,9 +72,9 @@ Corrected an error when checking quota policy that resulted in a failure to read
---
-* [HDFS-677](https://issues.apache.org/jira/browse/HDFS-677) | *Blocker* | **Rename failure due to quota results in deletion of src directory**
+* [MAPREDUCE-1068](https://issues.apache.org/jira/browse/MAPREDUCE-1068) | *Major* | **In hadoop-0.20.0 streaming job do not throw proper verbose error message if file is not present**
-Rename properly considers the case where both source and destination are over quota; operation will fail with error indication.
+Fix streaming job to show proper message if file is is not present, for -file option.
---
@@ -93,44 +86,44 @@ Memory leak in function hdfsFreeFileInfo in libhdfs. This bug affects fuse-dfs s
---
-* [MAPREDUCE-1182](https://issues.apache.org/jira/browse/MAPREDUCE-1182) | *Blocker* | **Reducers fail with OutOfMemoryError while copying Map outputs**
+* [MAPREDUCE-1147](https://issues.apache.org/jira/browse/MAPREDUCE-1147) | *Blocker* | **Map output records counter missing for map-only jobs in new API**
-Modifies shuffle related memory parameters to use 'long' from 'int' so that sizes greater than maximum integer size are handled correctly
+Adds a counter to track the number of records emitted by map writing directly to HDFS i.e map tasks of job with 0 reducers.
---
-* [MAPREDUCE-1147](https://issues.apache.org/jira/browse/MAPREDUCE-1147) | *Blocker* | **Map output records counter missing for map-only jobs in new API**
+* [MAPREDUCE-1182](https://issues.apache.org/jira/browse/MAPREDUCE-1182) | *Blocker* | **Reducers fail with OutOfMemoryError while copying Map outputs**
-Adds a counter to track the number of records emitted by map writing directly to HDFS i.e map tasks of job with 0 reducers.
+Modifies shuffle related memory parameters to use 'long' from 'int' so that sizes greater than maximum integer size are handled correctly
---
-* [MAPREDUCE-1068](https://issues.apache.org/jira/browse/MAPREDUCE-1068) | *Major* | **In hadoop-0.20.0 streaming job do not throw proper verbose error message if file is not present**
+* [HDFS-781](https://issues.apache.org/jira/browse/HDFS-781) | *Blocker* | **Metrics PendingDeletionBlocks is not decremented**
-Fix streaming job to show proper message if file is is not present, for -file option.
+Correct PendingDeletionBlocks metric to properly decrement counts.
---
-* [MAPREDUCE-979](https://issues.apache.org/jira/browse/MAPREDUCE-979) | *Blocker* | **JobConf.getMemoryFor{Map\|Reduce}Task doesn't fallback to newer config knobs when mapred.taskmaxvmem is set to DISABLED\_MEMORY\_LIMIT of -1**
+* [HDFS-793](https://issues.apache.org/jira/browse/HDFS-793) | *Blocker* | **DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet**
-Added support to fallback to new task memory configuration when deprecated memory configuration values are set to disabled.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-826](https://issues.apache.org/jira/browse/MAPREDUCE-826) | *Trivial* | **harchive doesn't use ToolRunner / harchive returns 0 even if the job fails with exception**
+* [HADOOP-6428](https://issues.apache.org/jira/browse/HADOOP-6428) | *Major* | **HttpServer sleeps with negative values**
-Use ToolRunner for archives job and return non zero error code on failure.
+Corrected arithmetic error that made sleep times less than zero.
---
-* [MAPREDUCE-623](https://issues.apache.org/jira/browse/MAPREDUCE-623) | *Major* | **Resolve javac warnings in mapred**
+* [HADOOP-6460](https://issues.apache.org/jira/browse/HADOOP-6460) | *Blocker* | **Namenode runs of out of memory due to memory leak in ipc Server**
-Removes javac warnings by either resolving them or suppressing them (wherever resolution is not possible)
+If an IPC server response buffer has grown to than 1MB, it is replaced by a smaller buffer to free up the Java heap that was used. This will improve the longevity of the name service.
---
@@ -142,9 +135,16 @@ Resolves the test failure by modifying the test to base it on spill counters rat
---
-* [MAPREDUCE-112](https://issues.apache.org/jira/browse/MAPREDUCE-112) | *Blocker* | **Reduce Input Records and Reduce Output Records counters are not being set when using the new Mapreduce reducer API**
+* [HADOOP-6498](https://issues.apache.org/jira/browse/HADOOP-6498) | *Blocker* | **IPC client bug may cause rpc call hang**
-Updates of counters for reduce input and output records were added in the new API so they are available for jobs using the new API.
+Correct synchronization error in IPC where handler thread could hang if request reader got an error.
+
+
+---
+
+* [MAPREDUCE-623](https://issues.apache.org/jira/browse/MAPREDUCE-623) | *Major* | **Resolve javac warnings in mapred**
+
+Removes javac warnings by either resolving them or suppressing them (wherever resolution is not possible)
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.203.0/CHANGES.0.20.203.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.203.0/CHANGES.0.20.203.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.203.0/CHANGES.0.20.203.0.md
index b45f75a..72c0742 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.203.0/CHANGES.0.20.203.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.203.0/CHANGES.0.20.203.0.md
@@ -20,16 +20,6 @@
## Release 0.20.203.0 - 2011-05-11
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
@@ -44,58 +34,40 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7247](https://issues.apache.org/jira/browse/HADOOP-7247) | Fix documentation to reflect new jar names | Major | . | Owen O'Malley | Owen O'Malley |
-| [HDFS-1626](https://issues.apache.org/jira/browse/HDFS-1626) | Make BLOCK\_INVALIDATE\_LIMIT configurable | Minor | namenode | Arun C Murthy | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-478](https://issues.apache.org/jira/browse/MAPREDUCE-478) | separate jvm param for mapper and reducer | Minor | . | Koji Noguchi | Arun C Murthy |
| [HDFS-457](https://issues.apache.org/jira/browse/HDFS-457) | better handling of volume failure in Data Node storage | Major | datanode | Boris Shkolnik | Boris Shkolnik |
-| [MAPREDUCE-2355](https://issues.apache.org/jira/browse/MAPREDUCE-2355) | Add an out of band heartbeat damper | Major | jobtracker | Owen O'Malley | Arun C Murthy |
+| [HDFS-1626](https://issues.apache.org/jira/browse/HDFS-1626) | Make BLOCK\_INVALIDATE\_LIMIT configurable | Minor | namenode | Arun C Murthy | Tsz Wo Nicholas Sze |
| [MAPREDUCE-2316](https://issues.apache.org/jira/browse/MAPREDUCE-2316) | Update docs for CapacityScheduler | Major | capacity-sched, documentation | Arun C Murthy | Arun C Murthy |
+| [HADOOP-7247](https://issues.apache.org/jira/browse/HADOOP-7247) | Fix documentation to reflect new jar names | Major | . | Owen O'Malley | Owen O'Malley |
| [MAPREDUCE-1943](https://issues.apache.org/jira/browse/MAPREDUCE-1943) | Implement limits on per-job JobConf, Counters, StatusReport, Split-Sizes | Major | . | Mahadev konar | Mahadev konar |
-| [MAPREDUCE-478](https://issues.apache.org/jira/browse/MAPREDUCE-478) | separate jvm param for mapper and reducer | Minor | . | Koji Noguchi | Arun C Murthy |
+| [MAPREDUCE-2355](https://issues.apache.org/jira/browse/MAPREDUCE-2355) | Add an out of band heartbeat damper | Major | jobtracker | Owen O'Malley | Arun C Murthy |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7259](https://issues.apache.org/jira/browse/HADOOP-7259) | contrib modules should include build.properties from parent. | Major | build | Owen O'Malley | Owen O'Malley |
-| [HADOOP-7258](https://issues.apache.org/jira/browse/HADOOP-7258) | Gzip codec should not return null decompressors | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-7253](https://issues.apache.org/jira/browse/HADOOP-7253) | Fix default config | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-7246](https://issues.apache.org/jira/browse/HADOOP-7246) | The default log4j configuration causes warnings about EventCounter | Major | . | Owen O'Malley | Luke Lu |
-| [HADOOP-7243](https://issues.apache.org/jira/browse/HADOOP-7243) | Fix contrib unit tests (fairshare, hdfsproxy, datajoin, streaming) | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-7232](https://issues.apache.org/jira/browse/HADOOP-7232) | Fix javadoc warnings | Blocker | documentation | Owen O'Malley | Owen O'Malley |
-| [HADOOP-7215](https://issues.apache.org/jira/browse/HADOOP-7215) | RPC clients must connect over a network interface corresponding to the host name in the client's kerberos principal key | Blocker | security | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-6907](https://issues.apache.org/jira/browse/HADOOP-6907) | Rpc client doesn't use the per-connection conf to figure out server's Kerberos principal | Major | ipc, security | Kan Zhang | Kan Zhang |
+| [MAPREDUCE-1280](https://issues.apache.org/jira/browse/MAPREDUCE-1280) | Eclipse Plugin does not work with Eclipse Ganymede (3.4) | Major | . | Aaron Kimball | Alex Kozlov |
| [HADOOP-7190](https://issues.apache.org/jira/browse/HADOOP-7190) | Put metrics v1 back into the hadoop-20-security branch | Major | metrics | Owen O'Malley | Owen O'Malley |
-| [HADOOP-7163](https://issues.apache.org/jira/browse/HADOOP-7163) | "java.net.SocketTimeoutException: 60000 millis timeout" happens a lot | Major | ipc | Owen O'Malley | Devaraj Das |
+| [HADOOP-7232](https://issues.apache.org/jira/browse/HADOOP-7232) | Fix javadoc warnings | Blocker | documentation | Owen O'Malley | Owen O'Malley |
| [HADOOP-7143](https://issues.apache.org/jira/browse/HADOOP-7143) | Hive Hadoop20SShims depends on removed HadoopArchives | Major | fs | Joep Rottinghuis | Joep Rottinghuis |
-| [HADOOP-7040](https://issues.apache.org/jira/browse/HADOOP-7040) | DiskChecker:mkdirsWithExistsCheck swallows FileNotFoundException. | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [HADOOP-6907](https://issues.apache.org/jira/browse/HADOOP-6907) | Rpc client doesn't use the per-connection conf to figure out server's Kerberos principal | Major | ipc, security | Kan Zhang | Kan Zhang |
-| [HADOOP-5647](https://issues.apache.org/jira/browse/HADOOP-5647) | TestJobHistory fails if /tmp/\_logs is not writable to. Testcase should not depend on /tmp | Major | test | Ravi Gummadi | Ravi Gummadi |
| [HDFS-1822](https://issues.apache.org/jira/browse/HDFS-1822) | Editlog opcodes overlap between 20 security and later releases | Blocker | namenode | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-7246](https://issues.apache.org/jira/browse/HADOOP-7246) | The default log4j configuration causes warnings about EventCounter | Major | . | Owen O'Malley | Luke Lu |
+| [HADOOP-7253](https://issues.apache.org/jira/browse/HADOOP-7253) | Fix default config | Major | . | Owen O'Malley | Owen O'Malley |
| [HDFS-1022](https://issues.apache.org/jira/browse/HDFS-1022) | Merge under-10-min tests specs into one file | Major | test | Erik Steffl | Erik Steffl |
+| [HADOOP-7259](https://issues.apache.org/jira/browse/HADOOP-7259) | contrib modules should include build.properties from parent. | Major | build | Owen O'Malley | Owen O'Malley |
+| [HADOOP-7215](https://issues.apache.org/jira/browse/HADOOP-7215) | RPC clients must connect over a network interface corresponding to the host name in the client's kerberos principal key | Blocker | security | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-7258](https://issues.apache.org/jira/browse/HADOOP-7258) | Gzip codec should not return null decompressors | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-5647](https://issues.apache.org/jira/browse/HADOOP-5647) | TestJobHistory fails if /tmp/\_logs is not writable to. Testcase should not depend on /tmp | Major | test | Ravi Gummadi | Ravi Gummadi |
+| [HADOOP-7040](https://issues.apache.org/jira/browse/HADOOP-7040) | DiskChecker:mkdirsWithExistsCheck swallows FileNotFoundException. | Major | . | Boris Shkolnik | Boris Shkolnik |
| [MAPREDUCE-2365](https://issues.apache.org/jira/browse/MAPREDUCE-2365) | Add counters for FileInputFormat (BYTES\_READ) and FileOutputFormat (BYTES\_WRITTEN) | Major | . | Owen O'Malley | Siddharth Seth |
+| [HADOOP-7163](https://issues.apache.org/jira/browse/HADOOP-7163) | "java.net.SocketTimeoutException: 60000 millis timeout" happens a lot | Major | ipc | Owen O'Malley | Devaraj Das |
+| [HADOOP-7243](https://issues.apache.org/jira/browse/HADOOP-7243) | Fix contrib unit tests (fairshare, hdfsproxy, datajoin, streaming) | Major | . | Owen O'Malley | Owen O'Malley |
+| [MAPREDUCE-323](https://issues.apache.org/jira/browse/MAPREDUCE-323) | Improve the way job history files are managed | Critical | jobtracker | Amar Kamat | Dick King |
| [MAPREDUCE-2278](https://issues.apache.org/jira/browse/MAPREDUCE-2278) | DistributedCache shouldn't hold a ref to JobConf | Major | distributed-cache, tasktracker | Arun C Murthy | Chris Douglas |
| [MAPREDUCE-1699](https://issues.apache.org/jira/browse/MAPREDUCE-1699) | JobHistory shouldn't be disabled for any reason | Major | jobtracker | Arun C Murthy | Krishna Ramachandran |
-| [MAPREDUCE-1280](https://issues.apache.org/jira/browse/MAPREDUCE-1280) | Eclipse Plugin does not work with Eclipse Ganymede (3.4) | Major | . | Aaron Kimball | Alex Kozlov |
-| [MAPREDUCE-1233](https://issues.apache.org/jira/browse/MAPREDUCE-1233) | Incorrect Waiting maps/reduces in Jobtracker metrics | Major | jobtracker | V.Karthikeyan | Luke Lu |
| [MAPREDUCE-1118](https://issues.apache.org/jira/browse/MAPREDUCE-1118) | Capacity Scheduler scheduling information is hard to read / should be tabular format | Major | capacity-sched | Allen Wittenauer | Krishna Ramachandran |
-| [MAPREDUCE-323](https://issues.apache.org/jira/browse/MAPREDUCE-323) | Improve the way job history files are managed | Critical | jobtracker | Amar Kamat | Dick King |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [MAPREDUCE-1233](https://issues.apache.org/jira/browse/MAPREDUCE-1233) | Incorrect Waiting maps/reduces in Jobtracker metrics | Major | jobtracker | V.Karthikeyan | Luke Lu |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.203.0/RELEASENOTES.0.20.203.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.203.0/RELEASENOTES.0.20.203.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.203.0/RELEASENOTES.0.20.203.0.md
index 4138475..57a6807 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.203.0/RELEASENOTES.0.20.203.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.203.0/RELEASENOTES.0.20.203.0.md
@@ -23,16 +23,20 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-5647](https://issues.apache.org/jira/browse/HADOOP-5647) | *Major* | **TestJobHistory fails if /tmp/\_logs is not writable to. Testcase should not depend on /tmp**
-
-Removed dependency of testcase on /tmp and made it to use test.build.data directory instead.
-
-
----
+* [MAPREDUCE-478](https://issues.apache.org/jira/browse/MAPREDUCE-478) | *Minor* | **separate jvm param for mapper and reducer**
-* [HDFS-1626](https://issues.apache.org/jira/browse/HDFS-1626) | *Minor* | **Make BLOCK\_INVALIDATE\_LIMIT configurable**
+Allow map and reduce jvm parameters, environment variables and ulimit to be set separately.
-Added a new configuration property dfs.block.invalidate.limit for FSNamesystem.blockInvalidateLimit.
+Configuration changes:
+ add mapred.map.child.java.opts
+ add mapred.reduce.child.java.opts
+ add mapred.map.child.env
+ add mapred.reduce.child.ulimit
+ add mapred.map.child.env
+ add mapred.reduce.child.ulimit
+ deprecated mapred.child.java.opts
+ deprecated mapred.child.env
+ deprecated mapred.child.ulimit
---
@@ -44,27 +48,16 @@ Datanode can continue if a volume for replica storage fails. Previously a datano
---
-* [MAPREDUCE-1118](https://issues.apache.org/jira/browse/MAPREDUCE-1118) | *Major* | **Capacity Scheduler scheduling information is hard to read / should be tabular format**
+* [HDFS-1626](https://issues.apache.org/jira/browse/HDFS-1626) | *Minor* | **Make BLOCK\_INVALIDATE\_LIMIT configurable**
-Add CapacityScheduler servlet to enhance web UI for queue information.
+Added a new configuration property dfs.block.invalidate.limit for FSNamesystem.blockInvalidateLimit.
---
-* [MAPREDUCE-478](https://issues.apache.org/jira/browse/MAPREDUCE-478) | *Minor* | **separate jvm param for mapper and reducer**
-
-Allow map and reduce jvm parameters, environment variables and ulimit to be set separately.
+* [HADOOP-5647](https://issues.apache.org/jira/browse/HADOOP-5647) | *Major* | **TestJobHistory fails if /tmp/\_logs is not writable to. Testcase should not depend on /tmp**
-Configuration changes:
- add mapred.map.child.java.opts
- add mapred.reduce.child.java.opts
- add mapred.map.child.env
- add mapred.reduce.child.ulimit
- add mapred.map.child.env
- add mapred.reduce.child.ulimit
- deprecated mapred.child.java.opts
- deprecated mapred.child.env
- deprecated mapred.child.ulimit
+Removed dependency of testcase on /tmp and made it to use test.build.data directory instead.
---
@@ -114,4 +107,9 @@ The new API described above, which can be used to programmatically obtain histor
throws IOException
+---
+
+* [MAPREDUCE-1118](https://issues.apache.org/jira/browse/MAPREDUCE-1118) | *Major* | **Capacity Scheduler scheduling information is hard to read / should be tabular format**
+
+Add CapacityScheduler servlet to enhance web UI for queue information.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.203.1/CHANGES.0.20.203.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.203.1/CHANGES.0.20.203.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.203.1/CHANGES.0.20.203.1.md
index a288a36..66bce3f 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.203.1/CHANGES.0.20.203.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.203.1/CHANGES.0.20.203.1.md
@@ -18,30 +18,8 @@
-->
# Apache Hadoop Changelog
-## Release 0.20.203.1 - Unreleased (as of 2016-03-04)
+## Release 0.20.203.1 - Unreleased (as of 2017-08-28)
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
@@ -52,21 +30,3 @@
| [HADOOP-7297](https://issues.apache.org/jira/browse/HADOOP-7297) | Error in the documentation regarding Checkpoint/Backup Node | Trivial | documentation | arnaud p | Harsh J |
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.0/CHANGES.0.20.204.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.0/CHANGES.0.20.204.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.0/CHANGES.0.20.204.0.md
index a9d18ef..d08c867 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.0/CHANGES.0.20.204.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.0/CHANGES.0.20.204.0.md
@@ -27,19 +27,13 @@
| [HADOOP-6255](https://issues.apache.org/jira/browse/HADOOP-6255) | Create an rpm integration project | Major | . | Owen O'Malley | Eric Yang |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7398](https://issues.apache.org/jira/browse/HADOOP-7398) | create a mechanism to suppress the HADOOP\_HOME deprecated warning | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-7144](https://issues.apache.org/jira/browse/HADOOP-7144) | Expose JMX with something like JMXProxyServlet | Major | . | Luke Lu | Robert Joseph Evans |
| [MAPREDUCE-2558](https://issues.apache.org/jira/browse/MAPREDUCE-2558) | Add queue-level metrics 0.20-security branch | Major | jobtracker | Jeffrey Naisbitt | Jeffrey Naisbitt |
+| [HADOOP-7398](https://issues.apache.org/jira/browse/HADOOP-7398) | create a mechanism to suppress the HADOOP\_HOME deprecated warning | Major | . | Owen O'Malley | Owen O'Malley |
| [MAPREDUCE-1938](https://issues.apache.org/jira/browse/MAPREDUCE-1938) | Ability for having user's classes take precedence over the system classes for tasks' classpath | Blocker | job submission, task, tasktracker | Devaraj Das | Krishna Ramachandran |
@@ -47,87 +41,81 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7277](https://issues.apache.org/jira/browse/HADOOP-7277) | Add Eclipse launch tasks for the 0.20-security branch | Minor | build | Jeffrey Naisbitt | Jeffrey Naisbitt |
-| [HADOOP-7248](https://issues.apache.org/jira/browse/HADOOP-7248) | Have a way to automatically update Eclipse .classpath file when new libs are added to the classpath through Ivy for 0.20-\* based sources | Minor | build | Konstantin Boudnik | Thomas Graves |
| [HDFS-1773](https://issues.apache.org/jira/browse/HDFS-1773) | Remove a datanode from cluster if include list is not empty and this datanode is removed from both include and exclude lists | Minor | namenode | Tanping Wang | Tanping Wang |
-| [MAPREDUCE-2524](https://issues.apache.org/jira/browse/MAPREDUCE-2524) | Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffle | Minor | tasktracker | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-2495](https://issues.apache.org/jira/browse/MAPREDUCE-2495) | The distributed cache cleanup thread has no monitoring to check to see if it has died for some reason | Minor | distributed-cache | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-2490](https://issues.apache.org/jira/browse/MAPREDUCE-2490) | Log blacklist debug count | Trivial | jobtracker | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-2479](https://issues.apache.org/jira/browse/MAPREDUCE-2479) | Backport MAPREDUCE-1568 to hadoop security branch | Major | tasktracker | Robert Joseph Evans | Robert Joseph Evans |
| [MAPREDUCE-2456](https://issues.apache.org/jira/browse/MAPREDUCE-2456) | Show the reducer taskid and map/reduce tasktrackers for "Failed fetch notification #\_ for task attempt..." log messages | Trivial | jobtracker | Jeffrey Naisbitt | Jeffrey Naisbitt |
+| [HADOOP-7248](https://issues.apache.org/jira/browse/HADOOP-7248) | Have a way to automatically update Eclipse .classpath file when new libs are added to the classpath through Ivy for 0.20-\* based sources | Minor | build | Konstantin Boudnik | Thomas Graves |
+| [HADOOP-7277](https://issues.apache.org/jira/browse/HADOOP-7277) | Add Eclipse launch tasks for the 0.20-security branch | Minor | build | Jeffrey Naisbitt | Jeffrey Naisbitt |
+| [MAPREDUCE-2479](https://issues.apache.org/jira/browse/MAPREDUCE-2479) | Backport MAPREDUCE-1568 to hadoop security branch | Major | tasktracker | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-2490](https://issues.apache.org/jira/browse/MAPREDUCE-2490) | Log blacklist debug count | Trivial | jobtracker | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-2495](https://issues.apache.org/jira/browse/MAPREDUCE-2495) | The distributed cache cleanup thread has no monitoring to check to see if it has died for some reason | Minor | distributed-cache | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-2524](https://issues.apache.org/jira/browse/MAPREDUCE-2524) | Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffle | Minor | tasktracker | Thomas Graves | Thomas Graves |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7475](https://issues.apache.org/jira/browse/HADOOP-7475) | hadoop-setup-single-node.sh is broken | Blocker | . | Eric Yang | Eric Yang |
-| [HADOOP-7373](https://issues.apache.org/jira/browse/HADOOP-7373) | Tarball deployment doesn't work with {start,stop}-{dfs,mapred} | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-7364](https://issues.apache.org/jira/browse/HADOOP-7364) | TestMiniMRDFSCaching fails if test.build.dir is set to something other than build/test | Major | test | Thomas Graves | Thomas Graves |
-| [HADOOP-7356](https://issues.apache.org/jira/browse/HADOOP-7356) | RPM packages broke bin/hadoop script for hadoop 0.20.205 | Blocker | . | Eric Yang | Eric Yang |
-| [HADOOP-7330](https://issues.apache.org/jira/browse/HADOOP-7330) | The metrics source mbean implementation should return the attribute value instead of the object | Major | metrics | Luke Lu | Luke Lu |
-| [HADOOP-7324](https://issues.apache.org/jira/browse/HADOOP-7324) | Ganglia plugins for metrics v2 | Blocker | metrics | Luke Lu | Priyo Mustafi |
-| [HADOOP-7274](https://issues.apache.org/jira/browse/HADOOP-7274) | CLONE - IOUtils.readFully and IOUtils.skipFully have typo in exception creation's message | Minor | util | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-118](https://issues.apache.org/jira/browse/MAPREDUCE-118) | Job.getJobID() will always return null | Blocker | client | Amar Kamat | Amareshwari Sriramadasu |
+| [HDFS-1258](https://issues.apache.org/jira/browse/HDFS-1258) | Clearing namespace quota on "/" corrupts FS image | Blocker | namenode | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-1377](https://issues.apache.org/jira/browse/HDFS-1377) | Quota bug for partial blocks allows quotas to be violated | Blocker | namenode | Eli Collins | Eli Collins |
+| [HDFS-1750](https://issues.apache.org/jira/browse/HDFS-1750) | fs -ls hftp://file not working | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-1758](https://issues.apache.org/jira/browse/HDFS-1758) | Web UI JSP pages thread safety issue | Minor | tools | Tanping Wang | Tanping Wang |
+| [MAPREDUCE-2411](https://issues.apache.org/jira/browse/MAPREDUCE-2411) | When you submit a job to a queue with no ACLs you get an inscrutible NPE | Minor | . | Dick King | Dick King |
+| [HDFS-1189](https://issues.apache.org/jira/browse/HDFS-1189) | Quota counts missed between clear quota and set quota | Major | namenode | Kang Xiao | John George |
+| [MAPREDUCE-2443](https://issues.apache.org/jira/browse/MAPREDUCE-2443) | Fix FI build - broken after MR-2429 | Minor | test | Siddharth Seth | Siddharth Seth |
| [HADOOP-7232](https://issues.apache.org/jira/browse/HADOOP-7232) | Fix javadoc warnings | Blocker | documentation | Owen O'Malley | Owen O'Malley |
-| [HDFS-2057](https://issues.apache.org/jira/browse/HDFS-2057) | Wait time to terminate the threads causing unit tests to take longer time | Major | datanode | Bharath Mundlapudi | Bharath Mundlapudi |
+| [HDFS-1822](https://issues.apache.org/jira/browse/HDFS-1822) | Editlog opcodes overlap between 20 security and later releases | Blocker | namenode | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-2451](https://issues.apache.org/jira/browse/MAPREDUCE-2451) | Log the reason string of healthcheck script | Trivial | jobtracker | Thomas Graves | Thomas Graves |
+| [HADOOP-7274](https://issues.apache.org/jira/browse/HADOOP-7274) | CLONE - IOUtils.readFully and IOUtils.skipFully have typo in exception creation's message | Minor | util | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-2514](https://issues.apache.org/jira/browse/MAPREDUCE-2514) | ReinitTrackerAction class name misspelled RenitTrackerAction in task tracker log | Trivial | tasktracker | Jonathan Eagles | Jonathan Eagles |
+| [HDFS-1592](https://issues.apache.org/jira/browse/HDFS-1592) | Datanode startup doesn't honor volumes.tolerated | Major | . | Bharath Mundlapudi | Bharath Mundlapudi |
+| [HADOOP-7330](https://issues.apache.org/jira/browse/HADOOP-7330) | The metrics source mbean implementation should return the attribute value instead of the object | Major | metrics | Luke Lu | Luke Lu |
| [HDFS-2023](https://issues.apache.org/jira/browse/HDFS-2023) | Backport of NPE for File.list and File.listFiles | Major | datanode | Bharath Mundlapudi | Bharath Mundlapudi |
+| [MAPREDUCE-2529](https://issues.apache.org/jira/browse/MAPREDUCE-2529) | Recognize Jetty bug 1342 and handle it | Major | tasktracker | Thomas Graves | Thomas Graves |
+| [HADOOP-7364](https://issues.apache.org/jira/browse/HADOOP-7364) | TestMiniMRDFSCaching fails if test.build.dir is set to something other than build/test | Major | test | Thomas Graves | Thomas Graves |
| [HDFS-1878](https://issues.apache.org/jira/browse/HDFS-1878) | TestHDFSServerPorts unit test failure - race condition in FSNamesystem.close() causes NullPointerException without serious consequence | Minor | namenode | Matt Foley | Matt Foley |
-| [HDFS-1822](https://issues.apache.org/jira/browse/HDFS-1822) | Editlog opcodes overlap between 20 security and later releases | Blocker | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-1758](https://issues.apache.org/jira/browse/HDFS-1758) | Web UI JSP pages thread safety issue | Minor | tools | Tanping Wang | Tanping Wang |
-| [HDFS-1750](https://issues.apache.org/jira/browse/HDFS-1750) | fs -ls hftp://file not working | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-2057](https://issues.apache.org/jira/browse/HDFS-2057) | Wait time to terminate the threads causing unit tests to take longer time | Major | datanode | Bharath Mundlapudi | Bharath Mundlapudi |
+| [HADOOP-7373](https://issues.apache.org/jira/browse/HADOOP-7373) | Tarball deployment doesn't work with {start,stop}-{dfs,mapred} | Major | . | Owen O'Malley | Owen O'Malley |
| [HDFS-1692](https://issues.apache.org/jira/browse/HDFS-1692) | In secure mode, Datanode process doesn't exit when disks fail. | Major | datanode | Bharath Mundlapudi | Bharath Mundlapudi |
-| [HDFS-1592](https://issues.apache.org/jira/browse/HDFS-1592) | Datanode startup doesn't honor volumes.tolerated | Major | . | Bharath Mundlapudi | Bharath Mundlapudi |
-| [HDFS-1377](https://issues.apache.org/jira/browse/HDFS-1377) | Quota bug for partial blocks allows quotas to be violated | Blocker | namenode | Eli Collins | Eli Collins |
-| [HDFS-1258](https://issues.apache.org/jira/browse/HDFS-1258) | Clearing namespace quota on "/" corrupts FS image | Blocker | namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-1189](https://issues.apache.org/jira/browse/HDFS-1189) | Quota counts missed between clear quota and set quota | Major | namenode | Kang Xiao | John George |
+| [HADOOP-7324](https://issues.apache.org/jira/browse/HADOOP-7324) | Ganglia plugins for metrics v2 | Blocker | metrics | Luke Lu | Priyo Mustafi |
+| [MAPREDUCE-2409](https://issues.apache.org/jira/browse/MAPREDUCE-2409) | Distributed Cache does not differentiate between file /archive for files with the same path | Major | distributed-cache | Siddharth Seth | Siddharth Seth |
+| [HADOOP-7475](https://issues.apache.org/jira/browse/HADOOP-7475) | hadoop-setup-single-node.sh is broken | Blocker | . | Eric Yang | Eric Yang |
+| [MAPREDUCE-2447](https://issues.apache.org/jira/browse/MAPREDUCE-2447) | Set JvmContext sooner for a task - MR2429 | Minor | . | Siddharth Seth | Siddharth Seth |
+| [MAPREDUCE-2621](https://issues.apache.org/jira/browse/MAPREDUCE-2621) | TestCapacityScheduler fails with "Queue "q1" does not exist" | Minor | . | Sherry Chen | Sherry Chen |
+| [MAPREDUCE-2651](https://issues.apache.org/jira/browse/MAPREDUCE-2651) | Race condition in Linux Task Controller for job log directory creation | Major | task-controller | Bharath Mundlapudi | Bharath Mundlapudi |
+| [HADOOP-7356](https://issues.apache.org/jira/browse/HADOOP-7356) | RPM packages broke bin/hadoop script for hadoop 0.20.205 | Blocker | . | Eric Yang | Eric Yang |
| [MAPREDUCE-2846](https://issues.apache.org/jira/browse/MAPREDUCE-2846) | a small % of all tasks fail with DefaultTaskController | Blocker | task, task-controller, tasktracker | Allen Wittenauer | Owen O'Malley |
| [MAPREDUCE-2804](https://issues.apache.org/jira/browse/MAPREDUCE-2804) | "Creation of symlink to attempt log dir failed." message is not useful | Blocker | . | Allen Wittenauer | Owen O'Malley |
-| [MAPREDUCE-2651](https://issues.apache.org/jira/browse/MAPREDUCE-2651) | Race condition in Linux Task Controller for job log directory creation | Major | task-controller | Bharath Mundlapudi | Bharath Mundlapudi |
-| [MAPREDUCE-2621](https://issues.apache.org/jira/browse/MAPREDUCE-2621) | TestCapacityScheduler fails with "Queue "q1" does not exist" | Minor | . | Sherry Chen | Sherry Chen |
-| [MAPREDUCE-2555](https://issues.apache.org/jira/browse/MAPREDUCE-2555) | JvmInvalidate errors in the gridmix TT logs | Minor | tasktracker | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-2529](https://issues.apache.org/jira/browse/MAPREDUCE-2529) | Recognize Jetty bug 1342 and handle it | Major | tasktracker | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-2514](https://issues.apache.org/jira/browse/MAPREDUCE-2514) | ReinitTrackerAction class name misspelled RenitTrackerAction in task tracker log | Trivial | tasktracker | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-2451](https://issues.apache.org/jira/browse/MAPREDUCE-2451) | Log the reason string of healthcheck script | Trivial | jobtracker | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-2447](https://issues.apache.org/jira/browse/MAPREDUCE-2447) | Set JvmContext sooner for a task - MR2429 | Minor | . | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-2443](https://issues.apache.org/jira/browse/MAPREDUCE-2443) | Fix FI build - broken after MR-2429 | Minor | test | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-2429](https://issues.apache.org/jira/browse/MAPREDUCE-2429) | Check jvmid during task status report | Major | tasktracker | Arun C Murthy | Siddharth Seth |
-| [MAPREDUCE-2418](https://issues.apache.org/jira/browse/MAPREDUCE-2418) | Errors not shown in the JobHistory servlet (specifically Counter Limit Exceeded) | Minor | . | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-2411](https://issues.apache.org/jira/browse/MAPREDUCE-2411) | When you submit a job to a queue with no ACLs you get an inscrutible NPE | Minor | . | Dick King | Dick King |
-| [MAPREDUCE-2409](https://issues.apache.org/jira/browse/MAPREDUCE-2409) | Distributed Cache does not differentiate between file /archive for files with the same path | Major | distributed-cache | Siddharth Seth | Siddharth Seth |
+| [MAPREDUCE-2358](https://issues.apache.org/jira/browse/MAPREDUCE-2358) | MapReduce assumes HDFS as the default filesystem | Major | . | Owen O'Malley | Krishna Ramachandran |
+| [MAPREDUCE-517](https://issues.apache.org/jira/browse/MAPREDUCE-517) | The capacity-scheduler should assign multiple tasks per heartbeat | Critical | . | Arun C Murthy | Arun C Murthy |
+| [MAPREDUCE-2357](https://issues.apache.org/jira/browse/MAPREDUCE-2357) | When extending inputsplit (non-FileSplit), all exceptions are ignored | Major | task | Owen O'Malley | Luke Lu |
| [MAPREDUCE-2366](https://issues.apache.org/jira/browse/MAPREDUCE-2366) | TaskTracker can't retrieve stdout and stderr from web UI | Major | tasktracker | Owen O'Malley | Dick King |
-| [MAPREDUCE-2364](https://issues.apache.org/jira/browse/MAPREDUCE-2364) | Shouldn't hold lock on rjob while localizing resources. | Major | tasktracker | Owen O'Malley | Devaraj Das |
| [MAPREDUCE-2362](https://issues.apache.org/jira/browse/MAPREDUCE-2362) | Unit test failures: TestBadRecords and TestTaskTrackerMemoryManager | Major | test | Owen O'Malley | Greg Roelofs |
+| [MAPREDUCE-2356](https://issues.apache.org/jira/browse/MAPREDUCE-2356) | A task succeeded even though there were errors on all attempts. | Major | . | Owen O'Malley | Luke Lu |
+| [MAPREDUCE-2555](https://issues.apache.org/jira/browse/MAPREDUCE-2555) | JvmInvalidate errors in the gridmix TT logs | Minor | tasktracker | Thomas Graves | Thomas Graves |
| [MAPREDUCE-2360](https://issues.apache.org/jira/browse/MAPREDUCE-2360) | Pig fails when using non-default FileSystem | Major | client | Owen O'Malley | |
| [MAPREDUCE-2359](https://issues.apache.org/jira/browse/MAPREDUCE-2359) | Distributed cache doesn't use non-default FileSystems correctly | Major | . | Owen O'Malley | Krishna Ramachandran |
-| [MAPREDUCE-2358](https://issues.apache.org/jira/browse/MAPREDUCE-2358) | MapReduce assumes HDFS as the default filesystem | Major | . | Owen O'Malley | Krishna Ramachandran |
-| [MAPREDUCE-2357](https://issues.apache.org/jira/browse/MAPREDUCE-2357) | When extending inputsplit (non-FileSplit), all exceptions are ignored | Major | task | Owen O'Malley | Luke Lu |
-| [MAPREDUCE-2356](https://issues.apache.org/jira/browse/MAPREDUCE-2356) | A task succeeded even though there were errors on all attempts. | Major | . | Owen O'Malley | Luke Lu |
-| [MAPREDUCE-517](https://issues.apache.org/jira/browse/MAPREDUCE-517) | The capacity-scheduler should assign multiple tasks per heartbeat | Critical | . | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-118](https://issues.apache.org/jira/browse/MAPREDUCE-118) | Job.getJobID() will always return null | Blocker | client | Amar Kamat | Amareshwari Sriramadasu |
+| [MAPREDUCE-2418](https://issues.apache.org/jira/browse/MAPREDUCE-2418) | Errors not shown in the JobHistory servlet (specifically Counter Limit Exceeded) | Minor | . | Siddharth Seth | Siddharth Seth |
+| [MAPREDUCE-2429](https://issues.apache.org/jira/browse/MAPREDUCE-2429) | Check jvmid during task status report | Major | tasktracker | Arun C Murthy | Siddharth Seth |
+| [MAPREDUCE-2364](https://issues.apache.org/jira/browse/MAPREDUCE-2364) | Shouldn't hold lock on rjob while localizing resources. | Major | tasktracker | Owen O'Malley | Devaraj Das |
### TESTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HDFS-2218](https://issues.apache.org/jira/browse/HDFS-2218) | Disable TestHdfsProxy.testHdfsProxyInterface in 0.20-security and branch-1 until HDFS-2217 is fixed | Blocker | contrib/hdfsproxy, test | Matt Foley | Matt Foley |
| [HDFS-2044](https://issues.apache.org/jira/browse/HDFS-2044) | TestQueueProcessingStatistics failing automatic test due to timing issues | Major | test | Matt Foley | Matt Foley |
+| [HDFS-2218](https://issues.apache.org/jira/browse/HDFS-2218) | Disable TestHdfsProxy.testHdfsProxyInterface in 0.20-security and branch-1 until HDFS-2217 is fixed | Blocker | contrib/hdfsproxy, test | Matt Foley | Matt Foley |
### SUB-TASKS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HDFS-1767](https://issues.apache.org/jira/browse/HDFS-1767) | Namenode should ignore non-initial block reports from datanodes when in safemode during startup | Major | datanode | Matt Foley | Matt Foley |
-| [HDFS-1541](https://issues.apache.org/jira/browse/HDFS-1541) | Not marking datanodes dead When namenode in safemode | Major | namenode | Hairong Kuang | Hairong Kuang |
| [HDFS-1445](https://issues.apache.org/jira/browse/HDFS-1445) | Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file | Major | datanode | Matt Foley | Matt Foley |
-| [MAPREDUCE-2415](https://issues.apache.org/jira/browse/MAPREDUCE-2415) | Distribute TaskTracker userlogs onto multiple disks | Major | task-controller, tasktracker | Bharath Mundlapudi | Bharath Mundlapudi |
+| [HDFS-1541](https://issues.apache.org/jira/browse/HDFS-1541) | Not marking datanodes dead When namenode in safemode | Major | namenode | Hairong Kuang | Hairong Kuang |
+| [HDFS-1767](https://issues.apache.org/jira/browse/HDFS-1767) | Namenode should ignore non-initial block reports from datanodes when in safemode during startup | Major | datanode | Matt Foley | Matt Foley |
| [MAPREDUCE-2413](https://issues.apache.org/jira/browse/MAPREDUCE-2413) | TaskTracker should handle disk failures at both startup and runtime | Major | task-controller, tasktracker | Bharath Mundlapudi | Ravi Gummadi |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [MAPREDUCE-2415](https://issues.apache.org/jira/browse/MAPREDUCE-2415) | Distribute TaskTracker userlogs onto multiple disks | Major | task-controller, tasktracker | Bharath Mundlapudi | Bharath Mundlapudi |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.0/RELEASENOTES.0.20.204.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.0/RELEASENOTES.0.20.204.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.0/RELEASENOTES.0.20.204.0.md
index ae774bd..10d5ba6 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.0/RELEASENOTES.0.20.204.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.0/RELEASENOTES.0.20.204.0.md
@@ -23,37 +23,30 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-6255](https://issues.apache.org/jira/browse/HADOOP-6255) | *Major* | **Create an rpm integration project**
-
-Added RPM/DEB packages to build system.
-
-
----
-
-* [HDFS-2218](https://issues.apache.org/jira/browse/HDFS-2218) | *Blocker* | **Disable TestHdfsProxy.testHdfsProxyInterface in 0.20-security and branch-1 until HDFS-2217 is fixed**
+* [HDFS-1445](https://issues.apache.org/jira/browse/HDFS-1445) | *Major* | **Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file**
-Test case TestHdfsProxy.testHdfsProxyInterface has been temporarily disabled for this release, due to failure in the Hudson automated test environment.
+Batch hardlinking during "upgrade" snapshots, cutting time from aprx 8 minutes per volume to aprx 8 seconds. Validated in both Linux and Windows. Depends on prior integration with patch for HADOOP-7133.
---
-* [HDFS-1445](https://issues.apache.org/jira/browse/HDFS-1445) | *Major* | **Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file**
+* [MAPREDUCE-2479](https://issues.apache.org/jira/browse/MAPREDUCE-2479) | *Major* | **Backport MAPREDUCE-1568 to hadoop security branch**
-Batch hardlinking during "upgrade" snapshots, cutting time from aprx 8 minutes per volume to aprx 8 seconds. Validated in both Linux and Windows. Depends on prior integration with patch for HADOOP-7133.
+Added mapreduce.tasktracker.distributedcache.checkperiod to the task tracker that defined the period to wait while cleaning up the distributed cache. The default is 1 min.
---
-* [MAPREDUCE-2846](https://issues.apache.org/jira/browse/MAPREDUCE-2846) | *Blocker* | **a small % of all tasks fail with DefaultTaskController**
+* [HADOOP-6255](https://issues.apache.org/jira/browse/HADOOP-6255) | *Major* | **Create an rpm integration project**
-Fixed a race condition in writing the log index file that caused tasks to 'fail'.
+Added RPM/DEB packages to build system.
---
-* [MAPREDUCE-2804](https://issues.apache.org/jira/browse/MAPREDUCE-2804) | *Blocker* | **"Creation of symlink to attempt log dir failed." message is not useful**
+* [MAPREDUCE-2524](https://issues.apache.org/jira/browse/MAPREDUCE-2524) | *Minor* | **Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffle**
-Removed duplicate chmods of job log dir that were vulnerable to race conditions between tasks. Also improved the messages when the symlinks failed to be created.
+Added a new configuration option: mapreduce.reduce.shuffle.maxfetchfailures, and removed a no longer used option: mapred.reduce.copy.backoff.
---
@@ -68,16 +61,23 @@ mapreduce.reduce.shuffle.catch.exception.message.regex
---
-* [MAPREDUCE-2524](https://issues.apache.org/jira/browse/MAPREDUCE-2524) | *Minor* | **Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffle**
+* [HDFS-2218](https://issues.apache.org/jira/browse/HDFS-2218) | *Blocker* | **Disable TestHdfsProxy.testHdfsProxyInterface in 0.20-security and branch-1 until HDFS-2217 is fixed**
-Added a new configuration option: mapreduce.reduce.shuffle.maxfetchfailures, and removed a no longer used option: mapred.reduce.copy.backoff.
+Test case TestHdfsProxy.testHdfsProxyInterface has been temporarily disabled for this release, due to failure in the Hudson automated test environment.
---
-* [MAPREDUCE-2479](https://issues.apache.org/jira/browse/MAPREDUCE-2479) | *Major* | **Backport MAPREDUCE-1568 to hadoop security branch**
+* [MAPREDUCE-2846](https://issues.apache.org/jira/browse/MAPREDUCE-2846) | *Blocker* | **a small % of all tasks fail with DefaultTaskController**
-Added mapreduce.tasktracker.distributedcache.checkperiod to the task tracker that defined the period to wait while cleaning up the distributed cache. The default is 1 min.
+Fixed a race condition in writing the log index file that caused tasks to 'fail'.
+
+
+---
+
+* [MAPREDUCE-2804](https://issues.apache.org/jira/browse/MAPREDUCE-2804) | *Blocker* | **"Creation of symlink to attempt log dir failed." message is not useful**
+
+Removed duplicate chmods of job log dir that were vulnerable to race conditions between tasks. Also improved the messages when the symlinks failed to be created.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.1/CHANGES.0.20.204.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.1/CHANGES.0.20.204.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.1/CHANGES.0.20.204.1.md
deleted file mode 100644
index 56c3f85..0000000
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.1/CHANGES.0.20.204.1.md
+++ /dev/null
@@ -1,64 +0,0 @@
-
-<!---
-# Licensed to the Apache Software Foundation (ASF) under one
-# or more contributor license agreements. See the NOTICE file
-# distributed with this work for additional information
-# regarding copyright ownership. The ASF licenses this file
-# to you under the Apache License, Version 2.0 (the
-# "License"); you may not use this file except in compliance
-# with the License. You may obtain a copy of the License at
-#
-# http://www.apache.org/licenses/LICENSE-2.0
-#
-# Unless required by applicable law or agreed to in writing, software
-# distributed under the License is distributed on an "AS IS" BASIS,
-# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-# See the License for the specific language governing permissions and
-# limitations under the License.
--->
-# Apache Hadoop Changelog
-
-## Release 0.20.204.1 - Unreleased
-
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### BUG FIXES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.1/RELEASENOTES.0.20.204.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.1/RELEASENOTES.0.20.204.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.1/RELEASENOTES.0.20.204.1.md
deleted file mode 100644
index db70b82..0000000
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.204.1/RELEASENOTES.0.20.204.1.md
+++ /dev/null
@@ -1,24 +0,0 @@
-
-<!---
-# Licensed to the Apache Software Foundation (ASF) under one
-# or more contributor license agreements. See the NOTICE file
-# distributed with this work for additional information
-# regarding copyright ownership. The ASF licenses this file
-# to you under the Apache License, Version 2.0 (the
-# "License"); you may not use this file except in compliance
-# with the License. You may obtain a copy of the License at
-#
-# http://www.apache.org/licenses/LICENSE-2.0
-#
-# Unless required by applicable law or agreed to in writing, software
-# distributed under the License is distributed on an "AS IS" BASIS,
-# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-# See the License for the specific language governing permissions and
-# limitations under the License.
--->
-# Apache Hadoop 0.20.204.1 Release Notes
-
-These release notes cover new developer and user-facing incompatibilities, features, and major improvements.
-
-
-
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[22/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/CHANGES.0.23.7.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/CHANGES.0.23.7.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/CHANGES.0.23.7.md
index d67a6b7..17f5be0 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/CHANGES.0.23.7.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/CHANGES.0.23.7.md
@@ -27,12 +27,6 @@
| [HDFS-395](https://issues.apache.org/jira/browse/HDFS-395) | DFS Scalability: Incremental block reports | Major | datanode, namenode | dhruba borthakur | Tomasz Nykiel |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
@@ -44,158 +38,152 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9379](https://issues.apache.org/jira/browse/HADOOP-9379) | capture the ulimit info after printing the log to the console | Trivial | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-9374](https://issues.apache.org/jira/browse/HADOOP-9374) | Add tokens from -tokenCacheFile into UGI | Major | security | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9352](https://issues.apache.org/jira/browse/HADOOP-9352) | Expose UGI.setLoginUser for tests | Major | security | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9336](https://issues.apache.org/jira/browse/HADOOP-9336) | Allow UGI of current connection to be queried | Critical | ipc | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9253](https://issues.apache.org/jira/browse/HADOOP-9253) | Capture ulimit info in the logs at service start time | Major | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-9247](https://issues.apache.org/jira/browse/HADOOP-9247) | parametrize Clover "generateXxx" properties to make them re-definable via -D in mvn calls | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
-| [HADOOP-9216](https://issues.apache.org/jira/browse/HADOOP-9216) | CompressionCodecFactory#getCodecClasses should trim the result of parsing by Configuration. | Major | io | Tsuyoshi Ozawa | Tsuyoshi Ozawa |
-| [HADOOP-9147](https://issues.apache.org/jira/browse/HADOOP-9147) | Add missing fields to FIleStatus.toString | Trivial | . | Jonathan Allen | Jonathan Allen |
-| [HADOOP-8849](https://issues.apache.org/jira/browse/HADOOP-8849) | FileUtil#fullyDelete should grant the target directories +rwx permissions before trying to delete them | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
-| [HADOOP-8711](https://issues.apache.org/jira/browse/HADOOP-8711) | provide an option for IPC server users to avoid printing stack information for certain exceptions | Major | ipc | Brandon Li | Brandon Li |
-| [HADOOP-8462](https://issues.apache.org/jira/browse/HADOOP-8462) | Native-code implementation of bzip2 codec | Major | io | Govind Kamat | Govind Kamat |
-| [HADOOP-8214](https://issues.apache.org/jira/browse/HADOOP-8214) | make hadoop script recognize a full set of deprecated commands | Major | scripts | Roman Shaposhnik | Roman Shaposhnik |
-| [HADOOP-8075](https://issues.apache.org/jira/browse/HADOOP-8075) | Lower native-hadoop library log from info to debug | Major | native | Eli Collins | Hızır Sefa İrken |
-| [HADOOP-7886](https://issues.apache.org/jira/browse/HADOOP-7886) | Add toString to FileStatus | Minor | . | Jakob Homan | SreeHari |
| [HADOOP-7358](https://issues.apache.org/jira/browse/HADOOP-7358) | Improve log levels when exceptions caught in RPC handler | Minor | ipc | Todd Lipcon | Todd Lipcon |
+| [HADOOP-7886](https://issues.apache.org/jira/browse/HADOOP-7886) | Add toString to FileStatus | Minor | . | Jakob Homan | SreeHari |
+| [HADOOP-8214](https://issues.apache.org/jira/browse/HADOOP-8214) | make hadoop script recognize a full set of deprecated commands | Major | scripts | Roman Shaposhnik | Roman Shaposhnik |
+| [HADOOP-8711](https://issues.apache.org/jira/browse/HADOOP-8711) | provide an option for IPC server users to avoid printing stack information for certain exceptions | Major | ipc | Brandon Li | Brandon Li |
| [HDFS-3817](https://issues.apache.org/jira/browse/HDFS-3817) | avoid printing stack information for SafeModeException | Major | namenode | Brandon Li | Brandon Li |
-| [MAPREDUCE-5079](https://issues.apache.org/jira/browse/MAPREDUCE-5079) | Recovery should restore task state from job history info directly | Critical | mr-am | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4990](https://issues.apache.org/jira/browse/MAPREDUCE-4990) | Construct debug strings conditionally in ShuffleHandler.Shuffle#sendMapOutput() | Trivial | . | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-4989](https://issues.apache.org/jira/browse/MAPREDUCE-4989) | JSONify DataTables input data for Attempts page | Major | jobhistoryserver, mr-am | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-4949](https://issues.apache.org/jira/browse/MAPREDUCE-4949) | Enable multiple pi jobs to run in parallel | Minor | examples | Sandy Ryza | Sandy Ryza |
+| [HADOOP-8075](https://issues.apache.org/jira/browse/HADOOP-8075) | Lower native-hadoop library log from info to debug | Major | native | Eli Collins | Hızır Sefa İrken |
+| [HADOOP-9147](https://issues.apache.org/jira/browse/HADOOP-9147) | Add missing fields to FIleStatus.toString | Trivial | . | Jonathan Allen | Jonathan Allen |
| [MAPREDUCE-4907](https://issues.apache.org/jira/browse/MAPREDUCE-4907) | TrackerDistributedCacheManager issues too many getFileStatus calls | Major | mrv1, tasktracker | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4822](https://issues.apache.org/jira/browse/MAPREDUCE-4822) | Unnecessary conversions in History Events | Trivial | jobhistoryserver | Robert Joseph Evans | Chu Tong |
+| [HADOOP-9216](https://issues.apache.org/jira/browse/HADOOP-9216) | CompressionCodecFactory#getCodecClasses should trim the result of parsing by Configuration. | Major | io | Tsuyoshi Ozawa | Tsuyoshi Ozawa |
+| [HADOOP-8849](https://issues.apache.org/jira/browse/HADOOP-8849) | FileUtil#fullyDelete should grant the target directories +rwx permissions before trying to delete them | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
| [MAPREDUCE-4458](https://issues.apache.org/jira/browse/MAPREDUCE-4458) | Warn if java.library.path is used for AM or Task | Major | mrv2 | Robert Joseph Evans | Robert Parker |
-| [YARN-525](https://issues.apache.org/jira/browse/YARN-525) | make CS node-locality-delay refreshable | Major | capacityscheduler | Thomas Graves | Thomas Graves |
-| [YARN-443](https://issues.apache.org/jira/browse/YARN-443) | allow OS scheduling priority of NM to be different than the containers it launches | Major | nodemanager | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4949](https://issues.apache.org/jira/browse/MAPREDUCE-4949) | Enable multiple pi jobs to run in parallel | Minor | examples | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9247](https://issues.apache.org/jira/browse/HADOOP-9247) | parametrize Clover "generateXxx" properties to make them re-definable via -D in mvn calls | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
+| [MAPREDUCE-4822](https://issues.apache.org/jira/browse/MAPREDUCE-4822) | Unnecessary conversions in History Events | Trivial | jobhistoryserver | Robert Joseph Evans | Chu Tong |
+| [MAPREDUCE-4989](https://issues.apache.org/jira/browse/MAPREDUCE-4989) | JSONify DataTables input data for Attempts page | Major | jobhistoryserver, mr-am | Ravi Prakash | Ravi Prakash |
| [YARN-249](https://issues.apache.org/jira/browse/YARN-249) | Capacity Scheduler web page should show list of active users per queue like it used to (in 1.x) | Major | capacityscheduler | Ravi Prakash | Ravi Prakash |
+| [HADOOP-9336](https://issues.apache.org/jira/browse/HADOOP-9336) | Allow UGI of current connection to be queried | Critical | ipc | Daryn Sharp | Daryn Sharp |
+| [HADOOP-9352](https://issues.apache.org/jira/browse/HADOOP-9352) | Expose UGI.setLoginUser for tests | Major | security | Daryn Sharp | Daryn Sharp |
+| [HADOOP-8462](https://issues.apache.org/jira/browse/HADOOP-8462) | Native-code implementation of bzip2 codec | Major | io | Govind Kamat | Govind Kamat |
+| [HADOOP-9374](https://issues.apache.org/jira/browse/HADOOP-9374) | Add tokens from -tokenCacheFile into UGI | Major | security | Daryn Sharp | Daryn Sharp |
+| [YARN-443](https://issues.apache.org/jira/browse/YARN-443) | allow OS scheduling priority of NM to be different than the containers it launches | Major | nodemanager | Thomas Graves | Thomas Graves |
+| [HADOOP-9379](https://issues.apache.org/jira/browse/HADOOP-9379) | capture the ulimit info after printing the log to the console | Trivial | . | Arpit Gupta | Arpit Gupta |
+| [MAPREDUCE-4990](https://issues.apache.org/jira/browse/MAPREDUCE-4990) | Construct debug strings conditionally in ShuffleHandler.Shuffle#sendMapOutput() | Trivial | . | Karthik Kambatla | Karthik Kambatla |
+| [HADOOP-9253](https://issues.apache.org/jira/browse/HADOOP-9253) | Capture ulimit info in the logs at service start time | Major | . | Arpit Gupta | Arpit Gupta |
+| [YARN-525](https://issues.apache.org/jira/browse/YARN-525) | make CS node-locality-delay refreshable | Major | capacityscheduler | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-5079](https://issues.apache.org/jira/browse/MAPREDUCE-5079) | Recovery should restore task state from job history info directly | Critical | mr-am | Jason Lowe | Jason Lowe |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9406](https://issues.apache.org/jira/browse/HADOOP-9406) | hadoop-client leaks dependency on JDK tools jar | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-9339](https://issues.apache.org/jira/browse/HADOOP-9339) | IPC.Server incorrectly sets UGI auth type | Major | ipc | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9303](https://issues.apache.org/jira/browse/HADOOP-9303) | command manual dfsadmin missing entry for restoreFailedStorage option | Major | . | Thomas Graves | Andy Isaacson |
-| [HADOOP-9302](https://issues.apache.org/jira/browse/HADOOP-9302) | HDFS docs not linked from top level | Major | documentation | Thomas Graves | Andy Isaacson |
-| [HADOOP-9289](https://issues.apache.org/jira/browse/HADOOP-9289) | FsShell rm -f fails for non-matching globs | Blocker | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9278](https://issues.apache.org/jira/browse/HADOOP-9278) | HarFileSystem may leak file handle | Major | fs | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9231](https://issues.apache.org/jira/browse/HADOOP-9231) | Parametrize staging URL for the uniformity of distributionManagement | Major | build | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-9221](https://issues.apache.org/jira/browse/HADOOP-9221) | Convert remaining xdocs to APT | Major | . | Andy Isaacson | Andy Isaacson |
+| [MAPREDUCE-3952](https://issues.apache.org/jira/browse/MAPREDUCE-3952) | In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split. | Major | mrv2 | Zhenxiao Luo | Bhallamudi Venkata Siva Kamesh |
+| [HDFS-1765](https://issues.apache.org/jira/browse/HDFS-1765) | Block Replication should respect under-replication block priority | Major | namenode | Hairong Kuang | Uma Maheswara Rao G |
+| [MAPREDUCE-4007](https://issues.apache.org/jira/browse/MAPREDUCE-4007) | JobClient getJob(JobID) should return NULL if the job does not exist (for backwards compatibility) | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-6941](https://issues.apache.org/jira/browse/HADOOP-6941) | Support non-SUN JREs in UserGroupInformation | Major | . | Stephen Watt | Devaraj Das |
+| [HADOOP-8251](https://issues.apache.org/jira/browse/HADOOP-8251) | SecurityUtil.fetchServiceTicket broken after HADOOP-6941 | Blocker | security | Todd Lipcon | Todd Lipcon |
+| [HDFS-3119](https://issues.apache.org/jira/browse/HDFS-3119) | Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file | Minor | namenode | J.Andreina | Ashish Singhi |
+| [HDFS-3256](https://issues.apache.org/jira/browse/HDFS-3256) | HDFS considers blocks under-replicated if topology script is configured with only 1 rack | Major | . | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-8346](https://issues.apache.org/jira/browse/HADOOP-8346) | Changes to support Kerberos with non Sun JVM (HADOOP-6941) broke SPNEGO | Blocker | security | Alejandro Abdelnur | Devaraj Das |
+| [MAPREDUCE-4470](https://issues.apache.org/jira/browse/MAPREDUCE-4470) | Fix TestCombineFileInputFormat.testForEmptyFile | Major | test | Kihwal Lee | Ilya Katsov |
+| [YARN-83](https://issues.apache.org/jira/browse/YARN-83) | Change package of YarnClient to include apache | Major | client | Bikas Saha | Bikas Saha |
+| [YARN-40](https://issues.apache.org/jira/browse/YARN-40) | Provide support for missing yarn commands | Major | client | Devaraj K | Devaraj K |
+| [YARN-150](https://issues.apache.org/jira/browse/YARN-150) | AppRejectedTransition does not unregister app from master service and scheduler | Major | . | Bikas Saha | Bikas Saha |
+| [HADOOP-8878](https://issues.apache.org/jira/browse/HADOOP-8878) | uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on | Major | . | Arpit Gupta | Arpit Gupta |
+| [HDFS-4072](https://issues.apache.org/jira/browse/HDFS-4072) | On file deletion remove corresponding blocks pending replication | Minor | namenode | Jing Zhao | Jing Zhao |
+| [HDFS-2434](https://issues.apache.org/jira/browse/HDFS-2434) | TestNameNodeMetrics.testCorruptBlock fails intermittently | Major | test | Uma Maheswara Rao G | Jing Zhao |
+| [MAPREDUCE-4637](https://issues.apache.org/jira/browse/MAPREDUCE-4637) | Killing an unassigned task attempt causes the job to fail | Major | mrv2 | Tom White | Mayank Bansal |
+| [MAPREDUCE-4278](https://issues.apache.org/jira/browse/MAPREDUCE-4278) | cannot run two local jobs in parallel from the same gateway. | Major | . | Araceli Henley | Sandy Ryza |
+| [HADOOP-9155](https://issues.apache.org/jira/browse/HADOOP-9155) | FsPermission should have different default value, 777 for directory and 666 for file | Minor | . | Binglin Chang | Binglin Chang |
+| [HADOOP-8816](https://issues.apache.org/jira/browse/HADOOP-8816) | HTTP Error 413 full HEAD if using kerberos authentication | Major | net | Moritz Moeller | Moritz Moeller |
| [HADOOP-9212](https://issues.apache.org/jira/browse/HADOOP-9212) | Potential deadlock in FileSystem.Cache/IPC/UGI | Major | fs | Tom White | Tom White |
| [HADOOP-9193](https://issues.apache.org/jira/browse/HADOOP-9193) | hadoop script can inadvertently expand wildcard arguments when delegating to hdfs script | Minor | scripts | Jason Lowe | Andy Isaacson |
-| [HADOOP-9190](https://issues.apache.org/jira/browse/HADOOP-9190) | packaging docs is broken | Major | documentation | Thomas Graves | Andy Isaacson |
-| [HADOOP-9155](https://issues.apache.org/jira/browse/HADOOP-9155) | FsPermission should have different default value, 777 for directory and 666 for file | Minor | . | Binglin Chang | Binglin Chang |
-| [HADOOP-9154](https://issues.apache.org/jira/browse/HADOOP-9154) | SortedMapWritable#putAll() doesn't add key/value classes to the map | Major | io | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-9124](https://issues.apache.org/jira/browse/HADOOP-9124) | SortedMapWritable violates contract of Map interface for equals() and hashCode() | Minor | io | Patrick Hunt | Surenkumar Nihalani |
-| [HADOOP-8878](https://issues.apache.org/jira/browse/HADOOP-8878) | uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on | Major | . | Arpit Gupta | Arpit Gupta |
+| [MAPREDUCE-4946](https://issues.apache.org/jira/browse/MAPREDUCE-4946) | Type conversion of map completion events leads to performance problems with large jobs | Critical | mr-am | Jason Lowe | Jason Lowe |
+| [HADOOP-9231](https://issues.apache.org/jira/browse/HADOOP-9231) | Parametrize staging URL for the uniformity of distributionManagement | Major | build | Konstantin Boudnik | Konstantin Boudnik |
+| [HDFS-4426](https://issues.apache.org/jira/browse/HDFS-4426) | Secondary namenode shuts down immediately after startup | Blocker | namenode | Jason Lowe | Arpit Agarwal |
+| [YARN-354](https://issues.apache.org/jira/browse/YARN-354) | WebAppProxyServer exits immediately after startup | Blocker | . | Liang Xie | Liang Xie |
| [HADOOP-8857](https://issues.apache.org/jira/browse/HADOOP-8857) | hadoop.http.authentication.signature.secret.file docs should not state that secret is randomly generated | Minor | security | Eli Collins | Alejandro Abdelnur |
-| [HADOOP-8816](https://issues.apache.org/jira/browse/HADOOP-8816) | HTTP Error 413 full HEAD if using kerberos authentication | Major | net | Moritz Moeller | Moritz Moeller |
-| [HADOOP-8346](https://issues.apache.org/jira/browse/HADOOP-8346) | Changes to support Kerberos with non Sun JVM (HADOOP-6941) broke SPNEGO | Blocker | security | Alejandro Abdelnur | Devaraj Das |
-| [HADOOP-8251](https://issues.apache.org/jira/browse/HADOOP-8251) | SecurityUtil.fetchServiceTicket broken after HADOOP-6941 | Blocker | security | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6941](https://issues.apache.org/jira/browse/HADOOP-6941) | Support non-SUN JREs in UserGroupInformation | Major | . | Stephen Watt | Devaraj Das |
-| [HDFS-4649](https://issues.apache.org/jira/browse/HDFS-4649) | Webhdfs cannot list large directories | Blocker | namenode, security, webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-4581](https://issues.apache.org/jira/browse/HDFS-4581) | DataNode#checkDiskError should not be called on network errors | Major | datanode | Rohit Kochar | Rohit Kochar |
-| [HDFS-4553](https://issues.apache.org/jira/browse/HDFS-4553) | Webhdfs will NPE on some unexpected response codes | Major | webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-4544](https://issues.apache.org/jira/browse/HDFS-4544) | Error in deleting blocks should not do check disk, for all types of errors | Major | . | Amareshwari Sriramadasu | Arpit Agarwal |
-| [HDFS-4532](https://issues.apache.org/jira/browse/HDFS-4532) | RPC call queue may fill due to current user lookup | Critical | namenode | Daryn Sharp | Daryn Sharp |
-| [HDFS-4495](https://issues.apache.org/jira/browse/HDFS-4495) | Allow client-side lease renewal to be retried beyond soft-limit | Major | hdfs-client | Kihwal Lee | Kihwal Lee |
-| [HDFS-4462](https://issues.apache.org/jira/browse/HDFS-4462) | 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS | Major | namenode | Aaron T. Myers | Aaron T. Myers |
| [HDFS-4444](https://issues.apache.org/jira/browse/HDFS-4444) | Add space between total transaction time and number of transactions in FSEditLog#printStatistics | Trivial | . | Stephen Chu | Stephen Chu |
-| [HDFS-4426](https://issues.apache.org/jira/browse/HDFS-4426) | Secondary namenode shuts down immediately after startup | Blocker | namenode | Jason Lowe | Arpit Agarwal |
+| [YARN-133](https://issues.apache.org/jira/browse/YARN-133) | update web services docs for RM clusterMetrics | Major | resourcemanager | Thomas Graves | Ravi Prakash |
+| [HADOOP-9190](https://issues.apache.org/jira/browse/HADOOP-9190) | packaging docs is broken | Major | documentation | Thomas Graves | Andy Isaacson |
| [HDFS-4288](https://issues.apache.org/jira/browse/HDFS-4288) | NN accepts incremental BR as IBR in safemode | Critical | namenode | Daryn Sharp | Daryn Sharp |
-| [HDFS-4222](https://issues.apache.org/jira/browse/HDFS-4222) | NN is unresponsive and loses heartbeats of DNs when Hadoop is configured to use LDAP and LDAP has issues | Minor | namenode | Xiaobo Peng | Xiaobo Peng |
-| [HDFS-4128](https://issues.apache.org/jira/browse/HDFS-4128) | 2NN gets stuck in inconsistent state if edit log replay fails in the middle | Major | namenode | Todd Lipcon | Kihwal Lee |
-| [HDFS-4072](https://issues.apache.org/jira/browse/HDFS-4072) | On file deletion remove corresponding blocks pending replication | Minor | namenode | Jing Zhao | Jing Zhao |
-| [HDFS-3344](https://issues.apache.org/jira/browse/HDFS-3344) | Unreliable corrupt blocks counting in TestProcessCorruptBlocks | Major | namenode | Tsz Wo Nicholas Sze | Kihwal Lee |
-| [HDFS-3256](https://issues.apache.org/jira/browse/HDFS-3256) | HDFS considers blocks under-replicated if topology script is configured with only 1 rack | Major | . | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3119](https://issues.apache.org/jira/browse/HDFS-3119) | Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file | Minor | namenode | J.Andreina | Ashish Singhi |
-| [HDFS-2434](https://issues.apache.org/jira/browse/HDFS-2434) | TestNameNodeMetrics.testCorruptBlock fails intermittently | Major | test | Uma Maheswara Rao G | Jing Zhao |
-| [HDFS-1765](https://issues.apache.org/jira/browse/HDFS-1765) | Block Replication should respect under-replication block priority | Major | namenode | Hairong Kuang | Uma Maheswara Rao G |
-| [MAPREDUCE-5137](https://issues.apache.org/jira/browse/MAPREDUCE-5137) | AM web UI: clicking on Map Task results in 500 error | Major | applicationmaster | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-5075](https://issues.apache.org/jira/browse/MAPREDUCE-5075) | DistCp leaks input file handles | Major | distcp | Chris Nauroth | Chris Nauroth |
-| [MAPREDUCE-5060](https://issues.apache.org/jira/browse/MAPREDUCE-5060) | Fetch failures that time out only count against the first map task | Critical | . | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-5053](https://issues.apache.org/jira/browse/MAPREDUCE-5053) | java.lang.InternalError from decompression codec cause reducer to fail | Major | . | Robert Parker | Robert Parker |
-| [MAPREDUCE-5043](https://issues.apache.org/jira/browse/MAPREDUCE-5043) | Fetch failure processing can cause AM event queue to backup and eventually OOM | Blocker | mr-am | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-5042](https://issues.apache.org/jira/browse/MAPREDUCE-5042) | Reducer unable to fetch for a map task that was recovered | Blocker | mr-am, security | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-5027](https://issues.apache.org/jira/browse/MAPREDUCE-5027) | Shuffle does not limit number of outstanding connections | Major | . | Jason Lowe | Robert Parker |
-| [MAPREDUCE-5023](https://issues.apache.org/jira/browse/MAPREDUCE-5023) | History Server Web Services missing Job Counters | Critical | jobhistoryserver, webapps | Kendall Thrapp | Ravi Prakash |
-| [MAPREDUCE-5009](https://issues.apache.org/jira/browse/MAPREDUCE-5009) | Killing the Task Attempt slated for commit does not clear the value from the Task commitAttempt member | Critical | mrv1 | Robert Parker | Robert Parker |
-| [MAPREDUCE-5000](https://issues.apache.org/jira/browse/MAPREDUCE-5000) | TaskImpl.getCounters() can return the counters for the wrong task attempt when task is speculating | Critical | mr-am | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4992](https://issues.apache.org/jira/browse/MAPREDUCE-4992) | AM hangs in RecoveryService when recovering tasks with speculative attempts | Critical | mr-am | Robert Parker | Robert Parker |
-| [MAPREDUCE-4969](https://issues.apache.org/jira/browse/MAPREDUCE-4969) | TestKeyValueTextInputFormat test fails with Open JDK 7 | Major | test | Arpit Agarwal | Arpit Agarwal |
-| [MAPREDUCE-4953](https://issues.apache.org/jira/browse/MAPREDUCE-4953) | HadoopPipes misuses fprintf | Major | pipes | Andy Isaacson | Andy Isaacson |
-| [MAPREDUCE-4946](https://issues.apache.org/jira/browse/MAPREDUCE-4946) | Type conversion of map completion events leads to performance problems with large jobs | Critical | mr-am | Jason Lowe | Jason Lowe |
+| [HADOOP-9221](https://issues.apache.org/jira/browse/HADOOP-9221) | Convert remaining xdocs to APT | Major | . | Andy Isaacson | Andy Isaacson |
+| [YARN-343](https://issues.apache.org/jira/browse/YARN-343) | Capacity Scheduler maximum-capacity value -1 is invalid | Major | capacityscheduler | Thomas Graves | Xuan Gong |
| [MAPREDUCE-4893](https://issues.apache.org/jira/browse/MAPREDUCE-4893) | MR AppMaster can do sub-optimal assignment of containers to map tasks leading to poor node locality | Major | applicationmaster | Bikas Saha | Bikas Saha |
-| [MAPREDUCE-4871](https://issues.apache.org/jira/browse/MAPREDUCE-4871) | AM uses mapreduce.jobtracker.split.metainfo.maxsize but mapred-default has mapreduce.job.split.metainfo.maxsize | Major | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4794](https://issues.apache.org/jira/browse/MAPREDUCE-4794) | DefaultSpeculator generates error messages on normal shutdown | Major | applicationmaster | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4671](https://issues.apache.org/jira/browse/MAPREDUCE-4671) | AM does not tell the RM about container requests that are no longer needed | Major | . | Bikas Saha | Bikas Saha |
-| [MAPREDUCE-4637](https://issues.apache.org/jira/browse/MAPREDUCE-4637) | Killing an unassigned task attempt causes the job to fail | Major | mrv2 | Tom White | Mayank Bansal |
-| [MAPREDUCE-4470](https://issues.apache.org/jira/browse/MAPREDUCE-4470) | Fix TestCombineFileInputFormat.testForEmptyFile | Major | test | Kihwal Lee | Ilya Katsov |
-| [MAPREDUCE-4278](https://issues.apache.org/jira/browse/MAPREDUCE-4278) | cannot run two local jobs in parallel from the same gateway. | Major | . | Araceli Henley | Sandy Ryza |
-| [MAPREDUCE-4007](https://issues.apache.org/jira/browse/MAPREDUCE-4007) | JobClient getJob(JobID) should return NULL if the job does not exist (for backwards compatibility) | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-3952](https://issues.apache.org/jira/browse/MAPREDUCE-3952) | In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split. | Major | mrv2 | Zhenxiao Luo | Bhallamudi Venkata Siva Kamesh |
-| [MAPREDUCE-3685](https://issues.apache.org/jira/browse/MAPREDUCE-3685) | There are some bugs in implementation of MergeManager | Critical | mrv2 | anty.rao | anty |
-| [YARN-460](https://issues.apache.org/jira/browse/YARN-460) | CS user left in list of active users for the queue even when application finished | Blocker | capacityscheduler | Thomas Graves | Thomas Graves |
-| [YARN-448](https://issues.apache.org/jira/browse/YARN-448) | Remove unnecessary hflush from log aggregation | Major | nodemanager | Kihwal Lee | Kihwal Lee |
-| [YARN-426](https://issues.apache.org/jira/browse/YARN-426) | Failure to download a public resource on a node prevents further downloads of the resource from that node | Critical | nodemanager | Jason Lowe | Jason Lowe |
-| [YARN-410](https://issues.apache.org/jira/browse/YARN-410) | New lines in diagnostics for a failed app on the per-application page make it hard to read | Major | . | Vinod Kumar Vavilapalli | Omkar Vinit Joshi |
-| [YARN-400](https://issues.apache.org/jira/browse/YARN-400) | RM can return null application resource usage report leading to NPE in client | Critical | resourcemanager | Jason Lowe | Jason Lowe |
-| [YARN-376](https://issues.apache.org/jira/browse/YARN-376) | Apps that have completed can appear as RUNNING on the NM UI | Blocker | resourcemanager | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4969](https://issues.apache.org/jira/browse/MAPREDUCE-4969) | TestKeyValueTextInputFormat test fails with Open JDK 7 | Major | test | Arpit Agarwal | Arpit Agarwal |
| [YARN-364](https://issues.apache.org/jira/browse/YARN-364) | AggregatedLogDeletionService can take too long to delete logs | Major | . | Jason Lowe | Jason Lowe |
-| [YARN-362](https://issues.apache.org/jira/browse/YARN-362) | Unexpected extra results when using webUI table search | Minor | . | Jason Lowe | Ravi Prakash |
+| [HDFS-4462](https://issues.apache.org/jira/browse/HDFS-4462) | 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS | Major | namenode | Aaron T. Myers | Aaron T. Myers |
| [YARN-360](https://issues.apache.org/jira/browse/YARN-360) | Allow apps to concurrently register tokens for renewal | Critical | . | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4953](https://issues.apache.org/jira/browse/MAPREDUCE-4953) | HadoopPipes misuses fprintf | Major | pipes | Andy Isaacson | Andy Isaacson |
+| [HADOOP-9278](https://issues.apache.org/jira/browse/HADOOP-9278) | HarFileSystem may leak file handle | Major | fs | Chris Nauroth | Chris Nauroth |
| [YARN-357](https://issues.apache.org/jira/browse/YARN-357) | App submission should not be synchronized | Major | resourcemanager | Daryn Sharp | Daryn Sharp |
| [YARN-355](https://issues.apache.org/jira/browse/YARN-355) | RM app submission jams under load | Blocker | resourcemanager | Daryn Sharp | Daryn Sharp |
-| [YARN-354](https://issues.apache.org/jira/browse/YARN-354) | WebAppProxyServer exits immediately after startup | Blocker | . | Liang Xie | Liang Xie |
-| [YARN-345](https://issues.apache.org/jira/browse/YARN-345) | Many InvalidStateTransitonException errors for ApplicationImpl in Node Manager | Critical | nodemanager | Devaraj K | Robert Parker |
-| [YARN-343](https://issues.apache.org/jira/browse/YARN-343) | Capacity Scheduler maximum-capacity value -1 is invalid | Major | capacityscheduler | Thomas Graves | Xuan Gong |
-| [YARN-269](https://issues.apache.org/jira/browse/YARN-269) | Resource Manager not logging the health\_check\_script result when taking it out | Major | resourcemanager | Thomas Graves | Jason Lowe |
+| [HADOOP-9289](https://issues.apache.org/jira/browse/HADOOP-9289) | FsShell rm -f fails for non-matching globs | Blocker | fs | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4671](https://issues.apache.org/jira/browse/MAPREDUCE-4671) | AM does not tell the RM about container requests that are no longer needed | Major | . | Bikas Saha | Bikas Saha |
+| [HADOOP-9124](https://issues.apache.org/jira/browse/HADOOP-9124) | SortedMapWritable violates contract of Map interface for equals() and hashCode() | Minor | io | Patrick Hunt | Surenkumar Nihalani |
+| [YARN-362](https://issues.apache.org/jira/browse/YARN-362) | Unexpected extra results when using webUI table search | Minor | . | Jason Lowe | Ravi Prakash |
+| [HADOOP-9302](https://issues.apache.org/jira/browse/HADOOP-9302) | HDFS docs not linked from top level | Major | documentation | Thomas Graves | Andy Isaacson |
+| [HADOOP-9303](https://issues.apache.org/jira/browse/HADOOP-9303) | command manual dfsadmin missing entry for restoreFailedStorage option | Major | . | Thomas Graves | Andy Isaacson |
+| [MAPREDUCE-5000](https://issues.apache.org/jira/browse/MAPREDUCE-5000) | TaskImpl.getCounters() can return the counters for the wrong task attempt when task is speculating | Critical | mr-am | Jason Lowe | Jason Lowe |
+| [HDFS-4495](https://issues.apache.org/jira/browse/HDFS-4495) | Allow client-side lease renewal to be retried beyond soft-limit | Major | hdfs-client | Kihwal Lee | Kihwal Lee |
+| [HADOOP-9154](https://issues.apache.org/jira/browse/HADOOP-9154) | SortedMapWritable#putAll() doesn't add key/value classes to the map | Major | io | Karthik Kambatla | Karthik Kambatla |
+| [MAPREDUCE-5009](https://issues.apache.org/jira/browse/MAPREDUCE-5009) | Killing the Task Attempt slated for commit does not clear the value from the Task commitAttempt member | Critical | mrv1 | Robert Parker | Robert Parker |
+| [YARN-400](https://issues.apache.org/jira/browse/YARN-400) | RM can return null application resource usage report leading to NPE in client | Critical | resourcemanager | Jason Lowe | Jason Lowe |
| [YARN-236](https://issues.apache.org/jira/browse/YARN-236) | RM should point tracking URL to RM web page when app fails to start | Major | resourcemanager | Jason Lowe | Jason Lowe |
+| [HDFS-4222](https://issues.apache.org/jira/browse/HDFS-4222) | NN is unresponsive and loses heartbeats of DNs when Hadoop is configured to use LDAP and LDAP has issues | Minor | namenode | Xiaobo Peng | Xiaobo Peng |
+| [YARN-426](https://issues.apache.org/jira/browse/YARN-426) | Failure to download a public resource on a node prevents further downloads of the resource from that node | Critical | nodemanager | Jason Lowe | Jason Lowe |
+| [HADOOP-9339](https://issues.apache.org/jira/browse/HADOOP-9339) | IPC.Server incorrectly sets UGI auth type | Major | ipc | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4871](https://issues.apache.org/jira/browse/MAPREDUCE-4871) | AM uses mapreduce.jobtracker.split.metainfo.maxsize but mapred-default has mapreduce.job.split.metainfo.maxsize | Major | mrv2 | Jason Lowe | Jason Lowe |
+| [YARN-269](https://issues.apache.org/jira/browse/YARN-269) | Resource Manager not logging the health\_check\_script result when taking it out | Major | resourcemanager | Thomas Graves | Jason Lowe |
+| [YARN-376](https://issues.apache.org/jira/browse/YARN-376) | Apps that have completed can appear as RUNNING on the NM UI | Blocker | resourcemanager | Jason Lowe | Jason Lowe |
+| [YARN-410](https://issues.apache.org/jira/browse/YARN-410) | New lines in diagnostics for a failed app on the per-application page make it hard to read | Major | . | Vinod Kumar Vavilapalli | Omkar Vinit Joshi |
+| [MAPREDUCE-4794](https://issues.apache.org/jira/browse/MAPREDUCE-4794) | DefaultSpeculator generates error messages on normal shutdown | Major | applicationmaster | Jason Lowe | Jason Lowe |
+| [HDFS-4128](https://issues.apache.org/jira/browse/HDFS-4128) | 2NN gets stuck in inconsistent state if edit log replay fails in the middle | Major | namenode | Todd Lipcon | Kihwal Lee |
+| [HDFS-4532](https://issues.apache.org/jira/browse/HDFS-4532) | RPC call queue may fill due to current user lookup | Critical | namenode | Daryn Sharp | Daryn Sharp |
+| [YARN-448](https://issues.apache.org/jira/browse/YARN-448) | Remove unnecessary hflush from log aggregation | Major | nodemanager | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-5043](https://issues.apache.org/jira/browse/MAPREDUCE-5043) | Fetch failure processing can cause AM event queue to backup and eventually OOM | Blocker | mr-am | Jason Lowe | Jason Lowe |
+| [YARN-345](https://issues.apache.org/jira/browse/YARN-345) | Many InvalidStateTransitonException errors for ApplicationImpl in Node Manager | Critical | nodemanager | Devaraj K | Robert Parker |
+| [HDFS-4553](https://issues.apache.org/jira/browse/HDFS-4553) | Webhdfs will NPE on some unexpected response codes | Major | webhdfs | Daryn Sharp | Daryn Sharp |
| [YARN-227](https://issues.apache.org/jira/browse/YARN-227) | Application expiration difficult to debug for end-users | Major | resourcemanager | Jason Lowe | Jason Lowe |
-| [YARN-150](https://issues.apache.org/jira/browse/YARN-150) | AppRejectedTransition does not unregister app from master service and scheduler | Major | . | Bikas Saha | Bikas Saha |
-| [YARN-133](https://issues.apache.org/jira/browse/YARN-133) | update web services docs for RM clusterMetrics | Major | resourcemanager | Thomas Graves | Ravi Prakash |
+| [MAPREDUCE-5027](https://issues.apache.org/jira/browse/MAPREDUCE-5027) | Shuffle does not limit number of outstanding connections | Major | . | Jason Lowe | Robert Parker |
+| [MAPREDUCE-3685](https://issues.apache.org/jira/browse/MAPREDUCE-3685) | There are some bugs in implementation of MergeManager | Critical | mrv2 | anty.rao | anty |
+| [HDFS-4544](https://issues.apache.org/jira/browse/HDFS-4544) | Error in deleting blocks should not do check disk, for all types of errors | Major | . | Amareshwari Sriramadasu | Arpit Agarwal |
+| [MAPREDUCE-5023](https://issues.apache.org/jira/browse/MAPREDUCE-5023) | History Server Web Services missing Job Counters | Critical | jobhistoryserver, webapps | Kendall Thrapp | Ravi Prakash |
+| [MAPREDUCE-5060](https://issues.apache.org/jira/browse/MAPREDUCE-5060) | Fetch failures that time out only count against the first map task | Critical | . | Robert Joseph Evans | Robert Joseph Evans |
+| [HDFS-3344](https://issues.apache.org/jira/browse/HDFS-3344) | Unreliable corrupt blocks counting in TestProcessCorruptBlocks | Major | namenode | Tsz Wo Nicholas Sze | Kihwal Lee |
+| [HADOOP-9406](https://issues.apache.org/jira/browse/HADOOP-9406) | hadoop-client leaks dependency on JDK tools jar | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-5042](https://issues.apache.org/jira/browse/MAPREDUCE-5042) | Reducer unable to fetch for a map task that was recovered | Blocker | mr-am, security | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-5053](https://issues.apache.org/jira/browse/MAPREDUCE-5053) | java.lang.InternalError from decompression codec cause reducer to fail | Major | . | Robert Parker | Robert Parker |
+| [MAPREDUCE-5075](https://issues.apache.org/jira/browse/MAPREDUCE-5075) | DistCp leaks input file handles | Major | distcp | Chris Nauroth | Chris Nauroth |
| [YARN-109](https://issues.apache.org/jira/browse/YARN-109) | .tmp file is not deleted for localized archives | Major | nodemanager | Jason Lowe | Mayank Bansal |
-| [YARN-83](https://issues.apache.org/jira/browse/YARN-83) | Change package of YarnClient to include apache | Major | client | Bikas Saha | Bikas Saha |
-| [YARN-40](https://issues.apache.org/jira/browse/YARN-40) | Provide support for missing yarn commands | Major | client | Devaraj K | Devaraj K |
+| [HDFS-4581](https://issues.apache.org/jira/browse/HDFS-4581) | DataNode#checkDiskError should not be called on network errors | Major | datanode | Rohit Kochar | Rohit Kochar |
+| [YARN-460](https://issues.apache.org/jira/browse/YARN-460) | CS user left in list of active users for the queue even when application finished | Blocker | capacityscheduler | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4992](https://issues.apache.org/jira/browse/MAPREDUCE-4992) | AM hangs in RecoveryService when recovering tasks with speculative attempts | Critical | mr-am | Robert Parker | Robert Parker |
+| [HDFS-4649](https://issues.apache.org/jira/browse/HDFS-4649) | Webhdfs cannot list large directories | Blocker | namenode, security, webhdfs | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-5137](https://issues.apache.org/jira/browse/MAPREDUCE-5137) | AM web UI: clicking on Map Task results in 500 error | Major | applicationmaster | Thomas Graves | Thomas Graves |
### TESTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9067](https://issues.apache.org/jira/browse/HADOOP-9067) | provide test for method org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, FSDataInputStream, long, FSDataInputStream, long) | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
| [HADOOP-8157](https://issues.apache.org/jira/browse/HADOOP-8157) | TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE | Major | . | Eli Collins | Todd Lipcon |
-| [MAPREDUCE-5007](https://issues.apache.org/jira/browse/MAPREDUCE-5007) | fix coverage org.apache.hadoop.mapreduce.v2.hs | Major | . | Aleksey Gorshkov | Aleksey Gorshkov |
-| [MAPREDUCE-4991](https://issues.apache.org/jira/browse/MAPREDUCE-4991) | coverage for gridmix | Major | . | Aleksey Gorshkov | Aleksey Gorshkov |
-| [MAPREDUCE-4972](https://issues.apache.org/jira/browse/MAPREDUCE-4972) | Coverage fixing for org.apache.hadoop.mapreduce.jobhistory | Major | . | Aleksey Gorshkov | Aleksey Gorshkov |
+| [HADOOP-9067](https://issues.apache.org/jira/browse/HADOOP-9067) | provide test for method org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, FSDataInputStream, long, FSDataInputStream, long) | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
| [MAPREDUCE-4905](https://issues.apache.org/jira/browse/MAPREDUCE-4905) | test org.apache.hadoop.mapred.pipes | Major | . | Aleksey Gorshkov | Aleksey Gorshkov |
+| [MAPREDUCE-4972](https://issues.apache.org/jira/browse/MAPREDUCE-4972) | Coverage fixing for org.apache.hadoop.mapreduce.jobhistory | Major | . | Aleksey Gorshkov | Aleksey Gorshkov |
| [MAPREDUCE-4875](https://issues.apache.org/jira/browse/MAPREDUCE-4875) | coverage fixing for org.apache.hadoop.mapred | Major | test | Aleksey Gorshkov | Aleksey Gorshkov |
+| [MAPREDUCE-4991](https://issues.apache.org/jira/browse/MAPREDUCE-4991) | coverage for gridmix | Major | . | Aleksey Gorshkov | Aleksey Gorshkov |
+| [MAPREDUCE-5007](https://issues.apache.org/jira/browse/MAPREDUCE-5007) | fix coverage org.apache.hadoop.mapreduce.v2.hs | Major | . | Aleksey Gorshkov | Aleksey Gorshkov |
### SUB-TASKS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HDFS-4577](https://issues.apache.org/jira/browse/HDFS-4577) | Webhdfs operations should declare if authentication is required | Major | webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-4567](https://issues.apache.org/jira/browse/HDFS-4567) | Webhdfs does not need a token for token operations | Major | webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-4566](https://issues.apache.org/jira/browse/HDFS-4566) | Webdhfs token cancelation should use authentication | Major | webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-4560](https://issues.apache.org/jira/browse/HDFS-4560) | Webhdfs cannot use tokens obtained by another user | Major | webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-4548](https://issues.apache.org/jira/browse/HDFS-4548) | Webhdfs doesn't renegotiate SPNEGO token | Blocker | . | Daryn Sharp | Daryn Sharp |
-| [HDFS-4542](https://issues.apache.org/jira/browse/HDFS-4542) | Webhdfs doesn't support secure proxy users | Blocker | webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-2495](https://issues.apache.org/jira/browse/HDFS-2495) | Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lock | Major | namenode | Tomasz Nykiel | Tomasz Nykiel |
| [HDFS-2477](https://issues.apache.org/jira/browse/HDFS-2477) | Optimize computing the diff between a block report and the namenode state. | Major | namenode | Tomasz Nykiel | Tomasz Nykiel |
+| [HDFS-2495](https://issues.apache.org/jira/browse/HDFS-2495) | Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lock | Major | namenode | Tomasz Nykiel | Tomasz Nykiel |
| [HDFS-2476](https://issues.apache.org/jira/browse/HDFS-2476) | More CPU efficient data structure for under-replicated/over-replicated/invalidate blocks | Major | namenode | Tomasz Nykiel | Tomasz Nykiel |
+| [YARN-29](https://issues.apache.org/jira/browse/YARN-29) | Add a yarn-client module | Major | client | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [HDFS-4542](https://issues.apache.org/jira/browse/HDFS-4542) | Webhdfs doesn't support secure proxy users | Blocker | webhdfs | Daryn Sharp | Daryn Sharp |
+| [HDFS-4560](https://issues.apache.org/jira/browse/HDFS-4560) | Webhdfs cannot use tokens obtained by another user | Major | webhdfs | Daryn Sharp | Daryn Sharp |
+| [HDFS-4566](https://issues.apache.org/jira/browse/HDFS-4566) | Webdhfs token cancelation should use authentication | Major | webhdfs | Daryn Sharp | Daryn Sharp |
+| [HDFS-4567](https://issues.apache.org/jira/browse/HDFS-4567) | Webhdfs does not need a token for token operations | Major | webhdfs | Daryn Sharp | Daryn Sharp |
+| [HDFS-4577](https://issues.apache.org/jira/browse/HDFS-4577) | Webhdfs operations should declare if authentication is required | Major | webhdfs | Daryn Sharp | Daryn Sharp |
| [YARN-468](https://issues.apache.org/jira/browse/YARN-468) | coverage fix for org.apache.hadoop.yarn.server.webproxy.amfilter | Major | . | Aleksey Gorshkov | Aleksey Gorshkov |
| [YARN-200](https://issues.apache.org/jira/browse/YARN-200) | yarn log does not output all needed information, and is in a binary format | Major | . | Robert Joseph Evans | Ravi Prakash |
-| [YARN-29](https://issues.apache.org/jira/browse/YARN-29) | Add a yarn-client module | Major | client | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-4548](https://issues.apache.org/jira/browse/HDFS-4548) | Webhdfs doesn't renegotiate SPNEGO token | Blocker | . | Daryn Sharp | Daryn Sharp |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/RELEASENOTES.0.23.7.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/RELEASENOTES.0.23.7.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/RELEASENOTES.0.23.7.md
index e367c5d..2a5b268 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/RELEASENOTES.0.23.7.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/RELEASENOTES.0.23.7.md
@@ -23,23 +23,23 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-9147](https://issues.apache.org/jira/browse/HADOOP-9147) | *Trivial* | **Add missing fields to FIleStatus.toString**
+* [HDFS-395](https://issues.apache.org/jira/browse/HDFS-395) | *Major* | **DFS Scalability: Incremental block reports**
-Update FileStatus.toString to include missing fields
+**WARNING: No release note provided for this change.**
---
-* [HDFS-395](https://issues.apache.org/jira/browse/HDFS-395) | *Major* | **DFS Scalability: Incremental block reports**
+* [MAPREDUCE-4637](https://issues.apache.org/jira/browse/MAPREDUCE-4637) | *Major* | **Killing an unassigned task attempt causes the job to fail**
-**WARNING: No release note provided for this incompatible change.**
+Handle TaskAttempt diagnostic updates while in the NEW and UNASSIGNED states.
---
-* [MAPREDUCE-4637](https://issues.apache.org/jira/browse/MAPREDUCE-4637) | *Major* | **Killing an unassigned task attempt causes the job to fail**
+* [HADOOP-9147](https://issues.apache.org/jira/browse/HADOOP-9147) | *Trivial* | **Add missing fields to FIleStatus.toString**
-Handle TaskAttempt diagnostic updates while in the NEW and UNASSIGNED states.
+Update FileStatus.toString to include missing fields
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/CHANGES.0.23.8.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/CHANGES.0.23.8.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/CHANGES.0.23.8.md
index 04e8036..0d043e6 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/CHANGES.0.23.8.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/CHANGES.0.23.8.md
@@ -20,63 +20,41 @@
## Release 0.23.8 - 2013-06-05
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9614](https://issues.apache.org/jira/browse/HADOOP-9614) | smart-test-patch.sh hangs for new version of patch (2.7.1) | Major | . | Ravi Prakash | Ravi Prakash |
-| [HADOOP-9504](https://issues.apache.org/jira/browse/HADOOP-9504) | MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo | Critical | metrics | Liang Xie | Liang Xie |
+| [MAPREDUCE-4383](https://issues.apache.org/jira/browse/MAPREDUCE-4383) | HadoopPipes.cc needs to include unistd.h | Minor | pipes | Andy Isaacson | Andy Isaacson |
+| [YARN-71](https://issues.apache.org/jira/browse/YARN-71) | Ensure/confirm that the NodeManager cleans up local-dirs on restart | Critical | nodemanager | Vinod Kumar Vavilapalli | Xuan Gong |
+| [HDFS-4690](https://issues.apache.org/jira/browse/HDFS-4690) | Namenode exits if entering safemode while secret manager is edit logging | Critical | namenode, security | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-5065](https://issues.apache.org/jira/browse/MAPREDUCE-5065) | DistCp should skip checksum comparisons if block-sizes are different on source/target. | Major | distcp | Mithun Radhakrishnan | Mithun Radhakrishnan |
+| [YARN-476](https://issues.apache.org/jira/browse/YARN-476) | ProcfsBasedProcessTree info message confuses users | Minor | . | Jason Lowe | Sandy Ryza |
+| [HDFS-4699](https://issues.apache.org/jira/browse/HDFS-4699) | TestPipelinesFailover#testPipelineRecoveryStress fails sporadically | Major | test | Chris Nauroth | Chris Nauroth |
+| [MAPREDUCE-5147](https://issues.apache.org/jira/browse/MAPREDUCE-5147) | Maven build should create hadoop-mapreduce-client-app-VERSION.jar directly | Major | mrv2 | Robert Parker | Robert Parker |
| [HADOOP-9469](https://issues.apache.org/jira/browse/HADOOP-9469) | mapreduce/yarn source jars not included in dist tarball | Major | . | Thomas Graves | Robert Parker |
+| [YARN-363](https://issues.apache.org/jira/browse/YARN-363) | yarn proxyserver fails to find webapps/proxy directory on startup | Major | . | Jason Lowe | Kenji Kikushima |
+| [MAPREDUCE-5168](https://issues.apache.org/jira/browse/MAPREDUCE-5168) | Reducer can OOM during shuffle because on-disk output stream not released | Critical | mrv2 | Jason Lowe | Jason Lowe |
+| [HDFS-4477](https://issues.apache.org/jira/browse/HDFS-4477) | Secondary namenode may retain old tokens | Critical | security | Kihwal Lee | Daryn Sharp |
+| [YARN-690](https://issues.apache.org/jira/browse/YARN-690) | RM exits on token cancel/renew problems | Blocker | resourcemanager | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4927](https://issues.apache.org/jira/browse/MAPREDUCE-4927) | Historyserver 500 error due to NPE when accessing specific counters page for failed job | Major | jobhistoryserver | Jason Lowe | Ashwin Shankar |
| [HDFS-4835](https://issues.apache.org/jira/browse/HDFS-4835) | Port trunk WebHDFS changes to branch-0.23 | Critical | webhdfs | Robert Parker | Robert Parker |
+| [HDFS-3875](https://issues.apache.org/jira/browse/HDFS-3875) | Issue handling checksum errors in write pipeline | Critical | datanode, hdfs-client | Todd Lipcon | Kihwal Lee |
| [HDFS-4807](https://issues.apache.org/jira/browse/HDFS-4807) | DFSOutputStream.createSocketForPipeline() should not include timeout extension on connect | Major | . | Kihwal Lee | Cristina L. Abad |
| [HDFS-4714](https://issues.apache.org/jira/browse/HDFS-4714) | Log short messages in Namenode RPC server for exceptions meant for clients | Major | namenode | Kihwal Lee | Kihwal Lee |
-| [HDFS-4699](https://issues.apache.org/jira/browse/HDFS-4699) | TestPipelinesFailover#testPipelineRecoveryStress fails sporadically | Major | test | Chris Nauroth | Chris Nauroth |
-| [HDFS-4690](https://issues.apache.org/jira/browse/HDFS-4690) | Namenode exits if entering safemode while secret manager is edit logging | Critical | namenode, security | Daryn Sharp | Daryn Sharp |
-| [HDFS-4477](https://issues.apache.org/jira/browse/HDFS-4477) | Secondary namenode may retain old tokens | Critical | security | Kihwal Lee | Daryn Sharp |
-| [HDFS-3875](https://issues.apache.org/jira/browse/HDFS-3875) | Issue handling checksum errors in write pipeline | Critical | datanode, hdfs-client | Todd Lipcon | Kihwal Lee |
+| [HADOOP-9614](https://issues.apache.org/jira/browse/HADOOP-9614) | smart-test-patch.sh hangs for new version of patch (2.7.1) | Major | . | Ravi Prakash | Ravi Prakash |
| [MAPREDUCE-5211](https://issues.apache.org/jira/browse/MAPREDUCE-5211) | Reducer intermediate files can collide during merge | Blocker | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-5168](https://issues.apache.org/jira/browse/MAPREDUCE-5168) | Reducer can OOM during shuffle because on-disk output stream not released | Critical | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-5147](https://issues.apache.org/jira/browse/MAPREDUCE-5147) | Maven build should create hadoop-mapreduce-client-app-VERSION.jar directly | Major | mrv2 | Robert Parker | Robert Parker |
-| [MAPREDUCE-5065](https://issues.apache.org/jira/browse/MAPREDUCE-5065) | DistCp should skip checksum comparisons if block-sizes are different on source/target. | Major | distcp | Mithun Radhakrishnan | Mithun Radhakrishnan |
+| [HADOOP-9504](https://issues.apache.org/jira/browse/HADOOP-9504) | MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo | Critical | metrics | Liang Xie | Liang Xie |
| [MAPREDUCE-5059](https://issues.apache.org/jira/browse/MAPREDUCE-5059) | Job overview shows average merge time larger than for any reduce attempt | Major | jobhistoryserver, webapps | Jason Lowe | Omkar Vinit Joshi |
-| [MAPREDUCE-4927](https://issues.apache.org/jira/browse/MAPREDUCE-4927) | Historyserver 500 error due to NPE when accessing specific counters page for failed job | Major | jobhistoryserver | Jason Lowe | Ashwin Shankar |
-| [MAPREDUCE-4383](https://issues.apache.org/jira/browse/MAPREDUCE-4383) | HadoopPipes.cc needs to include unistd.h | Minor | pipes | Andy Isaacson | Andy Isaacson |
-| [YARN-690](https://issues.apache.org/jira/browse/YARN-690) | RM exits on token cancel/renew problems | Blocker | resourcemanager | Daryn Sharp | Daryn Sharp |
-| [YARN-476](https://issues.apache.org/jira/browse/YARN-476) | ProcfsBasedProcessTree info message confuses users | Minor | . | Jason Lowe | Sandy Ryza |
-| [YARN-363](https://issues.apache.org/jira/browse/YARN-363) | yarn proxyserver fails to find webapps/proxy directory on startup | Major | . | Jason Lowe | Kenji Kikushima |
-| [YARN-71](https://issues.apache.org/jira/browse/YARN-71) | Ensure/confirm that the NodeManager cleans up local-dirs on restart | Critical | nodemanager | Vinod Kumar Vavilapalli | Xuan Gong |
### TESTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9233](https://issues.apache.org/jira/browse/HADOOP-9233) | Cover package org.apache.hadoop.io.compress.zlib with unit tests | Major | . | Vadim Bondarev | Vadim Bondarev |
| [HADOOP-9222](https://issues.apache.org/jira/browse/HADOOP-9222) | Cover package with org.apache.hadoop.io.lz4 unit tests | Major | . | Vadim Bondarev | Vadim Bondarev |
+| [HADOOP-9233](https://issues.apache.org/jira/browse/HADOOP-9233) | Cover package org.apache.hadoop.io.compress.zlib with unit tests | Major | . | Vadim Bondarev | Vadim Bondarev |
| [MAPREDUCE-5015](https://issues.apache.org/jira/browse/MAPREDUCE-5015) | Coverage fix for org.apache.hadoop.mapreduce.tools.CLI | Major | . | Aleksey Gorshkov | Aleksey Gorshkov |
@@ -87,9 +65,3 @@
| [YARN-548](https://issues.apache.org/jira/browse/YARN-548) | Add tests for YarnUncaughtExceptionHandler | Major | . | Vadim Bondarev | Vadim Bondarev |
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/CHANGES.0.23.9.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/CHANGES.0.23.9.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/CHANGES.0.23.9.md
index fed8832..238453c 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/CHANGES.0.23.9.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/CHANGES.0.23.9.md
@@ -20,49 +20,33 @@
## Release 0.23.9 - 2013-07-08
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [MAPREDUCE-5268](https://issues.apache.org/jira/browse/MAPREDUCE-5268) | Improve history server startup performance | Major | jobhistoryserver | Jason Lowe | Karthik Kambatla |
| [YARN-169](https://issues.apache.org/jira/browse/YARN-169) | Update log4j.appender.EventCounter to use org.apache.hadoop.log.metrics.EventCounter | Minor | nodemanager | Anthony Rojas | Anthony Rojas |
+| [MAPREDUCE-5268](https://issues.apache.org/jira/browse/MAPREDUCE-5268) | Improve history server startup performance | Major | jobhistoryserver | Jason Lowe | Karthik Kambatla |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9582](https://issues.apache.org/jira/browse/HADOOP-9582) | Non-existent file to "hadoop fs -conf" doesn't throw error | Major | conf | Ashwin Shankar | Ashwin Shankar |
-| [HADOOP-9581](https://issues.apache.org/jira/browse/HADOOP-9581) | hadoop --config non-existent directory should result in error | Major | scripts | Ashwin Shankar | Ashwin Shankar |
-| [HDFS-4878](https://issues.apache.org/jira/browse/HDFS-4878) | On Remove Block, Block is not Removed from neededReplications queue | Major | namenode | Tao Luo | Tao Luo |
+| [HDFS-4765](https://issues.apache.org/jira/browse/HDFS-4765) | Permission check of symlink deletion incorrectly throws UnresolvedLinkException | Major | namenode | Andrew Wang | Andrew Wang |
+| [YARN-742](https://issues.apache.org/jira/browse/YARN-742) | Log aggregation causes a lot of redundant setPermission calls | Major | nodemanager | Kihwal Lee | Jason Lowe |
| [HDFS-4867](https://issues.apache.org/jira/browse/HDFS-4867) | metaSave NPEs when there are invalid blocks in repl queue. | Major | namenode | Kihwal Lee | Plamen Jeliazkov |
| [HDFS-4862](https://issues.apache.org/jira/browse/HDFS-4862) | SafeModeInfo.isManual() returns true when resources are low even if it wasn't entered into manually | Major | . | Ravi Prakash | Ravi Prakash |
| [HDFS-4832](https://issues.apache.org/jira/browse/HDFS-4832) | Namenode doesn't change the number of missing blocks in safemode when DNs rejoin or leave | Critical | . | Ravi Prakash | Ravi Prakash |
-| [HDFS-4765](https://issues.apache.org/jira/browse/HDFS-4765) | Permission check of symlink deletion incorrectly throws UnresolvedLinkException | Major | namenode | Andrew Wang | Andrew Wang |
-| [HDFS-4205](https://issues.apache.org/jira/browse/HDFS-4205) | fsck fails with symlinks | Major | hdfs-client | Andy Isaacson | Jason Lowe |
-| [MAPREDUCE-5316](https://issues.apache.org/jira/browse/MAPREDUCE-5316) | job -list-attempt-ids command does not handle illegal task-state | Major | client | Ashwin Shankar | Ashwin Shankar |
-| [MAPREDUCE-5315](https://issues.apache.org/jira/browse/MAPREDUCE-5315) | DistCp reports success even on failure. | Critical | distcp | Mithun Radhakrishnan | Mithun Radhakrishnan |
+| [HADOOP-9581](https://issues.apache.org/jira/browse/HADOOP-9581) | hadoop --config non-existent directory should result in error | Major | scripts | Ashwin Shankar | Ashwin Shankar |
| [MAPREDUCE-5308](https://issues.apache.org/jira/browse/MAPREDUCE-5308) | Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs | Major | . | Nathan Roberts | Nathan Roberts |
+| [MAPREDUCE-5315](https://issues.apache.org/jira/browse/MAPREDUCE-5315) | DistCp reports success even on failure. | Critical | distcp | Mithun Radhakrishnan | Mithun Radhakrishnan |
+| [HDFS-4878](https://issues.apache.org/jira/browse/HDFS-4878) | On Remove Block, Block is not Removed from neededReplications queue | Major | namenode | Tao Luo | Tao Luo |
| [MAPREDUCE-4019](https://issues.apache.org/jira/browse/MAPREDUCE-4019) | -list-attempt-ids is not working | Minor | client | B Anil Kumar | Ashwin Shankar |
-| [YARN-742](https://issues.apache.org/jira/browse/YARN-742) | Log aggregation causes a lot of redundant setPermission calls | Major | nodemanager | Kihwal Lee | Jason Lowe |
+| [MAPREDUCE-5316](https://issues.apache.org/jira/browse/MAPREDUCE-5316) | job -list-attempt-ids command does not handle illegal task-state | Major | client | Ashwin Shankar | Ashwin Shankar |
+| [HADOOP-9582](https://issues.apache.org/jira/browse/HADOOP-9582) | Non-existent file to "hadoop fs -conf" doesn't throw error | Major | conf | Ashwin Shankar | Ashwin Shankar |
+| [HDFS-4205](https://issues.apache.org/jira/browse/HDFS-4205) | fsck fails with symlinks | Major | hdfs-client | Andy Isaacson | Jason Lowe |
### TESTS:
@@ -76,13 +60,7 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [YARN-478](https://issues.apache.org/jira/browse/YARN-478) | fix coverage org.apache.hadoop.yarn.webapp.log | Major | . | Aleksey Gorshkov | Aleksey Gorshkov |
| [YARN-427](https://issues.apache.org/jira/browse/YARN-427) | Coverage fix for org.apache.hadoop.yarn.server.api.\* | Major | . | Aleksey Gorshkov | Aleksey Gorshkov |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [YARN-478](https://issues.apache.org/jira/browse/YARN-478) | fix coverage org.apache.hadoop.yarn.webapp.log | Major | . | Aleksey Gorshkov | Aleksey Gorshkov |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/CHANGES.0.24.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/CHANGES.0.24.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/CHANGES.0.24.0.md
index 919f4dd..a419c45 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/CHANGES.0.24.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/CHANGES.0.24.0.md
@@ -18,7 +18,7 @@
-->
# Apache Hadoop Changelog
-## Release 0.24.0 - Unreleased (as of 2016-03-04)
+## Release 0.24.0 - Unreleased (as of 2017-08-28)
### INCOMPATIBLE CHANGES:
@@ -28,68 +28,56 @@
| [HADOOP-7507](https://issues.apache.org/jira/browse/HADOOP-7507) | jvm metrics all use the same namespace | Major | metrics | Jeff Bean | Alejandro Abdelnur |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7705](https://issues.apache.org/jira/browse/HADOOP-7705) | Add a log4j back end that can push out JSON data, one per line | Minor | util | Steve Loughran | Steve Loughran |
| [HADOOP-7594](https://issues.apache.org/jira/browse/HADOOP-7594) | Support HTTP REST in HttpServer | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-7705](https://issues.apache.org/jira/browse/HADOOP-7705) | Add a log4j back end that can push out JSON data, one per line | Minor | util | Steve Loughran | Steve Loughran |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7772](https://issues.apache.org/jira/browse/HADOOP-7772) | javadoc the topology classes | Trivial | . | Steve Loughran | Steve Loughran |
-| [HADOOP-7763](https://issues.apache.org/jira/browse/HADOOP-7763) | Add top-level navigation to APT docs | Major | documentation | Tom White | Tom White |
-| [HADOOP-7743](https://issues.apache.org/jira/browse/HADOOP-7743) | Add Maven profile to create a full source tarball | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-7737](https://issues.apache.org/jira/browse/HADOOP-7737) | normalize hadoop-mapreduce & hadoop-dist dist/tar build with common/hdfs | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-7595](https://issues.apache.org/jira/browse/HADOOP-7595) | Upgrade dependency to Avro 1.5.3 | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
| [HADOOP-7668](https://issues.apache.org/jira/browse/HADOOP-7668) | Add a NetUtils method that can tell if an InetAddress belongs to local host | Minor | util | Suresh Srinivas | Steve Loughran |
| [HADOOP-7642](https://issues.apache.org/jira/browse/HADOOP-7642) | create hadoop-dist module where TAR stitching would happen | Major | build | Alejandro Abdelnur | Tom White |
-| [HADOOP-7595](https://issues.apache.org/jira/browse/HADOOP-7595) | Upgrade dependency to Avro 1.5.3 | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-7737](https://issues.apache.org/jira/browse/HADOOP-7737) | normalize hadoop-mapreduce & hadoop-dist dist/tar build with common/hdfs | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-7743](https://issues.apache.org/jira/browse/HADOOP-7743) | Add Maven profile to create a full source tarball | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
| [HADOOP-7509](https://issues.apache.org/jira/browse/HADOOP-7509) | Improve message when Authentication is required | Trivial | . | Ravi Prakash | Ravi Prakash |
+| [HADOOP-7772](https://issues.apache.org/jira/browse/HADOOP-7772) | javadoc the topology classes | Trivial | . | Steve Loughran | Steve Loughran |
| [HADOOP-7360](https://issues.apache.org/jira/browse/HADOOP-7360) | FsShell does not preserve relative paths with globs | Major | fs | Daryn Sharp | Kihwal Lee |
+| [HADOOP-7763](https://issues.apache.org/jira/browse/HADOOP-7763) | Add top-level navigation to APT docs | Major | documentation | Tom White | Tom White |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7782](https://issues.apache.org/jira/browse/HADOOP-7782) | Aggregate project javadocs | Critical | build | Arun C Murthy | Tom White |
-| [HADOOP-7778](https://issues.apache.org/jira/browse/HADOOP-7778) | FindBugs warning in Token.getKind() | Major | . | Tom White | Tom White |
-| [HADOOP-7771](https://issues.apache.org/jira/browse/HADOOP-7771) | NPE when running hdfs dfs -copyToLocal, -get etc | Blocker | . | John George | John George |
-| [HADOOP-7766](https://issues.apache.org/jira/browse/HADOOP-7766) | The auth to local mappings are not being respected, with webhdfs and security enabled. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-7745](https://issues.apache.org/jira/browse/HADOOP-7745) | I switched variable names in HADOOP-7509 | Major | . | Ravi Prakash | Ravi Prakash |
-| [HADOOP-7728](https://issues.apache.org/jira/browse/HADOOP-7728) | hadoop-setup-conf.sh should be modified to enable task memory manager | Major | conf | Ramya Sunil | Ramya Sunil |
-| [HADOOP-7721](https://issues.apache.org/jira/browse/HADOOP-7721) | dfs.web.authentication.kerberos.principal expects the full hostname and does not replace \_HOST with the hostname | Major | . | Arpit Gupta | Jitendra Nath Pandey |
-| [HADOOP-7663](https://issues.apache.org/jira/browse/HADOOP-7663) | TestHDFSTrash failing on 22 | Major | test | Mayank Bansal | Mayank Bansal |
-| [HADOOP-7608](https://issues.apache.org/jira/browse/HADOOP-7608) | SnappyCodec check for Hadoop native lib is wrong | Major | io | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-7606](https://issues.apache.org/jira/browse/HADOOP-7606) | Upgrade Jackson to version 1.7.1 to match the version required by Jersey | Major | test | Aaron T. Myers | Alejandro Abdelnur |
-| [HADOOP-7599](https://issues.apache.org/jira/browse/HADOOP-7599) | Improve hadoop setup conf script to setup secure Hadoop cluster | Major | scripts | Eric Yang | Eric Yang |
-| [HADOOP-7593](https://issues.apache.org/jira/browse/HADOOP-7593) | AssertionError in TestHttpServer.testMaxThreads() | Major | test | Tsz Wo Nicholas Sze | Uma Maheswara Rao G |
| [HADOOP-7589](https://issues.apache.org/jira/browse/HADOOP-7589) | Prefer mvn test -DskipTests over mvn compile in test-patch.sh | Major | build | Robert Joseph Evans | Robert Joseph Evans |
| [HADOOP-7576](https://issues.apache.org/jira/browse/HADOOP-7576) | Fix findbugs warnings in Hadoop Auth (Alfredo) | Major | security | Tom White | Tsz Wo Nicholas Sze |
+| [HADOOP-7593](https://issues.apache.org/jira/browse/HADOOP-7593) | AssertionError in TestHttpServer.testMaxThreads() | Major | test | Tsz Wo Nicholas Sze | Uma Maheswara Rao G |
+| [HADOOP-7606](https://issues.apache.org/jira/browse/HADOOP-7606) | Upgrade Jackson to version 1.7.1 to match the version required by Jersey | Major | test | Aaron T. Myers | Alejandro Abdelnur |
| [HADOOP-7568](https://issues.apache.org/jira/browse/HADOOP-7568) | SequenceFile should not print into stdout | Major | io | Konstantin Shvachko | Plamen Jeliazkov |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-7599](https://issues.apache.org/jira/browse/HADOOP-7599) | Improve hadoop setup conf script to setup secure Hadoop cluster | Major | scripts | Eric Yang | Eric Yang |
+| [HADOOP-7608](https://issues.apache.org/jira/browse/HADOOP-7608) | SnappyCodec check for Hadoop native lib is wrong | Major | io | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-7663](https://issues.apache.org/jira/browse/HADOOP-7663) | TestHDFSTrash failing on 22 | Major | test | Mayank Bansal | Mayank Bansal |
+| [HADOOP-7721](https://issues.apache.org/jira/browse/HADOOP-7721) | dfs.web.authentication.kerberos.principal expects the full hostname and does not replace \_HOST with the hostname | Major | . | Arpit Gupta | Jitendra Nath Pandey |
+| [HADOOP-7745](https://issues.apache.org/jira/browse/HADOOP-7745) | I switched variable names in HADOOP-7509 | Major | . | Ravi Prakash | Ravi Prakash |
+| [HADOOP-7766](https://issues.apache.org/jira/browse/HADOOP-7766) | The auth to local mappings are not being respected, with webhdfs and security enabled. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HADOOP-7728](https://issues.apache.org/jira/browse/HADOOP-7728) | hadoop-setup-conf.sh should be modified to enable task memory manager | Major | conf | Ramya Sunil | Ramya Sunil |
+| [HADOOP-7778](https://issues.apache.org/jira/browse/HADOOP-7778) | FindBugs warning in Token.getKind() | Major | . | Tom White | Tom White |
+| [HADOOP-7771](https://issues.apache.org/jira/browse/HADOOP-7771) | NPE when running hdfs dfs -copyToLocal, -get etc | Blocker | . | John George | John George |
+| [HADOOP-7782](https://issues.apache.org/jira/browse/HADOOP-7782) | Aggregate project javadocs | Critical | build | Arun C Murthy | Tom White |
### SUB-TASKS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7564](https://issues.apache.org/jira/browse/HADOOP-7564) | Remove test-patch SVN externals | Major | . | Tom White | Tom White |
| [HADOOP-7469](https://issues.apache.org/jira/browse/HADOOP-7469) | add a standard handler for socket connection problems which improves diagnostics | Minor | util | Steve Loughran | Steve Loughran |
+| [HADOOP-7564](https://issues.apache.org/jira/browse/HADOOP-7564) | Remove test-patch SVN externals | Major | . | Tom White | Tom White |
### OTHER:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/RELEASENOTES.0.24.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/RELEASENOTES.0.24.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/RELEASENOTES.0.24.0.md
index 6c43809..58ed350 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/RELEASENOTES.0.24.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/RELEASENOTES.0.24.0.md
@@ -23,30 +23,30 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-7728](https://issues.apache.org/jira/browse/HADOOP-7728) | *Major* | **hadoop-setup-conf.sh should be modified to enable task memory manager**
+* [HADOOP-7547](https://issues.apache.org/jira/browse/HADOOP-7547) | *Minor* | **Fix the warning in writable classes.[ WritableComparable is a raw type. References to generic type WritableComparable\<T\> should be parameterized ]**
-Enable task memory management to be configurable via hadoop config setup script.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-7668](https://issues.apache.org/jira/browse/HADOOP-7668) | *Minor* | **Add a NetUtils method that can tell if an InetAddress belongs to local host**
+* [HADOOP-7507](https://issues.apache.org/jira/browse/HADOOP-7507) | *Major* | **jvm metrics all use the same namespace**
-closing again
+JVM metrics published to Ganglia now include the process name as part of the gmetric name.
---
-* [HADOOP-7547](https://issues.apache.org/jira/browse/HADOOP-7547) | *Minor* | **Fix the warning in writable classes.[ WritableComparable is a raw type. References to generic type WritableComparable\<T\> should be parameterized ]**
+* [HADOOP-7668](https://issues.apache.org/jira/browse/HADOOP-7668) | *Minor* | **Add a NetUtils method that can tell if an InetAddress belongs to local host**
-**WARNING: No release note provided for this incompatible change.**
+closing again
---
-* [HADOOP-7507](https://issues.apache.org/jira/browse/HADOOP-7507) | *Major* | **jvm metrics all use the same namespace**
+* [HADOOP-7728](https://issues.apache.org/jira/browse/HADOOP-7728) | *Major* | **hadoop-setup-conf.sh should be modified to enable task memory manager**
-JVM metrics published to Ganglia now include the process name as part of the gmetric name.
+Enable task memory management to be configurable via hadoop config setup script.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/CHANGES.0.3.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/CHANGES.0.3.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/CHANGES.0.3.0.md
index a2da3ed..98ba5fc 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/CHANGES.0.3.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/CHANGES.0.3.0.md
@@ -20,77 +20,61 @@
## Release 0.3.0 - 2006-06-02
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-256](https://issues.apache.org/jira/browse/HADOOP-256) | Implement a C api for hadoop dfs | Major | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-233](https://issues.apache.org/jira/browse/HADOOP-233) | add a http status server for the task trackers | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-222](https://issues.apache.org/jira/browse/HADOOP-222) | Set replication from dfsshell | Trivial | . | Johan Oskarsson | Johan Oskarsson |
| [HADOOP-209](https://issues.apache.org/jira/browse/HADOOP-209) | Add a program to recursively copy directories across file systems | Major | fs | Milind Bhandarkar | |
| [HADOOP-115](https://issues.apache.org/jira/browse/HADOOP-115) | permit reduce input types to differ from reduce output types | Major | . | Runping Qi | Runping Qi |
+| [HADOOP-233](https://issues.apache.org/jira/browse/HADOOP-233) | add a http status server for the task trackers | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-222](https://issues.apache.org/jira/browse/HADOOP-222) | Set replication from dfsshell | Trivial | . | Johan Oskarsson | Johan Oskarsson |
+| [HADOOP-256](https://issues.apache.org/jira/browse/HADOOP-256) | Implement a C api for hadoop dfs | Major | . | Arun C Murthy | Arun C Murthy |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-254](https://issues.apache.org/jira/browse/HADOOP-254) | use http to shuffle data between the maps and the reduces | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-218](https://issues.apache.org/jira/browse/HADOOP-218) | Inefficient calls to get configuration values in TaskInprogress | Minor | . | Mahadev konar | Mahadev konar |
-| [HADOOP-216](https://issues.apache.org/jira/browse/HADOOP-216) | Task Detail web page missing progress | Trivial | . | Bryan Pendleton | Doug Cutting |
-| [HADOOP-212](https://issues.apache.org/jira/browse/HADOOP-212) | allow changes to dfs block size | Critical | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-211](https://issues.apache.org/jira/browse/HADOOP-211) | logging improvements for Hadoop | Minor | . | Sameer Paranjpye | Sameer Paranjpye |
-| [HADOOP-208](https://issues.apache.org/jira/browse/HADOOP-208) | add failure page to webapp | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-204](https://issues.apache.org/jira/browse/HADOOP-204) | Need to tweak a few things in the metrics package to support the Simon plugin | Major | metrics | David Bowen | David Bowen |
+| [HADOOP-208](https://issues.apache.org/jira/browse/HADOOP-208) | add failure page to webapp | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-202](https://issues.apache.org/jira/browse/HADOOP-202) | sort should use a smaller number of reduces | Trivial | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-212](https://issues.apache.org/jira/browse/HADOOP-212) | allow changes to dfs block size | Critical | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-218](https://issues.apache.org/jira/browse/HADOOP-218) | Inefficient calls to get configuration values in TaskInprogress | Minor | . | Mahadev konar | Mahadev konar |
+| [HADOOP-216](https://issues.apache.org/jira/browse/HADOOP-216) | Task Detail web page missing progress | Trivial | . | Bryan Pendleton | Doug Cutting |
| [HADOOP-195](https://issues.apache.org/jira/browse/HADOOP-195) | improve performance of map output transfers | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-254](https://issues.apache.org/jira/browse/HADOOP-254) | use http to shuffle data between the maps and the reduces | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-75](https://issues.apache.org/jira/browse/HADOOP-75) | dfs should check full file availability only at close | Minor | . | Doug Cutting | Milind Bhandarkar |
+| [HADOOP-211](https://issues.apache.org/jira/browse/HADOOP-211) | logging improvements for Hadoop | Minor | . | Sameer Paranjpye | Sameer Paranjpye |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-270](https://issues.apache.org/jira/browse/HADOOP-270) | possible deadlock when shut down a datanode thread | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-265](https://issues.apache.org/jira/browse/HADOOP-265) | Abort tasktracker if it can not write to its local directories | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-264](https://issues.apache.org/jira/browse/HADOOP-264) | WritableFactory has no permissions to create DatanodeRegistration | Blocker | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-259](https://issues.apache.org/jira/browse/HADOOP-259) | map output http client does not timeout | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-251](https://issues.apache.org/jira/browse/HADOOP-251) | progress report failures kill task | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-146](https://issues.apache.org/jira/browse/HADOOP-146) | potential conflict in block id's, leading to data corruption | Major | . | Yoram Arnon | Konstantin Shvachko |
+| [HADOOP-180](https://issues.apache.org/jira/browse/HADOOP-180) | task tracker times out cleaning big job | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-200](https://issues.apache.org/jira/browse/HADOOP-200) | The map task names are sent to the reduces | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-219](https://issues.apache.org/jira/browse/HADOOP-219) | SequenceFile#handleChecksumException NPE | Trivial | io | stack | Doug Cutting |
+| [HADOOP-179](https://issues.apache.org/jira/browse/HADOOP-179) | task tracker ghosts remain after 10 minutes | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-161](https://issues.apache.org/jira/browse/HADOOP-161) | dfs blocks define equal, but not hashcode | Major | . | Owen O'Malley | Milind Bhandarkar |
+| [HADOOP-228](https://issues.apache.org/jira/browse/HADOOP-228) | hadoop cp should have a -config option | Minor | fs | Yoram Arnon | Milind Bhandarkar |
+| [HADOOP-229](https://issues.apache.org/jira/browse/HADOOP-229) | hadoop cp should generate a better number of map tasks | Minor | fs | Yoram Arnon | Milind Bhandarkar |
+| [HADOOP-238](https://issues.apache.org/jira/browse/HADOOP-238) | map outputs transfers fail with EOFException | Blocker | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-205](https://issues.apache.org/jira/browse/HADOOP-205) | the job tracker does not schedule enough map on the cluster | Major | . | Owen O'Malley | Mahadev konar |
| [HADOOP-247](https://issues.apache.org/jira/browse/HADOOP-247) | The Reduce Task thread for reporting progress during the sort exits in case of any IOException | Critical | . | Mahadev konar | Mahadev konar |
| [HADOOP-241](https://issues.apache.org/jira/browse/HADOOP-241) | TestCopyFiles fails under cygwin due to incorrect path | Minor | fs | Konstantin Shvachko | Milind Bhandarkar |
-| [HADOOP-238](https://issues.apache.org/jira/browse/HADOOP-238) | map outputs transfers fail with EOFException | Blocker | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-251](https://issues.apache.org/jira/browse/HADOOP-251) | progress report failures kill task | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-235](https://issues.apache.org/jira/browse/HADOOP-235) | LocalFileSystem.openRaw() throws the wrong string for FileNotFoundException | Major | . | Benjamin Reed | |
-| [HADOOP-229](https://issues.apache.org/jira/browse/HADOOP-229) | hadoop cp should generate a better number of map tasks | Minor | fs | Yoram Arnon | Milind Bhandarkar |
-| [HADOOP-228](https://issues.apache.org/jira/browse/HADOOP-228) | hadoop cp should have a -config option | Minor | fs | Yoram Arnon | Milind Bhandarkar |
-| [HADOOP-219](https://issues.apache.org/jira/browse/HADOOP-219) | SequenceFile#handleChecksumException NPE | Trivial | io | stack | Doug Cutting |
-| [HADOOP-217](https://issues.apache.org/jira/browse/HADOOP-217) | IllegalAcessException when creating a Block object via WritableFactories | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-205](https://issues.apache.org/jira/browse/HADOOP-205) | the job tracker does not schedule enough map on the cluster | Major | . | Owen O'Malley | Mahadev konar |
-| [HADOOP-200](https://issues.apache.org/jira/browse/HADOOP-200) | The map task names are sent to the reduces | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-180](https://issues.apache.org/jira/browse/HADOOP-180) | task tracker times out cleaning big job | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-179](https://issues.apache.org/jira/browse/HADOOP-179) | task tracker ghosts remain after 10 minutes | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-163](https://issues.apache.org/jira/browse/HADOOP-163) | If a DFS datanode cannot write onto its file system. it should tell the name node not to assign new blocks to it. | Major | . | Runping Qi | Hairong Kuang |
-| [HADOOP-161](https://issues.apache.org/jira/browse/HADOOP-161) | dfs blocks define equal, but not hashcode | Major | . | Owen O'Malley | Milind Bhandarkar |
-| [HADOOP-146](https://issues.apache.org/jira/browse/HADOOP-146) | potential conflict in block id's, leading to data corruption | Major | . | Yoram Arnon | Konstantin Shvachko |
-| [HADOOP-141](https://issues.apache.org/jira/browse/HADOOP-141) | Disk thrashing / task timeouts during map output copy phase | Major | . | p sutter | Owen O'Malley |
| [HADOOP-124](https://issues.apache.org/jira/browse/HADOOP-124) | don't permit two datanodes to run from same dfs.data.dir | Critical | . | Bryan Pendleton | Konstantin Shvachko |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-259](https://issues.apache.org/jira/browse/HADOOP-259) | map output http client does not timeout | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-264](https://issues.apache.org/jira/browse/HADOOP-264) | WritableFactory has no permissions to create DatanodeRegistration | Blocker | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-265](https://issues.apache.org/jira/browse/HADOOP-265) | Abort tasktracker if it can not write to its local directories | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-217](https://issues.apache.org/jira/browse/HADOOP-217) | IllegalAcessException when creating a Block object via WritableFactories | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-270](https://issues.apache.org/jira/browse/HADOOP-270) | possible deadlock when shut down a datanode thread | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-141](https://issues.apache.org/jira/browse/HADOOP-141) | Disk thrashing / task timeouts during map output copy phase | Major | . | p sutter | Owen O'Malley |
### SUB-TASKS:
@@ -100,9 +84,3 @@
| [HADOOP-220](https://issues.apache.org/jira/browse/HADOOP-220) | Add -dfs and -jt command-line parameters to specify namenode and jobtracker. | Major | fs | Milind Bhandarkar | Milind Bhandarkar |
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[06/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.3.0/CHANGES.2.3.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.3.0/CHANGES.2.3.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.3.0/CHANGES.2.3.0.md
index 71d6e77..5bcfe1d 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.3.0/CHANGES.2.3.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.3.0/CHANGES.2.3.0.md
@@ -24,648 +24,642 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HDFS-4997](https://issues.apache.org/jira/browse/HDFS-4997) | libhdfs doesn't return correct error codes in most cases | Major | libhdfs | Colin Patrick McCabe | Colin Patrick McCabe |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-4997](https://issues.apache.org/jira/browse/HDFS-4997) | libhdfs doesn't return correct error codes in most cases | Major | libhdfs | Colin P. McCabe | Colin P. McCabe |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10047](https://issues.apache.org/jira/browse/HADOOP-10047) | Add a directbuffer Decompressor API to hadoop | Major | io | Gopal V | Gopal V |
-| [HADOOP-9848](https://issues.apache.org/jira/browse/HADOOP-9848) | Create a MiniKDC for use with security testing | Major | security, test | Wei Yan | Wei Yan |
-| [HADOOP-9618](https://issues.apache.org/jira/browse/HADOOP-9618) | Add thread which detects JVM pauses | Major | util | Todd Lipcon | Todd Lipcon |
| [HADOOP-9432](https://issues.apache.org/jira/browse/HADOOP-9432) | Add support for markdown .md files in site documentation | Minor | build, documentation | Steve Loughran | Steve Loughran |
+| [HADOOP-9618](https://issues.apache.org/jira/browse/HADOOP-9618) | Add thread which detects JVM pauses | Major | util | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-5265](https://issues.apache.org/jira/browse/MAPREDUCE-5265) | History server admin service to refresh user and superuser group mappings | Major | jobhistoryserver | Jason Lowe | Ashwin Shankar |
+| [MAPREDUCE-5266](https://issues.apache.org/jira/browse/MAPREDUCE-5266) | Ability to refresh retention settings on history server | Major | jobhistoryserver | Jason Lowe | Ashwin Shankar |
+| [HADOOP-9848](https://issues.apache.org/jira/browse/HADOOP-9848) | Create a MiniKDC for use with security testing | Major | security, test | Wei Yan | Wei Yan |
| [HADOOP-8545](https://issues.apache.org/jira/browse/HADOOP-8545) | Filesystem Implementation for OpenStack Swift | Major | fs | Tim Miller | Dmitry Mezhensky |
-| [HDFS-5703](https://issues.apache.org/jira/browse/HDFS-5703) | Add support for HTTPS and swebhdfs to HttpFS | Major | webhdfs | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HDFS-5260](https://issues.apache.org/jira/browse/HDFS-5260) | Merge zero-copy memory-mapped HDFS client reads to trunk and branch-2. | Major | hdfs-client, libhdfs | Chris Nauroth | Chris Nauroth |
-| [HDFS-4949](https://issues.apache.org/jira/browse/HDFS-4949) | Centralized cache management in HDFS | Major | datanode, namenode | Andrew Wang | Andrew Wang |
-| [HDFS-2832](https://issues.apache.org/jira/browse/HDFS-2832) | Enable support for heterogeneous storages in HDFS - DN as a collection of storages | Major | datanode, namenode | Suresh Srinivas | Arpit Agarwal |
| [MAPREDUCE-5332](https://issues.apache.org/jira/browse/MAPREDUCE-5332) | Support token-preserving restart of history server | Major | jobhistoryserver | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-5266](https://issues.apache.org/jira/browse/MAPREDUCE-5266) | Ability to refresh retention settings on history server | Major | jobhistoryserver | Jason Lowe | Ashwin Shankar |
-| [MAPREDUCE-5265](https://issues.apache.org/jira/browse/MAPREDUCE-5265) | History server admin service to refresh user and superuser group mappings | Major | jobhistoryserver | Jason Lowe | Ashwin Shankar |
+| [YARN-1021](https://issues.apache.org/jira/browse/YARN-1021) | Yarn Scheduler Load Simulator | Major | scheduler | Wei Yan | Wei Yan |
+| [HDFS-5260](https://issues.apache.org/jira/browse/HDFS-5260) | Merge zero-copy memory-mapped HDFS client reads to trunk and branch-2. | Major | hdfs-client, libhdfs | Chris Nauroth | Chris Nauroth |
+| [YARN-1253](https://issues.apache.org/jira/browse/YARN-1253) | Changes to LinuxContainerExecutor to run containers as a single dedicated user in non-secure mode | Blocker | nodemanager | Alejandro Abdelnur | Roman Shaposhnik |
| [MAPREDUCE-1176](https://issues.apache.org/jira/browse/MAPREDUCE-1176) | FixedLengthInputFormat and FixedLengthRecordReader | Major | . | BitsOfInfo | Mariappan Asokan |
| [YARN-1392](https://issues.apache.org/jira/browse/YARN-1392) | Allow sophisticated app-to-queue placement policies in the Fair Scheduler | Major | scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-1253](https://issues.apache.org/jira/browse/YARN-1253) | Changes to LinuxContainerExecutor to run containers as a single dedicated user in non-secure mode | Blocker | nodemanager | Alejandro Abdelnur | Roman Shaposhnik |
-| [YARN-1021](https://issues.apache.org/jira/browse/YARN-1021) | Yarn Scheduler Load Simulator | Major | scheduler | Wei Yan | Wei Yan |
+| [HADOOP-10047](https://issues.apache.org/jira/browse/HADOOP-10047) | Add a directbuffer Decompressor API to hadoop | Major | io | Gopal V | Gopal V |
+| [HDFS-5703](https://issues.apache.org/jira/browse/HDFS-5703) | Add support for HTTPS and swebhdfs to HttpFS | Major | webhdfs | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-4949](https://issues.apache.org/jira/browse/HDFS-4949) | Centralized cache management in HDFS | Major | datanode, namenode | Andrew Wang | Andrew Wang |
+| [HDFS-2832](https://issues.apache.org/jira/browse/HDFS-2832) | Enable support for heterogeneous storages in HDFS - DN as a collection of storages | Major | datanode, namenode | Suresh Srinivas | Arpit Agarwal |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10274](https://issues.apache.org/jira/browse/HADOOP-10274) | Lower the logging level from ERROR to WARN for UGI.doAs method | Minor | security | takeshi.miao | takeshi.miao |
-| [HADOOP-10248](https://issues.apache.org/jira/browse/HADOOP-10248) | Property name should be included in the exception where property value is null | Major | . | Ted Yu | Akira AJISAKA |
-| [HADOOP-10228](https://issues.apache.org/jira/browse/HADOOP-10228) | FsPermission#fromShort() should cache FsAction.values() | Minor | fs | Haohui Mai | Haohui Mai |
-| [HADOOP-10208](https://issues.apache.org/jira/browse/HADOOP-10208) | Remove duplicate initialization in StringUtils.getStringCollection | Trivial | . | Benoy Antony | Benoy Antony |
-| [HADOOP-10198](https://issues.apache.org/jira/browse/HADOOP-10198) | DomainSocket: add support for socketpair | Minor | native | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-10173](https://issues.apache.org/jira/browse/HADOOP-10173) | Remove UGI from DIGEST-MD5 SASL server creation | Critical | ipc | Daryn Sharp | Daryn Sharp |
-| [HADOOP-10172](https://issues.apache.org/jira/browse/HADOOP-10172) | Cache SASL server factories | Critical | ipc | Daryn Sharp | Daryn Sharp |
-| [HADOOP-10169](https://issues.apache.org/jira/browse/HADOOP-10169) | remove the unnecessary synchronized in JvmMetrics class | Minor | metrics | Liang Xie | Liang Xie |
-| [HADOOP-10167](https://issues.apache.org/jira/browse/HADOOP-10167) | Mark hadoop-common source as UTF-8 in Maven pom files / refactoring | Major | build | Mikhail Antonov | Mikhail Antonov |
-| [HADOOP-10164](https://issues.apache.org/jira/browse/HADOOP-10164) | Allow UGI to login with a known Subject | Major | . | Robert Joseph Evans | Robert Joseph Evans |
-| [HADOOP-10143](https://issues.apache.org/jira/browse/HADOOP-10143) | replace WritableFactories's hashmap with ConcurrentHashMap | Major | io | Liang Xie | Liang Xie |
-| [HADOOP-10132](https://issues.apache.org/jira/browse/HADOOP-10132) | RPC#stopProxy() should log the class of proxy when IllegalArgumentException is encountered | Minor | . | Ted Yu | Ted Yu |
-| [HADOOP-10111](https://issues.apache.org/jira/browse/HADOOP-10111) | Allow DU to be initialized with an initial value | Major | . | Kihwal Lee | Kihwal Lee |
-| [HADOOP-10095](https://issues.apache.org/jira/browse/HADOOP-10095) | Performance improvement in CodecPool | Minor | io | Nicolas Liochon | Nicolas Liochon |
-| [HADOOP-10086](https://issues.apache.org/jira/browse/HADOOP-10086) | User document for authentication in secure cluster | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki |
-| [HADOOP-10079](https://issues.apache.org/jira/browse/HADOOP-10079) | log a warning message if group resolution takes too long. | Major | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-10067](https://issues.apache.org/jira/browse/HADOOP-10067) | Missing POM dependency on jsr305 | Minor | . | Robert Rati | Robert Rati |
-| [HADOOP-10064](https://issues.apache.org/jira/browse/HADOOP-10064) | Upgrade to maven antrun plugin version 1.7 | Major | build | Arpit Agarwal | Arpit Agarwal |
-| [HADOOP-10046](https://issues.apache.org/jira/browse/HADOOP-10046) | Print a log message when SSL is enabled | Trivial | . | David S. Wang | David S. Wang |
-| [HADOOP-10005](https://issues.apache.org/jira/browse/HADOOP-10005) | No need to check INFO severity level is enabled or not | Trivial | . | Jackie Chang | Jackie Chang |
-| [HADOOP-9998](https://issues.apache.org/jira/browse/HADOOP-9998) | Provide methods to clear only part of the DNSToSwitchMapping | Major | net | Junping Du | Junping Du |
-| [HADOOP-9915](https://issues.apache.org/jira/browse/HADOOP-9915) | o.a.h.fs.Stat support on Macosx | Trivial | . | Binglin Chang | Binglin Chang |
-| [HADOOP-9909](https://issues.apache.org/jira/browse/HADOOP-9909) | org.apache.hadoop.fs.Stat should permit other LANG | Major | fs | Shinichi Yamashita | |
-| [HADOOP-9897](https://issues.apache.org/jira/browse/HADOOP-9897) | Add method to get path start position without drive specifier in o.a.h.fs.Path | Trivial | fs | Binglin Chang | Binglin Chang |
+| [HDFS-4860](https://issues.apache.org/jira/browse/HDFS-4860) | Add additional attributes to JMX beans | Major | namenode | Trevor Lorimer | Trevor Lorimer |
+| [HADOOP-9241](https://issues.apache.org/jira/browse/HADOOP-9241) | DU refresh interval is not configurable | Trivial | . | Harsh J | Harsh J |
+| [HDFS-4278](https://issues.apache.org/jira/browse/HDFS-4278) | Log an ERROR when DFS\_BLOCK\_ACCESS\_TOKEN\_ENABLE config is disabled but security is turned on. | Major | datanode, namenode | Harsh J | Kousuke Saruta |
+| [HDFS-5034](https://issues.apache.org/jira/browse/HDFS-5034) | Remove debug prints from getFileLinkInfo | Trivial | namenode | Andrew Wang | Andrew Wang |
+| [HDFS-5004](https://issues.apache.org/jira/browse/HDFS-5004) | Add additional JMX bean for NameNode status data | Major | namenode | Trevor Lorimer | Trevor Lorimer |
+| [HADOOP-9319](https://issues.apache.org/jira/browse/HADOOP-9319) | Update bundled lz4 source to latest version | Major | . | Arpit Agarwal | Binglin Chang |
+| [MAPREDUCE-434](https://issues.apache.org/jira/browse/MAPREDUCE-434) | LocalJobRunner limited to single reducer | Minor | . | Yoram Arnon | Aaron Kimball |
+| [YARN-985](https://issues.apache.org/jira/browse/YARN-985) | Nodemanager should log where a resource was localized | Major | nodemanager | Ravi Prakash | Ravi Prakash |
+| [HDFS-5068](https://issues.apache.org/jira/browse/HDFS-5068) | Convert NNThroughputBenchmark to a Tool to allow generic options. | Major | benchmarks | Konstantin Shvachko | Konstantin Shvachko |
| [HADOOP-9860](https://issues.apache.org/jira/browse/HADOOP-9860) | Remove class HackedKeytab and HackedKeytabEncoder from hadoop-minikdc once jira DIRSERVER-1882 solved | Major | . | Wei Yan | Wei Yan |
-| [HADOOP-9784](https://issues.apache.org/jira/browse/HADOOP-9784) | Add a builder for HttpServer | Major | . | Junping Du | Junping Du |
-| [HADOOP-9693](https://issues.apache.org/jira/browse/HADOOP-9693) | Shell should add a probe for OSX | Trivial | . | Steve Loughran | |
-| [HADOOP-9652](https://issues.apache.org/jira/browse/HADOOP-9652) | Allow RawLocalFs#getFileLinkStatus to fill in the link owner and mode if requested | Major | . | Colin Patrick McCabe | Andrew Wang |
-| [HADOOP-9623](https://issues.apache.org/jira/browse/HADOOP-9623) | Update jets3t dependency to 0.9.0 | Major | fs/s3 | Timothy St. Clair | Amandeep Khurana |
-| [HADOOP-9611](https://issues.apache.org/jira/browse/HADOOP-9611) | mvn-rpmbuild against google-guice \> 3.0 yields missing cglib dependency | Major | build | Timothy St. Clair | Timothy St. Clair |
-| [HADOOP-9594](https://issues.apache.org/jira/browse/HADOOP-9594) | Update apache commons math dependency | Major | build | Timothy St. Clair | Timothy St. Clair |
-| [HADOOP-9494](https://issues.apache.org/jira/browse/HADOOP-9494) | Excluded auto-generated and examples code from clover reports | Major | . | Dennis Y | Andrey Klochkov |
| [HADOOP-9487](https://issues.apache.org/jira/browse/HADOOP-9487) | Deprecation warnings in Configuration should go to their own log or otherwise be suppressible | Major | conf | Steve Loughran | |
-| [HADOOP-9470](https://issues.apache.org/jira/browse/HADOOP-9470) | eliminate duplicate FQN tests in different Hadoop modules | Major | test | Ivan A. Veselovsky | Ivan A. Veselovsky |
-| [HADOOP-9319](https://issues.apache.org/jira/browse/HADOOP-9319) | Update bundled lz4 source to latest version | Major | . | Arpit Agarwal | Binglin Chang |
-| [HADOOP-9241](https://issues.apache.org/jira/browse/HADOOP-9241) | DU refresh interval is not configurable | Trivial | . | Harsh J | Harsh J |
+| [HDFS-2933](https://issues.apache.org/jira/browse/HDFS-2933) | Improve DataNode Web UI Index Page | Major | datanode | Philip Zeyliger | Vivek Ganesan |
+| [HADOOP-9693](https://issues.apache.org/jira/browse/HADOOP-9693) | Shell should add a probe for OSX | Trivial | . | Steve Loughran | |
+| [HADOOP-9784](https://issues.apache.org/jira/browse/HADOOP-9784) | Add a builder for HttpServer | Major | . | Junping Du | Junping Du |
+| [MAPREDUCE-5484](https://issues.apache.org/jira/browse/MAPREDUCE-5484) | YarnChild unnecessarily loads job conf twice | Major | task | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9909](https://issues.apache.org/jira/browse/HADOOP-9909) | org.apache.hadoop.fs.Stat should permit other LANG | Major | fs | Shinichi Yamashita | |
+| [HDFS-5144](https://issues.apache.org/jira/browse/HDFS-5144) | Document time unit to NameNodeMetrics.java | Minor | documentation | Akira Ajisaka | Akira Ajisaka |
+| [HADOOP-9915](https://issues.apache.org/jira/browse/HADOOP-9915) | o.a.h.fs.Stat support on Macosx | Trivial | . | Binglin Chang | Binglin Chang |
+| [HDFS-4879](https://issues.apache.org/jira/browse/HDFS-4879) | Add "blocked ArrayList" collection to avoid CMS full GCs | Major | namenode | Todd Lipcon | Todd Lipcon |
| [HADOOP-8704](https://issues.apache.org/jira/browse/HADOOP-8704) | add request logging to jetty/httpserver | Major | . | Thomas Graves | Jonathan Eagles |
-| [HDFS-5841](https://issues.apache.org/jira/browse/HDFS-5841) | Update HDFS caching documentation with new changes | Major | . | Andrew Wang | Andrew Wang |
-| [HDFS-5833](https://issues.apache.org/jira/browse/HDFS-5833) | SecondaryNameNode have an incorrect java doc | Trivial | namenode | Bangtao Zhou | |
-| [HDFS-5825](https://issues.apache.org/jira/browse/HDFS-5825) | Use FileUtils.copyFile() to implement DFSTestUtils.copyFile() | Minor | . | Haohui Mai | Haohui Mai |
-| [HDFS-5788](https://issues.apache.org/jira/browse/HDFS-5788) | listLocatedStatus response can be very large | Major | namenode | Nathan Roberts | Nathan Roberts |
-| [HDFS-5748](https://issues.apache.org/jira/browse/HDFS-5748) | Too much information shown in the dfs health page. | Major | . | Kihwal Lee | Haohui Mai |
-| [HDFS-5721](https://issues.apache.org/jira/browse/HDFS-5721) | sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns | Minor | . | Ted Yu | Ted Yu |
-| [HDFS-5695](https://issues.apache.org/jira/browse/HDFS-5695) | Clean up TestOfflineEditsViewer and OfflineEditsViewerHelper | Major | test | Haohui Mai | Haohui Mai |
-| [HDFS-5677](https://issues.apache.org/jira/browse/HDFS-5677) | Need error checking for HA cluster configuration | Minor | datanode, ha | Vincent Sheffer | Vincent Sheffer |
-| [HDFS-5676](https://issues.apache.org/jira/browse/HDFS-5676) | fix inconsistent synchronization of CachingStrategy | Minor | hdfs-client | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-5674](https://issues.apache.org/jira/browse/HDFS-5674) | Editlog code cleanup | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-5665](https://issues.apache.org/jira/browse/HDFS-5665) | Remove the unnecessary writeLock while initializing CacheManager in FsNameSystem Ctor | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HDFS-5663](https://issues.apache.org/jira/browse/HDFS-5663) | make the retry time and interval value configurable in openInfo() | Major | hdfs-client | Liang Xie | Liang Xie |
-| [HDFS-5662](https://issues.apache.org/jira/browse/HDFS-5662) | Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size | Major | namenode | Brandon Li | Brandon Li |
-| [HDFS-5652](https://issues.apache.org/jira/browse/HDFS-5652) | refactoring/uniforming invalid block token exception handling in DFSInputStream | Minor | hdfs-client | Liang Xie | Liang Xie |
-| [HDFS-5637](https://issues.apache.org/jira/browse/HDFS-5637) | try to refeatchToken while local read InvalidToken occurred | Major | hdfs-client, security | Liang Xie | Liang Xie |
-| [HDFS-5633](https://issues.apache.org/jira/browse/HDFS-5633) | Improve OfflineImageViewer to use less memory | Minor | . | Jing Zhao | Jing Zhao |
-| [HDFS-5587](https://issues.apache.org/jira/browse/HDFS-5587) | add debug information when NFS fails to start with duplicate user or group names | Minor | nfs | Brandon Li | Brandon Li |
-| [HDFS-5577](https://issues.apache.org/jira/browse/HDFS-5577) | NFS user guide update | Trivial | documentation | Brandon Li | Brandon Li |
-| [HDFS-5568](https://issues.apache.org/jira/browse/HDFS-5568) | Support inclusion of snapshot paths in Namenode fsck | Major | snapshots | Vinayakumar B | Vinayakumar B |
-| [HDFS-5563](https://issues.apache.org/jira/browse/HDFS-5563) | NFS gateway should commit the buffered data when read request comes after write to the same file | Major | nfs | Brandon Li | Brandon Li |
-| [HDFS-5561](https://issues.apache.org/jira/browse/HDFS-5561) | FSNameSystem#getNameJournalStatus() in JMX should return plain text instead of HTML | Minor | namenode | Fengdong Yu | Haohui Mai |
-| [HDFS-5548](https://issues.apache.org/jira/browse/HDFS-5548) | Use ConcurrentHashMap in portmap | Major | nfs | Haohui Mai | Haohui Mai |
-| [HDFS-5532](https://issues.apache.org/jira/browse/HDFS-5532) | Enable the webhdfs by default to support new HDFS web UI | Major | webhdfs | Vinayakumar B | Vinayakumar B |
-| [HDFS-5495](https://issues.apache.org/jira/browse/HDFS-5495) | Remove further JUnit3 usages from HDFS | Major | . | Andrew Wang | Jarek Jarcec Cecho |
-| [HDFS-5467](https://issues.apache.org/jira/browse/HDFS-5467) | Remove tab characters in hdfs-default.xml | Trivial | . | Andrew Wang | Shinichi Yamashita |
-| [HDFS-5399](https://issues.apache.org/jira/browse/HDFS-5399) | Revisit SafeModeException and corresponding retry policies | Major | . | Jing Zhao | Jing Zhao |
-| [HDFS-5371](https://issues.apache.org/jira/browse/HDFS-5371) | Let client retry the same NN when "dfs.client.test.drop.namenode.response.number" is enabled | Minor | ha, test | Jing Zhao | Jing Zhao |
-| [HDFS-5360](https://issues.apache.org/jira/browse/HDFS-5360) | Improvement of usage message of renameSnapshot and deleteSnapshot | Minor | snapshots | Shinichi Yamashita | Shinichi Yamashita |
-| [HDFS-5350](https://issues.apache.org/jira/browse/HDFS-5350) | Name Node should report fsimage transfer time as a metric | Minor | namenode | Rob Weltman | Jimmy Xiang |
-| [HDFS-5344](https://issues.apache.org/jira/browse/HDFS-5344) | Make LsSnapshottableDir as Tool interface implementation | Minor | snapshots, tools | sathish | sathish |
+| [HDFS-5188](https://issues.apache.org/jira/browse/HDFS-5188) | Clean up BlockPlacementPolicy and its implementations | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-5207](https://issues.apache.org/jira/browse/HDFS-5207) | In BlockPlacementPolicy, update 2 parameters of chooseTarget() | Major | namenode | Junping Du | Junping Du |
+| [MAPREDUCE-5487](https://issues.apache.org/jira/browse/MAPREDUCE-5487) | In task processes, JobConf is unnecessarily loaded again in Limits | Major | performance, task | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9998](https://issues.apache.org/jira/browse/HADOOP-9998) | Provide methods to clear only part of the DNSToSwitchMapping | Major | net | Junping Du | Junping Du |
+| [YARN-1010](https://issues.apache.org/jira/browse/YARN-1010) | FairScheduler: decouple container scheduling from nodemanager heartbeats | Critical | scheduler | Alejandro Abdelnur | Wei Yan |
+| [YARN-1199](https://issues.apache.org/jira/browse/YARN-1199) | Make NM/RM Versions Available | Major | . | Mit Desai | Mit Desai |
+| [YARN-1258](https://issues.apache.org/jira/browse/YARN-1258) | Allow configuring the Fair Scheduler root queue | Major | scheduler | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9470](https://issues.apache.org/jira/browse/HADOOP-9470) | eliminate duplicate FQN tests in different Hadoop modules | Major | test | Ivan A. Veselovsky | Ivan A. Veselovsky |
+| [HDFS-5323](https://issues.apache.org/jira/browse/HDFS-5323) | Remove some deadcode in BlockManager | Minor | namenode | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-5267](https://issues.apache.org/jira/browse/HDFS-5267) | Remove volatile from LightWeightHashSet | Minor | . | Junping Du | Junping Du |
+| [HADOOP-9494](https://issues.apache.org/jira/browse/HADOOP-9494) | Excluded auto-generated and examples code from clover reports | Major | . | Dennis Y | Andrey Klochkov |
| [HDFS-5338](https://issues.apache.org/jira/browse/HDFS-5338) | Add a conf to disable hostname check in DN registration | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-5333](https://issues.apache.org/jira/browse/HDFS-5333) | Improvement of current HDFS Web UI | Major | . | Jing Zhao | Haohui Mai |
+| [HADOOP-10046](https://issues.apache.org/jira/browse/HADOOP-10046) | Print a log message when SSL is enabled | Trivial | . | David S. Wang | David S. Wang |
+| [HADOOP-9897](https://issues.apache.org/jira/browse/HADOOP-9897) | Add method to get path start position without drive specifier in o.a.h.fs.Path | Trivial | fs | Binglin Chang | Binglin Chang |
+| [HADOOP-10005](https://issues.apache.org/jira/browse/HADOOP-10005) | No need to check INFO severity level is enabled or not | Trivial | . | Jackie Chang | Jackie Chang |
+| [HDFS-5360](https://issues.apache.org/jira/browse/HDFS-5360) | Improvement of usage message of renameSnapshot and deleteSnapshot | Minor | snapshots | Shinichi Yamashita | Shinichi Yamashita |
+| [MAPREDUCE-5457](https://issues.apache.org/jira/browse/MAPREDUCE-5457) | Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators | Major | . | Sandy Ryza | Sandy Ryza |
| [HDFS-5331](https://issues.apache.org/jira/browse/HDFS-5331) | make SnapshotDiff.java to a o.a.h.util.Tool interface implementation | Major | snapshots | Vinayakumar B | Vinayakumar B |
-| [HDFS-5323](https://issues.apache.org/jira/browse/HDFS-5323) | Remove some deadcode in BlockManager | Minor | namenode | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-5267](https://issues.apache.org/jira/browse/HDFS-5267) | Remove volatile from LightWeightHashSet | Minor | . | Junping Du | Junping Du |
-| [HDFS-5220](https://issues.apache.org/jira/browse/HDFS-5220) | Expose group resolution time as metric | Major | namenode | Rob Weltman | Jimmy Xiang |
-| [HDFS-5207](https://issues.apache.org/jira/browse/HDFS-5207) | In BlockPlacementPolicy, update 2 parameters of chooseTarget() | Major | namenode | Junping Du | Junping Du |
-| [HDFS-5188](https://issues.apache.org/jira/browse/HDFS-5188) | Clean up BlockPlacementPolicy and its implementations | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-5144](https://issues.apache.org/jira/browse/HDFS-5144) | Document time unit to NameNodeMetrics.java | Minor | documentation | Akira AJISAKA | Akira AJISAKA |
-| [HDFS-5068](https://issues.apache.org/jira/browse/HDFS-5068) | Convert NNThroughputBenchmark to a Tool to allow generic options. | Major | benchmarks | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-10064](https://issues.apache.org/jira/browse/HADOOP-10064) | Upgrade to maven antrun plugin version 1.7 | Major | build | Arpit Agarwal | Arpit Agarwal |
+| [YARN-1335](https://issues.apache.org/jira/browse/YARN-1335) | Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication | Major | scheduler | Sandy Ryza | Sandy Ryza |
+| [YARN-1333](https://issues.apache.org/jira/browse/YARN-1333) | Support blacklisting in the Fair Scheduler | Major | scheduler | Sandy Ryza | Tsuyoshi Ozawa |
+| [YARN-1109](https://issues.apache.org/jira/browse/YARN-1109) | Demote NodeManager "Sending out status for container" logs to debug | Major | nodemanager | Sandy Ryza | haosdent |
+| [MAPREDUCE-5596](https://issues.apache.org/jira/browse/MAPREDUCE-5596) | Allow configuring the number of threads used to serve shuffle connections | Major | . | Sandy Ryza | Sandy Ryza |
+| [YARN-1290](https://issues.apache.org/jira/browse/YARN-1290) | Let continuous scheduling achieve more balanced task assignment | Major | . | Wei Yan | Wei Yan |
+| [MAPREDUCE-5601](https://issues.apache.org/jira/browse/MAPREDUCE-5601) | ShuffleHandler fadvises file regions as DONTNEED even when fetch fails | Major | . | Sandy Ryza | Sandy Ryza |
| [HDFS-5037](https://issues.apache.org/jira/browse/HDFS-5037) | Active NN should trigger its own edit log rolls | Critical | ha, namenode | Todd Lipcon | Andrew Wang |
-| [HDFS-5034](https://issues.apache.org/jira/browse/HDFS-5034) | Remove debug prints from getFileLinkInfo | Trivial | namenode | Andrew Wang | Andrew Wang |
-| [HDFS-5004](https://issues.apache.org/jira/browse/HDFS-5004) | Add additional JMX bean for NameNode status data | Major | namenode | Trevor Lorimer | Trevor Lorimer |
+| [HADOOP-10079](https://issues.apache.org/jira/browse/HADOOP-10079) | log a warning message if group resolution takes too long. | Major | . | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-5344](https://issues.apache.org/jira/browse/HDFS-5344) | Make LsSnapshottableDir as Tool interface implementation | Minor | snapshots, tools | sathish | sathish |
+| [HADOOP-9623](https://issues.apache.org/jira/browse/HADOOP-9623) | Update jets3t dependency to 0.9.0 | Major | fs/s3 | Timothy St. Clair | Amandeep Khurana |
+| [HDFS-5371](https://issues.apache.org/jira/browse/HDFS-5371) | Let client retry the same NN when "dfs.client.test.drop.namenode.response.number" is enabled | Minor | ha, test | Jing Zhao | Jing Zhao |
+| [HDFS-5467](https://issues.apache.org/jira/browse/HDFS-5467) | Remove tab characters in hdfs-default.xml | Trivial | . | Andrew Wang | Shinichi Yamashita |
+| [YARN-1387](https://issues.apache.org/jira/browse/YARN-1387) | RMWebServices should use ClientRMService for filtering applications | Major | api | Karthik Kambatla | Karthik Kambatla |
+| [HDFS-5495](https://issues.apache.org/jira/browse/HDFS-5495) | Remove further JUnit3 usages from HDFS | Major | . | Andrew Wang | Jarek Jarcec Cecho |
+| [HADOOP-9594](https://issues.apache.org/jira/browse/HADOOP-9594) | Update apache commons math dependency | Major | build | Timothy St. Clair | Timothy St. Clair |
+| [HADOOP-10095](https://issues.apache.org/jira/browse/HADOOP-10095) | Performance improvement in CodecPool | Minor | io | Nicolas Liochon | Nicolas Liochon |
+| [HADOOP-10067](https://issues.apache.org/jira/browse/HADOOP-10067) | Missing POM dependency on jsr305 | Minor | . | Robert Rati | Robert Rati |
+| [YARN-786](https://issues.apache.org/jira/browse/YARN-786) | Expose application resource usage in RM REST API | Major | . | Sandy Ryza | Sandy Ryza |
+| [YARN-1303](https://issues.apache.org/jira/browse/YARN-1303) | Allow multiple commands separating with ";" in distributed-shell | Major | applications/distributed-shell | Tassapol Athiapinya | Xuan Gong |
+| [HDFS-5532](https://issues.apache.org/jira/browse/HDFS-5532) | Enable the webhdfs by default to support new HDFS web UI | Major | webhdfs | Vinayakumar B | Vinayakumar B |
+| [HADOOP-10111](https://issues.apache.org/jira/browse/HADOOP-10111) | Allow DU to be initialized with an initial value | Major | . | Kihwal Lee | Kihwal Lee |
+| [YARN-1423](https://issues.apache.org/jira/browse/YARN-1423) | Support queue placement by secondary group in the Fair Scheduler | Major | scheduler | Sandy Ryza | Theodore michael Malaska |
+| [HDFS-5548](https://issues.apache.org/jira/browse/HDFS-5548) | Use ConcurrentHashMap in portmap | Major | nfs | Haohui Mai | Haohui Mai |
+| [HDFS-5561](https://issues.apache.org/jira/browse/HDFS-5561) | FSNameSystem#getNameJournalStatus() in JMX should return plain text instead of HTML | Minor | namenode | Fengdong Yu | Haohui Mai |
+| [HDFS-5568](https://issues.apache.org/jira/browse/HDFS-5568) | Support inclusion of snapshot paths in Namenode fsck | Major | snapshots | Vinayakumar B | Vinayakumar B |
+| [HADOOP-10132](https://issues.apache.org/jira/browse/HADOOP-10132) | RPC#stopProxy() should log the class of proxy when IllegalArgumentException is encountered | Minor | . | Ted Yu | Ted Yu |
+| [HDFS-5577](https://issues.apache.org/jira/browse/HDFS-5577) | NFS user guide update | Trivial | documentation | Brandon Li | Brandon Li |
+| [HDFS-5563](https://issues.apache.org/jira/browse/HDFS-5563) | NFS gateway should commit the buffered data when read request comes after write to the same file | Major | nfs | Brandon Li | Brandon Li |
+| [MAPREDUCE-5640](https://issues.apache.org/jira/browse/MAPREDUCE-5640) | Rename TestLineRecordReader in jobclient module | Trivial | test | Jason Lowe | Jason Lowe |
+| [YARN-1332](https://issues.apache.org/jira/browse/YARN-1332) | In TestAMRMClient, replace assertTrue with assertEquals where possible | Minor | . | Sandy Ryza | Sebastian Wong |
+| [YARN-1403](https://issues.apache.org/jira/browse/YARN-1403) | Separate out configuration loading from QueueManager in the Fair Scheduler | Major | . | Sandy Ryza | Sandy Ryza |
+| [HDFS-5587](https://issues.apache.org/jira/browse/HDFS-5587) | add debug information when NFS fails to start with duplicate user or group names | Minor | nfs | Brandon Li | Brandon Li |
+| [HDFS-5633](https://issues.apache.org/jira/browse/HDFS-5633) | Improve OfflineImageViewer to use less memory | Minor | . | Jing Zhao | Jing Zhao |
| [HDFS-4983](https://issues.apache.org/jira/browse/HDFS-4983) | Numeric usernames do not work with WebHDFS FS | Major | webhdfs | Harsh J | Yongjun Zhang |
-| [HDFS-4879](https://issues.apache.org/jira/browse/HDFS-4879) | Add "blocked ArrayList" collection to avoid CMS full GCs | Major | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-4860](https://issues.apache.org/jira/browse/HDFS-4860) | Add additional attributes to JMX beans | Major | namenode | Trevor Lorimer | Trevor Lorimer |
-| [HDFS-4278](https://issues.apache.org/jira/browse/HDFS-4278) | Log an ERROR when DFS\_BLOCK\_ACCESS\_TOKEN\_ENABLE config is disabled but security is turned on. | Major | datanode, namenode | Harsh J | Kousuke Saruta |
-| [HDFS-2933](https://issues.apache.org/jira/browse/HDFS-2933) | Improve DataNode Web UI Index Page | Major | datanode | Philip Zeyliger | Vivek Ganesan |
+| [YARN-807](https://issues.apache.org/jira/browse/YARN-807) | When querying apps by queue, iterating over all apps is inefficient and limiting | Major | . | Sandy Ryza | Sandy Ryza |
+| [HDFS-5637](https://issues.apache.org/jira/browse/HDFS-5637) | try to refeatchToken while local read InvalidToken occurred | Major | hdfs-client, security | Liang Xie | Liang Xie |
+| [HDFS-5652](https://issues.apache.org/jira/browse/HDFS-5652) | refactoring/uniforming invalid block token exception handling in DFSInputStream | Minor | hdfs-client | Liang Xie | Liang Xie |
+| [HDFS-5665](https://issues.apache.org/jira/browse/HDFS-5665) | Remove the unnecessary writeLock while initializing CacheManager in FsNameSystem Ctor | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [HDFS-5350](https://issues.apache.org/jira/browse/HDFS-5350) | Name Node should report fsimage transfer time as a metric | Minor | namenode | Rob Weltman | Jimmy Xiang |
+| [HDFS-5674](https://issues.apache.org/jira/browse/HDFS-5674) | Editlog code cleanup | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-9611](https://issues.apache.org/jira/browse/HADOOP-9611) | mvn-rpmbuild against google-guice \> 3.0 yields missing cglib dependency | Major | build | Timothy St. Clair | Timothy St. Clair |
+| [HADOOP-10164](https://issues.apache.org/jira/browse/HADOOP-10164) | Allow UGI to login with a known Subject | Major | . | Robert Joseph Evans | Robert Joseph Evans |
+| [HDFS-5662](https://issues.apache.org/jira/browse/HDFS-5662) | Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size | Major | namenode | Brandon Li | Brandon Li |
+| [HDFS-5676](https://issues.apache.org/jira/browse/HDFS-5676) | fix inconsistent synchronization of CachingStrategy | Minor | hdfs-client | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-5663](https://issues.apache.org/jira/browse/HDFS-5663) | make the retry time and interval value configurable in openInfo() | Major | hdfs-client | Liang Xie | Liang Xie |
+| [HADOOP-10172](https://issues.apache.org/jira/browse/HADOOP-10172) | Cache SASL server factories | Critical | ipc | Daryn Sharp | Daryn Sharp |
| [MAPREDUCE-5692](https://issues.apache.org/jira/browse/MAPREDUCE-5692) | Add explicit diagnostics when a task attempt is killed due to speculative execution | Major | mrv2 | Gera Shegalov | Gera Shegalov |
-| [MAPREDUCE-5672](https://issues.apache.org/jira/browse/MAPREDUCE-5672) | Provide optional RollingFileAppender for container log4j (syslog) | Major | mr-am, mrv2 | Gera Shegalov | Gera Shegalov |
-| [MAPREDUCE-5640](https://issues.apache.org/jira/browse/MAPREDUCE-5640) | Rename TestLineRecordReader in jobclient module | Trivial | test | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-5601](https://issues.apache.org/jira/browse/MAPREDUCE-5601) | ShuffleHandler fadvises file regions as DONTNEED even when fetch fails | Major | . | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5596](https://issues.apache.org/jira/browse/MAPREDUCE-5596) | Allow configuring the number of threads used to serve shuffle connections | Major | . | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5487](https://issues.apache.org/jira/browse/MAPREDUCE-5487) | In task processes, JobConf is unnecessarily loaded again in Limits | Major | performance, task | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5484](https://issues.apache.org/jira/browse/MAPREDUCE-5484) | YarnChild unnecessarily loads job conf twice | Major | task | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5457](https://issues.apache.org/jira/browse/MAPREDUCE-5457) | Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators | Major | . | Sandy Ryza | Sandy Ryza |
+| [HADOOP-10169](https://issues.apache.org/jira/browse/HADOOP-10169) | remove the unnecessary synchronized in JvmMetrics class | Minor | metrics | Liang Xie | Liang Xie |
+| [HADOOP-10173](https://issues.apache.org/jira/browse/HADOOP-10173) | Remove UGI from DIGEST-MD5 SASL server creation | Critical | ipc | Daryn Sharp | Daryn Sharp |
+| [HDFS-5695](https://issues.apache.org/jira/browse/HDFS-5695) | Clean up TestOfflineEditsViewer and OfflineEditsViewerHelper | Major | test | Haohui Mai | Haohui Mai |
+| [HADOOP-10198](https://issues.apache.org/jira/browse/HADOOP-10198) | DomainSocket: add support for socketpair | Minor | native | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-5220](https://issues.apache.org/jira/browse/HDFS-5220) | Expose group resolution time as metric | Major | namenode | Rob Weltman | Jimmy Xiang |
| [MAPREDUCE-3310](https://issues.apache.org/jira/browse/MAPREDUCE-3310) | Custom grouping comparator cannot be set for Combiners | Major | client | Mathias Herberts | Alejandro Abdelnur |
-| [MAPREDUCE-2734](https://issues.apache.org/jira/browse/MAPREDUCE-2734) | DistCp with FairScheduler assign all map tasks in one TT | Trivial | jobtracker | Bochun Bai | Bochun Bai |
-| [MAPREDUCE-434](https://issues.apache.org/jira/browse/MAPREDUCE-434) | LocalJobRunner limited to single reducer | Minor | . | Yoram Arnon | Aaron Kimball |
-| [YARN-1623](https://issues.apache.org/jira/browse/YARN-1623) | Include queue name in RegisterApplicationMasterResponse | Major | scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-1616](https://issues.apache.org/jira/browse/YARN-1616) | RMFatalEventDispatcher should log the cause of the event | Trivial | resourcemanager | Karthik Kambatla | Karthik Kambatla |
+| [HADOOP-10208](https://issues.apache.org/jira/browse/HADOOP-10208) | Remove duplicate initialization in StringUtils.getStringCollection | Trivial | . | Benoy Antony | Benoy Antony |
+| [HDFS-5721](https://issues.apache.org/jira/browse/HDFS-5721) | sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns | Minor | . | Ted Yu | Ted Yu |
+| [HADOOP-10228](https://issues.apache.org/jira/browse/HADOOP-10228) | FsPermission#fromShort() should cache FsAction.values() | Minor | fs | Haohui Mai | Haohui Mai |
+| [HDFS-5677](https://issues.apache.org/jira/browse/HDFS-5677) | Need error checking for HA cluster configuration | Minor | datanode, ha | Vincent Sheffer | Vincent Sheffer |
| [YARN-1567](https://issues.apache.org/jira/browse/YARN-1567) | In Fair Scheduler, allow empty queues to change between leaf and parent on allocation file reload | Major | scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-1423](https://issues.apache.org/jira/browse/YARN-1423) | Support queue placement by secondary group in the Fair Scheduler | Major | scheduler | Sandy Ryza | Ted Malaska |
-| [YARN-1403](https://issues.apache.org/jira/browse/YARN-1403) | Separate out configuration loading from QueueManager in the Fair Scheduler | Major | . | Sandy Ryza | Sandy Ryza |
-| [YARN-1387](https://issues.apache.org/jira/browse/YARN-1387) | RMWebServices should use ClientRMService for filtering applications | Major | api | Karthik Kambatla | Karthik Kambatla |
-| [YARN-1335](https://issues.apache.org/jira/browse/YARN-1335) | Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication | Major | scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-1333](https://issues.apache.org/jira/browse/YARN-1333) | Support blacklisting in the Fair Scheduler | Major | scheduler | Sandy Ryza | Tsuyoshi Ozawa |
-| [YARN-1332](https://issues.apache.org/jira/browse/YARN-1332) | In TestAMRMClient, replace assertTrue with assertEquals where possible | Minor | . | Sandy Ryza | Sebastian Wong |
-| [YARN-1303](https://issues.apache.org/jira/browse/YARN-1303) | Allow multiple commands separating with ";" in distributed-shell | Major | applications/distributed-shell | Tassapol Athiapinya | Xuan Gong |
-| [YARN-1290](https://issues.apache.org/jira/browse/YARN-1290) | Let continuous scheduling achieve more balanced task assignment | Major | . | Wei Yan | Wei Yan |
-| [YARN-1258](https://issues.apache.org/jira/browse/YARN-1258) | Allow configuring the Fair Scheduler root queue | Major | scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-1199](https://issues.apache.org/jira/browse/YARN-1199) | Make NM/RM Versions Available | Major | . | Mit Desai | Mit Desai |
-| [YARN-1109](https://issues.apache.org/jira/browse/YARN-1109) | Demote NodeManager "Sending out status for container" logs to debug | Major | nodemanager | Sandy Ryza | haosdent |
-| [YARN-1010](https://issues.apache.org/jira/browse/YARN-1010) | FairScheduler: decouple container scheduling from nodemanager heartbeats | Critical | scheduler | Alejandro Abdelnur | Wei Yan |
-| [YARN-985](https://issues.apache.org/jira/browse/YARN-985) | Nodemanager should log where a resource was localized | Major | nodemanager | Ravi Prakash | Ravi Prakash |
+| [MAPREDUCE-5672](https://issues.apache.org/jira/browse/MAPREDUCE-5672) | Provide optional RollingFileAppender for container log4j (syslog) | Major | mr-am, mrv2 | Gera Shegalov | Gera Shegalov |
+| [YARN-1616](https://issues.apache.org/jira/browse/YARN-1616) | RMFatalEventDispatcher should log the cause of the event | Trivial | resourcemanager | Karthik Kambatla | Karthik Kambatla |
+| [HADOOP-10143](https://issues.apache.org/jira/browse/HADOOP-10143) | replace WritableFactories's hashmap with ConcurrentHashMap | Major | io | Liang Xie | Liang Xie |
+| [HDFS-5748](https://issues.apache.org/jira/browse/HDFS-5748) | Too much information shown in the dfs health page. | Major | . | Kihwal Lee | Haohui Mai |
+| [YARN-1623](https://issues.apache.org/jira/browse/YARN-1623) | Include queue name in RegisterApplicationMasterResponse | Major | scheduler | Sandy Ryza | Sandy Ryza |
+| [HDFS-5788](https://issues.apache.org/jira/browse/HDFS-5788) | listLocatedStatus response can be very large | Major | namenode | Nathan Roberts | Nathan Roberts |
+| [HADOOP-10167](https://issues.apache.org/jira/browse/HADOOP-10167) | Mark hadoop-common source as UTF-8 in Maven pom files / refactoring | Major | build | Mikhail Antonov | Mikhail Antonov |
+| [HADOOP-10248](https://issues.apache.org/jira/browse/HADOOP-10248) | Property name should be included in the exception where property value is null | Major | . | Ted Yu | Akira Ajisaka |
+| [HADOOP-9652](https://issues.apache.org/jira/browse/HADOOP-9652) | Allow RawLocalFs#getFileLinkStatus to fill in the link owner and mode if requested | Major | . | Colin P. McCabe | Andrew Wang |
+| [HADOOP-10086](https://issues.apache.org/jira/browse/HADOOP-10086) | User document for authentication in secure cluster | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki |
+| [HDFS-5825](https://issues.apache.org/jira/browse/HDFS-5825) | Use FileUtils.copyFile() to implement DFSTestUtils.copyFile() | Minor | . | Haohui Mai | Haohui Mai |
+| [HADOOP-10274](https://issues.apache.org/jira/browse/HADOOP-10274) | Lower the logging level from ERROR to WARN for UGI.doAs method | Minor | security | takeshi.miao | takeshi.miao |
+| [HDFS-5833](https://issues.apache.org/jira/browse/HDFS-5833) | SecondaryNameNode have an incorrect java doc | Trivial | namenode | Bangtao Zhou | |
+| [HDFS-5841](https://issues.apache.org/jira/browse/HDFS-5841) | Update HDFS caching documentation with new changes | Major | . | Andrew Wang | Andrew Wang |
+| [HDFS-5399](https://issues.apache.org/jira/browse/HDFS-5399) | Revisit SafeModeException and corresponding retry policies | Major | . | Jing Zhao | Jing Zhao |
+| [HDFS-5333](https://issues.apache.org/jira/browse/HDFS-5333) | Improvement of current HDFS Web UI | Major | . | Jing Zhao | Haohui Mai |
+| [MAPREDUCE-2734](https://issues.apache.org/jira/browse/MAPREDUCE-2734) | DistCp with FairScheduler assign all map tasks in one TT | Trivial | jobtracker | Bochun Bai | Bochun Bai |
| [YARN-905](https://issues.apache.org/jira/browse/YARN-905) | Add state filters to nodes CLI | Major | . | Sandy Ryza | Wei Yan |
-| [YARN-807](https://issues.apache.org/jira/browse/YARN-807) | When querying apps by queue, iterating over all apps is inefficient and limiting | Major | . | Sandy Ryza | Sandy Ryza |
-| [YARN-786](https://issues.apache.org/jira/browse/YARN-786) | Expose application resource usage in RM REST API | Major | . | Sandy Ryza | Sandy Ryza |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10317](https://issues.apache.org/jira/browse/HADOOP-10317) | Rename branch-2.3 release version from 2.4.0-SNAPSHOT to 2.3.0-SNAPSHOT | Major | . | Andrew Wang | Andrew Wang |
-| [HADOOP-10313](https://issues.apache.org/jira/browse/HADOOP-10313) | Script and jenkins job to produce Hadoop release artifacts | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-10311](https://issues.apache.org/jira/browse/HADOOP-10311) | Cleanup vendor names from the code base | Blocker | . | Suresh Srinivas | Alejandro Abdelnur |
-| [HADOOP-10310](https://issues.apache.org/jira/browse/HADOOP-10310) | SaslRpcServer should be initialized even when no secret manager present | Blocker | security | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-10305](https://issues.apache.org/jira/browse/HADOOP-10305) | Add "rpc.metrics.quantile.enable" and "rpc.metrics.percentiles.intervals" to core-default.xml | Major | metrics | Akira AJISAKA | Akira AJISAKA |
-| [HADOOP-10292](https://issues.apache.org/jira/browse/HADOOP-10292) | Restore HttpServer from branch-2.2 in branch-2 | Major | . | Haohui Mai | Haohui Mai |
-| [HADOOP-10291](https://issues.apache.org/jira/browse/HADOOP-10291) | TestSecurityUtil#testSocketAddrWithIP fails | Major | . | Mit Desai | Mit Desai |
-| [HADOOP-10288](https://issues.apache.org/jira/browse/HADOOP-10288) | Explicit reference to Log4JLogger breaks non-log4j users | Major | util | Todd Lipcon | Todd Lipcon |
-| [HADOOP-10273](https://issues.apache.org/jira/browse/HADOOP-10273) | Fix 'mvn site' | Major | build | Arpit Agarwal | Arpit Agarwal |
-| [HADOOP-10255](https://issues.apache.org/jira/browse/HADOOP-10255) | Rename HttpServer to HttpServer2 to retain older HttpServer in branch-2 for compatibility | Blocker | . | Haohui Mai | Haohui Mai |
-| [HADOOP-10252](https://issues.apache.org/jira/browse/HADOOP-10252) | HttpServer can't start if hostname is not specified | Major | . | Jimmy Xiang | Jimmy Xiang |
-| [HADOOP-10250](https://issues.apache.org/jira/browse/HADOOP-10250) | VersionUtil returns wrong value when comparing two versions | Major | . | Yongjun Zhang | Yongjun Zhang |
-| [HADOOP-10240](https://issues.apache.org/jira/browse/HADOOP-10240) | Windows build instructions incorrectly state requirement of protoc 2.4.1 instead of 2.5.0 | Trivial | documentation | Chris Nauroth | Chris Nauroth |
-| [HADOOP-10236](https://issues.apache.org/jira/browse/HADOOP-10236) | Fix typo in o.a.h.ipc.Client#checkResponse | Trivial | . | Akira AJISAKA | Akira AJISAKA |
-| [HADOOP-10235](https://issues.apache.org/jira/browse/HADOOP-10235) | Hadoop tarball has 2 versions of stax-api JARs | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-10234](https://issues.apache.org/jira/browse/HADOOP-10234) | "hadoop.cmd jar" does not propagate exit code. | Major | scripts | Chris Nauroth | Chris Nauroth |
-| [HADOOP-10223](https://issues.apache.org/jira/browse/HADOOP-10223) | MiniKdc#main() should close the FileReader it creates | Minor | . | Ted Yu | Ted Yu |
-| [HADOOP-10214](https://issues.apache.org/jira/browse/HADOOP-10214) | Fix multithreaded correctness warnings in ActiveStandbyElector | Major | ha | Liang Xie | Liang Xie |
-| [HADOOP-10212](https://issues.apache.org/jira/browse/HADOOP-10212) | Incorrect compile command in Native Library document | Major | documentation | Akira AJISAKA | Akira AJISAKA |
-| [HADOOP-10203](https://issues.apache.org/jira/browse/HADOOP-10203) | Connection leak in Jets3tNativeFileSystemStore#retrieveMetadata | Major | fs/s3 | Andrei Savu | Andrei Savu |
-| [HADOOP-10193](https://issues.apache.org/jira/browse/HADOOP-10193) | hadoop-auth's PseudoAuthenticationHandler can consume getInputStream | Minor | security | Gregory Chanan | Gregory Chanan |
-| [HADOOP-10178](https://issues.apache.org/jira/browse/HADOOP-10178) | Configuration deprecation always emit "deprecated" warnings when a new key is used | Major | conf | shanyu zhao | shanyu zhao |
-| [HADOOP-10175](https://issues.apache.org/jira/browse/HADOOP-10175) | Har files system authority should preserve userinfo | Major | fs | Chuan Liu | Chuan Liu |
-| [HADOOP-10171](https://issues.apache.org/jira/browse/HADOOP-10171) | TestRPC fails intermittently on jkd7 | Major | . | Mit Desai | Mit Desai |
-| [HADOOP-10168](https://issues.apache.org/jira/browse/HADOOP-10168) | fix javadoc of ReflectionUtils.copy | Major | . | Thejas M Nair | Thejas M Nair |
-| [HADOOP-10162](https://issues.apache.org/jira/browse/HADOOP-10162) | Fix symlink-related test failures in TestFileContextResolveAfs and TestStat in branch-2 | Major | . | Mit Desai | Mit Desai |
-| [HADOOP-10147](https://issues.apache.org/jira/browse/HADOOP-10147) | Upgrade to commons-logging 1.1.3 to avoid potential deadlock in MiniDFSCluster | Minor | build | Eric Sirianni | Steve Loughran |
-| [HADOOP-10146](https://issues.apache.org/jira/browse/HADOOP-10146) | Workaround JDK7 Process fd close bug | Critical | util | Daryn Sharp | Daryn Sharp |
-| [HADOOP-10142](https://issues.apache.org/jira/browse/HADOOP-10142) | Avoid groups lookup for unprivileged users such as "dr.who" | Major | . | Vinayakumar B | Vinayakumar B |
-| [HADOOP-10135](https://issues.apache.org/jira/browse/HADOOP-10135) | writes to swift fs over partition size leave temp files and empty output file | Major | fs | David Dobbins | David Dobbins |
-| [HADOOP-10130](https://issues.apache.org/jira/browse/HADOOP-10130) | RawLocalFS::LocalFSFileInputStream.pread does not track FS::Statistics | Minor | . | Binglin Chang | Binglin Chang |
-| [HADOOP-10129](https://issues.apache.org/jira/browse/HADOOP-10129) | Distcp may succeed when it fails | Critical | tools/distcp | Daryn Sharp | Daryn Sharp |
-| [HADOOP-10127](https://issues.apache.org/jira/browse/HADOOP-10127) | Add ipc.client.connect.retry.interval to control the frequency of connection retries | Major | ipc | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-10126](https://issues.apache.org/jira/browse/HADOOP-10126) | LightWeightGSet log message is confusing : "2.0% max memory = 2.0 GB" | Minor | util | Vinayakumar B | Vinayakumar B |
-| [HADOOP-10125](https://issues.apache.org/jira/browse/HADOOP-10125) | no need to process RPC request if the client connection has been dropped | Major | ipc | Ming Ma | Ming Ma |
-| [HADOOP-10112](https://issues.apache.org/jira/browse/HADOOP-10112) | har file listing doesn't work with wild card | Major | tools | Brandon Li | Brandon Li |
-| [HADOOP-10110](https://issues.apache.org/jira/browse/HADOOP-10110) | hadoop-auth has a build break due to missing dependency | Blocker | build | Chuan Liu | Chuan Liu |
-| [HADOOP-10106](https://issues.apache.org/jira/browse/HADOOP-10106) | Incorrect thread name in RPC log messages | Minor | . | Ming Ma | Ming Ma |
-| [HADOOP-10100](https://issues.apache.org/jira/browse/HADOOP-10100) | MiniKDC shouldn't use apacheds-all artifact | Major | . | Robert Kanter | Robert Kanter |
-| [HADOOP-10094](https://issues.apache.org/jira/browse/HADOOP-10094) | NPE in GenericOptionsParser#preProcessForWindows() | Trivial | util | Enis Soztutar | Enis Soztutar |
-| [HADOOP-10093](https://issues.apache.org/jira/browse/HADOOP-10093) | hadoop-env.cmd sets HADOOP\_CLIENT\_OPTS with a max heap size that is too small. | Major | conf | shanyu zhao | shanyu zhao |
-| [HADOOP-10090](https://issues.apache.org/jira/browse/HADOOP-10090) | Jobtracker metrics not updated properly after execution of a mapreduce job | Major | metrics | Ivan Mitic | Ivan Mitic |
-| [HADOOP-10088](https://issues.apache.org/jira/browse/HADOOP-10088) | copy-nativedistlibs.sh needs to quote snappy lib dir | Major | build | Raja Aluri | Raja Aluri |
-| [HADOOP-10087](https://issues.apache.org/jira/browse/HADOOP-10087) | UserGroupInformation.getGroupNames() fails to return primary group first when JniBasedUnixGroupsMappingWithFallback is used | Major | security | Yu Gao | Colin Patrick McCabe |
-| [HADOOP-10081](https://issues.apache.org/jira/browse/HADOOP-10081) | Client.setupIOStreams can leak socket resources on exception or error | Critical | ipc | Jason Lowe | Tsuyoshi Ozawa |
-| [HADOOP-10078](https://issues.apache.org/jira/browse/HADOOP-10078) | KerberosAuthenticator always does SPNEGO | Minor | security | Robert Kanter | Robert Kanter |
-| [HADOOP-10072](https://issues.apache.org/jira/browse/HADOOP-10072) | TestNfsExports#testMultiMatchers fails due to non-deterministic timing around cache expiry check. | Trivial | nfs, test | Chris Nauroth | Chris Nauroth |
-| [HADOOP-10058](https://issues.apache.org/jira/browse/HADOOP-10058) | TestMetricsSystemImpl#testInitFirstVerifyStopInvokedImmediately fails on trunk | Minor | metrics | Akira AJISAKA | Chen He |
-| [HADOOP-10055](https://issues.apache.org/jira/browse/HADOOP-10055) | FileSystemShell.apt.vm doc has typo "numRepicas" | Trivial | documentation | Eli Collins | Akira AJISAKA |
-| [HADOOP-10040](https://issues.apache.org/jira/browse/HADOOP-10040) | hadoop.cmd in UNIX format and would not run by default on Windows | Major | . | Yingda Chen | Chris Nauroth |
-| [HADOOP-10039](https://issues.apache.org/jira/browse/HADOOP-10039) | Add Hive to the list of projects using AbstractDelegationTokenSecretManager | Major | security | Suresh Srinivas | Haohui Mai |
-| [HADOOP-10031](https://issues.apache.org/jira/browse/HADOOP-10031) | FsShell -get/copyToLocal/moveFromLocal should support Windows local path | Major | fs | Chuan Liu | Chuan Liu |
-| [HADOOP-10030](https://issues.apache.org/jira/browse/HADOOP-10030) | FsShell -put/copyFromLocal should support Windows local path | Major | . | Chuan Liu | Chuan Liu |
-| [HADOOP-10029](https://issues.apache.org/jira/browse/HADOOP-10029) | Specifying har file to MR job fails in secure cluster | Major | fs | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-10028](https://issues.apache.org/jira/browse/HADOOP-10028) | Malformed ssl-server.xml.example | Minor | . | Jing Zhao | Haohui Mai |
-| [HADOOP-10006](https://issues.apache.org/jira/browse/HADOOP-10006) | Compilation failure in trunk for o.a.h.fs.swift.util.JSONUtil | Blocker | fs, util | Junping Du | Junping Du |
-| [HADOOP-9982](https://issues.apache.org/jira/browse/HADOOP-9982) | Fix dead links in hadoop site docs | Major | documentation | Akira AJISAKA | Akira AJISAKA |
-| [HADOOP-9981](https://issues.apache.org/jira/browse/HADOOP-9981) | globStatus should minimize its listStatus and getFileStatus calls | Critical | . | Kihwal Lee | Colin Patrick McCabe |
-| [HADOOP-9964](https://issues.apache.org/jira/browse/HADOOP-9964) | O.A.H.U.ReflectionUtils.printThreadInfo() is not thread-safe which cause TestHttpServer pending 10 minutes or longer. | Major | util | Junping Du | Junping Du |
-| [HADOOP-9929](https://issues.apache.org/jira/browse/HADOOP-9929) | Insufficient permissions for a path reported as file not found | Major | fs | Jason Lowe | Colin Patrick McCabe |
-| [HADOOP-9908](https://issues.apache.org/jira/browse/HADOOP-9908) | Fix NPE when versioninfo properties file is missing | Major | util | Todd Lipcon | Todd Lipcon |
-| [HADOOP-9898](https://issues.apache.org/jira/browse/HADOOP-9898) | Set SO\_KEEPALIVE on all our sockets | Minor | ipc, net | Todd Lipcon | Todd Lipcon |
-| [HADOOP-9889](https://issues.apache.org/jira/browse/HADOOP-9889) | Refresh the Krb5 configuration when creating a new kdc in Hadoop-MiniKDC | Major | . | Wei Yan | Wei Yan |
-| [HADOOP-9887](https://issues.apache.org/jira/browse/HADOOP-9887) | globStatus does not correctly handle paths starting with a drive spec on Windows | Major | fs | Chris Nauroth | Chuan Liu |
-| [HADOOP-9875](https://issues.apache.org/jira/browse/HADOOP-9875) | TestDoAsEffectiveUser can fail on JDK 7 | Minor | test | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-9871](https://issues.apache.org/jira/browse/HADOOP-9871) | Fix intermittent findbug warnings in DefaultMetricsSystem | Minor | . | Luke Lu | Junping Du |
-| [HADOOP-9865](https://issues.apache.org/jira/browse/HADOOP-9865) | FileContext.globStatus() has a regression with respect to relative path | Major | . | Chuan Liu | Chuan Liu |
-| [HADOOP-9847](https://issues.apache.org/jira/browse/HADOOP-9847) | TestGlobPath symlink tests fail to cleanup properly | Minor | . | Andrew Wang | Colin Patrick McCabe |
-| [HADOOP-9830](https://issues.apache.org/jira/browse/HADOOP-9830) | Typo at http://hadoop.apache.org/docs/current/ | Trivial | documentation | Dmitry Lysnichenko | Kousuke Saruta |
-| [HADOOP-9817](https://issues.apache.org/jira/browse/HADOOP-9817) | FileSystem#globStatus and FileContext#globStatus need to work with symlinks | Major | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-9791](https://issues.apache.org/jira/browse/HADOOP-9791) | Add a test case covering long paths for new FileUtil access check methods | Major | . | Ivan Mitic | Ivan Mitic |
-| [HADOOP-9787](https://issues.apache.org/jira/browse/HADOOP-9787) | ShutdownHelper util to shutdown threads and threadpools | Major | util | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-9703](https://issues.apache.org/jira/browse/HADOOP-9703) | org.apache.hadoop.ipc.Client leaks threads on stop. | Minor | . | Mark Miller | Tsuyoshi Ozawa |
-| [HADOOP-9660](https://issues.apache.org/jira/browse/HADOOP-9660) | [WINDOWS] Powershell / cmd parses -Dkey=value from command line as [-Dkey, value] which breaks GenericsOptionParser | Major | scripts, util | Enis Soztutar | Enis Soztutar |
+| [HDFS-4633](https://issues.apache.org/jira/browse/HDFS-4633) | TestDFSClientExcludedNodes fails sporadically if excluded nodes cache expires too quickly | Major | hdfs-client, test | Chris Nauroth | Chris Nauroth |
| [HADOOP-9635](https://issues.apache.org/jira/browse/HADOOP-9635) | Fix Potential Stack Overflow in DomainSocket.c | Major | native | V. Karthik Kumar | |
+| [MAPREDUCE-5316](https://issues.apache.org/jira/browse/MAPREDUCE-5316) | job -list-attempt-ids command does not handle illegal task-state | Major | client | Ashwin Shankar | Ashwin Shankar |
| [HADOOP-9582](https://issues.apache.org/jira/browse/HADOOP-9582) | Non-existent file to "hadoop fs -conf" doesn't throw error | Major | conf | Ashwin Shankar | Ashwin Shankar |
-| [HADOOP-9478](https://issues.apache.org/jira/browse/HADOOP-9478) | Fix race conditions during the initialization of Configuration related to deprecatedKeyMap | Major | conf | Dongyong Wang | Colin Patrick McCabe |
-| [HADOOP-9420](https://issues.apache.org/jira/browse/HADOOP-9420) | Add percentile or max metric for rpcQueueTime, processing time | Major | ipc, metrics | Todd Lipcon | Liang Xie |
+| [HADOOP-9660](https://issues.apache.org/jira/browse/HADOOP-9660) | [WINDOWS] Powershell / cmd parses -Dkey=value from command line as [-Dkey, value] which breaks GenericsOptionParser | Major | scripts, util | Enis Soztutar | Enis Soztutar |
+| [HADOOP-9703](https://issues.apache.org/jira/browse/HADOOP-9703) | org.apache.hadoop.ipc.Client leaks threads on stop. | Minor | . | Mark Miller | Tsuyoshi Ozawa |
+| [HDFS-4657](https://issues.apache.org/jira/browse/HDFS-4657) | Limit the number of blocks logged by the NN after a block report to a configurable value. | Major | namenode | Aaron T. Myers | Aaron T. Myers |
+| [MAPREDUCE-5380](https://issues.apache.org/jira/browse/MAPREDUCE-5380) | Invalid mapred command should return non-zero exit code | Major | . | Stephen Chu | Stephen Chu |
+| [MAPREDUCE-5404](https://issues.apache.org/jira/browse/MAPREDUCE-5404) | HSAdminServer does not use ephemeral ports in minicluster mode | Major | jobhistoryserver | Ted Yu | Ted Yu |
+| [HADOOP-9787](https://issues.apache.org/jira/browse/HADOOP-9787) | ShutdownHelper util to shutdown threads and threadpools | Major | util | Karthik Kambatla | Karthik Kambatla |
+| [HADOOP-9817](https://issues.apache.org/jira/browse/HADOOP-9817) | FileSystem#globStatus and FileContext#globStatus need to work with symlinks | Major | . | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-5065](https://issues.apache.org/jira/browse/HDFS-5065) | TestSymlinkHdfsDisable fails on Windows | Major | hdfs-client, test | Ivan Mitic | Ivan Mitic |
+| [HADOOP-9847](https://issues.apache.org/jira/browse/HADOOP-9847) | TestGlobPath symlink tests fail to cleanup properly | Minor | . | Andrew Wang | Colin P. McCabe |
+| [YARN-1060](https://issues.apache.org/jira/browse/YARN-1060) | Two tests in TestFairScheduler are missing @Test annotation | Major | scheduler | Sandy Ryza | Niranjan Singh |
+| [HADOOP-9871](https://issues.apache.org/jira/browse/HADOOP-9871) | Fix intermittent findbug warnings in DefaultMetricsSystem | Minor | . | Luke Lu | Junping Du |
+| [HDFS-4816](https://issues.apache.org/jira/browse/HDFS-4816) | transitionToActive blocks if the SBN is doing checkpoint image transfer | Major | namenode | Andrew Wang | Andrew Wang |
+| [HADOOP-9875](https://issues.apache.org/jira/browse/HADOOP-9875) | TestDoAsEffectiveUser can fail on JDK 7 | Minor | test | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-5093](https://issues.apache.org/jira/browse/HDFS-5093) | TestGlobPaths should re-use the MiniDFSCluster to avoid failure on Windows | Minor | test | Chuan Liu | Chuan Liu |
+| [HADOOP-9865](https://issues.apache.org/jira/browse/HADOOP-9865) | FileContext.globStatus() has a regression with respect to relative path | Major | . | Chuan Liu | Chuan Liu |
+| [HDFS-4994](https://issues.apache.org/jira/browse/HDFS-4994) | Audit log getContentSummary() calls | Minor | namenode | Kihwal Lee | Robert Parker |
+| [HADOOP-9887](https://issues.apache.org/jira/browse/HADOOP-9887) | globStatus does not correctly handle paths starting with a drive spec on Windows | Major | fs | Chris Nauroth | Chuan Liu |
+| [HDFS-4329](https://issues.apache.org/jira/browse/HDFS-4329) | DFSShell issues with directories with spaces in name | Major | hdfs-client | Andy Isaacson | Cristina L. Abad |
+| [HDFS-3981](https://issues.apache.org/jira/browse/HDFS-3981) | access time is set without holding FSNamesystem write lock | Major | namenode | Xiaobo Peng | Xiaobo Peng |
+| [HADOOP-9889](https://issues.apache.org/jira/browse/HADOOP-9889) | Refresh the Krb5 configuration when creating a new kdc in Hadoop-MiniKDC | Major | . | Wei Yan | Wei Yan |
+| [HADOOP-9908](https://issues.apache.org/jira/browse/HADOOP-9908) | Fix NPE when versioninfo properties file is missing | Major | util | Todd Lipcon | Todd Lipcon |
+| [HDFS-5164](https://issues.apache.org/jira/browse/HDFS-5164) | deleteSnapshot should check if OperationCategory.WRITE is possible before taking write lock | Minor | namenode | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-5170](https://issues.apache.org/jira/browse/HDFS-5170) | BlockPlacementPolicyDefault uses the wrong classname when alerting to enable debug logging | Trivial | . | Andrew Wang | Andrew Wang |
| [HADOOP-9350](https://issues.apache.org/jira/browse/HADOOP-9350) | Hadoop not building against Java7 on OSX | Minor | build | Steve Loughran | Robert Kanter |
-| [HADOOP-9114](https://issues.apache.org/jira/browse/HADOOP-9114) | After defined the dfs.checksum.type as the NULL, write file and hflush will through java.lang.ArrayIndexOutOfBoundsException | Minor | . | liuyang | sathish |
-| [HADOOP-9016](https://issues.apache.org/jira/browse/HADOOP-9016) | org.apache.hadoop.fs.HarFileSystem.HarFSDataInputStream.HarFsInputStream.skip(long) must never return negative value. | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
-| [HADOOP-8753](https://issues.apache.org/jira/browse/HADOOP-8753) | LocalDirAllocator throws "ArithmeticException: / by zero" when there is no available space on configured local dir | Minor | . | Nishan Shetty | Benoy Antony |
-| [HADOOP-7344](https://issues.apache.org/jira/browse/HADOOP-7344) | globStatus doesn't grok groupings with a slash | Major | fs | Daryn Sharp | Colin Patrick McCabe |
-| [HDFS-5921](https://issues.apache.org/jira/browse/HDFS-5921) | Cannot browse file system via NN web UI if any directory has the sticky bit set | Critical | namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-5876](https://issues.apache.org/jira/browse/HDFS-5876) | SecureDataNodeStarter does not pick up configuration in hdfs-site.xml | Major | datanode | Haohui Mai | Haohui Mai |
-| [HDFS-5873](https://issues.apache.org/jira/browse/HDFS-5873) | dfs.http.policy should have higher precedence over dfs.https.enable | Major | . | Yesha Vora | Haohui Mai |
-| [HDFS-5845](https://issues.apache.org/jira/browse/HDFS-5845) | SecondaryNameNode dies when checkpointing with cache pools | Blocker | namenode | Andrew Wang | Andrew Wang |
-| [HDFS-5844](https://issues.apache.org/jira/browse/HDFS-5844) | Fix broken link in WebHDFS.apt.vm | Minor | documentation | Akira AJISAKA | Akira AJISAKA |
-| [HDFS-5842](https://issues.apache.org/jira/browse/HDFS-5842) | Cannot create hftp filesystem when using a proxy user ugi and a doAs on a secure cluster | Major | security | Arpit Gupta | Jing Zhao |
-| [HDFS-5837](https://issues.apache.org/jira/browse/HDFS-5837) | dfs.namenode.replication.considerLoad does not consider decommissioned nodes | Major | namenode | Bryan Beaudreault | Tao Luo |
-| [HDFS-5830](https://issues.apache.org/jira/browse/HDFS-5830) | WebHdfsFileSystem.getFileBlockLocations throws IllegalArgumentException when accessing another cluster. | Blocker | caching, hdfs-client | Yongjun Zhang | Yongjun Zhang |
-| [HDFS-5806](https://issues.apache.org/jira/browse/HDFS-5806) | balancer should set SoTimeout to avoid indefinite hangs | Major | balancer & mover | Nathan Roberts | Nathan Roberts |
-| [HDFS-5800](https://issues.apache.org/jira/browse/HDFS-5800) | Typo: soft-limit for hard-limit in DFSClient | Trivial | hdfs-client | Kousuke Saruta | Kousuke Saruta |
-| [HDFS-5789](https://issues.apache.org/jira/browse/HDFS-5789) | Some of snapshot APIs missing checkOperation double check in fsn | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HDFS-5777](https://issues.apache.org/jira/browse/HDFS-5777) | Update LayoutVersion for the new editlog op OP\_ADD\_BLOCK | Major | namenode | Jing Zhao | Jing Zhao |
-| [HDFS-5766](https://issues.apache.org/jira/browse/HDFS-5766) | In DFSInputStream, do not add datanode to deadNodes after InvalidEncryptionKeyException in fetchBlockByteRange | Major | hdfs-client | Liang Xie | Liang Xie |
-| [HDFS-5762](https://issues.apache.org/jira/browse/HDFS-5762) | BlockReaderLocal doesn't return -1 on EOF when doing zero-length reads | Major | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-5756](https://issues.apache.org/jira/browse/HDFS-5756) | hadoopRzOptionsSetByteBufferPool does not accept NULL argument, contrary to docs | Major | libhdfs | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-5747](https://issues.apache.org/jira/browse/HDFS-5747) | BlocksMap.getStoredBlock(..) and BlockInfoUnderConstruction.addReplicaIfNotPresent(..) may throw NullPointerException | Minor | namenode | Tsz Wo Nicholas Sze | Arpit Agarwal |
-| [HDFS-5728](https://issues.apache.org/jira/browse/HDFS-5728) | [Diskfull] Block recovery will fail if the metafile does not have crc for all chunks of the block | Critical | datanode | Vinayakumar B | Vinayakumar B |
-| [HDFS-5719](https://issues.apache.org/jira/browse/HDFS-5719) | FSImage#doRollback() should close prevState before return | Minor | namenode | Ted Yu | Ted Yu |
-| [HDFS-5710](https://issues.apache.org/jira/browse/HDFS-5710) | FSDirectory#getFullPathName should check inodes against null | Major | . | Ted Yu | Uma Maheswara Rao G |
-| [HDFS-5704](https://issues.apache.org/jira/browse/HDFS-5704) | Change OP\_UPDATE\_BLOCKS with a new OP\_ADD\_BLOCK | Major | namenode | Suresh Srinivas | Jing Zhao |
-| [HDFS-5701](https://issues.apache.org/jira/browse/HDFS-5701) | Fix the CacheAdmin -addPool -maxTtl option name | Minor | caching, tools | Stephen Chu | Stephen Chu |
-| [HDFS-5691](https://issues.apache.org/jira/browse/HDFS-5691) | Fix typo in ShortCircuitLocalRead document | Minor | documentation | Akira AJISAKA | Akira AJISAKA |
-| [HDFS-5690](https://issues.apache.org/jira/browse/HDFS-5690) | DataNode fails to start in secure mode when dfs.http.policy equals to HTTP\_ONLY | Blocker | . | Haohui Mai | Haohui Mai |
-| [HDFS-5681](https://issues.apache.org/jira/browse/HDFS-5681) | renewLease should not hold fsn write lock | Major | namenode | Daryn Sharp | Daryn Sharp |
-| [HDFS-5675](https://issues.apache.org/jira/browse/HDFS-5675) | Add Mkdirs operation to NNThroughputBenchmark | Minor | benchmarks | Plamen Jeliazkov | Plamen Jeliazkov |
-| [HDFS-5671](https://issues.apache.org/jira/browse/HDFS-5671) | Fix socket leak in DFSInputStream#getBlockReader | Critical | hdfs-client | JamesLi | JamesLi |
-| [HDFS-5666](https://issues.apache.org/jira/browse/HDFS-5666) | Fix inconsistent synchronization in BPOfferService | Minor | namenode | Colin Patrick McCabe | Jimmy Xiang |
-| [HDFS-5661](https://issues.apache.org/jira/browse/HDFS-5661) | Browsing FileSystem via web ui, should use datanode's fqdn instead of ip address | Major | security | Benoy Antony | Benoy Antony |
-| [HDFS-5659](https://issues.apache.org/jira/browse/HDFS-5659) | dfsadmin -report doesn't output cache information properly | Major | caching | Akira AJISAKA | Andrew Wang |
-| [HDFS-5657](https://issues.apache.org/jira/browse/HDFS-5657) | race condition causes writeback state error in NFS gateway | Major | nfs | Brandon Li | Brandon Li |
-| [HDFS-5649](https://issues.apache.org/jira/browse/HDFS-5649) | Unregister NFS and Mount service when NFS gateway is shutting down | Major | nfs | Brandon Li | Brandon Li |
-| [HDFS-5592](https://issues.apache.org/jira/browse/HDFS-5592) | "DIR\* completeFile: /file is closed by DFSClient\_" should be logged only for successful closure of the file. | Major | . | Vinayakumar B | Vinayakumar B |
-| [HDFS-5590](https://issues.apache.org/jira/browse/HDFS-5590) | Block ID and generation stamp may be reused when persistBlocks is set to false | Major | . | Jing Zhao | Jing Zhao |
-| [HDFS-5582](https://issues.apache.org/jira/browse/HDFS-5582) | hdfs getconf -excludeFile or -includeFile always failed | Minor | . | Henry Hung | sathish |
-| [HDFS-5581](https://issues.apache.org/jira/browse/HDFS-5581) | NameNodeFsck should use only one instance of BlockPlacementPolicy | Major | namenode | Vinayakumar B | Vinayakumar B |
-| [HDFS-5580](https://issues.apache.org/jira/browse/HDFS-5580) | Infinite loop in Balancer.waitForMoveCompletion | Major | . | Binglin Chang | Binglin Chang |
-| [HDFS-5579](https://issues.apache.org/jira/browse/HDFS-5579) | Under construction files make DataNode decommission take very long hours | Major | namenode | zhaoyunjiong | zhaoyunjiong |
-| [HDFS-5562](https://issues.apache.org/jira/browse/HDFS-5562) | TestCacheDirectives and TestFsDatasetCache should stub out native mlock | Major | test | Akira AJISAKA | Colin Patrick McCabe |
-| [HDFS-5560](https://issues.apache.org/jira/browse/HDFS-5560) | Trash configuration log statements prints incorrect units | Major | . | Josh Elser | Josh Elser |
-| [HDFS-5558](https://issues.apache.org/jira/browse/HDFS-5558) | LeaseManager monitor thread can crash if the last block is complete but another block is not. | Major | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-5557](https://issues.apache.org/jira/browse/HDFS-5557) | Write pipeline recovery for the last packet in the block may cause rejection of valid replicas | Critical | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-5555](https://issues.apache.org/jira/browse/HDFS-5555) | CacheAdmin commands fail when first listed NameNode is in Standby | Major | caching | Stephen Chu | Jimmy Xiang |
-| [HDFS-5552](https://issues.apache.org/jira/browse/HDFS-5552) | Fix wrong information of "Cluster summay" in dfshealth.html | Major | namenode | Shinichi Yamashita | Haohui Mai |
-| [HDFS-5544](https://issues.apache.org/jira/browse/HDFS-5544) | Adding Test case For Checking dfs.checksum type as NULL value | Minor | hdfs-client | sathish | sathish |
-| [HDFS-5540](https://issues.apache.org/jira/browse/HDFS-5540) | Fix intermittent failure in TestBlocksWithNotEnoughRacks | Minor | . | Binglin Chang | Binglin Chang |
-| [HDFS-5533](https://issues.apache.org/jira/browse/HDFS-5533) | Symlink delete/create should be treated as DELETE/CREATE in snapshot diff report | Minor | snapshots | Binglin Chang | Binglin Chang |
-| [HDFS-5526](https://issues.apache.org/jira/browse/HDFS-5526) | Datanode cannot roll back to previous layout version | Blocker | datanode | Tsz Wo Nicholas Sze | Kihwal Lee |
-| [HDFS-5513](https://issues.apache.org/jira/browse/HDFS-5513) | CacheAdmin commands fail when using . as the path | Minor | caching, tools | Stephen Chu | Andrew Wang |
-| [HDFS-5512](https://issues.apache.org/jira/browse/HDFS-5512) | CacheAdmin -listPools fails with NPE when user lacks permissions to view all pools | Major | caching, tools | Stephen Chu | Andrew Wang |
-| [HDFS-5504](https://issues.apache.org/jira/browse/HDFS-5504) | In HA mode, OP\_DELETE\_SNAPSHOT is not decrementing the safemode threshold, leads to NN safemode. | Major | snapshots | Vinayakumar B | Vinayakumar B |
-| [HDFS-5482](https://issues.apache.org/jira/browse/HDFS-5482) | DistributedFileSystem#listPathBasedCacheDirectives must support relative paths | Major | tools | Stephen Chu | Colin Patrick McCabe |
-| [HDFS-5476](https://issues.apache.org/jira/browse/HDFS-5476) | Snapshot: clean the blocks/files/directories under a renamed file/directory while deletion | Major | . | Jing Zhao | Jing Zhao |
-| [HDFS-5474](https://issues.apache.org/jira/browse/HDFS-5474) | Deletesnapshot can make Namenode in safemode on NN restarts. | Major | snapshots | Uma Maheswara Rao G | sathish |
-| [HDFS-5471](https://issues.apache.org/jira/browse/HDFS-5471) | CacheAdmin -listPools fails when user lacks permissions to view all pools | Major | tools | Stephen Chu | Andrew Wang |
-| [HDFS-5468](https://issues.apache.org/jira/browse/HDFS-5468) | CacheAdmin help command does not recognize commands | Minor | tools | Stephen Chu | Stephen Chu |
-| [HDFS-5458](https://issues.apache.org/jira/browse/HDFS-5458) | Datanode failed volume threshold ignored if exception is thrown in getDataDirsFromURIs | Major | datanode | Andrew Wang | Mike Mellenthin |
-| [HDFS-5456](https://issues.apache.org/jira/browse/HDFS-5456) | NameNode startup progress creates new steps if caller attempts to create a counter for a step that doesn't already exist. | Critical | namenode | Chris Nauroth | Chris Nauroth |
-| [HDFS-5449](https://issues.apache.org/jira/browse/HDFS-5449) | WebHdfs compatibility broken between 2.2 and 1.x / 23.x | Blocker | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-5443](https://issues.apache.org/jira/browse/HDFS-5443) | Delete 0-sized block when deleting an under-construction file that is included in snapshot | Major | snapshots | Uma Maheswara Rao G | Jing Zhao |
-| [HDFS-5438](https://issues.apache.org/jira/browse/HDFS-5438) | Flaws in block report processing can cause data loss | Critical | namenode | Kihwal Lee | Kihwal Lee |
-| [HDFS-5434](https://issues.apache.org/jira/browse/HDFS-5434) | Write resiliency for replica count 1 | Minor | namenode | Taylor, Buddy | |
-| [HDFS-5433](https://issues.apache.org/jira/browse/HDFS-5433) | When reloading fsimage during checkpointing, we should clear existing snapshottable directories | Critical | snapshots | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-5432](https://issues.apache.org/jira/browse/HDFS-5432) | TestDatanodeJsp fails on Windows due to assumption that loopback address resolves to host name localhost. | Trivial | datanode, test | Chris Nauroth | Chris Nauroth |
-| [HDFS-5428](https://issues.apache.org/jira/browse/HDFS-5428) | under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode | Major | snapshots | Vinayakumar B | Jing Zhao |
-| [HDFS-5427](https://issues.apache.org/jira/browse/HDFS-5427) | not able to read deleted files from snapshot directly under snapshottable dir after checkpoint and NN restart | Major | snapshots | Vinayakumar B | Vinayakumar B |
-| [HDFS-5425](https://issues.apache.org/jira/browse/HDFS-5425) | Renaming underconstruction file with snapshots can make NN failure on restart | Major | namenode, snapshots | sathish | Jing Zhao |
-| [HDFS-5413](https://issues.apache.org/jira/browse/HDFS-5413) | hdfs.cmd does not support passthrough to any arbitrary class. | Major | scripts | Chris Nauroth | Chris Nauroth |
-| [HDFS-5407](https://issues.apache.org/jira/browse/HDFS-5407) | Fix typos in DFSClientCache | Trivial | . | Haohui Mai | Haohui Mai |
-| [HDFS-5403](https://issues.apache.org/jira/browse/HDFS-5403) | WebHdfs client cannot communicate with older WebHdfs servers post HDFS-5306 | Major | webhdfs | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-5400](https://issues.apache.org/jira/browse/HDFS-5400) | DFS\_CLIENT\_MMAP\_CACHE\_THREAD\_RUNS\_PER\_TIMEOUT constant is set to the wrong value | Major | . | Colin Patrick McCabe | Colin Patrick McCabe |
+| [HDFS-5122](https://issues.apache.org/jira/browse/HDFS-5122) | Support failover and retry in WebHdfsFileSystem for NN HA | Major | ha, webhdfs | Arpit Gupta | Haohui Mai |
+| [HADOOP-9929](https://issues.apache.org/jira/browse/HADOOP-9929) | Insufficient permissions for a path reported as file not found | Major | fs | Jason Lowe | Colin P. McCabe |
+| [HADOOP-9791](https://issues.apache.org/jira/browse/HADOOP-9791) | Add a test case covering long paths for new FileUtil access check methods | Major | . | Ivan Mitic | Ivan Mitic |
+| [MAPREDUCE-5504](https://issues.apache.org/jira/browse/MAPREDUCE-5504) | mapred queue -info inconsistent with types | Major | client | Thomas Graves | Kousuke Saruta |
+| [HADOOP-7344](https://issues.apache.org/jira/browse/HADOOP-7344) | globStatus doesn't grok groupings with a slash | Major | fs | Daryn Sharp | Colin P. McCabe |
+| [YARN-1188](https://issues.apache.org/jira/browse/YARN-1188) | The context of QueueMetrics becomes 'default' when using FairScheduler | Trivial | . | Akira Ajisaka | Tsuyoshi Ozawa |
+| [MAPREDUCE-5522](https://issues.apache.org/jira/browse/MAPREDUCE-5522) | Incorrectly expect the array of JobQueueInfo returned by o.a.h.mapred.QueueManager#getJobQueueInfos to have a specific order. | Minor | test | Jinghui Wang | Jinghui Wang |
+| [HADOOP-9981](https://issues.apache.org/jira/browse/HADOOP-9981) | globStatus should minimize its listStatus and getFileStatus calls | Critical | . | Kihwal Lee | Colin P. McCabe |
+| [MAPREDUCE-5514](https://issues.apache.org/jira/browse/MAPREDUCE-5514) | TestRMContainerAllocator fails on trunk | Blocker | . | Zhijie Shen | Zhijie Shen |
+| [HADOOP-10006](https://issues.apache.org/jira/browse/HADOOP-10006) | Compilation failure in trunk for o.a.h.fs.swift.util.JSONUtil | Blocker | fs, util | Junping Du | Junping Du |
+| [HADOOP-9964](https://issues.apache.org/jira/browse/HADOOP-9964) | O.A.H.U.ReflectionUtils.printThreadInfo() is not thread-safe which cause TestHttpServer pending 10 minutes or longer. | Major | util | Junping Du | Junping Du |
+| [YARN-1268](https://issues.apache.org/jira/browse/YARN-1268) | TestFairScheduler.testContinuousScheduling is flaky | Major | scheduler | Sandy Ryza | Sandy Ryza |
+| [HADOOP-10028](https://issues.apache.org/jira/browse/HADOOP-10028) | Malformed ssl-server.xml.example | Minor | . | Jing Zhao | Haohui Mai |
+| [HDFS-5291](https://issues.apache.org/jira/browse/HDFS-5291) | Clients need to retry when Active NN is in SafeMode | Critical | ha | Arpit Gupta | Jing Zhao |
+| [HADOOP-10030](https://issues.apache.org/jira/browse/HADOOP-10030) | FsShell -put/copyFromLocal should support Windows local path | Major | . | Chuan Liu | Chuan Liu |
+| [YARN-1284](https://issues.apache.org/jira/browse/YARN-1284) | LCE: Race condition leaves dangling cgroups entries for killed containers | Blocker | nodemanager | Alejandro Abdelnur | Alejandro Abdelnur |
+| [YARN-461](https://issues.apache.org/jira/browse/YARN-461) | Fair scheduler should not accept apps with empty string queue name | Major | resourcemanager | Sandy Ryza | Wei Yan |
+| [MAPREDUCE-5569](https://issues.apache.org/jira/browse/MAPREDUCE-5569) | FloatSplitter is not generating correct splits | Major | . | Nathan Roberts | Nathan Roberts |
+| [YARN-879](https://issues.apache.org/jira/browse/YARN-879) | Fix tests w.r.t o.a.h.y.server.resourcemanager.Application | Major | . | Junping Du | Junping Du |
+| [HADOOP-10031](https://issues.apache.org/jira/browse/HADOOP-10031) | FsShell -get/copyToLocal/moveFromLocal should support Windows local path | Major | fs | Chuan Liu | Chuan Liu |
+| [YARN-1265](https://issues.apache.org/jira/browse/YARN-1265) | Fair Scheduler chokes on unhealthy node reconnect | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza |
+| [HADOOP-10029](https://issues.apache.org/jira/browse/HADOOP-10029) | Specifying har file to MR job fails in secure cluster | Major | fs | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-5335](https://issues.apache.org/jira/browse/HDFS-5335) | DFSOutputStream#close() keeps throwing exceptions when it is called multiple times | Major | . | Arpit Gupta | Haohui Mai |
+| [HADOOP-10039](https://issues.apache.org/jira/browse/HADOOP-10039) | Add Hive to the list of projects using AbstractDelegationTokenSecretManager | Major | security | Suresh Srinivas | Haohui Mai |
+| [YARN-1300](https://issues.apache.org/jira/browse/YARN-1300) | SLS tests fail because conf puts yarn properties in fair-scheduler.xml | Major | . | Ted Yu | Ted Yu |
+| [HDFS-5322](https://issues.apache.org/jira/browse/HDFS-5322) | HDFS delegation token not found in cache errors seen on secure HA clusters | Major | ha | Arpit Gupta | Jing Zhao |
+| [YARN-1044](https://issues.apache.org/jira/browse/YARN-1044) | used/min/max resources do not display info in the scheduler page | Critical | resourcemanager, scheduler | Sangjin Lee | Sangjin Lee |
+| [HDFS-5329](https://issues.apache.org/jira/browse/HDFS-5329) | Update FSNamesystem#getListing() to handle inode path in startAfter token | Major | namenode, nfs | Brandon Li | Brandon Li |
+| [MAPREDUCE-5329](https://issues.apache.org/jira/browse/MAPREDUCE-5329) | APPLICATION\_INIT is never sent to AuxServices other than the builtin ShuffleHandler | Major | mr-am | Avner BenHanoch | Avner BenHanoch |
+| [YARN-305](https://issues.apache.org/jira/browse/YARN-305) | Fair scheduler logs too many "Node offered to app:..." messages | Critical | resourcemanager | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-10040](https://issues.apache.org/jira/browse/HADOOP-10040) | hadoop.cmd in UNIX format and would not run by default on Windows | Major | . | Yingda Chen | Chris Nauroth |
+| [MAPREDUCE-5546](https://issues.apache.org/jira/browse/MAPREDUCE-5546) | mapred.cmd on Windows set HADOOP\_OPTS incorrectly | Major | . | Chuan Liu | Chuan Liu |
+| [YARN-1259](https://issues.apache.org/jira/browse/YARN-1259) | In Fair Scheduler web UI, queue num pending and num active apps switched | Trivial | scheduler | Sandy Ryza | Robert Kanter |
+| [YARN-1182](https://issues.apache.org/jira/browse/YARN-1182) | MiniYARNCluster creates and inits the RM/NM only on start() | Major | . | Karthik Kambatla | Karthik Kambatla |
+| [HDFS-5352](https://issues.apache.org/jira/browse/HDFS-5352) | Server#initLog() doesn't close InputStream in httpfs | Minor | . | Ted Yu | Ted Yu |
+| [MAPREDUCE-5518](https://issues.apache.org/jira/browse/MAPREDUCE-5518) | Fix typo "can't read paritions file" | Trivial | examples | Albert Chu | Albert Chu |
+| [YARN-1295](https://issues.apache.org/jira/browse/YARN-1295) | In UnixLocalWrapperScriptBuilder, using bash -c can cause "Text file busy" errors | Major | nodemanager | Sandy Ryza | Sandy Ryza |
+| [HDFS-5283](https://issues.apache.org/jira/browse/HDFS-5283) | NN not coming out of startup safemode due to under construction blocks only inside snapshots also counted in safemode threshhold | Critical | snapshots | Vinayakumar B | Vinayakumar B |
+| [MAPREDUCE-5585](https://issues.apache.org/jira/browse/MAPREDUCE-5585) | TestCopyCommitter#testNoCommitAction Fails on JDK7 | Major | . | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-5586](https://issues.apache.org/jira/browse/MAPREDUCE-5586) | TestCopyMapper#testCopyFailOnBlockSizeDifference fails when run from hadoop-tools/hadoop-distcp directory | Major | . | Jonathan Eagles | Jonathan Eagles |
+| [HDFS-5370](https://issues.apache.org/jira/browse/HDFS-5370) | Typo in Error Message: different between range in condition and range in error message | Trivial | hdfs-client | Kousuke Saruta | Kousuke Saruta |
+| [HDFS-5346](https://issues.apache.org/jira/browse/HDFS-5346) | Avoid unnecessary call to getNumLiveDataNodes() for each block during IBR processing | Major | namenode, performance | Kihwal Lee | Ravi Prakash |
+| [HDFS-4376](https://issues.apache.org/jira/browse/HDFS-4376) | Fix several race conditions in Balancer and resolve intermittent timeout of TestBalancerWithNodeGroup | Major | balancer & mover | Aaron T. Myers | Junping Du |
| [HDFS-5375](https://issues.apache.org/jira/browse/HDFS-5375) | hdfs.cmd does not expose several snapshot commands. | Minor | tools | Chris Nauroth | Chris Nauroth |
+| [HDFS-5336](https://issues.apache.org/jira/browse/HDFS-5336) | DataNode should not output 'StartupProgress' metrics | Minor | namenode | Akira Ajisaka | Akira Ajisaka |
+| [HADOOP-10055](https://issues.apache.org/jira/browse/HADOOP-10055) | FileSystemShell.apt.vm doc has typo "numRepicas" | Trivial | documentation | Eli Collins | Akira Ajisaka |
| [HDFS-5374](https://issues.apache.org/jira/browse/HDFS-5374) | Remove deadcode in DFSOutputStream | Trivial | . | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-5372](https://issues.apache.org/jira/browse/HDFS-5372) | In FSNamesystem, hasReadLock() returns false if the current thread holds the write lock | Major | namenode | Tsz Wo Nicholas Sze | Vinayakumar B |
-| [HDFS-5370](https://issues.apache.org/jira/browse/HDFS-5370) | Typo in Error Message: different between range in condition and range in error message | Trivial | hdfs-client | Kousuke Saruta | Kousuke Saruta |
| [HDFS-5365](https://issues.apache.org/jira/browse/HDFS-5365) | Fix libhdfs compile error on FreeBSD9 | Major | build, libhdfs | Radim Kolar | Radim Kolar |
-| [HDFS-5353](https://issues.apache.org/jira/browse/HDFS-5353) | Short circuit reads fail when dfs.encrypt.data.transfer is enabled | Blocker | . | Haohui Mai | Colin Patrick McCabe |
-| [HDFS-5352](https://issues.apache.org/jira/browse/HDFS-5352) | Server#initLog() doesn't close InputStream in httpfs | Minor | . | Ted Yu | Ted Yu |
-| [HDFS-5346](https://issues.apache.org/jira/browse/HDFS-5346) | Avoid unnecessary call to getNumLiveDataNodes() for each block during IBR processing | Major | namenode, performance | Kihwal Lee | Ravi Prakash |
-| [HDFS-5343](https://issues.apache.org/jira/browse/HDFS-5343) | When cat command is issued on snapshot files getting unexpected result | Major | hdfs-client | sathish | sathish |
+| [MAPREDUCE-5587](https://issues.apache.org/jira/browse/MAPREDUCE-5587) | TestTextOutputFormat fails on JDK7 | Major | . | Jonathan Eagles | Jonathan Eagles |
+| [HDFS-5276](https://issues.apache.org/jira/browse/HDFS-5276) | FileSystem.Statistics got performance issue on multi-thread read/write. | Major | . | Chengxiang Li | Colin P. McCabe |
+| [YARN-1288](https://issues.apache.org/jira/browse/YARN-1288) | Make Fair Scheduler ACLs more user friendly | Major | scheduler | Sandy Ryza | Sandy Ryza |
+| [YARN-1331](https://issues.apache.org/jira/browse/YARN-1331) | yarn.cmd exits with NoClassDefFoundError trying to run rmadmin or logs | Trivial | client | Chris Nauroth | Chris Nauroth |
+| [YARN-1315](https://issues.apache.org/jira/browse/YARN-1315) | TestQueueACLs should also test FairScheduler | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza |
+| [HDFS-5400](https://issues.apache.org/jira/browse/HDFS-5400) | DFS\_CLIENT\_MMAP\_CACHE\_THREAD\_RUNS\_PER\_TIMEOUT constant is set to the wrong value | Major | . | Colin P. McCabe | Colin P. McCabe |
+| [MAPREDUCE-5561](https://issues.apache.org/jira/browse/MAPREDUCE-5561) | org.apache.hadoop.mapr
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[28/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.0/RELEASENOTES.0.23.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.0/RELEASENOTES.0.23.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.0/RELEASENOTES.0.23.0.md
index 69e364f..3e3ef45 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.0/RELEASENOTES.0.23.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.0/RELEASENOTES.0.23.0.md
@@ -23,201 +23,198 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-7740](https://issues.apache.org/jira/browse/HADOOP-7740) | *Minor* | **security audit logger is not on by default, fix the log4j properties to enable the logger**
+* [HADOOP-6683](https://issues.apache.org/jira/browse/HADOOP-6683) | *Minor* | **the first optimization: ZlibCompressor does not fully utilize the buffer**
-Fixed security audit logger configuration. (Arpit Gupta via Eric Yang)
+Improve the buffer utilization of ZlibCompressor to avoid invoking a JNI per write request.
---
-* [HADOOP-7728](https://issues.apache.org/jira/browse/HADOOP-7728) | *Major* | **hadoop-setup-conf.sh should be modified to enable task memory manager**
+* [HADOOP-7023](https://issues.apache.org/jira/browse/HADOOP-7023) | *Major* | **Add listCorruptFileBlocks to FileSystem**
-Enable task memory management to be configurable via hadoop config setup script.
+Add a new API listCorruptFileBlocks to FIleContext that returns a list of files that have corrupt blocks.
---
-* [HADOOP-7724](https://issues.apache.org/jira/browse/HADOOP-7724) | *Major* | **hadoop-setup-conf.sh should put proxy user info into the core-site.xml**
+* [HADOOP-7059](https://issues.apache.org/jira/browse/HADOOP-7059) | *Major* | **Remove "unused" warning in native code**
-Fixed hadoop-setup-conf.sh to put proxy user in core-site.xml. (Arpit Gupta via Eric Yang)
+Adds \_\_attribute\_\_ ((unused))
---
-* [HADOOP-7720](https://issues.apache.org/jira/browse/HADOOP-7720) | *Major* | **improve the hadoop-setup-conf.sh to read in the hbase user and setup the configs**
+* [HDFS-1526](https://issues.apache.org/jira/browse/HDFS-1526) | *Major* | **Dfs client name for a map/reduce task should have some randomness**
-Added parameter for HBase user to setup config script. (Arpit Gupta via Eric Yang)
+Make a client name has this format: DFSClient\_applicationid\_randomint\_threadid, where applicationid = mapred.task.id or else = "NONMAPREDUCE".
---
-* [HADOOP-7715](https://issues.apache.org/jira/browse/HADOOP-7715) | *Major* | **see log4j Error when running mr jobs and certain dfs calls**
+* [HDFS-1560](https://issues.apache.org/jira/browse/HDFS-1560) | *Minor* | **dfs.data.dir permissions should default to 700**
-Removed unnecessary security logger configuration. (Eric Yang)
+The permissions on datanode data directories (configured by dfs.datanode.data.dir.perm) now default to 0700. Upon startup, the datanode will automatically change the permissions to match the configured value.
---
-* [HADOOP-7711](https://issues.apache.org/jira/browse/HADOOP-7711) | *Major* | **hadoop-env.sh generated from templates has duplicate info**
+* [MAPREDUCE-1906](https://issues.apache.org/jira/browse/MAPREDUCE-1906) | *Major* | **Lower default minimum heartbeat interval for tasktracker \> Jobtracker**
-Fixed recursive sourcing of HADOOP\_OPTS environment variables (Arpit Gupta via Eric Yang)
+The default minimum heartbeat interval has been dropped from 3 seconds to 300ms to increase scheduling throughput on small clusters. Users may tune mapreduce.jobtracker.heartbeats.in.second to adjust this value.
---
-* [HADOOP-7708](https://issues.apache.org/jira/browse/HADOOP-7708) | *Critical* | **config generator does not update the properties file if on exists already**
+* [MAPREDUCE-2207](https://issues.apache.org/jira/browse/MAPREDUCE-2207) | *Major* | **Task-cleanup task should not be scheduled on the node that the task just failed**
-Fixed hadoop-setup-conf.sh to handle config file consistently. (Eric Yang)
+Task-cleanup task should not be scheduled on the node that the task just failed
---
-* [HADOOP-7707](https://issues.apache.org/jira/browse/HADOOP-7707) | *Major* | **improve config generator to allow users to specify proxy user, turn append on or off, turn webhdfs on or off**
+* [HDFS-1536](https://issues.apache.org/jira/browse/HDFS-1536) | *Major* | **Improve HDFS WebUI**
-Added toggle for dfs.support.append, webhdfs and hadoop proxy user to setup config script. (Arpit Gupta via Eric Yang)
+On web UI, missing block number now becomes accurate and under-replicated blocks do not include missing blocks.
---
-* [HADOOP-7691](https://issues.apache.org/jira/browse/HADOOP-7691) | *Major* | **hadoop deb pkg should take a diff group id**
+* [HADOOP-7089](https://issues.apache.org/jira/browse/HADOOP-7089) | *Minor* | **Fix link resolution logic in hadoop-config.sh**
-Fixed conflict uid for install packages. (Eric Yang)
+Updates hadoop-config.sh to always resolve symlinks when determining HADOOP\_HOME. Bash built-ins or POSIX:2001 compliant cmds are now required.
---
-* [HADOOP-7684](https://issues.apache.org/jira/browse/HADOOP-7684) | *Major* | **jobhistory server and secondarynamenode should have init.d script**
+* [HDFS-1547](https://issues.apache.org/jira/browse/HDFS-1547) | *Major* | **Improve decommission mechanism**
-Added init.d script for jobhistory server and secondary namenode. (Eric Yang)
+Summary of changes to the decommissioning process:
+# After nodes are decommissioned, they are not shutdown. The decommissioned nodes are not used for writes. For reads, the decommissioned nodes are given as the last location to read from.
+# Number of live and dead decommissioned nodes are displayed in the namenode webUI.
+# Decommissioned nodes free capacity is not count towards the the cluster free capacity.
---
-* [HADOOP-7681](https://issues.apache.org/jira/browse/HADOOP-7681) | *Minor* | **log4j.properties is missing properties for security audit and hdfs audit should be changed to info**
-
-HADOOP-7681. Fixed security and hdfs audit log4j properties
-(Arpit Gupta via Eric Yang)
-
+* [HDFS-1448](https://issues.apache.org/jira/browse/HDFS-1448) | *Major* | **Create multi-format parser for edits logs file, support binary and XML formats initially**
----
+Offline edits viewer feature adds oev tool to hdfs script. Oev makes it possible to convert edits logs to/from native binary and XML formats. It uses the same framework as Offline image viewer.
-* [HADOOP-7668](https://issues.apache.org/jira/browse/HADOOP-7668) | *Minor* | **Add a NetUtils method that can tell if an InetAddress belongs to local host**
+Example usage:
-closing again
+$HADOOP\_HOME/bin/hdfs oev -i edits -o output.xml
---
-* [HADOOP-7655](https://issues.apache.org/jira/browse/HADOOP-7655) | *Major* | **provide a small validation script that smoke tests the installed cluster**
+* [HADOOP-6864](https://issues.apache.org/jira/browse/HADOOP-6864) | *Major* | **Provide a JNI-based implementation of ShellBasedUnixGroupsNetgroupMapping (implementation of GroupMappingServiceProvider)**
-Committed to trunk and v23, since code reviewed by Eric.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-7603](https://issues.apache.org/jira/browse/HADOOP-7603) | *Major* | **Set default hdfs, mapred uid, and hadoop group gid for RPM packages**
+* [HADOOP-6904](https://issues.apache.org/jira/browse/HADOOP-6904) | *Major* | **A baby step towards inter-version RPC communications**
-Set hdfs uid, mapred uid, and hadoop gid to fixed numbers (201, 202, and 123, respectively).
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-7547](https://issues.apache.org/jira/browse/HADOOP-7547) | *Minor* | **Fix the warning in writable classes.[ WritableComparable is a raw type. References to generic type WritableComparable\<T\> should be parameterized ]**
+* [HADOOP-6436](https://issues.apache.org/jira/browse/HADOOP-6436) | *Major* | **Remove auto-generated native build files**
-**WARNING: No release note provided for this incompatible change.**
+The native build run when from trunk now requires autotools, libtool and openssl dev libraries.
---
-* [HADOOP-7507](https://issues.apache.org/jira/browse/HADOOP-7507) | *Major* | **jvm metrics all use the same namespace**
+* [MAPREDUCE-2260](https://issues.apache.org/jira/browse/MAPREDUCE-2260) | *Major* | **Remove auto-generated native build files**
-JVM metrics published to Ganglia now include the process name as part of the gmetric name.
+The native build run when from trunk now requires autotools, libtool and openssl dev libraries.
---
-* [HADOOP-7379](https://issues.apache.org/jira/browse/HADOOP-7379) | *Major* | **Add ability to include Protobufs in ObjectWritable**
+* [HDFS-1582](https://issues.apache.org/jira/browse/HDFS-1582) | *Major* | **Remove auto-generated native build files**
-Protocol buffer-generated types may now be used as arguments or return values for Hadoop RPC.
+The native build run when from trunk now requires autotools, libtool and openssl dev libraries.
---
-* [HADOOP-7374](https://issues.apache.org/jira/browse/HADOOP-7374) | *Major* | **Don't add tools.jar to the classpath when running Hadoop**
+* [HADOOP-6432](https://issues.apache.org/jira/browse/HADOOP-6432) | *Major* | **Statistics support in FileContext**
-The scripts that run Hadoop no longer automatically add tools.jar from the JDK to the classpath (if it is present). If your job depends on tools.jar in the JDK you will need to add this dependency in your job.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-7331](https://issues.apache.org/jira/browse/HADOOP-7331) | *Trivial* | **Make hadoop-daemon.sh to return 1 if daemon processes did not get started**
+* [HADOOP-7136](https://issues.apache.org/jira/browse/HADOOP-7136) | *Major* | **Remove failmon contrib**
-hadoop-daemon.sh now returns a non-zero exit code if it detects that the daemon was not still running after 3 seconds.
+Failmon removed from contrib codebase.
---
-* [HADOOP-7322](https://issues.apache.org/jira/browse/HADOOP-7322) | *Minor* | **Adding a util method in FileUtil for JDK File.listFiles**
+* [MAPREDUCE-2254](https://issues.apache.org/jira/browse/MAPREDUCE-2254) | *Major* | **Allow setting of end-of-record delimiter for TextInputFormat**
-Use of this new utility method avoids null result from File.listFiles(), and consequent NPEs.
+TextInputFormat may now split lines with delimiters other than newline, by specifying a configuration parameter "textinputformat.record.delimiter"
---
-* [HADOOP-7305](https://issues.apache.org/jira/browse/HADOOP-7305) | *Minor* | **Eclipse project files are incomplete**
+* [HADOOP-7153](https://issues.apache.org/jira/browse/HADOOP-7153) | *Minor* | **MapWritable violates contract of Map interface for equals() and hashCode()**
-Added missing library during creation of the eclipse project files.
+MapWritable now implements equals() and hashCode() based on the map contents rather than object identity in order to correctly implement the Map interface.
---
-* [HADOOP-7286](https://issues.apache.org/jira/browse/HADOOP-7286) | *Major* | **Refactor FsShell's du/dus/df**
+* [MAPREDUCE-1996](https://issues.apache.org/jira/browse/MAPREDUCE-1996) | *Trivial* | **API: Reducer.reduce() method detail misstatement**
-The "Found X items" header on the output of the "du" command has been removed to more closely match unix. The displayed paths now correspond to the command line arguments instead of always being a fully qualified URI. For example, the output will have relative paths if the command line arguments are relative paths.
+Fix a misleading documentation note about the usage of Reporter objects in Reducers.
---
-* [HADOOP-7264](https://issues.apache.org/jira/browse/HADOOP-7264) | *Major* | **Bump avro version to at least 1.4.1**
+* [MAPREDUCE-1159](https://issues.apache.org/jira/browse/MAPREDUCE-1159) | *Trivial* | **Limit Job name on jobtracker.jsp to be 80 char long**
-**WARNING: No release note provided for this incompatible change.**
+Job names on jobtracker.jsp should be 80 characters long at most.
---
-* [HADOOP-7257](https://issues.apache.org/jira/browse/HADOOP-7257) | *Major* | **A client side mount table to give per-application/per-job file system view**
+* [HDFS-1626](https://issues.apache.org/jira/browse/HDFS-1626) | *Minor* | **Make BLOCK\_INVALIDATE\_LIMIT configurable**
-viewfs - client-side mount table.
+Added a new configuration property dfs.block.invalidate.limit for FSNamesystem.blockInvalidateLimit.
---
-* [HADOOP-7227](https://issues.apache.org/jira/browse/HADOOP-7227) | *Major* | **Remove protocol version check at proxy creation in Hadoop RPC.**
+* [MAPREDUCE-2225](https://issues.apache.org/jira/browse/MAPREDUCE-2225) | *Blocker* | **MultipleOutputs should not require the use of 'Writable'**
-1. Protocol version check is removed from proxy creation, instead version check is performed at server in every rpc call.
-2. This change is backward incompatible because format of the rpc messages is changed to include client version, client method hash and rpc version.
-3. rpc version is introduced which should change when the format of rpc messages is changed.
+MultipleOutputs should not require the use/check of 'Writable' interfaces in key and value classes.
---
-* [HADOOP-7193](https://issues.apache.org/jira/browse/HADOOP-7193) | *Minor* | **Help message is wrong for touchz command.**
+* [MAPREDUCE-1811](https://issues.apache.org/jira/browse/MAPREDUCE-1811) | *Minor* | **Job.monitorAndPrintJob() should print status of the job at completion**
-Updated the help for the touchz command.
+Print the resultant status of a Job on completion instead of simply saying 'Complete'.
---
-* [HADOOP-7153](https://issues.apache.org/jira/browse/HADOOP-7153) | *Minor* | **MapWritable violates contract of Map interface for equals() and hashCode()**
+* [MAPREDUCE-993](https://issues.apache.org/jira/browse/MAPREDUCE-993) | *Minor* | **bin/hadoop job -events \<jobid\> \<from-event-#\> \<#-of-events\> help message is confusing**
-MapWritable now implements equals() and hashCode() based on the map contents rather than object identity in order to correctly implement the Map interface.
+Added a helpful description message to the \`mapred job -events\` command.
---
-* [HADOOP-7136](https://issues.apache.org/jira/browse/HADOOP-7136) | *Major* | **Remove failmon contrib**
+* [MAPREDUCE-1242](https://issues.apache.org/jira/browse/MAPREDUCE-1242) | *Trivial* | **Chain APIs error misleading**
-Failmon removed from contrib codebase.
+Fix a misleading exception message in case the Chained Mappers have mismatch in input/output Key/Value pairs between them.
---
@@ -229,37 +226,37 @@ This is the COMMON portion of a fix requiring coordinated change of COMMON and H
---
-* [HADOOP-7119](https://issues.apache.org/jira/browse/HADOOP-7119) | *Major* | **add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles**
+* [HDFS-1703](https://issues.apache.org/jira/browse/HDFS-1703) | *Minor* | **HDFS federation: Improve start/stop scripts and add script to decommission datanodes**
-Adding support for Kerberos HTTP SPNEGO authentication to the Hadoop web-consoles
+The masters file is no longer used to indicate which hosts to start the 2NN on. The 2NN is now started on hosts when dfs.namenode.secondary.http-address is configured with a non-wildcard IP.
---
-* [HADOOP-7117](https://issues.apache.org/jira/browse/HADOOP-7117) | *Major* | **Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml**
+* [HDFS-1675](https://issues.apache.org/jira/browse/HDFS-1675) | *Major* | **Transfer RBW between datanodes**
-Removed references to the older fs.checkpoint.\* properties that resided in core-site.xml
+Added a new stage TRANSFER\_RBW to DataTransferProtocol
---
-* [HADOOP-7089](https://issues.apache.org/jira/browse/HADOOP-7089) | *Minor* | **Fix link resolution logic in hadoop-config.sh**
+* [HDFS-1596](https://issues.apache.org/jira/browse/HDFS-1596) | *Major* | **Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml**
-Updates hadoop-config.sh to always resolve symlinks when determining HADOOP\_HOME. Bash built-ins or POSIX:2001 compliant cmds are now required.
+Removed references to the older fs.checkpoint.\* properties that resided in core-site.xml
---
-* [HADOOP-7059](https://issues.apache.org/jira/browse/HADOOP-7059) | *Major* | **Remove "unused" warning in native code**
+* [HADOOP-7117](https://issues.apache.org/jira/browse/HADOOP-7117) | *Major* | **Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml**
-Adds \_\_attribute\_\_ ((unused))
+Removed references to the older fs.checkpoint.\* properties that resided in core-site.xml
---
-* [HADOOP-7023](https://issues.apache.org/jira/browse/HADOOP-7023) | *Major* | **Add listCorruptFileBlocks to FileSystem**
+* [HDFS-1445](https://issues.apache.org/jira/browse/HDFS-1445) | *Major* | **Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file**
-Add a new API listCorruptFileBlocks to FIleContext that returns a list of files that have corrupt blocks.
+Batch hardlinking during "upgrade" snapshots, cutting time from aprx 8 minutes per volume to aprx 8 seconds. Validated in both Linux and Windows. Depends on prior integration with patch for HADOOP-7133.
---
@@ -272,904 +269,907 @@ Introduces ArrayPrimitiveWritable for a much more efficient wire format to trans
---
-* [HADOOP-6921](https://issues.apache.org/jira/browse/HADOOP-6921) | *Major* | **metrics2: metrics plugins**
+* [HADOOP-7193](https://issues.apache.org/jira/browse/HADOOP-7193) | *Minor* | **Help message is wrong for touchz command.**
-Metrics names are standardized to CapitalizedCamelCase. See release note of HADOOP-6918 and HADOOP-6920.
+Updated the help for the touchz command.
---
-* [HADOOP-6920](https://issues.apache.org/jira/browse/HADOOP-6920) | *Major* | **Metrics2: metrics instrumentation**
+* [HDFS-1120](https://issues.apache.org/jira/browse/HDFS-1120) | *Major* | **Make DataNode's block-to-device placement policy pluggable**
-Metrics names are standardized to use CapitalizedCamelCase. Some examples of this is:
-# Metrics names using "\_" is changed to new naming scheme. Eg: bytes\_written changes to BytesWritten.
-# All metrics names start with capitals. Example: threadsBlocked changes to ThreadsBlocked.
+Make the DataNode's block-volume choosing policy pluggable.
---
-* [HADOOP-6919](https://issues.apache.org/jira/browse/HADOOP-6919) | *Major* | **Metrics2: metrics framework**
+* [HDFS-1761](https://issues.apache.org/jira/browse/HDFS-1761) | *Major* | **Add a new DataTransferProtocol operation, Op.TRANSFER\_BLOCK, instead of using RPC**
-New metrics2 framework for Hadoop.
+Add a new DataTransferProtocol operation, Op.TRANSFER\_BLOCK, for transferring RBW/Finalized with acknowledgement and without using RPC.
---
-* [HADOOP-6904](https://issues.apache.org/jira/browse/HADOOP-6904) | *Major* | **A baby step towards inter-version RPC communications**
+* [MAPREDUCE-2405](https://issues.apache.org/jira/browse/MAPREDUCE-2405) | *Major* | **MR-279: Implement uber-AppMaster (in-cluster LocalJobRunner for MRv2)**
-**WARNING: No release note provided for this incompatible change.**
+An efficient implementation of small jobs by running all tasks in the MR ApplicationMaster JVM, there-by affecting lower latency.
---
-* [HADOOP-6864](https://issues.apache.org/jira/browse/HADOOP-6864) | *Major* | **Provide a JNI-based implementation of ShellBasedUnixGroupsNetgroupMapping (implementation of GroupMappingServiceProvider)**
+* [HDFS-1606](https://issues.apache.org/jira/browse/HDFS-1606) | *Major* | **Provide a stronger data guarantee in the write pipeline**
-**WARNING: No release note provided for this incompatible change.**
+Added two configuration properties, dfs.client.block.write.replace-datanode-on-failure.enable and dfs.client.block.write.replace-datanode-on-failure.policy. Added a new feature to replace datanode on failure in DataTransferProtocol. Added getAdditionalDatanode(..) in ClientProtocol.
---
-* [HADOOP-6683](https://issues.apache.org/jira/browse/HADOOP-6683) | *Minor* | **the first optimization: ZlibCompressor does not fully utilize the buffer**
+* [HDFS-1070](https://issues.apache.org/jira/browse/HDFS-1070) | *Major* | **Speedup NameNode image loading and saving by storing local file names**
-Improve the buffer utilization of ZlibCompressor to avoid invoking a JNI per write request.
+This changes the fsimage format to be
+root directory-1 directory-2 ... directoy-n.
+Each directory stores all its children in the following format:
+Directory\_full\_path\_name num\_of\_children child-1 ... child-n.
+Each inode stores only the last component of its path name into fsimage.
+This change requires an upgrade at deployment.
---
-* [HADOOP-6436](https://issues.apache.org/jira/browse/HADOOP-6436) | *Major* | **Remove auto-generated native build files**
+* [HDFS-1594](https://issues.apache.org/jira/browse/HDFS-1594) | *Major* | **When the disk becomes full Namenode is getting shutdown and not able to recover**
-The native build run when from trunk now requires autotools, libtool and openssl dev libraries.
+Implemented a daemon thread to monitor the disk usage for periodically and if the disk usage reaches the threshold value, put the name node into Safe mode so that no modification to file system will occur. Once the disk usage reaches below the threshold, name node will be put out of the safe mode. Here threshold value and interval to check the disk usage are configurable.
---
-* [HADOOP-6432](https://issues.apache.org/jira/browse/HADOOP-6432) | *Major* | **Statistics support in FileContext**
+* [HDFS-1843](https://issues.apache.org/jira/browse/HDFS-1843) | *Minor* | **Discover file not found early for file append**
-**WARNING: No release note provided for this incompatible change.**
+I have committed this. Thanks to Bharath!
---
-* [HADOOP-6385](https://issues.apache.org/jira/browse/HADOOP-6385) | *Minor* | **dfs does not support -rmdir (was HDFS-639)**
+* [MAPREDUCE-1461](https://issues.apache.org/jira/browse/MAPREDUCE-1461) | *Major* | **Feature to instruct rumen-folder utility to skip jobs worth of specific duration**
-The "rm" family of FsShell commands now supports -rmdir and -f options.
+Added a ''-starts-after' option to Rumen's Folder utility. The time duration specified after the '-starts-after' option is an offset with respect to the submit time of the first job in the input trace. Jobs in the input trace having a submit time (relative to the first job's submit time) lesser than the specified offset will be ignored.
---
-* [HADOOP-6255](https://issues.apache.org/jira/browse/HADOOP-6255) | *Major* | **Create an rpm integration project**
+* [MAPREDUCE-2153](https://issues.apache.org/jira/browse/MAPREDUCE-2153) | *Major* | **Bring in more job configuration properties in to the trace file**
-Added RPM/DEB packages to build system.
+Adds job configuration parameters to the job trace. The configuration parameters are stored under the 'jobProperties' field as key-value pairs.
---
-* [HADOOP-5647](https://issues.apache.org/jira/browse/HADOOP-5647) | *Major* | **TestJobHistory fails if /tmp/\_logs is not writable to. Testcase should not depend on /tmp**
+* [MAPREDUCE-2417](https://issues.apache.org/jira/browse/MAPREDUCE-2417) | *Major* | **In Gridmix, in RoundRobinUserResolver mode, the testing/proxy users are not associated with unique users in a trace**
-Removed dependency of testcase on /tmp and made it to use test.build.data directory instead.
+Fixes Gridmix in RoundRobinUserResolver mode to map testing/proxy users to unique users in a trace.
---
-* [HADOOP-2081](https://issues.apache.org/jira/browse/HADOOP-2081) | *Major* | **Configuration getInt, getLong, and getFloat replace invalid numbers with the default value**
+* [MAPREDUCE-2416](https://issues.apache.org/jira/browse/MAPREDUCE-2416) | *Major* | **In Gridmix, in RoundRobinUserResolver, the list of groups for a user obtained from users-list-file is incorrect**
-Invalid configuration values now result in a number format exception rather than the default value being used.
+Removes the restriction of specifying group names in users-list file for Gridmix in RoundRobinUserResolver mode.
---
-* [HDFS-2465](https://issues.apache.org/jira/browse/HDFS-2465) | *Major* | **Add HDFS support for fadvise readahead and drop-behind**
+* [MAPREDUCE-2434](https://issues.apache.org/jira/browse/MAPREDUCE-2434) | *Major* | **MR-279: ResourceManager metrics**
-HDFS now has the ability to use posix\_fadvise and sync\_data\_range syscalls to manage the OS buffer cache. This support is currently considered experimental, and may be enabled by configuring the following keys:
-dfs.datanode.drop.cache.behind.writes - set to true to drop data out of the buffer cache after writing
-dfs.datanode.drop.cache.behind.reads - set to true to drop data out of the buffer cache when performing sequential reads
-dfs.datanode.sync.behind.writes - set to true to trigger dirty page writeback immediately after writing data
-dfs.datanode.readahead.bytes - set to a non-zero value to trigger readahead for sequential reads
+I just committed this. Thanks Luke!
---
-* [HDFS-2355](https://issues.apache.org/jira/browse/HDFS-2355) | *Major* | **Federation: enable using the same configuration file across all the nodes in the cluster.**
+* [MAPREDUCE-1978](https://issues.apache.org/jira/browse/MAPREDUCE-1978) | *Major* | **[Rumen] TraceBuilder should provide recursive input folder scanning**
-This change allows when running multiple namenodes on different hosts, sharing the same configuration file across all the nodes in the cluster (Datanodes, NamNode, BackupNode, SecondaryNameNode), without the need to define dfs.federation.nameservice.id parameter.
+Adds -recursive option to TraceBuilder for scanning the input directories recursively.
---
-* [HDFS-2338](https://issues.apache.org/jira/browse/HDFS-2338) | *Major* | **Configuration option to enable/disable webhdfs.**
+* [HADOOP-7227](https://issues.apache.org/jira/browse/HADOOP-7227) | *Major* | **Remove protocol version check at proxy creation in Hadoop RPC.**
-Added a conf property dfs.webhdfs.enabled for enabling/disabling webhdfs.
+1. Protocol version check is removed from proxy creation, instead version check is performed at server in every rpc call.
+2. This change is backward incompatible because format of the rpc messages is changed to include client version, client method hash and rpc version.
+3. rpc version is introduced which should change when the format of rpc messages is changed.
---
-* [HDFS-2318](https://issues.apache.org/jira/browse/HDFS-2318) | *Major* | **Provide authentication to webhdfs using SPNEGO**
+* [MAPREDUCE-2474](https://issues.apache.org/jira/browse/MAPREDUCE-2474) | *Minor* | **Add docs to the new API Partitioner on how to access Job Configuration data**
-Added two new conf properties dfs.web.authentication.kerberos.principal and dfs.web.authentication.kerberos.keytab for the SPNEGO servlet filter.
+Improve the Partitioner interface's docs to help fetch Job Configuration objects.
---
-* [HDFS-2210](https://issues.apache.org/jira/browse/HDFS-2210) | *Major* | **Remove hdfsproxy**
+* [HADOOP-6919](https://issues.apache.org/jira/browse/HADOOP-6919) | *Major* | **Metrics2: metrics framework**
-The hdfsproxy contrib component is no longer supported.
+New metrics2 framework for Hadoop.
---
-* [HDFS-2202](https://issues.apache.org/jira/browse/HDFS-2202) | *Major* | **Changes to balancer bandwidth should not require datanode restart.**
-
-New dfsadmin command added: [-setBalancerBandwidth \<bandwidth\>] where bandwidth is max network bandwidth in bytes per second that the balancer is allowed to use on each datanode during balacing.
+* [HDFS-1826](https://issues.apache.org/jira/browse/HDFS-1826) | *Major* | **NameNode should save image to name directories in parallel during upgrade**
-This is an incompatible change in 0.23. The versions of ClientProtocol and DatanodeProtocol are changed.
+I've committed this. Thanks, Matt!
---
-* [HDFS-2107](https://issues.apache.org/jira/browse/HDFS-2107) | *Major* | **Move block management code to a package**
+* [MAPREDUCE-2478](https://issues.apache.org/jira/browse/MAPREDUCE-2478) | *Major* | **MR 279: Improve history server**
-Moved block management codes to a new package org.apache.hadoop.hdfs.server.blockmanagement.
+Looks great. I just committed this. Thanks Siddharth!
---
-* [HDFS-2087](https://issues.apache.org/jira/browse/HDFS-2087) | *Major* | **Add methods to DataTransferProtocol interface**
+* [HADOOP-7257](https://issues.apache.org/jira/browse/HADOOP-7257) | *Major* | **A client side mount table to give per-application/per-job file system view**
-Declare methods in DataTransferProtocol interface, and change Sender and Receiver to implement the interface.
+viewfs - client-side mount table.
---
-* [HDFS-2066](https://issues.apache.org/jira/browse/HDFS-2066) | *Major* | **Create a package and individual class files for DataTransferProtocol**
+* [HADOOP-6920](https://issues.apache.org/jira/browse/HADOOP-6920) | *Major* | **Metrics2: metrics instrumentation**
-**WARNING: No release note provided for this incompatible change.**
+Metrics names are standardized to use CapitalizedCamelCase. Some examples of this is:
+# Metrics names using "\_" is changed to new naming scheme. Eg: bytes\_written changes to BytesWritten.
+# All metrics names start with capitals. Example: threadsBlocked changes to ThreadsBlocked.
---
-* [HDFS-2058](https://issues.apache.org/jira/browse/HDFS-2058) | *Major* | **DataTransfer Protocol using protobufs**
+* [HADOOP-6921](https://issues.apache.org/jira/browse/HADOOP-6921) | *Major* | **metrics2: metrics plugins**
-**WARNING: No release note provided for this incompatible change.**
+Metrics names are standardized to CapitalizedCamelCase. See release note of HADOOP-6918 and HADOOP-6920.
---
-* [HDFS-2055](https://issues.apache.org/jira/browse/HDFS-2055) | *Major* | **Add hflush support to libhdfs**
+* [HDFS-1814](https://issues.apache.org/jira/browse/HDFS-1814) | *Major* | **HDFS portion of HADOOP-7214 - Hadoop /usr/bin/groups equivalent**
-Add hdfsHFlush to libhdfs.
+Introduces a new command, "hdfs groups", which displays what groups are associated with a user as seen by the NameNode.
---
-* [HDFS-1966](https://issues.apache.org/jira/browse/HDFS-1966) | *Major* | **Encapsulate individual DataTransferProtocol op header**
+* [MAPREDUCE-2473](https://issues.apache.org/jira/browse/MAPREDUCE-2473) | *Major* | **MR portion of HADOOP-7214 - Hadoop /usr/bin/groups equivalent**
-Added header classes for individual DataTransferProtocol op headers.
+Introduces a new command, "mapred groups", which displays what groups are associated with a user as seen by the JobTracker.
---
-* [HDFS-1963](https://issues.apache.org/jira/browse/HDFS-1963) | *Major* | **HDFS rpm integration project**
+* [HDFS-1917](https://issues.apache.org/jira/browse/HDFS-1917) | *Major* | **Clean up duplication of dependent jar files**
-Create HDFS RPM package
+Remove packaging of duplicated third party jar files
---
-* [HDFS-1945](https://issues.apache.org/jira/browse/HDFS-1945) | *Major* | **Removed deprecated fields in DataTransferProtocol**
+* [HDFS-1117](https://issues.apache.org/jira/browse/HDFS-1117) | *Major* | **HDFS portion of HADOOP-6728 (ovehaul metrics framework)**
-Removed the deprecated fields in DataTransferProtocol.
+Metrics names are standardized to use CapitalizedCamelCase. Some examples:
+# Metrics names using "\_" is changed to new naming scheme. Eg: bytes\_written changes to BytesWritten.
+# All metrics names start with capitals. Example: threadsBlocked changes to ThreadsBlocked.
---
-* [HDFS-1939](https://issues.apache.org/jira/browse/HDFS-1939) | *Major* | **ivy: test conf should not extend common conf**
+* [HDFS-1945](https://issues.apache.org/jira/browse/HDFS-1945) | *Major* | **Removed deprecated fields in DataTransferProtocol**
-\* Removed duplicated jars in test class path.
+Removed the deprecated fields in DataTransferProtocol.
---
-* [HDFS-1917](https://issues.apache.org/jira/browse/HDFS-1917) | *Major* | **Clean up duplication of dependent jar files**
+* [HADOOP-7286](https://issues.apache.org/jira/browse/HADOOP-7286) | *Major* | **Refactor FsShell's du/dus/df**
-Remove packaging of duplicated third party jar files
+The "Found X items" header on the output of the "du" command has been removed to more closely match unix. The displayed paths now correspond to the command line arguments instead of always being a fully qualified URI. For example, the output will have relative paths if the command line arguments are relative paths.
---
-* [HDFS-1869](https://issues.apache.org/jira/browse/HDFS-1869) | *Major* | **mkdirs should use the supplied permission for all of the created directories**
+* [HDFS-1939](https://issues.apache.org/jira/browse/HDFS-1939) | *Major* | **ivy: test conf should not extend common conf**
-A multi-level mkdir is now POSIX compliant. Instead of creating intermediate directories with the permissions of the parent directory, intermediate directories are created with permission bits of rwxrwxrwx (0777) as modified by the current umask, plus write and search permission for the owner.
+\* Removed duplicated jars in test class path.
---
-* [HDFS-1843](https://issues.apache.org/jira/browse/HDFS-1843) | *Minor* | **Discover file not found early for file append**
+* [MAPREDUCE-2483](https://issues.apache.org/jira/browse/MAPREDUCE-2483) | *Major* | **Clean up duplication of dependent jar files**
-I have committed this. Thanks to Bharath!
+Removed duplicated hadoop-common library dependencies.
---
-* [HDFS-1826](https://issues.apache.org/jira/browse/HDFS-1826) | *Major* | **NameNode should save image to name directories in parallel during upgrade**
+* [MAPREDUCE-2407](https://issues.apache.org/jira/browse/MAPREDUCE-2407) | *Major* | **Make Gridmix emulate usage of Distributed Cache files**
-I've committed this. Thanks, Matt!
+Makes Gridmix emulate HDFS based distributed cache files and local file system based distributed cache files.
---
-* [HDFS-1814](https://issues.apache.org/jira/browse/HDFS-1814) | *Major* | **HDFS portion of HADOOP-7214 - Hadoop /usr/bin/groups equivalent**
+* [MAPREDUCE-2492](https://issues.apache.org/jira/browse/MAPREDUCE-2492) | *Major* | **[MAPREDUCE] The new MapReduce API should make available task's progress to the task**
-Introduces a new command, "hdfs groups", which displays what groups are associated with a user as seen by the NameNode.
+Map and Reduce task can access the attempt's overall progress via TaskAttemptContext.
---
-* [HDFS-1761](https://issues.apache.org/jira/browse/HDFS-1761) | *Major* | **Add a new DataTransferProtocol operation, Op.TRANSFER\_BLOCK, instead of using RPC**
+* [HADOOP-7322](https://issues.apache.org/jira/browse/HADOOP-7322) | *Minor* | **Adding a util method in FileUtil for JDK File.listFiles**
-Add a new DataTransferProtocol operation, Op.TRANSFER\_BLOCK, for transferring RBW/Finalized with acknowledgement and without using RPC.
+Use of this new utility method avoids null result from File.listFiles(), and consequent NPEs.
---
-* [HDFS-1723](https://issues.apache.org/jira/browse/HDFS-1723) | *Minor* | **quota errors messages should use the same scale**
+* [MAPREDUCE-2137](https://issues.apache.org/jira/browse/MAPREDUCE-2137) | *Major* | **Mapping between Gridmix jobs and the corresponding original MR jobs is needed**
-Updated the Quota exceptions to now use human readable output.
+New configuration properties gridmix.job.original-job-id and gridmix.job.original-job-name in the configuration of simulated job are exposed/documented to gridmix user for mapping between original cluster's jobs and simulated jobs.
---
-* [HDFS-1703](https://issues.apache.org/jira/browse/HDFS-1703) | *Minor* | **HDFS federation: Improve start/stop scripts and add script to decommission datanodes**
+* [MAPREDUCE-2408](https://issues.apache.org/jira/browse/MAPREDUCE-2408) | *Major* | **Make Gridmix emulate usage of data compression**
-The masters file is no longer used to indicate which hosts to start the 2NN on. The 2NN is now started on hosts when dfs.namenode.secondary.http-address is configured with a non-wildcard IP.
+Emulates the MapReduce compression feature in Gridmix. By default, compression emulation is turned on. Compression emulation can be disabled by setting 'gridmix.compression-emulation.enable' to 'false'. Use 'gridmix.compression-emulation.map-input.decompression-ratio', 'gridmix.compression-emulation.map-output.compression-ratio' and 'gridmix.compression-emulation.reduce-output.compression-ratio' to configure the compression ratios at map input, map output and reduce output side respectively. Currently, compression ratios in the range [0.07, 0.68] are supported. Gridmix auto detects whether map-input, map output and reduce output should emulate compression based on original job's compression related configuration parameters.
---
-* [HDFS-1675](https://issues.apache.org/jira/browse/HDFS-1675) | *Major* | **Transfer RBW between datanodes**
+* [MAPREDUCE-2517](https://issues.apache.org/jira/browse/MAPREDUCE-2517) | *Major* | **Porting Gridmix v3 system tests into trunk branch.**
-Added a new stage TRANSFER\_RBW to DataTransferProtocol
+Adds system tests to Gridmix. These system tests cover various features like job types (load and sleep), user resolvers (round-robin, submitter-user, echo) and submission modes (stress, replay and serial).
---
-* [HDFS-1636](https://issues.apache.org/jira/browse/HDFS-1636) | *Minor* | **If dfs.name.dir points to an empty dir, namenode format shouldn't require confirmation**
+* [HADOOP-6255](https://issues.apache.org/jira/browse/HADOOP-6255) | *Major* | **Create an rpm integration project**
-If dfs.name.dir points to an empty dir, namenode -format no longer requires confirmation.
+Added RPM/DEB packages to build system.
---
-* [HDFS-1626](https://issues.apache.org/jira/browse/HDFS-1626) | *Minor* | **Make BLOCK\_INVALIDATE\_LIMIT configurable**
+* [HDFS-1963](https://issues.apache.org/jira/browse/HDFS-1963) | *Major* | **HDFS rpm integration project**
-Added a new configuration property dfs.block.invalidate.limit for FSNamesystem.blockInvalidateLimit.
+Create HDFS RPM package
---
-* [HDFS-1620](https://issues.apache.org/jira/browse/HDFS-1620) | *Minor* | **Rename HdfsConstants -\> HdfsServerConstants, FSConstants -\> HdfsConstants**
+* [MAPREDUCE-2521](https://issues.apache.org/jira/browse/MAPREDUCE-2521) | *Major* | **Mapreduce RPM integration project**
-Rename HdfsConstants interface to HdfsServerConstants, FSConstants interface to HdfsConstants
+Created rpm and debian packages for MapReduce.
---
-* [HDFS-1606](https://issues.apache.org/jira/browse/HDFS-1606) | *Major* | **Provide a stronger data guarantee in the write pipeline**
+* [MAPREDUCE-2455](https://issues.apache.org/jira/browse/MAPREDUCE-2455) | *Major* | **Remove deprecated JobTracker.State in favour of JobTrackerStatus**
-Added two configuration properties, dfs.client.block.write.replace-datanode-on-failure.enable and dfs.client.block.write.replace-datanode-on-failure.policy. Added a new feature to replace datanode on failure in DataTransferProtocol. Added getAdditionalDatanode(..) in ClientProtocol.
+**WARNING: No release note provided for this change.**
---
-* [HDFS-1596](https://issues.apache.org/jira/browse/HDFS-1596) | *Major* | **Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml**
+* [MAPREDUCE-2544](https://issues.apache.org/jira/browse/MAPREDUCE-2544) | *Major* | **Gridmix compression emulation system tests.**
-Removed references to the older fs.checkpoint.\* properties that resided in core-site.xml
+Adds system tests for testing the compression emulation feature of Gridmix.
---
-* [HDFS-1594](https://issues.apache.org/jira/browse/HDFS-1594) | *Major* | **When the disk becomes full Namenode is getting shutdown and not able to recover**
+* [HDFS-1636](https://issues.apache.org/jira/browse/HDFS-1636) | *Minor* | **If dfs.name.dir points to an empty dir, namenode format shouldn't require confirmation**
-Implemented a daemon thread to monitor the disk usage for periodically and if the disk usage reaches the threshold value, put the name node into Safe mode so that no modification to file system will occur. Once the disk usage reaches below the threshold, name node will be put out of the safe mode. Here threshold value and interval to check the disk usage are configurable.
+If dfs.name.dir points to an empty dir, namenode -format no longer requires confirmation.
---
-* [HDFS-1582](https://issues.apache.org/jira/browse/HDFS-1582) | *Major* | **Remove auto-generated native build files**
+* [HDFS-1966](https://issues.apache.org/jira/browse/HDFS-1966) | *Major* | **Encapsulate individual DataTransferProtocol op header**
-The native build run when from trunk now requires autotools, libtool and openssl dev libraries.
+Added header classes for individual DataTransferProtocol op headers.
---
-* [HDFS-1560](https://issues.apache.org/jira/browse/HDFS-1560) | *Minor* | **dfs.data.dir permissions should default to 700**
+* [MAPREDUCE-2469](https://issues.apache.org/jira/browse/MAPREDUCE-2469) | *Major* | **Task counters should also report the total heap usage of the task**
-The permissions on datanode data directories (configured by dfs.datanode.data.dir.perm) now default to 0700. Upon startup, the datanode will automatically change the permissions to match the configured value.
+Task attempt's total heap usage gets recorded and published via counters as COMMITTED\_HEAP\_BYTES.
---
-* [HDFS-1547](https://issues.apache.org/jira/browse/HDFS-1547) | *Major* | **Improve decommission mechanism**
+* [MAPREDUCE-2543](https://issues.apache.org/jira/browse/MAPREDUCE-2543) | *Major* | **[Gridmix] Add support for HighRam jobs**
-Summary of changes to the decommissioning process:
-# After nodes are decommissioned, they are not shutdown. The decommissioned nodes are not used for writes. For reads, the decommissioned nodes are given as the last location to read from.
-# Number of live and dead decommissioned nodes are displayed in the namenode webUI.
-# Decommissioned nodes free capacity is not count towards the the cluster free capacity.
+Adds High-Ram feature emulation in Gridmix.
---
-* [HDFS-1536](https://issues.apache.org/jira/browse/HDFS-1536) | *Major* | **Improve HDFS WebUI**
+* [HADOOP-7331](https://issues.apache.org/jira/browse/HADOOP-7331) | *Trivial* | **Make hadoop-daemon.sh to return 1 if daemon processes did not get started**
-On web UI, missing block number now becomes accurate and under-replicated blocks do not include missing blocks.
+hadoop-daemon.sh now returns a non-zero exit code if it detects that the daemon was not still running after 3 seconds.
---
-* [HDFS-1526](https://issues.apache.org/jira/browse/HDFS-1526) | *Major* | **Dfs client name for a map/reduce task should have some randomness**
+* [MAPREDUCE-2554](https://issues.apache.org/jira/browse/MAPREDUCE-2554) | *Major* | **Gridmix distributed cache emulation system tests.**
-Make a client name has this format: DFSClient\_applicationid\_randomint\_threadid, where applicationid = mapred.task.id or else = "NONMAPREDUCE".
+Adds distributed cache related system tests to Gridmix.
---
-* [HDFS-1448](https://issues.apache.org/jira/browse/HDFS-1448) | *Major* | **Create multi-format parser for edits logs file, support binary and XML formats initially**
-
-Offline edits viewer feature adds oev tool to hdfs script. Oev makes it possible to convert edits logs to/from native binary and XML formats. It uses the same framework as Offline image viewer.
+* [MAPREDUCE-2529](https://issues.apache.org/jira/browse/MAPREDUCE-2529) | *Major* | **Recognize Jetty bug 1342 and handle it**
-Example usage:
+Added 2 new config parameters:
-$HADOOP\_HOME/bin/hdfs oev -i edits -o output.xml
+mapreduce.reduce.shuffle.catch.exception.stack.regex
+mapreduce.reduce.shuffle.catch.exception.message.regex
---
-* [HDFS-1445](https://issues.apache.org/jira/browse/HDFS-1445) | *Major* | **Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file**
+* [MAPREDUCE-2104](https://issues.apache.org/jira/browse/MAPREDUCE-2104) | *Major* | **Rumen TraceBuilder Does Not Emit CPU/Memory Usage Details in Traces**
-Batch hardlinking during "upgrade" snapshots, cutting time from aprx 8 minutes per volume to aprx 8 seconds. Validated in both Linux and Windows. Depends on prior integration with patch for HADOOP-7133.
+Adds cpu, physical memory, virtual memory and heap usages to TraceBuilder's output.
---
-* [HDFS-1381](https://issues.apache.org/jira/browse/HDFS-1381) | *Major* | **HDFS javadocs hard-code references to dfs.namenode.name.dir and dfs.datanode.data.dir parameters**
+* [HADOOP-5647](https://issues.apache.org/jira/browse/HADOOP-5647) | *Major* | **TestJobHistory fails if /tmp/\_logs is not writable to. Testcase should not depend on /tmp**
-Updated the JavaDocs to appropriately represent the new Configuration Keys that are used in the code. The docs did not match the code.
+Removed dependency of testcase on /tmp and made it to use test.build.data directory instead.
---
-* [HDFS-1321](https://issues.apache.org/jira/browse/HDFS-1321) | *Minor* | **If service port and main port are the same, there is no clear log message explaining the issue.**
+* [MAPREDUCE-587](https://issues.apache.org/jira/browse/MAPREDUCE-587) | *Minor* | **Stream test TestStreamingExitStatus fails with Out of Memory**
-Added a check to match the sure RPC and HTTP Port's on the NameNode were not set to the same value, otherwise an IOException is throw with the appropriate message.
+Fixed the streaming test TestStreamingExitStatus's failure due to an OutOfMemory error by reducing the testcase's io.sort.mb.
---
-* [HDFS-1120](https://issues.apache.org/jira/browse/HDFS-1120) | *Major* | **Make DataNode's block-to-device placement policy pluggable**
+* [HDFS-2058](https://issues.apache.org/jira/browse/HDFS-2058) | *Major* | **DataTransfer Protocol using protobufs**
-Make the DataNode's block-volume choosing policy pluggable.
+**WARNING: No release note provided for this change.**
---
-* [HDFS-1117](https://issues.apache.org/jira/browse/HDFS-1117) | *Major* | **HDFS portion of HADOOP-6728 (ovehaul metrics framework)**
+* [MAPREDUCE-2430](https://issues.apache.org/jira/browse/MAPREDUCE-2430) | *Major* | **Remove mrunit contrib**
-Metrics names are standardized to use CapitalizedCamelCase. Some examples:
-# Metrics names using "\_" is changed to new naming scheme. Eg: bytes\_written changes to BytesWritten.
-# All metrics names start with capitals. Example: threadsBlocked changes to ThreadsBlocked.
+MRUnit is now available as a separate Apache project.
---
-* [HDFS-1073](https://issues.apache.org/jira/browse/HDFS-1073) | *Major* | **Simpler model for Namenode's fs Image and edit Logs**
+* [HADOOP-7374](https://issues.apache.org/jira/browse/HADOOP-7374) | *Major* | **Don't add tools.jar to the classpath when running Hadoop**
-The NameNode's storage layout for its name directories has been reorganized to be more robust. Each edit now has a unique transaction ID, and each file is associated with a transaction ID (for checkpoints) or a range of transaction IDs (for edit logs).
+The scripts that run Hadoop no longer automatically add tools.jar from the JDK to the classpath (if it is present). If your job depends on tools.jar in the JDK you will need to add this dependency in your job.
---
-* [HDFS-1070](https://issues.apache.org/jira/browse/HDFS-1070) | *Major* | **Speedup NameNode image loading and saving by storing local file names**
+* [HDFS-2066](https://issues.apache.org/jira/browse/HDFS-2066) | *Major* | **Create a package and individual class files for DataTransferProtocol**
-This changes the fsimage format to be
-root directory-1 directory-2 ... directoy-n.
-Each directory stores all its children in the following format:
-Directory\_full\_path\_name num\_of\_children child-1 ... child-n.
-Each inode stores only the last component of its path name into fsimage.
-This change requires an upgrade at deployment.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-3317](https://issues.apache.org/jira/browse/MAPREDUCE-3317) | *Major* | **Rumen TraceBuilder is emiting null as hostname**
+* [MAPREDUCE-2106](https://issues.apache.org/jira/browse/MAPREDUCE-2106) | *Major* | **Emulate CPU Usage of Tasks in GridMix3**
-Fixes Rumen to get correct hostName that includes rackName in attempt info.
+Adds cumulative cpu usage emulation to Gridmix
---
-* [MAPREDUCE-3241](https://issues.apache.org/jira/browse/MAPREDUCE-3241) | *Major* | **(Rumen)TraceBuilder throws IllegalArgumentException**
+* [MAPREDUCE-2563](https://issues.apache.org/jira/browse/MAPREDUCE-2563) | *Major* | **Gridmix high ram jobs emulation system tests.**
-Rumen is fixed to ignore the AMRestartedEvent.
+Adds system tests to test the High-Ram feature in Gridmix.
---
-* [MAPREDUCE-3205](https://issues.apache.org/jira/browse/MAPREDUCE-3205) | *Blocker* | **MR2 memory limits should be pmem, not vmem**
+* [MAPREDUCE-2107](https://issues.apache.org/jira/browse/MAPREDUCE-2107) | *Major* | **Emulate Memory Usage of Tasks in GridMix3**
-Resource limits are now expressed and enforced in terms of physical memory, rather than virtual memory. The virtual memory limit is set as a configurable multiple of the physical limit. The NodeManager's memory usage is now configured in units of MB rather than GB.
+Adds total heap usage emulation to Gridmix. Also, Gridmix can configure the simulated task's JVM heap options with max heap options obtained from the original task (via Rumen). Use 'gridmix.task.jvm-options.enable' to disable the task max heap options configuration.
---
-* [MAPREDUCE-3186](https://issues.apache.org/jira/browse/MAPREDUCE-3186) | *Blocker* | **User jobs are getting hanged if the Resource manager process goes down and comes up while job is getting executed.**
-
-New Yarn configuration property:
+* [HADOOP-7379](https://issues.apache.org/jira/browse/HADOOP-7379) | *Major* | **Add ability to include Protobufs in ObjectWritable**
-Name: yarn.app.mapreduce.am.scheduler.connection.retries
-Description: Number of times AM should retry to contact RM if connection is lost.
+Protocol buffer-generated types may now be used as arguments or return values for Hadoop RPC.
---
-* [MAPREDUCE-3166](https://issues.apache.org/jira/browse/MAPREDUCE-3166) | *Major* | **Make Rumen use job history api instead of relying on current history file name format**
+* [HDFS-2055](https://issues.apache.org/jira/browse/HDFS-2055) | *Major* | **Add hflush support to libhdfs**
-Makes Rumen use job history api instead of relying on current history file name format.
+Add hdfsHFlush to libhdfs.
---
-* [MAPREDUCE-3157](https://issues.apache.org/jira/browse/MAPREDUCE-3157) | *Major* | **Rumen TraceBuilder is skipping analyzing 0.20 history files**
+* [HDFS-2087](https://issues.apache.org/jira/browse/HDFS-2087) | *Major* | **Add methods to DataTransferProtocol interface**
-Fixes TraceBuilder to handle 0.20 history file names also.
+Declare methods in DataTransferProtocol interface, and change Sender and Receiver to implement the interface.
---
-* [MAPREDUCE-3112](https://issues.apache.org/jira/browse/MAPREDUCE-3112) | *Major* | **Calling hadoop cli inside mapreduce job leads to errors**
+* [HDFS-1321](https://issues.apache.org/jira/browse/HDFS-1321) | *Minor* | **If service port and main port are the same, there is no clear log message explaining the issue.**
-Removed inheritance of certain server environment variables (HADOOP\_OPTS and HADOOP\_ROOT\_LOGGER) in task attempt process.
+Added a check to match the sure RPC and HTTP Port's on the NameNode were not set to the same value, otherwise an IOException is throw with the appropriate message.
---
-* [MAPREDUCE-3081](https://issues.apache.org/jira/browse/MAPREDUCE-3081) | *Major* | **Change the name format for hadoop core and vaidya jar to be hadoop-{core/vaidya}-{version}.jar in vaidya.sh**
+* [HDFS-1723](https://issues.apache.org/jira/browse/HDFS-1723) | *Minor* | **quota errors messages should use the same scale**
-contrib/vaidya/bin/vaidya.sh script fixed to use appropriate jars and classpath
+Updated the Quota exceptions to now use human readable output.
---
-* [MAPREDUCE-3042](https://issues.apache.org/jira/browse/MAPREDUCE-3042) | *Major* | **YARN RM fails to start**
+* [HDFS-2107](https://issues.apache.org/jira/browse/HDFS-2107) | *Major* | **Move block management code to a package**
-Simple typo fix to allow ResourceManager to start instead of fail
+Moved block management codes to a new package org.apache.hadoop.hdfs.server.blockmanagement.
---
-* [MAPREDUCE-3041](https://issues.apache.org/jira/browse/MAPREDUCE-3041) | *Blocker* | **Enhance YARN Client-RM protocol to provide access to information such as cluster's Min/Max Resource capabilities similar to that of AM-RM protocol**
+* [MAPREDUCE-2596](https://issues.apache.org/jira/browse/MAPREDUCE-2596) | *Major* | **Gridmix should notify job failures**
-**WARNING: No release note provided for this incompatible change.**
+Gridmix now prints a summary information after every run. It summarizes the runs w.r.t input trace details, input data statistics, cli arguments, data-gen runtime, simulation runtimes etc and also the cluster w.r.t map slots, reduce slots, jobtracker-address, hdfs-address etc.
---
-* [MAPREDUCE-2930](https://issues.apache.org/jira/browse/MAPREDUCE-2930) | *Major* | **Generate state graph from the State Machine Definition**
+* [MAPREDUCE-2606](https://issues.apache.org/jira/browse/MAPREDUCE-2606) | *Major* | **Remove IsolationRunner**
-Generate state graph from State Machine Definition
+IsolationRunner is no longer maintained. See MAPREDUCE-2637 for its replacement.
---
-* [MAPREDUCE-2858](https://issues.apache.org/jira/browse/MAPREDUCE-2858) | *Blocker* | **MRv2 WebApp Security**
+* [HADOOP-7305](https://issues.apache.org/jira/browse/HADOOP-7305) | *Minor* | **Eclipse project files are incomplete**
-A new server has been added to yarn. It is a web proxy that sits in front of the AM web UI. The server is controlled by the yarn.web-proxy.address config. If that config is set, and it points to an address that is different then the RM web interface then a separate proxy server needs to be launched.
+Added missing library during creation of the eclipse project files.
-This can be done by running
-yarn-daemon.sh start proxyserver
+---
-If a separate proxy server is needed other configs also may need to be set, if security is enabled.
-yarn.web-proxy.principal
-yarn.web-proxy.keytab
+* [HADOOP-2081](https://issues.apache.org/jira/browse/HADOOP-2081) | *Major* | **Configuration getInt, getLong, and getFloat replace invalid numbers with the default value**
-The proxy server is stateless and should be able to support a VIP or other load balancing sitting in front of multiple instances of this server.
+Invalid configuration values now result in a number format exception rather than the default value being used.
---
-* [MAPREDUCE-2846](https://issues.apache.org/jira/browse/MAPREDUCE-2846) | *Blocker* | **a small % of all tasks fail with DefaultTaskController**
+* [HADOOP-6385](https://issues.apache.org/jira/browse/HADOOP-6385) | *Minor* | **dfs does not support -rmdir (was HDFS-639)**
-Fixed a race condition in writing the log index file that caused tasks to 'fail'.
+The "rm" family of FsShell commands now supports -rmdir and -f options.
---
-* [MAPREDUCE-2789](https://issues.apache.org/jira/browse/MAPREDUCE-2789) | *Major* | **[MR:279] Update the scheduling info on CLI**
+* [HDFS-2210](https://issues.apache.org/jira/browse/HDFS-2210) | *Major* | **Remove hdfsproxy**
-"mapred/job -list" now contains map/reduce, container, and resource information.
+The hdfsproxy contrib component is no longer supported.
---
-* [MAPREDUCE-2764](https://issues.apache.org/jira/browse/MAPREDUCE-2764) | *Major* | **Fix renewal of dfs delegation tokens**
+* [HDFS-1073](https://issues.apache.org/jira/browse/HDFS-1073) | *Major* | **Simpler model for Namenode's fs Image and edit Logs**
-Generalizes token renewal and canceling to a common interface and provides a plugin interface for adding renewers for new kinds of tokens. Hftp changed to store the tokens as HFTP and renew them over http.
+The NameNode's storage layout for its name directories has been reorganized to be more robust. Each edit now has a unique transaction ID, and each file is associated with a transaction ID (for checkpoints) or a range of transaction IDs (for edit logs).
---
-* [MAPREDUCE-2736](https://issues.apache.org/jira/browse/MAPREDUCE-2736) | *Major* | **Remove unused contrib components dependent on MR1**
+* [HDFS-1381](https://issues.apache.org/jira/browse/HDFS-1381) | *Major* | **HDFS javadocs hard-code references to dfs.namenode.name.dir and dfs.datanode.data.dir parameters**
-The pre-MR2 MapReduce implementation (JobTracker, TaskTracer, etc) and contrib components are no longer supported. This implementation is currently supported in the 0.20.20x releases.
+Updated the JavaDocs to appropriately represent the new Configuration Keys that are used in the code. The docs did not match the code.
---
-* [MAPREDUCE-2719](https://issues.apache.org/jira/browse/MAPREDUCE-2719) | *Major* | **MR-279: Write a shell command application**
+* [HDFS-2202](https://issues.apache.org/jira/browse/HDFS-2202) | *Major* | **Changes to balancer bandwidth should not require datanode restart.**
-Adding a simple, DistributedShell application as an alternate framework to MapReduce and to act as an illustrative example for porting applications to YARN.
+New dfsadmin command added: [-setBalancerBandwidth \<bandwidth\>] where bandwidth is max network bandwidth in bytes per second that the balancer is allowed to use on each datanode during balacing.
+
+This is an incompatible change in 0.23. The versions of ClientProtocol and DatanodeProtocol are changed.
---
-* [MAPREDUCE-2702](https://issues.apache.org/jira/browse/MAPREDUCE-2702) | *Blocker* | **[MR-279] OutputCommitter changes for MR Application Master recovery**
+* [MAPREDUCE-2494](https://issues.apache.org/jira/browse/MAPREDUCE-2494) | *Major* | **Make the distributed cache delete entires using LRU priority**
-Enhance OutputCommitter and FileOutputCommitter to allow for recover of tasks across job restart.
+Added config option mapreduce.tasktracker.cache.local.keep.pct to the TaskTracker. It is the target percentage of the local distributed cache that should be kept in between garbage collection runs. In practice it will delete unused distributed cache entries in LRU order until the size of the cache is less than mapreduce.tasktracker.cache.local.keep.pct of the maximum cache size. This is a floating point value between 0.0 and 1.0. The default is 0.95.
---
-* [MAPREDUCE-2649](https://issues.apache.org/jira/browse/MAPREDUCE-2649) | *Major* | **MR279: Fate of finished Applications on RM**
+* [MAPREDUCE-2037](https://issues.apache.org/jira/browse/MAPREDUCE-2037) | *Major* | **Capturing interim progress times, CPU usage, and memory usage, when tasks reach certain progress thresholds**
-New config added:
+Capture intermediate task resource consumption information:
+\* Time taken so far
+\* CPU load [either at the time the data are taken, or exponentially smoothed]
+\* Memory load [also either at the time the data are taken, or exponentially smoothed]
- // the maximum number of completed applications the RM keeps \<name\>yarn.server.resourcemanager.expire.applications.completed.max\</name\>
+This would be taken at intervals that depend on the task progress plateaus. For example, reducers have three progress ranges - [0-1/3], (1/3-2/3], and (2/3-3/3] - where fundamentally different activities happen. Mappers have different boundaries that are not symmetrically placed [0-9/10], (9/10-1]. Data capture boundaries should coincide with activity boundaries. For the state information capture [CPU and memory] we should average over the covered interval.
---
-* [MAPREDUCE-2606](https://issues.apache.org/jira/browse/MAPREDUCE-2606) | *Major* | **Remove IsolationRunner**
+* [MAPREDUCE-901](https://issues.apache.org/jira/browse/MAPREDUCE-901) | *Major* | **Move Framework Counters into a TaskMetric structure**
-IsolationRunner is no longer maintained. See MAPREDUCE-2637 for its replacement.
+Efficient implementation of MapReduce framework counters.
---
-* [MAPREDUCE-2596](https://issues.apache.org/jira/browse/MAPREDUCE-2596) | *Major* | **Gridmix should notify job failures**
+* [MAPREDUCE-1738](https://issues.apache.org/jira/browse/MAPREDUCE-1738) | *Major* | **MapReduce portion of HADOOP-6728 (ovehaul metrics framework)**
-Gridmix now prints a summary information after every run. It summarizes the runs w.r.t input trace details, input data statistics, cli arguments, data-gen runtime, simulation runtimes etc and also the cluster w.r.t map slots, reduce slots, jobtracker-address, hdfs-address etc.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-2563](https://issues.apache.org/jira/browse/MAPREDUCE-2563) | *Major* | **Gridmix high ram jobs emulation system tests.**
-
-Adds system tests to test the High-Ram feature in Gridmix.
+* [MAPREDUCE-279](https://issues.apache.org/jira/browse/MAPREDUCE-279) | *Major* | **Map-Reduce 2.0**
+MapReduce has undergone a complete re-haul in hadoop-0.23 and we now have, what we call, MapReduce 2.0 (MRv2).
----
+The fundamental idea of MRv2 is to split up the two major functionalities of the JobTracker, resource management and job scheduling/monitoring, into separate daemons. The idea is to have a global ResourceManager (RM) and per-application ApplicationMaster (AM). An application is either a single job in the classical sense of Map-Reduce jobs or a DAG of jobs. The ResourceManager and per-node slave, the NodeManager (NM), form the data-computation framework. The ResourceManager is the ultimate authority that arbitrates resources among all the applications in the system. The per-application ApplicationMaster is, in effect, a framework specific library and is tasked with negotiating resources from the ResourceManager and working with the NodeManager(s) to execute and monitor the tasks.
-* [MAPREDUCE-2554](https://issues.apache.org/jira/browse/MAPREDUCE-2554) | *Major* | **Gridmix distributed cache emulation system tests.**
+The ResourceManager has two main components:
+\* Scheduler (S)
+\* ApplicationsManager (ASM)
-Adds distributed cache related system tests to Gridmix.
+The Scheduler is responsible for allocating resources to the various running applications subject to familiar constraints of capacities, queues etc. The Scheduler is pure scheduler in the sense that it performs no monitoring or tracking of status for the application. Also, it offers no guarantees on restarting failed tasks either due to application failure or hardware failures. The Scheduler performs its scheduling function based the resource requirements of the applications; it does so based on the abstract notion of a Resource Container which incorporates elements such as memory, cpu, disk, network etc.
+The Scheduler has a pluggable policy plug-in, which is responsible for partitioning the cluster resources among the various queues, applications etc. The current Map-Reduce schedulers such as the CapacityScheduler and the FairScheduler would be some examples of the plug-in.
----
+The CapacityScheduler supports hierarchical queues to allow for more predictable sharing of cluster resources.
+The ApplicationsManager is responsible for accepting job-submissions, negotiating the first container for executing the application specific ApplicationMaster and provides the service for restarting the ApplicationMaster container on failure.
-* [MAPREDUCE-2544](https://issues.apache.org/jira/browse/MAPREDUCE-2544) | *Major* | **Gridmix compression emulation system tests.**
+The NodeManager is the per-machine framework agent who is responsible for launching the applications' containers, monitoring their resource usage (cpu, memory, disk, network) and reporting the same to the Scheduler.
-Adds system tests for testing the compression emulation feature of Gridmix.
+The per-application ApplicationMaster has the responsibility of negotiating appropriate resource containers from the Scheduler, tracking their status and monitoring for progress.
---
-* [MAPREDUCE-2543](https://issues.apache.org/jira/browse/MAPREDUCE-2543) | *Major* | **[Gridmix] Add support for HighRam jobs**
+* [HADOOP-7264](https://issues.apache.org/jira/browse/HADOOP-7264) | *Major* | **Bump avro version to at least 1.4.1**
-Adds High-Ram feature emulation in Gridmix.
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-2529](https://issues.apache.org/jira/browse/MAPREDUCE-2529) | *Major* | **Recognize Jetty bug 1342 and handle it**
+* [MAPREDUCE-2649](https://issues.apache.org/jira/browse/MAPREDUCE-2649) | *Major* | **MR279: Fate of finished Applications on RM**
-Added 2 new config parameters:
+New config added:
-mapreduce.reduce.shuffle.catch.exception.stack.regex
-mapreduce.reduce.shuffle.catch.exception.message.regex
+ // the maximum number of completed applications the RM keeps \<name\>yarn.server.resourcemanager.expire.applications.completed.max\</name\>
---
-* [MAPREDUCE-2521](https://issues.apache.org/jira/browse/MAPREDUCE-2521) | *Major* | **Mapreduce RPM integration project**
+* [MAPREDUCE-2846](https://issues.apache.org/jira/browse/MAPREDUCE-2846) | *Blocker* | **a small % of all tasks fail with DefaultTaskController**
-Created rpm and debian packages for MapReduce.
+Fixed a race condition in writing the log index file that caused tasks to 'fail'.
---
-* [MAPREDUCE-2517](https://issues.apache.org/jira/browse/MAPREDUCE-2517) | *Major* | **Porting Gridmix v3 system tests into trunk branch.**
+* [HADOOP-7547](https://issues.apache.org/jira/browse/HADOOP-7547) | *Minor* | **Fix the warning in writable classes.[ WritableComparable is a raw type. References to generic type WritableComparable\<T\> should be parameterized ]**
-Adds system tests to Gridmix. These system tests cover various features like job types (load and sleep), user resolvers (round-robin, submitter-user, echo) and submission modes (stress, replay and serial).
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-2494](https://issues.apache.org/jira/browse/MAPREDUCE-2494) | *Major* | **Make the distributed cache delete entires using LRU priority**
+* [HDFS-1620](https://issues.apache.org/jira/browse/HDFS-1620) | *Minor* | **Rename HdfsConstants -\> HdfsServerConstants, FSConstants -\> HdfsConstants**
-Added config option mapreduce.tasktracker.cache.local.keep.pct to the TaskTracker. It is the target percentage of the local distributed cache that should be kept in between garbage collection runs. In practice it will delete unused distributed cache entries in LRU order until the size of the cache is less than mapreduce.tasktracker.cache.local.keep.pct of the maximum cache size. This is a floating point value between 0.0 and 1.0. The default is 0.95.
+Rename HdfsConstants interface to HdfsServerConstants, FSConstants interface to HdfsConstants
---
-* [MAPREDUCE-2492](https://issues.apache.org/jira/browse/MAPREDUCE-2492) | *Major* | **[MAPREDUCE] The new MapReduce API should make available task's progress to the task**
+* [HADOOP-7507](https://issues.apache.org/jira/browse/HADOOP-7507) | *Major* | **jvm metrics all use the same namespace**
-Map and Reduce task can access the attempt's overall progress via TaskAttemptContext.
+JVM metrics published to Ganglia now include the process name as part of the gmetric name.
---
-* [MAPREDUCE-2483](https://issues.apache.org/jira/browse/MAPREDUCE-2483) | *Major* | **Clean up duplication of dependent jar files**
+* [HADOOP-7119](https://issues.apache.org/jira/browse/HADOOP-7119) | *Major* | **add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles**
-Removed duplicated hadoop-common library dependencies.
+Adding support for Kerberos HTTP SPNEGO authentication to the Hadoop web-consoles
---
-* [MAPREDUCE-2478](https://issues.apache.org/jira/browse/MAPREDUCE-2478) | *Major* | **MR 279: Improve history server**
+* [HDFS-2338](https://issues.apache.org/jira/browse/HDFS-2338) | *Major* | **Configuration option to enable/disable webhdfs.**
-Looks great. I just committed this. Thanks Siddharth!
+Added a conf property dfs.webhdfs.enabled for enabling/disabling webhdfs.
---
-* [MAPREDUCE-2474](https://issues.apache.org/jira/browse/MAPREDUCE-2474) | *Minor* | **Add docs to the new API Partitioner on how to access Job Configuration data**
+* [HDFS-2318](https://issues.apache.org/jira/browse/HDFS-2318) | *Major* | **Provide authentication to webhdfs using SPNEGO**
-Improve the Partitioner interface's docs to help fetch Job Configuration objects.
+Added two new conf properties dfs.web.authentication.kerberos.principal and dfs.web.authentication.kerberos.keytab for the SPNEGO servlet filter.
---
-* [MAPREDUCE-2473](https://issues.apache.org/jira/browse/MAPREDUCE-2473) | *Major* | **MR portion of HADOOP-7214 - Hadoop /usr/bin/groups equivalent**
+* [MAPREDUCE-3042](https://issues.apache.org/jira/browse/MAPREDUCE-3042) | *Major* | **YARN RM fails to start**
-Introduces a new command, "mapred groups", which displays what groups are associated with a user as seen by the JobTracker.
+Simple typo fix to allow ResourceManager to start instead of fail
---
-* [MAPREDUCE-2469](https://issues.apache.org/jira/browse/MAPREDUCE-2469) | *Major* | **Task counters should also report the total heap usage of the task**
+* [MAPREDUCE-2930](https://issues.apache.org/jira/browse/MAPREDUCE-2930) | *Major* | **Generate state graph from the State Machine Definition**
-Task attempt's total heap usage gets recorded and published via counters as COMMITTED\_HEAP\_BYTES.
+Generate state graph from State Machine Definition
---
-* [MAPREDUCE-2455](https://issues.apache.org/jira/browse/MAPREDUCE-2455) | *Major* | **Remove deprecated JobTracker.State in favour of JobTrackerStatus**
+* [MAPREDUCE-3081](https://issues.apache.org/jira/browse/MAPREDUCE-3081) | *Major* | **Change the name format for hadoop core and vaidya jar to be hadoop-{core/vaidya}-{version}.jar in vaidya.sh**
-**WARNING: No release note provided for this incompatible change.**
+contrib/vaidya/bin/vaidya.sh script fixed to use appropriate jars and classpath
---
-* [MAPREDUCE-2434](https://issues.apache.org/jira/browse/MAPREDUCE-2434) | *Major* | **MR-279: ResourceManager metrics**
+* [MAPREDUCE-3041](https://issues.apache.org/jira/browse/MAPREDUCE-3041) | *Blocker* | **Enhance YARN Client-RM protocol to provide access to information such as cluster's Min/Max Resource capabilities similar to that of AM-RM protocol**
-I just committed this. Thanks Luke!
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-2430](https://issues.apache.org/jira/browse/MAPREDUCE-2430) | *Major* | **Remove mrunit contrib**
+* [HADOOP-7668](https://issues.apache.org/jira/browse/HADOOP-7668) | *Minor* | **Add a NetUtils method that can tell if an InetAddress belongs to local host**
-MRUnit is now available as a separate Apache project.
+closing again
---
-* [MAPREDUCE-2417](https://issues.apache.org/jira/browse/MAPREDUCE-2417) | *Major* | **In Gridmix, in RoundRobinUserResolver mode, the testing/proxy users are not associated with unique users in a trace**
+* [HDFS-2355](https://issues.apache.org/jira/browse/HDFS-2355) | *Major* | **Federation: enable using the same configuration file across all the nodes in the cluster.**
-Fixes Gridmix in RoundRobinUserResolver mode to map testing/proxy users to unique users in a trace.
+This change allows when running multiple namenodes on different hosts, sharing the same configuration file across all the nodes in the cluster (Datanodes, NamNode, BackupNode, SecondaryNameNode), without the need to define dfs.federation.nameservice.id parameter.
---
-* [MAPREDUCE-2416](https://issues.apache.org/jira/browse/MAPREDUCE-2416) | *Major* | **In Gridmix, in RoundRobinUserResolver, the list of groups for a user obtained from users-list-file is incorrect**
+* [MAPREDUCE-2719](https://issues.apache.org/jira/browse/MAPREDUCE-2719) | *Major* | **MR-279: Write a shell command application**
-Removes the restriction of specifying group names in users-list file for Gridmix in RoundRobinUserResolver mode.
+Adding a simple, DistributedShell application as an alternate framework to MapReduce and to act as an illustrative example for porting applications to YARN.
---
-* [MAPREDUCE-2408](https://issues.apache.org/jira/browse/MAPREDUCE-2408) | *Major* | **Make Gridmix emulate usage of data compression**
+* [HADOOP-7691](https://issues.apache.org/jira/browse/HADOOP-7691) | *Major* | **hadoop deb pkg should take a diff group id**
-Emulates the MapReduce compression feature in Gridmix. By default, compression emulation is turned on. Compression emulation can be disabled by setting 'gridmix.compression-emulation.enable' to 'false'. Use 'gridmix.compression-emulation.map-input.decompression-ratio', 'gridmix.compression-emulation.map-output.compression-ratio' and 'gridmix.compression-emulation.reduce-output.compression-ratio' to configure the compression ratios at map input, map output and reduce output side respectively. Currently, compression ratios in the range [0.07, 0.68] are supported. Gridmix auto detects whether map-input, map output and reduce output should emulate compression based on original job's compression related configuration parameters.
+Fixed conflict uid for install packages. (Eric Yang)
---
-* [MAPREDUCE-2407](https://issues.apache.org/jira/browse/MAPREDUCE-2407) | *Major* | **Make Gridmix emulate usage of Distributed Cache files**
+* [HADOOP-7603](https://issues.apache.org/jira/browse/HADOOP-7603) | *Major* | **Set default hdfs, mapred uid, and hadoop group gid for RPM packages**
-Makes Gridmix emulate HDFS based distributed cache files and local file system based distributed cache files.
+Set hdfs uid, mapred uid, and hadoop gid to fixed numbers (201, 202, and 123, respectively).
---
-* [MAPREDUCE-2405](https://issues.apache.org/jira/browse/MAPREDUCE-2405) | *Major* | **MR-279: Implement uber-AppMaster (in-cluster LocalJobRunner for MRv2)**
+* [HADOOP-7684](https://issues.apache.org/jira/browse/HADOOP-7684) | *Major* | **jobhistory server and secondarynamenode should have init.d script**
-An efficient implementation of small jobs by running all tasks in the MR ApplicationMaster JVM, there-by affecting lower latency.
+Added init.d script for jobhistory server and secondary namenode. (Eric Yang)
---
-* [MAPREDUCE-2260](https://issues.apache.org/jira/browse/MAPREDUCE-2260) | *Major* | **Remove auto-generated native build files**
+* [MAPREDUCE-3112](https://issues.apache.org/jira/browse/MAPREDUCE-3112) | *Major* | **Calling hadoop cli inside mapreduce job leads to errors**
-The native build run when from trunk now requires autotools, libtool and openssl dev libraries.
+Removed inheritance of certain server environment variables (HADOOP\_OPTS and HADOOP\_ROOT\_LOGGER) in task attempt process.
---
-* [MAPREDUCE-2254](https://issues.apache.org/jira/browse/MAPREDUCE-2254) | *Major* | **Allow setting of end-of-record delimiter for TextInputFormat**
+* [HADOOP-7715](https://issues.apache.org/jira/browse/HADOOP-7715) | *Major* | **see log4j Error when running mr jobs and certain dfs calls**
-TextInputFormat may now split lines with delimiters other than newline, by specifying a configuration parameter "textinputformat.record.delimiter"
+Removed unnecessary security logger configuration. (Eric Yang)
---
-* [MAPREDUCE-2225](https://issues.apache.org/jira/browse/MAPREDUCE-2225) | *Blocker* | **MultipleOutputs should not require the use of 'Writable'**
+* [HADOOP-7711](https://issues.apache.org/jira/browse/HADOOP-7711) | *Major* | **hadoop-env.sh generated from templates has duplicate info**
-MultipleOutputs should not require the use/check of 'Writable' interfaces in key and value classes.
+Fixed recursive sourcing of HADOOP\_OPTS environment variables (Arpit Gupta via Eric Yang)
---
-* [MAPREDUCE-2207](https://issues.apache.org/jira/browse/MAPREDUCE-2207) | *Major* | **Task-cleanup task should not be scheduled on the node that the task just failed**
+* [HADOOP-7681](https://issues.apache.org/jira/browse/HADOOP-7681) | *Minor* | **log4j.properties is missing properties for security audit and hdfs audit should be changed to info**
-Task-cleanup task should not be scheduled on the node that the task just failed
+HADOOP-7681. Fixed security and hdfs audit log4j properties
+(Arpit Gupta via Eric Yang)
---
-* [MAPREDUCE-2153](https://issues.apache.org/jira/browse/MAPREDUCE-2153) | *Major* | **Bring in more job configuration properties in to the trace file**
+* [HADOOP-7708](https://issues.apache.org/jira/browse/HADOOP-7708) | *Critical* | **config generator does not update the properties file if on exists already**
-Adds job configuration parameters to the job trace. The configuration parameters are stored under the 'jobProperties' field as key-value pairs.
+Fixed hadoop-setup-conf.sh to handle config file consistently. (Eric Yang)
---
-* [MAPREDUCE-2137](https://issues.apache.org/jira/browse/MAPREDUCE-2137) | *Major* | **Mapping between Gridmix jobs and the corresponding original MR jobs is needed**
+* [HADOOP-7707](https://issues.apache.org/jira/browse/HADOOP-7707) | *Major* | **improve config generator to allow users to specify proxy user, turn append on or off, turn webhdfs on or off**
-New configuration properties gridmix.job.original-job-id and gridmix.job.original-job-name in the configuration of simulated job are exposed/documented to gridmix user for mapping between original cluster's jobs and simulated jobs.
+Added toggle for dfs.support.append, webhdfs and hadoop proxy user to setup config script. (Arpit Gupta via Eric Yang)
---
-* [MAPREDUCE-2107](https://issues.apache.org/jira/browse/MAPREDUCE-2107) | *Major* | **Emulate Memory Usage of Tasks in GridMix3**
+* [HADOOP-7720](https://issues.apache.org/jira/browse/HADOOP-7720) | *Major* | **improve the hadoop-setup-conf.sh to read in the hbase user and setup the configs**
-Adds total heap usage emulation to Gridmix. Also, Gridmix can configure the simulated task's JVM heap options with max heap options obtained from the original task (via Rumen). Use 'gridmix.task.jvm-options.enable' to disable the task max heap options configuration.
+Added parameter for HBase user to setup config script. (Arpit Gupta via Eric Yang)
---
-* [MAPREDUCE-2106](https://issues.apache.org/jira/browse/MAPREDUCE-2106) | *Major* | **Emulate CPU Usage of Tasks in GridMix3**
+* [MAPREDUCE-2702](https://issues.apache.org/jira/browse/MAPREDUCE-2702) | *Blocker* | **[MR-279] OutputCommitter changes for MR Application Master recovery**
-Adds cumulative cpu usage emulation to Gridmix
+Enhance OutputCommitter and FileOutputCommitter to allow for recover of tasks across job restart.
---
-* [MAPREDUCE-2104](https://issues.apache.org/jira/browse/MAPREDUCE-2104) | *Major* | **Rumen TraceBuilder Does Not Emit CPU/Memory Usage Details in Traces**
+* [HADOOP-7724](https://issues.apache.org/jira/browse/HADOOP-7724) | *Major* | **hadoop-setup-conf.sh should put proxy user info into the core-site.xml**
-Adds cpu, physical memory, virtual memory and heap usages to TraceBuilder's output.
+Fixed hadoop-setup-conf.sh to put proxy user in core-site.xml. (Arpit Gupta via Eric Yang)
---
-* [MAPREDUCE-2037](https://issues.apache.org/jira/browse/MAPREDUCE-2037) | *Major* | **Capturing interim progress times, CPU usage, and memory usage, when tasks reach certain progress thresholds**
-
-Capture intermediate task resource consumption information:
-\* Time taken so far
-\* CPU load [either at the time the data are taken, or exponentially smoothed]
-\* Memory load [also either at the time the data are taken, or exponentially smoothed]
+* [MAPREDUCE-3157](https://issues.apache.org/jira/browse/MAPREDUCE-3157) | *Major* | **Rumen TraceBuilder is skipping analyzing 0.20 history files**
-This would be taken at intervals that depend on the task progress plateaus. For example, reducers have three progress ranges - [0-1/3], (1/3-2/3], and (2/3-3/3] - where fundamentally different activities happen. Mappers have different boundaries that are not symmetrically placed [0-9/10], (9/10-1]. Data capture boundaries should coincide with activity boundaries. For the state information capture [CPU and memory] we should average over the covered interval.
+Fixes TraceBuilder to handle 0.20 history file names also.
---
-* [MAPREDUCE-1996](https://issues.apache.org/jira/browse/MAPREDUCE-1996) | *Trivial* | **API: Reducer.reduce() method detail misstatement**
+* [MAPREDUCE-3166](https://issues.apache.org/jira/browse/MAPREDUCE-3166) | *Major* | **Make Rumen use job history api instead of relying on current history file name format**
-Fix a misleading documentation note about the usage of Reporter objects in Reducers.
+Makes Rumen use job history api instead of relying on current history file name format.
---
-* [MAPREDUCE-1978](https://issues.apache.org/jira/browse/MAPREDUCE-1978) | *Major* | **[Rumen] TraceBuilder should provide recursive input folder scanning**
+* [MAPREDUCE-2789](https://issues.apache.org/jira/browse/MAPREDUCE-2789) | *Major* | **[MR:279] Update the scheduling info on CLI**
-Adds -recursive option to TraceBuilder for scanning the input directories recursively.
+"mapred/job -list" now contains map/reduce, container, and resource information.
---
-* [MAPREDUCE-1906](https://issues.apache.org/jira/browse/MAPREDUCE-1906) | *Major* | **Lower default minimum heartbeat interval for tasktracker \> Jobtracker**
+* [MAPREDUCE-2764](https://issues.apache.org/jira/browse/MAPREDUCE-2764) | *Major* | **Fix renewal of dfs delegation tokens**
-The default minimum heartbeat interval has been dropped from 3 seconds to 300ms to increase scheduling throughput on small clusters. Users may tune mapreduce.jobtracker.heartbeats.in.second to adjust this value.
+Generalizes token renewal and canceling to a common interface and provides a plugin interface for adding renewers for new kinds of tokens. Hftp changed to store the tokens as HFTP and renew them over http.
---
-* [MAPREDUCE-1811](https://issues.apache.org/jira/browse/MAPREDUCE-1811) | *Minor* | **Job.monitorAndPrintJob() should print status of the job at completion**
+* [HADOOP-7655](https://issues.apache.org/jira/browse/HADOOP-7655) | *Major* | **provide a small validation script that smoke tests the installed cluster**
-Print the resultant status of a Job on completion instead of simply saying 'Complete'.
+Committed to trunk and v23, since code reviewed by Eric.
---
-* [MAPREDUCE-1738](https://issues.apache.org/jira/browse/MAPREDUCE-1738) | *Major* | **MapReduce portion of HADOOP-6728 (ovehaul metrics framework)**
+* [MAPREDUCE-2858](https://issues.apache.org/jira/browse/MAPREDUCE-2858) | *Blocker* | **MRv2 WebApp Security**
+
+A new server has been added to yarn. It is a web proxy that sits in front of the AM web UI. The server is controlled by the yarn.web-proxy.address config. If that config is set, and it points to an address that is different then the RM web interface then a separate proxy server needs to be launched.
+
+This can be done by running
+
+yarn-daemon.sh start proxyserver
-**WARNING: No release note provided for this incompatible change.**
+If a separate proxy server is needed other configs also may need to be set, if security is enabled.
+yarn.web-proxy.principal
+yarn.web-proxy.keytab
+
+The proxy server is stateless and should be able to support a VIP or other load balancing sitting in front of multiple instances of this server.
---
-* [MAPREDUCE-1461](https://issues.apache.org/jira/browse/MAPREDUCE-1461) | *Major* | **Feature to instruct rumen-folder utility to skip jobs worth of specific duration**
+* [MAPREDUCE-3205](https://issues.apache.org/jira/browse/MAPREDUCE-3205) | *Blocker* | **MR2 memory limits should be pmem, not vmem**
-Added a ''-starts-after' option to Rumen's Folder utility. The time duration specified after the '-starts-after' option is an offset with respect to the submit time of the first job in the input trace. Jobs in the input trace having a submit time (relative to the first job's submit time) lesser than the specified offset will be ignored.
+Resource limits are now expressed and enforced in terms of physical memory, rather than virtual memory. The virtual memory limit is set as a configurable multiple of the physical limit. The NodeManager's memory usage is now configured in units of MB rather than GB.
---
-* [MAPREDUCE-1242](https://issues.apache.org/jira/browse/MAPREDUCE-1242) | *Trivial* | **Chain APIs error misleading**
+* [HDFS-1869](https://issues.apache.org/jira/browse/HDFS-1869) | *Major* | **mkdirs should use the supplied permission for all of the created directories**
-Fix a misleading exception message in case the Chained Mappers have mismatch in input/output Key/Value pairs between them.
+A multi-level mkdir is now POSIX compliant. Instead of creating intermediate directories with the permissions of the parent directory, intermediate directories are created with permission bits of rwxrwxrwx (0777) as modified by the current umask, plus write and search permission for the owner.
---
-* [MAPREDUCE-1159](https://issues.apache.org/jira/browse/MAPREDUCE-1159) | *Trivial* | **Limit Job name on jobtracker.jsp to be 80 char long**
+* [HADOOP-7728](https://issues.apache.org/jira/browse/HADOOP-7728) | *Major* | **hadoop-setup-conf.sh should be modified to enable task memory manager**
-Job names on jobtracker.jsp should be 80 characters long at most.
+Enable task memory management to be configurable via hadoop config setup script.
---
-* [MAPREDUCE-993](https://issues.apache.org/jira/browse/MAPREDUCE-993) | *Minor* | **bin/hadoop job -events \<jobid\> \<from-event-#\> \<#-of-events\> help message is confusing**
+* [MAPREDUCE-3186](https://issues.apache.org/jira/browse/MAPREDUCE-3186) | *Blocker* | **User jobs are getting hanged if the Resource manager process goes down and comes up while job is getting executed.**
+
+New Yarn configuration property:
-Added a helpful description message to the `mapred job -events` command.
+Name: yarn.app.mapreduce.am.scheduler.connection.retries
+Description: Number of times AM should retry to contact RM if connection is lost.
---
-* [MAPREDUCE-901](https://issues.apache.org/jira/browse/MAPREDUCE-901) | *Major* | **Move Framework Counters into a TaskMetric structure**
+* [MAPREDUCE-2736](https://issues.apache.org/jira/browse/MAPREDUCE-2736) | *Major* | **Remove unused contrib components dependent on MR1**
-Efficient implementation of MapReduce framework counters.
+The pre-MR2 MapReduce implementation (JobTracker, TaskTracer, etc) and contrib components are no longer supported. This implementation is currently supported in the 0.20.20x releases.
---
-* [MAPREDUCE-587](https://issues.apache.org/jira/browse/MAPREDUCE-587) | *Minor* | **Stream test TestStreamingExitStatus fails with Out of Memory**
+* [HADOOP-7740](https://issues.a
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[50/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.0/CHANGES.0.12.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.0/CHANGES.0.12.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.0/CHANGES.0.12.0.md
index 40e402c..125ec55 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.0/CHANGES.0.12.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.0/CHANGES.0.12.0.md
@@ -20,98 +20,88 @@
## Release 0.12.0 - 2007-03-02
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1032](https://issues.apache.org/jira/browse/HADOOP-1032) | Support for caching Job JARs | Minor | . | Gautam Kowshik | Gautam Kowshik |
-| [HADOOP-492](https://issues.apache.org/jira/browse/HADOOP-492) | Global counters | Major | . | arkady borkovsky | David Bowen |
| [HADOOP-491](https://issues.apache.org/jira/browse/HADOOP-491) | streaming jobs should allow programs that don't do any IO for a long time | Major | . | arkady borkovsky | Arun C Murthy |
+| [HADOOP-492](https://issues.apache.org/jira/browse/HADOOP-492) | Global counters | Major | . | arkady borkovsky | David Bowen |
+| [HADOOP-1032](https://issues.apache.org/jira/browse/HADOOP-1032) | Support for caching Job JARs | Minor | . | Gautam Kowshik | Gautam Kowshik |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1043](https://issues.apache.org/jira/browse/HADOOP-1043) | Optimize the shuffle phase (increase the parallelism) | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-1042](https://issues.apache.org/jira/browse/HADOOP-1042) | Improve the handling of failed map output fetches | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-1041](https://issues.apache.org/jira/browse/HADOOP-1041) | Counter names are ugly | Major | . | Owen O'Malley | David Bowen |
-| [HADOOP-1040](https://issues.apache.org/jira/browse/HADOOP-1040) | Improvement of RandomWriter example to use custom InputFormat, OutputFormat, and Counters | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1033](https://issues.apache.org/jira/browse/HADOOP-1033) | Rewrite AmazonEC2 wiki page | Minor | scripts | Tom White | Tom White |
-| [HADOOP-1030](https://issues.apache.org/jira/browse/HADOOP-1030) | in unit tests, set ipc timeout in one place | Minor | test | Doug Cutting | Doug Cutting |
-| [HADOOP-1025](https://issues.apache.org/jira/browse/HADOOP-1025) | remove dead code in Server.java | Minor | ipc | Doug Cutting | Doug Cutting |
-| [HADOOP-1017](https://issues.apache.org/jira/browse/HADOOP-1017) | Optimization: Reduce Overhead from ReflectionUtils.newInstance | Major | util | Ron Bodkin | |
+| [HADOOP-975](https://issues.apache.org/jira/browse/HADOOP-975) | Separation of user tasks' stdout and stderr streams | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-982](https://issues.apache.org/jira/browse/HADOOP-982) | A couple setter functions and toString method for BytesWritable. | Major | io | Owen O'Malley | Owen O'Malley |
+| [HADOOP-858](https://issues.apache.org/jira/browse/HADOOP-858) | clean up smallJobsBenchmark and move to src/test/org/apache/hadoop/mapred | Minor | build | Nigel Daley | Nigel Daley |
+| [HADOOP-954](https://issues.apache.org/jira/browse/HADOOP-954) | Metrics should offer complete set of static report methods or none at all | Minor | metrics | Nigel Daley | David Bowen |
+| [HADOOP-882](https://issues.apache.org/jira/browse/HADOOP-882) | S3FileSystem should retry if there is a communication problem with S3 | Major | fs | Tom White | Tom White |
+| [HADOOP-977](https://issues.apache.org/jira/browse/HADOOP-977) | The output from the user's task should be tagged and sent to the resepective console streams. | Major | . | Owen O'Malley | Arun C Murthy |
| [HADOOP-1007](https://issues.apache.org/jira/browse/HADOOP-1007) | Names used for map, reduce, and shuffle metrics should be unique | Trivial | metrics | Nigel Daley | Nigel Daley |
+| [HADOOP-889](https://issues.apache.org/jira/browse/HADOOP-889) | DFS unit tests have duplicate code | Minor | test | Doug Cutting | Milind Bhandarkar |
+| [HADOOP-943](https://issues.apache.org/jira/browse/HADOOP-943) | fsck to show the filename of the corrupted file | Trivial | . | Koji Noguchi | dhruba borthakur |
+| [HADOOP-333](https://issues.apache.org/jira/browse/HADOOP-333) | we should have some checks that the sort benchmark generates correct outputs | Major | . | Owen O'Malley | Arun C Murthy |
+| [HADOOP-1017](https://issues.apache.org/jira/browse/HADOOP-1017) | Optimization: Reduce Overhead from ReflectionUtils.newInstance | Major | util | Ron Bodkin | |
+| [HADOOP-867](https://issues.apache.org/jira/browse/HADOOP-867) | job client should generate input fragments before the job is submitted | Major | . | Owen O'Malley | |
+| [HADOOP-952](https://issues.apache.org/jira/browse/HADOOP-952) | Create a public (shared) Hadoop EC2 AMI | Major | scripts | Tom White | Tom White |
+| [HADOOP-1025](https://issues.apache.org/jira/browse/HADOOP-1025) | remove dead code in Server.java | Minor | ipc | Doug Cutting | Doug Cutting |
| [HADOOP-997](https://issues.apache.org/jira/browse/HADOOP-997) | Implement S3 retry mechanism for failed block transfers | Major | fs | Tom White | Tom White |
+| [HADOOP-1030](https://issues.apache.org/jira/browse/HADOOP-1030) | in unit tests, set ipc timeout in one place | Minor | test | Doug Cutting | Doug Cutting |
| [HADOOP-985](https://issues.apache.org/jira/browse/HADOOP-985) | Namenode should identify DataNodes as ip:port instead of hostname:port | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-982](https://issues.apache.org/jira/browse/HADOOP-982) | A couple setter functions and toString method for BytesWritable. | Major | io | Owen O'Malley | Owen O'Malley |
-| [HADOOP-977](https://issues.apache.org/jira/browse/HADOOP-977) | The output from the user's task should be tagged and sent to the resepective console streams. | Major | . | Owen O'Malley | Arun C Murthy |
-| [HADOOP-975](https://issues.apache.org/jira/browse/HADOOP-975) | Separation of user tasks' stdout and stderr streams | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-248](https://issues.apache.org/jira/browse/HADOOP-248) | locating map outputs via random probing is inefficient | Major | . | Owen O'Malley | Devaraj Das |
+| [HADOOP-1040](https://issues.apache.org/jira/browse/HADOOP-1040) | Improvement of RandomWriter example to use custom InputFormat, OutputFormat, and Counters | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-928](https://issues.apache.org/jira/browse/HADOOP-928) | make checksums optional per FileSystem | Major | fs | Doug Cutting | Hairong Kuang |
+| [HADOOP-1042](https://issues.apache.org/jira/browse/HADOOP-1042) | Improve the handling of failed map output fetches | Major | . | Devaraj Das | Devaraj Das |
| [HADOOP-972](https://issues.apache.org/jira/browse/HADOOP-972) | Improve the rack-aware replica placement performance | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-954](https://issues.apache.org/jira/browse/HADOOP-954) | Metrics should offer complete set of static report methods or none at all | Minor | metrics | Nigel Daley | David Bowen |
-| [HADOOP-952](https://issues.apache.org/jira/browse/HADOOP-952) | Create a public (shared) Hadoop EC2 AMI | Major | scripts | Tom White | Tom White |
-| [HADOOP-943](https://issues.apache.org/jira/browse/HADOOP-943) | fsck to show the filename of the corrupted file | Trivial | . | Koji Noguchi | dhruba borthakur |
-| [HADOOP-941](https://issues.apache.org/jira/browse/HADOOP-941) | Enhancements to Hadoop record I/O - Part 1 | Major | record | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-1043](https://issues.apache.org/jira/browse/HADOOP-1043) | Optimize the shuffle phase (increase the parallelism) | Major | . | Devaraj Das | Devaraj Das |
| [HADOOP-940](https://issues.apache.org/jira/browse/HADOOP-940) | pendingReplications of FSNamesystem is not informative | Major | . | Hairong Kuang | dhruba borthakur |
-| [HADOOP-928](https://issues.apache.org/jira/browse/HADOOP-928) | make checksums optional per FileSystem | Major | fs | Doug Cutting | Hairong Kuang |
-| [HADOOP-889](https://issues.apache.org/jira/browse/HADOOP-889) | DFS unit tests have duplicate code | Minor | test | Doug Cutting | Milind Bhandarkar |
-| [HADOOP-882](https://issues.apache.org/jira/browse/HADOOP-882) | S3FileSystem should retry if there is a communication problem with S3 | Major | fs | Tom White | Tom White |
-| [HADOOP-867](https://issues.apache.org/jira/browse/HADOOP-867) | job client should generate input fragments before the job is submitted | Major | . | Owen O'Malley | |
-| [HADOOP-858](https://issues.apache.org/jira/browse/HADOOP-858) | clean up smallJobsBenchmark and move to src/test/org/apache/hadoop/mapred | Minor | build | Nigel Daley | Nigel Daley |
+| [HADOOP-941](https://issues.apache.org/jira/browse/HADOOP-941) | Enhancements to Hadoop record I/O - Part 1 | Major | record | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-1041](https://issues.apache.org/jira/browse/HADOOP-1041) | Counter names are ugly | Major | . | Owen O'Malley | David Bowen |
| [HADOOP-432](https://issues.apache.org/jira/browse/HADOOP-432) | support undelete, snapshots, or other mechanism to recover lost files | Major | . | Yoram Arnon | Doug Cutting |
-| [HADOOP-333](https://issues.apache.org/jira/browse/HADOOP-333) | we should have some checks that the sort benchmark generates correct outputs | Major | . | Owen O'Malley | Arun C Murthy |
-| [HADOOP-248](https://issues.apache.org/jira/browse/HADOOP-248) | locating map outputs via random probing is inefficient | Major | . | Owen O'Malley | Devaraj Das |
+| [HADOOP-1033](https://issues.apache.org/jira/browse/HADOOP-1033) | Rewrite AmazonEC2 wiki page | Minor | scripts | Tom White | Tom White |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1056](https://issues.apache.org/jira/browse/HADOOP-1056) | Decommission only recognizes IP addesses in hosts and exclude files on refresh. | Major | . | Wendy Chien | Wendy Chien |
-| [HADOOP-1049](https://issues.apache.org/jira/browse/HADOOP-1049) | race condition in setting up ipc connections | Major | ipc | Owen O'Malley | Devaraj Das |
-| [HADOOP-1046](https://issues.apache.org/jira/browse/HADOOP-1046) | Datanode should periodically clean up /tmp from partially received (and not completed) block files | Major | . | Andrzej Bialecki | Andrzej Bialecki |
-| [HADOOP-1044](https://issues.apache.org/jira/browse/HADOOP-1044) | TestDecommission fails because it attempts to transfer block to a dead datanode | Major | test | Wendy Chien | Wendy Chien |
-| [HADOOP-1039](https://issues.apache.org/jira/browse/HADOOP-1039) | Reduce the time taken by TestCheckpoint | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1037](https://issues.apache.org/jira/browse/HADOOP-1037) | bin/slaves.sh not compatible with /bin/dash | Major | . | Doug Cutting | |
-| [HADOOP-1036](https://issues.apache.org/jira/browse/HADOOP-1036) | task gets lost during assignment | Critical | . | Owen O'Malley | Arun C Murthy |
-| [HADOOP-1034](https://issues.apache.org/jira/browse/HADOOP-1034) | RuntimeException and Error not catched in DataNode.DataXceiver.run() | Major | . | Philippe Gassmann | |
-| [HADOOP-1029](https://issues.apache.org/jira/browse/HADOOP-1029) | streaming doesn't work with multiple maps | Blocker | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1027](https://issues.apache.org/jira/browse/HADOOP-1027) | Fix the RAM FileSystem/Merge problems (reported in HADOOP-1014) | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-1021](https://issues.apache.org/jira/browse/HADOOP-1021) | TestMiniMRLocalFS and TestMiniMRCaching broken on Windows | Major | test | Nigel Daley | |
-| [HADOOP-1020](https://issues.apache.org/jira/browse/HADOOP-1020) | Path class on Windows seems broken | Major | . | Nigel Daley | Doug Cutting |
-| [HADOOP-1010](https://issues.apache.org/jira/browse/HADOOP-1010) | getReordReader methof of InputFormat class should handle null reporter argument | Major | . | Runping Qi | Runping Qi |
-| [HADOOP-1006](https://issues.apache.org/jira/browse/HADOOP-1006) | The "-local" option does work properly with test programs | Minor | test | Gautam Kowshik | Doug Cutting |
-| [HADOOP-1000](https://issues.apache.org/jira/browse/HADOOP-1000) | Loggers in the Task framework should not write the the Tasks stderr | Major | . | Owen O'Malley | Arun C Murthy |
-| [HADOOP-994](https://issues.apache.org/jira/browse/HADOOP-994) | DFS Scalability : a BlockReport that returns large number of blocks-to-be-deleted cause datanode to lost connectivity to namenode | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-992](https://issues.apache.org/jira/browse/HADOOP-992) | The mini/mr cluster for testing always uses the local file system rather than the namenode that was passed in | Major | test | Owen O'Malley | Owen O'Malley |
-| [HADOOP-990](https://issues.apache.org/jira/browse/HADOOP-990) | Datanode doesn't retry when write to one (full)drive fail | Major | . | Koji Noguchi | Raghu Angadi |
-| [HADOOP-973](https://issues.apache.org/jira/browse/HADOOP-973) | NPE in FSDataset during heavy Namenode load | Major | . | Nigel Daley | dhruba borthakur |
-| [HADOOP-947](https://issues.apache.org/jira/browse/HADOOP-947) | isReplicationInProgress() is very heavyweight | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-933](https://issues.apache.org/jira/browse/HADOOP-933) | Application defined InputSplits do not work | Major | . | Benjamin Reed | Owen O'Malley |
-| [HADOOP-923](https://issues.apache.org/jira/browse/HADOOP-923) | DFS Scalability: datanode heartbeat timeouts cause cascading timeouts of other datanodes | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-893](https://issues.apache.org/jira/browse/HADOOP-893) | dead datanode set should be maintained in the file handle or file system for hdfs | Major | . | Owen O'Malley | Raghu Angadi |
-| [HADOOP-878](https://issues.apache.org/jira/browse/HADOOP-878) | reducer NONE does not work with multiple maps | Minor | . | Mahadev konar | Arun C Murthy |
-| [HADOOP-803](https://issues.apache.org/jira/browse/HADOOP-803) | Reducing memory consumption on Namenode : Part 1 | Major | . | Raghu Angadi | Raghu Angadi |
| [HADOOP-761](https://issues.apache.org/jira/browse/HADOOP-761) | Unit tests should cleanup created files in /tmp. It causes tests to fail if more than one users run tests on same machine. | Minor | test | Sanjay Dahiya | Nigel Daley |
-| [HADOOP-654](https://issues.apache.org/jira/browse/HADOOP-654) | jobs fail with some hardware/system failures on a small number of nodes | Minor | . | Yoram Arnon | Arun C Murthy |
-| [HADOOP-649](https://issues.apache.org/jira/browse/HADOOP-649) | Jobs without any map and reduce operations seems to be lost after their execution | Major | . | Thomas Friol | Owen O'Malley |
-| [HADOOP-564](https://issues.apache.org/jira/browse/HADOOP-564) | we should use hdfs:// in all API URIs | Major | . | eric baldeschwieler | Wendy Chien |
+| [HADOOP-1010](https://issues.apache.org/jira/browse/HADOOP-1010) | getReordReader methof of InputFormat class should handle null reporter argument | Major | . | Runping Qi | Runping Qi |
+| [HADOOP-923](https://issues.apache.org/jira/browse/HADOOP-923) | DFS Scalability: datanode heartbeat timeouts cause cascading timeouts of other datanodes | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-476](https://issues.apache.org/jira/browse/HADOOP-476) | Streaming should check for correctness of the task | Major | . | arkady borkovsky | Arun C Murthy |
+| [HADOOP-973](https://issues.apache.org/jira/browse/HADOOP-973) | NPE in FSDataset during heavy Namenode load | Major | . | Nigel Daley | dhruba borthakur |
+| [HADOOP-649](https://issues.apache.org/jira/browse/HADOOP-649) | Jobs without any map and reduce operations seems to be lost after their execution | Major | . | Thomas Friol | Owen O'Malley |
+| [HADOOP-803](https://issues.apache.org/jira/browse/HADOOP-803) | Reducing memory consumption on Namenode : Part 1 | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1021](https://issues.apache.org/jira/browse/HADOOP-1021) | TestMiniMRLocalFS and TestMiniMRCaching broken on Windows | Major | test | Nigel Daley | |
+| [HADOOP-947](https://issues.apache.org/jira/browse/HADOOP-947) | isReplicationInProgress() is very heavyweight | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-442](https://issues.apache.org/jira/browse/HADOOP-442) | slaves file should include an 'exclude' section, to prevent "bad" datanodes and tasktrackers from disrupting a cluster | Major | conf | Yoram Arnon | Wendy Chien |
-| [HADOOP-338](https://issues.apache.org/jira/browse/HADOOP-338) | the number of maps in the JobConf does not match reality | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-933](https://issues.apache.org/jira/browse/HADOOP-933) | Application defined InputSplits do not work | Major | . | Benjamin Reed | Owen O'Malley |
+| [HADOOP-1006](https://issues.apache.org/jira/browse/HADOOP-1006) | The "-local" option does work properly with test programs | Minor | test | Gautam Kowshik | Doug Cutting |
+| [HADOOP-990](https://issues.apache.org/jira/browse/HADOOP-990) | Datanode doesn't retry when write to one (full)drive fail | Major | . | Koji Noguchi | Raghu Angadi |
+| [HADOOP-564](https://issues.apache.org/jira/browse/HADOOP-564) | we should use hdfs:// in all API URIs | Major | . | eric baldeschwieler | Wendy Chien |
+| [HADOOP-654](https://issues.apache.org/jira/browse/HADOOP-654) | jobs fail with some hardware/system failures on a small number of nodes | Minor | . | Yoram Arnon | Arun C Murthy |
+| [HADOOP-1029](https://issues.apache.org/jira/browse/HADOOP-1029) | streaming doesn't work with multiple maps | Blocker | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-1034](https://issues.apache.org/jira/browse/HADOOP-1034) | RuntimeException and Error not catched in DataNode.DataXceiver.run() | Major | . | Philippe Gassmann | |
+| [HADOOP-878](https://issues.apache.org/jira/browse/HADOOP-878) | reducer NONE does not work with multiple maps | Minor | . | Mahadev konar | Arun C Murthy |
+| [HADOOP-1039](https://issues.apache.org/jira/browse/HADOOP-1039) | Reduce the time taken by TestCheckpoint | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1027](https://issues.apache.org/jira/browse/HADOOP-1027) | Fix the RAM FileSystem/Merge problems (reported in HADOOP-1014) | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-1036](https://issues.apache.org/jira/browse/HADOOP-1036) | task gets lost during assignment | Critical | . | Owen O'Malley | Arun C Murthy |
+| [HADOOP-1044](https://issues.apache.org/jira/browse/HADOOP-1044) | TestDecommission fails because it attempts to transfer block to a dead datanode | Major | test | Wendy Chien | Wendy Chien |
| [HADOOP-109](https://issues.apache.org/jira/browse/HADOOP-109) | Blocks are not replicated when... | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1020](https://issues.apache.org/jira/browse/HADOOP-1020) | Path class on Windows seems broken | Major | . | Nigel Daley | Doug Cutting |
+| [HADOOP-1000](https://issues.apache.org/jira/browse/HADOOP-1000) | Loggers in the Task framework should not write the the Tasks stderr | Major | . | Owen O'Malley | Arun C Murthy |
+| [HADOOP-1037](https://issues.apache.org/jira/browse/HADOOP-1037) | bin/slaves.sh not compatible with /bin/dash | Major | . | Doug Cutting | |
+| [HADOOP-1046](https://issues.apache.org/jira/browse/HADOOP-1046) | Datanode should periodically clean up /tmp from partially received (and not completed) block files | Major | . | Andrzej Bialecki | Andrzej Bialecki |
+| [HADOOP-1049](https://issues.apache.org/jira/browse/HADOOP-1049) | race condition in setting up ipc connections | Major | ipc | Owen O'Malley | Devaraj Das |
+| [HADOOP-1056](https://issues.apache.org/jira/browse/HADOOP-1056) | Decommission only recognizes IP addesses in hosts and exclude files on refresh. | Major | . | Wendy Chien | Wendy Chien |
+| [HADOOP-994](https://issues.apache.org/jira/browse/HADOOP-994) | DFS Scalability : a BlockReport that returns large number of blocks-to-be-deleted cause datanode to lost connectivity to namenode | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-338](https://issues.apache.org/jira/browse/HADOOP-338) | the number of maps in the JobConf does not match reality | Major | . | Owen O'Malley | Owen O'Malley |
### TESTS:
@@ -121,15 +111,3 @@
| [HADOOP-1051](https://issues.apache.org/jira/browse/HADOOP-1051) | Add checkstyle target to ant build file | Major | build, test | Tom White | Tom White |
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.1/CHANGES.0.12.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.1/CHANGES.0.12.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.1/CHANGES.0.12.1.md
index 74a17c6..8853d99 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.1/CHANGES.0.12.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.1/CHANGES.0.12.1.md
@@ -20,74 +20,40 @@
## Release 0.12.1 - 2007-03-17
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1096](https://issues.apache.org/jira/browse/HADOOP-1096) | Rename InputArchive and OutputArchive and make them public | Major | record | Milind Bhandarkar | Milind Bhandarkar |
| [HADOOP-1053](https://issues.apache.org/jira/browse/HADOOP-1053) | Make Record I/O functionally modular from the rest of Hadoop | Major | record | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-1096](https://issues.apache.org/jira/browse/HADOOP-1096) | Rename InputArchive and OutputArchive and make them public | Major | record | Milind Bhandarkar | Milind Bhandarkar |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1129](https://issues.apache.org/jira/browse/HADOOP-1129) | The DFSClient hides IOExceptions in flush | Major | . | Owen O'Malley | Hairong Kuang |
-| [HADOOP-1128](https://issues.apache.org/jira/browse/HADOOP-1128) | Missing progress information in map tasks | Major | . | Andrzej Bialecki | Andrzej Bialecki |
-| [HADOOP-1126](https://issues.apache.org/jira/browse/HADOOP-1126) | Optimize CPU usage when cluster restarts | Major | . | dhruba borthakur | Hairong Kuang |
-| [HADOOP-1117](https://issues.apache.org/jira/browse/HADOOP-1117) | DFS Scalability: When the namenode is restarted it consumes 80% CPU | Blocker | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1115](https://issues.apache.org/jira/browse/HADOOP-1115) | copyToLocal doesn't copy directories | Blocker | . | Nigel Daley | |
-| [HADOOP-1112](https://issues.apache.org/jira/browse/HADOOP-1112) | Race condition in Hadoop metrics | Major | . | David Bowen | |
-| [HADOOP-1109](https://issues.apache.org/jira/browse/HADOOP-1109) | Streaming, NPE when reading sequencefile | Major | . | Koji Noguchi | |
-| [HADOOP-1108](https://issues.apache.org/jira/browse/HADOOP-1108) | Checksumed file system should retry reading if a different replica is found when handle ChecksumException | Blocker | . | dhruba borthakur | Hairong Kuang |
-| [HADOOP-1099](https://issues.apache.org/jira/browse/HADOOP-1099) | NullPointerException in JobInProgress.getTaskInProgress | Major | . | Nigel Daley | Gautam Kowshik |
-| [HADOOP-1092](https://issues.apache.org/jira/browse/HADOOP-1092) | NullPointerException in HeartbeatMonitor thread | Blocker | . | Nigel Daley | Hairong Kuang |
-| [HADOOP-1091](https://issues.apache.org/jira/browse/HADOOP-1091) | NPE from Simon in JT stdout | Major | . | David Bowen | David Bowen |
-| [HADOOP-1089](https://issues.apache.org/jira/browse/HADOOP-1089) | The c++ version of write and read v-int don't agree with the java versions | Major | record | Owen O'Malley | Milind Bhandarkar |
-| [HADOOP-1088](https://issues.apache.org/jira/browse/HADOOP-1088) | Csv and Xml serialization for buffers do not work for byte value of -1 | Blocker | record | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-1035](https://issues.apache.org/jira/browse/HADOOP-1035) | StackOverflowError in FSDataSet | Blocker | . | Philippe Gassmann | Raghu Angadi |
+| [HADOOP-1067](https://issues.apache.org/jira/browse/HADOOP-1067) | Compile fails if Checkstyle jar is present in lib directory | Major | build | Tom White | Tom White |
+| [HADOOP-1060](https://issues.apache.org/jira/browse/HADOOP-1060) | IndexOutOfBoundsException in JobInProgress.updateTaskStatus leads to hung jobs | Blocker | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-1077](https://issues.apache.org/jira/browse/HADOOP-1077) | Race condition in fetching map outputs (might lead to hung reduces) | Blocker | . | Devaraj Das | Devaraj Das |
| [HADOOP-1083](https://issues.apache.org/jira/browse/HADOOP-1083) | Replication not occuring after cluster restart when datanodes missing | Blocker | . | Nigel Daley | Hairong Kuang |
| [HADOOP-1082](https://issues.apache.org/jira/browse/HADOOP-1082) | NullpointerException in ChecksumFileSystem$FSInputChecker.seek | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1088](https://issues.apache.org/jira/browse/HADOOP-1088) | Csv and Xml serialization for buffers do not work for byte value of -1 | Blocker | record | Milind Bhandarkar | Milind Bhandarkar |
| [HADOOP-1080](https://issues.apache.org/jira/browse/HADOOP-1080) | Cygwin path translation should occur earlier in bin/hadoop | Major | scripts | Andrzej Bialecki | |
-| [HADOOP-1077](https://issues.apache.org/jira/browse/HADOOP-1077) | Race condition in fetching map outputs (might lead to hung reduces) | Blocker | . | Devaraj Das | Devaraj Das |
+| [HADOOP-1091](https://issues.apache.org/jira/browse/HADOOP-1091) | NPE from Simon in JT stdout | Major | . | David Bowen | David Bowen |
+| [HADOOP-1092](https://issues.apache.org/jira/browse/HADOOP-1092) | NullPointerException in HeartbeatMonitor thread | Blocker | . | Nigel Daley | Hairong Kuang |
+| [HADOOP-1112](https://issues.apache.org/jira/browse/HADOOP-1112) | Race condition in Hadoop metrics | Major | . | David Bowen | |
+| [HADOOP-1108](https://issues.apache.org/jira/browse/HADOOP-1108) | Checksumed file system should retry reading if a different replica is found when handle ChecksumException | Blocker | . | dhruba borthakur | Hairong Kuang |
| [HADOOP-1070](https://issues.apache.org/jira/browse/HADOOP-1070) | Number of racks and datanode double temporarily when upgrading from 0.10.1 to 0.11.2 | Blocker | . | Nigel Daley | Konstantin Shvachko |
-| [HADOOP-1067](https://issues.apache.org/jira/browse/HADOOP-1067) | Compile fails if Checkstyle jar is present in lib directory | Major | build | Tom White | Tom White |
-| [HADOOP-1060](https://issues.apache.org/jira/browse/HADOOP-1060) | IndexOutOfBoundsException in JobInProgress.updateTaskStatus leads to hung jobs | Blocker | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1035](https://issues.apache.org/jira/browse/HADOOP-1035) | StackOverflowError in FSDataSet | Blocker | . | Philippe Gassmann | Raghu Angadi |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-1099](https://issues.apache.org/jira/browse/HADOOP-1099) | NullPointerException in JobInProgress.getTaskInProgress | Major | . | Nigel Daley | Gautam Kowshik |
+| [HADOOP-1115](https://issues.apache.org/jira/browse/HADOOP-1115) | copyToLocal doesn't copy directories | Blocker | . | Nigel Daley | |
+| [HADOOP-1109](https://issues.apache.org/jira/browse/HADOOP-1109) | Streaming, NPE when reading sequencefile | Major | . | Koji Noguchi | |
+| [HADOOP-1117](https://issues.apache.org/jira/browse/HADOOP-1117) | DFS Scalability: When the namenode is restarted it consumes 80% CPU | Blocker | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1089](https://issues.apache.org/jira/browse/HADOOP-1089) | The c++ version of write and read v-int don't agree with the java versions | Major | record | Owen O'Malley | Milind Bhandarkar |
+| [HADOOP-1128](https://issues.apache.org/jira/browse/HADOOP-1128) | Missing progress information in map tasks | Major | . | Andrzej Bialecki | Andrzej Bialecki |
+| [HADOOP-1129](https://issues.apache.org/jira/browse/HADOOP-1129) | The DFSClient hides IOExceptions in flush | Major | . | Owen O'Malley | Hairong Kuang |
+| [HADOOP-1126](https://issues.apache.org/jira/browse/HADOOP-1126) | Optimize CPU usage when cluster restarts | Major | . | dhruba borthakur | Hairong Kuang |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.2/CHANGES.0.12.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.2/CHANGES.0.12.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.2/CHANGES.0.12.2.md
index e70e14b..341610a 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.2/CHANGES.0.12.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.2/CHANGES.0.12.2.md
@@ -20,55 +20,15 @@
## Release 0.12.2 - 2007-03-23
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1150](https://issues.apache.org/jira/browse/HADOOP-1150) | Streaming -reducer and -mapper no longer have defaults | Major | . | Nigel Daley | Owen O'Malley |
+| [HADOOP-1135](https://issues.apache.org/jira/browse/HADOOP-1135) | A block report processing may incorrectly cause the namenode to delete blocks | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-1145](https://issues.apache.org/jira/browse/HADOOP-1145) | XmlRecordInput class should be public | Major | record | Runping Qi | Milind Bhandarkar |
| [HADOOP-1140](https://issues.apache.org/jira/browse/HADOOP-1140) | Deadlock bug involving the o.a.h.metrics package | Major | metrics | David Bowen | David Bowen |
-| [HADOOP-1135](https://issues.apache.org/jira/browse/HADOOP-1135) | A block report processing may incorrectly cause the namenode to delete blocks | Major | . | dhruba borthakur | dhruba borthakur |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-1150](https://issues.apache.org/jira/browse/HADOOP-1150) | Streaming -reducer and -mapper no longer have defaults | Major | . | Nigel Daley | Owen O'Malley |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.3/CHANGES.0.12.3.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.3/CHANGES.0.12.3.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.3/CHANGES.0.12.3.md
index 0bba5ae..9bce386 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.3/CHANGES.0.12.3.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.12.3/CHANGES.0.12.3.md
@@ -20,59 +20,19 @@
## Release 0.12.3 - 2007-04-06
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1192](https://issues.apache.org/jira/browse/HADOOP-1192) | Du command takes a noticable longer time to execute on a large dfs than the 0.11 release | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1191](https://issues.apache.org/jira/browse/HADOOP-1191) | MapTask should wait for the status reporting thread to die before invoking the TaskUmbilicalProtocol.done(taskid) | Major | . | Devaraj Das | Doug Cutting |
-| [HADOOP-1179](https://issues.apache.org/jira/browse/HADOOP-1179) | task Tracker should be restarted if its jetty http server cannot serve get-map-output files | Major | . | Runping Qi | Devaraj Das |
-| [HADOOP-1177](https://issues.apache.org/jira/browse/HADOOP-1177) | Lack of logging of exceptions in MapOutputLocation.getFile | Major | . | Owen O'Malley | Devaraj Das |
-| [HADOOP-1175](https://issues.apache.org/jira/browse/HADOOP-1175) | the user output/logs are broken from the web ui | Major | . | Owen O'Malley | Arun C Murthy |
| [HADOOP-1162](https://issues.apache.org/jira/browse/HADOOP-1162) | Record IO: seariliizing a byte buffer to CSV fails if buffer contains bytes less than 16. | Major | . | David Bowen | Milind Bhandarkar |
| [HADOOP-1123](https://issues.apache.org/jira/browse/HADOOP-1123) | LocalFileSystem gets a NullPointerException when tries to recover from ChecksumError | Major | fs | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1177](https://issues.apache.org/jira/browse/HADOOP-1177) | Lack of logging of exceptions in MapOutputLocation.getFile | Major | . | Owen O'Malley | Devaraj Das |
+| [HADOOP-1175](https://issues.apache.org/jira/browse/HADOOP-1175) | the user output/logs are broken from the web ui | Major | . | Owen O'Malley | Arun C Murthy |
+| [HADOOP-1191](https://issues.apache.org/jira/browse/HADOOP-1191) | MapTask should wait for the status reporting thread to die before invoking the TaskUmbilicalProtocol.done(taskid) | Major | . | Devaraj Das | Doug Cutting |
+| [HADOOP-1192](https://issues.apache.org/jira/browse/HADOOP-1192) | Du command takes a noticable longer time to execute on a large dfs than the 0.11 release | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-1105](https://issues.apache.org/jira/browse/HADOOP-1105) | Reducers don't make "progress" while iterating through values | Major | . | Owen O'Malley | Owen O'Malley |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-1179](https://issues.apache.org/jira/browse/HADOOP-1179) | task Tracker should be restarted if its jetty http server cannot serve get-map-output files | Major | . | Runping Qi | Devaraj Das |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.13.0/CHANGES.0.13.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.13.0/CHANGES.0.13.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.13.0/CHANGES.0.13.0.md
index d79fb5e..076044c 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.13.0/CHANGES.0.13.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.13.0/CHANGES.0.13.0.md
@@ -20,29 +20,19 @@
## Release 0.13.0 - 2007-06-08
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1251](https://issues.apache.org/jira/browse/HADOOP-1251) | A method to get the InputSplit from a Mapper | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1247](https://issues.apache.org/jira/browse/HADOOP-1247) | Make Hadoop Abacus work with Hadoop Streaming | Major | . | Runping Qi | Runping Qi |
-| [HADOOP-1217](https://issues.apache.org/jira/browse/HADOOP-1217) | Specify a junit test timeout in build.xml files | Minor | build | Nigel Daley | Nigel Daley |
-| [HADOOP-1216](https://issues.apache.org/jira/browse/HADOOP-1216) | Hadoop should support reduce none option | Major | . | Runping Qi | Runping Qi |
| [HADOOP-1120](https://issues.apache.org/jira/browse/HADOOP-1120) | Contribute some code helping implement map/reduce apps for joining data from multiple sources | Major | . | Runping Qi | Runping Qi |
-| [HADOOP-1111](https://issues.apache.org/jira/browse/HADOOP-1111) | Job completion notification to a job configured URL | Major | . | Alejandro Abdelnur | |
| [HADOOP-702](https://issues.apache.org/jira/browse/HADOOP-702) | DFS Upgrade Proposal | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1217](https://issues.apache.org/jira/browse/HADOOP-1217) | Specify a junit test timeout in build.xml files | Minor | build | Nigel Daley | Nigel Daley |
+| [HADOOP-1251](https://issues.apache.org/jira/browse/HADOOP-1251) | A method to get the InputSplit from a Mapper | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1111](https://issues.apache.org/jira/browse/HADOOP-1111) | Job completion notification to a job configured URL | Major | . | Alejandro Abdelnur | |
+| [HADOOP-1216](https://issues.apache.org/jira/browse/HADOOP-1216) | Hadoop should support reduce none option | Major | . | Runping Qi | Runping Qi |
+| [HADOOP-1247](https://issues.apache.org/jira/browse/HADOOP-1247) | Make Hadoop Abacus work with Hadoop Streaming | Major | . | Runping Qi | Runping Qi |
| [HADOOP-485](https://issues.apache.org/jira/browse/HADOOP-485) | allow a different comparator for grouping keys in calls to reduce | Major | . | Owen O'Malley | Tahir Hashmi |
@@ -50,152 +40,134 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1326](https://issues.apache.org/jira/browse/HADOOP-1326) | Return the RunningJob from JobClient.runJob | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1324](https://issues.apache.org/jira/browse/HADOOP-1324) | FSError encountered by one running task should not be fatal to other tasks on that node | Major | . | Devaraj Das | Arun C Murthy |
-| [HADOOP-1315](https://issues.apache.org/jira/browse/HADOOP-1315) | Hadoop Streaming code clean up | Major | . | Runping Qi | Runping Qi |
-| [HADOOP-1308](https://issues.apache.org/jira/browse/HADOOP-1308) | Tighten generic Class restrictions in JobConf.java | Minor | . | Michael Bieniosek | Michael Bieniosek |
-| [HADOOP-1304](https://issues.apache.org/jira/browse/HADOOP-1304) | MAX\_TASK\_FAILURES should be configurable | Major | . | Christian Kunz | Devaraj Das |
-| [HADOOP-1290](https://issues.apache.org/jira/browse/HADOOP-1290) | Move Hadoop Abacus to hadoop.mapred.lib | Major | . | Runping Qi | |
-| [HADOOP-1284](https://issues.apache.org/jira/browse/HADOOP-1284) | clean up the protocol between stream mapper/reducer and the framework | Major | . | Runping Qi | Runping Qi |
-| [HADOOP-1276](https://issues.apache.org/jira/browse/HADOOP-1276) | TaskTracker expiry interval is not configurable | Major | . | Alejandro Abdelnur | Arun C Murthy |
-| [HADOOP-1270](https://issues.apache.org/jira/browse/HADOOP-1270) | Randomize the fetch of map outputs | Major | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1263](https://issues.apache.org/jira/browse/HADOOP-1263) | retry logic when dfs exist or open fails temporarily, e.g because of timeout | Major | . | Christian Kunz | Hairong Kuang |
-| [HADOOP-1260](https://issues.apache.org/jira/browse/HADOOP-1260) | need code review guidelines | Major | build | Nigel Daley | Nigel Daley |
-| [HADOOP-1250](https://issues.apache.org/jira/browse/HADOOP-1250) | Remove the MustangFile class from streaming and promote the chmod into FileUtils | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1214](https://issues.apache.org/jira/browse/HADOOP-1214) | the first step for streaming clean up | Major | . | Runping Qi | Runping Qi |
-| [HADOOP-1213](https://issues.apache.org/jira/browse/HADOOP-1213) | When RPC call fails then log call message detail | Minor | ipc | Nigel Daley | Doug Cutting |
-| [HADOOP-1194](https://issues.apache.org/jira/browse/HADOOP-1194) | map output should not do block level compression | Major | . | Runping Qi | Arun C Murthy |
-| [HADOOP-1190](https://issues.apache.org/jira/browse/HADOOP-1190) | Fix unchecked warnings | Major | . | Tom White | Tom White |
-| [HADOOP-1167](https://issues.apache.org/jira/browse/HADOOP-1167) | InMemoryFileSystem uses synchronizedtMaps with maps that are locked anyways | Minor | fs | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1166](https://issues.apache.org/jira/browse/HADOOP-1166) | Pull the NullOutputFormat into the lib package | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1165](https://issues.apache.org/jira/browse/HADOOP-1165) | Code for toString in code generated by Record I/O Compiler can be generic | Minor | record | Milind Bhandarkar | Milind Bhandarkar |
-| [HADOOP-1161](https://issues.apache.org/jira/browse/HADOOP-1161) | need improved release process | Major | build | Doug Cutting | Doug Cutting |
-| [HADOOP-1148](https://issues.apache.org/jira/browse/HADOOP-1148) | re-indent all code | Minor | . | Doug Cutting | Doug Cutting |
-| [HADOOP-1144](https://issues.apache.org/jira/browse/HADOOP-1144) | Hadoop should allow a configurable percentage of failed map tasks before declaring a job failed. | Major | . | Christian Kunz | Arun C Murthy |
-| [HADOOP-1133](https://issues.apache.org/jira/browse/HADOOP-1133) | Tools to analyze and debug namenode on a production cluster | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1131](https://issues.apache.org/jira/browse/HADOOP-1131) | Add a closeAll() static method to FileSystem | Minor | . | Philippe Gassmann | |
-| [HADOOP-1127](https://issues.apache.org/jira/browse/HADOOP-1127) | Speculative Execution and output of Reduce tasks | Major | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1116](https://issues.apache.org/jira/browse/HADOOP-1116) | Add maxmemory="256m" in the junit call of build-contrib.xml | Major | build | Philippe Gassmann | |
| [HADOOP-1101](https://issues.apache.org/jira/browse/HADOOP-1101) | Add more statistics in the web-ui to do with tasks | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-1116](https://issues.apache.org/jira/browse/HADOOP-1116) | Add maxmemory="256m" in the junit call of build-contrib.xml | Major | build | Philippe Gassmann | |
| [HADOOP-1094](https://issues.apache.org/jira/browse/HADOOP-1094) | Optimize readFields and write methods in record I/O | Major | record | Milind Bhandarkar | Milind Bhandarkar |
| [HADOOP-1068](https://issues.apache.org/jira/browse/HADOOP-1068) | Improve error message for 0 datanode case | Major | . | Owen O'Malley | dhruba borthakur |
+| [HADOOP-1131](https://issues.apache.org/jira/browse/HADOOP-1131) | Add a closeAll() static method to FileSystem | Minor | . | Philippe Gassmann | |
+| [HADOOP-1165](https://issues.apache.org/jira/browse/HADOOP-1165) | Code for toString in code generated by Record I/O Compiler can be generic | Minor | record | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-1166](https://issues.apache.org/jira/browse/HADOOP-1166) | Pull the NullOutputFormat into the lib package | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1167](https://issues.apache.org/jira/browse/HADOOP-1167) | InMemoryFileSystem uses synchronizedtMaps with maps that are locked anyways | Minor | fs | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1194](https://issues.apache.org/jira/browse/HADOOP-1194) | map output should not do block level compression | Major | . | Runping Qi | Arun C Murthy |
+| [HADOOP-1133](https://issues.apache.org/jira/browse/HADOOP-1133) | Tools to analyze and debug namenode on a production cluster | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-988](https://issues.apache.org/jira/browse/HADOOP-988) | Namenode should use single map for block to its meta data. | Major | . | Raghu Angadi | Raghu Angadi |
| [HADOOP-978](https://issues.apache.org/jira/browse/HADOOP-978) | AlreadyBeingCreatedException detail message could contain more useful info | Minor | . | Nigel Daley | Konstantin Shvachko |
| [HADOOP-971](https://issues.apache.org/jira/browse/HADOOP-971) | DFS Scalabilty: Improve name node performance by adding a hostname to datanodes map | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-968](https://issues.apache.org/jira/browse/HADOOP-968) | Reduce shuffle and merge should be done a child JVM | Major | . | Owen O'Malley | Devaraj Das |
| [HADOOP-819](https://issues.apache.org/jira/browse/HADOOP-819) | LineRecordWriter should not always insert tab char between key and value | Major | . | Runping Qi | Runping Qi |
+| [HADOOP-1213](https://issues.apache.org/jira/browse/HADOOP-1213) | When RPC call fails then log call message detail | Minor | ipc | Nigel Daley | Doug Cutting |
+| [HADOOP-1250](https://issues.apache.org/jira/browse/HADOOP-1250) | Remove the MustangFile class from streaming and promote the chmod into FileUtils | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1214](https://issues.apache.org/jira/browse/HADOOP-1214) | the first step for streaming clean up | Major | . | Runping Qi | Runping Qi |
+| [HADOOP-1148](https://issues.apache.org/jira/browse/HADOOP-1148) | re-indent all code | Minor | . | Doug Cutting | Doug Cutting |
+| [HADOOP-968](https://issues.apache.org/jira/browse/HADOOP-968) | Reduce shuffle and merge should be done a child JVM | Major | . | Owen O'Malley | Devaraj Das |
+| [HADOOP-1260](https://issues.apache.org/jira/browse/HADOOP-1260) | need code review guidelines | Major | build | Nigel Daley | Nigel Daley |
+| [HADOOP-1190](https://issues.apache.org/jira/browse/HADOOP-1190) | Fix unchecked warnings | Major | . | Tom White | Tom White |
+| [HADOOP-1127](https://issues.apache.org/jira/browse/HADOOP-1127) | Speculative Execution and output of Reduce tasks | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-1284](https://issues.apache.org/jira/browse/HADOOP-1284) | clean up the protocol between stream mapper/reducer and the framework | Major | . | Runping Qi | Runping Qi |
+| [HADOOP-1290](https://issues.apache.org/jira/browse/HADOOP-1290) | Move Hadoop Abacus to hadoop.mapred.lib | Major | . | Runping Qi | |
+| [HADOOP-1304](https://issues.apache.org/jira/browse/HADOOP-1304) | MAX\_TASK\_FAILURES should be configurable | Major | . | Christian Kunz | Devaraj Das |
+| [HADOOP-1308](https://issues.apache.org/jira/browse/HADOOP-1308) | Tighten generic Class restrictions in JobConf.java | Minor | . | Michael Bieniosek | Michael Bieniosek |
+| [HADOOP-1315](https://issues.apache.org/jira/browse/HADOOP-1315) | Hadoop Streaming code clean up | Major | . | Runping Qi | Runping Qi |
+| [HADOOP-1144](https://issues.apache.org/jira/browse/HADOOP-1144) | Hadoop should allow a configurable percentage of failed map tasks before declaring a job failed. | Major | . | Christian Kunz | Arun C Murthy |
+| [HADOOP-1263](https://issues.apache.org/jira/browse/HADOOP-1263) | retry logic when dfs exist or open fails temporarily, e.g because of timeout | Major | . | Christian Kunz | Hairong Kuang |
+| [HADOOP-1276](https://issues.apache.org/jira/browse/HADOOP-1276) | TaskTracker expiry interval is not configurable | Major | . | Alejandro Abdelnur | Arun C Murthy |
+| [HADOOP-1326](https://issues.apache.org/jira/browse/HADOOP-1326) | Return the RunningJob from JobClient.runJob | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1270](https://issues.apache.org/jira/browse/HADOOP-1270) | Randomize the fetch of map outputs | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-1324](https://issues.apache.org/jira/browse/HADOOP-1324) | FSError encountered by one running task should not be fatal to other tasks on that node | Major | . | Devaraj Das | Arun C Murthy |
+| [HADOOP-1161](https://issues.apache.org/jira/browse/HADOOP-1161) | need improved release process | Major | build | Doug Cutting | Doug Cutting |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-1452](https://issues.apache.org/jira/browse/HADOOP-1452) | map output transfers of more than 2^31 bytes output are failing | Blocker | . | Christian Kunz | Owen O'Malley |
-| [HADOOP-1435](https://issues.apache.org/jira/browse/HADOOP-1435) | FileSystem.globPaths should not create a Path from an empty string | Blocker | fs | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1431](https://issues.apache.org/jira/browse/HADOOP-1431) | Map tasks can't timeout for failing to call progress | Blocker | . | Owen O'Malley | Arun C Murthy |
-| [HADOOP-1427](https://issues.apache.org/jira/browse/HADOOP-1427) | Typo in GzipCodec.createInputStream - bufferSize | Blocker | io | Espen Amble Kolstad | Espen Amble Kolstad |
-| [HADOOP-1411](https://issues.apache.org/jira/browse/HADOOP-1411) | AlreadyBeingCreatedException from task retries | Blocker | . | Nigel Daley | Hairong Kuang |
-| [HADOOP-1407](https://issues.apache.org/jira/browse/HADOOP-1407) | Failed tasks not killing job | Blocker | . | Nigel Daley | Arun C Murthy |
-| [HADOOP-1388](https://issues.apache.org/jira/browse/HADOOP-1388) | Possible Null Pointer Dereference in taskdetails.jsp | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-1386](https://issues.apache.org/jira/browse/HADOOP-1386) | The constructor of Path should not take an empty string as a parameter | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1385](https://issues.apache.org/jira/browse/HADOOP-1385) | MD5Hash has a bad hash function | Major | io | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1369](https://issues.apache.org/jira/browse/HADOOP-1369) | Inconsistent synchronization of TaskTracker fields | Blocker | . | Nigel Daley | Owen O'Malley |
-| [HADOOP-1368](https://issues.apache.org/jira/browse/HADOOP-1368) | Inconsistent synchronization of 3 fields in JobInProgress.java | Blocker | . | Nigel Daley | Owen O'Malley |
-| [HADOOP-1363](https://issues.apache.org/jira/browse/HADOOP-1363) | waitForCompletion() calls Thread.sleep() with a lock held | Blocker | . | Nigel Daley | Owen O'Malley |
-| [HADOOP-1361](https://issues.apache.org/jira/browse/HADOOP-1361) | seek calls in 3 io classes ignore result of skipBytes(int) | Blocker | io | Nigel Daley | Hairong Kuang |
-| [HADOOP-1358](https://issues.apache.org/jira/browse/HADOOP-1358) | seek call ignores result of skipBytes(int) | Blocker | . | Nigel Daley | Hairong Kuang |
-| [HADOOP-1356](https://issues.apache.org/jira/browse/HADOOP-1356) | ValueHistogram.addNextValue(Object) ignores return value of String.substring(int, int) | Blocker | . | Nigel Daley | Runping Qi |
-| [HADOOP-1354](https://issues.apache.org/jira/browse/HADOOP-1354) | Null pointer dereference of paths in FsShell.dus(String) | Blocker | fs | Nigel Daley | Hairong Kuang |
-| [HADOOP-1353](https://issues.apache.org/jira/browse/HADOOP-1353) | Null pointer dereference of nodeInfo in FSNamesystem.removeDatanode(DatanodeID) | Blocker | . | Nigel Daley | dhruba borthakur |
-| [HADOOP-1350](https://issues.apache.org/jira/browse/HADOOP-1350) | Shuffle started taking a very long time after the HADOOP-1176 fix | Blocker | . | Devaraj Das | Devaraj Das |
-| [HADOOP-1345](https://issues.apache.org/jira/browse/HADOOP-1345) | Checksum object does not get restored to the old state in retries when handle ChecksumException | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1332](https://issues.apache.org/jira/browse/HADOOP-1332) | Sporadic unit test failures (TestMiniMRClasspath, TestMiniMRLocalFS, TestMiniMRDFSCaching) | Blocker | . | Nigel Daley | Arun C Murthy |
-| [HADOOP-1322](https://issues.apache.org/jira/browse/HADOOP-1322) | Tasktracker blacklist leads to hung jobs in single-node cluster | Critical | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1312](https://issues.apache.org/jira/browse/HADOOP-1312) | heartbeat monitor thread goes away | Blocker | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1310](https://issues.apache.org/jira/browse/HADOOP-1310) | Fix unchecked warnings in aggregate code | Major | . | Tom White | Tom White |
-| [HADOOP-1299](https://issues.apache.org/jira/browse/HADOOP-1299) | Once RPC.stopClient has been called, RPC can not be used again | Minor | ipc | stack | stack |
-| [HADOOP-1297](https://issues.apache.org/jira/browse/HADOOP-1297) | datanode sending block reports to namenode once every second | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1294](https://issues.apache.org/jira/browse/HADOOP-1294) | Fix unchecked warnings in main Hadoop code under Java 6. | Major | test | Tom White | Tom White |
-| [HADOOP-1293](https://issues.apache.org/jira/browse/HADOOP-1293) | stderr from streaming skipped after first 20 lines. | Minor | . | Koji Noguchi | Koji Noguchi |
-| [HADOOP-1279](https://issues.apache.org/jira/browse/HADOOP-1279) | list of completed jobs purges jobs based on submission not on completion age | Major | . | Alejandro Abdelnur | Arun C Murthy |
-| [HADOOP-1278](https://issues.apache.org/jira/browse/HADOOP-1278) | Fix the per-job tasktracker 'blacklist' | Major | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1275](https://issues.apache.org/jira/browse/HADOOP-1275) | job notification property in hadoop-default.xml is misspelled | Trivial | . | Alejandro Abdelnur | |
-| [HADOOP-1272](https://issues.apache.org/jira/browse/HADOOP-1272) | Extract InnerClasses from FSNamesystem into separate classes | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1271](https://issues.apache.org/jira/browse/HADOOP-1271) | The StreamBaseRecordReader is unable to log record data that's not UTF-8 | Minor | . | Gautam Kowshik | Arun C Murthy |
-| [HADOOP-1262](https://issues.apache.org/jira/browse/HADOOP-1262) | file corruption detected because dfs client does not use replica blocks for checksum file | Major | . | dhruba borthakur | Hairong Kuang |
-| [HADOOP-1258](https://issues.apache.org/jira/browse/HADOOP-1258) | TestCheckpoint test case doesn't wait for MiniDFSCluster to be active | Trivial | test | Nigel Daley | Nigel Daley |
-| [HADOOP-1256](https://issues.apache.org/jira/browse/HADOOP-1256) | Dfs image loading and edits loading creates multiple instances of DatanodeDescriptor for the same datanode | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1255](https://issues.apache.org/jira/browse/HADOOP-1255) | Name-node falls into infinite loop trying to remove a dead node. | Blocker | . | Konstantin Shvachko | Hairong Kuang |
-| [HADOOP-1253](https://issues.apache.org/jira/browse/HADOOP-1253) | ConcurrentModificationException and NPE in JobControl | Minor | . | Johan Oskarsson | Johan Oskarsson |
-| [HADOOP-1252](https://issues.apache.org/jira/browse/HADOOP-1252) | Disk problems should be handled better by the MR framework | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-1244](https://issues.apache.org/jira/browse/HADOOP-1244) | stop-dfs.sh incorrectly specifies slaves file for stopping datanode | Minor | . | Michael Bieniosek | dhruba borthakur |
-| [HADOOP-1243](https://issues.apache.org/jira/browse/HADOOP-1243) | ClientProtocol.versionID should be 11 | Major | . | Konstantin Shvachko | dhruba borthakur |
-| [HADOOP-1242](https://issues.apache.org/jira/browse/HADOOP-1242) | dfs upgrade/downgrade problems | Blocker | . | Owen O'Malley | Konstantin Shvachko |
-| [HADOOP-1241](https://issues.apache.org/jira/browse/HADOOP-1241) | Null PointerException in processReport when namenode is restarted | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1239](https://issues.apache.org/jira/browse/HADOOP-1239) | Classes in src/test/testjar need package name | Trivial | test | Jim Kellerman | Jim Kellerman |
-| [HADOOP-1238](https://issues.apache.org/jira/browse/HADOOP-1238) | maps\_running metric is only updated at the end of the task | Minor | metrics | Michael Bieniosek | David Bowen |
-| [HADOOP-1224](https://issues.apache.org/jira/browse/HADOOP-1224) | "Browse the filesystem" link pointing to a dead data-node | Major | . | Konstantin Shvachko | Enis Soztutar |
-| [HADOOP-1219](https://issues.apache.org/jira/browse/HADOOP-1219) | Spurious progress messages should be discarded after a task is done | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-1218](https://issues.apache.org/jira/browse/HADOOP-1218) | In TaskTracker the access to RunningJob object is not synchronized in one place | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-1211](https://issues.apache.org/jira/browse/HADOOP-1211) | Remove deprecated constructor and unused static members in DataNode class | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1205](https://issues.apache.org/jira/browse/HADOOP-1205) | The open method of FSNamesystem should be synchronized | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1204](https://issues.apache.org/jira/browse/HADOOP-1204) | Re-factor InputFormat/RecordReader related classes | Major | . | Runping Qi | Runping Qi |
-| [HADOOP-1203](https://issues.apache.org/jira/browse/HADOOP-1203) | UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes | Major | test | Nigel Daley | Nigel Daley |
-| [HADOOP-1200](https://issues.apache.org/jira/browse/HADOOP-1200) | Datanode should periodically do a disk check | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1198](https://issues.apache.org/jira/browse/HADOOP-1198) | ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases | Major | test | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1189](https://issues.apache.org/jira/browse/HADOOP-1189) | Still seeing some unexpected 'No space left on device' exceptions | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1187](https://issues.apache.org/jira/browse/HADOOP-1187) | DFS Scalability: avoid scanning entire list of datanodes in getAdditionalBlocks | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1184](https://issues.apache.org/jira/browse/HADOOP-1184) | Decommission fails if a block that needs replication has only one replica | Major | . | dhruba borthakur | |
+| [HADOOP-1047](https://issues.apache.org/jira/browse/HADOOP-1047) | TestReplication fails because DFS does not guarantee all the replicas are placed when a file is closed | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1063](https://issues.apache.org/jira/browse/HADOOP-1063) | MiniDFSCluster exists a race condition that lead to data node resources are not properly released | Major | test | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1071](https://issues.apache.org/jira/browse/HADOOP-1071) | RPC$VersionMismatch exception is not fatal to JobTracker | Major | . | Nigel Daley | Tahir Hashmi |
+| [HADOOP-1064](https://issues.apache.org/jira/browse/HADOOP-1064) | dfsclient logging messages should have appropriate log levels | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1137](https://issues.apache.org/jira/browse/HADOOP-1137) | StatusHttpServer assumes that resources for /static are in files | Major | . | Benjamin Reed | |
+| [HADOOP-1122](https://issues.apache.org/jira/browse/HADOOP-1122) | Divide-by-zero exception in chooseTarget | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1085](https://issues.apache.org/jira/browse/HADOOP-1085) | Remove 'port rolling' from Mini{DFS\|MR}Cluster | Major | test | Arun C Murthy | Arun C Murthy |
+| [HADOOP-1153](https://issues.apache.org/jira/browse/HADOOP-1153) | DataNode and FSNamesystem don't shutdown cleanly | Major | . | Nigel Daley | Konstantin Shvachko |
+| [HADOOP-1146](https://issues.apache.org/jira/browse/HADOOP-1146) | "Reduce input records" counter name is misleading | Major | . | David Bowen | David Bowen |
+| [HADOOP-1164](https://issues.apache.org/jira/browse/HADOOP-1164) | TestReplicationPolicy doesn't use port 0 for the NameNode | Major | test | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1169](https://issues.apache.org/jira/browse/HADOOP-1169) | CopyFiles skips src files of s3 urls | Minor | util | stack | |
+| [HADOOP-1110](https://issues.apache.org/jira/browse/HADOOP-1110) | JobTracker WebUI "Map input records" a little off. | Trivial | . | Koji Noguchi | David Bowen |
| [HADOOP-1178](https://issues.apache.org/jira/browse/HADOOP-1178) | NullPointer Exception in org.apache.hadoop.dfs.NameNode.isDir on namenode restart | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1176](https://issues.apache.org/jira/browse/HADOOP-1176) | Reduce hang on huge map output | Major | . | Hairong Kuang | Arun C Murthy |
+| [HADOOP-1011](https://issues.apache.org/jira/browse/HADOOP-1011) | ConcurrentModificationException in JobHistory | Major | . | Nigel Daley | Tahir Hashmi |
+| [HADOOP-672](https://issues.apache.org/jira/browse/HADOOP-672) | dfs shell enhancements | Minor | . | Yoram Arnon | dhruba borthakur |
| [HADOOP-1170](https://issues.apache.org/jira/browse/HADOOP-1170) | Very high CPU usage on data nodes because of FSDataset.checkDataDir() on every connect | Major | . | Igor Bolotin | |
-| [HADOOP-1169](https://issues.apache.org/jira/browse/HADOOP-1169) | CopyFiles skips src files of s3 urls | Minor | util | stack | |
-| [HADOOP-1164](https://issues.apache.org/jira/browse/HADOOP-1164) | TestReplicationPolicy doesn't use port 0 for the NameNode | Major | test | Owen O'Malley | Owen O'Malley |
-| [HADOOP-1163](https://issues.apache.org/jira/browse/HADOOP-1163) | Ganglia metrics reporting is misconfigured | Minor | metrics | Michael Bieniosek | |
-| [HADOOP-1160](https://issues.apache.org/jira/browse/HADOOP-1160) | DistributedFileSystem doesn't close the RawDistributedFileSystem on close. | Blocker | . | Owen O'Malley | Hairong Kuang |
+| [HADOOP-1090](https://issues.apache.org/jira/browse/HADOOP-1090) | In SortValidator, the check for whether a file belongs to sort-input or sort-output dir is weak | Major | . | Devaraj Das | Arun C Murthy |
+| [HADOOP-1081](https://issues.apache.org/jira/browse/HADOOP-1081) | JAVA\_PLATFORM with spaces (i.e. Mac OS X-ppc-32) breaks bin/hadoop script | Major | scripts | Andrzej Bialecki | |
| [HADOOP-1156](https://issues.apache.org/jira/browse/HADOOP-1156) | NullPointerException in MiniDFSCluster | Major | . | Konstantin Shvachko | Hairong Kuang |
-| [HADOOP-1154](https://issues.apache.org/jira/browse/HADOOP-1154) | streaming hang. (PipeMapRed$MROutputThread gone) | Major | . | Koji Noguchi | Koji Noguchi |
-| [HADOOP-1153](https://issues.apache.org/jira/browse/HADOOP-1153) | DataNode and FSNamesystem don't shutdown cleanly | Major | . | Nigel Daley | Konstantin Shvachko |
-| [HADOOP-1152](https://issues.apache.org/jira/browse/HADOOP-1152) | Reduce task hang failing in MapOutputCopier.copyOutput | Major | . | Koji Noguchi | Tahir Hashmi |
+| [HADOOP-1163](https://issues.apache.org/jira/browse/HADOOP-1163) | Ganglia metrics reporting is misconfigured | Minor | metrics | Michael Bieniosek | |
+| [HADOOP-1187](https://issues.apache.org/jira/browse/HADOOP-1187) | DFS Scalability: avoid scanning entire list of datanodes in getAdditionalBlocks | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-1151](https://issues.apache.org/jira/browse/HADOOP-1151) | streaming PipeMapRed prints system info to stderr | Trivial | . | Koji Noguchi | Koji Noguchi |
+| [HADOOP-1203](https://issues.apache.org/jira/browse/HADOOP-1203) | UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes | Major | test | Nigel Daley | Nigel Daley |
| [HADOOP-1149](https://issues.apache.org/jira/browse/HADOOP-1149) | DFS Scalability: high cpu usage in addStoredBlock | Major | . | dhruba borthakur | Raghu Angadi |
-| [HADOOP-1146](https://issues.apache.org/jira/browse/HADOOP-1146) | "Reduce input records" counter name is misleading | Major | . | David Bowen | David Bowen |
-| [HADOOP-1137](https://issues.apache.org/jira/browse/HADOOP-1137) | StatusHttpServer assumes that resources for /static are in files | Major | . | Benjamin Reed | |
+| [HADOOP-1073](https://issues.apache.org/jira/browse/HADOOP-1073) | DFS Scalability: high CPU usage in choosing replication targets and file open | Major | . | dhruba borthakur | Hairong Kuang |
+| [HADOOP-1218](https://issues.apache.org/jira/browse/HADOOP-1218) | In TaskTracker the access to RunningJob object is not synchronized in one place | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-1219](https://issues.apache.org/jira/browse/HADOOP-1219) | Spurious progress messages should be discarded after a task is done | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-1198](https://issues.apache.org/jira/browse/HADOOP-1198) | ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases | Major | test | Arun C Murthy | Arun C Murthy |
+| [HADOOP-1211](https://issues.apache.org/jira/browse/HADOOP-1211) | Remove deprecated constructor and unused static members in DataNode class | Major | . | Konstantin Shvachko | Konstantin Shvachko |
| [HADOOP-1136](https://issues.apache.org/jira/browse/HADOOP-1136) | exception in UnderReplicatedBlocks:add when ther are more replicas of a block than required | Major | . | dhruba borthakur | Hairong Kuang |
-| [HADOOP-1122](https://issues.apache.org/jira/browse/HADOOP-1122) | Divide-by-zero exception in chooseTarget | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1001](https://issues.apache.org/jira/browse/HADOOP-1001) | the output of the map is not type checked against the specified types | Major | . | Owen O'Malley | Tahir Hashmi |
+| [HADOOP-1189](https://issues.apache.org/jira/browse/HADOOP-1189) | Still seeing some unexpected 'No space left on device' exceptions | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1204](https://issues.apache.org/jira/browse/HADOOP-1204) | Re-factor InputFormat/RecordReader related classes | Major | . | Runping Qi | Runping Qi |
| [HADOOP-1114](https://issues.apache.org/jira/browse/HADOOP-1114) | bin/hadoop script clobbers CLASSPATH | Minor | scripts | Michael Bieniosek | Doug Cutting |
-| [HADOOP-1110](https://issues.apache.org/jira/browse/HADOOP-1110) | JobTracker WebUI "Map input records" a little off. | Trivial | . | Koji Noguchi | David Bowen |
+| [HADOOP-1238](https://issues.apache.org/jira/browse/HADOOP-1238) | maps\_running metric is only updated at the end of the task | Minor | metrics | Michael Bieniosek | David Bowen |
| [HADOOP-1093](https://issues.apache.org/jira/browse/HADOOP-1093) | NNBench generates millions of NotReplicatedYetException in Namenode log | Major | . | Nigel Daley | dhruba borthakur |
-| [HADOOP-1090](https://issues.apache.org/jira/browse/HADOOP-1090) | In SortValidator, the check for whether a file belongs to sort-input or sort-output dir is weak | Major | . | Devaraj Das | Arun C Murthy |
-| [HADOOP-1085](https://issues.apache.org/jira/browse/HADOOP-1085) | Remove 'port rolling' from Mini{DFS\|MR}Cluster | Major | test | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1081](https://issues.apache.org/jira/browse/HADOOP-1081) | JAVA\_PLATFORM with spaces (i.e. Mac OS X-ppc-32) breaks bin/hadoop script | Major | scripts | Andrzej Bialecki | |
-| [HADOOP-1073](https://issues.apache.org/jira/browse/HADOOP-1073) | DFS Scalability: high CPU usage in choosing replication targets and file open | Major | . | dhruba borthakur | Hairong Kuang |
-| [HADOOP-1071](https://issues.apache.org/jira/browse/HADOOP-1071) | RPC$VersionMismatch exception is not fatal to JobTracker | Major | . | Nigel Daley | Tahir Hashmi |
-| [HADOOP-1064](https://issues.apache.org/jira/browse/HADOOP-1064) | dfsclient logging messages should have appropriate log levels | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1063](https://issues.apache.org/jira/browse/HADOOP-1063) | MiniDFSCluster exists a race condition that lead to data node resources are not properly released | Major | test | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1061](https://issues.apache.org/jira/browse/HADOOP-1061) | S3 listSubPaths bug | Critical | fs | Mike Smith | |
+| [HADOOP-1239](https://issues.apache.org/jira/browse/HADOOP-1239) | Classes in src/test/testjar need package name | Trivial | test | Jim Kellerman | Jim Kellerman |
+| [HADOOP-1243](https://issues.apache.org/jira/browse/HADOOP-1243) | ClientProtocol.versionID should be 11 | Major | . | Konstantin Shvachko | dhruba borthakur |
+| [HADOOP-1241](https://issues.apache.org/jira/browse/HADOOP-1241) | Null PointerException in processReport when namenode is restarted | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1244](https://issues.apache.org/jira/browse/HADOOP-1244) | stop-dfs.sh incorrectly specifies slaves file for stopping datanode | Minor | . | Michael Bieniosek | dhruba borthakur |
+| [HADOOP-1253](https://issues.apache.org/jira/browse/HADOOP-1253) | ConcurrentModificationException and NPE in JobControl | Minor | . | Johan Oskarsson | Johan Oskarsson |
+| [HADOOP-1256](https://issues.apache.org/jira/browse/HADOOP-1256) | Dfs image loading and edits loading creates multiple instances of DatanodeDescriptor for the same datanode | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1258](https://issues.apache.org/jira/browse/HADOOP-1258) | TestCheckpoint test case doesn't wait for MiniDFSCluster to be active | Trivial | test | Nigel Daley | Nigel Daley |
+| [HADOOP-1154](https://issues.apache.org/jira/browse/HADOOP-1154) | streaming hang. (PipeMapRed$MROutputThread gone) | Major | . | Koji Noguchi | Koji Noguchi |
+| [HADOOP-1275](https://issues.apache.org/jira/browse/HADOOP-1275) | job notification property in hadoop-default.xml is misspelled | Trivial | . | Alejandro Abdelnur | |
+| [HADOOP-1152](https://issues.apache.org/jira/browse/HADOOP-1152) | Reduce task hang failing in MapOutputCopier.copyOutput | Major | . | Koji Noguchi | Tahir Hashmi |
| [HADOOP-1050](https://issues.apache.org/jira/browse/HADOOP-1050) | Do not count lost tasktracker against the job | Major | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1047](https://issues.apache.org/jira/browse/HADOOP-1047) | TestReplication fails because DFS does not guarantee all the replicas are placed when a file is closed | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1011](https://issues.apache.org/jira/browse/HADOOP-1011) | ConcurrentModificationException in JobHistory | Major | . | Nigel Daley | Tahir Hashmi |
-| [HADOOP-1001](https://issues.apache.org/jira/browse/HADOOP-1001) | the output of the map is not type checked against the specified types | Major | . | Owen O'Malley | Tahir Hashmi |
-| [HADOOP-672](https://issues.apache.org/jira/browse/HADOOP-672) | dfs shell enhancements | Minor | . | Yoram Arnon | dhruba borthakur |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-1271](https://issues.apache.org/jira/browse/HADOOP-1271) | The StreamBaseRecordReader is unable to log record data that's not UTF-8 | Minor | . | Gautam Kowshik | Arun C Murthy |
+| [HADOOP-1262](https://issues.apache.org/jira/browse/HADOOP-1262) | file corruption detected because dfs client does not use replica blocks for checksum file | Major | . | dhruba borthakur | Hairong Kuang |
+| [HADOOP-1279](https://issues.apache.org/jira/browse/HADOOP-1279) | list of completed jobs purges jobs based on submission not on completion age | Major | . | Alejandro Abdelnur | Arun C Murthy |
+| [HADOOP-1176](https://issues.apache.org/jira/browse/HADOOP-1176) | Reduce hang on huge map output | Major | . | Hairong Kuang | Arun C Murthy |
+| [HADOOP-1293](https://issues.apache.org/jira/browse/HADOOP-1293) | stderr from streaming skipped after first 20 lines. | Minor | . | Koji Noguchi | Koji Noguchi |
+| [HADOOP-1297](https://issues.apache.org/jira/browse/HADOOP-1297) | datanode sending block reports to namenode once every second | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1294](https://issues.apache.org/jira/browse/HADOOP-1294) | Fix unchecked warnings in main Hadoop code under Java 6. | Major | test | Tom White | Tom White |
+| [HADOOP-1299](https://issues.apache.org/jira/browse/HADOOP-1299) | Once RPC.stopClient has been called, RPC can not be used again | Minor | ipc | stack | stack |
+| [HADOOP-1278](https://issues.apache.org/jira/browse/HADOOP-1278) | Fix the per-job tasktracker 'blacklist' | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-1272](https://issues.apache.org/jira/browse/HADOOP-1272) | Extract InnerClasses from FSNamesystem into separate classes | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1061](https://issues.apache.org/jira/browse/HADOOP-1061) | S3 listSubPaths bug | Critical | fs | Mike Smith | |
+| [HADOOP-1312](https://issues.apache.org/jira/browse/HADOOP-1312) | heartbeat monitor thread goes away | Blocker | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-1322](https://issues.apache.org/jira/browse/HADOOP-1322) | Tasktracker blacklist leads to hung jobs in single-node cluster | Critical | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-1184](https://issues.apache.org/jira/browse/HADOOP-1184) | Decommission fails if a block that needs replication has only one replica | Major | . | dhruba borthakur | |
+| [HADOOP-1224](https://issues.apache.org/jira/browse/HADOOP-1224) | "Browse the filesystem" link pointing to a dead data-node | Major | . | Konstantin Shvachko | Enis Soztutar |
+| [HADOOP-1200](https://issues.apache.org/jira/browse/HADOOP-1200) | Datanode should periodically do a disk check | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1252](https://issues.apache.org/jira/browse/HADOOP-1252) | Disk problems should be handled better by the MR framework | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-1310](https://issues.apache.org/jira/browse/HADOOP-1310) | Fix unchecked warnings in aggregate code | Major | . | Tom White | Tom White |
+| [HADOOP-1255](https://issues.apache.org/jira/browse/HADOOP-1255) | Name-node falls into infinite loop trying to remove a dead node. | Blocker | . | Konstantin Shvachko | Hairong Kuang |
+| [HADOOP-1160](https://issues.apache.org/jira/browse/HADOOP-1160) | DistributedFileSystem doesn't close the RawDistributedFileSystem on close. | Blocker | . | Owen O'Malley | Hairong Kuang |
+| [HADOOP-1350](https://issues.apache.org/jira/browse/HADOOP-1350) | Shuffle started taking a very long time after the HADOOP-1176 fix | Blocker | . | Devaraj Das | Devaraj Das |
+| [HADOOP-1345](https://issues.apache.org/jira/browse/HADOOP-1345) | Checksum object does not get restored to the old state in retries when handle ChecksumException | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1205](https://issues.apache.org/jira/browse/HADOOP-1205) | The open method of FSNamesystem should be synchronized | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1353](https://issues.apache.org/jira/browse/HADOOP-1353) | Null pointer dereference of nodeInfo in FSNamesystem.removeDatanode(DatanodeID) | Blocker | . | Nigel Daley | dhruba borthakur |
+| [HADOOP-1354](https://issues.apache.org/jira/browse/HADOOP-1354) | Null pointer dereference of paths in FsShell.dus(String) | Blocker | fs | Nigel Daley | Hairong Kuang |
+| [HADOOP-1358](https://issues.apache.org/jira/browse/HADOOP-1358) | seek call ignores result of skipBytes(int) | Blocker | . | Nigel Daley | Hairong Kuang |
+| [HADOOP-1356](https://issues.apache.org/jira/browse/HADOOP-1356) | ValueHistogram.addNextValue(Object) ignores return value of String.substring(int, int) | Blocker | . | Nigel Daley | Runping Qi |
+| [HADOOP-1363](https://issues.apache.org/jira/browse/HADOOP-1363) | waitForCompletion() calls Thread.sleep() with a lock held | Blocker | . | Nigel Daley | Owen O'Malley |
+| [HADOOP-1368](https://issues.apache.org/jira/browse/HADOOP-1368) | Inconsistent synchronization of 3 fields in JobInProgress.java | Blocker | . | Nigel Daley | Owen O'Malley |
+| [HADOOP-1369](https://issues.apache.org/jira/browse/HADOOP-1369) | Inconsistent synchronization of TaskTracker fields | Blocker | . | Nigel Daley | Owen O'Malley |
+| [HADOOP-1361](https://issues.apache.org/jira/browse/HADOOP-1361) | seek calls in 3 io classes ignore result of skipBytes(int) | Blocker | io | Nigel Daley | Hairong Kuang |
+| [HADOOP-1388](https://issues.apache.org/jira/browse/HADOOP-1388) | Possible Null Pointer Dereference in taskdetails.jsp | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-1385](https://issues.apache.org/jira/browse/HADOOP-1385) | MD5Hash has a bad hash function | Major | io | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1386](https://issues.apache.org/jira/browse/HADOOP-1386) | The constructor of Path should not take an empty string as a parameter | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1407](https://issues.apache.org/jira/browse/HADOOP-1407) | Failed tasks not killing job | Blocker | . | Nigel Daley | Arun C Murthy |
+| [HADOOP-1427](https://issues.apache.org/jira/browse/HADOOP-1427) | Typo in GzipCodec.createInputStream - bufferSize | Blocker | io | Espen Amble Kolstad | Espen Amble Kolstad |
+| [HADOOP-1435](https://issues.apache.org/jira/browse/HADOOP-1435) | FileSystem.globPaths should not create a Path from an empty string | Blocker | fs | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1411](https://issues.apache.org/jira/browse/HADOOP-1411) | AlreadyBeingCreatedException from task retries | Blocker | . | Nigel Daley | Hairong Kuang |
+| [HADOOP-1242](https://issues.apache.org/jira/browse/HADOOP-1242) | dfs upgrade/downgrade problems | Blocker | . | Owen O'Malley | Konstantin Shvachko |
+| [HADOOP-1332](https://issues.apache.org/jira/browse/HADOOP-1332) | Sporadic unit test failures (TestMiniMRClasspath, TestMiniMRLocalFS, TestMiniMRDFSCaching) | Blocker | . | Nigel Daley | Arun C Murthy |
+| [HADOOP-1431](https://issues.apache.org/jira/browse/HADOOP-1431) | Map tasks can't timeout for failing to call progress | Blocker | . | Owen O'Malley | Arun C Murthy |
+| [HADOOP-1452](https://issues.apache.org/jira/browse/HADOOP-1452) | map output transfers of more than 2^31 bytes output are failing | Blocker | . | Christian Kunz | Owen O'Malley |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.13.1/CHANGES.0.13.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.13.1/CHANGES.0.13.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.13.1/CHANGES.0.13.1.md
deleted file mode 100644
index 1892940..0000000
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.13.1/CHANGES.0.13.1.md
+++ /dev/null
@@ -1,64 +0,0 @@
-
-<!---
-# Licensed to the Apache Software Foundation (ASF) under one
-# or more contributor license agreements. See the NOTICE file
-# distributed with this work for additional information
-# regarding copyright ownership. The ASF licenses this file
-# to you under the Apache License, Version 2.0 (the
-# "License"); you may not use this file except in compliance
-# with the License. You may obtain a copy of the License at
-#
-# http://www.apache.org/licenses/LICENSE-2.0
-#
-# Unless required by applicable law or agreed to in writing, software
-# distributed under the License is distributed on an "AS IS" BASIS,
-# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-# See the License for the specific language governing permissions and
-# limitations under the License.
--->
-# Apache Hadoop Changelog
-
-## Release 0.13.1 - Unreleased
-
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### BUG FIXES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.13.1/RELEASENOTES.0.13.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.13.1/RELEASENOTES.0.13.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.13.1/RELEASENOTES.0.13.1.md
deleted file mode 100644
index 5b95ea1..0000000
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.13.1/RELEASENOTES.0.13.1.md
+++ /dev/null
@@ -1,24 +0,0 @@
-
-<!---
-# Licensed to the Apache Software Foundation (ASF) under one
-# or more contributor license agreements. See the NOTICE file
-# distributed with this work for additional information
-# regarding copyright ownership. The ASF licenses this file
-# to you under the Apache License, Version 2.0 (the
-# "License"); you may not use this file except in compliance
-# with the License. You may obtain a copy of the License at
-#
-# http://www.apache.org/licenses/LICENSE-2.0
-#
-# Unless required by applicable law or agreed to in writing, software
-# distributed under the License is distributed on an "AS IS" BASIS,
-# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-# See the License for the specific language governing permissions and
-# limitations under the License.
--->
-# Apache Hadoop 0.13.1 Release Notes
-
-These release notes cover new developer and user-facing incompatibilities, features, and major improvements.
-
-
-
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[27/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.1/CHANGES.0.23.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.1/CHANGES.0.23.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.1/CHANGES.0.23.1.md
index dd31769..c9172b5 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.1/CHANGES.0.23.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.1/CHANGES.0.23.1.md
@@ -24,467 +24,461 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8013](https://issues.apache.org/jira/browse/HADOOP-8013) | ViewFileSystem does not honor setVerifyChecksum | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7470](https://issues.apache.org/jira/browse/HADOOP-7470) | move up to Jackson 1.8.8 | Minor | util | Steve Loughran | Enis Soztutar |
| [HADOOP-7348](https://issues.apache.org/jira/browse/HADOOP-7348) | Modify the option of FsShell getmerge from [addnl] to [-nl] for consistency | Major | fs | XieXianshan | XieXianshan |
| [MAPREDUCE-3720](https://issues.apache.org/jira/browse/MAPREDUCE-3720) | Command line listJobs should not visit each AM | Major | client, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-7470](https://issues.apache.org/jira/browse/HADOOP-7470) | move up to Jackson 1.8.8 | Minor | util | Steve Loughran | Enis Soztutar |
+| [HADOOP-8013](https://issues.apache.org/jira/browse/HADOOP-8013) | ViewFileSystem does not honor setVerifyChecksum | Major | fs | Daryn Sharp | Daryn Sharp |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
+| [MAPREDUCE-778](https://issues.apache.org/jira/browse/MAPREDUCE-778) | [Rumen] Need a standalone JobHistory log anonymizer | Major | tools/rumen | Hong Tang | Amar Kamat |
| [HADOOP-7808](https://issues.apache.org/jira/browse/HADOOP-7808) | Port token service changes from 205 | Major | fs, security | Daryn Sharp | Daryn Sharp |
-| [HDFS-2316](https://issues.apache.org/jira/browse/HDFS-2316) | [umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTP | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [MAPREDUCE-2765](https://issues.apache.org/jira/browse/MAPREDUCE-2765) | DistCp Rewrite | Major | distcp, mrv2 | Mithun Radhakrishnan | Mithun Radhakrishnan |
-| [MAPREDUCE-778](https://issues.apache.org/jira/browse/MAPREDUCE-778) | [Rumen] Need a standalone JobHistory log anonymizer | Major | tools/rumen | Hong Tang | Amar Kamat |
+| [HDFS-2316](https://issues.apache.org/jira/browse/HDFS-2316) | [umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTP | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8027](https://issues.apache.org/jira/browse/HADOOP-8027) | Visiting /jmx on the daemon web interfaces may print unnecessary error in logs | Minor | metrics | Harsh J | Aaron T. Myers |
-| [HADOOP-8015](https://issues.apache.org/jira/browse/HADOOP-8015) | ChRootFileSystem should extend FilterFileSystem | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8009](https://issues.apache.org/jira/browse/HADOOP-8009) | Create hadoop-client and hadoop-minicluster artifacts for downstream projects | Critical | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-7987](https://issues.apache.org/jira/browse/HADOOP-7987) | Support setting the run-as user in unsecure mode | Major | security | Devaraj Das | Jitendra Nath Pandey |
-| [HADOOP-7939](https://issues.apache.org/jira/browse/HADOOP-7939) | Improve Hadoop subcomponent integration in Hadoop 0.23 | Major | build, conf, documentation, scripts | Roman Shaposhnik | Roman Shaposhnik |
-| [HADOOP-7934](https://issues.apache.org/jira/browse/HADOOP-7934) | Normalize dependencies versions across all modules | Critical | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-7919](https://issues.apache.org/jira/browse/HADOOP-7919) | [Doc] Remove hadoop.logfile.\* properties. | Trivial | documentation | Harsh J | Harsh J |
-| [HADOOP-7910](https://issues.apache.org/jira/browse/HADOOP-7910) | add configuration methods to handle human readable size values | Minor | conf | Sho Shimauchi | Sho Shimauchi |
-| [HADOOP-7890](https://issues.apache.org/jira/browse/HADOOP-7890) | Redirect hadoop script's deprecation message to stderr | Trivial | scripts | Koji Noguchi | Koji Noguchi |
-| [HADOOP-7858](https://issues.apache.org/jira/browse/HADOOP-7858) | Drop some info logging to DEBUG level in IPC, metrics, and HTTP | Trivial | . | Todd Lipcon | Todd Lipcon |
+| [HDFS-362](https://issues.apache.org/jira/browse/HDFS-362) | FSEditLog should not writes long and short as UTF8 and should not use ArrayWritable for writing non-array items | Major | namenode | Tsz Wo Nicholas Sze | Uma Maheswara Rao G |
+| [HDFS-2349](https://issues.apache.org/jira/browse/HDFS-2349) | DN should log a WARN, not an INFO when it detects a corruption during block transfer | Trivial | datanode | Harsh J | Harsh J |
+| [HADOOP-7736](https://issues.apache.org/jira/browse/HADOOP-7736) | Remove duplicate call of Path#normalizePath during initialization. | Trivial | fs | Harsh J | Harsh J |
+| [HADOOP-7761](https://issues.apache.org/jira/browse/HADOOP-7761) | Improve performance of raw comparisons | Major | io, performance, util | Todd Lipcon | Todd Lipcon |
+| [HADOOP-7424](https://issues.apache.org/jira/browse/HADOOP-7424) | Log an error if the topology script doesn't handle multiple args | Major | . | Eli Collins | Uma Maheswara Rao G |
+| [HADOOP-7792](https://issues.apache.org/jira/browse/HADOOP-7792) | Common component for HDFS-2416: Add verifyToken method to AbstractDelegationTokenSecretManager | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HDFS-2533](https://issues.apache.org/jira/browse/HDFS-2533) | Remove needless synchronization on FSDataSet.getBlockFile | Minor | datanode, performance | Todd Lipcon | Todd Lipcon |
+| [HDFS-2080](https://issues.apache.org/jira/browse/HDFS-2080) | Speed up DFS read path by lessening checksum overhead | Major | hdfs-client, performance | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-3325](https://issues.apache.org/jira/browse/MAPREDUCE-3325) | Improvements to CapacityScheduler doc | Major | mrv2 | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-3341](https://issues.apache.org/jira/browse/MAPREDUCE-3341) | Enhance logging of initalized queue limit values | Major | mrv2 | Anupam Seth | Anupam Seth |
+| [MAPREDUCE-3331](https://issues.apache.org/jira/browse/MAPREDUCE-3331) | Improvement to single node cluster setup documentation for 0.23 | Minor | mrv2 | Anupam Seth | Anupam Seth |
+| [MAPREDUCE-3169](https://issues.apache.org/jira/browse/MAPREDUCE-3169) | Create a new MiniMRCluster equivalent which only provides client APIs cross MR1 and MR2 | Major | mrv1, mrv2, test | Todd Lipcon | Ahmed Radwan |
+| [MAPREDUCE-3415](https://issues.apache.org/jira/browse/MAPREDUCE-3415) | improve MiniMRYarnCluster & DistributedShell JAR resolution | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-2560](https://issues.apache.org/jira/browse/HDFS-2560) | Refactor BPOfferService to be a static inner class | Major | datanode | Todd Lipcon | Todd Lipcon |
+| [HDFS-2562](https://issues.apache.org/jira/browse/HDFS-2562) | Refactor DN configuration variables out of DataNode class | Minor | datanode | Todd Lipcon | Todd Lipcon |
+| [HDFS-2563](https://issues.apache.org/jira/browse/HDFS-2563) | Some cleanup in BPOfferService | Major | datanode | Todd Lipcon | Todd Lipcon |
+| [HDFS-2502](https://issues.apache.org/jira/browse/HDFS-2502) | hdfs-default.xml should include dfs.name.dir.restore | Minor | documentation | Eli Collins | Harsh J |
+| [HDFS-2568](https://issues.apache.org/jira/browse/HDFS-2568) | Use a set to manage child sockets in XceiverServer | Trivial | datanode | Harsh J | Harsh J |
+| [HDFS-2454](https://issues.apache.org/jira/browse/HDFS-2454) | Move maxXceiverCount check to before starting the thread in dataXceiver | Minor | datanode | Uma Maheswara Rao G | Harsh J |
+| [HDFS-2570](https://issues.apache.org/jira/browse/HDFS-2570) | Add descriptions for dfs.\*.https.address in hdfs-default.xml | Trivial | documentation | Eli Collins | Eli Collins |
| [HADOOP-7841](https://issues.apache.org/jira/browse/HADOOP-7841) | Run tests with non-secure random | Trivial | build | Todd Lipcon | Todd Lipcon |
+| [HADOOP-6614](https://issues.apache.org/jira/browse/HADOOP-6614) | RunJar should provide more diags when it can't create a temp file | Minor | util | Steve Loughran | Jonathan Hsieh |
+| [HDFS-2566](https://issues.apache.org/jira/browse/HDFS-2566) | Move BPOfferService to be a non-inner class | Minor | datanode | Todd Lipcon | Todd Lipcon |
+| [HDFS-2536](https://issues.apache.org/jira/browse/HDFS-2536) | Remove unused imports | Trivial | namenode | Aaron T. Myers | Harsh J |
+| [MAPREDUCE-3411](https://issues.apache.org/jira/browse/MAPREDUCE-3411) | Performance Upgrade for jQuery | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-3265](https://issues.apache.org/jira/browse/MAPREDUCE-3265) | Reduce log level on MR2 IPC construction, etc | Blocker | mrv2 | Todd Lipcon | Arun C Murthy |
+| [HDFS-2246](https://issues.apache.org/jira/browse/HDFS-2246) | Shortcut a local client reads to a Datanodes files directly | Major | . | Sanjay Radia | Jitendra Nath Pandey |
+| [HADOOP-7858](https://issues.apache.org/jira/browse/HADOOP-7858) | Drop some info logging to DEBUG level in IPC, metrics, and HTTP | Trivial | . | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-3371](https://issues.apache.org/jira/browse/MAPREDUCE-3371) | Review and improve the yarn-api javadocs. | Minor | documentation, mrv2 | Ravi Prakash | Ravi Prakash |
+| [MAPREDUCE-3238](https://issues.apache.org/jira/browse/MAPREDUCE-3238) | Small cleanup in SchedulerApp | Trivial | mrv2 | Todd Lipcon | Todd Lipcon |
| [HADOOP-7804](https://issues.apache.org/jira/browse/HADOOP-7804) | enable hadoop config generator to set dfs.block.local-path-access.user to enable short circuit read | Major | conf | Arpit Gupta | Arpit Gupta |
-| [HADOOP-7792](https://issues.apache.org/jira/browse/HADOOP-7792) | Common component for HDFS-2416: Add verifyToken method to AbstractDelegationTokenSecretManager | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
| [HADOOP-7777](https://issues.apache.org/jira/browse/HADOOP-7777) | Implement a base class for DNSToSwitchMapping implementations that can offer extra topology information | Major | util | Steve Loughran | Steve Loughran |
-| [HADOOP-7761](https://issues.apache.org/jira/browse/HADOOP-7761) | Improve performance of raw comparisons | Major | io, performance, util | Todd Lipcon | Todd Lipcon |
+| [HDFS-2604](https://issues.apache.org/jira/browse/HDFS-2604) | Add a log message to show if WebHDFS is enabled | Minor | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-3369](https://issues.apache.org/jira/browse/MAPREDUCE-3369) | Migrate MR1 tests to run on MR2 using the new interfaces introduced in MAPREDUCE-3169 | Major | mrv1, mrv2, test | Ahmed Radwan | Ahmed Radwan |
+| [MAPREDUCE-3147](https://issues.apache.org/jira/browse/MAPREDUCE-3147) | Handle leaf queues with the same name properly | Major | mrv2 | Ravi Prakash | Ravi Prakash |
+| [HDFS-2178](https://issues.apache.org/jira/browse/HDFS-2178) | HttpFS - a read/write Hadoop file system proxy | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
| [HADOOP-7758](https://issues.apache.org/jira/browse/HADOOP-7758) | Make GlobFilter class public | Major | fs | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-7736](https://issues.apache.org/jira/browse/HADOOP-7736) | Remove duplicate call of Path#normalizePath during initialization. | Trivial | fs | Harsh J | Harsh J |
+| [HADOOP-6886](https://issues.apache.org/jira/browse/HADOOP-6886) | LocalFileSystem Needs createNonRecursive API | Minor | fs | Nicolas Spiegelberg | Nicolas Spiegelberg |
+| [HDFS-2511](https://issues.apache.org/jira/browse/HDFS-2511) | Add dev script to generate HDFS protobufs | Minor | build | Todd Lipcon | Alejandro Abdelnur |
+| [HDFS-2653](https://issues.apache.org/jira/browse/HDFS-2653) | DFSClient should cache whether addrs are non-local when short-circuiting is enabled | Major | datanode | Eli Collins | Eli Collins |
+| [HDFS-2654](https://issues.apache.org/jira/browse/HDFS-2654) | Make BlockReaderLocal not extend RemoteBlockReader2 | Major | datanode | Eli Collins | Eli Collins |
+| [MAPREDUCE-2863](https://issues.apache.org/jira/browse/MAPREDUCE-2863) | Support web-services for RM & NM | Blocker | mrv2, nodemanager, resourcemanager | Arun C Murthy | Thomas Graves |
+| [HDFS-2675](https://issues.apache.org/jira/browse/HDFS-2675) | Reduce verbosity when double-closing edit logs | Trivial | namenode | Todd Lipcon | Todd Lipcon |
| [HADOOP-7657](https://issues.apache.org/jira/browse/HADOOP-7657) | Add support for LZ4 compression | Major | . | Bert Sanders | Binglin Chang |
+| [HDFS-2335](https://issues.apache.org/jira/browse/HDFS-2335) | DataNodeCluster and NNStorage always pull fresh entropy | Major | datanode, namenode | Eli Collins | Uma Maheswara Rao G |
+| [HADOOP-7890](https://issues.apache.org/jira/browse/HADOOP-7890) | Redirect hadoop script's deprecation message to stderr | Trivial | scripts | Koji Noguchi | Koji Noguchi |
+| [MAPREDUCE-3597](https://issues.apache.org/jira/browse/MAPREDUCE-3597) | Provide a way to access other info of history file from Rumentool | Major | tools/rumen | Ravi Gummadi | Ravi Gummadi |
| [HADOOP-7574](https://issues.apache.org/jira/browse/HADOOP-7574) | Improvement for FSshell -stat | Trivial | fs | XieXianshan | XieXianshan |
-| [HADOOP-7504](https://issues.apache.org/jira/browse/HADOOP-7504) | hadoop-metrics.properties missing some Ganglia31 options | Trivial | metrics | Eli Collins | Harsh J |
-| [HADOOP-7424](https://issues.apache.org/jira/browse/HADOOP-7424) | Log an error if the topology script doesn't handle multiple args | Major | . | Eli Collins | Uma Maheswara Rao G |
-| [HADOOP-6886](https://issues.apache.org/jira/browse/HADOOP-6886) | LocalFileSystem Needs createNonRecursive API | Minor | fs | Nicolas Spiegelberg | Nicolas Spiegelberg |
| [HADOOP-6840](https://issues.apache.org/jira/browse/HADOOP-6840) | Support non-recursive create() in FileSystem & SequenceFile.Writer | Minor | fs, io | Nicolas Spiegelberg | Nicolas Spiegelberg |
-| [HADOOP-6614](https://issues.apache.org/jira/browse/HADOOP-6614) | RunJar should provide more diags when it can't create a temp file | Minor | util | Steve Loughran | Jonathan Hsieh |
+| [HDFS-2726](https://issues.apache.org/jira/browse/HDFS-2726) | "Exception in createBlockOutputStream" shouldn't delete exception stack trace | Major | . | Michael Bieniosek | Harsh J |
+| [HADOOP-7910](https://issues.apache.org/jira/browse/HADOOP-7910) | add configuration methods to handle human readable size values | Minor | conf | Sho Shimauchi | Sho Shimauchi |
+| [HDFS-2729](https://issues.apache.org/jira/browse/HDFS-2729) | Update BlockManager's comments regarding the invalid block set | Minor | namenode | Harsh J | Harsh J |
+| [HDFS-554](https://issues.apache.org/jira/browse/HDFS-554) | BlockInfo.ensureCapacity may get a speedup from System.arraycopy() | Minor | namenode | Steve Loughran | Harsh J |
+| [HADOOP-7919](https://issues.apache.org/jira/browse/HADOOP-7919) | [Doc] Remove hadoop.logfile.\* properties. | Trivial | documentation | Harsh J | Harsh J |
+| [HADOOP-7504](https://issues.apache.org/jira/browse/HADOOP-7504) | hadoop-metrics.properties missing some Ganglia31 options | Trivial | metrics | Eli Collins | Harsh J |
+| [MAPREDUCE-3610](https://issues.apache.org/jira/browse/MAPREDUCE-3610) | Some parts in MR use old property dfs.block.size | Minor | . | Sho Shimauchi | Sho Shimauchi |
+| [HADOOP-7934](https://issues.apache.org/jira/browse/HADOOP-7934) | Normalize dependencies versions across all modules | Critical | build | Alejandro Abdelnur | Alejandro Abdelnur |
| [HADOOP-4515](https://issues.apache.org/jira/browse/HADOOP-4515) | conf.getBoolean must be case insensitive | Minor | . | Abhijit Bagri | Sho Shimauchi |
-| [HDFS-3139](https://issues.apache.org/jira/browse/HDFS-3139) | Minor Datanode logging improvement | Minor | datanode | Eli Collins | Eli Collins |
-| [HDFS-2868](https://issues.apache.org/jira/browse/HDFS-2868) | Add number of active transfer threads to the DataNode status | Minor | datanode | Harsh J | Harsh J |
-| [HDFS-2826](https://issues.apache.org/jira/browse/HDFS-2826) | Test case for HDFS-1476 (safemode can initialize repl queues before exiting) | Minor | namenode, test | Todd Lipcon | Todd Lipcon |
-| [HDFS-2825](https://issues.apache.org/jira/browse/HDFS-2825) | Add test hook to turn off the writer preferring its local DN | Minor | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2817](https://issues.apache.org/jira/browse/HDFS-2817) | Combine the two TestSafeMode test suites | Minor | test | Todd Lipcon | Todd Lipcon |
-| [HDFS-2814](https://issues.apache.org/jira/browse/HDFS-2814) | NamenodeMXBean does not account for svn revision in the version information | Minor | . | Hitesh Shah | Hitesh Shah |
-| [HDFS-2803](https://issues.apache.org/jira/browse/HDFS-2803) | Adding logging to LeaseRenewer for better lease expiration triage. | Minor | namenode | Jimmy Xiang | Jimmy Xiang |
+| [MAPREDUCE-3299](https://issues.apache.org/jira/browse/MAPREDUCE-3299) | Add AMInfo table to the AM job page | Minor | mrv2 | Siddharth Seth | Jonathan Eagles |
| [HDFS-2788](https://issues.apache.org/jira/browse/HDFS-2788) | HdfsServerConstants#DN\_KEEPALIVE\_TIMEOUT is dead code | Major | datanode | Eli Collins | Eli Collins |
-| [HDFS-2761](https://issues.apache.org/jira/browse/HDFS-2761) | Improve Hadoop subcomponent integration in Hadoop 0.23 | Major | build, hdfs-client, scripts | Roman Shaposhnik | Roman Shaposhnik |
-| [HDFS-2729](https://issues.apache.org/jira/browse/HDFS-2729) | Update BlockManager's comments regarding the invalid block set | Minor | namenode | Harsh J | Harsh J |
-| [HDFS-2726](https://issues.apache.org/jira/browse/HDFS-2726) | "Exception in createBlockOutputStream" shouldn't delete exception stack trace | Major | . | Michael Bieniosek | Harsh J |
-| [HDFS-2675](https://issues.apache.org/jira/browse/HDFS-2675) | Reduce verbosity when double-closing edit logs | Trivial | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2654](https://issues.apache.org/jira/browse/HDFS-2654) | Make BlockReaderLocal not extend RemoteBlockReader2 | Major | datanode | Eli Collins | Eli Collins |
-| [HDFS-2653](https://issues.apache.org/jira/browse/HDFS-2653) | DFSClient should cache whether addrs are non-local when short-circuiting is enabled | Major | datanode | Eli Collins | Eli Collins |
-| [HDFS-2604](https://issues.apache.org/jira/browse/HDFS-2604) | Add a log message to show if WebHDFS is enabled | Minor | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2570](https://issues.apache.org/jira/browse/HDFS-2570) | Add descriptions for dfs.\*.https.address in hdfs-default.xml | Trivial | documentation | Eli Collins | Eli Collins |
-| [HDFS-2568](https://issues.apache.org/jira/browse/HDFS-2568) | Use a set to manage child sockets in XceiverServer | Trivial | datanode | Harsh J | Harsh J |
-| [HDFS-2566](https://issues.apache.org/jira/browse/HDFS-2566) | Move BPOfferService to be a non-inner class | Minor | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2563](https://issues.apache.org/jira/browse/HDFS-2563) | Some cleanup in BPOfferService | Major | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2562](https://issues.apache.org/jira/browse/HDFS-2562) | Refactor DN configuration variables out of DataNode class | Minor | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2560](https://issues.apache.org/jira/browse/HDFS-2560) | Refactor BPOfferService to be a static inner class | Major | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2536](https://issues.apache.org/jira/browse/HDFS-2536) | Remove unused imports | Trivial | namenode | Aaron T. Myers | Harsh J |
-| [HDFS-2533](https://issues.apache.org/jira/browse/HDFS-2533) | Remove needless synchronization on FSDataSet.getBlockFile | Minor | datanode, performance | Todd Lipcon | Todd Lipcon |
-| [HDFS-2511](https://issues.apache.org/jira/browse/HDFS-2511) | Add dev script to generate HDFS protobufs | Minor | build | Todd Lipcon | Alejandro Abdelnur |
-| [HDFS-2502](https://issues.apache.org/jira/browse/HDFS-2502) | hdfs-default.xml should include dfs.name.dir.restore | Minor | documentation | Eli Collins | Harsh J |
-| [HDFS-2454](https://issues.apache.org/jira/browse/HDFS-2454) | Move maxXceiverCount check to before starting the thread in dataXceiver | Minor | datanode | Uma Maheswara Rao G | Harsh J |
+| [HDFS-2803](https://issues.apache.org/jira/browse/HDFS-2803) | Adding logging to LeaseRenewer for better lease expiration triage. | Minor | namenode | Jimmy Xiang | Jimmy Xiang |
+| [HDFS-2817](https://issues.apache.org/jira/browse/HDFS-2817) | Combine the two TestSafeMode test suites | Minor | test | Todd Lipcon | Todd Lipcon |
+| [HDFS-2825](https://issues.apache.org/jira/browse/HDFS-2825) | Add test hook to turn off the writer preferring its local DN | Minor | namenode | Todd Lipcon | Todd Lipcon |
+| [HDFS-2826](https://issues.apache.org/jira/browse/HDFS-2826) | Test case for HDFS-1476 (safemode can initialize repl queues before exiting) | Minor | namenode, test | Todd Lipcon | Todd Lipcon |
| [HDFS-2397](https://issues.apache.org/jira/browse/HDFS-2397) | Undeprecate SecondaryNameNode | Major | namenode | Todd Lipcon | Eli Collins |
-| [HDFS-2349](https://issues.apache.org/jira/browse/HDFS-2349) | DN should log a WARN, not an INFO when it detects a corruption during block transfer | Trivial | datanode | Harsh J | Harsh J |
-| [HDFS-2335](https://issues.apache.org/jira/browse/HDFS-2335) | DataNodeCluster and NNStorage always pull fresh entropy | Major | datanode, namenode | Eli Collins | Uma Maheswara Rao G |
-| [HDFS-2246](https://issues.apache.org/jira/browse/HDFS-2246) | Shortcut a local client reads to a Datanodes files directly | Major | . | Sanjay Radia | Jitendra Nath Pandey |
-| [HDFS-2178](https://issues.apache.org/jira/browse/HDFS-2178) | HttpFS - a read/write Hadoop file system proxy | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HDFS-2080](https://issues.apache.org/jira/browse/HDFS-2080) | Speed up DFS read path by lessening checksum overhead | Major | hdfs-client, performance | Todd Lipcon | Todd Lipcon |
-| [HDFS-554](https://issues.apache.org/jira/browse/HDFS-554) | BlockInfo.ensureCapacity may get a speedup from System.arraycopy() | Minor | namenode | Steve Loughran | Harsh J |
-| [HDFS-362](https://issues.apache.org/jira/browse/HDFS-362) | FSEditLog should not writes long and short as UTF8 and should not use ArrayWritable for writing non-array items | Major | namenode | Tsz Wo Nicholas Sze | Uma Maheswara Rao G |
-| [MAPREDUCE-3771](https://issues.apache.org/jira/browse/MAPREDUCE-3771) | Port MAPREDUCE-1735 to trunk/0.23 | Major | . | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-3756](https://issues.apache.org/jira/browse/MAPREDUCE-3756) | Make single shuffle limit configurable | Major | mrv2 | Arun C Murthy | Hitesh Shah |
-| [MAPREDUCE-3693](https://issues.apache.org/jira/browse/MAPREDUCE-3693) | Add admin env to mapred-default.xml | Minor | mrv2 | Roman Shaposhnik | Roman Shaposhnik |
| [MAPREDUCE-3692](https://issues.apache.org/jira/browse/MAPREDUCE-3692) | yarn-resourcemanager out and log files can get big | Blocker | mrv2 | Eli Collins | Eli Collins |
-| [MAPREDUCE-3679](https://issues.apache.org/jira/browse/MAPREDUCE-3679) | AM logs and others should not automatically refresh after every 1 second. | Major | mrv2 | Mahadev konar | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-3610](https://issues.apache.org/jira/browse/MAPREDUCE-3610) | Some parts in MR use old property dfs.block.size | Minor | . | Sho Shimauchi | Sho Shimauchi |
-| [MAPREDUCE-3597](https://issues.apache.org/jira/browse/MAPREDUCE-3597) | Provide a way to access other info of history file from Rumentool | Major | tools/rumen | Ravi Gummadi | Ravi Gummadi |
-| [MAPREDUCE-3481](https://issues.apache.org/jira/browse/MAPREDUCE-3481) | [Gridmix] Improve STRESS mode locking | Major | contrib/gridmix | Amar Kamat | Amar Kamat |
-| [MAPREDUCE-3415](https://issues.apache.org/jira/browse/MAPREDUCE-3415) | improve MiniMRYarnCluster & DistributedShell JAR resolution | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-3411](https://issues.apache.org/jira/browse/MAPREDUCE-3411) | Performance Upgrade for jQuery | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-3371](https://issues.apache.org/jira/browse/MAPREDUCE-3371) | Review and improve the yarn-api javadocs. | Minor | documentation, mrv2 | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-3369](https://issues.apache.org/jira/browse/MAPREDUCE-3369) | Migrate MR1 tests to run on MR2 using the new interfaces introduced in MAPREDUCE-3169 | Major | mrv1, mrv2, test | Ahmed Radwan | Ahmed Radwan |
+| [HADOOP-7987](https://issues.apache.org/jira/browse/HADOOP-7987) | Support setting the run-as user in unsecure mode | Major | security | Devaraj Das | Jitendra Nath Pandey |
| [MAPREDUCE-3360](https://issues.apache.org/jira/browse/MAPREDUCE-3360) | Provide information about lost nodes in the UI. | Critical | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh |
-| [MAPREDUCE-3341](https://issues.apache.org/jira/browse/MAPREDUCE-3341) | Enhance logging of initalized queue limit values | Major | mrv2 | Anupam Seth | Anupam Seth |
-| [MAPREDUCE-3331](https://issues.apache.org/jira/browse/MAPREDUCE-3331) | Improvement to single node cluster setup documentation for 0.23 | Minor | mrv2 | Anupam Seth | Anupam Seth |
-| [MAPREDUCE-3325](https://issues.apache.org/jira/browse/MAPREDUCE-3325) | Improvements to CapacityScheduler doc | Major | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3299](https://issues.apache.org/jira/browse/MAPREDUCE-3299) | Add AMInfo table to the AM job page | Minor | mrv2 | Siddharth Seth | Jonathan Eagles |
-| [MAPREDUCE-3265](https://issues.apache.org/jira/browse/MAPREDUCE-3265) | Reduce log level on MR2 IPC construction, etc | Blocker | mrv2 | Todd Lipcon | Arun C Murthy |
-| [MAPREDUCE-3238](https://issues.apache.org/jira/browse/MAPREDUCE-3238) | Small cleanup in SchedulerApp | Trivial | mrv2 | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-3169](https://issues.apache.org/jira/browse/MAPREDUCE-3169) | Create a new MiniMRCluster equivalent which only provides client APIs cross MR1 and MR2 | Major | mrv1, mrv2, test | Todd Lipcon | Ahmed Radwan |
-| [MAPREDUCE-3147](https://issues.apache.org/jira/browse/MAPREDUCE-3147) | Handle leaf queues with the same name properly | Major | mrv2 | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-2863](https://issues.apache.org/jira/browse/MAPREDUCE-2863) | Support web-services for RM & NM | Blocker | mrv2, nodemanager, resourcemanager | Arun C Murthy | Thomas Graves |
+| [MAPREDUCE-3693](https://issues.apache.org/jira/browse/MAPREDUCE-3693) | Add admin env to mapred-default.xml | Minor | mrv2 | Roman Shaposhnik | Roman Shaposhnik |
+| [HADOOP-7939](https://issues.apache.org/jira/browse/HADOOP-7939) | Improve Hadoop subcomponent integration in Hadoop 0.23 | Major | build, conf, documentation, scripts | Roman Shaposhnik | Roman Shaposhnik |
+| [MAPREDUCE-3481](https://issues.apache.org/jira/browse/MAPREDUCE-3481) | [Gridmix] Improve STRESS mode locking | Major | contrib/gridmix | Amar Kamat | Amar Kamat |
+| [MAPREDUCE-3679](https://issues.apache.org/jira/browse/MAPREDUCE-3679) | AM logs and others should not automatically refresh after every 1 second. | Major | mrv2 | Mahadev konar | Vinod Kumar Vavilapalli |
+| [MAPREDUCE-3756](https://issues.apache.org/jira/browse/MAPREDUCE-3756) | Make single shuffle limit configurable | Major | mrv2 | Arun C Murthy | Hitesh Shah |
+| [MAPREDUCE-3771](https://issues.apache.org/jira/browse/MAPREDUCE-3771) | Port MAPREDUCE-1735 to trunk/0.23 | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-8015](https://issues.apache.org/jira/browse/HADOOP-8015) | ChRootFileSystem should extend FilterFileSystem | Major | fs | Daryn Sharp | Daryn Sharp |
+| [HDFS-2814](https://issues.apache.org/jira/browse/HDFS-2814) | NamenodeMXBean does not account for svn revision in the version information | Minor | . | Hitesh Shah | Hitesh Shah |
+| [HDFS-2868](https://issues.apache.org/jira/browse/HDFS-2868) | Add number of active transfer threads to the DataNode status | Minor | datanode | Harsh J | Harsh J |
+| [HADOOP-8027](https://issues.apache.org/jira/browse/HADOOP-8027) | Visiting /jmx on the daemon web interfaces may print unnecessary error in logs | Minor | metrics | Harsh J | Aaron T. Myers |
+| [HADOOP-8009](https://issues.apache.org/jira/browse/HADOOP-8009) | Create hadoop-client and hadoop-minicluster artifacts for downstream projects | Critical | build | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3139](https://issues.apache.org/jira/browse/HDFS-3139) | Minor Datanode logging improvement | Minor | datanode | Eli Collins | Eli Collins |
+| [HDFS-2761](https://issues.apache.org/jira/browse/HDFS-2761) | Improve Hadoop subcomponent integration in Hadoop 0.23 | Major | build, hdfs-client, scripts | Roman Shaposhnik | Roman Shaposhnik |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8055](https://issues.apache.org/jira/browse/HADOOP-8055) | Distribution tar.gz does not contain etc/hadoop/core-site.xml | Major | build | Eric Charles | Harsh J |
-| [HADOOP-8054](https://issues.apache.org/jira/browse/HADOOP-8054) | NPE with FilterFileSystem | Critical | fs | Amareshwari Sriramadasu | Daryn Sharp |
-| [HADOOP-8052](https://issues.apache.org/jira/browse/HADOOP-8052) | Hadoop Metrics2 should emit Float.MAX\_VALUE (instead of Double.MAX\_VALUE) to avoid making Ganglia's gmetad core | Major | metrics | Varun Kapoor | Varun Kapoor |
-| [HADOOP-8018](https://issues.apache.org/jira/browse/HADOOP-8018) | Hudson auto test for HDFS has started throwing javadoc: warning - Error fetching URL: http://java.sun.com/javase/6/docs/api/package-list | Major | build, test | Matt Foley | Jonathan Eagles |
-| [HADOOP-8012](https://issues.apache.org/jira/browse/HADOOP-8012) | hadoop-daemon.sh and yarn-daemon.sh are trying to mkdir and chow log/pid dirs which can fail | Minor | scripts | Roman Shaposhnik | Roman Shaposhnik |
-| [HADOOP-8006](https://issues.apache.org/jira/browse/HADOOP-8006) | TestFSInputChecker is failing in trunk. | Major | fs | Uma Maheswara Rao G | Daryn Sharp |
-| [HADOOP-8002](https://issues.apache.org/jira/browse/HADOOP-8002) | SecurityUtil acquired token message should be a debug rather than info | Major | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-8001](https://issues.apache.org/jira/browse/HADOOP-8001) | ChecksumFileSystem's rename doesn't correctly handle checksum files | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8000](https://issues.apache.org/jira/browse/HADOOP-8000) | fetchdt command not available in bin/hadoop | Critical | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-7999](https://issues.apache.org/jira/browse/HADOOP-7999) | "hadoop archive" fails with ClassNotFoundException | Critical | scripts | Jason Lowe | Jason Lowe |
-| [HADOOP-7998](https://issues.apache.org/jira/browse/HADOOP-7998) | CheckFileSystem does not correctly honor setVerifyChecksum | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7993](https://issues.apache.org/jira/browse/HADOOP-7993) | Hadoop ignores old-style config options for enabling compressed output | Major | conf | Anupam Seth | Anupam Seth |
-| [HADOOP-7988](https://issues.apache.org/jira/browse/HADOOP-7988) | Upper case in hostname part of the principals doesn't work with kerberos. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-7986](https://issues.apache.org/jira/browse/HADOOP-7986) | Add config for History Server protocol in hadoop-policy for service level authorization. | Major | . | Mahadev konar | Mahadev konar |
-| [HADOOP-7982](https://issues.apache.org/jira/browse/HADOOP-7982) | UserGroupInformation fails to login if thread's context classloader can't load HadoopLoginModule | Major | security | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7981](https://issues.apache.org/jira/browse/HADOOP-7981) | Improve documentation for org.apache.hadoop.io.compress.Decompressor.getRemaining | Major | io | Jonathan Eagles | Jonathan Eagles |
-| [HADOOP-7975](https://issues.apache.org/jira/browse/HADOOP-7975) | Add entry to XML defaults for new LZ4 codec | Minor | . | Harsh J | Harsh J |
-| [HADOOP-7974](https://issues.apache.org/jira/browse/HADOOP-7974) | TestViewFsTrash incorrectly determines the user's home directory | Major | fs, test | Eli Collins | Harsh J |
-| [HADOOP-7971](https://issues.apache.org/jira/browse/HADOOP-7971) | hadoop \<job/queue/pipes\> removed - should be added back, but deprecated | Blocker | . | Thomas Graves | Prashant Sharma |
-| [HADOOP-7964](https://issues.apache.org/jira/browse/HADOOP-7964) | Deadlock in class init. | Blocker | security, util | Kihwal Lee | Daryn Sharp |
-| [HADOOP-7963](https://issues.apache.org/jira/browse/HADOOP-7963) | test failures: TestViewFileSystemWithAuthorityLocalFileSystem and TestViewFileSystemLocalFileSystem | Blocker | . | Thomas Graves | Siddharth Seth |
-| [HADOOP-7949](https://issues.apache.org/jira/browse/HADOOP-7949) | Updated maxIdleTime default in the code to match core-default.xml | Trivial | ipc | Eli Collins | Eli Collins |
-| [HADOOP-7948](https://issues.apache.org/jira/browse/HADOOP-7948) | Shell scripts created by hadoop-dist/pom.xml to build tar do not properly propagate failure | Minor | build | Michajlo Matijkiw | Michajlo Matijkiw |
-| [HADOOP-7936](https://issues.apache.org/jira/browse/HADOOP-7936) | There's a Hoop README in the root dir of the tarball | Major | build | Eli Collins | Alejandro Abdelnur |
-| [HADOOP-7933](https://issues.apache.org/jira/browse/HADOOP-7933) | Viewfs changes for MAPREDUCE-3529 | Critical | viewfs | Siddharth Seth | Siddharth Seth |
-| [HADOOP-7917](https://issues.apache.org/jira/browse/HADOOP-7917) | compilation of protobuf files fails in windows/cygwin | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-7914](https://issues.apache.org/jira/browse/HADOOP-7914) | duplicate declaration of hadoop-hdfs test-jar | Major | build | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-7912](https://issues.apache.org/jira/browse/HADOOP-7912) | test-patch should run eclipse:eclipse to verify that it does not break again | Major | build | Robert Joseph Evans | Robert Joseph Evans |
-| [HADOOP-7907](https://issues.apache.org/jira/browse/HADOOP-7907) | hadoop-tools JARs are not part of the distro | Blocker | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-7902](https://issues.apache.org/jira/browse/HADOOP-7902) | skipping name rules setting (if already set) should be done on UGI initialization only | Major | . | Tsz Wo Nicholas Sze | Alejandro Abdelnur |
-| [HADOOP-7898](https://issues.apache.org/jira/browse/HADOOP-7898) | Fix javadoc warnings in AuthenticationToken.java | Minor | security | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-7887](https://issues.apache.org/jira/browse/HADOOP-7887) | KerberosAuthenticatorHandler is not setting KerberosName name rules from configuration | Critical | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-7878](https://issues.apache.org/jira/browse/HADOOP-7878) | Regression HADOOP-7777 switch changes break HDFS tests when the isSingleSwitch() predicate is used | Minor | util | Steve Loughran | Steve Loughran |
-| [HADOOP-7870](https://issues.apache.org/jira/browse/HADOOP-7870) | fix SequenceFile#createWriter with boolean createParent arg to respect createParent. | Major | . | Jonathan Hsieh | Jonathan Hsieh |
-| [HADOOP-7864](https://issues.apache.org/jira/browse/HADOOP-7864) | Building mvn site with Maven \< 3.0.2 causes OOM errors | Major | build | Andrew Bayer | Andrew Bayer |
-| [HADOOP-7859](https://issues.apache.org/jira/browse/HADOOP-7859) | TestViewFsHdfs.testgetFileLinkStatus is failing an assert | Major | fs | Eli Collins | Eli Collins |
-| [HADOOP-7854](https://issues.apache.org/jira/browse/HADOOP-7854) | UGI getCurrentUser is not synchronized | Critical | security | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7853](https://issues.apache.org/jira/browse/HADOOP-7853) | multiple javax security configurations cause conflicts | Blocker | security | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7851](https://issues.apache.org/jira/browse/HADOOP-7851) | Configuration.getClasses() never returns the default value. | Major | conf | Amar Kamat | Uma Maheswara Rao G |
-| [HADOOP-7843](https://issues.apache.org/jira/browse/HADOOP-7843) | compilation failing because workDir not initialized in RunJar.java | Major | . | John George | John George |
-| [HADOOP-7837](https://issues.apache.org/jira/browse/HADOOP-7837) | no NullAppender in the log4j config | Major | conf | Steve Loughran | Eli Collins |
+| [MAPREDUCE-2784](https://issues.apache.org/jira/browse/MAPREDUCE-2784) | [Gridmix] TestGridmixSummary fails with NPE when run in DEBUG mode. | Major | contrib/gridmix | Amar Kamat | Amar Kamat |
+| [MAPREDUCE-2950](https://issues.apache.org/jira/browse/MAPREDUCE-2950) | [Gridmix] TestUserResolve fails in trunk | Major | contrib/gridmix | Amar Kamat | Ravi Gummadi |
+| [HADOOP-6490](https://issues.apache.org/jira/browse/HADOOP-6490) | Path.normalize should use StringUtils.replace in favor of String.replace | Minor | fs | Zheng Shao | Uma Maheswara Rao G |
+| [MAPREDUCE-3291](https://issues.apache.org/jira/browse/MAPREDUCE-3291) | App fail to launch due to delegation token not found in cache | Blocker | mrv2 | Ramya Sunil | Robert Joseph Evans |
+| [MAPREDUCE-3344](https://issues.apache.org/jira/browse/MAPREDUCE-3344) | o.a.h.mapreduce.Reducer since 0.21 blindly casts to ReduceContext.ValueIterator | Major | . | Brock Noland | Brock Noland |
+| [HADOOP-7801](https://issues.apache.org/jira/browse/HADOOP-7801) | HADOOP\_PREFIX cannot be overriden | Major | build | Bruno Mahé | Bruno Mahé |
+| [MAPREDUCE-3346](https://issues.apache.org/jira/browse/MAPREDUCE-3346) | Rumen LoggedTaskAttempt getHostName call returns hostname as null | Blocker | tools/rumen | Karam Singh | Amar Kamat |
+| [MAPREDUCE-3342](https://issues.apache.org/jira/browse/MAPREDUCE-3342) | JobHistoryServer doesn't show job queue | Critical | jobhistoryserver, mrv2 | Thomas Graves | Jonathan Eagles |
+| [MAPREDUCE-3345](https://issues.apache.org/jira/browse/MAPREDUCE-3345) | Race condition in ResourceManager causing TestContainerManagerSecurity to fail sometimes | Major | mrv2, resourcemanager | Vinod Kumar Vavilapalli | Hitesh Shah |
+| [MAPREDUCE-3368](https://issues.apache.org/jira/browse/MAPREDUCE-3368) | compile-mapred-test fails | Critical | build, mrv2 | Ramya Sunil | Hitesh Shah |
+| [MAPREDUCE-3336](https://issues.apache.org/jira/browse/MAPREDUCE-3336) | com.google.inject.internal.Preconditions not public api - shouldn't be using it | Critical | mrv2 | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-3333](https://issues.apache.org/jira/browse/MAPREDUCE-3333) | MR AM for sort-job going out of memory | Blocker | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [MAPREDUCE-3280](https://issues.apache.org/jira/browse/MAPREDUCE-3280) | MR AM should not read the username from configuration | Major | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [MAPREDUCE-3379](https://issues.apache.org/jira/browse/MAPREDUCE-3379) | LocalResourceTracker should not tracking deleted cache entries | Major | mrv2, nodemanager | Siddharth Seth | Siddharth Seth |
+| [MAPREDUCE-3370](https://issues.apache.org/jira/browse/MAPREDUCE-3370) | MiniMRYarnCluster uses a hard coded path location for the MapReduce application jar | Major | mrv2, test | Ahmed Radwan | Ahmed Radwan |
| [HADOOP-7813](https://issues.apache.org/jira/browse/HADOOP-7813) | test-patch +1 patches that introduce javadoc and findbugs warnings in some cases | Major | build, test | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-3324](https://issues.apache.org/jira/browse/MAPREDUCE-3324) | Not All HttpServer tools links (stacks,logs,config,metrics) are accessible through all UI servers | Critical | jobhistoryserver, mrv2, nodemanager | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-3243](https://issues.apache.org/jira/browse/MAPREDUCE-3243) | Invalid tracking URL for streaming jobs | Major | contrib/streaming, mrv2 | Ramya Sunil | Jonathan Eagles |
| [HADOOP-7811](https://issues.apache.org/jira/browse/HADOOP-7811) | TestUserGroupInformation#testGetServerSideGroups test fails in chroot | Major | security, test | Jonathan Eagles | Jonathan Eagles |
-| [HADOOP-7810](https://issues.apache.org/jira/browse/HADOOP-7810) | move hadoop archive to core from tools | Blocker | . | John George | John George |
-| [HADOOP-7802](https://issues.apache.org/jira/browse/HADOOP-7802) | Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. | Major | . | Bruno Mahé | Bruno Mahé |
-| [HADOOP-7801](https://issues.apache.org/jira/browse/HADOOP-7801) | HADOOP\_PREFIX cannot be overriden | Major | build | Bruno Mahé | Bruno Mahé |
+| [MAPREDUCE-3355](https://issues.apache.org/jira/browse/MAPREDUCE-3355) | AM scheduling hangs frequently with sort job on 350 nodes | Blocker | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [MAPREDUCE-3407](https://issues.apache.org/jira/browse/MAPREDUCE-3407) | Wrong jar getting used in TestMR\*Jobs\* for MiniMRYarnCluster | Minor | mrv2 | Hitesh Shah | Hitesh Shah |
| [HADOOP-7787](https://issues.apache.org/jira/browse/HADOOP-7787) | Make source tarball use conventional name. | Major | build | Bruno Mahé | Bruno Mahé |
-| [HADOOP-6490](https://issues.apache.org/jira/browse/HADOOP-6490) | Path.normalize should use StringUtils.replace in favor of String.replace | Minor | fs | Zheng Shao | Uma Maheswara Rao G |
-| [HDFS-2923](https://issues.apache.org/jira/browse/HDFS-2923) | Namenode IPC handler count uses the wrong configuration key | Critical | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2893](https://issues.apache.org/jira/browse/HDFS-2893) | The start/stop scripts don't start/stop the 2NN when using the default configuration | Minor | . | Eli Collins | Eli Collins |
-| [HDFS-2889](https://issues.apache.org/jira/browse/HDFS-2889) | getNumCurrentReplicas is package private but should be public on 0.23 (see HDFS-2408) | Major | hdfs-client | Gregory Chanan | Gregory Chanan |
-| [HDFS-2869](https://issues.apache.org/jira/browse/HDFS-2869) | Error in Webhdfs documentation for mkdir | Minor | webhdfs | Harsh J | Harsh J |
-| [HDFS-2840](https://issues.apache.org/jira/browse/HDFS-2840) | TestHostnameFilter should work with localhost or localhost.localdomain | Major | test | Eli Collins | Alejandro Abdelnur |
-| [HDFS-2837](https://issues.apache.org/jira/browse/HDFS-2837) | mvn javadoc:javadoc not seeing LimitedPrivate class | Major | . | Robert Joseph Evans | Robert Joseph Evans |
-| [HDFS-2836](https://issues.apache.org/jira/browse/HDFS-2836) | HttpFSServer still has 2 javadoc warnings in trunk | Major | . | Robert Joseph Evans | Robert Joseph Evans |
-| [HDFS-2835](https://issues.apache.org/jira/browse/HDFS-2835) | Fix org.apache.hadoop.hdfs.tools.GetConf$Command Findbug issue | Major | tools | Robert Joseph Evans | Robert Joseph Evans |
-| [HDFS-2827](https://issues.apache.org/jira/browse/HDFS-2827) | Cannot save namespace after renaming a directory above a file with an open lease | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HDFS-2822](https://issues.apache.org/jira/browse/HDFS-2822) | processMisReplicatedBlock incorrectly identifies under-construction blocks as under-replicated | Major | ha, namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2818](https://issues.apache.org/jira/browse/HDFS-2818) | dfshealth.jsp missing space between role and node name | Trivial | namenode | Todd Lipcon | Devaraj K |
-| [HDFS-2816](https://issues.apache.org/jira/browse/HDFS-2816) | Fix missing license header in hadoop-hdfs-project/hadoop-hdfs-httpfs/dev-support/findbugsExcludeFile.xml | Trivial | . | Hitesh Shah | Hitesh Shah |
-| [HDFS-2810](https://issues.apache.org/jira/browse/HDFS-2810) | Leases not properly getting renewed by clients | Critical | hdfs-client | Todd Lipcon | Todd Lipcon |
-| [HDFS-2791](https://issues.apache.org/jira/browse/HDFS-2791) | If block report races with closing of file, replica is incorrectly marked corrupt | Major | datanode, namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2790](https://issues.apache.org/jira/browse/HDFS-2790) | FSNamesystem.setTimes throws exception with wrong configuration name in the message | Minor | . | Arpit Gupta | Arpit Gupta |
-| [HDFS-2751](https://issues.apache.org/jira/browse/HDFS-2751) | Datanode drops OS cache behind reads even for short reads | Major | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2722](https://issues.apache.org/jira/browse/HDFS-2722) | HttpFs shouldn't be using an int for block size | Major | hdfs-client | Harsh J | Harsh J |
-| [HDFS-2710](https://issues.apache.org/jira/browse/HDFS-2710) | HDFS part of MAPREDUCE-3529, HADOOP-7933 | Critical | . | Siddharth Seth | |
-| [HDFS-2707](https://issues.apache.org/jira/browse/HDFS-2707) | HttpFS should read the hadoop-auth secret from a file instead inline from the configuration | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HDFS-2706](https://issues.apache.org/jira/browse/HDFS-2706) | Use configuration for blockInvalidateLimit if it is set | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2705](https://issues.apache.org/jira/browse/HDFS-2705) | HttpFS server should check that upload requests have correct content-type | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HDFS-2658](https://issues.apache.org/jira/browse/HDFS-2658) | HttpFS introduced 70 javadoc warnings | Major | . | Eli Collins | Alejandro Abdelnur |
-| [HDFS-2657](https://issues.apache.org/jira/browse/HDFS-2657) | TestHttpFSServer and TestServerWebApp are failing on trunk | Major | . | Eli Collins | Alejandro Abdelnur |
-| [HDFS-2649](https://issues.apache.org/jira/browse/HDFS-2649) | eclipse:eclipse build fails for hadoop-hdfs-httpfs | Major | build | Jason Lowe | Jason Lowe |
-| [HDFS-2646](https://issues.apache.org/jira/browse/HDFS-2646) | Hadoop HttpFS introduced 4 findbug warnings. | Major | . | Uma Maheswara Rao G | Alejandro Abdelnur |
-| [HDFS-2640](https://issues.apache.org/jira/browse/HDFS-2640) | Javadoc generation hangs | Major | . | Tom White | Tom White |
-| [HDFS-2614](https://issues.apache.org/jira/browse/HDFS-2614) | hadoop dist tarball is missing hdfs headers | Major | build | Bruno Mahé | Alejandro Abdelnur |
-| [HDFS-2606](https://issues.apache.org/jira/browse/HDFS-2606) | webhdfs client filesystem impl must set the content-type header for create/append | Critical | webhdfs | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HDFS-2596](https://issues.apache.org/jira/browse/HDFS-2596) | TestDirectoryScanner doesn't test parallel scans | Major | datanode, test | Eli Collins | Eli Collins |
-| [HDFS-2594](https://issues.apache.org/jira/browse/HDFS-2594) | webhdfs HTTP API should implement getDelegationTokens() instead getDelegationToken() | Critical | webhdfs | Alejandro Abdelnur | Tsz Wo Nicholas Sze |
-| [HDFS-2590](https://issues.apache.org/jira/browse/HDFS-2590) | Some links in WebHDFS forrest doc do not work | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2588](https://issues.apache.org/jira/browse/HDFS-2588) | hdfs jsp pages missing DOCTYPE [post-split branches] | Trivial | scripts | Dave Vronay | Dave Vronay |
-| [HDFS-2575](https://issues.apache.org/jira/browse/HDFS-2575) | DFSTestUtil may create empty files | Minor | test | Todd Lipcon | Todd Lipcon |
-| [HDFS-2567](https://issues.apache.org/jira/browse/HDFS-2567) | When 0 DNs are available, show a proper error when trying to browse DFS via web UI | Major | namenode | Harsh J | Harsh J |
-| [HDFS-2553](https://issues.apache.org/jira/browse/HDFS-2553) | BlockPoolSliceScanner spinning in loop | Critical | datanode | Todd Lipcon | Uma Maheswara Rao G |
-| [HDFS-2545](https://issues.apache.org/jira/browse/HDFS-2545) | Webhdfs: Support multiple namenodes in federation | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-7802](https://issues.apache.org/jira/browse/HADOOP-7802) | Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. | Major | . | Bruno Mahé | Bruno Mahé |
| [HDFS-2544](https://issues.apache.org/jira/browse/HDFS-2544) | Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. | Major | scripts | Bruno Mahé | Bruno Mahé |
+| [MAPREDUCE-3373](https://issues.apache.org/jira/browse/MAPREDUCE-3373) | Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. | Major | . | Bruno Mahé | Bruno Mahé |
| [HDFS-2543](https://issues.apache.org/jira/browse/HDFS-2543) | HADOOP\_PREFIX cannot be overriden | Major | scripts | Bruno Mahé | Bruno Mahé |
+| [MAPREDUCE-3372](https://issues.apache.org/jira/browse/MAPREDUCE-3372) | HADOOP\_PREFIX cannot be overriden | Major | . | Bruno Mahé | Bruno Mahé |
| [HDFS-2541](https://issues.apache.org/jira/browse/HDFS-2541) | For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. | Major | datanode | Harsh J | Harsh J |
-| [HDFS-1314](https://issues.apache.org/jira/browse/HDFS-1314) | dfs.blocksize accepts only absolute value | Minor | . | Karim Saadah | Sho Shimauchi |
-| [HDFS-442](https://issues.apache.org/jira/browse/HDFS-442) | dfsthroughput in test.jar throws NPE | Minor | test | Ramya Sunil | Harsh J |
-| [HDFS-69](https://issues.apache.org/jira/browse/HDFS-69) | Improve dfsadmin command line help | Minor | . | Ravi Phulari | Harsh J |
-| [MAPREDUCE-3880](https://issues.apache.org/jira/browse/MAPREDUCE-3880) | Allow for 32-bit container-executor | Blocker | build, mrv2 | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-3858](https://issues.apache.org/jira/browse/MAPREDUCE-3858) | Task attempt failure during commit results in task never completing | Critical | mrv2 | Tom White | Tom White |
-| [MAPREDUCE-3856](https://issues.apache.org/jira/browse/MAPREDUCE-3856) | Instances of RunningJob class givs incorrect job tracking urls when mutiple jobs are submitted from same client jvm. | Critical | mrv2 | Eric Payne | Eric Payne |
-| [MAPREDUCE-3843](https://issues.apache.org/jira/browse/MAPREDUCE-3843) | Job summary log file found missing on the RM host | Critical | jobhistoryserver, mrv2 | Anupam Seth | Anupam Seth |
-| [MAPREDUCE-3840](https://issues.apache.org/jira/browse/MAPREDUCE-3840) | JobEndNotifier doesn't use the proxyToUse during connecting | Blocker | mrv2 | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-3834](https://issues.apache.org/jira/browse/MAPREDUCE-3834) | If multiple hosts for a split belong to the same rack, the rack is added multiple times in the AM request table | Critical | mr-am, mrv2 | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-3833](https://issues.apache.org/jira/browse/MAPREDUCE-3833) | Capacity scheduler queue refresh doesn't recompute queue capacities properly | Major | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-3828](https://issues.apache.org/jira/browse/MAPREDUCE-3828) | Broken urls: AM tracking url and jobhistory url in a single node setup. | Major | mrv2 | Ahmed Radwan | Siddharth Seth |
-| [MAPREDUCE-3826](https://issues.apache.org/jira/browse/MAPREDUCE-3826) | RM UI when loaded throws a message stating Data Tables warning and then the column sorting stops working | Major | mrv2 | Arpit Gupta | Jonathan Eagles |
-| [MAPREDUCE-3822](https://issues.apache.org/jira/browse/MAPREDUCE-3822) | TestJobCounters is failing intermittently on trunk and 0.23. | Critical | mrv2 | Mahadev konar | Mahadev konar |
-| [MAPREDUCE-3817](https://issues.apache.org/jira/browse/MAPREDUCE-3817) | bin/mapred command cannot run distcp and archive jobs | Major | mrv2 | Arpit Gupta | Arpit Gupta |
-| [MAPREDUCE-3814](https://issues.apache.org/jira/browse/MAPREDUCE-3814) | MR1 compile fails | Major | mrv1, mrv2 | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-3808](https://issues.apache.org/jira/browse/MAPREDUCE-3808) | NPE in FileOutputCommitter when running a 0 reduce job | Blocker | mrv2 | Siddharth Seth | Robert Joseph Evans |
-| [MAPREDUCE-3804](https://issues.apache.org/jira/browse/MAPREDUCE-3804) | yarn webapp interface vulnerable to cross scripting attacks | Major | jobhistoryserver, mrv2, resourcemanager | Dave Thompson | Dave Thompson |
-| [MAPREDUCE-3795](https://issues.apache.org/jira/browse/MAPREDUCE-3795) | "job -status" command line output is malformed | Major | mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-3794](https://issues.apache.org/jira/browse/MAPREDUCE-3794) | Support mapred.Task.Counter and mapred.JobInProgress.Counter enums for compatibility | Major | mrv2 | Tom White | Tom White |
-| [MAPREDUCE-3791](https://issues.apache.org/jira/browse/MAPREDUCE-3791) | can't build site in hadoop-yarn-server-common | Major | documentation, mrv2 | Roman Shaposhnik | Mahadev konar |
-| [MAPREDUCE-3784](https://issues.apache.org/jira/browse/MAPREDUCE-3784) | maxActiveApplications(\|PerUser) per queue is too low for small clusters | Major | mrv2 | Ramya Sunil | Arun C Murthy |
-| [MAPREDUCE-3780](https://issues.apache.org/jira/browse/MAPREDUCE-3780) | RM assigns containers to killed applications | Blocker | mrv2 | Ramya Sunil | Hitesh Shah |
-| [MAPREDUCE-3775](https://issues.apache.org/jira/browse/MAPREDUCE-3775) | Change MiniYarnCluster to escape special chars in testname | Minor | mrv2 | Hitesh Shah | Hitesh Shah |
-| [MAPREDUCE-3774](https://issues.apache.org/jira/browse/MAPREDUCE-3774) | yarn-default.xml should be moved to hadoop-yarn-common. | Major | mrv2 | Mahadev konar | Mahadev konar |
-| [MAPREDUCE-3770](https://issues.apache.org/jira/browse/MAPREDUCE-3770) | [Rumen] Zombie.getJobConf() results into NPE | Critical | tools/rumen | Amar Kamat | Amar Kamat |
-| [MAPREDUCE-3765](https://issues.apache.org/jira/browse/MAPREDUCE-3765) | FifoScheduler does not respect yarn.scheduler.fifo.minimum-allocation-mb setting | Minor | mrv2 | Hitesh Shah | Hitesh Shah |
-| [MAPREDUCE-3764](https://issues.apache.org/jira/browse/MAPREDUCE-3764) | AllocatedGB etc metrics incorrect if min-allocation-mb isn't a multiple of 1GB | Critical | mrv2 | Siddharth Seth | Arun C Murthy |
-| [MAPREDUCE-3762](https://issues.apache.org/jira/browse/MAPREDUCE-3762) | Resource Manager fails to come up with default capacity scheduler configs. | Critical | mrv2 | Mahadev konar | Mahadev konar |
-| [MAPREDUCE-3760](https://issues.apache.org/jira/browse/MAPREDUCE-3760) | Blacklisted NMs should not appear in Active nodes list | Major | mrv2 | Ramya Sunil | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-3759](https://issues.apache.org/jira/browse/MAPREDUCE-3759) | ClassCastException thrown in -list-active-trackers when there are a few unhealthy nodes | Major | mrv2 | Ramya Sunil | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-3754](https://issues.apache.org/jira/browse/MAPREDUCE-3754) | RM webapp should have pages filtered based on App-state | Major | mrv2, webapps | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-3752](https://issues.apache.org/jira/browse/MAPREDUCE-3752) | Headroom should be capped by queue max-cap | Blocker | mrv2 | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-3749](https://issues.apache.org/jira/browse/MAPREDUCE-3749) | ConcurrentModificationException in counter groups | Blocker | mrv2 | Tom White | Tom White |
-| [MAPREDUCE-3748](https://issues.apache.org/jira/browse/MAPREDUCE-3748) | Move CS related nodeUpdate log messages to DEBUG | Minor | mrv2 | Ramya Sunil | Ramya Sunil |
-| [MAPREDUCE-3747](https://issues.apache.org/jira/browse/MAPREDUCE-3747) | Memory Total is not refreshed until an app is launched | Major | mrv2 | Ramya Sunil | Arun C Murthy |
-| [MAPREDUCE-3744](https://issues.apache.org/jira/browse/MAPREDUCE-3744) | Unable to retrieve application logs via "yarn logs" or "mapred job -logs" | Blocker | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-3742](https://issues.apache.org/jira/browse/MAPREDUCE-3742) | "yarn logs" command fails with ClassNotFoundException | Blocker | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-3737](https://issues.apache.org/jira/browse/MAPREDUCE-3737) | The Web Application Proxy's is not documented very well | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-3735](https://issues.apache.org/jira/browse/MAPREDUCE-3735) | Add distcp jar to the distribution (tar) | Blocker | mrv2 | Mahadev konar | Mahadev konar |
-| [MAPREDUCE-3733](https://issues.apache.org/jira/browse/MAPREDUCE-3733) | Add Apache License Header to hadoop-distcp/pom.xml | Major | . | Mahadev konar | Mahadev konar |
-| [MAPREDUCE-3732](https://issues.apache.org/jira/browse/MAPREDUCE-3732) | CS should only use 'activeUsers with pending requests' for computing user-limits | Blocker | mrv2, resourcemanager, scheduler | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-3727](https://issues.apache.org/jira/browse/MAPREDUCE-3727) | jobtoken location property in jobconf refers to wrong jobtoken file | Critical | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-3723](https://issues.apache.org/jira/browse/MAPREDUCE-3723) | TestAMWebServicesJobs & TestHSWebServicesJobs incorrectly asserting tests | Major | mrv2, test, webapps | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh |
-| [MAPREDUCE-3721](https://issues.apache.org/jira/browse/MAPREDUCE-3721) | Race in shuffle can cause it to hang | Blocker | mrv2 | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-3717](https://issues.apache.org/jira/browse/MAPREDUCE-3717) | JobClient test jar has missing files to run all the test programs. | Blocker | mrv2 | Mahadev konar | Mahadev konar |
-| [MAPREDUCE-3716](https://issues.apache.org/jira/browse/MAPREDUCE-3716) | java.io.File.createTempFile fails in map/reduce tasks | Blocker | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-3714](https://issues.apache.org/jira/browse/MAPREDUCE-3714) | Reduce hangs in a corner case | Blocker | mrv2, task | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-3713](https://issues.apache.org/jira/browse/MAPREDUCE-3713) | Incorrect headroom reported to jobs | Blocker | mrv2, resourcemanager | Siddharth Seth | Arun C Murthy |
-| [MAPREDUCE-3712](https://issues.apache.org/jira/browse/MAPREDUCE-3712) | The mapreduce tar does not contain the hadoop-mapreduce-client-jobclient-tests.jar. | Blocker | mrv2 | Ravi Prakash | Mahadev konar |
-| [MAPREDUCE-3710](https://issues.apache.org/jira/browse/MAPREDUCE-3710) | last split generated by FileInputFormat.getSplits may not have the best locality | Major | mrv1, mrv2 | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-3709](https://issues.apache.org/jira/browse/MAPREDUCE-3709) | TestDistributedShell is failing | Major | mrv2, test | Eli Collins | Hitesh Shah |
-| [MAPREDUCE-3708](https://issues.apache.org/jira/browse/MAPREDUCE-3708) | Metrics: Incorrect Apps Submitted Count | Major | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh |
-| [MAPREDUCE-3705](https://issues.apache.org/jira/browse/MAPREDUCE-3705) | ant build fails on 0.23 branch | Blocker | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3703](https://issues.apache.org/jira/browse/MAPREDUCE-3703) | ResourceManager should provide node lists in JMX output | Critical | mrv2, resourcemanager | Eric Payne | Eric Payne |
-| [MAPREDUCE-3702](https://issues.apache.org/jira/browse/MAPREDUCE-3702) | internal server error trying access application master via proxy with filter enabled | Critical | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3701](https://issues.apache.org/jira/browse/MAPREDUCE-3701) | Delete HadoopYarnRPC from 0.23 branch. | Major | mrv2 | Mahadev konar | Mahadev konar |
-| [MAPREDUCE-3699](https://issues.apache.org/jira/browse/MAPREDUCE-3699) | Default RPC handlers are very low for YARN servers | Major | mrv2 | Vinod Kumar Vavilapalli | Hitesh Shah |
-| [MAPREDUCE-3697](https://issues.apache.org/jira/browse/MAPREDUCE-3697) | Hadoop Counters API limits Oozie's working across different hadoop versions | Blocker | mrv2 | John George | Mahadev konar |
-| [MAPREDUCE-3696](https://issues.apache.org/jira/browse/MAPREDUCE-3696) | MR job via oozie does not work on hadoop 23 | Blocker | mrv2 | John George | John George |
-| [MAPREDUCE-3691](https://issues.apache.org/jira/browse/MAPREDUCE-3691) | webservices add support to compress response | Critical | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3689](https://issues.apache.org/jira/browse/MAPREDUCE-3689) | RM web UI doesn't handle newline in job name | Blocker | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3684](https://issues.apache.org/jira/browse/MAPREDUCE-3684) | LocalDistributedCacheManager does not shut down its thread pool | Major | client | Tom White | Tom White |
-| [MAPREDUCE-3683](https://issues.apache.org/jira/browse/MAPREDUCE-3683) | Capacity scheduler LeafQueues maximum capacity calculation issues | Blocker | mrv2 | Thomas Graves | Arun C Murthy |
-| [MAPREDUCE-3681](https://issues.apache.org/jira/browse/MAPREDUCE-3681) | capacity scheduler LeafQueues calculate used capacity wrong | Critical | mrv2 | Thomas Graves | Arun C Murthy |
-| [MAPREDUCE-3669](https://issues.apache.org/jira/browse/MAPREDUCE-3669) | Getting a lot of PriviledgedActionException / SaslException when running a job | Blocker | mrv2 | Thomas Graves | Mahadev konar |
-| [MAPREDUCE-3664](https://issues.apache.org/jira/browse/MAPREDUCE-3664) | HDFS Federation Documentation has incorrect configuration example | Minor | documentation | praveen sripati | Brandon Li |
-| [MAPREDUCE-3657](https://issues.apache.org/jira/browse/MAPREDUCE-3657) | State machine visualize build fails | Minor | build, mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-3656](https://issues.apache.org/jira/browse/MAPREDUCE-3656) | Sort job on 350 scale is consistently failing with latest MRV2 code | Blocker | applicationmaster, mrv2, resourcemanager | Karam Singh | Siddharth Seth |
-| [MAPREDUCE-3652](https://issues.apache.org/jira/browse/MAPREDUCE-3652) | org.apache.hadoop.mapred.TestWebUIAuthorization.testWebUIAuthorization fails | Blocker | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3651](https://issues.apache.org/jira/browse/MAPREDUCE-3651) | TestQueueManagerRefresh fails | Blocker | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3649](https://issues.apache.org/jira/browse/MAPREDUCE-3649) | Job End notification gives an error on calling back. | Blocker | mrv2 | Mahadev konar | Ravi Prakash |
-| [MAPREDUCE-3648](https://issues.apache.org/jira/browse/MAPREDUCE-3648) | TestJobConf failing | Blocker | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3646](https://issues.apache.org/jira/browse/MAPREDUCE-3646) | Remove redundant URL info from "mapred job" output | Major | client, mrv2 | Ramya Sunil | Jonathan Eagles |
-| [MAPREDUCE-3645](https://issues.apache.org/jira/browse/MAPREDUCE-3645) | TestJobHistory fails | Blocker | mrv1 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3639](https://issues.apache.org/jira/browse/MAPREDUCE-3639) | TokenCache likely broken for FileSystems which don't issue delegation tokens | Blocker | mrv2 | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-3625](https://issues.apache.org/jira/browse/MAPREDUCE-3625) | CapacityScheduler web-ui display of queue's used capacity is broken | Critical | mrv2 | Arun C Murthy | Jason Lowe |
-| [MAPREDUCE-3624](https://issues.apache.org/jira/browse/MAPREDUCE-3624) | bin/yarn script adds jdk tools.jar to the classpath. | Major | mrv2 | Mahadev konar | Mahadev konar |
-| [MAPREDUCE-3617](https://issues.apache.org/jira/browse/MAPREDUCE-3617) | Remove yarn default values for resource manager and nodemanager principal | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-3615](https://issues.apache.org/jira/browse/MAPREDUCE-3615) | mapred ant test failures | Blocker | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3608](https://issues.apache.org/jira/browse/MAPREDUCE-3608) | MAPREDUCE-3522 commit causes compilation to fail | Major | mrv2 | Mahadev konar | Mahadev konar |
-| [MAPREDUCE-3604](https://issues.apache.org/jira/browse/MAPREDUCE-3604) | Streaming's check for local mode is broken | Blocker | contrib/streaming | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-3596](https://issues.apache.org/jira/browse/MAPREDUCE-3596) | Sort benchmark got hang after completion of 99% map phase | Blocker | applicationmaster, mrv2 | Ravi Prakash | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-3588](https://issues.apache.org/jira/browse/MAPREDUCE-3588) | bin/yarn broken after MAPREDUCE-3366 | Blocker | . | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-3586](https://issues.apache.org/jira/browse/MAPREDUCE-3586) | Lots of AMs hanging around in PIG testing | Blocker | mr-am, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-3582](https://issues.apache.org/jira/browse/MAPREDUCE-3582) | Move successfully passing MR1 tests to MR2 maven tree. | Major | mrv2, test | Ahmed Radwan | Ahmed Radwan |
-| [MAPREDUCE-3579](https://issues.apache.org/jira/browse/MAPREDUCE-3579) | ConverterUtils should not include a port in a path for a URL with no port | Major | mrv2 | Aaron T. Myers | Aaron T. Myers |
-| [MAPREDUCE-3564](https://issues.apache.org/jira/browse/MAPREDUCE-3564) | TestStagingCleanup and TestJobEndNotifier are failing on trunk. | Blocker | mrv2 | Mahadev konar | Siddharth Seth |
-| [MAPREDUCE-3563](https://issues.apache.org/jira/browse/MAPREDUCE-3563) | LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter | Major | mrv2 | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-3560](https://issues.apache.org/jira/browse/MAPREDUCE-3560) | TestRMNodeTransitions is failing on trunk | Blocker | mrv2, resourcemanager, test | Vinod Kumar Vavilapalli | Siddharth Seth |
-| [MAPREDUCE-3557](https://issues.apache.org/jira/browse/MAPREDUCE-3557) | MR1 test fail to compile because of missing hadoop-archives dependency | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-3549](https://issues.apache.org/jira/browse/MAPREDUCE-3549) | write api documentation for web service apis for RM, NM, mapreduce app master, and job history server | Blocker | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3544](https://issues.apache.org/jira/browse/MAPREDUCE-3544) | gridmix build is broken, requires hadoop-archives to be added as ivy dependency | Major | build, tools/rumen | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-3542](https://issues.apache.org/jira/browse/MAPREDUCE-3542) | Support "FileSystemCounter" legacy counter group name for compatibility | Major | . | Tom White | Tom White |
-| [MAPREDUCE-3541](https://issues.apache.org/jira/browse/MAPREDUCE-3541) | Fix broken TestJobQueueClient test | Blocker | mrv2 | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-3537](https://issues.apache.org/jira/browse/MAPREDUCE-3537) | DefaultContainerExecutor has a race condn. with multiple concurrent containers | Blocker | . | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-3532](https://issues.apache.org/jira/browse/MAPREDUCE-3532) | When 0 is provided as port number in yarn.nodemanager.webapp.address, NMs webserver component picks up random port, NM keeps on Reporting 0 port to RM | Critical | mrv2, nodemanager | Karam Singh | Bhallamudi Venkata Siva Kamesh |
-| [MAPREDUCE-3531](https://issues.apache.org/jira/browse/MAPREDUCE-3531) | Sometimes java.lang.IllegalArgumentException: Invalid key to HMAC computation in NODE\_UPDATE also causing RM to stop scheduling | Blocker | mrv2, resourcemanager, scheduler | Karam Singh | Robert Joseph Evans |
-| [MAPREDUCE-3530](https://issues.apache.org/jira/browse/MAPREDUCE-3530) | Sometimes NODE\_UPDATE to the scheduler throws an NPE causing the scheduling to stop | Blocker | mrv2, resourcemanager, scheduler | Karam Singh | Arun C Murthy |
-| [MAPREDUCE-3529](https://issues.apache.org/jira/browse/MAPREDUCE-3529) | TokenCache does not cache viewfs credentials correctly | Critical | mrv2 | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-3528](https://issues.apache.org/jira/browse/MAPREDUCE-3528) | The task timeout check interval should be configurable independent of mapreduce.task.timeout | Major | mr-am, mrv2 | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-3527](https://issues.apache.org/jira/browse/MAPREDUCE-3527) | Fix minor API incompatibilities between 1.0 and 0.23 | Major | . | Tom White | Tom White |
-| [MAPREDUCE-3522](https://issues.apache.org/jira/browse/MAPREDUCE-3522) | Capacity Scheduler ACLs not inherited by default | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-3521](https://issues.apache.org/jira/browse/MAPREDUCE-3521) | Hadoop Streaming ignores unknown parameters | Minor | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-3518](https://issues.apache.org/jira/browse/MAPREDUCE-3518) | mapred queue -info \<queue\> -showJobs throws NPE | Critical | client, mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-3513](https://issues.apache.org/jira/browse/MAPREDUCE-3513) | Capacity Scheduler web UI has a spelling mistake for Memory. | Trivial | mrv2 | Mahadev konar | chackaravarthy |
-| [MAPREDUCE-3510](https://issues.apache.org/jira/browse/MAPREDUCE-3510) | Capacity Scheduler inherited ACLs not displayed by mapred queue -showacls | Major | capacity-sched, mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-3505](https://issues.apache.org/jira/browse/MAPREDUCE-3505) | yarn APPLICATION\_CLASSPATH needs to be overridable | Major | mrv2 | Bruno Mahé | Ahmed Radwan |
-| [MAPREDUCE-3500](https://issues.apache.org/jira/browse/MAPREDUCE-3500) | MRJobConfig creates an LD\_LIBRARY\_PATH using the platform ARCH | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-3499](https://issues.apache.org/jira/browse/MAPREDUCE-3499) | New MiniMR does not setup proxyuser configuration correctly, thus tests using doAs do not work | Blocker | mrv2, test | Alejandro Abdelnur | John George |
-| [MAPREDUCE-3496](https://issues.apache.org/jira/browse/MAPREDUCE-3496) | Yarn initializes ACL operations from capacity scheduler config in a non-deterministic order | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-3490](https://issues.apache.org/jira/browse/MAPREDUCE-3490) | RMContainerAllocator counts failed maps towards Reduce ramp up | Blocker | mr-am, mrv2 | Siddharth Seth | Sharad Agarwal |
-| [MAPREDUCE-3488](https://issues.apache.org/jira/browse/MAPREDUCE-3488) | Streaming jobs are failing because the main class isnt set in the pom files. | Blocker | mrv2 | Mahadev konar | Mahadev konar |
-| [MAPREDUCE-3487](https://issues.apache.org/jira/browse/MAPREDUCE-3487) | jobhistory web ui task counters no longer links to singletakecounter page | Critical | mrv2 | Thomas Graves | Jason Lowe |
-| [MAPREDUCE-3484](https://issues.apache.org/jira/browse/MAPREDUCE-3484) | JobEndNotifier is getting interrupted before completing all its retries. | Major | mr-am, mrv2 | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-3479](https://issues.apache.org/jira/browse/MAPREDUCE-3479) | JobClient#getJob cannot find local jobs | Major | client | Tom White | Tom White |
-| [MAPREDUCE-3478](https://issues.apache.org/jira/browse/MAPREDUCE-3478) | Cannot build against ZooKeeper 3.4.0 | Minor | mrv2 | Andrew Bayer | Tom White |
-| [MAPREDUCE-3477](https://issues.apache.org/jira/browse/MAPREDUCE-3477) | Hadoop site documentation cannot be built anymore on trunk and branch-0.23 | Major | documentation, mrv2 | Bruno Mahé | Jonathan Eagles |
-| [MAPREDUCE-3465](https://issues.apache.org/jira/browse/MAPREDUCE-3465) | org.apache.hadoop.yarn.util.TestLinuxResourceCalculatorPlugin fails on 0.23 | Minor | mrv2 | Hitesh Shah | Hitesh Shah |
-| [MAPREDUCE-3464](https://issues.apache.org/jira/browse/MAPREDUCE-3464) | mapreduce jsp pages missing DOCTYPE [post-split branches] | Trivial | . | Dave Vronay | Dave Vronay |
-| [MAPREDUCE-3463](https://issues.apache.org/jira/browse/MAPREDUCE-3463) | Second AM fails to recover properly when first AM is killed with java.lang.IllegalArgumentException causing lost job | Blocker | applicationmaster, mrv2 | Karam Singh | Siddharth Seth |
-| [MAPREDUCE-3462](https://issues.apache.org/jira/browse/MAPREDUCE-3462) | Job submission failing in JUnit tests | Blocker | mrv2, test | Amar Kamat | Ravi Prakash |
-| [MAPREDUCE-3460](https://issues.apache.org/jira/browse/MAPREDUCE-3460) | MR AM can hang if containers are allocated on a node blacklisted by the AM | Blocker | mr-am, mrv2 | Siddharth Seth | Robert Joseph Evans |
-| [MAPREDUCE-3458](https://issues.apache.org/jira/browse/MAPREDUCE-3458) | Fix findbugs warnings in hadoop-examples | Major | mrv2 | Arun C Murthy | Devaraj K |
-| [MAPREDUCE-3456](https://issues.apache.org/jira/browse/MAPREDUCE-3456) | $HADOOP\_PREFIX/bin/yarn should set defaults for $HADOOP\_\*\_HOME | Blocker | mrv2 | Eric Payne | Eric Payne |
-| [MAPREDUCE-3454](https://issues.apache.org/jira/browse/MAPREDUCE-3454) | [Gridmix] TestDistCacheEmulation is broken | Major | contrib/gridmix | Amar Kamat | Hitesh Shah |
-| [MAPREDUCE-3453](https://issues.apache.org/jira/browse/MAPREDUCE-3453) | RM web ui application details page shows RM cluster about information | Major | mrv2 | Thomas Graves | Jonathan Eagles |
-| [MAPREDUCE-3452](https://issues.apache.org/jira/browse/MAPREDUCE-3452) | fifoscheduler web ui page always shows 0% used for the queue | Major | mrv2 | Thomas Graves | Jonathan Eagles |
-| [MAPREDUCE-3450](https://issues.apache.org/jira/browse/MAPREDUCE-3450) | NM port info no longer available in JobHistory | Major | mr-am, mrv2 | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-3448](https://issues.apache.org/jira/browse/MAPREDUCE-3448) | TestCombineOutputCollector javac unchecked warning on mocked generics | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-3447](https://issues.apache.org/jira/browse/MAPREDUCE-3447) | mapreduce examples not working | Blocker | mrv2 | Thomas Graves | Mahadev konar |
-| [MAPREDUCE-3444](https://issues.apache.org/jira/browse/MAPREDUCE-3444) | trunk/0.23 builds broken | Blocker | mrv2 | Hitesh Shah | Hitesh Shah |
-| [MAPREDUCE-3443](https://issues.apache.org/jira/browse/MAPREDUCE-3443) | Oozie jobs are running as oozie user even though they create the jobclient as doAs. | Blocker | mrv2 | Mahadev konar | Mahadev konar |
+| [HDFS-2567](https://issues.apache.org/jira/browse/HDFS-2567) | When 0 DNs are available, show a proper error when trying to browse DFS via web UI | Major | namenode | Harsh J | Harsh J |
| [MAPREDUCE-3437](https://issues.apache.org/jira/browse/MAPREDUCE-3437) | Branch 23 fails to build with Failure to find org.apache.hadoop:hadoop-project:pom:0.24.0-SNAPSHOT | Blocker | build, mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-3436](https://issues.apache.org/jira/browse/MAPREDUCE-3436) | JobHistory webapp address should use the host from the jobhistory address | Major | mrv2, webapps | Bruno Mahé | Ahmed Radwan |
+| [HADOOP-7843](https://issues.apache.org/jira/browse/HADOOP-7843) | compilation failing because workDir not initialized in RunJar.java | Major | . | John George | John George |
| [MAPREDUCE-3434](https://issues.apache.org/jira/browse/MAPREDUCE-3434) | Nightly build broken | Blocker | mrv2 | Hitesh Shah | Hitesh Shah |
-| [MAPREDUCE-3427](https://issues.apache.org/jira/browse/MAPREDUCE-3427) | streaming tests fail with MR2 | Blocker | contrib/streaming, mrv2 | Alejandro Abdelnur | Hitesh Shah |
-| [MAPREDUCE-3422](https://issues.apache.org/jira/browse/MAPREDUCE-3422) | Counter display names are not being picked up | Major | mrv2 | Tom White | Jonathan Eagles |
-| [MAPREDUCE-3420](https://issues.apache.org/jira/browse/MAPREDUCE-3420) | [Umbrella ticket] Make uber jobs functional | Major | mrv2 | Hitesh Shah | |
-| [MAPREDUCE-3417](https://issues.apache.org/jira/browse/MAPREDUCE-3417) | job access controls not working app master and job history UI's | Blocker | mrv2 | Thomas Graves | Jonathan Eagles |
-| [MAPREDUCE-3413](https://issues.apache.org/jira/browse/MAPREDUCE-3413) | RM web ui applications not sorted in any order by default | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [HDFS-2575](https://issues.apache.org/jira/browse/HDFS-2575) | DFSTestUtil may create empty files | Minor | test | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-3447](https://issues.apache.org/jira/browse/MAPREDUCE-3447) | mapreduce examples not working | Blocker | mrv2 | Thomas Graves | Mahadev konar |
+| [MAPREDUCE-3444](https://issues.apache.org/jira/browse/MAPREDUCE-3444) | trunk/0.23 builds broken | Blocker | mrv2 | Hitesh Shah | Hitesh Shah |
| [MAPREDUCE-3412](https://issues.apache.org/jira/browse/MAPREDUCE-3412) | 'ant docs' is broken | Major | . | Amar Kamat | Amar Kamat |
+| [MAPREDUCE-3454](https://issues.apache.org/jira/browse/MAPREDUCE-3454) | [Gridmix] TestDistCacheEmulation is broken | Major | contrib/gridmix | Amar Kamat | Hitesh Shah |
| [MAPREDUCE-3408](https://issues.apache.org/jira/browse/MAPREDUCE-3408) | yarn-daemon.sh unconditionnaly sets yarn.root.logger | Major | mrv2, nodemanager, resourcemanager | Bruno Mahé | Bruno Mahé |
-| [MAPREDUCE-3407](https://issues.apache.org/jira/browse/MAPREDUCE-3407) | Wrong jar getting used in TestMR\*Jobs\* for MiniMRYarnCluster | Minor | mrv2 | Hitesh Shah | Hitesh Shah |
-| [MAPREDUCE-3404](https://issues.apache.org/jira/browse/MAPREDUCE-3404) | Speculative Execution: speculative map tasks launched even if -Dmapreduce.map.speculative=false | Critical | job submission, mrv2 | patrick white | Eric Payne |
-| [MAPREDUCE-3398](https://issues.apache.org/jira/browse/MAPREDUCE-3398) | Log Aggregation broken in Secure Mode | Blocker | mrv2, nodemanager | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-3391](https://issues.apache.org/jira/browse/MAPREDUCE-3391) | Connecting to CM is logged as Connecting to RM | Minor | applicationmaster | Subroto Sanyal | Subroto Sanyal |
+| [MAPREDUCE-3329](https://issues.apache.org/jira/browse/MAPREDUCE-3329) | capacity schedule maximum-capacity allowed to be less then capacity | Blocker | mrv2 | Thomas Graves | Arun C Murthy |
+| [HDFS-2588](https://issues.apache.org/jira/browse/HDFS-2588) | hdfs jsp pages missing DOCTYPE [post-split branches] | Trivial | scripts | Dave Vronay | Dave Vronay |
+| [MAPREDUCE-3464](https://issues.apache.org/jira/browse/MAPREDUCE-3464) | mapreduce jsp pages missing DOCTYPE [post-split branches] | Trivial | . | Dave Vronay | Dave Vronay |
+| [HDFS-2590](https://issues.apache.org/jira/browse/HDFS-2590) | Some links in WebHDFS forrest doc do not work | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-7859](https://issues.apache.org/jira/browse/HADOOP-7859) | TestViewFsHdfs.testgetFileLinkStatus is failing an assert | Major | fs | Eli Collins | Eli Collins |
+| [MAPREDUCE-3413](https://issues.apache.org/jira/browse/MAPREDUCE-3413) | RM web ui applications not sorted in any order by default | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [HDFS-2596](https://issues.apache.org/jira/browse/HDFS-2596) | TestDirectoryScanner doesn't test parallel scans | Major | datanode, test | Eli Collins | Eli Collins |
+| [MAPREDUCE-3045](https://issues.apache.org/jira/browse/MAPREDUCE-3045) | Elapsed time filter on jobhistory server displays incorrect table entries | Minor | jobhistoryserver, mrv2 | Ramya Sunil | Jonathan Eagles |
+| [MAPREDUCE-3465](https://issues.apache.org/jira/browse/MAPREDUCE-3465) | org.apache.hadoop.yarn.util.TestLinuxResourceCalculatorPlugin fails on 0.23 | Minor | mrv2 | Hitesh Shah | Hitesh Shah |
+| [MAPREDUCE-3121](https://issues.apache.org/jira/browse/MAPREDUCE-3121) | DFIP aka 'NodeManager should handle Disk-Failures In Place' | Blocker | mrv2, nodemanager | Vinod Kumar Vavilapalli | Ravi Gummadi |
+| [MAPREDUCE-3448](https://issues.apache.org/jira/browse/MAPREDUCE-3448) | TestCombineOutputCollector javac unchecked warning on mocked generics | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [HADOOP-7864](https://issues.apache.org/jira/browse/HADOOP-7864) | Building mvn site with Maven \< 3.0.2 causes OOM errors | Major | build | Andrew Bayer | Andrew Bayer |
+| [HDFS-2606](https://issues.apache.org/jira/browse/HDFS-2606) | webhdfs client filesystem impl must set the content-type header for create/append | Critical | webhdfs | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-3450](https://issues.apache.org/jira/browse/MAPREDUCE-3450) | NM port info no longer available in JobHistory | Major | mr-am, mrv2 | Siddharth Seth | Siddharth Seth |
+| [HADOOP-7853](https://issues.apache.org/jira/browse/HADOOP-7853) | multiple javax security configurations cause conflicts | Blocker | security | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-3477](https://issues.apache.org/jira/browse/MAPREDUCE-3477) | Hadoop site documentation cannot be built anymore on trunk and branch-0.23 | Major | documentation, mrv2 | Bruno Mahé | Jonathan Eagles |
+| [MAPREDUCE-3488](https://issues.apache.org/jira/browse/MAPREDUCE-3488) | Streaming jobs are failing because the main class isnt set in the pom files. | Blocker | mrv2 | Mahadev konar | Mahadev konar |
+| [HADOOP-7870](https://issues.apache.org/jira/browse/HADOOP-7870) | fix SequenceFile#createWriter with boolean createParent arg to respect createParent. | Major | . | Jonathan Hsieh | Jonathan Hsieh |
+| [HDFS-2614](https://issues.apache.org/jira/browse/HDFS-2614) | hadoop dist tarball is missing hdfs headers | Major | build | Bruno Mahé | Alejandro Abdelnur |
+| [HADOOP-7854](https://issues.apache.org/jira/browse/HADOOP-7854) | UGI getCurrentUser is not synchronized | Critical | security | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-3463](https://issues.apache.org/jira/browse/MAPREDUCE-3463) | Second AM fails to recover properly when first AM is killed with java.lang.IllegalArgumentException causing lost job | Blocker | applicationmaster, mrv2 | Karam Singh | Siddharth Seth |
+| [MAPREDUCE-3452](https://issues.apache.org/jira/browse/MAPREDUCE-3452) | fifoscheduler web ui page always shows 0% used for the queue | Major | mrv2 | Thomas Graves | Jonathan Eagles |
+| [MAPREDUCE-3443](https://issues.apache.org/jira/browse/MAPREDUCE-3443) | Oozie jobs are running as oozie user even though they create the jobclient as doAs. | Blocker | mrv2 | Mahadev konar | Mahadev konar |
+| [MAPREDUCE-3460](https://issues.apache.org/jira/browse/MAPREDUCE-3460) | MR AM can hang if containers are allocated on a node blacklisted by the AM | Blocker | mr-am, mrv2 | Siddharth Seth | Robert Joseph Evans |
+| [MAPREDUCE-3453](https://issues.apache.org/jira/browse/MAPREDUCE-3453) | RM web ui application details page shows RM cluster about information | Major | mrv2 | Thomas Graves | Jonathan Eagles |
+| [MAPREDUCE-3479](https://issues.apache.org/jira/browse/MAPREDUCE-3479) | JobClient#getJob cannot find local jobs | Major | client | Tom White | Tom White |
+| [MAPREDUCE-3500](https://issues.apache.org/jira/browse/MAPREDUCE-3500) | MRJobConfig creates an LD\_LIBRARY\_PATH using the platform ARCH | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-3456](https://issues.apache.org/jira/browse/MAPREDUCE-3456) | $HADOOP\_PREFIX/bin/yarn should set defaults for $HADOOP\_\*\_HOME | Blocker | mrv2 | Eric Payne | Eric Payne |
+| [MAPREDUCE-3458](https://issues.apache.org/jira/browse/MAPREDUCE-3458) | Fix findbugs warnings in hadoop-examples | Major | mrv2 | Arun C Murthy | Devaraj K |
| [MAPREDUCE-3389](https://issues.apache.org/jira/browse/MAPREDUCE-3389) | MRApps loads the 'mrapp-generated-classpath' file with classpath from the build machine | Critical | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-3496](https://issues.apache.org/jira/browse/MAPREDUCE-3496) | Yarn initializes ACL operations from capacity scheduler config in a non-deterministic order | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [HADOOP-7887](https://issues.apache.org/jira/browse/HADOOP-7887) | KerberosAuthenticatorHandler is not setting KerberosName name rules from configuration | Critical | security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-7898](https://issues.apache.org/jira/browse/HADOOP-7898) | Fix javadoc warnings in AuthenticationToken.java | Minor | security | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-3327](https://issues.apache.org/jira/browse/MAPREDUCE-3327) | RM web ui scheduler link doesn't show correct max value for queues | Critical | mrv2 | Thomas Graves | Anupam Seth |
+| [MAPREDUCE-3513](https://issues.apache.org/jira/browse/MAPREDUCE-3513) | Capacity Scheduler web UI has a spelling mistake for Memory. | Trivial | mrv2 | Mahadev konar | chackaravarthy |
+| [HADOOP-7851](https://issues.apache.org/jira/browse/HADOOP-7851) | Configuration.getClasses() never returns the default value. | Major | conf | Amar Kamat | Uma Maheswara Rao G |
+| [HDFS-2594](https://issues.apache.org/jira/browse/HDFS-2594) | webhdfs HTTP API should implement getDelegationTokens() instead getDelegationToken() | Critical | webhdfs | Alejandro Abdelnur | Tsz Wo Nicholas Sze |
+| [HADOOP-7902](https://issues.apache.org/jira/browse/HADOOP-7902) | skipping name rules setting (if already set) should be done on UGI initialization only | Major | . | Tsz Wo Nicholas Sze | Alejandro Abdelnur |
+| [HADOOP-7878](https://issues.apache.org/jira/browse/HADOOP-7878) | Regression HADOOP-7777 switch changes break HDFS tests when the isSingleSwitch() predicate is used | Minor | util | Steve Loughran | Steve Loughran |
+| [MAPREDUCE-3527](https://issues.apache.org/jira/browse/MAPREDUCE-3527) | Fix minor API incompatibilities between 1.0 and 0.23 | Major | . | Tom White | Tom White |
+| [HADOOP-7912](https://issues.apache.org/jira/browse/HADOOP-7912) | test-patch should run eclipse:eclipse to verify that it does not break again | Major | build | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-3518](https://issues.apache.org/jira/browse/MAPREDUCE-3518) | mapred queue -info \<queue\> -showJobs throws NPE | Critical | client, mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-3328](https://issues.apache.org/jira/browse/MAPREDUCE-3328) | mapred queue -list output inconsistent and missing child queues | Critical | mrv2 | Thomas Graves | Ravi Prakash |
+| [MAPREDUCE-3510](https://issues.apache.org/jira/browse/MAPREDUCE-3510) | Capacity Scheduler inherited ACLs not displayed by mapred queue -showacls | Major | capacity-sched, mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-3537](https://issues.apache.org/jira/browse/MAPREDUCE-3537) | DefaultContainerExecutor has a race condn. with multiple concurrent containers | Blocker | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-7914](https://issues.apache.org/jira/browse/HADOOP-7914) | duplicate declaration of hadoop-hdfs test-jar | Major | build | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-7810](https://issues.apache.org/jira/browse/HADOOP-7810) | move hadoop archive to core from tools | Blocker | . | John George | John George |
+| [MAPREDUCE-3542](https://issues.apache.org/jira/browse/MAPREDUCE-3542) | Support "FileSystemCounter" legacy counter group name for compatibility | Major | . | Tom White | Tom White |
+| [MAPREDUCE-3544](https://issues.apache.org/jira/browse/MAPREDUCE-3544) | gridmix build is broken, requires hadoop-archives to be added as ivy dependency | Major | build, tools/rumen | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-2545](https://issues.apache.org/jira/browse/HDFS-2545) | Webhdfs: Support multiple namenod
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[34/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.0/CHANGES.0.21.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.0/CHANGES.0.21.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.0/CHANGES.0.21.0.md
index 75c62a1..1026058 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.0/CHANGES.0.21.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.21.0/CHANGES.0.21.0.md
@@ -24,1343 +24,1337 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-6701](https://issues.apache.org/jira/browse/HADOOP-6701) | Incorrect exit codes for "dfs -chown", "dfs -chgrp" | Minor | fs | Ravi Phulari | Ravi Phulari |
-| [HADOOP-6686](https://issues.apache.org/jira/browse/HADOOP-6686) | Remove redundant exception class name in unwrapped exceptions thrown at the RPC client | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-6577](https://issues.apache.org/jira/browse/HADOOP-6577) | IPC server response buffer reset threshold should be configurable | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-6569](https://issues.apache.org/jira/browse/HADOOP-6569) | FsShell#cat should avoid calling unecessary getFileStatus before opening a file to read | Major | fs | Hairong Kuang | Hairong Kuang |
-| [HADOOP-6367](https://issues.apache.org/jira/browse/HADOOP-6367) | Move Access Token implementation from Common to HDFS | Major | security | Kan Zhang | Kan Zhang |
-| [HADOOP-6299](https://issues.apache.org/jira/browse/HADOOP-6299) | Use JAAS LoginContext for our login | Major | security | Arun C Murthy | Owen O'Malley |
-| [HADOOP-6230](https://issues.apache.org/jira/browse/HADOOP-6230) | Move process tree, and memory calculator classes out of Common into Map/Reduce. | Major | util | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [HADOOP-6203](https://issues.apache.org/jira/browse/HADOOP-6203) | Improve error message when moving to trash fails due to quota issue | Major | fs | Jakob Homan | Boris Shkolnik |
-| [HADOOP-6201](https://issues.apache.org/jira/browse/HADOOP-6201) | FileSystem::ListStatus should throw FileNotFoundException | Major | fs | Jakob Homan | Jakob Homan |
-| [HADOOP-5913](https://issues.apache.org/jira/browse/HADOOP-5913) | Allow administrators to be able to start and stop queues | Major | . | rahul k singh | rahul k singh |
-| [HADOOP-5879](https://issues.apache.org/jira/browse/HADOOP-5879) | GzipCodec should read compression level etc from configuration | Major | io | Zheng Shao | He Yongqiang |
-| [HADOOP-5861](https://issues.apache.org/jira/browse/HADOOP-5861) | s3n files are not getting split by default | Major | fs/s3 | Joydeep Sen Sarma | Tom White |
-| [HADOOP-5738](https://issues.apache.org/jira/browse/HADOOP-5738) | Split waiting tasks field in JobTracker metrics to individual tasks | Major | metrics | Sreekanth Ramakrishnan | Sreekanth Ramakrishnan |
-| [HADOOP-5679](https://issues.apache.org/jira/browse/HADOOP-5679) | Resolve findbugs warnings in core/streaming/pipes/examples | Major | . | Jothi Padmanabhan | Jothi Padmanabhan |
-| [HADOOP-5620](https://issues.apache.org/jira/browse/HADOOP-5620) | discp can preserve modification times of files | Major | . | dhruba borthakur | Rodrigo Schmidt |
-| [HADOOP-5485](https://issues.apache.org/jira/browse/HADOOP-5485) | Authorisation machanism required for acceesing jobtracker url :- jobtracker.com:port/scheduler | Major | . | Aroop Maliakkal | Vinod Kumar Vavilapalli |
-| [HADOOP-5464](https://issues.apache.org/jira/browse/HADOOP-5464) | DFSClient does not treat write timeout of 0 properly | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-5438](https://issues.apache.org/jira/browse/HADOOP-5438) | Merge FileSystem.create and FileSystem.append | Major | fs | He Yongqiang | He Yongqiang |
-| [HADOOP-5258](https://issues.apache.org/jira/browse/HADOOP-5258) | Provide dfsadmin functionality to report on namenode's view of network topology | Major | . | Jakob Homan | Jakob Homan |
-| [HADOOP-5219](https://issues.apache.org/jira/browse/HADOOP-5219) | SequenceFile is using mapred property | Major | io | Sharad Agarwal | Sharad Agarwal |
-| [HADOOP-5176](https://issues.apache.org/jira/browse/HADOOP-5176) | TestDFSIO reports itself as TestFDSIO | Trivial | benchmarks | Bryan Duxbury | Ravi Phulari |
-| [HADOOP-5094](https://issues.apache.org/jira/browse/HADOOP-5094) | Show dead nodes information in dfsadmin -report | Minor | . | Jim Huang | Jakob Homan |
-| [HADOOP-5022](https://issues.apache.org/jira/browse/HADOOP-5022) | [HOD] logcondense should delete all hod logs for a user, including jobtracker logs | Blocker | contrib/hod | Hemanth Yamijala | Peeyush Bishnoi |
-| [HADOOP-4942](https://issues.apache.org/jira/browse/HADOOP-4942) | Remove getName() and getNamed(String name, Configuration conf) | Major | fs | Tsz Wo Nicholas Sze | Jakob Homan |
+| [HADOOP-4895](https://issues.apache.org/jira/browse/HADOOP-4895) | Remove deprecated methods in DFSClient | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-4941](https://issues.apache.org/jira/browse/HADOOP-4941) | Remove getBlockSize(Path f), getLength(Path f) and getReplication(Path src) | Major | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4268](https://issues.apache.org/jira/browse/HADOOP-4268) | Permission checking in fsck | Major | . | Koji Noguchi | Tsz Wo Nicholas Sze |
+| [HADOOP-4648](https://issues.apache.org/jira/browse/HADOOP-4648) | Remove ChecksumDistriubtedFileSystem and InMemoryFileSystem | Major | fs | Owen O'Malley | Chris Douglas |
| [HADOOP-4940](https://issues.apache.org/jira/browse/HADOOP-4940) | Remove delete(Path f) | Major | fs | Tsz Wo Nicholas Sze | Enis Soztutar |
-| [HADOOP-4895](https://issues.apache.org/jira/browse/HADOOP-4895) | Remove deprecated methods in DFSClient | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4861](https://issues.apache.org/jira/browse/HADOOP-4861) | Add disk usage with human-readable size (-duh) | Trivial | . | Bryan Duxbury | Todd Lipcon |
+| [HADOOP-3953](https://issues.apache.org/jira/browse/HADOOP-3953) | Sticky bit for directories | Major | . | Koji Noguchi | Jakob Homan |
+| [HADOOP-5022](https://issues.apache.org/jira/browse/HADOOP-5022) | [HOD] logcondense should delete all hod logs for a user, including jobtracker logs | Blocker | contrib/hod | Hemanth Yamijala | Peeyush Bishnoi |
+| [HADOOP-5094](https://issues.apache.org/jira/browse/HADOOP-5094) | Show dead nodes information in dfsadmin -report | Minor | . | Jim Huang | Jakob Homan |
+| [HADOOP-5176](https://issues.apache.org/jira/browse/HADOOP-5176) | TestDFSIO reports itself as TestFDSIO | Trivial | benchmarks | Bryan Duxbury | Ravi Phulari |
+| [HADOOP-4942](https://issues.apache.org/jira/browse/HADOOP-4942) | Remove getName() and getNamed(String name, Configuration conf) | Major | fs | Tsz Wo Nicholas Sze | Jakob Homan |
| [HADOOP-4779](https://issues.apache.org/jira/browse/HADOOP-4779) | Remove deprecated FileSystem methods | Major | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-5219](https://issues.apache.org/jira/browse/HADOOP-5219) | SequenceFile is using mapred property | Major | io | Sharad Agarwal | Sharad Agarwal |
+| [HADOOP-5258](https://issues.apache.org/jira/browse/HADOOP-5258) | Provide dfsadmin functionality to report on namenode's view of network topology | Major | . | Jakob Homan | Jakob Homan |
| [HADOOP-4756](https://issues.apache.org/jira/browse/HADOOP-4756) | Create a command line tool to access JMX exported properties from a NameNode server | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [HADOOP-4655](https://issues.apache.org/jira/browse/HADOOP-4655) | FileSystem.CACHE should be ref-counted | Major | fs | Hong Tang | dhruba borthakur |
-| [HADOOP-4648](https://issues.apache.org/jira/browse/HADOOP-4648) | Remove ChecksumDistriubtedFileSystem and InMemoryFileSystem | Major | fs | Owen O'Malley | Chris Douglas |
| [HADOOP-4539](https://issues.apache.org/jira/browse/HADOOP-4539) | Streaming Edits to a Backup Node. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-4268](https://issues.apache.org/jira/browse/HADOOP-4268) | Permission checking in fsck | Major | . | Koji Noguchi | Tsz Wo Nicholas Sze |
-| [HADOOP-3953](https://issues.apache.org/jira/browse/HADOOP-3953) | Sticky bit for directories | Major | . | Koji Noguchi | Jakob Homan |
+| [HADOOP-4655](https://issues.apache.org/jira/browse/HADOOP-4655) | FileSystem.CACHE should be ref-counted | Major | fs | Hong Tang | dhruba borthakur |
+| [HADOOP-5464](https://issues.apache.org/jira/browse/HADOOP-5464) | DFSClient does not treat write timeout of 0 properly | Major | . | Raghu Angadi | Raghu Angadi |
| [HADOOP-2827](https://issues.apache.org/jira/browse/HADOOP-2827) | Remove deprecated NetUtils.getServerAddress | Major | conf, util | dhruba borthakur | Chris Douglas |
-| [HDFS-1024](https://issues.apache.org/jira/browse/HDFS-1024) | SecondaryNamenode fails to checkpoint because namenode fails with CancelledKeyException | Blocker | . | dhruba borthakur | Dmytro Molkov |
-| [HDFS-1016](https://issues.apache.org/jira/browse/HDFS-1016) | HDFS side change for HADOOP-6569 | Major | hdfs-client | Hairong Kuang | Hairong Kuang |
-| [HDFS-985](https://issues.apache.org/jira/browse/HDFS-985) | HDFS should issue multiple RPCs for listing a large directory | Major | . | Hairong Kuang | Hairong Kuang |
-| [HDFS-984](https://issues.apache.org/jira/browse/HDFS-984) | Delegation Tokens should be persisted in Namenode | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HDFS-946](https://issues.apache.org/jira/browse/HDFS-946) | NameNode should not return full path name when lisitng a diretory or getting the status of a file | Major | . | Hairong Kuang | Hairong Kuang |
-| [HDFS-892](https://issues.apache.org/jira/browse/HDFS-892) | optionally use Avro for namenode RPC | Major | namenode | Doug Cutting | Doug Cutting |
-| [HDFS-873](https://issues.apache.org/jira/browse/HDFS-873) | DataNode directories as URIs | Major | datanode | Konstantin Shvachko | Konstantin Shvachko |
-| [HDFS-793](https://issues.apache.org/jira/browse/HDFS-793) | DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet | Blocker | datanode | Hairong Kuang | Hairong Kuang |
-| [HDFS-764](https://issues.apache.org/jira/browse/HDFS-764) | Moving Access Token implementation from Common to HDFS | Major | . | Kan Zhang | Kan Zhang |
-| [HDFS-737](https://issues.apache.org/jira/browse/HDFS-737) | Improvement in metasave output | Major | namenode | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HDFS-660](https://issues.apache.org/jira/browse/HDFS-660) | Remove deprecated methods from InterDatanodeProtocol. | Major | datanode | Konstantin Shvachko | Konstantin Shvachko |
-| [HDFS-630](https://issues.apache.org/jira/browse/HDFS-630) | In DFSOutputStream.nextBlockOutputStream(), the client can exclude specific datanodes when locating the next block. | Major | hdfs-client, namenode | Ruyue Ma | Cosmin Lehene |
-| [HDFS-618](https://issues.apache.org/jira/browse/HDFS-618) | Support for non-recursive mkdir in HDFS | Major | hdfs-client, namenode | Kan Zhang | Kan Zhang |
-| [HDFS-617](https://issues.apache.org/jira/browse/HDFS-617) | Support for non-recursive create() in HDFS | Major | hdfs-client, namenode | Kan Zhang | Kan Zhang |
-| [HDFS-602](https://issues.apache.org/jira/browse/HDFS-602) | Atempt to make a directory under an existing file on DistributedFileSystem should throw an FileAlreadyExistsException instead of FileNotFoundException | Major | hdfs-client, namenode | Boris Shkolnik | Boris Shkolnik |
-| [HDFS-538](https://issues.apache.org/jira/browse/HDFS-538) | DistributedFileSystem::listStatus incorrectly returns null for empty result sets | Major | . | Jakob Homan | Jakob Homan |
-| [HDFS-514](https://issues.apache.org/jira/browse/HDFS-514) | DFSClient.namenode is a public field. Should be private. | Major | hdfs-client | Bill Zeller | Bill Zeller |
-| [HDFS-512](https://issues.apache.org/jira/browse/HDFS-512) | Set block id as the key to Block | Major | . | Hairong Kuang | Konstantin Shvachko |
-| [HDFS-288](https://issues.apache.org/jira/browse/HDFS-288) | Redundant computation in hashCode() implemenation | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [MAPREDUCE-1607](https://issues.apache.org/jira/browse/MAPREDUCE-1607) | Task controller may not set permissions for a task cleanup attempt's log directory | Major | task-controller | Hemanth Yamijala | Amareshwari Sriramadasu |
-| [MAPREDUCE-1493](https://issues.apache.org/jira/browse/MAPREDUCE-1493) | Authorization for job-history pages | Major | jobtracker, security | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-1385](https://issues.apache.org/jira/browse/MAPREDUCE-1385) | Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299) | Major | . | Devaraj Das | Devaraj Das |
-| [MAPREDUCE-1307](https://issues.apache.org/jira/browse/MAPREDUCE-1307) | Introduce the concept of Job Permissions | Major | security | Devaraj Das | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-1287](https://issues.apache.org/jira/browse/MAPREDUCE-1287) | Avoid calling Partitioner with only 1 reducer | Minor | . | Ed Mazur | Chris Douglas |
-| [MAPREDUCE-1218](https://issues.apache.org/jira/browse/MAPREDUCE-1218) | Collecting cpu and memory usage for TaskTrackers | Major | . | Scott Chen | Scott Chen |
-| [MAPREDUCE-1213](https://issues.apache.org/jira/browse/MAPREDUCE-1213) | TaskTrackers restart is very slow because it deletes distributed cache directory synchronously | Major | . | dhruba borthakur | Zheng Shao |
-| [MAPREDUCE-1097](https://issues.apache.org/jira/browse/MAPREDUCE-1097) | Changes/fixes to support Vertica 3.5 | Minor | contrib/vertica | Omer Trajman | Omer Trajman |
-| [MAPREDUCE-967](https://issues.apache.org/jira/browse/MAPREDUCE-967) | TaskTracker does not need to fully unjar job jars | Major | tasktracker | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-963](https://issues.apache.org/jira/browse/MAPREDUCE-963) | mapred's FileAlreadyExistsException should be deprecated in favor of hadoop-common's one. | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [MAPREDUCE-899](https://issues.apache.org/jira/browse/MAPREDUCE-899) | When using LinuxTaskController, localized files may become accessible to unintended users if permissions are misconfigured. | Major | tasktracker | Vinod Kumar Vavilapalli | Amareshwari Sriramadasu |
-| [MAPREDUCE-895](https://issues.apache.org/jira/browse/MAPREDUCE-895) | FileSystem::ListStatus will now throw FileNotFoundException, MapRed needs updated | Major | . | Jakob Homan | Jakob Homan |
-| [MAPREDUCE-873](https://issues.apache.org/jira/browse/MAPREDUCE-873) | Simplify Job Recovery | Major | jobtracker | Devaraj Das | Sharad Agarwal |
-| [MAPREDUCE-862](https://issues.apache.org/jira/browse/MAPREDUCE-862) | Modify UI to support a hierarchy of queues | Major | . | Hemanth Yamijala | V.V.Chaitanya Krishna |
-| [MAPREDUCE-849](https://issues.apache.org/jira/browse/MAPREDUCE-849) | Renaming of configuration property names in mapreduce | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [MAPREDUCE-817](https://issues.apache.org/jira/browse/MAPREDUCE-817) | Add a cache for retired jobs with minimal job info and provide a way to access history file url | Major | client, jobtracker | Sharad Agarwal | Sharad Agarwal |
-| [MAPREDUCE-777](https://issues.apache.org/jira/browse/MAPREDUCE-777) | A method for finding and tracking jobs from the new API | Major | client | Owen O'Malley | Amareshwari Sriramadasu |
+| [HADOOP-5485](https://issues.apache.org/jira/browse/HADOOP-5485) | Authorisation machanism required for acceesing jobtracker url :- jobtracker.com:port/scheduler | Major | . | Aroop Maliakkal | Vinod Kumar Vavilapalli |
+| [HADOOP-5738](https://issues.apache.org/jira/browse/HADOOP-5738) | Split waiting tasks field in JobTracker metrics to individual tasks | Major | metrics | Sreekanth Ramakrishnan | Sreekanth Ramakrishnan |
+| [HADOOP-5679](https://issues.apache.org/jira/browse/HADOOP-5679) | Resolve findbugs warnings in core/streaming/pipes/examples | Major | . | Jothi Padmanabhan | Jothi Padmanabhan |
+| [HADOOP-5438](https://issues.apache.org/jira/browse/HADOOP-5438) | Merge FileSystem.create and FileSystem.append | Major | fs | He Yongqiang | He Yongqiang |
+| [HADOOP-4861](https://issues.apache.org/jira/browse/HADOOP-4861) | Add disk usage with human-readable size (-duh) | Trivial | . | Bryan Duxbury | Todd Lipcon |
+| [HADOOP-5620](https://issues.apache.org/jira/browse/HADOOP-5620) | discp can preserve modification times of files | Major | . | dhruba borthakur | Rodrigo Schmidt |
+| [HADOOP-5861](https://issues.apache.org/jira/browse/HADOOP-5861) | s3n files are not getting split by default | Major | fs/s3 | Joydeep Sen Sarma | Tom White |
+| [HADOOP-5913](https://issues.apache.org/jira/browse/HADOOP-5913) | Allow administrators to be able to start and stop queues | Major | . | rahul k singh | rahul k singh |
+| [MAPREDUCE-516](https://issues.apache.org/jira/browse/MAPREDUCE-516) | Fix the 'cluster drain' problem in the Capacity Scheduler wrt High RAM Jobs | Major | . | Arun C Murthy | Arun C Murthy |
+| [MAPREDUCE-358](https://issues.apache.org/jira/browse/MAPREDUCE-358) | Change org.apache.hadoop.examples. AggregateWordCount and org.apache.hadoop.examples.AggregateWordHistogram to use new mapreduce api. | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [MAPREDUCE-245](https://issues.apache.org/jira/browse/MAPREDUCE-245) | Job and JobControl classes should return interfaces rather than implementations | Major | . | Tom White | Tom White |
| [MAPREDUCE-772](https://issues.apache.org/jira/browse/MAPREDUCE-772) | Chaging LineRecordReader algo so that it does not need to skip backwards in the stream | Major | . | Abdul Qadeer | Abdul Qadeer |
+| [HDFS-514](https://issues.apache.org/jira/browse/HDFS-514) | DFSClient.namenode is a public field. Should be private. | Major | hdfs-client | Bill Zeller | Bill Zeller |
| [MAPREDUCE-766](https://issues.apache.org/jira/browse/MAPREDUCE-766) | Enhance -list-blacklisted-trackers to display host name, blacklisted reason and blacklist report. | Major | . | Sreekanth Ramakrishnan | Sreekanth Ramakrishnan |
+| [MAPREDUCE-817](https://issues.apache.org/jira/browse/MAPREDUCE-817) | Add a cache for retired jobs with minimal job info and provide a way to access history file url | Major | client, jobtracker | Sharad Agarwal | Sharad Agarwal |
| [MAPREDUCE-711](https://issues.apache.org/jira/browse/MAPREDUCE-711) | Move Distributed Cache from Common to Map/Reduce | Major | . | Owen O'Malley | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-516](https://issues.apache.org/jira/browse/MAPREDUCE-516) | Fix the 'cluster drain' problem in the Capacity Scheduler wrt High RAM Jobs | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-6201](https://issues.apache.org/jira/browse/HADOOP-6201) | FileSystem::ListStatus should throw FileNotFoundException | Major | fs | Jakob Homan | Jakob Homan |
+| [HDFS-538](https://issues.apache.org/jira/browse/HDFS-538) | DistributedFileSystem::listStatus incorrectly returns null for empty result sets | Major | . | Jakob Homan | Jakob Homan |
+| [MAPREDUCE-895](https://issues.apache.org/jira/browse/MAPREDUCE-895) | FileSystem::ListStatus will now throw FileNotFoundException, MapRed needs updated | Major | . | Jakob Homan | Jakob Homan |
| [MAPREDUCE-479](https://issues.apache.org/jira/browse/MAPREDUCE-479) | Add reduce ID to shuffle clienttrace | Minor | . | Jiaqi Tan | Jiaqi Tan |
-| [MAPREDUCE-358](https://issues.apache.org/jira/browse/MAPREDUCE-358) | Change org.apache.hadoop.examples. AggregateWordCount and org.apache.hadoop.examples.AggregateWordHistogram to use new mapreduce api. | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
| [MAPREDUCE-355](https://issues.apache.org/jira/browse/MAPREDUCE-355) | Change org.apache.hadoop.mapred.join to use new api | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [MAPREDUCE-245](https://issues.apache.org/jira/browse/MAPREDUCE-245) | Job and JobControl classes should return interfaces rather than implementations | Major | . | Tom White | Tom White |
+| [MAPREDUCE-873](https://issues.apache.org/jira/browse/MAPREDUCE-873) | Simplify Job Recovery | Major | jobtracker | Devaraj Das | Sharad Agarwal |
+| [HDFS-288](https://issues.apache.org/jira/browse/HDFS-288) | Redundant computation in hashCode() implemenation | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-6230](https://issues.apache.org/jira/browse/HADOOP-6230) | Move process tree, and memory calculator classes out of Common into Map/Reduce. | Major | util | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [HADOOP-6203](https://issues.apache.org/jira/browse/HADOOP-6203) | Improve error message when moving to trash fails due to quota issue | Major | fs | Jakob Homan | Boris Shkolnik |
+| [MAPREDUCE-963](https://issues.apache.org/jira/browse/MAPREDUCE-963) | mapred's FileAlreadyExistsException should be deprecated in favor of hadoop-common's one. | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [HDFS-602](https://issues.apache.org/jira/browse/HDFS-602) | Atempt to make a directory under an existing file on DistributedFileSystem should throw an FileAlreadyExistsException instead of FileNotFoundException | Major | hdfs-client, namenode | Boris Shkolnik | Boris Shkolnik |
+| [HADOOP-5879](https://issues.apache.org/jira/browse/HADOOP-5879) | GzipCodec should read compression level etc from configuration | Major | io | Zheng Shao | He Yongqiang |
+| [HDFS-617](https://issues.apache.org/jira/browse/HDFS-617) | Support for non-recursive create() in HDFS | Major | hdfs-client, namenode | Kan Zhang | Kan Zhang |
+| [HDFS-618](https://issues.apache.org/jira/browse/HDFS-618) | Support for non-recursive mkdir in HDFS | Major | hdfs-client, namenode | Kan Zhang | Kan Zhang |
| [MAPREDUCE-157](https://issues.apache.org/jira/browse/MAPREDUCE-157) | Job History log file format is not friendly for external tools. | Major | . | Owen O'Malley | Jothi Padmanabhan |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [MAPREDUCE-862](https://issues.apache.org/jira/browse/MAPREDUCE-862) | Modify UI to support a hierarchy of queues | Major | . | Hemanth Yamijala | V.V.Chaitanya Krishna |
+| [MAPREDUCE-777](https://issues.apache.org/jira/browse/MAPREDUCE-777) | A method for finding and tracking jobs from the new API | Major | client | Owen O'Malley | Amareshwari Sriramadasu |
+| [MAPREDUCE-849](https://issues.apache.org/jira/browse/MAPREDUCE-849) | Renaming of configuration property names in mapreduce | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HDFS-660](https://issues.apache.org/jira/browse/HDFS-660) | Remove deprecated methods from InterDatanodeProtocol. | Major | datanode | Konstantin Shvachko | Konstantin Shvachko |
+| [HDFS-512](https://issues.apache.org/jira/browse/HDFS-512) | Set block id as the key to Block | Major | . | Hairong Kuang | Konstantin Shvachko |
+| [HDFS-737](https://issues.apache.org/jira/browse/HDFS-737) | Improvement in metasave output | Major | namenode | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HADOOP-6367](https://issues.apache.org/jira/browse/HADOOP-6367) | Move Access Token implementation from Common to HDFS | Major | security | Kan Zhang | Kan Zhang |
+| [HDFS-764](https://issues.apache.org/jira/browse/HDFS-764) | Moving Access Token implementation from Common to HDFS | Major | . | Kan Zhang | Kan Zhang |
+| [HDFS-793](https://issues.apache.org/jira/browse/HDFS-793) | DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet | Blocker | datanode | Hairong Kuang | Hairong Kuang |
+| [MAPREDUCE-967](https://issues.apache.org/jira/browse/MAPREDUCE-967) | TaskTracker does not need to fully unjar job jars | Major | tasktracker | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-1213](https://issues.apache.org/jira/browse/MAPREDUCE-1213) | TaskTrackers restart is very slow because it deletes distributed cache directory synchronously | Major | . | dhruba borthakur | Zheng Shao |
+| [HDFS-873](https://issues.apache.org/jira/browse/HDFS-873) | DataNode directories as URIs | Major | datanode | Konstantin Shvachko | Konstantin Shvachko |
+| [MAPREDUCE-1218](https://issues.apache.org/jira/browse/MAPREDUCE-1218) | Collecting cpu and memory usage for TaskTrackers | Major | . | Scott Chen | Scott Chen |
+| [MAPREDUCE-1287](https://issues.apache.org/jira/browse/MAPREDUCE-1287) | Avoid calling Partitioner with only 1 reducer | Minor | . | Ed Mazur | Chris Douglas |
+| [MAPREDUCE-1097](https://issues.apache.org/jira/browse/MAPREDUCE-1097) | Changes/fixes to support Vertica 3.5 | Minor | contrib/vertica | Omer Trajman | Omer Trajman |
+| [HDFS-630](https://issues.apache.org/jira/browse/HDFS-630) | In DFSOutputStream.nextBlockOutputStream(), the client can exclude specific datanodes when locating the next block. | Major | hdfs-client, namenode | Ruyue Ma | Cosmin Lehene |
+| [MAPREDUCE-1385](https://issues.apache.org/jira/browse/MAPREDUCE-1385) | Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299) | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-6299](https://issues.apache.org/jira/browse/HADOOP-6299) | Use JAAS LoginContext for our login | Major | security | Arun C Murthy | Owen O'Malley |
+| [MAPREDUCE-899](https://issues.apache.org/jira/browse/MAPREDUCE-899) | When using LinuxTaskController, localized files may become accessible to unintended users if permissions are misconfigured. | Major | tasktracker | Vinod Kumar Vavilapalli | Amareshwari Sriramadasu |
+| [HADOOP-6577](https://issues.apache.org/jira/browse/HADOOP-6577) | IPC server response buffer reset threshold should be configurable | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-1307](https://issues.apache.org/jira/browse/MAPREDUCE-1307) | Introduce the concept of Job Permissions | Major | security | Devaraj Das | Vinod Kumar Vavilapalli |
+| [HDFS-946](https://issues.apache.org/jira/browse/HDFS-946) | NameNode should not return full path name when lisitng a diretory or getting the status of a file | Major | . | Hairong Kuang | Hairong Kuang |
+| [HDFS-984](https://issues.apache.org/jira/browse/HDFS-984) | Delegation Tokens should be persisted in Namenode | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HDFS-1016](https://issues.apache.org/jira/browse/HDFS-1016) | HDFS side change for HADOOP-6569 | Major | hdfs-client | Hairong Kuang | Hairong Kuang |
+| [MAPREDUCE-1493](https://issues.apache.org/jira/browse/MAPREDUCE-1493) | Authorization for job-history pages | Major | jobtracker, security | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [HDFS-985](https://issues.apache.org/jira/browse/HDFS-985) | HDFS should issue multiple RPCs for listing a large directory | Major | . | Hairong Kuang | Hairong Kuang |
+| [HDFS-892](https://issues.apache.org/jira/browse/HDFS-892) | optionally use Avro for namenode RPC | Major | namenode | Doug Cutting | Doug Cutting |
+| [HADOOP-6569](https://issues.apache.org/jira/browse/HADOOP-6569) | FsShell#cat should avoid calling unecessary getFileStatus before opening a file to read | Major | fs | Hairong Kuang | Hairong Kuang |
+| [HDFS-1024](https://issues.apache.org/jira/browse/HDFS-1024) | SecondaryNamenode fails to checkpoint because namenode fails with CancelledKeyException | Blocker | . | dhruba borthakur | Dmytro Molkov |
+| [HADOOP-6686](https://issues.apache.org/jira/browse/HADOOP-6686) | Remove redundant exception class name in unwrapped exceptions thrown at the RPC client | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-6701](https://issues.apache.org/jira/browse/HADOOP-6701) | Incorrect exit codes for "dfs -chown", "dfs -chgrp" | Minor | fs | Ravi Phulari | Ravi Phulari |
+| [MAPREDUCE-1607](https://issues.apache.org/jira/browse/MAPREDUCE-1607) | Task controller may not set permissions for a task cleanup attempt's log directory | Major | task-controller | Hemanth Yamijala | Amareshwari Sriramadasu |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-6869](https://issues.apache.org/jira/browse/HADOOP-6869) | Functionality to create file or folder on a remote daemon side | Major | test | Vinay Kumar Thota | Vinay Kumar Thota |
-| [HADOOP-6594](https://issues.apache.org/jira/browse/HADOOP-6594) | Update hdfs script to provide fetchdt tool | Major | . | Jakob Homan | Jakob Homan |
-| [HADOOP-6580](https://issues.apache.org/jira/browse/HADOOP-6580) | UGI should contain authentication method. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-6573](https://issues.apache.org/jira/browse/HADOOP-6573) | Delegation Tokens should be persisted. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-6566](https://issues.apache.org/jira/browse/HADOOP-6566) | Hadoop daemons should not start up if the ownership/permissions on the directories used at runtime are misconfigured | Major | security | Devaraj Das | Arun C Murthy |
-| [HADOOP-6547](https://issues.apache.org/jira/browse/HADOOP-6547) | Move the Delegation Token feature to common since both HDFS and MapReduce needs it | Major | security | Devaraj Das | Devaraj Das |
-| [HADOOP-6517](https://issues.apache.org/jira/browse/HADOOP-6517) | Ability to add/get tokens from UserGroupInformation | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-6510](https://issues.apache.org/jira/browse/HADOOP-6510) | doAs for proxy user | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-6497](https://issues.apache.org/jira/browse/HADOOP-6497) | Introduce wrapper around FSDataInputStream providing Avro SeekableInput interface | Major | fs | Aaron Kimball | Aaron Kimball |
-| [HADOOP-6433](https://issues.apache.org/jira/browse/HADOOP-6433) | Add AsyncDiskService that is used in both hdfs and mapreduce | Major | . | Zheng Shao | Zheng Shao |
-| [HADOOP-6419](https://issues.apache.org/jira/browse/HADOOP-6419) | Change RPC layer to support SASL based mutual authentication | Major | security | Kan Zhang | Kan Zhang |
-| [HADOOP-6415](https://issues.apache.org/jira/browse/HADOOP-6415) | Adding a common token interface for both job token and delegation token | Major | security | Kan Zhang | Kan Zhang |
-| [HADOOP-6408](https://issues.apache.org/jira/browse/HADOOP-6408) | Add a /conf servlet to dump running configuration | Major | . | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6337](https://issues.apache.org/jira/browse/HADOOP-6337) | Update FilterInitializer class to be more visible and take a conf for further development | Major | . | Jakob Homan | Jakob Homan |
-| [HADOOP-6332](https://issues.apache.org/jira/browse/HADOOP-6332) | Large-scale Automated Test Framework | Major | test | Arun C Murthy | Konstantin Boudnik |
-| [HADOOP-6323](https://issues.apache.org/jira/browse/HADOOP-6323) | Serialization should provide comparators | Major | io | Doug Cutting | Aaron Kimball |
-| [HADOOP-6313](https://issues.apache.org/jira/browse/HADOOP-6313) | Expose flush APIs to application users | Major | fs | Hairong Kuang | Hairong Kuang |
-| [HADOOP-6270](https://issues.apache.org/jira/browse/HADOOP-6270) | FileContext needs to provide deleteOnExit functionality | Major | fs | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-6235](https://issues.apache.org/jira/browse/HADOOP-6235) | Adding a new method for getting server default values from a FileSystem | Major | fs | Kan Zhang | Kan Zhang |
-| [HADOOP-6226](https://issues.apache.org/jira/browse/HADOOP-6226) | Create a LimitedByteArrayOutputStream that does not expand its buffer on write | Major | . | Jothi Padmanabhan | Jothi Padmanabhan |
-| [HADOOP-6218](https://issues.apache.org/jira/browse/HADOOP-6218) | Split TFile by Record Sequence Number | Major | . | Hong Tang | Hong Tang |
-| [HADOOP-6173](https://issues.apache.org/jira/browse/HADOOP-6173) | src/native/packageNativeHadoop.sh only packages files with "hadoop" in the name | Minor | build, scripts | Hong Tang | Hong Tang |
-| [HADOOP-6165](https://issues.apache.org/jira/browse/HADOOP-6165) | Add metadata to Serializations | Blocker | contrib/serialization | Tom White | Tom White |
-| [HADOOP-6120](https://issues.apache.org/jira/browse/HADOOP-6120) | Add support for Avro types in hadoop | Major | . | Sharad Agarwal | Sharad Agarwal |
-| [HADOOP-5887](https://issues.apache.org/jira/browse/HADOOP-5887) | Sqoop should create tables in Hive metastore after importing to HDFS | Major | . | Aaron Kimball | Aaron Kimball |
-| [HADOOP-5844](https://issues.apache.org/jira/browse/HADOOP-5844) | Use mysqldump when connecting to local mysql instance in Sqoop | Major | . | Aaron Kimball | Aaron Kimball |
-| [HADOOP-5815](https://issues.apache.org/jira/browse/HADOOP-5815) | Sqoop: A database import tool for Hadoop | Major | . | Aaron Kimball | Aaron Kimball |
-| [HADOOP-5752](https://issues.apache.org/jira/browse/HADOOP-5752) | Provide examples of using offline image viewer (oiv) to analyze hadoop file systems | Major | . | Jakob Homan | Jakob Homan |
-| [HADOOP-5745](https://issues.apache.org/jira/browse/HADOOP-5745) | Allow setting the default value of maxRunningJobs for all pools | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-5643](https://issues.apache.org/jira/browse/HADOOP-5643) | Ability to blacklist tasktracker | Major | . | Rajiv Chittajallu | Amar Kamat |
+| [HADOOP-4368](https://issues.apache.org/jira/browse/HADOOP-4368) | Superuser privileges required to do "df" | Minor | . | Brian Bockelman | Craig Macdonald |
+| [HADOOP-3741](https://issues.apache.org/jira/browse/HADOOP-3741) | SecondaryNameNode has http server on dfs.secondary.http.address but without any contents | Major | . | Lohit Vijayarenu | Tsz Wo Nicholas Sze |
+| [HADOOP-5018](https://issues.apache.org/jira/browse/HADOOP-5018) | Chukwa should support pipelined writers | Major | . | Ari Rabkin | Ari Rabkin |
+| [HADOOP-5052](https://issues.apache.org/jira/browse/HADOOP-5052) | Add an example for computing exact digits of Pi | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4927](https://issues.apache.org/jira/browse/HADOOP-4927) | Part files on the output filesystem are created irrespective of whether the corresponding task has anything to write there | Major | . | Devaraj Das | Jothi Padmanabhan |
+| [HADOOP-5042](https://issues.apache.org/jira/browse/HADOOP-5042) | Add expiration handling to the chukwa log4j appender | Major | . | Jerome Boulon | Jerome Boulon |
+| [HADOOP-5232](https://issues.apache.org/jira/browse/HADOOP-5232) | preparing HadoopPatchQueueAdmin.sh,test-patch.sh scripts to run builds on hudson slaves. | Major | build | Giridharan Kesavan | Giridharan Kesavan |
+| [HADOOP-5363](https://issues.apache.org/jira/browse/HADOOP-5363) | Proxying for multiple HDFS clusters of different versions | Major | . | Kan Zhang | zhiyong zhang |
+| [HADOOP-5366](https://issues.apache.org/jira/browse/HADOOP-5366) | Support for retrieving files using standard HTTP clients like curl | Major | . | Kan Zhang | zhiyong zhang |
| [HADOOP-5528](https://issues.apache.org/jira/browse/HADOOP-5528) | Binary partitioner | Major | . | Klaas Bosteels | Klaas Bosteels |
| [HADOOP-5518](https://issues.apache.org/jira/browse/HADOOP-5518) | MRUnit unit test library | Major | . | Aaron Kimball | Aaron Kimball |
+| [HADOOP-5257](https://issues.apache.org/jira/browse/HADOOP-5257) | Export namenode/datanode functionality through a pluggable RPC layer | Minor | . | Carlos Valiente | Carlos Valiente |
| [HADOOP-5469](https://issues.apache.org/jira/browse/HADOOP-5469) | Exposing Hadoop metrics via HTTP | Major | metrics | Philip Zeyliger | Philip Zeyliger |
| [HADOOP-5467](https://issues.apache.org/jira/browse/HADOOP-5467) | Create an offline fsimage image viewer | Major | . | Jakob Homan | Jakob Homan |
-| [HADOOP-5366](https://issues.apache.org/jira/browse/HADOOP-5366) | Support for retrieving files using standard HTTP clients like curl | Major | . | Kan Zhang | zhiyong zhang |
-| [HADOOP-5363](https://issues.apache.org/jira/browse/HADOOP-5363) | Proxying for multiple HDFS clusters of different versions | Major | . | Kan Zhang | zhiyong zhang |
-| [HADOOP-5257](https://issues.apache.org/jira/browse/HADOOP-5257) | Export namenode/datanode functionality through a pluggable RPC layer | Minor | . | Carlos Valiente | Carlos Valiente |
-| [HADOOP-5232](https://issues.apache.org/jira/browse/HADOOP-5232) | preparing HadoopPatchQueueAdmin.sh,test-patch.sh scripts to run builds on hudson slaves. | Major | build | Giridharan Kesavan | Giridharan Kesavan |
-| [HADOOP-5175](https://issues.apache.org/jira/browse/HADOOP-5175) | Option to prohibit jars unpacking | Major | . | Andrew Gudkov | Todd Lipcon |
-| [HADOOP-5052](https://issues.apache.org/jira/browse/HADOOP-5052) | Add an example for computing exact digits of Pi | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-5042](https://issues.apache.org/jira/browse/HADOOP-5042) | Add expiration handling to the chukwa log4j appender | Major | . | Jerome Boulon | Jerome Boulon |
-| [HADOOP-5018](https://issues.apache.org/jira/browse/HADOOP-5018) | Chukwa should support pipelined writers | Major | . | Ari Rabkin | Ari Rabkin |
-| [HADOOP-4952](https://issues.apache.org/jira/browse/HADOOP-4952) | Improved files system interface for the application writer. | Major | fs | Sanjay Radia | Sanjay Radia |
-| [HADOOP-4927](https://issues.apache.org/jira/browse/HADOOP-4927) | Part files on the output filesystem are created irrespective of whether the corresponding task has anything to write there | Major | . | Devaraj Das | Jothi Padmanabhan |
+| [HADOOP-5752](https://issues.apache.org/jira/browse/HADOOP-5752) | Provide examples of using offline image viewer (oiv) to analyze hadoop file systems | Major | . | Jakob Homan | Jakob Homan |
+| [HADOOP-5745](https://issues.apache.org/jira/browse/HADOOP-5745) | Allow setting the default value of maxRunningJobs for all pools | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-5643](https://issues.apache.org/jira/browse/HADOOP-5643) | Ability to blacklist tasktracker | Major | . | Rajiv Chittajallu | Amar Kamat |
+| [HADOOP-4359](https://issues.apache.org/jira/browse/HADOOP-4359) | Access Token: Support for data access authorization checking on DataNodes | Major | . | Kan Zhang | Kan Zhang |
| [HADOOP-4829](https://issues.apache.org/jira/browse/HADOOP-4829) | Allow FileSystem shutdown hook to be disabled | Minor | fs | Bryan Duxbury | Todd Lipcon |
+| [HADOOP-5815](https://issues.apache.org/jira/browse/HADOOP-5815) | Sqoop: A database import tool for Hadoop | Major | . | Aaron Kimball | Aaron Kimball |
+| [HADOOP-5175](https://issues.apache.org/jira/browse/HADOOP-5175) | Option to prohibit jars unpacking | Major | . | Andrew Gudkov | Todd Lipcon |
+| [HADOOP-5844](https://issues.apache.org/jira/browse/HADOOP-5844) | Use mysqldump when connecting to local mysql instance in Sqoop | Major | . | Aaron Kimball | Aaron Kimball |
| [HADOOP-4768](https://issues.apache.org/jira/browse/HADOOP-4768) | Dynamic Priority Scheduler that allows queue shares to be controlled dynamically by a currency | Major | . | Thomas Sandholm | Thomas Sandholm |
-| [HADOOP-4368](https://issues.apache.org/jira/browse/HADOOP-4368) | Superuser privileges required to do "df" | Minor | . | Brian Bockelman | Craig Macdonald |
-| [HADOOP-4359](https://issues.apache.org/jira/browse/HADOOP-4359) | Access Token: Support for data access authorization checking on DataNodes | Major | . | Kan Zhang | Kan Zhang |
-| [HADOOP-4012](https://issues.apache.org/jira/browse/HADOOP-4012) | Providing splitting support for bzip2 compressed files | Major | io | Abdul Qadeer | Abdul Qadeer |
-| [HADOOP-3741](https://issues.apache.org/jira/browse/HADOOP-3741) | SecondaryNameNode has http server on dfs.secondary.http.address but without any contents | Major | . | Lohit Vijayarenu | Tsz Wo Nicholas Sze |
-| [HDFS-2137](https://issues.apache.org/jira/browse/HDFS-2137) | Datanode Disk Fail Inplace | Major | datanode | Bharath Mundlapudi | |
-| [HDFS-1091](https://issues.apache.org/jira/browse/HDFS-1091) | Implement listStatus that returns an Iterator of FileStatus | Major | . | Hairong Kuang | Hairong Kuang |
-| [HDFS-999](https://issues.apache.org/jira/browse/HDFS-999) | Secondary namenode should login using kerberos if security is configured | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [HDFS-993](https://issues.apache.org/jira/browse/HDFS-993) | Namenode should issue a delegation token only for kerberos authenticated clients. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HDFS-991](https://issues.apache.org/jira/browse/HDFS-991) | Allow browsing the filesystem over http using delegation tokens | Major | . | Owen O'Malley | Owen O'Malley |
-| [HDFS-935](https://issues.apache.org/jira/browse/HDFS-935) | Real user in delegation token. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HDFS-905](https://issues.apache.org/jira/browse/HDFS-905) | Make changes to HDFS for the new UserGroupInformation APIs (HADOOP-6299) | Major | . | Devaraj Das | Jakob Homan |
-| [HDFS-814](https://issues.apache.org/jira/browse/HDFS-814) | Add an api to get the visible length of a DFSDataInputStream. | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-731](https://issues.apache.org/jira/browse/HDFS-731) | Support new Syncable interface in HDFS | Major | . | Hairong Kuang | Hairong Kuang |
-| [HDFS-702](https://issues.apache.org/jira/browse/HDFS-702) | Add Hdfs Impl for the new file system interface | Major | namenode | Sanjay Radia | Sanjay Radia |
-| [HDFS-654](https://issues.apache.org/jira/browse/HDFS-654) | HDFS needs to support new rename introduced for FileContext | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-610](https://issues.apache.org/jira/browse/HDFS-610) | Add support for FileContext | Major | hdfs-client, namenode | Sanjay Radia | Sanjay Radia |
-| [HDFS-595](https://issues.apache.org/jira/browse/HDFS-595) | FsPermission tests need to be updated for new octal configuration parameter from HADOOP-6234 | Major | hdfs-client | Jakob Homan | Jakob Homan |
-| [HDFS-567](https://issues.apache.org/jira/browse/HDFS-567) | Two contrib tools to facilitate searching for block history information | Major | tools | Bill Zeller | Jitendra Nath Pandey |
-| [HDFS-503](https://issues.apache.org/jira/browse/HDFS-503) | Implement erasure coding as a layer on HDFS | Major | contrib/raid | dhruba borthakur | dhruba borthakur |
-| [HDFS-492](https://issues.apache.org/jira/browse/HDFS-492) | Expose corrupt replica/block information | Major | namenode | Bill Zeller | Bill Zeller |
-| [HDFS-461](https://issues.apache.org/jira/browse/HDFS-461) | Analyzing file size distribution. | Major | test, tools | Konstantin Shvachko | Konstantin Shvachko |
-| [HDFS-459](https://issues.apache.org/jira/browse/HDFS-459) | Job History Log Analyzer | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HDFS-458](https://issues.apache.org/jira/browse/HDFS-458) | Create target for 10 minute patch test build for hdfs | Major | build, test | Jakob Homan | Jakob Homan |
+| [HADOOP-5887](https://issues.apache.org/jira/browse/HADOOP-5887) | Sqoop should create tables in Hive metastore after importing to HDFS | Major | . | Aaron Kimball | Aaron Kimball |
+| [MAPREDUCE-567](https://issues.apache.org/jira/browse/MAPREDUCE-567) | Add a new example MR that always fails | Major | examples | Philip Zeyliger | Philip Zeyliger |
| [HDFS-447](https://issues.apache.org/jira/browse/HDFS-447) | proxy to call LDAP for IP lookup and get user ID and directories, validate requested URL | Critical | contrib/hdfsproxy | zhiyong zhang | zhiyong zhang |
-| [HDFS-245](https://issues.apache.org/jira/browse/HDFS-245) | Create symbolic links in HDFS | Major | . | dhruba borthakur | Eli Collins |
-| [HDFS-235](https://issues.apache.org/jira/browse/HDFS-235) | Add support for byte-ranges to hftp | Major | . | Venkatesh Seetharam | Bill Zeller |
-| [HDFS-222](https://issues.apache.org/jira/browse/HDFS-222) | Support for concatenating of files into a single file | Major | . | Venkatesh Seetharam | Boris Shkolnik |
+| [MAPREDUCE-551](https://issues.apache.org/jira/browse/MAPREDUCE-551) | Add preemption to the fair scheduler | Major | contrib/fair-share | Matei Zaharia | Matei Zaharia |
+| [MAPREDUCE-211](https://issues.apache.org/jira/browse/MAPREDUCE-211) | Provide a node health check script and run it periodically to check the node health status | Major | . | Aroop Maliakkal | Sreekanth Ramakrishnan |
| [HDFS-204](https://issues.apache.org/jira/browse/HDFS-204) | Revive number of files listed metrics | Major | namenode | Koji Noguchi | Jitendra Nath Pandey |
-| [MAPREDUCE-1774](https://issues.apache.org/jira/browse/MAPREDUCE-1774) | Large-scale Automated Framework | Major | test | Konstantin Boudnik | Konstantin Boudnik |
-| [MAPREDUCE-1673](https://issues.apache.org/jira/browse/MAPREDUCE-1673) | Start and Stop scripts for the RaidNode | Major | contrib/raid | Rodrigo Schmidt | Rodrigo Schmidt |
-| [MAPREDUCE-1464](https://issues.apache.org/jira/browse/MAPREDUCE-1464) | In JobTokenIdentifier change method getUsername to getUser which returns UGI | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [MAPREDUCE-1383](https://issues.apache.org/jira/browse/MAPREDUCE-1383) | Allow storage and caching of delegation token. | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [MAPREDUCE-1338](https://issues.apache.org/jira/browse/MAPREDUCE-1338) | need security keys storage solution | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [MAPREDUCE-1335](https://issues.apache.org/jira/browse/MAPREDUCE-1335) | Add SASL DIGEST-MD5 authentication to TaskUmbilicalProtocol | Major | . | Kan Zhang | Kan Zhang |
-| [MAPREDUCE-1304](https://issues.apache.org/jira/browse/MAPREDUCE-1304) | Add counters for task time spent in GC | Major | task | Todd Lipcon | Aaron Kimball |
-| [MAPREDUCE-1295](https://issues.apache.org/jira/browse/MAPREDUCE-1295) | We need a job trace manipulator to build gridmix runs. | Major | tools/rumen | Dick King | Dick King |
-| [MAPREDUCE-1167](https://issues.apache.org/jira/browse/MAPREDUCE-1167) | Make ProcfsBasedProcessTree collect rss memory information | Major | tasktracker | Scott Chen | Scott Chen |
-| [MAPREDUCE-1074](https://issues.apache.org/jira/browse/MAPREDUCE-1074) | Provide documentation for Mark/Reset functionality | Major | documentation | Jothi Padmanabhan | Jothi Padmanabhan |
-| [MAPREDUCE-980](https://issues.apache.org/jira/browse/MAPREDUCE-980) | Modify JobHistory to use Avro for serialization instead of raw JSON | Major | . | Jothi Padmanabhan | Doug Cutting |
-| [MAPREDUCE-853](https://issues.apache.org/jira/browse/MAPREDUCE-853) | Support a hierarchy of queues in the Map/Reduce framework | Major | jobtracker | Hemanth Yamijala | |
-| [MAPREDUCE-824](https://issues.apache.org/jira/browse/MAPREDUCE-824) | Support a hierarchy of queues in the capacity scheduler | Major | capacity-sched | Hemanth Yamijala | rahul k singh |
+| [MAPREDUCE-532](https://issues.apache.org/jira/browse/MAPREDUCE-532) | Allow admins of the Capacity Scheduler to set a hard-limit on the capacity of a queue | Major | capacity-sched | Rajiv Chittajallu | rahul k singh |
+| [HDFS-459](https://issues.apache.org/jira/browse/HDFS-459) | Job History Log Analyzer | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HDFS-461](https://issues.apache.org/jira/browse/HDFS-461) | Analyzing file size distribution. | Major | test, tools | Konstantin Shvachko | Konstantin Shvachko |
+| [MAPREDUCE-467](https://issues.apache.org/jira/browse/MAPREDUCE-467) | Collect information about number of tasks succeeded / total per time unit for a tasktracker. | Major | . | Hemanth Yamijala | Sharad Agarwal |
+| [MAPREDUCE-546](https://issues.apache.org/jira/browse/MAPREDUCE-546) | Provide sample fair scheduler config file in conf/ and use it by default if no other config file is specified | Minor | . | Matei Zaharia | Matei Zaharia |
+| [MAPREDUCE-740](https://issues.apache.org/jira/browse/MAPREDUCE-740) | Provide summary information per job once a job is finished. | Major | jobtracker | Hong Tang | Arun C Murthy |
+| [HDFS-458](https://issues.apache.org/jira/browse/HDFS-458) | Create target for 10 minute patch test build for hdfs | Major | build, test | Jakob Homan | Jakob Homan |
+| [HADOOP-6120](https://issues.apache.org/jira/browse/HADOOP-6120) | Add support for Avro types in hadoop | Major | . | Sharad Agarwal | Sharad Agarwal |
+| [MAPREDUCE-706](https://issues.apache.org/jira/browse/MAPREDUCE-706) | Support for FIFO pools in the fair scheduler | Major | contrib/fair-share | Matei Zaharia | Matei Zaharia |
+| [HADOOP-6173](https://issues.apache.org/jira/browse/HADOOP-6173) | src/native/packageNativeHadoop.sh only packages files with "hadoop" in the name | Minor | build, scripts | Hong Tang | Hong Tang |
| [MAPREDUCE-800](https://issues.apache.org/jira/browse/MAPREDUCE-800) | MRUnit should support the new API | Major | contrib/mrunit | Aaron Kimball | Aaron Kimball |
| [MAPREDUCE-798](https://issues.apache.org/jira/browse/MAPREDUCE-798) | MRUnit should be able to test a succession of MapReduce passes | Major | contrib/mrunit | Aaron Kimball | Aaron Kimball |
-| [MAPREDUCE-776](https://issues.apache.org/jira/browse/MAPREDUCE-776) | Gridmix: Trace-based benchmark for Map/Reduce | Major | benchmarks | Chris Douglas | Chris Douglas |
-| [MAPREDUCE-775](https://issues.apache.org/jira/browse/MAPREDUCE-775) | Add input/output formatters for Vertica clustered ADBMS. | Major | contrib/vertica | Omer Trajman | Omer Trajman |
| [MAPREDUCE-768](https://issues.apache.org/jira/browse/MAPREDUCE-768) | Configuration information should generate dump in a standard format. | Major | . | rahul k singh | V.V.Chaitanya Krishna |
+| [MAPREDUCE-824](https://issues.apache.org/jira/browse/MAPREDUCE-824) | Support a hierarchy of queues in the capacity scheduler | Major | capacity-sched | Hemanth Yamijala | rahul k singh |
| [MAPREDUCE-751](https://issues.apache.org/jira/browse/MAPREDUCE-751) | Rumen: a tool to extract job characterization data from job tracker logs | Major | tools/rumen | Dick King | Dick King |
-| [MAPREDUCE-740](https://issues.apache.org/jira/browse/MAPREDUCE-740) | Provide summary information per job once a job is finished. | Major | jobtracker | Hong Tang | Arun C Murthy |
+| [HDFS-492](https://issues.apache.org/jira/browse/HDFS-492) | Expose corrupt replica/block information | Major | namenode | Bill Zeller | Bill Zeller |
+| [HADOOP-6226](https://issues.apache.org/jira/browse/HADOOP-6226) | Create a LimitedByteArrayOutputStream that does not expand its buffer on write | Major | . | Jothi Padmanabhan | Jothi Padmanabhan |
+| [HADOOP-6165](https://issues.apache.org/jira/browse/HADOOP-6165) | Add metadata to Serializations | Blocker | contrib/serialization | Tom White | Tom White |
+| [HADOOP-6235](https://issues.apache.org/jira/browse/HADOOP-6235) | Adding a new method for getting server default values from a FileSystem | Major | fs | Kan Zhang | Kan Zhang |
+| [HDFS-595](https://issues.apache.org/jira/browse/HDFS-595) | FsPermission tests need to be updated for new octal configuration parameter from HADOOP-6234 | Major | hdfs-client | Jakob Homan | Jakob Homan |
+| [HDFS-235](https://issues.apache.org/jira/browse/HDFS-235) | Add support for byte-ranges to hftp | Major | . | Venkatesh Seetharam | Bill Zeller |
+| [HADOOP-4012](https://issues.apache.org/jira/browse/HADOOP-4012) | Providing splitting support for bzip2 compressed files | Major | io | Abdul Qadeer | Abdul Qadeer |
+| [MAPREDUCE-776](https://issues.apache.org/jira/browse/MAPREDUCE-776) | Gridmix: Trace-based benchmark for Map/Reduce | Major | benchmarks | Chris Douglas | Chris Douglas |
+| [HADOOP-4952](https://issues.apache.org/jira/browse/HADOOP-4952) | Improved files system interface for the application writer. | Major | fs | Sanjay Radia | Sanjay Radia |
+| [MAPREDUCE-853](https://issues.apache.org/jira/browse/MAPREDUCE-853) | Support a hierarchy of queues in the Map/Reduce framework | Major | jobtracker | Hemanth Yamijala | |
+| [HDFS-567](https://issues.apache.org/jira/browse/HDFS-567) | Two contrib tools to facilitate searching for block history information | Major | tools | Bill Zeller | Jitendra Nath Pandey |
+| [MAPREDUCE-775](https://issues.apache.org/jira/browse/MAPREDUCE-775) | Add input/output formatters for Vertica clustered ADBMS. | Major | contrib/vertica | Omer Trajman | Omer Trajman |
+| [HADOOP-6270](https://issues.apache.org/jira/browse/HADOOP-6270) | FileContext needs to provide deleteOnExit functionality | Major | fs | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-610](https://issues.apache.org/jira/browse/HDFS-610) | Add support for FileContext | Major | hdfs-client, namenode | Sanjay Radia | Sanjay Radia |
+| [MAPREDUCE-679](https://issues.apache.org/jira/browse/MAPREDUCE-679) | XML-based metrics as JSP servlet for JobTracker | Major | jobtracker | Aaron Kimball | Aaron Kimball |
+| [MAPREDUCE-980](https://issues.apache.org/jira/browse/MAPREDUCE-980) | Modify JobHistory to use Avro for serialization instead of raw JSON | Major | . | Jothi Padmanabhan | Doug Cutting |
| [MAPREDUCE-728](https://issues.apache.org/jira/browse/MAPREDUCE-728) | Mumak: Map-Reduce Simulator | Major | . | Arun C Murthy | Hong Tang |
+| [HADOOP-6218](https://issues.apache.org/jira/browse/HADOOP-6218) | Split TFile by Record Sequence Number | Major | . | Hong Tang | Hong Tang |
+| [HDFS-654](https://issues.apache.org/jira/browse/HDFS-654) | HDFS needs to support new rename introduced for FileContext | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-222](https://issues.apache.org/jira/browse/HDFS-222) | Support for concatenating of files into a single file | Major | . | Venkatesh Seetharam | Boris Shkolnik |
+| [HADOOP-6313](https://issues.apache.org/jira/browse/HADOOP-6313) | Expose flush APIs to application users | Major | fs | Hairong Kuang | Hairong Kuang |
+| [HDFS-731](https://issues.apache.org/jira/browse/HDFS-731) | Support new Syncable interface in HDFS | Major | . | Hairong Kuang | Hairong Kuang |
+| [HDFS-702](https://issues.apache.org/jira/browse/HDFS-702) | Add Hdfs Impl for the new file system interface | Major | namenode | Sanjay Radia | Sanjay Radia |
| [MAPREDUCE-707](https://issues.apache.org/jira/browse/MAPREDUCE-707) | Provide a jobconf property for explicitly assigning a job to a pool | Trivial | contrib/fair-share | Matei Zaharia | Alan Heirich |
-| [MAPREDUCE-706](https://issues.apache.org/jira/browse/MAPREDUCE-706) | Support for FIFO pools in the fair scheduler | Major | contrib/fair-share | Matei Zaharia | Matei Zaharia |
+| [HADOOP-6337](https://issues.apache.org/jira/browse/HADOOP-6337) | Update FilterInitializer class to be more visible and take a conf for further development | Major | . | Jakob Homan | Jakob Homan |
+| [HDFS-503](https://issues.apache.org/jira/browse/HDFS-503) | Implement erasure coding as a layer on HDFS | Major | contrib/raid | dhruba borthakur | dhruba borthakur |
+| [MAPREDUCE-1167](https://issues.apache.org/jira/browse/MAPREDUCE-1167) | Make ProcfsBasedProcessTree collect rss memory information | Major | tasktracker | Scott Chen | Scott Chen |
+| [MAPREDUCE-1074](https://issues.apache.org/jira/browse/MAPREDUCE-1074) | Provide documentation for Mark/Reset functionality | Major | documentation | Jothi Padmanabhan | Jothi Padmanabhan |
+| [HADOOP-6323](https://issues.apache.org/jira/browse/HADOOP-6323) | Serialization should provide comparators | Major | io | Doug Cutting | Aaron Kimball |
+| [HADOOP-6433](https://issues.apache.org/jira/browse/HADOOP-6433) | Add AsyncDiskService that is used in both hdfs and mapreduce | Major | . | Zheng Shao | Zheng Shao |
+| [HADOOP-6415](https://issues.apache.org/jira/browse/HADOOP-6415) | Adding a common token interface for both job token and delegation token | Major | security | Kan Zhang | Kan Zhang |
| [MAPREDUCE-698](https://issues.apache.org/jira/browse/MAPREDUCE-698) | Per-pool task limits for the fair scheduler | Major | contrib/fair-share | Matei Zaharia | Kevin Peterson |
-| [MAPREDUCE-679](https://issues.apache.org/jira/browse/MAPREDUCE-679) | XML-based metrics as JSP servlet for JobTracker | Major | jobtracker | Aaron Kimball | Aaron Kimball |
-| [MAPREDUCE-567](https://issues.apache.org/jira/browse/MAPREDUCE-567) | Add a new example MR that always fails | Major | examples | Philip Zeyliger | Philip Zeyliger |
-| [MAPREDUCE-551](https://issues.apache.org/jira/browse/MAPREDUCE-551) | Add preemption to the fair scheduler | Major | contrib/fair-share | Matei Zaharia | Matei Zaharia |
-| [MAPREDUCE-546](https://issues.apache.org/jira/browse/MAPREDUCE-546) | Provide sample fair scheduler config file in conf/ and use it by default if no other config file is specified | Minor | . | Matei Zaharia | Matei Zaharia |
-| [MAPREDUCE-532](https://issues.apache.org/jira/browse/MAPREDUCE-532) | Allow admins of the Capacity Scheduler to set a hard-limit on the capacity of a queue | Major | capacity-sched | Rajiv Chittajallu | rahul k singh |
-| [MAPREDUCE-467](https://issues.apache.org/jira/browse/MAPREDUCE-467) | Collect information about number of tasks succeeded / total per time unit for a tasktracker. | Major | . | Hemanth Yamijala | Sharad Agarwal |
-| [MAPREDUCE-211](https://issues.apache.org/jira/browse/MAPREDUCE-211) | Provide a node health check script and run it periodically to check the node health status | Major | . | Aroop Maliakkal | Sreekanth Ramakrishnan |
+| [HDFS-814](https://issues.apache.org/jira/browse/HDFS-814) | Add an api to get the visible length of a DFSDataInputStream. | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-6408](https://issues.apache.org/jira/browse/HADOOP-6408) | Add a /conf servlet to dump running configuration | Major | . | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-1295](https://issues.apache.org/jira/browse/MAPREDUCE-1295) | We need a job trace manipulator to build gridmix runs. | Major | tools/rumen | Dick King | Dick King |
+| [HADOOP-6497](https://issues.apache.org/jira/browse/HADOOP-6497) | Introduce wrapper around FSDataInputStream providing Avro SeekableInput interface | Major | fs | Aaron Kimball | Aaron Kimball |
+| [MAPREDUCE-1338](https://issues.apache.org/jira/browse/MAPREDUCE-1338) | need security keys storage solution | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [HDFS-905](https://issues.apache.org/jira/browse/HDFS-905) | Make changes to HDFS for the new UserGroupInformation APIs (HADOOP-6299) | Major | . | Devaraj Das | Jakob Homan |
+| [HADOOP-6517](https://issues.apache.org/jira/browse/HADOOP-6517) | Ability to add/get tokens from UserGroupInformation | Major | . | Owen O'Malley | Owen O'Malley |
+| [MAPREDUCE-1383](https://issues.apache.org/jira/browse/MAPREDUCE-1383) | Allow storage and caching of delegation token. | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [HADOOP-6419](https://issues.apache.org/jira/browse/HADOOP-6419) | Change RPC layer to support SASL based mutual authentication | Major | security | Kan Zhang | Kan Zhang |
+| [MAPREDUCE-1335](https://issues.apache.org/jira/browse/MAPREDUCE-1335) | Add SASL DIGEST-MD5 authentication to TaskUmbilicalProtocol | Major | . | Kan Zhang | Kan Zhang |
+| [HADOOP-6510](https://issues.apache.org/jira/browse/HADOOP-6510) | doAs for proxy user | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HDFS-935](https://issues.apache.org/jira/browse/HDFS-935) | Real user in delegation token. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [MAPREDUCE-1464](https://issues.apache.org/jira/browse/MAPREDUCE-1464) | In JobTokenIdentifier change method getUsername to getUser which returns UGI | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HADOOP-6547](https://issues.apache.org/jira/browse/HADOOP-6547) | Move the Delegation Token feature to common since both HDFS and MapReduce needs it | Major | security | Devaraj Das | Devaraj Das |
+| [HDFS-245](https://issues.apache.org/jira/browse/HDFS-245) | Create symbolic links in HDFS | Major | . | dhruba borthakur | Eli Collins |
+| [HADOOP-6573](https://issues.apache.org/jira/browse/HADOOP-6573) | Delegation Tokens should be persisted. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HDFS-991](https://issues.apache.org/jira/browse/HDFS-991) | Allow browsing the filesystem over http using delegation tokens | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-6594](https://issues.apache.org/jira/browse/HADOOP-6594) | Update hdfs script to provide fetchdt tool | Major | . | Jakob Homan | Jakob Homan |
+| [HADOOP-6566](https://issues.apache.org/jira/browse/HADOOP-6566) | Hadoop daemons should not start up if the ownership/permissions on the directories used at runtime are misconfigured | Major | security | Devaraj Das | Arun C Murthy |
+| [HADOOP-6580](https://issues.apache.org/jira/browse/HADOOP-6580) | UGI should contain authentication method. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HDFS-999](https://issues.apache.org/jira/browse/HDFS-999) | Secondary namenode should login using kerberos if security is configured | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [HDFS-993](https://issues.apache.org/jira/browse/HDFS-993) | Namenode should issue a delegation token only for kerberos authenticated clients. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [MAPREDUCE-1673](https://issues.apache.org/jira/browse/MAPREDUCE-1673) | Start and Stop scripts for the RaidNode | Major | contrib/raid | Rodrigo Schmidt | Rodrigo Schmidt |
+| [MAPREDUCE-1304](https://issues.apache.org/jira/browse/MAPREDUCE-1304) | Add counters for task time spent in GC | Major | task | Todd Lipcon | Aaron Kimball |
+| [HDFS-1091](https://issues.apache.org/jira/browse/HDFS-1091) | Implement listStatus that returns an Iterator of FileStatus | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-6332](https://issues.apache.org/jira/browse/HADOOP-6332) | Large-scale Automated Test Framework | Major | test | Arun C Murthy | Konstantin Boudnik |
+| [MAPREDUCE-1774](https://issues.apache.org/jira/browse/MAPREDUCE-1774) | Large-scale Automated Framework | Major | test | Konstantin Boudnik | Konstantin Boudnik |
+| [HADOOP-6869](https://issues.apache.org/jira/browse/HADOOP-6869) | Functionality to create file or folder on a remote daemon side | Major | test | Vinay Kumar Thota | Vinay Kumar Thota |
+| [HDFS-2137](https://issues.apache.org/jira/browse/HDFS-2137) | Datanode Disk Fail Inplace | Major | datanode | Bharath Mundlapudi | |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-6813](https://issues.apache.org/jira/browse/HADOOP-6813) | Add a new newInstance method in FileSystem that takes a "user" as argument | Blocker | fs | Devaraj Das | Devaraj Das |
-| [HADOOP-6798](https://issues.apache.org/jira/browse/HADOOP-6798) | Align Ivy version for all Hadoop subprojects. | Major | build | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-6794](https://issues.apache.org/jira/browse/HADOOP-6794) | Move configuration and script files post split | Blocker | conf, scripts | Tom White | Tom White |
-| [HADOOP-6777](https://issues.apache.org/jira/browse/HADOOP-6777) | Implement a functionality for suspend and resume a process. | Major | test | Vinay Kumar Thota | Vinay Kumar Thota |
-| [HADOOP-6769](https://issues.apache.org/jira/browse/HADOOP-6769) | Add an API in FileSystem to get FileSystem instances based on users | Blocker | . | Devaraj Das | Devaraj Das |
-| [HADOOP-6717](https://issues.apache.org/jira/browse/HADOOP-6717) | Log levels in o.a.h.security.Groups too high | Trivial | security | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6713](https://issues.apache.org/jira/browse/HADOOP-6713) | The RPC server Listener thread is a scalability bottleneck | Major | ipc | dhruba borthakur | Dmytro Molkov |
-| [HADOOP-6709](https://issues.apache.org/jira/browse/HADOOP-6709) | Re-instate deprecated FileSystem methods that were removed after 0.20 | Blocker | fs | Tom White | Tom White |
-| [HADOOP-6678](https://issues.apache.org/jira/browse/HADOOP-6678) | Remove FileContext#isFile, isDirectory and exists | Major | fs | Hairong Kuang | Eli Collins |
-| [HADOOP-6657](https://issues.apache.org/jira/browse/HADOOP-6657) | Common portion of MAPREDUCE-1545 | Major | . | Luke Lu | Luke Lu |
-| [HADOOP-6635](https://issues.apache.org/jira/browse/HADOOP-6635) | Install or deploy source jars to maven repo | Major | build | Patrick Angeles | Patrick Angeles |
-| [HADOOP-6589](https://issues.apache.org/jira/browse/HADOOP-6589) | Better error messages for RPC clients when authentication fails | Major | ipc, security | Kan Zhang | Kan Zhang |
-| [HADOOP-6585](https://issues.apache.org/jira/browse/HADOOP-6585) | Add FileStatus#isDirectory and isFile | Blocker | fs | Eli Collins | Eli Collins |
-| [HADOOP-6583](https://issues.apache.org/jira/browse/HADOOP-6583) | Capture metrics for authentication/authorization at the RPC layer | Major | ipc, security | Devaraj Das | Devaraj Das |
-| [HADOOP-6582](https://issues.apache.org/jira/browse/HADOOP-6582) | Token class should have a toString, equals and hashcode method | Major | security | Devaraj Das | Boris Shkolnik |
-| [HADOOP-6579](https://issues.apache.org/jira/browse/HADOOP-6579) | A utility for reading and writing tokens into a URL safe string. | Major | security | Owen O'Malley | Owen O'Malley |
-| [HADOOP-6559](https://issues.apache.org/jira/browse/HADOOP-6559) | The RPC client should try to re-login when it detects that the TGT expired | Major | security | Devaraj Das | Devaraj Das |
-| [HADOOP-6543](https://issues.apache.org/jira/browse/HADOOP-6543) | Allow authentication-enabled RPC clients to connect to authentication-disabled RPC servers | Major | ipc, security | Kan Zhang | Kan Zhang |
-| [HADOOP-6537](https://issues.apache.org/jira/browse/HADOOP-6537) | Proposal for exceptions thrown by FileContext and Abstract File System | Major | . | Jitendra Nath Pandey | Suresh Srinivas |
-| [HADOOP-6534](https://issues.apache.org/jira/browse/HADOOP-6534) | LocalDirAllocator should use whitespace trimming configuration getters | Major | conf, fs | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6531](https://issues.apache.org/jira/browse/HADOOP-6531) | add FileUtil.fullyDeleteContents(dir) api to delete contents of a directory | Minor | fs | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-6518](https://issues.apache.org/jira/browse/HADOOP-6518) | Kerberos login in UGI should honor KRB5CCNAME | Major | security | Owen O'Malley | Owen O'Malley |
-| [HADOOP-6515](https://issues.apache.org/jira/browse/HADOOP-6515) | Make maximum number of http threads configurable | Major | . | Scott Chen | Scott Chen |
-| [HADOOP-6492](https://issues.apache.org/jira/browse/HADOOP-6492) | Make avro serialization APIs public | Major | . | Aaron Kimball | Aaron Kimball |
-| [HADOOP-6479](https://issues.apache.org/jira/browse/HADOOP-6479) | TestUTF8 assertions could fail with better text | Minor | test | Steve Loughran | Steve Loughran |
-| [HADOOP-6471](https://issues.apache.org/jira/browse/HADOOP-6471) | StringBuffer -\> StringBuilder - conversion of references as necessary | Major | . | Karthik K | Karthik K |
-| [HADOOP-6467](https://issues.apache.org/jira/browse/HADOOP-6467) | Performance improvement for liststatus on directories in hadoop archives. | Major | fs | Mahadev konar | Mahadev konar |
-| [HADOOP-6443](https://issues.apache.org/jira/browse/HADOOP-6443) | Serialization classes accept invalid metadata | Major | io | Aaron Kimball | Aaron Kimball |
-| [HADOOP-6435](https://issues.apache.org/jira/browse/HADOOP-6435) | Make RPC.waitForProxy with timeout public | Major | ipc | Steve Loughran | Steve Loughran |
-| [HADOOP-6434](https://issues.apache.org/jira/browse/HADOOP-6434) | Make HttpServer slightly easier to manage/diagnose faults with | Minor | . | Steve Loughran | Steve Loughran |
-| [HADOOP-6420](https://issues.apache.org/jira/browse/HADOOP-6420) | String-to-String Maps should be embeddable in Configuration | Major | conf | Aaron Kimball | Aaron Kimball |
-| [HADOOP-6413](https://issues.apache.org/jira/browse/HADOOP-6413) | Move TestReflectionUtils to Common | Major | test | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6407](https://issues.apache.org/jira/browse/HADOOP-6407) | Have a way to automatically update Eclipse .classpath file when new libs are added to the classpath through Ivy | Minor | build | Konstantin Boudnik | Tom White |
-| [HADOOP-6403](https://issues.apache.org/jira/browse/HADOOP-6403) | Deprecate EC2 bash scripts | Major | contrib/cloud | Tom White | Tom White |
-| [HADOOP-6400](https://issues.apache.org/jira/browse/HADOOP-6400) | Log errors getting Unix UGI | Minor | security | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6394](https://issues.apache.org/jira/browse/HADOOP-6394) | Helper class for FileContext tests | Major | test | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-6366](https://issues.apache.org/jira/browse/HADOOP-6366) | Reduce ivy console output to ovservable level | Major | . | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-6343](https://issues.apache.org/jira/browse/HADOOP-6343) | Stack trace of any runtime exceptions should be recorded in the server logs. | Major | ipc | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-6326](https://issues.apache.org/jira/browse/HADOOP-6326) | Hundson runs should check for AspectJ warnings and report failure if any is present | Critical | build | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-6318](https://issues.apache.org/jira/browse/HADOOP-6318) | Upgrade to Avro 1.2.0 | Major | io, ipc | Doug Cutting | Doug Cutting |
-| [HADOOP-6307](https://issues.apache.org/jira/browse/HADOOP-6307) | Support reading on un-closed SequenceFile | Major | io | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-6305](https://issues.apache.org/jira/browse/HADOOP-6305) | Unify build property names to facilitate cross-projects modifications | Major | build | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-6301](https://issues.apache.org/jira/browse/HADOOP-6301) | Need to post Injection HowTo to Apache Hadoop's Wiki | Major | . | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-6279](https://issues.apache.org/jira/browse/HADOOP-6279) | Add JVM memory usage to JvmMetrics | Minor | . | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6271](https://issues.apache.org/jira/browse/HADOOP-6271) | Fix FileContext to allow both recursive and non recursive create and mkdir | Major | fs | Sanjay Radia | Sanjay Radia |
-| [HADOOP-6268](https://issues.apache.org/jira/browse/HADOOP-6268) | Add ivy jar to .gitignore | Minor | build | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6267](https://issues.apache.org/jira/browse/HADOOP-6267) | build-contrib.xml unnecessarily enforces that contrib projects be located in contrib/ dir | Minor | build | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6252](https://issues.apache.org/jira/browse/HADOOP-6252) | Provide method to determine if a deprecated key was set in the config file | Major | conf | Jakob Homan | Jakob Homan |
-| [HADOOP-6246](https://issues.apache.org/jira/browse/HADOOP-6246) | Update umask code to use key deprecation facilities from HADOOP-6105 | Major | fs | Jakob Homan | Jakob Homan |
-| [HADOOP-6233](https://issues.apache.org/jira/browse/HADOOP-6233) | Changes in common to rename the config keys as detailed in HDFS-531. | Major | fs | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-6224](https://issues.apache.org/jira/browse/HADOOP-6224) | Add a method to WritableUtils performing a bounded read of a String | Major | io | Jothi Padmanabhan | Jothi Padmanabhan |
-| [HADOOP-6216](https://issues.apache.org/jira/browse/HADOOP-6216) | HDFS Web UI displays comments from dfs.exclude file and counts them as dead nodes | Major | util | Jim Huang | Ravi Phulari |
-| [HADOOP-6204](https://issues.apache.org/jira/browse/HADOOP-6204) | Implementing aspects development and fault injeciton framework for Hadoop | Major | build, test | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-6182](https://issues.apache.org/jira/browse/HADOOP-6182) | Adding Apache License Headers and reduce releaseaudit warnings to zero | Major | . | Giridharan Kesavan | Giridharan Kesavan |
-| [HADOOP-6166](https://issues.apache.org/jira/browse/HADOOP-6166) | Improve PureJavaCrc32 | Major | performance, util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-6161](https://issues.apache.org/jira/browse/HADOOP-6161) | Add get/setEnum to Configuration | Minor | conf | Chris Douglas | Chris Douglas |
-| [HADOOP-6160](https://issues.apache.org/jira/browse/HADOOP-6160) | releaseaudit (rats) should not be run againt the entire release binary | Major | build | Giridharan Kesavan | Giridharan Kesavan |
-| [HADOOP-6150](https://issues.apache.org/jira/browse/HADOOP-6150) | Need to be able to instantiate a comparator instance from a comparator string without creating a TFile.Reader object | Minor | io | Hong Tang | Hong Tang |
-| [HADOOP-6148](https://issues.apache.org/jira/browse/HADOOP-6148) | Implement a pure Java CRC32 calculator | Major | performance, util | Owen O'Malley | Scott Carey |
-| [HADOOP-6146](https://issues.apache.org/jira/browse/HADOOP-6146) | Upgrade to JetS3t version 0.7.1 | Major | fs/s3 | Tom White | Tom White |
-| [HADOOP-6133](https://issues.apache.org/jira/browse/HADOOP-6133) | ReflectionUtils performance regression | Major | conf | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6109](https://issues.apache.org/jira/browse/HADOOP-6109) | Handle large (several MB) text input lines in a reasonable amount of time | Major | io | thushara wijeratna | thushara wijeratna |
-| [HADOOP-6106](https://issues.apache.org/jira/browse/HADOOP-6106) | Provide an option in ShellCommandExecutor to timeout commands that do not complete within a certain amount of time. | Major | util | Hemanth Yamijala | Sreekanth Ramakrishnan |
-| [HADOOP-6105](https://issues.apache.org/jira/browse/HADOOP-6105) | Provide a way to automatically handle backward compatibility of deprecated keys | Major | conf | Hemanth Yamijala | V.V.Chaitanya Krishna |
-| [HADOOP-6099](https://issues.apache.org/jira/browse/HADOOP-6099) | Allow configuring the IPC module to send pings | Major | ipc | dhruba borthakur | dhruba borthakur |
-| [HADOOP-5976](https://issues.apache.org/jira/browse/HADOOP-5976) | create script to provide classpath for external tools | Major | scripts | Owen O'Malley | Owen O'Malley |
-| [HADOOP-5968](https://issues.apache.org/jira/browse/HADOOP-5968) | Sqoop should only print a warning about mysql import speed once | Minor | . | Aaron Kimball | Aaron Kimball |
-| [HADOOP-5967](https://issues.apache.org/jira/browse/HADOOP-5967) | Sqoop should only use a single map task | Minor | . | Aaron Kimball | Aaron Kimball |
-| [HADOOP-5961](https://issues.apache.org/jira/browse/HADOOP-5961) | DataNode should understand generic hadoop options | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-5925](https://issues.apache.org/jira/browse/HADOOP-5925) | EC2 scripts should exit on error | Major | contrib/cloud | Tom White | Tom White |
-| [HADOOP-5897](https://issues.apache.org/jira/browse/HADOOP-5897) | Add more Metrics to Namenode to capture heap usage | Major | metrics | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-5896](https://issues.apache.org/jira/browse/HADOOP-5896) | Remove the dependency of GenericOptionsParser on Option.withArgPattern | Major | . | Sharad Agarwal | Sharad Agarwal |
-| [HADOOP-5890](https://issues.apache.org/jira/browse/HADOOP-5890) | Use exponential backoff on Thread.sleep during DN shutdown | Major | . | Todd Lipcon | Todd Lipcon |
-| [HADOOP-5873](https://issues.apache.org/jira/browse/HADOOP-5873) | Remove deprecated methods randomDataNode() and getDatanodeByIndex(..) in FSNamesystem | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-5867](https://issues.apache.org/jira/browse/HADOOP-5867) | Cleaning NNBench\* off javac warnings | Major | test | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-5858](https://issues.apache.org/jira/browse/HADOOP-5858) | Eliminate UTF8 and fix warnings in test/hdfs-with-mr package | Major | test | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-5857](https://issues.apache.org/jira/browse/HADOOP-5857) | Refactor hdfs jsp codes | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-5854](https://issues.apache.org/jira/browse/HADOOP-5854) | findbugs : fix "Inconsistent Synchronization" warnings in hdfs | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-5839](https://issues.apache.org/jira/browse/HADOOP-5839) | fixes to ec2 scripts to allow remote job submission | Major | contrib/cloud | Joydeep Sen Sarma | Joydeep Sen Sarma |
-| [HADOOP-5838](https://issues.apache.org/jira/browse/HADOOP-5838) | Remove a few javac warnings under hdfs | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-5822](https://issues.apache.org/jira/browse/HADOOP-5822) | Fix javac warnings in several dfs tests related to unncessary casts | Major | test | Jakob Homan | Jakob Homan |
-| [HADOOP-5784](https://issues.apache.org/jira/browse/HADOOP-5784) | The length of the heartbeat cycle should be configurable. | Major | . | Owen O'Malley | Amareshwari Sriramadasu |
-| [HADOOP-5771](https://issues.apache.org/jira/browse/HADOOP-5771) | Create unit test for LinuxTaskController | Major | security, test | Sreekanth Ramakrishnan | Sreekanth Ramakrishnan |
-| [HADOOP-5733](https://issues.apache.org/jira/browse/HADOOP-5733) | Add map/reduce slot capacity and lost map/reduce slot capacity to JobTracker metrics | Major | metrics | Hong Tang | Sreekanth Ramakrishnan |
-| [HADOOP-5727](https://issues.apache.org/jira/browse/HADOOP-5727) | Faster, simpler id.hashCode() which does not allocate memory | Major | . | Shevek | Shevek |
-| [HADOOP-5721](https://issues.apache.org/jira/browse/HADOOP-5721) | Provide EditLogFileInputStream and EditLogFileOutputStream as independent classes | Minor | . | Luca Telloli | |
-| [HADOOP-5717](https://issues.apache.org/jira/browse/HADOOP-5717) | Create public enum class for the Framework counters in org.apache.hadoop.mapreduce | Major | . | Owen O'Malley | Amareshwari Sriramadasu |
-| [HADOOP-5705](https://issues.apache.org/jira/browse/HADOOP-5705) | Improved tries in TotalOrderPartitioner to eliminate large leaf nodes. | Major | . | Dick King | Dick King |
-| [HADOOP-5687](https://issues.apache.org/jira/browse/HADOOP-5687) | Hadoop NameNode throws NPE if fs.default.name is the default value | Minor | . | Philip Zeyliger | Philip Zeyliger |
-| [HADOOP-5675](https://issues.apache.org/jira/browse/HADOOP-5675) | DistCp should not launch a job if it is not necessary | Minor | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-5664](https://issues.apache.org/jira/browse/HADOOP-5664) | Use of ReentrantLock.lock() in MapOutputBuffer takes up too much cpu time | Minor | . | Bryan Duxbury | Chris Douglas |
-| [HADOOP-5657](https://issues.apache.org/jira/browse/HADOOP-5657) | Validate data passed through TestReduceFetch | Minor | test | Chris Douglas | Chris Douglas |
-| [HADOOP-5638](https://issues.apache.org/jira/browse/HADOOP-5638) | More improvement on block placement performance | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5625](https://issues.apache.org/jira/browse/HADOOP-5625) | Add I/O duration time in client trace | Minor | . | Lei (Eddy) Xu | Lei (Eddy) Xu |
-| [HADOOP-5613](https://issues.apache.org/jira/browse/HADOOP-5613) | change S3Exception to checked exception | Minor | fs/s3 | Andrew Hitchcock | Andrew Hitchcock |
-| [HADOOP-5603](https://issues.apache.org/jira/browse/HADOOP-5603) | Improve block placement performance | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5596](https://issues.apache.org/jira/browse/HADOOP-5596) | Make ObjectWritable support EnumSet | Major | io | He Yongqiang | He Yongqiang |
-| [HADOOP-5595](https://issues.apache.org/jira/browse/HADOOP-5595) | NameNode does not need to run a replicator to choose a random DataNode | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5589](https://issues.apache.org/jira/browse/HADOOP-5589) | TupleWritable: Lift implicit limit on the number of values that can be stored | Major | . | Jingkei Ly | Jingkei Ly |
-| [HADOOP-5572](https://issues.apache.org/jira/browse/HADOOP-5572) | The map progress value should have a separate phase for doing the final sort. | Major | . | Owen O'Malley | Ravi Gummadi |
-| [HADOOP-5509](https://issues.apache.org/jira/browse/HADOOP-5509) | PendingReplicationBlocks should not start monitor in constructor. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-5502](https://issues.apache.org/jira/browse/HADOOP-5502) | Backup and checkpoint nodes should be documented | Major | documentation | Konstantin Shvachko | Jakob Homan |
-| [HADOOP-5500](https://issues.apache.org/jira/browse/HADOOP-5500) | Allow number of fields to be supplied when field names are not known in DBOutputFormat#setOutput() | Major | . | Enis Soztutar | Enis Soztutar |
-| [HADOOP-5494](https://issues.apache.org/jira/browse/HADOOP-5494) | IFile.Reader should have a nextRawKey/nextRawValue | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-5455](https://issues.apache.org/jira/browse/HADOOP-5455) | default "hadoop-metrics.properties" doesn't mention "rpc" context | Minor | documentation, metrics | Philip Zeyliger | Philip Zeyliger |
-| [HADOOP-5450](https://issues.apache.org/jira/browse/HADOOP-5450) | Add support for application-specific typecodes to typed bytes | Blocker | . | Klaas Bosteels | Klaas Bosteels |
-| [HADOOP-5423](https://issues.apache.org/jira/browse/HADOOP-5423) | It should be posible to specify metadata for the output file produced by SequenceFile.Sorter.sort | Major | io | Michael Tamm | Michael Tamm |
-| [HADOOP-5419](https://issues.apache.org/jira/browse/HADOOP-5419) | Provide a way for users to find out what operations they can do on which M/R queues | Major | . | Hemanth Yamijala | rahul k singh |
-| [HADOOP-5396](https://issues.apache.org/jira/browse/HADOOP-5396) | Queue ACLs should be refreshed without requiring a restart of the job tracker | Major | . | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-| [HADOOP-5369](https://issues.apache.org/jira/browse/HADOOP-5369) | Small tweaks to reduce MapFile index size | Major | . | Ben Maurer | Ben Maurer |
-| [HADOOP-5365](https://issues.apache.org/jira/browse/HADOOP-5365) | hdfsprxoy should log every access | Major | . | Kan Zhang | zhiyong zhang |
-| [HADOOP-5364](https://issues.apache.org/jira/browse/HADOOP-5364) | Adding SSL certificate expiration warning to hdfsproxy | Major | . | Kan Zhang | zhiyong zhang |
-| [HADOOP-5331](https://issues.apache.org/jira/browse/HADOOP-5331) | KFS: Add support for append | Major | . | Sriram Rao | Sriram Rao |
-| [HADOOP-5317](https://issues.apache.org/jira/browse/HADOOP-5317) | Provide documentation for LazyOutput Feature | Major | documentation | Jothi Padmanabhan | Jothi Padmanabhan |
-| [HADOOP-5279](https://issues.apache.org/jira/browse/HADOOP-5279) | test-patch.sh scirpt should just call the test-core target as part of runtestcore function. | Major | . | Giridharan Kesavan | Giridharan Kesavan |
-| [HADOOP-5266](https://issues.apache.org/jira/browse/HADOOP-5266) | Values Iterator should support "mark" and "reset" | Major | . | Jothi Padmanabhan | Jothi Padmanabhan |
-| [HADOOP-5264](https://issues.apache.org/jira/browse/HADOOP-5264) | TaskTracker should have single conf reference | Major | . | Sharad Agarwal | Sharad Agarwal |
-| [HADOOP-5240](https://issues.apache.org/jira/browse/HADOOP-5240) | 'ant javadoc' does not check whether outputs are up to date and always rebuilds | Major | build | Aaron Kimball | Aaron Kimball |
-| [HADOOP-5222](https://issues.apache.org/jira/browse/HADOOP-5222) | Add offset in client trace | Minor | . | Lei (Eddy) Xu | Lei (Eddy) Xu |
-| [HADOOP-5205](https://issues.apache.org/jira/browse/HADOOP-5205) | Change CHUKWA\_IDENT\_STRING from "demo" to "TODO-AGENTS-INSTANCE-NAME" | Major | . | Jerome Boulon | Jerome Boulon |
-| [HADOOP-5196](https://issues.apache.org/jira/browse/HADOOP-5196) | avoiding unnecessary byte[] allocation in SequenceFile.CompressedBytes and SequenceFile.UncompressedBytes | Minor | io | Hong Tang | Hong Tang |
-| [HADOOP-5147](https://issues.apache.org/jira/browse/HADOOP-5147) | remove refs to slaves file | Minor | . | Ari Rabkin | Ari Rabkin |
-| [HADOOP-5144](https://issues.apache.org/jira/browse/HADOOP-5144) | manual way of turning on restore of failed storage replicas for namenode | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [HADOOP-5135](https://issues.apache.org/jira/browse/HADOOP-5135) | Separate the core, hdfs and mapred junit tests | Major | build | Sharad Agarwal | Sharad Agarwal |
+| [HADOOP-4936](https://issues.apache.org/jira/browse/HADOOP-4936) | Improvements to TestSafeMode | Major | test | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-4794](https://issues.apache.org/jira/browse/HADOOP-4794) | separate branch for HadoopVersionAnnotation | Major | build | Owen O'Malley | Chris Douglas |
| [HADOOP-5126](https://issues.apache.org/jira/browse/HADOOP-5126) | Empty file BlocksWithLocations.java should be removed | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-5124](https://issues.apache.org/jira/browse/HADOOP-5124) | A few optimizations to FsNamesystem#RecentInvalidateSets | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5107](https://issues.apache.org/jira/browse/HADOOP-5107) | split the core, hdfs, and mapred jars from each other and publish them independently to the Maven repository | Major | build | Owen O'Malley | Giridharan Kesavan |
-| [HADOOP-5101](https://issues.apache.org/jira/browse/HADOOP-5101) | optimizing build.xml target dependencies | Major | build | Giridharan Kesavan | Giridharan Kesavan |
| [HADOOP-5088](https://issues.apache.org/jira/browse/HADOOP-5088) | include releaseaudit as part of test-patch.sh script | Major | build | Giridharan Kesavan | Giridharan Kesavan |
+| [HADOOP-2721](https://issues.apache.org/jira/browse/HADOOP-2721) | Use job control for tasks (and therefore for pipes and streaming) | Major | . | Owen O'Malley | Ravi Gummadi |
+| [HADOOP-5124](https://issues.apache.org/jira/browse/HADOOP-5124) | A few optimizations to FsNamesystem#RecentInvalidateSets | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-4859](https://issues.apache.org/jira/browse/HADOOP-4859) | Make the M/R Job output dir unique for Daily rolling | Major | . | Jerome Boulon | Jerome Boulon |
| [HADOOP-5038](https://issues.apache.org/jira/browse/HADOOP-5038) | remove System.out.println statement | Major | . | Jerome Boulon | Jerome Boulon |
+| [HADOOP-5147](https://issues.apache.org/jira/browse/HADOOP-5147) | remove refs to slaves file | Minor | . | Ari Rabkin | Ari Rabkin |
+| [HADOOP-5101](https://issues.apache.org/jira/browse/HADOOP-5101) | optimizing build.xml target dependencies | Major | build | Giridharan Kesavan | Giridharan Kesavan |
+| [HADOOP-4868](https://issues.apache.org/jira/browse/HADOOP-4868) | Split the hadoop script into 3 parts | Major | scripts | Sharad Agarwal | Sharad Agarwal |
+| [HADOOP-1722](https://issues.apache.org/jira/browse/HADOOP-1722) | Make streaming to handle non-utf8 byte array | Major | . | Runping Qi | Klaas Bosteels |
+| [HADOOP-4885](https://issues.apache.org/jira/browse/HADOOP-4885) | Try to restore failed replicas of Name Node storage (at checkpoint time) | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [HADOOP-5279](https://issues.apache.org/jira/browse/HADOOP-5279) | test-patch.sh scirpt should just call the test-core target as part of runtestcore function. | Major | . | Giridharan Kesavan | Giridharan Kesavan |
+| [HADOOP-5222](https://issues.apache.org/jira/browse/HADOOP-5222
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[45/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.0/RELEASENOTES.0.17.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.0/RELEASENOTES.0.17.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.0/RELEASENOTES.0.17.0.md
index c8c2794..4e2fee2 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.0/RELEASENOTES.0.17.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.0/RELEASENOTES.0.17.0.md
@@ -23,269 +23,265 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-3382](https://issues.apache.org/jira/browse/HADOOP-3382) | *Blocker* | **Memory leak when files are not cleanly closed**
+* [HADOOP-1593](https://issues.apache.org/jira/browse/HADOOP-1593) | *Major* | **FsShell should work with paths in non-default FileSystem**
-Fixed a memory leak associated with 'abandoned' files (i.e. not cleanly closed). This held up significant amounts of memory depending on activity and how long NameNode has been running.
+This bug allows non default path to specifeid in fsshell commands.
+
+So, you can now specify hadoop dfs -ls hdfs://remotehost1:port/path
+ and hadoop dfs -ls hdfs://remotehost2:port/path without changing the config.
---
-* [HADOOP-3280](https://issues.apache.org/jira/browse/HADOOP-3280) | *Blocker* | **virtual address space limits break streaming apps**
+* [HADOOP-2345](https://issues.apache.org/jira/browse/HADOOP-2345) | *Major* | **new transactions to support HDFS Appends**
-This patch adds the mapred.child.ulimit to limit the virtual memory for children processes to the given value.
+Introduce new namenode transactions to support appending to HDFS files.
---
-* [HADOOP-3266](https://issues.apache.org/jira/browse/HADOOP-3266) | *Major* | **Remove HOD changes from CHANGES.txt, as they are now inside src/contrib/hod**
+* [HADOOP-2178](https://issues.apache.org/jira/browse/HADOOP-2178) | *Major* | **Job history on HDFS**
-Moved HOD change items from CHANGES.txt to a new file src/contrib/hod/CHANGES.txt.
+This feature provides facility to store job history on DFS. Now cluster admin can provide either localFS location or DFS location using configuration property "mapred.job.history.location" to store job histroy. History will be logged in user specified location also. User can specify history location using configuration property "mapred.job.history.user.location" .
+The classes org.apache.hadoop.mapred.DefaultJobHistoryParser.MasterIndex and org.apache.hadoop.mapred.DefaultJobHistoryParser.MasterIndexParseListener, and public method org.apache.hadoop.mapred.DefaultJobHistoryParser.parseMasterIndex are not available.
+The signature of public method org.apache.hadoop.mapred.DefaultJobHistoryParser.parseJobTasks(File jobHistoryFile, JobHistory.JobInfo job) is changed to DefaultJobHistoryParser.parseJobTasks(String jobHistoryFile, JobHistory.JobInfo job, FileSystem fs).
+The signature of public method org.apache.hadoop.mapred.JobHistory.parseHistory(File path, Listener l) is changed to JobHistory.parseHistoryFromFS(String path, Listener l, FileSystem fs)
---
-* [HADOOP-3239](https://issues.apache.org/jira/browse/HADOOP-3239) | *Major* | **exists() calls logs FileNotFoundException in namenode log**
+* [HADOOP-2192](https://issues.apache.org/jira/browse/HADOOP-2192) | *Major* | **dfs mv command differs from POSIX standards**
-getFileInfo returns null for File not found instead of throwing FileNotFoundException
+this patch makes dfs -mv more like linux mv command getting rid of unnecessary output in dfs -mv and returns an error message when moving non existent files/directories --- mv: cannot stat "filename": No such file or directory.
---
-* [HADOOP-3223](https://issues.apache.org/jira/browse/HADOOP-3223) | *Blocker* | **Hadoop dfs -help for permissions contains a typo**
+* [HADOOP-2873](https://issues.apache.org/jira/browse/HADOOP-2873) | *Major* | **Namenode fails to re-start after cluster shutdown - DFSClient: Could not obtain blocks even all datanodes were up & live**
-Minor typo fix in help message for chmod. impact : none.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-3204](https://issues.apache.org/jira/browse/HADOOP-3204) | *Blocker* | **LocalFSMerger needs to catch throwable**
+* [HADOOP-2063](https://issues.apache.org/jira/browse/HADOOP-2063) | *Blocker* | **Command to pull corrupted files**
-Fixes LocalFSMerger in ReduceTask.java to handle errors/exceptions better. Prior to this all exceptions except IOException would be silently ignored.
+Added a new option -ignoreCrc to fs -get, or equivalently, fs -copyToLocal, such that crc checksum will be ignored for the command. The use of this option is to download the corrupted files.
---
-* [HADOOP-3168](https://issues.apache.org/jira/browse/HADOOP-3168) | *Major* | **reduce amount of logging in hadoop streaming**
+* [HADOOP-1985](https://issues.apache.org/jira/browse/HADOOP-1985) | *Major* | **Abstract node to switch mapping into a topology service class used by namenode and jobtracker**
-Decreases the frequency of logging from streaming from every 100 records to every 10,000 records.
+This issue introduces rack awareness for map tasks. It also moves the rack resolution logic to the central servers - NameNode & JobTracker. The administrator can specify a loadable class given by topology.node.switch.mapping.impl to specify the class implementing the logic for rack resolution. The class must implement a method - resolve(List\<String\> names), where names is the list of DNS-names/IP-addresses that we want resolved. The return value is a list of resolved network paths of the form /foo/rack, where rack is the rackID where the node belongs to and foo is the switch where multiple racks are connected, and so on. The default implementation of this class is packaged along with hadoop and points to org.apache.hadoop.net.ScriptBasedMapping and this class loads a script that can be used for rack resolution. The script location is configurable. It is specified by topology.script.file.name and defaults to an empty script. In the case where the script name is empty, /default-rack
is returned for all dns-names/IP-addresses. The loadable topology.node.switch.mapping.impl provides administrators fleixibilty to define how their site's node resolution should happen.
+For mapred, one can also specify the level of the cache w.r.t the number of levels in the resolved network path - defaults to two. This means that the JobTracker will cache tasks at the host level and at the rack level.
+Known issue: the task caching will not work with levels greater than 2 (beyond racks). This bug is tracked in HADOOP-3296.
---
-* [HADOOP-3162](https://issues.apache.org/jira/browse/HADOOP-3162) | *Blocker* | **Map/reduce stops working with comma separated input paths**
+* [HADOOP-1986](https://issues.apache.org/jira/browse/HADOOP-1986) | *Major* | **Add support for a general serialization mechanism for Map Reduce**
-The public methods org.apache.hadoop.mapred.JobConf.setInputPath(Path) and org.apache.hadoop.mapred.JobConf.addInputPath(Path) are deprecated. And the methods have the semantics of branch 0.16.
-The following public APIs are added in org.apache.hadoop.mapred.FileInputFormat :
-public static void setInputPaths(JobConf job, Path... paths);
-public static void setInputPaths(JobConf job, String commaSeparatedPaths);
-public static void addInputPath(JobConf job, Path path);
-public static void addInputPaths(JobConf job, String commaSeparatedPaths);
-Earlier code calling JobConf.setInputPath(Path), JobConf.addInputPath(Path) should now call FileInputFormat.setInputPaths(JobConf, Path...) and FileInputFormat.addInputPath(Path) respectively
+Programs that implement the raw Mapper or Reducer interfaces will need modification to compile with this release. For example,
+class MyMapper implements Mapper {
+ public void map(WritableComparable key, Writable val,
+ OutputCollector out, Reporter reporter) throws IOException {
+ // ...
+ }
+ // ...
+}
----
+will need to be changed to refer to the parameterized type. For example:
-* [HADOOP-3152](https://issues.apache.org/jira/browse/HADOOP-3152) | *Minor* | **Make index interval configuable when using MapFileOutputFormat for map-reduce job**
+class MyMapper implements Mapper\<WritableComparable, Writable, WritableComparable, Writable\> {
+ public void map(WritableComparable key, Writable val,
+ OutputCollector\<WritableComparable, Writable\> out, Reporter reporter) throws IOException {
+ // ...
+ }
+ // ...
+}
-Add a static method MapFile#setIndexInterval(Configuration, int interval) so that MapReduce jobs that use MapFileOutputFormat can set the index interval.
+Similarly implementations of the following raw interfaces will need modification: InputFormat, OutputCollector, OutputFormat, Partitioner, RecordReader, RecordWriter
---
-* [HADOOP-3140](https://issues.apache.org/jira/browse/HADOOP-3140) | *Major* | **JobTracker should not try to promote a (map) task if it does not write to DFS at all**
+* [HADOOP-910](https://issues.apache.org/jira/browse/HADOOP-910) | *Major* | **Reduces can do merges for the on-disk map output files in parallel with their copying**
-Tasks that don't generate any output are not inserted in the commit queue of the JobTracker. They are marked as SUCCESSFUL by the TaskTracker and the JobTracker updates their state short-circuiting the commit queue.
+Reducers now perform merges of shuffle data (both in-memory and on disk) while fetching map outputs. Earlier, during shuffle they used to merge only the in-memory outputs.
---
-* [HADOOP-3137](https://issues.apache.org/jira/browse/HADOOP-3137) | *Major* | **[HOD] Update hod version number**
+* [HADOOP-2219](https://issues.apache.org/jira/browse/HADOOP-2219) | *Major* | **du like command to count number of files under a given directory**
-Build script was changed to make HOD versions follow Hadoop version numbers. As a result of this change, the next version of HOD would not be 0.5, but would be synchronized to the Hadoop version number. Users who rely on the version number of HOD should note the unexpected jump in version numbers.
+Added a new fs command fs -count for counting the number of bytes, files and directories under a given path.
+
+Added a new RPC getContentSummary(String path) to ClientProtocol.
---
-* [HADOOP-3124](https://issues.apache.org/jira/browse/HADOOP-3124) | *Major* | **DFS data node should not use hard coded 10 minutes as write timeout.**
+* [HADOOP-2820](https://issues.apache.org/jira/browse/HADOOP-2820) | *Major* | **Remove deprecated classes in streaming**
-Makes DataNode socket write timeout configurable. User impact : none.
+The deprecated classes org.apache.hadoop.streaming.StreamLineRecordReader, org.apache.hadoop.streaming.StreamOutputFormat and org.apache.hadoop.streaming.StreamSequenceRecordReader are removed
---
-* [HADOOP-3099](https://issues.apache.org/jira/browse/HADOOP-3099) | *Blocker* | **Need new options in distcp for preserving ower, group and permission**
+* [HADOOP-2819](https://issues.apache.org/jira/browse/HADOOP-2819) | *Major* | **Remove deprecated methods in JobConf()**
-Added a new option -p to distcp for preserving file/directory status.
--p[rbugp] Preserve status
- r: replication number
- b: block size
- u: user
- g: group
- p: permission
- -p alone is equivalent to -prbugp
+The following deprecated methods are removed from org.apache.hadoop.JobConf :
+public Class getInputKeyClass()
+public void setInputKeyClass(Class theClass)
+public Class getInputValueClass()
+public void setInputValueClass(Class theClass)
+
+The methods, public boolean org.apache.hadoop.JobConf.getSpeculativeExecution() and
+public void org.apache.hadoop.JobConf.setSpeculativeExecution(boolean speculativeExecution) are undeprecated.
---
-* [HADOOP-3093](https://issues.apache.org/jira/browse/HADOOP-3093) | *Major* | **ma/reduce throws the following exception if "io.serializations" is not set:**
+* [HADOOP-2817](https://issues.apache.org/jira/browse/HADOOP-2817) | *Major* | **Remove deprecated mapred.tasktracker.tasks.maximum and clusterStatus.getMaxTasks()**
-The following public APIs are added in org.apache.hadoop.conf.Configuration
- String[] Configuration.getStrings(String name, String... defaultValue) and
- void Configuration.setStrings(String name, String... values)
+The deprecated method public int org.apache.hadoop.mapred.ClusterStatus.getMaxTasks() is removed.
+The deprecated configuration property "mapred.tasktracker.tasks.maximum" is removed.
---
-* [HADOOP-3091](https://issues.apache.org/jira/browse/HADOOP-3091) | *Major* | **hadoop dfs -put should support multiple src**
+* [HADOOP-2821](https://issues.apache.org/jira/browse/HADOOP-2821) | *Major* | **Remove deprecated classes in util**
-hadoop dfs -put accepts multiple sources when destination is a directory.
+The deprecated classes org.apache.hadoop.util.ShellUtil and org.apache.hadoop.util.ToolBase are removed.
---
-* [HADOOP-3073](https://issues.apache.org/jira/browse/HADOOP-3073) | *Blocker* | **SocketOutputStream.close() should close the channel.**
+* [HADOOP-2758](https://issues.apache.org/jira/browse/HADOOP-2758) | *Major* | **Reduce memory copies when data is read from DFS**
-SocketOutputStream.close() closes the underlying channel. Increase compatibility with java.net.Socket.getOutputStream. User Impact : none.
+DataNode takes 50% less CPU while serving data to clients.
---
-* [HADOOP-3060](https://issues.apache.org/jira/browse/HADOOP-3060) | *Major* | **MiniMRCluster is ignoring parameter taskTrackerFirst**
+* [HADOOP-771](https://issues.apache.org/jira/browse/HADOOP-771) | *Major* | **Namenode should return error when trying to delete non-empty directory**
-The parameter boolean taskTrackerFirst is removed from org.apache.hadoop.mapred.MiniMRCluster constructors.
-Thus signature of following APIs
- public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, boolean taskTrackerFirst, int numDir)
- public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, boolean taskTrackerFirst, int numDir, String[] racks)
- public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, boolean taskTrackerFirst, int numDir, String[] racks, String[] hosts)
- public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, boolean taskTrackerFirst, int numDir, String[] racks, String[] hosts, UnixUserGroupInformation ugi )
-is changed to
- public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, int numDir)
- public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, int numDir, String[] racks)
- public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, int numDir, String[] racks, String[] hosts)
- public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, int numDir, String[] racks, String[] hosts, UnixUserGroupInformation ugi )
-respectively.
-Since the old signatures were not deprecated, any code using the old constructors must be changed to use the new constructors.
+This patch adds a new api to file system i.e delete(path, boolean), deprecating the previous delete(path).
+the new api recursively deletes files only if boolean is set to true.
+If path is a file, the boolean value does not matter, if path is a directory and the directory is non empty delete(path, false) will throw an exception and delete(path, true) will delete all files recursively.
---
-* [HADOOP-3048](https://issues.apache.org/jira/browse/HADOOP-3048) | *Blocker* | **Stringifier**
+* [HADOOP-2765](https://issues.apache.org/jira/browse/HADOOP-2765) | *Major* | **setting memory limits for tasks**
- A new Interface and a default implementation to convert and restore serializations of objects to strings.
+This feature enables specifying ulimits for streaming/pipes tasks. Now pipes and streaming tasks have same virtual memory available as the java process which invokes them. Ulimit value will be the same as -Xmx value for java processes provided using mapred.child.java.opts.
---
-* [HADOOP-3041](https://issues.apache.org/jira/browse/HADOOP-3041) | *Blocker* | **Within a task, the value ofJobConf.getOutputPath() method is modified**
+* [HADOOP-2657](https://issues.apache.org/jira/browse/HADOOP-2657) | *Major* | **Enhancements to DFSClient to support flushing data at any point in time**
-1. Deprecates JobConf.setOutputPath and JobConf.getOutputPath
-JobConf.getOutputPath() still returns the same value that it used to return.
-2. Deprecates OutputFormatBase. Adds FileOutputFormat. Existing output formats extending OutputFormatBase, now extend FileOutputFormat.
-3. Adds the following APIs in FileOutputFormat :
-public static void setOutputPath(JobConf conf, Path outputDir); // sets mapred.output.dir
-public static Path getOutputPath(JobConf conf) ; // gets mapred.output.dir
-public static Path getWorkOutputPath(JobConf conf); // gets mapred.work.output.dir
-4. static void setWorkOutputPath(JobConf conf, Path outputDir) is also added to FileOutputFormat. This is used by the framework to set mapred.work.output.dir as task's temporary output dir .
+A new API DFSOututStream.flush() flushes all outstanding data to the pipeline of datanodes.
---
-* [HADOOP-3040](https://issues.apache.org/jira/browse/HADOOP-3040) | *Major* | **Streaming should assume an empty key if the first character on a line is the seperator (stream.map.output.field.separator, by default, tab)**
+* [HADOOP-2399](https://issues.apache.org/jira/browse/HADOOP-2399) | *Major* | **Input key and value to combiner and reducer should be reused**
-If the first character on a line is the separator, empty key is assumed, and the whole line is the value (due to a bug this was not the case).
+The key and value objects that are given to the Combiner and Reducer are now reused between calls. This is much more efficient, but the user can not assume the objects are constant.
---
-* [HADOOP-3001](https://issues.apache.org/jira/browse/HADOOP-3001) | *Blocker* | **FileSystems should track how many bytes are read and written**
+* [HADOOP-2423](https://issues.apache.org/jira/browse/HADOOP-2423) | *Major* | **The codes in FSDirectory.mkdirs(...) is inefficient.**
-Adds new framework map/reduce counters that track the number of bytes read and written to HDFS, local, KFS, and S3 file systems.
+Improved FSDirectory.mkdirs(...) performance. In NNThroughputBenchmark-create, the ops per sec in was improved ~54%.
---
-* [HADOOP-2982](https://issues.apache.org/jira/browse/HADOOP-2982) | *Blocker* | **[HOD] checknodes should look for free nodes without the jobs attribute**
+* [HADOOP-2470](https://issues.apache.org/jira/browse/HADOOP-2470) | *Major* | **Open and isDir should be removed from ClientProtocol**
-The number of free nodes in the cluster is computed using a better algorithm that filters out inconsistencies in node status as reported by Torque.
+Open and isDir were removed from ClientProtocol.
---
-* [HADOOP-2947](https://issues.apache.org/jira/browse/HADOOP-2947) | *Blocker* | **[HOD] Hod should redirect stderr and stdout of Hadoop daemons to assist debugging**
+* [HADOOP-2775](https://issues.apache.org/jira/browse/HADOOP-2775) | *Major* | **[HOD] Put in place unit test framework for HOD**
-The stdout and stderr streams of daemons are redirected to files that are created under the hadoop log directory. Users can now send kill 3 signals to the daemons to get stack traces and thread dumps for debugging.
+A unit testing framework based on pyunit is added to HOD. Developers contributing patches to HOD should now contribute unit tests along with the patches where possible.
---
-* [HADOOP-2899](https://issues.apache.org/jira/browse/HADOOP-2899) | *Major* | **[HOD] hdfs:///mapredsystem directory not cleaned up after deallocation**
+* [HADOOP-2825](https://issues.apache.org/jira/browse/HADOOP-2825) | *Major* | **MapOutputLocation.getFile() needs to be removed**
-The mapred system directory generated by HOD is cleaned up at cluster deallocation time.
+The deprecated method, public long org.apache.hadoop.mapred.MapOutputLocation.getFile(FileSystem fileSys, Path localFilename, int reduce, Progressable pingee, int timeout) is removed.
---
-* [HADOOP-2873](https://issues.apache.org/jira/browse/HADOOP-2873) | *Major* | **Namenode fails to re-start after cluster shutdown - DFSClient: Could not obtain blocks even all datanodes were up & live**
+* [HADOOP-2822](https://issues.apache.org/jira/browse/HADOOP-2822) | *Major* | **Remove deprecated classes in mapred**
-**WARNING: No release note provided for this incompatible change.**
+The deprecated classes org.apache.hadoop.mapred.InputFormatBase and org.apache.hadoop.mapred.PhasedFileSystem are removed.
---
-* [HADOOP-2855](https://issues.apache.org/jira/browse/HADOOP-2855) | *Blocker* | **[HOD] HOD fails to allocate a cluster if the tarball specified is a relative path**
+* [HADOOP-2559](https://issues.apache.org/jira/browse/HADOOP-2559) | *Major* | **DFS should place one replica per rack**
-Changes were made to handle relative paths correctly for important HOD options such as the cluster directory, tarball option, and script file.
+Change DFS block placement to allocate the first replica locally, the second off-rack, and the third intra-rack from the second.
---
-* [HADOOP-2854](https://issues.apache.org/jira/browse/HADOOP-2854) | *Blocker* | **Remove the deprecated ipc.Server.getUserInfo()**
+* [HADOOP-2239](https://issues.apache.org/jira/browse/HADOOP-2239) | *Major* | **Security: Need to be able to encrypt Hadoop socket connections**
-Removes deprecated method Server.getUserInfo()
+This patch adds a new FileSystem, HftpsFileSystem, that allows access to HDFS data over HTTPS.
---
-* [HADOOP-2839](https://issues.apache.org/jira/browse/HADOOP-2839) | *Blocker* | **Remove deprecated methods in FileSystem**
+* [HADOOP-2027](https://issues.apache.org/jira/browse/HADOOP-2027) | *Major* | **FileSystem should provide byte ranges for file locations**
-Removes deprecated API FileSystem#globPaths()
+New FileSystem API getFileBlockLocations to return the number of bytes in each block in a file via a single rpc to the namenode to speed up job planning. Deprecates getFileCacheHints.
---
-* [HADOOP-2831](https://issues.apache.org/jira/browse/HADOOP-2831) | *Blocker* | **Remove the deprecated INode.getAbsoluteName()**
+* [HADOOP-2899](https://issues.apache.org/jira/browse/HADOOP-2899) | *Major* | **[HOD] hdfs:///mapredsystem directory not cleaned up after deallocation**
-Removes deprecated method INode#getAbsoluteName()
+The mapred system directory generated by HOD is cleaned up at cluster deallocation time.
---
-* [HADOOP-2828](https://issues.apache.org/jira/browse/HADOOP-2828) | *Major* | **Remove deprecated methods in Configuration.java**
+* [HADOOP-2116](https://issues.apache.org/jira/browse/HADOOP-2116) | *Major* | **Job.local.dir to be exposed to tasks**
-The following deprecated methods in org.apache.hadoop.conf.Configuration are removed.
-public Object getObject(String name)
-public void setObject(String name, Object value)
-public Object get(String name, Object defaultValue)
-public void set(String name, Object value)
-and public Iterator entries()
+This issue restructures local job directory on the tasktracker.
+Users are provided with a job-specific shared directory (mapred-local/taskTracker/jobcache/$jobid/ work) for using it as scratch space, through configuration property and system property "job.local.dir". Now, the directory "../work" is not available from the task's cwd.
---
-* [HADOOP-2826](https://issues.apache.org/jira/browse/HADOOP-2826) | *Major* | **FileSplit.getFile(), LineRecordReader. readLine() need to be removed**
+* [HADOOP-2796](https://issues.apache.org/jira/browse/HADOOP-2796) | *Major* | **For script option hod should exit with distinguishable exit codes for script code and hod exit code.**
-The deprecated methods, public File org.apache.hadoop.mapred.FileSplit.getFile() and
- public static long org.apache.hadoop.mapred.LineRecordReader.readLine(InputStream in, OutputStream out)
-are removed.
-The constructor org.apache.hadoop.mapred.LineRecordReader.LineReader(InputStream in, Configuration conf) 's visibility is made public.
-The signature of the public org.apache.hadoop.streaming.UTF8ByteArrayUtils.readLIne(InputStream) method is changed to UTF8ByteArrayUtils.readLIne(LineReader, Text). Since the old signature is not deprecated, any code using the old method must be changed to use the new method.
+A provision to reliably detect a failing script's exit code was added. In case the hod script option returned a non-zero exit code, users can now look for a 'script.exitcode' file written to the HOD cluster directory. If this file is present, it means the script failed with the returned exit code.
---
-* [HADOOP-2825](https://issues.apache.org/jira/browse/HADOOP-2825) | *Major* | **MapOutputLocation.getFile() needs to be removed**
+* [HADOOP-2828](https://issues.apache.org/jira/browse/HADOOP-2828) | *Major* | **Remove deprecated methods in Configuration.java**
-The deprecated method, public long org.apache.hadoop.mapred.MapOutputLocation.getFile(FileSystem fileSys, Path localFilename, int reduce, Progressable pingee, int timeout) is removed.
+The following deprecated methods in org.apache.hadoop.conf.Configuration are removed.
+public Object getObject(String name)
+public void setObject(String name, Object value)
+public Object get(String name, Object defaultValue)
+public void set(String name, Object value)
+and public Iterator entries()
---
@@ -306,299 +302,303 @@ and public int getLine() are removed
---
-* [HADOOP-2822](https://issues.apache.org/jira/browse/HADOOP-2822) | *Major* | **Remove deprecated classes in mapred**
+* [HADOOP-3040](https://issues.apache.org/jira/browse/HADOOP-3040) | *Major* | **Streaming should assume an empty key if the first character on a line is the seperator (stream.map.output.field.separator, by default, tab)**
-The deprecated classes org.apache.hadoop.mapred.InputFormatBase and org.apache.hadoop.mapred.PhasedFileSystem are removed.
+If the first character on a line is the separator, empty key is assumed, and the whole line is the value (due to a bug this was not the case).
---
-* [HADOOP-2821](https://issues.apache.org/jira/browse/HADOOP-2821) | *Major* | **Remove deprecated classes in util**
-
-The deprecated classes org.apache.hadoop.util.ShellUtil and org.apache.hadoop.util.ToolBase are removed.
+* [HADOOP-1622](https://issues.apache.org/jira/browse/HADOOP-1622) | *Major* | **Hadoop should provide a way to allow the user to specify jar file(s) the user job depends on**
+This patch allows new command line options for
----
+hadoop jar
+which are
-* [HADOOP-2820](https://issues.apache.org/jira/browse/HADOOP-2820) | *Major* | **Remove deprecated classes in streaming**
+hadoop jar -files \<comma seperated list of files\> -libjars \<comma seperated list of jars\> -archives \<comma seperated list of archives\>
-The deprecated classes org.apache.hadoop.streaming.StreamLineRecordReader, org.apache.hadoop.streaming.StreamOutputFormat and org.apache.hadoop.streaming.StreamSequenceRecordReader are removed
+-files options allows you to speficy comma seperated list of path which would be present in your current working directory of your task
+-libjars option allows you to add jars to the classpaths of the maps and reduces.
+-archives allows you to pass archives as arguments that are unzipped/unjarred and a link with name of the jar/zip are created in the current working directory if tasks.
---
-* [HADOOP-2819](https://issues.apache.org/jira/browse/HADOOP-2819) | *Major* | **Remove deprecated methods in JobConf()**
-
-The following deprecated methods are removed from org.apache.hadoop.JobConf :
-public Class getInputKeyClass()
-public void setInputKeyClass(Class theClass)
-public Class getInputValueClass()
-public void setInputValueClass(Class theClass)
+* [HADOOP-2119](https://issues.apache.org/jira/browse/HADOOP-2119) | *Critical* | **JobTracker becomes non-responsive if the task trackers finish task too fast**
-The methods, public boolean org.apache.hadoop.JobConf.getSpeculativeExecution() and
-public void org.apache.hadoop.JobConf.setSpeculativeExecution(boolean speculativeExecution) are undeprecated.
+This removes many inefficiencies in task placement and scheduling logic. The JobTracker would perform linear scans of the list of submitted tasks in cases where it did not find an obvious candidate task for a node. With better data structures for managing job state, all task placement operations now run in constant time (in most cases). Also, the task output promotions are batched.
---
-* [HADOOP-2818](https://issues.apache.org/jira/browse/HADOOP-2818) | *Major* | **Remove deprecated Counters.getDisplayName(), getCounterNames(), getCounter(String counterName)**
+* [HADOOP-3091](https://issues.apache.org/jira/browse/HADOOP-3091) | *Major* | **hadoop dfs -put should support multiple src**
-The deprecated methods public String org.apache.hadoop.mapred.Counters.getDisplayName(String counter) and
-public synchronized Collection\<String\> org.apache.hadoop.mapred.Counters.getCounterNames() are removed.
-The deprecated method public synchronized long org.apache.hadoop.mapred.Counters.getCounter(String counterName) is undeprecated.
+hadoop dfs -put accepts multiple sources when destination is a directory.
---
-* [HADOOP-2817](https://issues.apache.org/jira/browse/HADOOP-2817) | *Major* | **Remove deprecated mapred.tasktracker.tasks.maximum and clusterStatus.getMaxTasks()**
+* [HADOOP-3073](https://issues.apache.org/jira/browse/HADOOP-3073) | *Blocker* | **SocketOutputStream.close() should close the channel.**
-The deprecated method public int org.apache.hadoop.mapred.ClusterStatus.getMaxTasks() is removed.
-The deprecated configuration property "mapred.tasktracker.tasks.maximum" is removed.
+SocketOutputStream.close() closes the underlying channel. Increase compatibility with java.net.Socket.getOutputStream. User Impact : none.
---
-* [HADOOP-2796](https://issues.apache.org/jira/browse/HADOOP-2796) | *Major* | **For script option hod should exit with distinguishable exit codes for script code and hod exit code.**
+* [HADOOP-2982](https://issues.apache.org/jira/browse/HADOOP-2982) | *Blocker* | **[HOD] checknodes should look for free nodes without the jobs attribute**
-A provision to reliably detect a failing script's exit code was added. In case the hod script option returned a non-zero exit code, users can now look for a 'script.exitcode' file written to the HOD cluster directory. If this file is present, it means the script failed with the returned exit code.
+The number of free nodes in the cluster is computed using a better algorithm that filters out inconsistencies in node status as reported by Torque.
---
-* [HADOOP-2775](https://issues.apache.org/jira/browse/HADOOP-2775) | *Major* | **[HOD] Put in place unit test framework for HOD**
+* [HADOOP-3060](https://issues.apache.org/jira/browse/HADOOP-3060) | *Major* | **MiniMRCluster is ignoring parameter taskTrackerFirst**
-A unit testing framework based on pyunit is added to HOD. Developers contributing patches to HOD should now contribute unit tests along with the patches where possible.
+The parameter boolean taskTrackerFirst is removed from org.apache.hadoop.mapred.MiniMRCluster constructors.
+Thus signature of following APIs
+ public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, boolean taskTrackerFirst, int numDir)
+ public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, boolean taskTrackerFirst, int numDir, String[] racks)
+ public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, boolean taskTrackerFirst, int numDir, String[] racks, String[] hosts)
+ public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, boolean taskTrackerFirst, int numDir, String[] racks, String[] hosts, UnixUserGroupInformation ugi )
+is changed to
+ public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, int numDir)
+ public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, int numDir, String[] racks)
+ public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, int numDir, String[] racks, String[] hosts)
+ public MiniMRCluster(int jobTrackerPort, int taskTrackerPort, int numTaskTrackers, String namenode, int numDir, String[] racks, String[] hosts, UnixUserGroupInformation ugi )
+respectively.
+Since the old signatures were not deprecated, any code using the old constructors must be changed to use the new constructors.
---
-* [HADOOP-2765](https://issues.apache.org/jira/browse/HADOOP-2765) | *Major* | **setting memory limits for tasks**
+* [HADOOP-2055](https://issues.apache.org/jira/browse/HADOOP-2055) | *Minor* | **JobConf should have a setInputPathFilter method**
-This feature enables specifying ulimits for streaming/pipes tasks. Now pipes and streaming tasks have same virtual memory available as the java process which invokes them. Ulimit value will be the same as -Xmx value for java processes provided using mapred.child.java.opts.
+This issue provides users the ability to specify what paths to ignore for processing in the job input directory (apart from the filenames that start with "\_" and "."). Defines two new APIs - FileInputFormat.setInputPathFilter(JobConf, PathFilter), and, FileInputFormat.getInputPathFilter(JobConf).
---
-* [HADOOP-2758](https://issues.apache.org/jira/browse/HADOOP-2758) | *Major* | **Reduce memory copies when data is read from DFS**
+* [HADOOP-2854](https://issues.apache.org/jira/browse/HADOOP-2854) | *Blocker* | **Remove the deprecated ipc.Server.getUserInfo()**
-DataNode takes 50% less CPU while serving data to clients.
+Removes deprecated method Server.getUserInfo()
---
-* [HADOOP-2657](https://issues.apache.org/jira/browse/HADOOP-2657) | *Major* | **Enhancements to DFSClient to support flushing data at any point in time**
+* [HADOOP-2563](https://issues.apache.org/jira/browse/HADOOP-2563) | *Blocker* | **Remove deprecated FileSystem#listPaths()**
-A new API DFSOututStream.flush() flushes all outstanding data to the pipeline of datanodes.
+Removes deprecated method FileSystem#listPaths()
---
-* [HADOOP-2634](https://issues.apache.org/jira/browse/HADOOP-2634) | *Blocker* | **Deprecate exists() and isDir() to simplify ClientProtocol.**
+* [HADOOP-2855](https://issues.apache.org/jira/browse/HADOOP-2855) | *Blocker* | **[HOD] HOD fails to allocate a cluster if the tarball specified is a relative path**
-Deprecates exists() from ClientProtocol
+Changes were made to handle relative paths correctly for important HOD options such as the cluster directory, tarball option, and script file.
---
-* [HADOOP-2563](https://issues.apache.org/jira/browse/HADOOP-2563) | *Blocker* | **Remove deprecated FileSystem#listPaths()**
+* [HADOOP-2818](https://issues.apache.org/jira/browse/HADOOP-2818) | *Major* | **Remove deprecated Counters.getDisplayName(), getCounterNames(), getCounter(String counterName)**
-Removes deprecated method FileSystem#listPaths()
+The deprecated methods public String org.apache.hadoop.mapred.Counters.getDisplayName(String counter) and
+public synchronized Collection\<String\> org.apache.hadoop.mapred.Counters.getCounterNames() are removed.
+The deprecated method public synchronized long org.apache.hadoop.mapred.Counters.getCounter(String counterName) is undeprecated.
---
-* [HADOOP-2559](https://issues.apache.org/jira/browse/HADOOP-2559) | *Major* | **DFS should place one replica per rack**
+* [HADOOP-2831](https://issues.apache.org/jira/browse/HADOOP-2831) | *Blocker* | **Remove the deprecated INode.getAbsoluteName()**
-Change DFS block placement to allocate the first replica locally, the second off-rack, and the third intra-rack from the second.
+Removes deprecated method INode#getAbsoluteName()
---
-* [HADOOP-2551](https://issues.apache.org/jira/browse/HADOOP-2551) | *Blocker* | **hadoop-env.sh needs finer granularity**
+* [HADOOP-2947](https://issues.apache.org/jira/browse/HADOOP-2947) | *Blocker* | **[HOD] Hod should redirect stderr and stdout of Hadoop daemons to assist debugging**
-New environment variables were introduced to allow finer grained control of Java options passed to server and client JVMs. See the new \*\_OPTS variables in conf/hadoop-env.sh.
+The stdout and stderr streams of daemons are redirected to files that are created under the hadoop log directory. Users can now send kill 3 signals to the daemons to get stack traces and thread dumps for debugging.
---
-* [HADOOP-2470](https://issues.apache.org/jira/browse/HADOOP-2470) | *Major* | **Open and isDir should be removed from ClientProtocol**
+* [HADOOP-3137](https://issues.apache.org/jira/browse/HADOOP-3137) | *Major* | **[HOD] Update hod version number**
-Open and isDir were removed from ClientProtocol.
+Build script was changed to make HOD versions follow Hadoop version numbers. As a result of this change, the next version of HOD would not be 0.5, but would be synchronized to the Hadoop version number. Users who rely on the version number of HOD should note the unexpected jump in version numbers.
---
-* [HADOOP-2423](https://issues.apache.org/jira/browse/HADOOP-2423) | *Major* | **The codes in FSDirectory.mkdirs(...) is inefficient.**
+* [HADOOP-3093](https://issues.apache.org/jira/browse/HADOOP-3093) | *Major* | **ma/reduce throws the following exception if "io.serializations" is not set:**
-Improved FSDirectory.mkdirs(...) performance. In NNThroughputBenchmark-create, the ops per sec in was improved ~54%.
+The following public APIs are added in org.apache.hadoop.conf.Configuration
+ String[] Configuration.getStrings(String name, String... defaultValue) and
+ void Configuration.setStrings(String name, String... values)
---
-* [HADOOP-2410](https://issues.apache.org/jira/browse/HADOOP-2410) | *Major* | **Make EC2 cluster nodes more independent of each other**
+* [HADOOP-2839](https://issues.apache.org/jira/browse/HADOOP-2839) | *Blocker* | **Remove deprecated methods in FileSystem**
-The command "hadoop-ec2 run" has been replaced by "hadoop-ec2 launch-cluster \<group\> \<number of instances\>", and "hadoop-ec2 start-hadoop" has been removed since Hadoop is started on instance start up. See http://wiki.apache.org/hadoop/AmazonEC2 for details.
+Removes deprecated API FileSystem#globPaths()
---
-* [HADOOP-2399](https://issues.apache.org/jira/browse/HADOOP-2399) | *Major* | **Input key and value to combiner and reducer should be reused**
+* [HADOOP-2551](https://issues.apache.org/jira/browse/HADOOP-2551) | *Blocker* | **hadoop-env.sh needs finer granularity**
-The key and value objects that are given to the Combiner and Reducer are now reused between calls. This is much more efficient, but the user can not assume the objects are constant.
+New environment variables were introduced to allow finer grained control of Java options passed to server and client JVMs. See the new \*\_OPTS variables in conf/hadoop-env.sh.
---
-* [HADOOP-2345](https://issues.apache.org/jira/browse/HADOOP-2345) | *Major* | **new transactions to support HDFS Appends**
+* [HADOOP-2634](https://issues.apache.org/jira/browse/HADOOP-2634) | *Blocker* | **Deprecate exists() and isDir() to simplify ClientProtocol.**
-Introduce new namenode transactions to support appending to HDFS files.
+Deprecates exists() from ClientProtocol
---
-* [HADOOP-2239](https://issues.apache.org/jira/browse/HADOOP-2239) | *Major* | **Security: Need to be able to encrypt Hadoop socket connections**
+* [HADOOP-3099](https://issues.apache.org/jira/browse/HADOOP-3099) | *Blocker* | **Need new options in distcp for preserving ower, group and permission**
-This patch adds a new FileSystem, HftpsFileSystem, that allows access to HDFS data over HTTPS.
+Added a new option -p to distcp for preserving file/directory status.
+-p[rbugp] Preserve status
+ r: replication number
+ b: block size
+ u: user
+ g: group
+ p: permission
+ -p alone is equivalent to -prbugp
---
-* [HADOOP-2219](https://issues.apache.org/jira/browse/HADOOP-2219) | *Major* | **du like command to count number of files under a given directory**
-
-Added a new fs command fs -count for counting the number of bytes, files and directories under a given path.
+* [HADOOP-3001](https://issues.apache.org/jira/browse/HADOOP-3001) | *Blocker* | **FileSystems should track how many bytes are read and written**
-Added a new RPC getContentSummary(String path) to ClientProtocol.
+Adds new framework map/reduce counters that track the number of bytes read and written to HDFS, local, KFS, and S3 file systems.
---
-* [HADOOP-2192](https://issues.apache.org/jira/browse/HADOOP-2192) | *Major* | **dfs mv command differs from POSIX standards**
+* [HADOOP-3048](https://issues.apache.org/jira/browse/HADOOP-3048) | *Blocker* | **Stringifier**
-this patch makes dfs -mv more like linux mv command getting rid of unnecessary output in dfs -mv and returns an error message when moving non existent files/directories --- mv: cannot stat "filename": No such file or directory.
+ A new Interface and a default implementation to convert and restore serializations of objects to strings.
---
-* [HADOOP-2178](https://issues.apache.org/jira/browse/HADOOP-2178) | *Major* | **Job history on HDFS**
+* [HADOOP-2410](https://issues.apache.org/jira/browse/HADOOP-2410) | *Major* | **Make EC2 cluster nodes more independent of each other**
-This feature provides facility to store job history on DFS. Now cluster admin can provide either localFS location or DFS location using configuration property "mapred.job.history.location" to store job histroy. History will be logged in user specified location also. User can specify history location using configuration property "mapred.job.history.user.location" .
-The classes org.apache.hadoop.mapred.DefaultJobHistoryParser.MasterIndex and org.apache.hadoop.mapred.DefaultJobHistoryParser.MasterIndexParseListener, and public method org.apache.hadoop.mapred.DefaultJobHistoryParser.parseMasterIndex are not available.
-The signature of public method org.apache.hadoop.mapred.DefaultJobHistoryParser.parseJobTasks(File jobHistoryFile, JobHistory.JobInfo job) is changed to DefaultJobHistoryParser.parseJobTasks(String jobHistoryFile, JobHistory.JobInfo job, FileSystem fs).
-The signature of public method org.apache.hadoop.mapred.JobHistory.parseHistory(File path, Listener l) is changed to JobHistory.parseHistoryFromFS(String path, Listener l, FileSystem fs)
+The command "hadoop-ec2 run" has been replaced by "hadoop-ec2 launch-cluster \<group\> \<number of instances\>", and "hadoop-ec2 start-hadoop" has been removed since Hadoop is started on instance start up. See http://wiki.apache.org/hadoop/AmazonEC2 for details.
---
-* [HADOOP-2119](https://issues.apache.org/jira/browse/HADOOP-2119) | *Critical* | **JobTracker becomes non-responsive if the task trackers finish task too fast**
+* [HADOOP-2826](https://issues.apache.org/jira/browse/HADOOP-2826) | *Major* | **FileSplit.getFile(), LineRecordReader. readLine() need to be removed**
-This removes many inefficiencies in task placement and scheduling logic. The JobTracker would perform linear scans of the list of submitted tasks in cases where it did not find an obvious candidate task for a node. With better data structures for managing job state, all task placement operations now run in constant time (in most cases). Also, the task output promotions are batched.
+The deprecated methods, public File org.apache.hadoop.mapred.FileSplit.getFile() and
+ public static long org.apache.hadoop.mapred.LineRecordReader.readLine(InputStream in, OutputStream out)
+are removed.
+The constructor org.apache.hadoop.mapred.LineRecordReader.LineReader(InputStream in, Configuration conf) 's visibility is made public.
+The signature of the public org.apache.hadoop.streaming.UTF8ByteArrayUtils.readLIne(InputStream) method is changed to UTF8ByteArrayUtils.readLIne(LineReader, Text). Since the old signature is not deprecated, any code using the old method must be changed to use the new method.
---
-* [HADOOP-2116](https://issues.apache.org/jira/browse/HADOOP-2116) | *Major* | **Job.local.dir to be exposed to tasks**
+* [HADOOP-3140](https://issues.apache.org/jira/browse/HADOOP-3140) | *Major* | **JobTracker should not try to promote a (map) task if it does not write to DFS at all**
-This issue restructures local job directory on the tasktracker.
-Users are provided with a job-specific shared directory (mapred-local/taskTracker/jobcache/$jobid/ work) for using it as scratch space, through configuration property and system property "job.local.dir". Now, the directory "../work" is not available from the task's cwd.
+Tasks that don't generate any output are not inserted in the commit queue of the JobTracker. They are marked as SUCCESSFUL by the TaskTracker and the JobTracker updates their state short-circuiting the commit queue.
---
-* [HADOOP-2063](https://issues.apache.org/jira/browse/HADOOP-2063) | *Blocker* | **Command to pull corrupted files**
+* [HADOOP-3041](https://issues.apache.org/jira/browse/HADOOP-3041) | *Blocker* | **Within a task, the value ofJobConf.getOutputPath() method is modified**
-Added a new option -ignoreCrc to fs -get, or equivalently, fs -copyToLocal, such that crc checksum will be ignored for the command. The use of this option is to download the corrupted files.
+1. Deprecates JobConf.setOutputPath and JobConf.getOutputPath
+JobConf.getOutputPath() still returns the same value that it used to return.
+2. Deprecates OutputFormatBase. Adds FileOutputFormat. Existing output formats extending OutputFormatBase, now extend FileOutputFormat.
+3. Adds the following APIs in FileOutputFormat :
+public static void setOutputPath(JobConf conf, Path outputDir); // sets mapred.output.dir
+public static Path getOutputPath(JobConf conf) ; // gets mapred.output.dir
+public static Path getWorkOutputPath(JobConf conf); // gets mapred.work.output.dir
+4. static void setWorkOutputPath(JobConf conf, Path outputDir) is also added to FileOutputFormat. This is used by the framework to set mapred.work.output.dir as task's temporary output dir .
---
-* [HADOOP-2055](https://issues.apache.org/jira/browse/HADOOP-2055) | *Minor* | **JobConf should have a setInputPathFilter method**
+* [HADOOP-3168](https://issues.apache.org/jira/browse/HADOOP-3168) | *Major* | **reduce amount of logging in hadoop streaming**
-This issue provides users the ability to specify what paths to ignore for processing in the job input directory (apart from the filenames that start with "\_" and "."). Defines two new APIs - FileInputFormat.setInputPathFilter(JobConf, PathFilter), and, FileInputFormat.getInputPathFilter(JobConf).
+Decreases the frequency of logging from streaming from every 100 records to every 10,000 records.
---
-* [HADOOP-2027](https://issues.apache.org/jira/browse/HADOOP-2027) | *Major* | **FileSystem should provide byte ranges for file locations**
+* [HADOOP-3152](https://issues.apache.org/jira/browse/HADOOP-3152) | *Minor* | **Make index interval configuable when using MapFileOutputFormat for map-reduce job**
-New FileSystem API getFileBlockLocations to return the number of bytes in each block in a file via a single rpc to the namenode to speed up job planning. Deprecates getFileCacheHints.
+Add a static method MapFile#setIndexInterval(Configuration, int interval) so that MapReduce jobs that use MapFileOutputFormat can set the index interval.
---
-* [HADOOP-1986](https://issues.apache.org/jira/browse/HADOOP-1986) | *Major* | **Add support for a general serialization mechanism for Map Reduce**
+* [HADOOP-3223](https://issues.apache.org/jira/browse/HADOOP-3223) | *Blocker* | **Hadoop dfs -help for permissions contains a typo**
-Programs that implement the raw Mapper or Reducer interfaces will need modification to compile with this release. For example,
+Minor typo fix in help message for chmod. impact : none.
-class MyMapper implements Mapper {
- public void map(WritableComparable key, Writable val,
- OutputCollector out, Reporter reporter) throws IOException {
- // ...
- }
- // ...
-}
-will need to be changed to refer to the parameterized type. For example:
+---
-class MyMapper implements Mapper\<WritableComparable, Writable, WritableComparable, Writable\> {
- public void map(WritableComparable key, Writable val,
- OutputCollector\<WritableComparable, Writable\> out, Reporter reporter) throws IOException {
- // ...
- }
- // ...
-}
+* [HADOOP-3204](https://issues.apache.org/jira/browse/HADOOP-3204) | *Blocker* | **LocalFSMerger needs to catch throwable**
-Similarly implementations of the following raw interfaces will need modification: InputFormat, OutputCollector, OutputFormat, Partitioner, RecordReader, RecordWriter
+Fixes LocalFSMerger in ReduceTask.java to handle errors/exceptions better. Prior to this all exceptions except IOException would be silently ignored.
---
-* [HADOOP-1985](https://issues.apache.org/jira/browse/HADOOP-1985) | *Major* | **Abstract node to switch mapping into a topology service class used by namenode and jobtracker**
+* [HADOOP-3239](https://issues.apache.org/jira/browse/HADOOP-3239) | *Major* | **exists() calls logs FileNotFoundException in namenode log**
-This issue introduces rack awareness for map tasks. It also moves the rack resolution logic to the central servers - NameNode & JobTracker. The administrator can specify a loadable class given by topology.node.switch.mapping.impl to specify the class implementing the logic for rack resolution. The class must implement a method - resolve(List\<String\> names), where names is the list of DNS-names/IP-addresses that we want resolved. The return value is a list of resolved network paths of the form /foo/rack, where rack is the rackID where the node belongs to and foo is the switch where multiple racks are connected, and so on. The default implementation of this class is packaged along with hadoop and points to org.apache.hadoop.net.ScriptBasedMapping and this class loads a script that can be used for rack resolution. The script location is configurable. It is specified by topology.script.file.name and defaults to an empty script. In the case where the script name is empty, /default-rack
is returned for all dns-names/IP-addresses. The loadable topology.node.switch.mapping.impl provides administrators fleixibilty to define how their site's node resolution should happen.
-For mapred, one can also specify the level of the cache w.r.t the number of levels in the resolved network path - defaults to two. This means that the JobTracker will cache tasks at the host level and at the rack level.
-Known issue: the task caching will not work with levels greater than 2 (beyond racks). This bug is tracked in HADOOP-3296.
+getFileInfo returns null for File not found instead of throwing FileNotFoundException
---
-* [HADOOP-1622](https://issues.apache.org/jira/browse/HADOOP-1622) | *Major* | **Hadoop should provide a way to allow the user to specify jar file(s) the user job depends on**
+* [HADOOP-3162](https://issues.apache.org/jira/browse/HADOOP-3162) | *Blocker* | **Map/reduce stops working with comma separated input paths**
+
+The public methods org.apache.hadoop.mapred.JobConf.setInputPath(Path) and org.apache.hadoop.mapred.JobConf.addInputPath(Path) are deprecated. And the methods have the semantics of branch 0.16.
+The following public APIs are added in org.apache.hadoop.mapred.FileInputFormat :
+public static void setInputPaths(JobConf job, Path... paths);
+public static void setInputPaths(JobConf job, String commaSeparatedPaths);
+public static void addInputPath(JobConf job, Path path);
+public static void addInputPaths(JobConf job, String commaSeparatedPaths);
+Earlier code calling JobConf.setInputPath(Path), JobConf.addInputPath(Path) should now call FileInputFormat.setInputPaths(JobConf, Path...) and FileInputFormat.addInputPath(Path) respectively
-This patch allows new command line options for
-hadoop jar
-which are
+---
-hadoop jar -files \<comma seperated list of files\> -libjars \<comma seperated list of jars\> -archives \<comma seperated list of archives\>
+* [HADOOP-3124](https://issues.apache.org/jira/browse/HADOOP-3124) | *Major* | **DFS data node should not use hard coded 10 minutes as write timeout.**
--files options allows you to speficy comma seperated list of path which would be present in your current working directory of your task
--libjars option allows you to add jars to the classpaths of the maps and reduces.
--archives allows you to pass archives as arguments that are unzipped/unjarred and a link with name of the jar/zip are created in the current working directory if tasks.
+Makes DataNode socket write timeout configurable. User impact : none.
---
-* [HADOOP-1593](https://issues.apache.org/jira/browse/HADOOP-1593) | *Major* | **FsShell should work with paths in non-default FileSystem**
-
-This bug allows non default path to specifeid in fsshell commands.
+* [HADOOP-3266](https://issues.apache.org/jira/browse/HADOOP-3266) | *Major* | **Remove HOD changes from CHANGES.txt, as they are now inside src/contrib/hod**
-So, you can now specify hadoop dfs -ls hdfs://remotehost1:port/path
- and hadoop dfs -ls hdfs://remotehost2:port/path without changing the config.
+Moved HOD change items from CHANGES.txt to a new file src/contrib/hod/CHANGES.txt.
---
-* [HADOOP-910](https://issues.apache.org/jira/browse/HADOOP-910) | *Major* | **Reduces can do merges for the on-disk map output files in parallel with their copying**
+* [HADOOP-3280](https://issues.apache.org/jira/browse/HADOOP-3280) | *Blocker* | **virtual address space limits break streaming apps**
-Reducers now perform merges of shuffle data (both in-memory and on disk) while fetching map outputs. Earlier, during shuffle they used to merge only the in-memory outputs.
+This patch adds the mapred.child.ulimit to limit the virtual memory for children processes to the given value.
---
-* [HADOOP-771](https://issues.apache.org/jira/browse/HADOOP-771) | *Major* | **Namenode should return error when trying to delete non-empty directory**
+* [HADOOP-3382](https://issues.apache.org/jira/browse/HADOOP-3382) | *Blocker* | **Memory leak when files are not cleanly closed**
-This patch adds a new api to file system i.e delete(path, boolean), deprecating the previous delete(path).
-the new api recursively deletes files only if boolean is set to true.
-If path is a file, the boolean value does not matter, if path is a directory and the directory is non empty delete(path, false) will throw an exception and delete(path, true) will delete all files recursively.
+Fixed a memory leak associated with 'abandoned' files (i.e. not cleanly closed). This held up significant amounts of memory depending on activity and how long NameNode has been running.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.1/CHANGES.0.17.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.1/CHANGES.0.17.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.1/CHANGES.0.17.1.md
index f69eb78..b372c5d 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.1/CHANGES.0.17.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.1/CHANGES.0.17.1.md
@@ -27,54 +27,18 @@
| [HADOOP-3565](https://issues.apache.org/jira/browse/HADOOP-3565) | JavaSerialization can throw java.io.StreamCorruptedException | Major | . | Tom White | Tom White |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-3550](https://issues.apache.org/jira/browse/HADOOP-3550) | Reduce tasks failing with OOM | Blocker | . | Arun C Murthy | Chris Douglas |
-| [HADOOP-3526](https://issues.apache.org/jira/browse/HADOOP-3526) | contrib/data\_join doesn't work | Blocker | . | Spyros Blanas | Spyros Blanas |
-| [HADOOP-3522](https://issues.apache.org/jira/browse/HADOOP-3522) | ValuesIterator.next() doesn't return a new object, thus failing many equals() tests. | Major | . | Spyros Blanas | Owen O'Malley |
-| [HADOOP-3477](https://issues.apache.org/jira/browse/HADOOP-3477) | release tar.gz contains duplicate files | Major | build | Adam Heath | Adam Heath |
-| [HADOOP-3475](https://issues.apache.org/jira/browse/HADOOP-3475) | MapOutputBuffer allocates 4x as much space to record capacity as intended | Major | . | Chris Douglas | Chris Douglas |
+| [HADOOP-2159](https://issues.apache.org/jira/browse/HADOOP-2159) | Namenode stuck in safemode | Major | . | Christian Kunz | Hairong Kuang |
| [HADOOP-3472](https://issues.apache.org/jira/browse/HADOOP-3472) | MapFile.Reader getClosest() function returns incorrect results when before is true | Major | io | Todd Lipcon | stack |
| [HADOOP-3442](https://issues.apache.org/jira/browse/HADOOP-3442) | QuickSort may get into unbounded recursion | Blocker | . | Runping Qi | Chris Douglas |
-| [HADOOP-2159](https://issues.apache.org/jira/browse/HADOOP-2159) | Namenode stuck in safemode | Major | . | Christian Kunz | Hairong Kuang |
+| [HADOOP-3477](https://issues.apache.org/jira/browse/HADOOP-3477) | release tar.gz contains duplicate files | Major | build | Adam Heath | Adam Heath |
+| [HADOOP-3475](https://issues.apache.org/jira/browse/HADOOP-3475) | MapOutputBuffer allocates 4x as much space to record capacity as intended | Major | . | Chris Douglas | Chris Douglas |
+| [HADOOP-3522](https://issues.apache.org/jira/browse/HADOOP-3522) | ValuesIterator.next() doesn't return a new object, thus failing many equals() tests. | Major | . | Spyros Blanas | Owen O'Malley |
+| [HADOOP-3550](https://issues.apache.org/jira/browse/HADOOP-3550) | Reduce tasks failing with OOM | Blocker | . | Arun C Murthy | Chris Douglas |
+| [HADOOP-3526](https://issues.apache.org/jira/browse/HADOOP-3526) | contrib/data\_join doesn't work | Blocker | . | Spyros Blanas | Spyros Blanas |
| [HADOOP-1979](https://issues.apache.org/jira/browse/HADOOP-1979) | fsck on namenode without datanodes takes too much time | Minor | . | Koji Noguchi | Lohit Vijayarenu |
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.2/CHANGES.0.17.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.2/CHANGES.0.17.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.2/CHANGES.0.17.2.md
index db3eac4..629976c 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.2/CHANGES.0.17.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.2/CHANGES.0.17.2.md
@@ -20,64 +20,24 @@
## Release 0.17.2 - 2008-08-11
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-4773](https://issues.apache.org/jira/browse/HADOOP-4773) | namenode startup error, hadoop-user-namenode.pid permission denied. | Critical | . | Focus | |
-| [HADOOP-3931](https://issues.apache.org/jira/browse/HADOOP-3931) | Bug in MapTask.MapOutputBuffer.collect leads to an unnecessary and harmful 'reset' | Blocker | . | Arun C Murthy | Chris Douglas |
-| [HADOOP-3859](https://issues.apache.org/jira/browse/HADOOP-3859) | 1000 concurrent read on a single file failing the task/client | Blocker | . | Koji Noguchi | Johan Oskarsson |
-| [HADOOP-3813](https://issues.apache.org/jira/browse/HADOOP-3813) | RPC queue overload of JobTracker | Major | . | Christian Kunz | Amareshwari Sriramadasu |
-| [HADOOP-3760](https://issues.apache.org/jira/browse/HADOOP-3760) | DFS operations fail because of Stream closed error | Blocker | . | Amar Kamat | Lohit Vijayarenu |
+| [HADOOP-3370](https://issues.apache.org/jira/browse/HADOOP-3370) | failed tasks may stay forever in TaskTracker.runningJobs | Critical | . | Zheng Shao | Zheng Shao |
+| [HADOOP-3633](https://issues.apache.org/jira/browse/HADOOP-3633) | Uncaught exception in DataXceiveServer | Blocker | . | Koji Noguchi | Konstantin Shvachko |
+| [HADOOP-3681](https://issues.apache.org/jira/browse/HADOOP-3681) | Infinite loop in dfs close | Blocker | . | Koji Noguchi | Lohit Vijayarenu |
+| [HADOOP-3002](https://issues.apache.org/jira/browse/HADOOP-3002) | HDFS should not remove blocks while in safemode. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-3685](https://issues.apache.org/jira/browse/HADOOP-3685) | Unbalanced replication target | Blocker | . | Koji Noguchi | Hairong Kuang |
| [HADOOP-3758](https://issues.apache.org/jira/browse/HADOOP-3758) | Excessive exceptions in HDFS namenode log file | Blocker | . | Jim Huang | Lohit Vijayarenu |
+| [HADOOP-3760](https://issues.apache.org/jira/browse/HADOOP-3760) | DFS operations fail because of Stream closed error | Blocker | . | Amar Kamat | Lohit Vijayarenu |
| [HADOOP-3707](https://issues.apache.org/jira/browse/HADOOP-3707) | Frequent DiskOutOfSpaceException on almost-full datanodes | Blocker | . | Koji Noguchi | Raghu Angadi |
-| [HADOOP-3685](https://issues.apache.org/jira/browse/HADOOP-3685) | Unbalanced replication target | Blocker | . | Koji Noguchi | Hairong Kuang |
-| [HADOOP-3681](https://issues.apache.org/jira/browse/HADOOP-3681) | Infinite loop in dfs close | Blocker | . | Koji Noguchi | Lohit Vijayarenu |
| [HADOOP-3678](https://issues.apache.org/jira/browse/HADOOP-3678) | Avoid spurious "DataXceiver: java.io.IOException: Connection reset by peer" errors in DataNode log | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-3633](https://issues.apache.org/jira/browse/HADOOP-3633) | Uncaught exception in DataXceiveServer | Blocker | . | Koji Noguchi | Konstantin Shvachko |
-| [HADOOP-3370](https://issues.apache.org/jira/browse/HADOOP-3370) | failed tasks may stay forever in TaskTracker.runningJobs | Critical | . | Zheng Shao | Zheng Shao |
-| [HADOOP-3002](https://issues.apache.org/jira/browse/HADOOP-3002) | HDFS should not remove blocks while in safemode. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-3813](https://issues.apache.org/jira/browse/HADOOP-3813) | RPC queue overload of JobTracker | Major | . | Christian Kunz | Amareshwari Sriramadasu |
+| [HADOOP-3859](https://issues.apache.org/jira/browse/HADOOP-3859) | 1000 concurrent read on a single file failing the task/client | Blocker | . | Koji Noguchi | Johan Oskarsson |
+| [HADOOP-3931](https://issues.apache.org/jira/browse/HADOOP-3931) | Bug in MapTask.MapOutputBuffer.collect leads to an unnecessary and harmful 'reset' | Blocker | . | Arun C Murthy | Chris Douglas |
+| [HADOOP-4773](https://issues.apache.org/jira/browse/HADOOP-4773) | namenode startup error, hadoop-user-namenode.pid permission denied. | Critical | . | Focus | |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.2/RELEASENOTES.0.17.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.2/RELEASENOTES.0.17.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.2/RELEASENOTES.0.17.2.md
index 27e4924..ca7c081 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.2/RELEASENOTES.0.17.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.2/RELEASENOTES.0.17.2.md
@@ -23,13 +23,6 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-3859](https://issues.apache.org/jira/browse/HADOOP-3859) | *Blocker* | **1000 concurrent read on a single file failing the task/client**
-
-Allows the user to change the maximum number of xceivers in the datanode.
-
-
----
-
* [HADOOP-3760](https://issues.apache.org/jira/browse/HADOOP-3760) | *Blocker* | **DFS operations fail because of Stream closed error**
Fix a bug with HDFS file close() mistakenly introduced by HADOOP-3681.
@@ -49,4 +42,9 @@ NameNode keeps a count of number of blocks scheduled to be written to a datanode
Avoid spurious exceptions logged at DataNode when clients read from DFS.
+---
+
+* [HADOOP-3859](https://issues.apache.org/jira/browse/HADOOP-3859) | *Blocker* | **1000 concurrent read on a single file failing the task/client**
+
+Allows the user to change the maximum number of xceivers in the datanode.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.3/CHANGES.0.17.3.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.3/CHANGES.0.17.3.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.3/CHANGES.0.17.3.md
index 4b7b7b1..5a97d7c 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.3/CHANGES.0.17.3.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.17.3/CHANGES.0.17.3.md
@@ -18,55 +18,21 @@
-->
# Apache Hadoop Changelog
-## Release 0.17.3 - Unreleased (as of 2016-03-04)
+## Release 0.17.3 - Unreleased (as of 2017-08-28)
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-4326](https://issues.apache.org/jira/browse/HADOOP-4326) | ChecksumFileSystem does not override all create(...) methods | Blocker | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4318](https://issues.apache.org/jira/browse/HADOOP-4318) | distcp fails | Blocker | . | Christian Kunz | Tsz Wo Nicholas Sze |
| [HADOOP-4277](https://issues.apache.org/jira/browse/HADOOP-4277) | Checksum verification is disabled for LocalFS | Blocker | . | Raghu Angadi | Raghu Angadi |
| [HADOOP-4271](https://issues.apache.org/jira/browse/HADOOP-4271) | Bug in FSInputChecker makes it possible to read from an invalid buffer | Blocker | fs | Ning Li | Ning Li |
+| [HADOOP-4318](https://issues.apache.org/jira/browse/HADOOP-4318) | distcp fails | Blocker | . | Christian Kunz | Tsz Wo Nicholas Sze |
+| [HADOOP-4326](https://issues.apache.org/jira/browse/HADOOP-4326) | ChecksumFileSystem does not override all create(...) methods | Blocker | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-3217](https://issues.apache.org/jira/browse/HADOOP-3217) | [HOD] Be less agressive when querying job status from resource manager. | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### OTHER:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[30/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.0/RELEASENOTES.0.22.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.0/RELEASENOTES.0.22.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.0/RELEASENOTES.0.22.0.md
index 41ffd77..1678634 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.0/RELEASENOTES.0.22.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.0/RELEASENOTES.0.22.0.md
@@ -23,609 +23,609 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-7302](https://issues.apache.org/jira/browse/HADOOP-7302) | *Major* | **webinterface.private.actions should not be in common**
+* [MAPREDUCE-478](https://issues.apache.org/jira/browse/MAPREDUCE-478) | *Minor* | **separate jvm param for mapper and reducer**
-Option webinterface.private.actions has been renamed to mapreduce.jobtracker.webinterface.trusted and should be specified in mapred-site.xml instead of core-site.xml
+Allow map and reduce jvm parameters, environment variables and ulimit to be set separately.
+
+Configuration changes:
+ add mapred.map.child.java.opts
+ add mapred.reduce.child.java.opts
+ add mapred.map.child.env
+ add mapred.reduce.child.ulimit
+ add mapred.map.child.env
+ add mapred.reduce.child.ulimit
+ deprecated mapred.child.java.opts
+ deprecated mapred.child.env
+ deprecated mapred.child.ulimit
---
-* [HADOOP-7229](https://issues.apache.org/jira/browse/HADOOP-7229) | *Major* | **Absolute path to kinit in auto-renewal thread**
+* [HADOOP-6344](https://issues.apache.org/jira/browse/HADOOP-6344) | *Major* | **rm and rmr fail to correctly move the user's files to the trash prior to deleting when they are over quota.**
-When Hadoop's Kerberos integration is enabled, it is now required that either {{kinit}} be on the path for user accounts running the Hadoop client, or that the {{hadoop.kerberos.kinit.command}} configuration option be manually set to the absolute path to {{kinit}}.
+Trash feature notifies user of over-quota condition rather than silently deleting files/directories; deletion can be compelled with "rm -skiptrash".
---
-* [HADOOP-7193](https://issues.apache.org/jira/browse/HADOOP-7193) | *Minor* | **Help message is wrong for touchz command.**
+* [HADOOP-6599](https://issues.apache.org/jira/browse/HADOOP-6599) | *Major* | **Split RPC metrics into summary and detailed metrics**
-Updated the help for the touchz command.
+Split existing RpcMetrics into RpcMetrics and RpcDetailedMetrics. The new RpcDetailedMetrics has per method usage details and is available under context name "rpc" and record name "detailed-metrics"
---
-* [HADOOP-7192](https://issues.apache.org/jira/browse/HADOOP-7192) | *Trivial* | **fs -stat docs aren't updated to reflect the format features**
+* [MAPREDUCE-927](https://issues.apache.org/jira/browse/MAPREDUCE-927) | *Major* | **Cleanup of task-logs should happen in TaskTracker instead of the Child**
-Updated the web documentation to reflect the formatting abilities of 'fs -stat'.
+Moved Task log cleanup into a separate thread in TaskTracker.
+Added configuration "mapreduce.job.userlog.retain.hours" to specify the time(in hours) for which the user-logs are to be retained after the job completion.
---
-* [HADOOP-7156](https://issues.apache.org/jira/browse/HADOOP-7156) | *Critical* | **getpwuid\_r is not thread-safe on RHEL6**
+* [HADOOP-6730](https://issues.apache.org/jira/browse/HADOOP-6730) | *Major* | **Bug in FileContext#copy and provide base class for FileContext tests**
-Adds a new configuration hadoop.work.around.non.threadsafe.getpwuid which can be used to enable a mutex around this call to workaround thread-unsafe implementations of getpwuid\_r. Users should consult http://wiki.apache.org/hadoop/KnownBrokenPwuidImplementations for a list of such systems.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-7137](https://issues.apache.org/jira/browse/HADOOP-7137) | *Major* | **Remove hod contrib**
+* [MAPREDUCE-1707](https://issues.apache.org/jira/browse/MAPREDUCE-1707) | *Major* | **TaskRunner can get NPE in getting ugi from TaskTracker**
-Removed contrib related build targets.
+Fixed a bug that causes TaskRunner to get NPE in getting ugi from TaskTracker and subsequently crashes it resulting in a failing task after task-timeout period.
---
-* [HADOOP-7134](https://issues.apache.org/jira/browse/HADOOP-7134) | *Major* | **configure files that are generated as part of the released tarball need to have executable bit set**
+* [MAPREDUCE-1680](https://issues.apache.org/jira/browse/MAPREDUCE-1680) | *Major* | **Add a metrics to track the number of heartbeats processed**
-I have just committed this to trunk and branch-0.22. Thanks Roman!
+Added a metric to track number of heartbeats processed by the JobTracker.
---
-* [HADOOP-7117](https://issues.apache.org/jira/browse/HADOOP-7117) | *Major* | **Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml**
+* [HDFS-1109](https://issues.apache.org/jira/browse/HDFS-1109) | *Major* | **HFTP and URL Encoding**
-Removed references to the older fs.checkpoint.\* properties that resided in core-site.xml
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-7089](https://issues.apache.org/jira/browse/HADOOP-7089) | *Minor* | **Fix link resolution logic in hadoop-config.sh**
+* [HDFS-1061](https://issues.apache.org/jira/browse/HDFS-1061) | *Minor* | **Memory footprint optimization for INodeFile object.**
-Updates hadoop-config.sh to always resolve symlinks when determining HADOOP\_HOME. Bash built-ins or POSIX:2001 compliant cmds are now required.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-7013](https://issues.apache.org/jira/browse/HADOOP-7013) | *Major* | **Add boolean field isCorrupt to BlockLocation**
+* [HDFS-1079](https://issues.apache.org/jira/browse/HDFS-1079) | *Major* | **HDFS implementation should throw exceptions defined in AbstractFileSystem**
-This patch has changed the serialization format of BlockLocation.
+Specific exceptions are thrown from HDFS implementation and protocol per the interface defined in AbstractFileSystem. The compatibility is not affected as the applications catch IOException and will be able to handle specific exceptions that are subclasses of IOException.
---
-* [HADOOP-7005](https://issues.apache.org/jira/browse/HADOOP-7005) | *Major* | **Update test-patch.sh to remove callback to Hudson master**
+* [MAPREDUCE-1558](https://issues.apache.org/jira/browse/MAPREDUCE-1558) | *Major* | **specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612)**
-N/A
+new config:
+hadoop.security.service.user.name.key
+this setting points to the server principal for RefreshUserToGroupMappingsProtocol.
+The value should be either NN or JT principal depending if it is used in DFAdmin or MRAdmin. The value is set by the application. No need for default value.
---
-* [HADOOP-6949](https://issues.apache.org/jira/browse/HADOOP-6949) | *Major* | **Reduces RPC packet size for primitive arrays, especially long[], which is used at block reporting**
+* [HDFS-708](https://issues.apache.org/jira/browse/HDFS-708) | *Major* | **A stress-test tool for HDFS.**
-Increments the RPC protocol version in org.apache.hadoop.ipc.Server from 4 to 5.
-Introduces ArrayPrimitiveWritable for a much more efficient wire format to transmit arrays of primitives over RPC. ObjectWritable uses the new writable for array of primitives for RPC and continues to use existing format for on-disk data.
+Does not currently provide anything but uniform distribution.
+Uses some older depreciated class interfaces (for mapper and reducer)
+This was tested on 0.20 and 0.22 (locally) so it should be fairly backwards compatible.
---
-* [HADOOP-6922](https://issues.apache.org/jira/browse/HADOOP-6922) | *Major* | **COMMON part of MAPREDUCE-1664**
+* [MAPREDUCE-1354](https://issues.apache.org/jira/browse/MAPREDUCE-1354) | *Critical* | **Incremental enhancements to the JobTracker for better scalability**
-Makes AccessControlList a writable and updates documentation for Job ACLs.
+Incremental enhancements to the JobTracker include a no-lock version of JT.getTaskCompletion events, no lock on the JT while doing i/o during job-submission and several fixes to cut down configuration parsing during heartbeat-handling.
---
-* [HADOOP-6905](https://issues.apache.org/jira/browse/HADOOP-6905) | *Major* | **Better logging messages when a delegation token is invalid**
+* [MAPREDUCE-1683](https://issues.apache.org/jira/browse/MAPREDUCE-1683) | *Major* | **Remove JNI calls from ClusterStatus cstr**
-**WARNING: No release note provided for this incompatible change.**
+Removes JNI calls to get jvm current/max heap usage in ClusterStatus. Any instances of ClusterStatus serialized in a prior version will not be correctly deserialized using the updated class.
---
-* [HADOOP-6835](https://issues.apache.org/jira/browse/HADOOP-6835) | *Major* | **Support concatenated gzip files**
+* [MAPREDUCE-1773](https://issues.apache.org/jira/browse/MAPREDUCE-1773) | *Major* | **streaming doesn't support jobclient.output.filter**
-Processing of concatenated gzip files formerly stopped (quietly) at the end of the first substream/"member"; now processing will continue to the end of the concatenated stream, like gzip(1) does. (bzip2 support is unaffected by this patch.)
+Improved console messaging for streaming jobs by using the generic JobClient API itself instead of the existing streaming-specific code.
---
-* [HADOOP-6787](https://issues.apache.org/jira/browse/HADOOP-6787) | *Major* | **Factor out glob pattern code from FileContext and Filesystem**
+* [MAPREDUCE-1785](https://issues.apache.org/jira/browse/MAPREDUCE-1785) | *Minor* | **Add streaming config option for not emitting the key**
-**WARNING: No release note provided for this incompatible change.**
+Added a configuration property "stream.map.input.ignoreKey" to specify whether to ignore key or not while writing input for the mapper. This configuration parameter is valid only if stream.map.input.writer.class is org.apache.hadoop.streaming.io.TextInputWriter.class. For all other InputWriter's, key is always written.
---
-* [HADOOP-6730](https://issues.apache.org/jira/browse/HADOOP-6730) | *Major* | **Bug in FileContext#copy and provide base class for FileContext tests**
+* [MAPREDUCE-572](https://issues.apache.org/jira/browse/MAPREDUCE-572) | *Minor* | **If #link is missing from uri format of -cacheArchive then streaming does not throw error.**
-**WARNING: No release note provided for this incompatible change.**
+Improved streaming job failure when #link is missing from uri format of -cacheArchive. Earlier it used to fail when launching individual tasks, now it fails during job submission itself.
---
-* [HADOOP-6693](https://issues.apache.org/jira/browse/HADOOP-6693) | *Major* | **Add metrics to track kerberos login activity**
+* [HDFS-1096](https://issues.apache.org/jira/browse/HDFS-1096) | *Major* | **allow dfsadmin/mradmin refresh of superuser proxy group mappings**
-New metrics "login" of type MetricTimeVaryingRate is added under new metrics context name "ugi" and metrics record name "ugi".
+changed protocol name (may be used in hadoop-policy.xml)
+from security.refresh.usertogroups.mappings.protocol.acl to security.refresh.user.mappings.protocol.acl
---
-* [HADOOP-6683](https://issues.apache.org/jira/browse/HADOOP-6683) | *Minor* | **the first optimization: ZlibCompressor does not fully utilize the buffer**
+* [HADOOP-6787](https://issues.apache.org/jira/browse/HADOOP-6787) | *Major* | **Factor out glob pattern code from FileContext and Filesystem**
-Improve the buffer utilization of ZlibCompressor to avoid invoking a JNI per write request.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-6663](https://issues.apache.org/jira/browse/HADOOP-6663) | *Major* | **BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file**
+* [MAPREDUCE-1836](https://issues.apache.org/jira/browse/MAPREDUCE-1836) | *Major* | **Refresh for proxy superuser config (mr part for HDFS-1096)**
-Fix EOF exception in BlockDecompressorStream when decompressing previous compressed empty file
+changing name of the protocol (may be used in hadoop-policy.xml)
+from
+security.refresh.usertogroups.mappings.protocol.acl
+to
+security.refresh.user.mappings.protocol.acl
---
-* [HADOOP-6599](https://issues.apache.org/jira/browse/HADOOP-6599) | *Major* | **Split RPC metrics into summary and detailed metrics**
+* [MAPREDUCE-1505](https://issues.apache.org/jira/browse/MAPREDUCE-1505) | *Major* | **Cluster class should create the rpc client only when needed**
-Split existing RpcMetrics into RpcMetrics and RpcDetailedMetrics. The new RpcDetailedMetrics has per method usage details and is available under context name "rpc" and record name "detailed-metrics"
+Lazily construct a connection to the JobTracker from the job-submission client.
---
-* [HADOOP-6436](https://issues.apache.org/jira/browse/HADOOP-6436) | *Major* | **Remove auto-generated native build files**
+* [MAPREDUCE-1543](https://issues.apache.org/jira/browse/MAPREDUCE-1543) | *Major* | **Log messages of JobACLsManager should use security logging of HADOOP-6586**
-The native build run when from trunk now requires autotools, libtool and openssl dev libraries.
+Adds the audit logging facility to MapReduce. All authorization/authentication events are logged to audit log. Audit log entries are stored as key=value.
---
-* [HADOOP-6344](https://issues.apache.org/jira/browse/HADOOP-6344) | *Major* | **rm and rmr fail to correctly move the user's files to the trash prior to deleting when they are over quota.**
+* [MAPREDUCE-1533](https://issues.apache.org/jira/browse/MAPREDUCE-1533) | *Major* | **Reduce or remove usage of String.format() usage in CapacityTaskScheduler.updateQSIObjects and Counters.makeEscapedString()**
-Trash feature notifies user of over-quota condition rather than silently deleting files/directories; deletion can be compelled with "rm -skiptrash".
+Incremental enhancements to the JobTracker to optimize heartbeat handling.
---
-* [HADOOP-4675](https://issues.apache.org/jira/browse/HADOOP-4675) | *Major* | **Current Ganglia metrics implementation is incompatible with Ganglia 3.1**
+* [HDFS-1080](https://issues.apache.org/jira/browse/HDFS-1080) | *Major* | **SecondaryNameNode image transfer should use the defined http address rather than local ip address**
-Support for reporting metrics to Ganglia 3.1 servers
+**WARNING: No release note provided for this change.**
---
-* [HDFS-1948](https://issues.apache.org/jira/browse/HDFS-1948) | *Major* | **Forward port 'hdfs-1520 lightweight namenode operation to trigger lease reccovery'**
+* [MAPREDUCE-1813](https://issues.apache.org/jira/browse/MAPREDUCE-1813) | *Major* | **NPE in PipeMapred.MRErrorThread**
-Adds method to NameNode/ClientProtocol that allows for rude revoke of lease on current lease holder
+Fixed an NPE in streaming that occurs when there is no input to reduce and the streaming reducer sends status updates by writing "reporter:status: xxx" statements to stderr.
---
-* [HDFS-1825](https://issues.apache.org/jira/browse/HDFS-1825) | *Major* | **Remove thriftfs contrib**
+* [MAPREDUCE-1829](https://issues.apache.org/jira/browse/MAPREDUCE-1829) | *Major* | **JobInProgress.findSpeculativeTask should use min() to find the candidate instead of sort()**
-Removed thriftfs contrib component.
+Improved performance of the method JobInProgress.findSpeculativeTask() which is in the critical heartbeat code path.
---
-* [HDFS-1596](https://issues.apache.org/jira/browse/HDFS-1596) | *Major* | **Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml**
+* [MAPREDUCE-1887](https://issues.apache.org/jira/browse/MAPREDUCE-1887) | *Major* | **MRAsyncDiskService does not properly absolutize volume root paths**
-Removed references to the older fs.checkpoint.\* properties that resided in core-site.xml
+MAPREDUCE-1887. MRAsyncDiskService now properly absolutizes volume root paths. (Aaron Kimball via zshao)
---
-* [HDFS-1582](https://issues.apache.org/jira/browse/HDFS-1582) | *Major* | **Remove auto-generated native build files**
+* [HADOOP-6835](https://issues.apache.org/jira/browse/HADOOP-6835) | *Major* | **Support concatenated gzip files**
-The native build run when from trunk now requires autotools, libtool and openssl dev libraries.
+Processing of concatenated gzip files formerly stopped (quietly) at the end of the first substream/"member"; now processing will continue to the end of the concatenated stream, like gzip(1) does. (bzip2 support is unaffected by this patch.)
---
-* [HDFS-1560](https://issues.apache.org/jira/browse/HDFS-1560) | *Minor* | **dfs.data.dir permissions should default to 700**
+* [MAPREDUCE-1733](https://issues.apache.org/jira/browse/MAPREDUCE-1733) | *Major* | **Authentication between pipes processes and java counterparts.**
-The permissions on datanode data directories (configured by dfs.datanode.data.dir.perm) now default to 0700. Upon startup, the datanode will automatically change the permissions to match the configured value.
+This jira introduces backward incompatibility. Existing pipes applications MUST be recompiled with new hadoop pipes library once the changes in this jira are deployed.
---
-* [HDFS-1457](https://issues.apache.org/jira/browse/HDFS-1457) | *Major* | **Limit transmission rate when transfering image between primary and secondary NNs**
+* [HDFS-1315](https://issues.apache.org/jira/browse/HDFS-1315) | *Major* | **Add fsck event to audit log and remove other audit log events corresponding to FSCK listStatus and open calls**
-Add a configuration variable dfs.image.transfer.bandwidthPerSec to allow the user to specify the amount of bandwidth for transferring image and edits. Its default value is 0 indicating no throttling.
+When running fsck, audit log events are not logged for listStatus and open are not logged. A new event with cmd=fsck is logged with ugi field set to the user requesting fsck and src field set to the fsck path.
---
-* [HDFS-1435](https://issues.apache.org/jira/browse/HDFS-1435) | *Major* | **Provide an option to store fsimage compressed**
+* [MAPREDUCE-1866](https://issues.apache.org/jira/browse/MAPREDUCE-1866) | *Minor* | **Remove deprecated class org.apache.hadoop.streaming.UTF8ByteArrayUtils**
-This provides an option to store fsimage compressed. The layout version is bumped to -25. The user could configure if s/he wants the fsimage to be compressed or not and which codec to use. By default the fsimage is not compressed.
+Removed public deprecated class org.apache.hadoop.streaming.UTF8ByteArrayUtils.
---
-* [HDFS-1318](https://issues.apache.org/jira/browse/HDFS-1318) | *Major* | **HDFS Namenode and Datanode WebUI information needs to be accessible programmatically for scripts**
+* [HDFS-330](https://issues.apache.org/jira/browse/HDFS-330) | *Trivial* | **Datanode Web UIs should provide robots.txt**
-resubmit the patch for HDFS1318 as Hudson was down last week.
+A robots.txt is now in place which will prevent well behaved crawlers from perusing Hadoop web interfaces.
---
-* [HDFS-1315](https://issues.apache.org/jira/browse/HDFS-1315) | *Major* | **Add fsck event to audit log and remove other audit log events corresponding to FSCK listStatus and open calls**
+* [HDFS-202](https://issues.apache.org/jira/browse/HDFS-202) | *Major* | **Add a bulk FIleSystem.getFileBlockLocations**
-When running fsck, audit log events are not logged for listStatus and open are not logged. A new event with cmd=fsck is logged with ugi field set to the user requesting fsck and src field set to the fsck path.
+**WARNING: No release note provided for this change.**
---
-* [HDFS-1109](https://issues.apache.org/jira/browse/HDFS-1109) | *Major* | **HFTP and URL Encoding**
+* [MAPREDUCE-1780](https://issues.apache.org/jira/browse/MAPREDUCE-1780) | *Major* | **AccessControlList.toString() is used for serialization of ACL in JobStatus.java**
-**WARNING: No release note provided for this incompatible change.**
+Fixes serialization of job-acls in JobStatus to use AccessControlList.write() instead of AccessControlList.toString().
---
-* [HDFS-1096](https://issues.apache.org/jira/browse/HDFS-1096) | *Major* | **allow dfsadmin/mradmin refresh of superuser proxy group mappings**
+* [HADOOP-6905](https://issues.apache.org/jira/browse/HADOOP-6905) | *Major* | **Better logging messages when a delegation token is invalid**
-changed protocol name (may be used in hadoop-policy.xml)
-from security.refresh.usertogroups.mappings.protocol.acl to security.refresh.user.mappings.protocol.acl
+**WARNING: No release note provided for this change.**
---
-* [HDFS-1080](https://issues.apache.org/jira/browse/HDFS-1080) | *Major* | **SecondaryNameNode image transfer should use the defined http address rather than local ip address**
+* [HADOOP-6693](https://issues.apache.org/jira/browse/HADOOP-6693) | *Major* | **Add metrics to track kerberos login activity**
-**WARNING: No release note provided for this incompatible change.**
+New metrics "login" of type MetricTimeVaryingRate is added under new metrics context name "ugi" and metrics record name "ugi".
---
-* [HDFS-1079](https://issues.apache.org/jira/browse/HDFS-1079) | *Major* | **HDFS implementation should throw exceptions defined in AbstractFileSystem**
+* [HDFS-1318](https://issues.apache.org/jira/browse/HDFS-1318) | *Major* | **HDFS Namenode and Datanode WebUI information needs to be accessible programmatically for scripts**
-Specific exceptions are thrown from HDFS implementation and protocol per the interface defined in AbstractFileSystem. The compatibility is not affected as the applications catch IOException and will be able to handle specific exceptions that are subclasses of IOException.
+resubmit the patch for HDFS1318 as Hudson was down last week.
---
-* [HDFS-1061](https://issues.apache.org/jira/browse/HDFS-1061) | *Minor* | **Memory footprint optimization for INodeFile object.**
+* [MAPREDUCE-220](https://issues.apache.org/jira/browse/MAPREDUCE-220) | *Major* | **Collecting cpu and memory usage for MapReduce tasks**
-**WARNING: No release note provided for this incompatible change.**
+Collect cpu and memory statistics per task.
---
-* [HDFS-1035](https://issues.apache.org/jira/browse/HDFS-1035) | *Major* | **Generate Eclipse's .classpath file from Ivy config**
+* [HDFS-712](https://issues.apache.org/jira/browse/HDFS-712) | *Major* | **Move libhdfs from mr to hdfs**
-Added support to auto-generate the Eclipse .classpath file from ivy.
+Moved the libhdfs package to the HDFS subproject.
---
-* [HDFS-903](https://issues.apache.org/jira/browse/HDFS-903) | *Critical* | **NN should verify images and edit logs on startup**
+* [MAPREDUCE-2032](https://issues.apache.org/jira/browse/MAPREDUCE-2032) | *Major* | **TestJobOutputCommitter fails in ant test run**
-Store fsimage MD5 checksum in VERSION file. Validate checksum when loading a fsimage. Layout version bumped.
+Clears a problem that {{TestJobCleanup}} leaves behind files that cause {{TestJobOutputCommitter}} to error out.
---
-* [HDFS-712](https://issues.apache.org/jira/browse/HDFS-712) | *Major* | **Move libhdfs from mr to hdfs**
+* [HADOOP-6922](https://issues.apache.org/jira/browse/HADOOP-6922) | *Major* | **COMMON part of MAPREDUCE-1664**
-Moved the libhdfs package to the HDFS subproject.
+Makes AccessControlList a writable and updates documentation for Job ACLs.
---
-* [HDFS-708](https://issues.apache.org/jira/browse/HDFS-708) | *Major* | **A stress-test tool for HDFS.**
+* [MAPREDUCE-1664](https://issues.apache.org/jira/browse/MAPREDUCE-1664) | *Major* | **Job Acls affect Queue Acls**
-Does not currently provide anything but uniform distribution.
-Uses some older depreciated class interfaces (for mapper and reducer)
-This was tested on 0.20 and 0.22 (locally) so it should be fairly backwards compatible.
+<!-- markdown -->
+* Removed aclsEnabled flag from queues configuration files.
+* Removed the configuration property mapreduce.cluster.job-authorization-enabled.
+* Added mapreduce.cluster.acls.enabled as the single configuration property in mapred-default.xml that enables the authorization checks for all job level and queue level operations.
+* To enable authorization of users to do job level and queue level operations, mapreduce.cluster.acls.enabled is to be set to true in JobTracker's configuration and in all TaskTrackers' configurations.
+* To get access to a job, it is enough for a user to be part of one of the access lists i.e. either job-acl or queue-admins-acl(unlike before, when, one has to be part of both the lists).
+* Queue administrators(configured via acl-administer-jobs) of a queue can do all view-job and modify-job operations on all jobs submitted to that queue.
+* ClusterOwner(who started the mapreduce cluster) and cluster administrators(configured via mapreduce.cluster.permissions.supergroup) can do all job level operations and queue level operations on all jobs on all queues in that cluster irrespective of job-acls and queue-acls configured.
+* JobOwner(who submitted job to a queue) can do all view-job and modify-job operations on his/her job irrespective of job-acls and queue-acls.
+* Since aclsEnabled flag is removed from queues configuration files, "refresh of queues configuration" will not change mapreduce.cluster.acls.enabled on the fly. mapreduce.cluster.acls.enabled can be modified only when restarting the mapreduce cluster.
---
-* [HDFS-330](https://issues.apache.org/jira/browse/HDFS-330) | *Trivial* | **Datanode Web UIs should provide robots.txt**
+* [MAPREDUCE-1517](https://issues.apache.org/jira/browse/MAPREDUCE-1517) | *Major* | **streaming should support running on background**
-A robots.txt is now in place which will prevent well behaved crawlers from perusing Hadoop web interfaces.
+Adds -background option to run a streaming job in background.
---
-* [HDFS-202](https://issues.apache.org/jira/browse/HDFS-202) | *Major* | **Add a bulk FIleSystem.getFileBlockLocations**
+* [MAPREDUCE-2147](https://issues.apache.org/jira/browse/MAPREDUCE-2147) | *Trivial* | **JobInProgress has some redundant lines in its ctor**
-**WARNING: No release note provided for this incompatible change.**
+Remove some redundant lines from JobInProgress's constructor which was re-initializing things unnecessarily.
---
-* [MAPREDUCE-3151](https://issues.apache.org/jira/browse/MAPREDUCE-3151) | *Major* | **Contrib tests failing**
+* [HDFS-1435](https://issues.apache.org/jira/browse/HDFS-1435) | *Major* | **Provide an option to store fsimage compressed**
-Confirmed that problem of finding ivy file occurs w/o patch with ant 1.7, and not with patch (with either ant 1.7 or 1.8).
-Other unit tests are still failing the test steps themselves on my laptop, but that is not due not finding the ivy file.
+This provides an option to store fsimage compressed. The layout version is bumped to -25. The user could configure if s/he wants the fsimage to be compressed or not and which codec to use. By default the fsimage is not compressed.
---
-* [MAPREDUCE-2516](https://issues.apache.org/jira/browse/MAPREDUCE-2516) | *Minor* | **option to control sensitive web actions**
+* [HADOOP-7005](https://issues.apache.org/jira/browse/HADOOP-7005) | *Major* | **Update test-patch.sh to remove callback to Hudson master**
-Configuration option webinterface.private.actions has been renamed to mapreduce.jobtracker.webinterface.trusted
+N/A
---
-* [MAPREDUCE-2410](https://issues.apache.org/jira/browse/MAPREDUCE-2410) | *Minor* | **document multiple keys per reducer oddity in hadoop streaming FAQ**
+* [HADOOP-6663](https://issues.apache.org/jira/browse/HADOOP-6663) | *Major* | **BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file**
-Add an FAQ entry regarding the differences between Java API and Streaming development of MR programs.
+Fix EOF exception in BlockDecompressorStream when decompressing previous compressed empty file
---
-* [MAPREDUCE-2272](https://issues.apache.org/jira/browse/MAPREDUCE-2272) | *Trivial* | **Job ACL file should not be executable**
+* [HDFS-903](https://issues.apache.org/jira/browse/HDFS-903) | *Critical* | **NN should verify images and edit logs on startup**
-Job ACL files now have permissions set to 600 (previously 700).
+Store fsimage MD5 checksum in VERSION file. Validate checksum when loading a fsimage. Layout version bumped.
---
-* [MAPREDUCE-2260](https://issues.apache.org/jira/browse/MAPREDUCE-2260) | *Major* | **Remove auto-generated native build files**
+* [HDFS-1457](https://issues.apache.org/jira/browse/HDFS-1457) | *Major* | **Limit transmission rate when transfering image between primary and secondary NNs**
-The native build run when from trunk now requires autotools, libtool and openssl dev libraries.
+Add a configuration variable dfs.image.transfer.bandwidthPerSec to allow the user to specify the amount of bandwidth for transferring image and edits. Its default value is 0 indicating no throttling.
---
-* [MAPREDUCE-2251](https://issues.apache.org/jira/browse/MAPREDUCE-2251) | *Major* | **Remove mapreduce.job.userhistorylocation config**
+* [HDFS-1035](https://issues.apache.org/jira/browse/HDFS-1035) | *Major* | **Generate Eclipse's .classpath file from Ivy config**
-Remove the now defunct property `mapreduce.job.userhistorylocation`.
+Added support to auto-generate the Eclipse .classpath file from ivy.
---
-* [MAPREDUCE-2147](https://issues.apache.org/jira/browse/MAPREDUCE-2147) | *Trivial* | **JobInProgress has some redundant lines in its ctor**
+* [MAPREDUCE-1592](https://issues.apache.org/jira/browse/MAPREDUCE-1592) | *Major* | **Generate Eclipse's .classpath file from Ivy config**
-Remove some redundant lines from JobInProgress's constructor which was re-initializing things unnecessarily.
+Added support to auto-generate the Eclipse .classpath file from ivy.
---
-* [MAPREDUCE-2096](https://issues.apache.org/jira/browse/MAPREDUCE-2096) | *Blocker* | **Secure local filesystem IO from symlink vulnerabilities**
+* [HADOOP-4675](https://issues.apache.org/jira/browse/HADOOP-4675) | *Major* | **Current Ganglia metrics implementation is incompatible with Ganglia 3.1**
-The TaskTracker now uses the libhadoop JNI library to operate securely on local files when security is enabled. Secure clusters must ensure that libhadoop.so is available to the TaskTracker.
+Support for reporting metrics to Ganglia 3.1 servers
---
-* [MAPREDUCE-2054](https://issues.apache.org/jira/browse/MAPREDUCE-2054) | *Major* | **Hierarchical queue implementation broke dynamic queue addition in Dynamic Scheduler**
+* [MAPREDUCE-1905](https://issues.apache.org/jira/browse/MAPREDUCE-1905) | *Blocker* | **Context.setStatus() and progress() api are ignored**
-Fix Dynamic Priority Scheduler to work with hierarchical queue names
+Moved the api public Counter getCounter(Enum\<?\> counterName), public Counter getCounter(String groupName, String counterName) from org.apache.hadoop.mapreduce.TaskInputOutputContext to org.apache.hadoop.mapreduce.TaskAttemptContext
---
-* [MAPREDUCE-2032](https://issues.apache.org/jira/browse/MAPREDUCE-2032) | *Major* | **TestJobOutputCommitter fails in ant test run**
+* [HADOOP-7013](https://issues.apache.org/jira/browse/HADOOP-7013) | *Major* | **Add boolean field isCorrupt to BlockLocation**
-Clears a problem that {{TestJobCleanup}} leaves behind files that cause {{TestJobOutputCommitter}} to error out.
+This patch has changed the serialization format of BlockLocation.
---
-* [MAPREDUCE-1996](https://issues.apache.org/jira/browse/MAPREDUCE-1996) | *Trivial* | **API: Reducer.reduce() method detail misstatement**
+* [HADOOP-6683](https://issues.apache.org/jira/browse/HADOOP-6683) | *Minor* | **the first optimization: ZlibCompressor does not fully utilize the buffer**
-Fix a misleading documentation note about the usage of Reporter objects in Reducers.
+Improve the buffer utilization of ZlibCompressor to avoid invoking a JNI per write request.
---
-* [MAPREDUCE-1905](https://issues.apache.org/jira/browse/MAPREDUCE-1905) | *Blocker* | **Context.setStatus() and progress() api are ignored**
+* [HDFS-1560](https://issues.apache.org/jira/browse/HDFS-1560) | *Minor* | **dfs.data.dir permissions should default to 700**
-Moved the api public Counter getCounter(Enum\<?\> counterName), public Counter getCounter(String groupName, String counterName) from org.apache.hadoop.mapreduce.TaskInputOutputContext to org.apache.hadoop.mapreduce.TaskAttemptContext
+The permissions on datanode data directories (configured by dfs.datanode.data.dir.perm) now default to 0700. Upon startup, the datanode will automatically change the permissions to match the configured value.
---
-* [MAPREDUCE-1887](https://issues.apache.org/jira/browse/MAPREDUCE-1887) | *Major* | **MRAsyncDiskService does not properly absolutize volume root paths**
+* [MAPREDUCE-2096](https://issues.apache.org/jira/browse/MAPREDUCE-2096) | *Blocker* | **Secure local filesystem IO from symlink vulnerabilities**
-MAPREDUCE-1887. MRAsyncDiskService now properly absolutizes volume root paths. (Aaron Kimball via zshao)
+The TaskTracker now uses the libhadoop JNI library to operate securely on local files when security is enabled. Secure clusters must ensure that libhadoop.so is available to the TaskTracker.
---
-* [MAPREDUCE-1866](https://issues.apache.org/jira/browse/MAPREDUCE-1866) | *Minor* | **Remove deprecated class org.apache.hadoop.streaming.UTF8ByteArrayUtils**
+* [HADOOP-7089](https://issues.apache.org/jira/browse/HADOOP-7089) | *Minor* | **Fix link resolution logic in hadoop-config.sh**
-Removed public deprecated class org.apache.hadoop.streaming.UTF8ByteArrayUtils.
+Updates hadoop-config.sh to always resolve symlinks when determining HADOOP\_HOME. Bash built-ins or POSIX:2001 compliant cmds are now required.
---
-* [MAPREDUCE-1836](https://issues.apache.org/jira/browse/MAPREDUCE-1836) | *Major* | **Refresh for proxy superuser config (mr part for HDFS-1096)**
+* [HADOOP-6436](https://issues.apache.org/jira/browse/HADOOP-6436) | *Major* | **Remove auto-generated native build files**
-changing name of the protocol (may be used in hadoop-policy.xml)
-from
-security.refresh.usertogroups.mappings.protocol.acl
-to
-security.refresh.user.mappings.protocol.acl
+The native build run when from trunk now requires autotools, libtool and openssl dev libraries.
---
-* [MAPREDUCE-1829](https://issues.apache.org/jira/browse/MAPREDUCE-1829) | *Major* | **JobInProgress.findSpeculativeTask should use min() to find the candidate instead of sort()**
+* [MAPREDUCE-2260](https://issues.apache.org/jira/browse/MAPREDUCE-2260) | *Major* | **Remove auto-generated native build files**
-Improved performance of the method JobInProgress.findSpeculativeTask() which is in the critical heartbeat code path.
+The native build run when from trunk now requires autotools, libtool and openssl dev libraries.
---
-* [MAPREDUCE-1813](https://issues.apache.org/jira/browse/MAPREDUCE-1813) | *Major* | **NPE in PipeMapred.MRErrorThread**
+* [HDFS-1582](https://issues.apache.org/jira/browse/HDFS-1582) | *Major* | **Remove auto-generated native build files**
-Fixed an NPE in streaming that occurs when there is no input to reduce and the streaming reducer sends status updates by writing "reporter:status: xxx" statements to stderr.
+The native build run when from trunk now requires autotools, libtool and openssl dev libraries.
---
-* [MAPREDUCE-1785](https://issues.apache.org/jira/browse/MAPREDUCE-1785) | *Minor* | **Add streaming config option for not emitting the key**
+* [HADOOP-7134](https://issues.apache.org/jira/browse/HADOOP-7134) | *Major* | **configure files that are generated as part of the released tarball need to have executable bit set**
-Added a configuration property "stream.map.input.ignoreKey" to specify whether to ignore key or not while writing input for the mapper. This configuration parameter is valid only if stream.map.input.writer.class is org.apache.hadoop.streaming.io.TextInputWriter.class. For all other InputWriter's, key is always written.
+I have just committed this to trunk and branch-0.22. Thanks Roman!
---
-* [MAPREDUCE-1780](https://issues.apache.org/jira/browse/MAPREDUCE-1780) | *Major* | **AccessControlList.toString() is used for serialization of ACL in JobStatus.java**
+* [MAPREDUCE-2054](https://issues.apache.org/jira/browse/MAPREDUCE-2054) | *Major* | **Hierarchical queue implementation broke dynamic queue addition in Dynamic Scheduler**
-Fixes serialization of job-acls in JobStatus to use AccessControlList.write() instead of AccessControlList.toString().
+Fix Dynamic Priority Scheduler to work with hierarchical queue names
---
-* [MAPREDUCE-1773](https://issues.apache.org/jira/browse/MAPREDUCE-1773) | *Major* | **streaming doesn't support jobclient.output.filter**
+* [MAPREDUCE-1996](https://issues.apache.org/jira/browse/MAPREDUCE-1996) | *Trivial* | **API: Reducer.reduce() method detail misstatement**
-Improved console messaging for streaming jobs by using the generic JobClient API itself instead of the existing streaming-specific code.
+Fix a misleading documentation note about the usage of Reporter objects in Reducers.
---
-* [MAPREDUCE-1733](https://issues.apache.org/jira/browse/MAPREDUCE-1733) | *Major* | **Authentication between pipes processes and java counterparts.**
+* [MAPREDUCE-1159](https://issues.apache.org/jira/browse/MAPREDUCE-1159) | *Trivial* | **Limit Job name on jobtracker.jsp to be 80 char long**
-This jira introduces backward incompatibility. Existing pipes applications MUST be recompiled with new hadoop pipes library once the changes in this jira are deployed.
+Job names on jobtracker.jsp should be 80 characters long at most.
---
-* [MAPREDUCE-1707](https://issues.apache.org/jira/browse/MAPREDUCE-1707) | *Major* | **TaskRunner can get NPE in getting ugi from TaskTracker**
+* [MAPREDUCE-2272](https://issues.apache.org/jira/browse/MAPREDUCE-2272) | *Trivial* | **Job ACL file should not be executable**
-Fixed a bug that causes TaskRunner to get NPE in getting ugi from TaskTracker and subsequently crashes it resulting in a failing task after task-timeout period.
+Job ACL files now have permissions set to 600 (previously 700).
---
-* [MAPREDUCE-1683](https://issues.apache.org/jira/browse/MAPREDUCE-1683) | *Major* | **Remove JNI calls from ClusterStatus cstr**
+* [MAPREDUCE-2251](https://issues.apache.org/jira/browse/MAPREDUCE-2251) | *Major* | **Remove mapreduce.job.userhistorylocation config**
-Removes JNI calls to get jvm current/max heap usage in ClusterStatus. Any instances of ClusterStatus serialized in a prior version will not be correctly deserialized using the updated class.
+Remove the now defunct property \`mapreduce.job.userhistorylocation\`.
---
-* [MAPREDUCE-1680](https://issues.apache.org/jira/browse/MAPREDUCE-1680) | *Major* | **Add a metrics to track the number of heartbeats processed**
+* [HADOOP-7156](https://issues.apache.org/jira/browse/HADOOP-7156) | *Critical* | **getpwuid\_r is not thread-safe on RHEL6**
-Added a metric to track number of heartbeats processed by the JobTracker.
+Adds a new configuration hadoop.work.around.non.threadsafe.getpwuid which can be used to enable a mutex around this call to workaround thread-unsafe implementations of getpwuid\_r. Users should consult http://wiki.apache.org/hadoop/KnownBrokenPwuidImplementations for a list of such systems.
---
-* [MAPREDUCE-1664](https://issues.apache.org/jira/browse/MAPREDUCE-1664) | *Major* | **Job Acls affect Queue Acls**
+* [HDFS-1596](https://issues.apache.org/jira/browse/HDFS-1596) | *Major* | **Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml**
-<!-- markdown -->
-* Removed aclsEnabled flag from queues configuration files.
-* Removed the configuration property mapreduce.cluster.job-authorization-enabled.
-* Added mapreduce.cluster.acls.enabled as the single configuration property in mapred-default.xml that enables the authorization checks for all job level and queue level operations.
-* To enable authorization of users to do job level and queue level operations, mapreduce.cluster.acls.enabled is to be set to true in JobTracker's configuration and in all TaskTrackers' configurations.
-* To get access to a job, it is enough for a user to be part of one of the access lists i.e. either job-acl or queue-admins-acl(unlike before, when, one has to be part of both the lists).
-* Queue administrators(configured via acl-administer-jobs) of a queue can do all view-job and modify-job operations on all jobs submitted to that queue.
-* ClusterOwner(who started the mapreduce cluster) and cluster administrators(configured via mapreduce.cluster.permissions.supergroup) can do all job level operations and queue level operations on all jobs on all queues in that cluster irrespective of job-acls and queue-acls configured.
-* JobOwner(who submitted job to a queue) can do all view-job and modify-job operations on his/her job irrespective of job-acls and queue-acls.
-* Since aclsEnabled flag is removed from queues configuration files, "refresh of queues configuration" will not change mapreduce.cluster.acls.enabled on the fly. mapreduce.cluster.acls.enabled can be modified only when restarting the mapreduce cluster.
+Removed references to the older fs.checkpoint.\* properties that resided in core-site.xml
---
-* [MAPREDUCE-1592](https://issues.apache.org/jira/browse/MAPREDUCE-1592) | *Major* | **Generate Eclipse's .classpath file from Ivy config**
+* [HADOOP-7117](https://issues.apache.org/jira/browse/HADOOP-7117) | *Major* | **Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml**
-Added support to auto-generate the Eclipse .classpath file from ivy.
+Removed references to the older fs.checkpoint.\* properties that resided in core-site.xml
---
-* [MAPREDUCE-1558](https://issues.apache.org/jira/browse/MAPREDUCE-1558) | *Major* | **specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612)**
+* [HADOOP-6949](https://issues.apache.org/jira/browse/HADOOP-6949) | *Major* | **Reduces RPC packet size for primitive arrays, especially long[], which is used at block reporting**
-new config:
-hadoop.security.service.user.name.key
-this setting points to the server principal for RefreshUserToGroupMappingsProtocol.
-The value should be either NN or JT principal depending if it is used in DFAdmin or MRAdmin. The value is set by the application. No need for default value.
+Increments the RPC protocol version in org.apache.hadoop.ipc.Server from 4 to 5.
+Introduces ArrayPrimitiveWritable for a much more efficient wire format to transmit arrays of primitives over RPC. ObjectWritable uses the new writable for array of primitives for RPC and continues to use existing format for on-disk data.
---
-* [MAPREDUCE-1543](https://issues.apache.org/jira/browse/MAPREDUCE-1543) | *Major* | **Log messages of JobACLsManager should use security logging of HADOOP-6586**
+* [HADOOP-7193](https://issues.apache.org/jira/browse/HADOOP-7193) | *Minor* | **Help message is wrong for touchz command.**
-Adds the audit logging facility to MapReduce. All authorization/authentication events are logged to audit log. Audit log entries are stored as key=value.
+Updated the help for the touchz command.
---
-* [MAPREDUCE-1533](https://issues.apache.org/jira/browse/MAPREDUCE-1533) | *Major* | **Reduce or remove usage of String.format() usage in CapacityTaskScheduler.updateQSIObjects and Counters.makeEscapedString()**
+* [HADOOP-7229](https://issues.apache.org/jira/browse/HADOOP-7229) | *Major* | **Absolute path to kinit in auto-renewal thread**
-Incremental enhancements to the JobTracker to optimize heartbeat handling.
+When Hadoop's Kerberos integration is enabled, it is now required that either {{kinit}} be on the path for user accounts running the Hadoop client, or that the {{hadoop.kerberos.kinit.command}} configuration option be manually set to the absolute path to {{kinit}}.
---
-* [MAPREDUCE-1517](https://issues.apache.org/jira/browse/MAPREDUCE-1517) | *Major* | **streaming should support running on background**
+* [MAPREDUCE-2410](https://issues.apache.org/jira/browse/MAPREDUCE-2410) | *Minor* | **document multiple keys per reducer oddity in hadoop streaming FAQ**
-Adds -background option to run a streaming job in background.
+Add an FAQ entry regarding the differences between Java API and Streaming development of MR programs.
---
-* [MAPREDUCE-1505](https://issues.apache.org/jira/browse/MAPREDUCE-1505) | *Major* | **Cluster class should create the rpc client only when needed**
+* [HDFS-1825](https://issues.apache.org/jira/browse/HDFS-1825) | *Major* | **Remove thriftfs contrib**
-Lazily construct a connection to the JobTracker from the job-submission client.
+Removed thriftfs contrib component.
---
-* [MAPREDUCE-1354](https://issues.apache.org/jira/browse/MAPREDUCE-1354) | *Critical* | **Incremental enhancements to the JobTracker for better scalability**
+* [HADOOP-7137](https://issues.apache.org/jira/browse/HADOOP-7137) | *Major* | **Remove hod contrib**
-Incremental enhancements to the JobTracker include a no-lock version of JT.getTaskCompletion events, no lock on the JT while doing i/o during job-submission and several fixes to cut down configuration parsing during heartbeat-handling.
+Removed contrib related build targets.
---
-* [MAPREDUCE-1159](https://issues.apache.org/jira/browse/MAPREDUCE-1159) | *Trivial* | **Limit Job name on jobtracker.jsp to be 80 char long**
+* [HADOOP-7192](https://issues.apache.org/jira/browse/HADOOP-7192) | *Trivial* | **fs -stat docs aren't updated to reflect the format features**
-Job names on jobtracker.jsp should be 80 characters long at most.
+Updated the web documentation to reflect the formatting abilities of 'fs -stat'.
---
-* [MAPREDUCE-1118](https://issues.apache.org/jira/browse/MAPREDUCE-1118) | *Major* | **Capacity Scheduler scheduling information is hard to read / should be tabular format**
+* [HADOOP-7302](https://issues.apache.org/jira/browse/HADOOP-7302) | *Major* | **webinterface.private.actions should not be in common**
-Add CapacityScheduler servlet to enhance web UI for queue information.
+Option webinterface.private.actions has been renamed to mapreduce.jobtracker.webinterface.trusted and should be specified in mapred-site.xml instead of core-site.xml
---
-* [MAPREDUCE-927](https://issues.apache.org/jira/browse/MAPREDUCE-927) | *Major* | **Cleanup of task-logs should happen in TaskTracker instead of the Child**
+* [MAPREDUCE-2516](https://issues.apache.org/jira/browse/MAPREDUCE-2516) | *Minor* | **option to control sensitive web actions**
-Moved Task log cleanup into a separate thread in TaskTracker.
-Added configuration "mapreduce.job.userlog.retain.hours" to specify the time(in hours) for which the user-logs are to be retained after the job completion.
+Configuration option webinterface.private.actions has been renamed to mapreduce.jobtracker.webinterface.trusted
---
-* [MAPREDUCE-572](https://issues.apache.org/jira/browse/MAPREDUCE-572) | *Minor* | **If #link is missing from uri format of -cacheArchive then streaming does not throw error.**
+* [HDFS-1948](https://issues.apache.org/jira/browse/HDFS-1948) | *Major* | **Forward port 'hdfs-1520 lightweight namenode operation to trigger lease reccovery'**
-Improved streaming job failure when #link is missing from uri format of -cacheArchive. Earlier it used to fail when launching individual tasks, now it fails during job submission itself.
+Adds method to NameNode/ClientProtocol that allows for rude revoke of lease on current lease holder
---
-* [MAPREDUCE-478](https://issues.apache.org/jira/browse/MAPREDUCE-478) | *Minor* | **separate jvm param for mapper and reducer**
-
-Allow map and reduce jvm parameters, environment variables and ulimit to be set separately.
+* [MAPREDUCE-3151](https://issues.apache.org/jira/browse/MAPREDUCE-3151) | *Major* | **Contrib tests failing**
-Configuration changes:
- add mapred.map.child.java.opts
- add mapred.reduce.child.java.opts
- add mapred.map.child.env
- add mapred.reduce.child.ulimit
- add mapred.map.child.env
- add mapred.reduce.child.ulimit
- deprecated mapred.child.java.opts
- deprecated mapred.child.env
- deprecated mapred.child.ulimit
+Confirmed that problem of finding ivy file occurs w/o patch with ant 1.7, and not with patch (with either ant 1.7 or 1.8).
+Other unit tests are still failing the test steps themselves on my laptop, but that is not due not finding the ivy file.
---
-* [MAPREDUCE-220](https://issues.apache.org/jira/browse/MAPREDUCE-220) | *Major* | **Collecting cpu and memory usage for MapReduce tasks**
+* [MAPREDUCE-1118](https://issues.apache.org/jira/browse/MAPREDUCE-1118) | *Major* | **Capacity Scheduler scheduling information is hard to read / should be tabular format**
-Collect cpu and memory statistics per task.
+Add CapacityScheduler servlet to enhance web UI for queue information.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.1/CHANGES.0.22.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.1/CHANGES.0.22.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.1/CHANGES.0.22.1.md
index ac195f0..2346cad 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.1/CHANGES.0.22.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.1/CHANGES.0.22.1.md
@@ -18,7 +18,7 @@
-->
# Apache Hadoop Changelog
-## Release 0.22.1 - Unreleased (as of 2016-03-04)
+## Release 0.22.1 - Unreleased (as of 2017-08-28)
### INCOMPATIBLE CHANGES:
@@ -27,18 +27,12 @@
| [HADOOP-6453](https://issues.apache.org/jira/browse/HADOOP-6453) | Hadoop wrapper script shouldn't ignore an existing JAVA\_LIBRARY\_PATH | Minor | scripts | Chad Metcalf | |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7937](https://issues.apache.org/jira/browse/HADOOP-7937) | Forward port SequenceFile#syncFs and friends from Hadoop 1.x | Major | io | Eli Collins | Tom White |
| [HADOOP-7119](https://issues.apache.org/jira/browse/HADOOP-7119) | add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-7937](https://issues.apache.org/jira/browse/HADOOP-7937) | Forward port SequenceFile#syncFs and friends from Hadoop 1.x | Major | io | Eli Collins | Tom White |
| [MAPREDUCE-3837](https://issues.apache.org/jira/browse/MAPREDUCE-3837) | Job tracker is not able to recover job in case of crash and after that no user can submit job. | Major | . | Mayank Bansal | Mayank Bansal |
@@ -46,13 +40,13 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7338](https://issues.apache.org/jira/browse/HADOOP-7338) | LocalDirAllocator improvements for MR-2178 | Major | . | Todd Lipcon | Benoy Antony |
-| [HADOOP-7272](https://issues.apache.org/jira/browse/HADOOP-7272) | Remove unnecessary security related info logs | Major | ipc, security | Suresh Srinivas | Suresh Srinivas |
| [HADOOP-6995](https://issues.apache.org/jira/browse/HADOOP-6995) | Allow wildcards to be used in ProxyUsers configurations | Minor | security | Todd Lipcon | Todd Lipcon |
-| [HDFS-2246](https://issues.apache.org/jira/browse/HDFS-2246) | Shortcut a local client reads to a Datanodes files directly | Major | . | Sanjay Radia | Jitendra Nath Pandey |
| [HDFS-1601](https://issues.apache.org/jira/browse/HDFS-1601) | Pipeline ACKs are sent as lots of tiny TCP packets | Major | datanode | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-4405](https://issues.apache.org/jira/browse/MAPREDUCE-4405) | Adding test case for HierarchicalQueue in TestJobQueueClient | Minor | client | Mayank Bansal | Mayank Bansal |
+| [HADOOP-7272](https://issues.apache.org/jira/browse/HADOOP-7272) | Remove unnecessary security related info logs | Major | ipc, security | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-2246](https://issues.apache.org/jira/browse/HDFS-2246) | Shortcut a local client reads to a Datanodes files directly | Major | . | Sanjay Radia | Jitendra Nath Pandey |
+| [HADOOP-7338](https://issues.apache.org/jira/browse/HADOOP-7338) | LocalDirAllocator improvements for MR-2178 | Major | . | Todd Lipcon | Benoy Antony |
| [MAPREDUCE-4403](https://issues.apache.org/jira/browse/MAPREDUCE-4403) | Adding test case for resubmission of jobs in TestRecoveryManager | Minor | jobtracker | Mayank Bansal | Mayank Bansal |
+| [MAPREDUCE-4405](https://issues.apache.org/jira/browse/MAPREDUCE-4405) | Adding test case for HierarchicalQueue in TestJobQueueClient | Minor | client | Mayank Bansal | Mayank Bansal |
| [MAPREDUCE-4349](https://issues.apache.org/jira/browse/MAPREDUCE-4349) | Distributed Cache gives inconsistent result if cache Archive files get deleted from task tracker | Minor | . | Mayank Bansal | Mayank Bansal |
| [MAPREDUCE-2353](https://issues.apache.org/jira/browse/MAPREDUCE-2353) | Make the MR changes to reflect the API changes in SecureIO library | Major | security, task, tasktracker | Devaraj Das | Benoy Antony |
| [MAPREDUCE-1521](https://issues.apache.org/jira/browse/MAPREDUCE-1521) | Protection against incorrectly configured reduces | Major | jobtracker | Arun C Murthy | Mahadev konar |
@@ -62,58 +56,52 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7680](https://issues.apache.org/jira/browse/HADOOP-7680) | TestHardLink fails on Mac OS X, when gnu stat is in path | Major | . | Milind Bhandarkar | Milind Bhandarkar |
+| [MAPREDUCE-2420](https://issues.apache.org/jira/browse/MAPREDUCE-2420) | JobTracker should be able to renew delegation token over HTTP | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [MAPREDUCE-2452](https://issues.apache.org/jira/browse/MAPREDUCE-2452) | Delegation token cancellation shouldn't hold global JobTracker lock | Major | jobtracker | Devaraj Das | Devaraj Das |
| [HADOOP-7621](https://issues.apache.org/jira/browse/HADOOP-7621) | alfredo config should be in a file not readable by users | Critical | security | Alejandro Abdelnur | Aaron T. Myers |
-| [HADOOP-7115](https://issues.apache.org/jira/browse/HADOOP-7115) | Add a cache for getpwuid\_r and getpwgid\_r calls | Major | . | Arun C Murthy | Alejandro Abdelnur |
-| [HDFS-3402](https://issues.apache.org/jira/browse/HDFS-3402) | Fix hdfs scripts for secure datanodes | Minor | scripts, security | Benoy Antony | Benoy Antony |
-| [HDFS-3368](https://issues.apache.org/jira/browse/HDFS-3368) | Missing blocks due to bad DataNodes coming up and down. | Major | namenode | Konstantin Shvachko | Konstantin Shvachko |
-| [HDFS-2991](https://issues.apache.org/jira/browse/HDFS-2991) | failure to load edits: ClassCastException | Blocker | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2877](https://issues.apache.org/jira/browse/HDFS-2877) | If locking of a storage dir fails, it will remove the other NN's lock file on exit | Major | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2718](https://issues.apache.org/jira/browse/HDFS-2718) | Optimize OP\_ADD in edits loading | Major | namenode | Konstantin Shvachko | Konstantin Shvachko |
| [HDFS-2698](https://issues.apache.org/jira/browse/HDFS-2698) | BackupNode is downloading image from NameNode for every checkpoint | Major | namenode | Konstantin Shvachko | Konstantin Shvachko |
| [HDFS-1910](https://issues.apache.org/jira/browse/HDFS-1910) | when dfs.name.dir and dfs.name.edits.dir are same fsimage will be saved twice every time | Minor | namenode | Gokul | |
-| [HDFS-1584](https://issues.apache.org/jira/browse/HDFS-1584) | Need to check TGT and renew if needed when fetching delegation tokens using HFTP | Major | security | Kan Zhang | Benoy Antony |
-| [MAPREDUCE-5706](https://issues.apache.org/jira/browse/MAPREDUCE-5706) | toBeDeleted parent directories aren't being cleaned up | Major | security | Robert Kanter | Robert Kanter |
-| [MAPREDUCE-4404](https://issues.apache.org/jira/browse/MAPREDUCE-4404) | Adding Test case for TestMRJobClient to verify the user name | Minor | client | Mayank Bansal | Mayank Bansal |
-| [MAPREDUCE-4360](https://issues.apache.org/jira/browse/MAPREDUCE-4360) | Capacity Scheduler Hierarchical leaf queue does not honor the max capacity of container queue | Major | . | Mayank Bansal | Mayank Bansal |
-| [MAPREDUCE-4318](https://issues.apache.org/jira/browse/MAPREDUCE-4318) | TestRecoveryManager should not use raw and deprecated configuration parameters. | Major | test | Konstantin Shvachko | Benoy Antony |
-| [MAPREDUCE-4314](https://issues.apache.org/jira/browse/MAPREDUCE-4314) | Synchronization in JvmManager for 0.22 branch | Major | tasktracker | Konstantin Shvachko | Benoy Antony |
+| [MAPREDUCE-3593](https://issues.apache.org/jira/browse/MAPREDUCE-3593) | MAPREDUCE Impersonation is not working in 22 | Major | job submission | Mayank Bansal | Mayank Bansal |
+| [MAPREDUCE-3725](https://issues.apache.org/jira/browse/MAPREDUCE-3725) | Hadoop 22 hadoop job -list returns user name as NULL | Major | client | Mayank Bansal | Mayank Bansal |
+| [HDFS-2718](https://issues.apache.org/jira/browse/HDFS-2718) | Optimize OP\_ADD in edits loading | Major | namenode | Konstantin Shvachko | Konstantin Shvachko |
+| [HDFS-2877](https://issues.apache.org/jira/browse/HDFS-2877) | If locking of a storage dir fails, it will remove the other NN's lock file on exit | Major | namenode | Todd Lipcon | Todd Lipcon |
+| [HADOOP-7680](https://issues.apache.org/jira/browse/HADOOP-7680) | TestHardLink fails on Mac OS X, when gnu stat is in path | Major | . | Milind Bhandarkar | Milind Bhandarkar |
+| [HDFS-2991](https://issues.apache.org/jira/browse/HDFS-2991) | failure to load edits: ClassCastException | Blocker | namenode | Todd Lipcon | Todd Lipcon |
| [MAPREDUCE-4164](https://issues.apache.org/jira/browse/MAPREDUCE-4164) | Hadoop 22 Exception thrown after task completion causes its reexecution | Major | tasktracker | Mayank Bansal | Mayank Bansal |
| [MAPREDUCE-3863](https://issues.apache.org/jira/browse/MAPREDUCE-3863) | 0.22 branch mvn deploy is not publishing hadoop-streaming JAR | Critical | build | Alejandro Abdelnur | Benoy Antony |
-| [MAPREDUCE-3725](https://issues.apache.org/jira/browse/MAPREDUCE-3725) | Hadoop 22 hadoop job -list returns user name as NULL | Major | client | Mayank Bansal | Mayank Bansal |
-| [MAPREDUCE-3593](https://issues.apache.org/jira/browse/MAPREDUCE-3593) | MAPREDUCE Impersonation is not working in 22 | Major | job submission | Mayank Bansal | Mayank Bansal |
-| [MAPREDUCE-2452](https://issues.apache.org/jira/browse/MAPREDUCE-2452) | Delegation token cancellation shouldn't hold global JobTracker lock | Major | jobtracker | Devaraj Das | Devaraj Das |
-| [MAPREDUCE-2420](https://issues.apache.org/jira/browse/MAPREDUCE-2420) | JobTracker should be able to renew delegation token over HTTP | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [MAPREDUCE-2377](https://issues.apache.org/jira/browse/MAPREDUCE-2377) | task-controller fails to parse configuration if it doesn't end in \n | Major | task-controller | Todd Lipcon | Benoy Antony |
+| [HDFS-3368](https://issues.apache.org/jira/browse/HDFS-3368) | Missing blocks due to bad DataNodes coming up and down. | Major | namenode | Konstantin Shvachko | Konstantin Shvachko |
| [MAPREDUCE-2178](https://issues.apache.org/jira/browse/MAPREDUCE-2178) | Race condition in LinuxTaskController permissions handling | Major | security, task-controller | Todd Lipcon | Benoy Antony |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [MAPREDUCE-4314](https://issues.apache.org/jira/browse/MAPREDUCE-4314) | Synchronization in JvmManager for 0.22 branch | Major | tasktracker | Konstantin Shvachko | Benoy Antony |
+| [MAPREDUCE-2377](https://issues.apache.org/jira/browse/MAPREDUCE-2377) | task-controller fails to parse configuration if it doesn't end in \\n | Major | task-controller | Todd Lipcon | Benoy Antony |
+| [MAPREDUCE-4318](https://issues.apache.org/jira/browse/MAPREDUCE-4318) | TestRecoveryManager should not use raw and deprecated configuration parameters. | Major | test | Konstantin Shvachko | Benoy Antony |
+| [MAPREDUCE-4360](https://issues.apache.org/jira/browse/MAPREDUCE-4360) | Capacity Scheduler Hierarchical leaf queue does not honor the max capacity of container queue | Major | . | Mayank Bansal | Mayank Bansal |
+| [HDFS-1584](https://issues.apache.org/jira/browse/HDFS-1584) | Need to check TGT and renew if needed when fetching delegation tokens using HFTP | Major | security | Kan Zhang | Benoy Antony |
+| [HDFS-3402](https://issues.apache.org/jira/browse/HDFS-3402) | Fix hdfs scripts for secure datanodes | Minor | scripts, security | Benoy Antony | Benoy Antony |
+| [HADOOP-7115](https://issues.apache.org/jira/browse/HADOOP-7115) | Add a cache for getpwuid\_r and getpwgid\_r calls | Major | . | Arun C Murthy | Alejandro Abdelnur |
+| [MAPREDUCE-4404](https://issues.apache.org/jira/browse/MAPREDUCE-4404) | Adding Test case for TestMRJobClient to verify the user name | Minor | client | Mayank Bansal | Mayank Bansal |
+| [MAPREDUCE-5706](https://issues.apache.org/jira/browse/MAPREDUCE-5706) | toBeDeleted parent directories aren't being cleaned up | Major | security | Robert Kanter | Robert Kanter |
### SUB-TASKS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8383](https://issues.apache.org/jira/browse/HADOOP-8383) | TestKerberosAuthenticator fails | Minor | security | Benoy Antony | Benoy Antony |
-| [HADOOP-8381](https://issues.apache.org/jira/browse/HADOOP-8381) | Substitute \_HOST with hostname for HTTP principals | Minor | security | Benoy Antony | Benoy Antony |
| [HDFS-2886](https://issues.apache.org/jira/browse/HDFS-2886) | CreateEditLogs should generate a realistic edit log. | Major | namenode | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-8381](https://issues.apache.org/jira/browse/HADOOP-8381) | Substitute \_HOST with hostname for HTTP principals | Minor | security | Benoy Antony | Benoy Antony |
+| [HADOOP-8383](https://issues.apache.org/jira/browse/HADOOP-8383) | TestKerberosAuthenticator fails | Minor | security | Benoy Antony | Benoy Antony |
### OTHER:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8357](https://issues.apache.org/jira/browse/HADOOP-8357) | Restore security in Hadoop 0.22 branch | Major | security | Konstantin Shvachko | Benoy Antony |
-| [MAPREDUCE-4249](https://issues.apache.org/jira/browse/MAPREDUCE-4249) | Fix failures in streaming test TestFileArgs | Minor | security | Benoy Antony | Benoy Antony |
-| [MAPREDUCE-4248](https://issues.apache.org/jira/browse/MAPREDUCE-4248) | TestRecoveryManager fails | Minor | security | Benoy Antony | Benoy Antony |
-| [MAPREDUCE-4247](https://issues.apache.org/jira/browse/MAPREDUCE-4247) | TestTaskTrackerLocalization fails | Minor | security | Benoy Antony | Benoy Antony |
-| [MAPREDUCE-4246](https://issues.apache.org/jira/browse/MAPREDUCE-4246) | Failure in deleting user directories in Secure hadoop | Major | security | Benoy Antony | Benoy Antony |
-| [MAPREDUCE-4244](https://issues.apache.org/jira/browse/MAPREDUCE-4244) | Fix an issue related to do with setting of correct groups for tasks | Minor | security | Benoy Antony | Benoy Antony |
-| [MAPREDUCE-4243](https://issues.apache.org/jira/browse/MAPREDUCE-4243) | Modify mapreduce build to include task-controller | Minor | build | Benoy Antony | Benoy Antony |
| [MAPREDUCE-4240](https://issues.apache.org/jira/browse/MAPREDUCE-4240) | Revert MAPREDUCE-2767 | Minor | security | Benoy Antony | Benoy Antony |
+| [MAPREDUCE-4243](https://issues.apache.org/jira/browse/MAPREDUCE-4243) | Modify mapreduce build to include task-controller | Minor | build | Benoy Antony | Benoy Antony |
+| [MAPREDUCE-4244](https://issues.apache.org/jira/browse/MAPREDUCE-4244) | Fix an issue related to do with setting of correct groups for tasks | Minor | security | Benoy Antony | Benoy Antony |
+| [MAPREDUCE-4246](https://issues.apache.org/jira/browse/MAPREDUCE-4246) | Failure in deleting user directories in Secure hadoop | Major | security | Benoy Antony | Benoy Antony |
+| [MAPREDUCE-4247](https://issues.apache.org/jira/browse/MAPREDUCE-4247) | TestTaskTrackerLocalization fails | Minor | security | Benoy Antony | Benoy Antony |
+| [MAPREDUCE-4248](https://issues.apache.org/jira/browse/MAPREDUCE-4248) | TestRecoveryManager fails | Minor | security | Benoy Antony | Benoy Antony |
+| [MAPREDUCE-4249](https://issues.apache.org/jira/browse/MAPREDUCE-4249) | Fix failures in streaming test TestFileArgs | Minor | security | Benoy Antony | Benoy Antony |
+| [HADOOP-8357](https://issues.apache.org/jira/browse/HADOOP-8357) | Restore security in Hadoop 0.22 branch | Major | security | Konstantin Shvachko | Benoy Antony |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.1/RELEASENOTES.0.22.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.1/RELEASENOTES.0.22.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.1/RELEASENOTES.0.22.1.md
index f08f501..9230479 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.1/RELEASENOTES.0.22.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.1/RELEASENOTES.0.22.1.md
@@ -23,13 +23,6 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-7119](https://issues.apache.org/jira/browse/HADOOP-7119) | *Major* | **add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles**
-
-Adding support for Kerberos HTTP SPNEGO authentication to the Hadoop web-consoles
-
-
----
-
* [HADOOP-6995](https://issues.apache.org/jira/browse/HADOOP-6995) | *Minor* | **Allow wildcards to be used in ProxyUsers configurations**
When configuring proxy users and hosts, the special wildcard value "\*" may be specified to match any host or any user.
@@ -37,9 +30,9 @@ When configuring proxy users and hosts, the special wildcard value "\*" may be s
---
-* [HADOOP-6453](https://issues.apache.org/jira/browse/HADOOP-6453) | *Minor* | **Hadoop wrapper script shouldn't ignore an existing JAVA\_LIBRARY\_PATH**
+* [HADOOP-7119](https://issues.apache.org/jira/browse/HADOOP-7119) | *Major* | **add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles**
-**WARNING: No release note provided for this incompatible change.**
+Adding support for Kerberos HTTP SPNEGO authentication to the Hadoop web-consoles
---
@@ -61,4 +54,9 @@ c. dfs.client.read.shortcircuit.skip.checksum is the key to bypass checksum chec
Submitting the patch after setting the user name at the client side
+---
+
+* [HADOOP-6453](https://issues.apache.org/jira/browse/HADOOP-6453) | *Minor* | **Hadoop wrapper script shouldn't ignore an existing JAVA\_LIBRARY\_PATH**
+
+**WARNING: No release note provided for this change.**
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[21/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.1/CHANGES.0.3.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.1/CHANGES.0.3.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.1/CHANGES.0.3.1.md
index 9bf1d66..c9c200c 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.1/CHANGES.0.3.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.1/CHANGES.0.3.1.md
@@ -20,56 +20,16 @@
## Release 0.3.1 - 2006-06-05
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-276](https://issues.apache.org/jira/browse/HADOOP-276) | No appenders could be found for logger | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-274](https://issues.apache.org/jira/browse/HADOOP-274) | The new logging framework puts application logs into server directory in hadoop.log | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-272](https://issues.apache.org/jira/browse/HADOOP-272) | bin/hadoop dfs -rm \<dir\> crashes in log4j code | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-274](https://issues.apache.org/jira/browse/HADOOP-274) | The new logging framework puts application logs into server directory in hadoop.log | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-262](https://issues.apache.org/jira/browse/HADOOP-262) | the reduce tasks do not report progress if they the map output locations is empty. | Major | . | Mahadev konar | Mahadev konar |
| [HADOOP-245](https://issues.apache.org/jira/browse/HADOOP-245) | record io translator doesn't strip path names | Major | record | Owen O'Malley | Milind Bhandarkar |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-276](https://issues.apache.org/jira/browse/HADOOP-276) | No appenders could be found for logger | Major | . | Owen O'Malley | Owen O'Malley |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.2/CHANGES.0.3.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.2/CHANGES.0.3.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.2/CHANGES.0.3.2.md
index dd30d8c..cb69295 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.2/CHANGES.0.3.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.2/CHANGES.0.3.2.md
@@ -20,16 +20,6 @@
## Release 0.3.2 - 2006-06-09
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
@@ -51,33 +41,15 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-294](https://issues.apache.org/jira/browse/HADOOP-294) | dfs client error retries aren't happening (already being created and not replicated yet) | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-292](https://issues.apache.org/jira/browse/HADOOP-292) | hadoop dfs commands should not output superfluous data to stdout | Minor | . | Yoram Arnon | Owen O'Malley |
-| [HADOOP-289](https://issues.apache.org/jira/browse/HADOOP-289) | Datanodes need to catch SocketTimeoutException and UnregisteredDatanodeException | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-285](https://issues.apache.org/jira/browse/HADOOP-285) | Data nodes cannot re-join the cluster once connection is lost | Blocker | . | Konstantin Shvachko | Hairong Kuang |
-| [HADOOP-284](https://issues.apache.org/jira/browse/HADOOP-284) | dfs timeout on open | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-282](https://issues.apache.org/jira/browse/HADOOP-282) | the datanode crashes if it starts before the namenode | Critical | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-280](https://issues.apache.org/jira/browse/HADOOP-280) | AllTestDriver has incorrect class name for DistributedFSCheck test | Major | . | Konstantin Shvachko | |
+| [HADOOP-240](https://issues.apache.org/jira/browse/HADOOP-240) | namenode should not log failed mkdirs at warning level | Minor | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-285](https://issues.apache.org/jira/browse/HADOOP-285) | Data nodes cannot re-join the cluster once connection is lost | Blocker | . | Konstantin Shvachko | Hairong Kuang |
| [HADOOP-277](https://issues.apache.org/jira/browse/HADOOP-277) | Race condition in Configuration.getLocalPath() | Major | . | p sutter | Sameer Paranjpye |
+| [HADOOP-282](https://issues.apache.org/jira/browse/HADOOP-282) | the datanode crashes if it starts before the namenode | Critical | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-289](https://issues.apache.org/jira/browse/HADOOP-289) | Datanodes need to catch SocketTimeoutException and UnregisteredDatanodeException | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-292](https://issues.apache.org/jira/browse/HADOOP-292) | hadoop dfs commands should not output superfluous data to stdout | Minor | . | Yoram Arnon | Owen O'Malley |
+| [HADOOP-294](https://issues.apache.org/jira/browse/HADOOP-294) | dfs client error retries aren't happening (already being created and not replicated yet) | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-242](https://issues.apache.org/jira/browse/HADOOP-242) | job fails because of "No valid local directories in property: " exception | Major | . | Yoram Arnon | Owen O'Malley |
-| [HADOOP-240](https://issues.apache.org/jira/browse/HADOOP-240) | namenode should not log failed mkdirs at warning level | Minor | . | Hairong Kuang | Hairong Kuang |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-284](https://issues.apache.org/jira/browse/HADOOP-284) | dfs timeout on open | Major | . | Owen O'Malley | Owen O'Malley |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.4.0/CHANGES.0.4.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.4.0/CHANGES.0.4.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.4.0/CHANGES.0.4.0.md
index ac6b87d..3ed4368 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.4.0/CHANGES.0.4.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.4.0/CHANGES.0.4.0.md
@@ -20,75 +20,47 @@
## Release 0.4.0 - 2006-06-28
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-296](https://issues.apache.org/jira/browse/HADOOP-296) | Do not assign blocks to a datanode with \< x mb free | Major | . | Johan Oskarsson | Johan Oskarsson |
| [HADOOP-250](https://issues.apache.org/jira/browse/HADOOP-250) | HTTP Browsing interface for DFS Health/Status | Major | . | Devaraj Das | |
| [HADOOP-123](https://issues.apache.org/jira/browse/HADOOP-123) | mini map/reduce cluster for junit tests | Major | . | Owen O'Malley | Milind Bhandarkar |
+| [HADOOP-296](https://issues.apache.org/jira/browse/HADOOP-296) | Do not assign blocks to a datanode with \< x mb free | Major | . | Johan Oskarsson | Johan Oskarsson |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-328](https://issues.apache.org/jira/browse/HADOOP-328) | add a -i option to distcp to ignore read errors of the input files | Major | util | Owen O'Malley | Owen O'Malley |
-| [HADOOP-326](https://issues.apache.org/jira/browse/HADOOP-326) | cleanup of dead field (map ouput port) | Minor | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-314](https://issues.apache.org/jira/browse/HADOOP-314) | remove the append phase in sorting the reduce inputs | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-305](https://issues.apache.org/jira/browse/HADOOP-305) | tasktracker waits for 10 seconds for asking for a task. | Minor | . | Mahadev konar | Mahadev konar |
-| [HADOOP-301](https://issues.apache.org/jira/browse/HADOOP-301) | the randomwriter example will clobber the output file | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-298](https://issues.apache.org/jira/browse/HADOOP-298) | nicer reports of progress for distcp | Minor | util | Owen O'Malley | Owen O'Malley |
| [HADOOP-271](https://issues.apache.org/jira/browse/HADOOP-271) | add links to task tracker http server from task details and failure pages | Minor | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-314](https://issues.apache.org/jira/browse/HADOOP-314) | remove the append phase in sorting the reduce inputs | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-301](https://issues.apache.org/jira/browse/HADOOP-301) | the randomwriter example will clobber the output file | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-305](https://issues.apache.org/jira/browse/HADOOP-305) | tasktracker waits for 10 seconds for asking for a task. | Minor | . | Mahadev konar | Mahadev konar |
| [HADOOP-59](https://issues.apache.org/jira/browse/HADOOP-59) | support generic command-line options | Minor | conf | Doug Cutting | Hairong Kuang |
+| [HADOOP-326](https://issues.apache.org/jira/browse/HADOOP-326) | cleanup of dead field (map ouput port) | Minor | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-328](https://issues.apache.org/jira/browse/HADOOP-328) | add a -i option to distcp to ignore read errors of the input files | Major | util | Owen O'Malley | Owen O'Malley |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-325](https://issues.apache.org/jira/browse/HADOOP-325) | ClassNotFoundException under jvm 1.6 | Major | ipc | Owen O'Malley | Owen O'Malley |
-| [HADOOP-319](https://issues.apache.org/jira/browse/HADOOP-319) | FileSystem "close" does not remove the closed fs from the fs map | Major | fs | Hairong Kuang | Hairong Kuang |
-| [HADOOP-318](https://issues.apache.org/jira/browse/HADOOP-318) | Progress in writing a DFS file does not count towards Job progress and can make the task timeout | Major | . | Milind Bhandarkar | Milind Bhandarkar |
-| [HADOOP-317](https://issues.apache.org/jira/browse/HADOOP-317) | "connection was forcibly closed" Exception in RPC on Windows | Major | ipc | Konstantin Shvachko | Doug Cutting |
-| [HADOOP-316](https://issues.apache.org/jira/browse/HADOOP-316) | job tracker has a deadlock | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-311](https://issues.apache.org/jira/browse/HADOOP-311) | dfs client timeout on read kills task | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-304](https://issues.apache.org/jira/browse/HADOOP-304) | UnregisteredDatanodeException message correction | Trivial | . | Konstantin Shvachko | Konstantin Shvachko |
| [HADOOP-299](https://issues.apache.org/jira/browse/HADOOP-299) | maps from second jobs will not run until the first job finishes completely | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-278](https://issues.apache.org/jira/browse/HADOOP-278) | a missing map/reduce input directory does not produce a user-visible error message | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-210](https://issues.apache.org/jira/browse/HADOOP-210) | Namenode not able to accept connections | Major | . | Mahadev konar | Devaraj Das |
+| [HADOOP-311](https://issues.apache.org/jira/browse/HADOOP-311) | dfs client timeout on read kills task | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-316](https://issues.apache.org/jira/browse/HADOOP-316) | job tracker has a deadlock | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-317](https://issues.apache.org/jira/browse/HADOOP-317) | "connection was forcibly closed" Exception in RPC on Windows | Major | ipc | Konstantin Shvachko | Doug Cutting |
+| [HADOOP-319](https://issues.apache.org/jira/browse/HADOOP-319) | FileSystem "close" does not remove the closed fs from the fs map | Major | fs | Hairong Kuang | Hairong Kuang |
| [HADOOP-135](https://issues.apache.org/jira/browse/HADOOP-135) | Potential deadlock in JobTracker. | Major | . | Konstantin Shvachko | Owen O'Malley |
-| [HADOOP-99](https://issues.apache.org/jira/browse/HADOOP-99) | task trackers can only be assigned one task every heartbeat | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-278](https://issues.apache.org/jira/browse/HADOOP-278) | a missing map/reduce input directory does not produce a user-visible error message | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-304](https://issues.apache.org/jira/browse/HADOOP-304) | UnregisteredDatanodeException message correction | Trivial | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-325](https://issues.apache.org/jira/browse/HADOOP-325) | ClassNotFoundException under jvm 1.6 | Major | ipc | Owen O'Malley | Owen O'Malley |
| [HADOOP-27](https://issues.apache.org/jira/browse/HADOOP-27) | MapRed tries to allocate tasks to nodes that have no available disk space | Major | . | Mike Cafarella | |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-99](https://issues.apache.org/jira/browse/HADOOP-99) | task trackers can only be assigned one task every heartbeat | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-318](https://issues.apache.org/jira/browse/HADOOP-318) | Progress in writing a DFS file does not count towards Job progress and can make the task timeout | Major | . | Milind Bhandarkar | Milind Bhandarkar |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.5.0/CHANGES.0.5.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.5.0/CHANGES.0.5.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.5.0/CHANGES.0.5.0.md
index e7c8244..483da0a 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.5.0/CHANGES.0.5.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.5.0/CHANGES.0.5.0.md
@@ -20,102 +20,86 @@
## Release 0.5.0 - 2006-08-04
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-425](https://issues.apache.org/jira/browse/HADOOP-425) | a python word count example that runs under jython | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-412](https://issues.apache.org/jira/browse/HADOOP-412) | provide an input format that fetches a subset of sequence file records | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-386](https://issues.apache.org/jira/browse/HADOOP-386) | Periodically move blocks from full nodes to those with space | Major | . | Johan Oskarsson | Johan Oskarsson |
-| [HADOOP-381](https://issues.apache.org/jira/browse/HADOOP-381) | keeping files for tasks that match regex on task id | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-369](https://issues.apache.org/jira/browse/HADOOP-369) | Added ability to copy all part-files into one output file | Trivial | . | Johan Oskarsson | Johan Oskarsson |
+| [HADOOP-339](https://issues.apache.org/jira/browse/HADOOP-339) | making improvements to the jobclients to get information on currenlyl running jobs and the jobqueue | Minor | . | Mahadev konar | Mahadev konar |
| [HADOOP-359](https://issues.apache.org/jira/browse/HADOOP-359) | add optional compression of map outputs | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-347](https://issues.apache.org/jira/browse/HADOOP-347) | Implement HDFS content browsing interface | Major | . | Devaraj Das | Devaraj Das |
| [HADOOP-342](https://issues.apache.org/jira/browse/HADOOP-342) | Design/Implement a tool to support archival and analysis of logfiles. | Major | . | Arun C Murthy | |
-| [HADOOP-339](https://issues.apache.org/jira/browse/HADOOP-339) | making improvements to the jobclients to get information on currenlyl running jobs and the jobqueue | Minor | . | Mahadev konar | Mahadev konar |
+| [HADOOP-347](https://issues.apache.org/jira/browse/HADOOP-347) | Implement HDFS content browsing interface | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-381](https://issues.apache.org/jira/browse/HADOOP-381) | keeping files for tasks that match regex on task id | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-386](https://issues.apache.org/jira/browse/HADOOP-386) | Periodically move blocks from full nodes to those with space | Major | . | Johan Oskarsson | Johan Oskarsson |
+| [HADOOP-369](https://issues.apache.org/jira/browse/HADOOP-369) | Added ability to copy all part-files into one output file | Trivial | . | Johan Oskarsson | Johan Oskarsson |
+| [HADOOP-412](https://issues.apache.org/jira/browse/HADOOP-412) | provide an input format that fetches a subset of sequence file records | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-425](https://issues.apache.org/jira/browse/HADOOP-425) | a python word count example that runs under jython | Major | . | Owen O'Malley | Owen O'Malley |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-410](https://issues.apache.org/jira/browse/HADOOP-410) | Using HashMap instead of TreeMap for some maps in Namenode yields 17% performance improvement | Major | . | Milind Bhandarkar | Milind Bhandarkar |
-| [HADOOP-409](https://issues.apache.org/jira/browse/HADOOP-409) | expose JobConf properties as environment variables | Major | . | Michel Tourn | |
-| [HADOOP-396](https://issues.apache.org/jira/browse/HADOOP-396) | Writable DatanodeID | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-395](https://issues.apache.org/jira/browse/HADOOP-395) | infoPort field should be a DatanodeID member | Major | . | Konstantin Shvachko | Devaraj Das |
-| [HADOOP-394](https://issues.apache.org/jira/browse/HADOOP-394) | MiniDFSCluster shudown order | Minor | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-392](https://issues.apache.org/jira/browse/HADOOP-392) | Improve the UI for DFS content browsing | Major | . | Devaraj Das | |
+| [HADOOP-340](https://issues.apache.org/jira/browse/HADOOP-340) | Using wildcards in config pathnames | Minor | conf | Johan Oskarsson | Doug Cutting |
+| [HADOOP-355](https://issues.apache.org/jira/browse/HADOOP-355) | hadoopStreaming: fix APIs, -reduce NONE, StreamSequenceRecordReader | Major | . | Michel Tourn | |
| [HADOOP-361](https://issues.apache.org/jira/browse/HADOOP-361) | junit with pure-Java hadoopStreaming combiner; remove CRLF in some files | Major | . | Michel Tourn | |
+| [HADOOP-252](https://issues.apache.org/jira/browse/HADOOP-252) | add versioning to RPC | Major | ipc | Yoram Arnon | |
| [HADOOP-356](https://issues.apache.org/jira/browse/HADOOP-356) | Build and test hadoopStreaming nightly | Major | . | Michel Tourn | |
-| [HADOOP-355](https://issues.apache.org/jira/browse/HADOOP-355) | hadoopStreaming: fix APIs, -reduce NONE, StreamSequenceRecordReader | Major | . | Michel Tourn | |
-| [HADOOP-345](https://issues.apache.org/jira/browse/HADOOP-345) | JobConf access to name-values | Major | . | Michel Tourn | Michel Tourn |
| [HADOOP-341](https://issues.apache.org/jira/browse/HADOOP-341) | Enhance distcp to handle \*http\* as a 'source protocol'. | Major | util | Arun C Murthy | Arun C Murthy |
-| [HADOOP-340](https://issues.apache.org/jira/browse/HADOOP-340) | Using wildcards in config pathnames | Minor | conf | Johan Oskarsson | Doug Cutting |
-| [HADOOP-335](https://issues.apache.org/jira/browse/HADOOP-335) | factor out the namespace image/transaction log writing | Major | . | Owen O'Malley | Konstantin Shvachko |
+| [HADOOP-237](https://issues.apache.org/jira/browse/HADOOP-237) | Standard set of Performance Metrics for Hadoop | Major | metrics | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-260](https://issues.apache.org/jira/browse/HADOOP-260) | the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines | Minor | . | Mahadev konar | Milind Bhandarkar |
| [HADOOP-321](https://issues.apache.org/jira/browse/HADOOP-321) | DatanodeInfo refactoring | Major | . | Konstantin Shvachko | Konstantin Shvachko |
| [HADOOP-302](https://issues.apache.org/jira/browse/HADOOP-302) | class Text (replacement for class UTF8) was: HADOOP-136 | Major | io | Michel Tourn | Hairong Kuang |
-| [HADOOP-260](https://issues.apache.org/jira/browse/HADOOP-260) | the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines | Minor | . | Mahadev konar | Milind Bhandarkar |
-| [HADOOP-252](https://issues.apache.org/jira/browse/HADOOP-252) | add versioning to RPC | Major | ipc | Yoram Arnon | |
-| [HADOOP-237](https://issues.apache.org/jira/browse/HADOOP-237) | Standard set of Performance Metrics for Hadoop | Major | metrics | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-335](https://issues.apache.org/jira/browse/HADOOP-335) | factor out the namespace image/transaction log writing | Major | . | Owen O'Malley | Konstantin Shvachko |
+| [HADOOP-396](https://issues.apache.org/jira/browse/HADOOP-396) | Writable DatanodeID | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-395](https://issues.apache.org/jira/browse/HADOOP-395) | infoPort field should be a DatanodeID member | Major | . | Konstantin Shvachko | Devaraj Das |
+| [HADOOP-345](https://issues.apache.org/jira/browse/HADOOP-345) | JobConf access to name-values | Major | . | Michel Tourn | Michel Tourn |
+| [HADOOP-409](https://issues.apache.org/jira/browse/HADOOP-409) | expose JobConf properties as environment variables | Major | . | Michel Tourn | |
+| [HADOOP-392](https://issues.apache.org/jira/browse/HADOOP-392) | Improve the UI for DFS content browsing | Major | . | Devaraj Das | |
+| [HADOOP-410](https://issues.apache.org/jira/browse/HADOOP-410) | Using HashMap instead of TreeMap for some maps in Namenode yields 17% performance improvement | Major | . | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-394](https://issues.apache.org/jira/browse/HADOOP-394) | MiniDFSCluster shudown order | Minor | . | Konstantin Shvachko | Konstantin Shvachko |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-415](https://issues.apache.org/jira/browse/HADOOP-415) | DFSNodesStatus() should sort data nodes. | Major | . | Konstantin Shvachko | |
-| [HADOOP-404](https://issues.apache.org/jira/browse/HADOOP-404) | Regression tests are not working. | Major | . | Mahadev konar | |
-| [HADOOP-393](https://issues.apache.org/jira/browse/HADOOP-393) | The validateUTF function of class Text throws MalformedInputException for valid UTF8 code containing ascii chars | Major | io | Hairong Kuang | Hairong Kuang |
-| [HADOOP-391](https://issues.apache.org/jira/browse/HADOOP-391) | test-contrib with spaces in classpath (Windows) | Major | . | Michel Tourn | |
-| [HADOOP-389](https://issues.apache.org/jira/browse/HADOOP-389) | MiniMapReduce tests get stuck because of some timing issues with initialization of tasktrackers. | Major | . | Mahadev konar | Mahadev konar |
-| [HADOOP-388](https://issues.apache.org/jira/browse/HADOOP-388) | the hadoop-daemons.sh fails with "no such file or directory" when used from a relative path | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-387](https://issues.apache.org/jira/browse/HADOOP-387) | LocalJobRunner assigns duplicate mapid's | Major | . | Sami Siren | |
-| [HADOOP-385](https://issues.apache.org/jira/browse/HADOOP-385) | rcc does not generate correct Java code for the field of a record type | Major | . | Hairong Kuang | Milind Bhandarkar |
+| [HADOOP-352](https://issues.apache.org/jira/browse/HADOOP-352) | Portability of hadoop shell scripts for deployment | Major | . | Jean-Baptiste Quenot | |
+| [HADOOP-313](https://issues.apache.org/jira/browse/HADOOP-313) | A stand alone driver for individual tasks | Major | . | Michel Tourn | Michel Tourn |
+| [HADOOP-358](https://issues.apache.org/jira/browse/HADOOP-358) | NPE in Path.equals | Major | fs | Frédéric Bertin | Doug Cutting |
+| [HADOOP-327](https://issues.apache.org/jira/browse/HADOOP-327) | ToolBase calls System.exit | Major | util | Owen O'Malley | Hairong Kuang |
+| [HADOOP-360](https://issues.apache.org/jira/browse/HADOOP-360) | hadoop-daemon starts but does not stop servers under cygWin | Major | . | Konstantin Shvachko | |
+| [HADOOP-354](https://issues.apache.org/jira/browse/HADOOP-354) | All daemons should have public methods to start and stop them | Major | . | Barry Kaplan | |
+| [HADOOP-364](https://issues.apache.org/jira/browse/HADOOP-364) | rpc versioning broke out-of-order server launches | Major | ipc | Owen O'Malley | Owen O'Malley |
+| [HADOOP-365](https://issues.apache.org/jira/browse/HADOOP-365) | datanode crashes on startup with ClassCastException | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-350](https://issues.apache.org/jira/browse/HADOOP-350) | In standalone mode, 'org.apache.commons.cli cannot be resolved' | Minor | . | stack | |
+| [HADOOP-368](https://issues.apache.org/jira/browse/HADOOP-368) | DistributedFSCheck should cleanup, seek, and report missing files. | Minor | fs | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-376](https://issues.apache.org/jira/browse/HADOOP-376) | Datanode does not scan for an open http port | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-384](https://issues.apache.org/jira/browse/HADOOP-384) | improved error messages for file checksum errors | Minor | fs | Owen O'Malley | Owen O'Malley |
+| [HADOOP-344](https://issues.apache.org/jira/browse/HADOOP-344) | TaskTracker passes incorrect file path to DF under cygwin | Major | . | Konstantin Shvachko | Konstantin Shvachko |
| [HADOOP-383](https://issues.apache.org/jira/browse/HADOOP-383) | unit tests fail on windows | Major | . | Owen O'Malley | Michel Tourn |
| [HADOOP-380](https://issues.apache.org/jira/browse/HADOOP-380) | The reduce tasks poll for mapoutputs in a loop | Major | . | Mahadev konar | Mahadev konar |
-| [HADOOP-377](https://issues.apache.org/jira/browse/HADOOP-377) | Configuration does not handle URL | Major | . | Jean-Baptiste Quenot | |
-| [HADOOP-376](https://issues.apache.org/jira/browse/HADOOP-376) | Datanode does not scan for an open http port | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-387](https://issues.apache.org/jira/browse/HADOOP-387) | LocalJobRunner assigns duplicate mapid's | Major | . | Sami Siren | |
+| [HADOOP-385](https://issues.apache.org/jira/browse/HADOOP-385) | rcc does not generate correct Java code for the field of a record type | Major | . | Hairong Kuang | Milind Bhandarkar |
+| [HADOOP-388](https://issues.apache.org/jira/browse/HADOOP-388) | the hadoop-daemons.sh fails with "no such file or directory" when used from a relative path | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-375](https://issues.apache.org/jira/browse/HADOOP-375) | Introduce a way for datanodes to register their HTTP info ports with the NameNode | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-368](https://issues.apache.org/jira/browse/HADOOP-368) | DistributedFSCheck should cleanup, seek, and report missing files. | Minor | fs | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-365](https://issues.apache.org/jira/browse/HADOOP-365) | datanode crashes on startup with ClassCastException | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-364](https://issues.apache.org/jira/browse/HADOOP-364) | rpc versioning broke out-of-order server launches | Major | ipc | Owen O'Malley | Owen O'Malley |
+| [HADOOP-389](https://issues.apache.org/jira/browse/HADOOP-389) | MiniMapReduce tests get stuck because of some timing issues with initialization of tasktrackers. | Major | . | Mahadev konar | Mahadev konar |
+| [HADOOP-391](https://issues.apache.org/jira/browse/HADOOP-391) | test-contrib with spaces in classpath (Windows) | Major | . | Michel Tourn | |
| [HADOOP-362](https://issues.apache.org/jira/browse/HADOOP-362) | tasks can get lost when reporting task completion to the JobTracker has an error | Major | . | Devaraj Das | Owen O'Malley |
-| [HADOOP-360](https://issues.apache.org/jira/browse/HADOOP-360) | hadoop-daemon starts but does not stop servers under cygWin | Major | . | Konstantin Shvachko | |
-| [HADOOP-358](https://issues.apache.org/jira/browse/HADOOP-358) | NPE in Path.equals | Major | fs | Frédéric Bertin | Doug Cutting |
-| [HADOOP-354](https://issues.apache.org/jira/browse/HADOOP-354) | All daemons should have public methods to start and stop them | Major | . | Barry Kaplan | |
-| [HADOOP-352](https://issues.apache.org/jira/browse/HADOOP-352) | Portability of hadoop shell scripts for deployment | Major | . | Jean-Baptiste Quenot | |
-| [HADOOP-350](https://issues.apache.org/jira/browse/HADOOP-350) | In standalone mode, 'org.apache.commons.cli cannot be resolved' | Minor | . | stack | |
-| [HADOOP-344](https://issues.apache.org/jira/browse/HADOOP-344) | TaskTracker passes incorrect file path to DF under cygwin | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-327](https://issues.apache.org/jira/browse/HADOOP-327) | ToolBase calls System.exit | Major | util | Owen O'Malley | Hairong Kuang |
-| [HADOOP-313](https://issues.apache.org/jira/browse/HADOOP-313) | A stand alone driver for individual tasks | Major | . | Michel Tourn | Michel Tourn |
+| [HADOOP-393](https://issues.apache.org/jira/browse/HADOOP-393) | The validateUTF function of class Text throws MalformedInputException for valid UTF8 code containing ascii chars | Major | io | Hairong Kuang | Hairong Kuang |
+| [HADOOP-404](https://issues.apache.org/jira/browse/HADOOP-404) | Regression tests are not working. | Major | . | Mahadev konar | |
+| [HADOOP-377](https://issues.apache.org/jira/browse/HADOOP-377) | Configuration does not handle URL | Major | . | Jean-Baptiste Quenot | |
| [HADOOP-226](https://issues.apache.org/jira/browse/HADOOP-226) | DFSShell problems. Incorrect block replication detection in fsck. | Major | . | Konstantin Shvachko | |
+| [HADOOP-415](https://issues.apache.org/jira/browse/HADOOP-415) | DFSNodesStatus() should sort data nodes. | Major | . | Konstantin Shvachko | |
### TESTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-418](https://issues.apache.org/jira/browse/HADOOP-418) | hadoopStreaming test jobconf -\> env.var. mapping | Major | . | Michel Tourn | |
| [HADOOP-411](https://issues.apache.org/jira/browse/HADOOP-411) | junit test for HADOOP-59: support generic command-line options | Major | . | Hairong Kuang | Hairong Kuang |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-418](https://issues.apache.org/jira/browse/HADOOP-418) | hadoopStreaming test jobconf -\> env.var. mapping | Major | . | Michel Tourn | |
### OTHER:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.6.0/CHANGES.0.6.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.6.0/CHANGES.0.6.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.6.0/CHANGES.0.6.0.md
index 0e2b761..10ebc37 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.6.0/CHANGES.0.6.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.6.0/CHANGES.0.6.0.md
@@ -20,86 +20,64 @@
## Release 0.6.0 - 2006-09-08
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-497](https://issues.apache.org/jira/browse/HADOOP-497) | DataNodes and TaskTrackers should be able to report hostnames and ips relative to customizable network interfaces and nameservers | Minor | util | Lorenzo Thione | Lorenzo Thione |
| [HADOOP-456](https://issues.apache.org/jira/browse/HADOOP-456) | Checkpointing and logging of data node descriptors | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-441](https://issues.apache.org/jira/browse/HADOOP-441) | SequenceFile should support 'custom compressors' | Major | io | Arun C Murthy | Arun C Murthy |
| [HADOOP-322](https://issues.apache.org/jira/browse/HADOOP-322) | Need a job control utility to submit and monitor a group of jobs which have DAG dependency | Major | . | Runping Qi | Runping Qi |
+| [HADOOP-497](https://issues.apache.org/jira/browse/HADOOP-497) | DataNodes and TaskTrackers should be able to report hostnames and ips relative to customizable network interfaces and nameservers | Minor | util | Lorenzo Thione | Lorenzo Thione |
+| [HADOOP-441](https://issues.apache.org/jira/browse/HADOOP-441) | SequenceFile should support 'custom compressors' | Major | io | Arun C Murthy | Arun C Murthy |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-499](https://issues.apache.org/jira/browse/HADOOP-499) | Avoid the use of Strings to improve the performance of hadoop streaming | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-488](https://issues.apache.org/jira/browse/HADOOP-488) | Change ToolBase.doMain() to return a status code | Major | . | Andrzej Bialecki | |
-| [HADOOP-486](https://issues.apache.org/jira/browse/HADOOP-486) | adding username to jobstatus | Minor | . | Mahadev konar | Mahadev konar |
-| [HADOOP-483](https://issues.apache.org/jira/browse/HADOOP-483) | Document libhdfs and fix some OS specific stuff in Makefile | Major | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-474](https://issues.apache.org/jira/browse/HADOOP-474) | support compressed text files as input and output | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-468](https://issues.apache.org/jira/browse/HADOOP-468) | Setting scheduling priority in hadoop-env.sh | Minor | . | Vetle Roeim | |
-| [HADOOP-464](https://issues.apache.org/jira/browse/HADOOP-464) | Troubleshooting message for RunJar (bin/hadoop jar) | Major | util | Michel Tourn | |
-| [HADOOP-463](https://issues.apache.org/jira/browse/HADOOP-463) | variable expansion in Configuration | Major | conf | Michel Tourn | |
| [HADOOP-450](https://issues.apache.org/jira/browse/HADOOP-450) | Remove the need for users to specify the types of the inputs | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-464](https://issues.apache.org/jira/browse/HADOOP-464) | Troubleshooting message for RunJar (bin/hadoop jar) | Major | util | Michel Tourn | |
+| [HADOOP-468](https://issues.apache.org/jira/browse/HADOOP-468) | Setting scheduling priority in hadoop-env.sh | Minor | . | Vetle Roeim | |
+| [HADOOP-54](https://issues.apache.org/jira/browse/HADOOP-54) | SequenceFile should compress blocks, not individual entries | Major | io | Doug Cutting | Arun C Murthy |
+| [HADOOP-486](https://issues.apache.org/jira/browse/HADOOP-486) | adding username to jobstatus | Minor | . | Mahadev konar | Mahadev konar |
| [HADOOP-437](https://issues.apache.org/jira/browse/HADOOP-437) | support gzip input files | Major | . | Michel Tourn | |
-| [HADOOP-312](https://issues.apache.org/jira/browse/HADOOP-312) | Connections should not be cached | Major | ipc | Devaraj Das | Devaraj Das |
+| [HADOOP-463](https://issues.apache.org/jira/browse/HADOOP-463) | variable expansion in Configuration | Major | conf | Michel Tourn | |
+| [HADOOP-488](https://issues.apache.org/jira/browse/HADOOP-488) | Change ToolBase.doMain() to return a status code | Major | . | Andrzej Bialecki | |
+| [HADOOP-499](https://issues.apache.org/jira/browse/HADOOP-499) | Avoid the use of Strings to improve the performance of hadoop streaming | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-64](https://issues.apache.org/jira/browse/HADOOP-64) | DataNode should be capable of managing multiple volumes | Minor | . | Sameer Paranjpye | Milind Bhandarkar |
-| [HADOOP-54](https://issues.apache.org/jira/browse/HADOOP-54) | SequenceFile should compress blocks, not individual entries | Major | io | Doug Cutting | Arun C Murthy |
+| [HADOOP-312](https://issues.apache.org/jira/browse/HADOOP-312) | Connections should not be cached | Major | ipc | Devaraj Das | Devaraj Das |
+| [HADOOP-483](https://issues.apache.org/jira/browse/HADOOP-483) | Document libhdfs and fix some OS specific stuff in Makefile | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-474](https://issues.apache.org/jira/browse/HADOOP-474) | support compressed text files as input and output | Major | . | Owen O'Malley | Owen O'Malley |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-517](https://issues.apache.org/jira/browse/HADOOP-517) | readLine function of UTF8ByteArrayUtils does not handle end of line correctly | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-507](https://issues.apache.org/jira/browse/HADOOP-507) | Runtime exception in org.apache.hadoop.io.WritableFactories.newInstance when trying to startup namenode/datanode | Major | util | Arun C Murthy | Owen O'Malley |
-| [HADOOP-501](https://issues.apache.org/jira/browse/HADOOP-501) | toString(resources, sb) in Configuration.java throws a ClassCastException since resources can be loaded from an URL | Minor | . | Thomas Friol | |
-| [HADOOP-473](https://issues.apache.org/jira/browse/HADOOP-473) | TextInputFormat does not correctly handle all line endings | Major | . | Dennis Kubes | |
-| [HADOOP-469](https://issues.apache.org/jira/browse/HADOOP-469) | Portability of hadoop shell scripts for deployment | Major | . | Jean-Baptiste Quenot | |
-| [HADOOP-460](https://issues.apache.org/jira/browse/HADOOP-460) | Small jobs benchmark fails with current Hadoop due to UTF8 -\> Text ClassCastException | Major | . | Sanjay Dahiya | |
-| [HADOOP-458](https://issues.apache.org/jira/browse/HADOOP-458) | libhdfs corrupts memory | Major | . | Christian Kunz | Konstantin Shvachko |
-| [HADOOP-455](https://issues.apache.org/jira/browse/HADOOP-455) | Text class should support the DEL character | Major | io | Hairong Kuang | Hairong Kuang |
-| [HADOOP-453](https://issues.apache.org/jira/browse/HADOOP-453) | bug in Text.setCapacity( int len ) | Minor | . | Sami Siren | |
-| [HADOOP-434](https://issues.apache.org/jira/browse/HADOOP-434) | Use Hadoop scripts to run smallJobsBenchmark to avoid classpath issues. | Major | . | Sanjay Dahiya | Sanjay Dahiya |
| [HADOOP-427](https://issues.apache.org/jira/browse/HADOOP-427) | DatanodeInfo class should be used instead of DatanodeDescriptor in the jsp & related files | Major | . | Devaraj Das | Devaraj Das |
| [HADOOP-426](https://issues.apache.org/jira/browse/HADOOP-426) | streaming unit tests failing on SunOS | Major | . | Doug Cutting | Michel Tourn |
-| [HADOOP-424](https://issues.apache.org/jira/browse/HADOOP-424) | mapreduce jobs fail when no split is returned via inputFormat.getSplits | Major | . | Frédéric Bertin | |
-| [HADOOP-421](https://issues.apache.org/jira/browse/HADOOP-421) | replace String in hadoop record io with the new Text class | Major | record | Owen O'Malley | Milind Bhandarkar |
-| [HADOOP-419](https://issues.apache.org/jira/browse/HADOOP-419) | libdfs doesn't work with application threads | Major | . | Christian Kunz | Owen O'Malley |
| [HADOOP-400](https://issues.apache.org/jira/browse/HADOOP-400) | the job tracker re-runs failed tasks on the same node | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-324](https://issues.apache.org/jira/browse/HADOOP-324) | "IOException: No space left on device" is handled incorrectly | Major | . | Konstantin Shvachko | Wendy Chien |
-| [HADOOP-320](https://issues.apache.org/jira/browse/HADOOP-320) | bin/hadoop dfs -mv does not mv source's checksum file if source is a file | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-286](https://issues.apache.org/jira/browse/HADOOP-286) | copyFromLocal throws LeaseExpiredException | Major | . | Runping Qi | Konstantin Shvachko |
+| [HADOOP-434](https://issues.apache.org/jira/browse/HADOOP-434) | Use Hadoop scripts to run smallJobsBenchmark to avoid classpath issues. | Major | . | Sanjay Dahiya | Sanjay Dahiya |
+| [HADOOP-453](https://issues.apache.org/jira/browse/HADOOP-453) | bug in Text.setCapacity( int len ) | Minor | . | Sami Siren | |
+| [HADOOP-455](https://issues.apache.org/jira/browse/HADOOP-455) | Text class should support the DEL character | Major | io | Hairong Kuang | Hairong Kuang |
+| [HADOOP-176](https://issues.apache.org/jira/browse/HADOOP-176) | comparators of integral writable types are not transitive for inequalities | Major | io | Dick King | |
+| [HADOOP-421](https://issues.apache.org/jira/browse/HADOOP-421) | replace String in hadoop record io with the new Text class | Major | record | Owen O'Malley | Milind Bhandarkar |
+| [HADOOP-469](https://issues.apache.org/jira/browse/HADOOP-469) | Portability of hadoop shell scripts for deployment | Major | . | Jean-Baptiste Quenot | |
+| [HADOOP-473](https://issues.apache.org/jira/browse/HADOOP-473) | TextInputFormat does not correctly handle all line endings | Major | . | Dennis Kubes | |
| [HADOOP-281](https://issues.apache.org/jira/browse/HADOOP-281) | dfs.FSDirectory.mkdirs can create sub-directories of a file! | Major | . | Sameer Paranjpye | Wendy Chien |
+| [HADOOP-419](https://issues.apache.org/jira/browse/HADOOP-419) | libdfs doesn't work with application threads | Major | . | Christian Kunz | Owen O'Malley |
+| [HADOOP-460](https://issues.apache.org/jira/browse/HADOOP-460) | Small jobs benchmark fails with current Hadoop due to UTF8 -\> Text ClassCastException | Major | . | Sanjay Dahiya | |
| [HADOOP-196](https://issues.apache.org/jira/browse/HADOOP-196) | Fix buggy uselessness of Configuration( Configuration other) constructor | Major | conf | alan wootton | |
-| [HADOOP-176](https://issues.apache.org/jira/browse/HADOOP-176) | comparators of integral writable types are not transitive for inequalities | Major | io | Dick King | |
+| [HADOOP-501](https://issues.apache.org/jira/browse/HADOOP-501) | toString(resources, sb) in Configuration.java throws a ClassCastException since resources can be loaded from an URL | Minor | . | Thomas Friol | |
+| [HADOOP-424](https://issues.apache.org/jira/browse/HADOOP-424) | mapreduce jobs fail when no split is returned via inputFormat.getSplits | Major | . | Frédéric Bertin | |
+| [HADOOP-507](https://issues.apache.org/jira/browse/HADOOP-507) | Runtime exception in org.apache.hadoop.io.WritableFactories.newInstance when trying to startup namenode/datanode | Major | util | Arun C Murthy | Owen O'Malley |
+| [HADOOP-320](https://issues.apache.org/jira/browse/HADOOP-320) | bin/hadoop dfs -mv does not mv source's checksum file if source is a file | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-286](https://issues.apache.org/jira/browse/HADOOP-286) | copyFromLocal throws LeaseExpiredException | Major | . | Runping Qi | Konstantin Shvachko |
| [HADOOP-50](https://issues.apache.org/jira/browse/HADOOP-50) | dfs datanode should store blocks in multiple directories | Major | . | Doug Cutting | Milind Bhandarkar |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-458](https://issues.apache.org/jira/browse/HADOOP-458) | libhdfs corrupts memory | Major | . | Christian Kunz | Konstantin Shvachko |
+| [HADOOP-517](https://issues.apache.org/jira/browse/HADOOP-517) | readLine function of UTF8ByteArrayUtils does not handle end of line correctly | Major | . | Hairong Kuang | Hairong Kuang |
### OTHER:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.6.1/CHANGES.0.6.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.6.1/CHANGES.0.6.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.6.1/CHANGES.0.6.1.md
index d044e63..5bec621 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.6.1/CHANGES.0.6.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.6.1/CHANGES.0.6.1.md
@@ -20,56 +20,16 @@
## Release 0.6.1 - 2006-09-13
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-529](https://issues.apache.org/jira/browse/HADOOP-529) | SequenceFile fails task with NullPointerException in codec initialization | Blocker | . | Sanjay Dahiya | Owen O'Malley |
-| [HADOOP-526](https://issues.apache.org/jira/browse/HADOOP-526) | datanode lock message causes NullPointerException | Major | . | Owen O'Malley | Milind Bhandarkar |
+| [HADOOP-520](https://issues.apache.org/jira/browse/HADOOP-520) | libhdfs returns success even when writing to a file fails | Major | . | Christian Kunz | Arun C Murthy |
| [HADOOP-523](https://issues.apache.org/jira/browse/HADOOP-523) | TextInputformat .isSplittable() fails with NullPointerException with hadoop 0.6.1 | Major | . | Sanjay Dahiya | Owen O'Malley |
| [HADOOP-521](https://issues.apache.org/jira/browse/HADOOP-521) | classloader problem for clients | Major | io | Christian Kunz | Owen O'Malley |
-| [HADOOP-520](https://issues.apache.org/jira/browse/HADOOP-520) | libhdfs returns success even when writing to a file fails | Major | . | Christian Kunz | Arun C Murthy |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-526](https://issues.apache.org/jira/browse/HADOOP-526) | datanode lock message causes NullPointerException | Major | . | Owen O'Malley | Milind Bhandarkar |
+| [HADOOP-529](https://issues.apache.org/jira/browse/HADOOP-529) | SequenceFile fails task with NullPointerException in codec initialization | Blocker | . | Sanjay Dahiya | Owen O'Malley |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.6.2/CHANGES.0.6.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.6.2/CHANGES.0.6.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.6.2/CHANGES.0.6.2.md
index 6303874..d9e6c6f 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.6.2/CHANGES.0.6.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.6.2/CHANGES.0.6.2.md
@@ -20,16 +20,6 @@
## Release 0.6.2 - 2006-09-18
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
@@ -39,35 +29,11 @@
| [HADOOP-374](https://issues.apache.org/jira/browse/HADOOP-374) | native support for gzipped text files | Major | . | Yoram Arnon | |
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-534](https://issues.apache.org/jira/browse/HADOOP-534) | Jobconf should set the default output value class to be Text | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-532](https://issues.apache.org/jira/browse/HADOOP-532) | Writable underrun in sort example | Major | io | Owen O'Malley | Owen O'Malley |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-534](https://issues.apache.org/jira/browse/HADOOP-534) | Jobconf should set the default output value class to be Text | Major | . | Hairong Kuang | Hairong Kuang |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.7.0/CHANGES.0.7.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.7.0/CHANGES.0.7.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.7.0/CHANGES.0.7.0.md
index ec97937..35a4934 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.7.0/CHANGES.0.7.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.7.0/CHANGES.0.7.0.md
@@ -20,72 +20,62 @@
## Release 0.7.0 - 2006-10-06
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-567](https://issues.apache.org/jira/browse/HADOOP-567) | The build script should record the Hadoop version into the build | Major | util | Owen O'Malley | Owen O'Malley |
-| [HADOOP-559](https://issues.apache.org/jira/browse/HADOOP-559) | Support file patterns in dfs commands | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-542](https://issues.apache.org/jira/browse/HADOOP-542) | on-the-fly merge sort, HADOOP-540, reformat | Major | . | Michel Tourn | |
-| [HADOOP-522](https://issues.apache.org/jira/browse/HADOOP-522) | MapFile should support block compression | Major | io | Doug Cutting | Doug Cutting |
-| [HADOOP-519](https://issues.apache.org/jira/browse/HADOOP-519) | HDFS File API should be extended to include positional read | Major | . | Milind Bhandarkar | Milind Bhandarkar |
| [HADOOP-306](https://issues.apache.org/jira/browse/HADOOP-306) | Safe mode and name node startup procedures | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-559](https://issues.apache.org/jira/browse/HADOOP-559) | Support file patterns in dfs commands | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-519](https://issues.apache.org/jira/browse/HADOOP-519) | HDFS File API should be extended to include positional read | Major | . | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-522](https://issues.apache.org/jira/browse/HADOOP-522) | MapFile should support block compression | Major | io | Doug Cutting | Doug Cutting |
+| [HADOOP-567](https://issues.apache.org/jira/browse/HADOOP-567) | The build script should record the Hadoop version into the build | Major | util | Owen O'Malley | Owen O'Malley |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-560](https://issues.apache.org/jira/browse/HADOOP-560) | tasks should have a "killed" state | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-556](https://issues.apache.org/jira/browse/HADOOP-556) | Streaming should send keep-alive signals to Reporter every 10 seconds, not every 100 records | Major | . | Michel Tourn | |
-| [HADOOP-551](https://issues.apache.org/jira/browse/HADOOP-551) | reduce the number of lines printed to the console during execution | Minor | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-527](https://issues.apache.org/jira/browse/HADOOP-527) | Allow to specify the bind address for all hadoop servers | Major | . | Philippe Gassmann | |
-| [HADOOP-487](https://issues.apache.org/jira/browse/HADOOP-487) | misspelt DFS host name gives null pointer exception in getProtocolVersion | Major | . | Dick King | Sameer Paranjpye |
+| [HADOOP-551](https://issues.apache.org/jira/browse/HADOOP-551) | reduce the number of lines printed to the console during execution | Minor | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-431](https://issues.apache.org/jira/browse/HADOOP-431) | default behaviour of dfsShell -rm should resemble 'rm -i', not 'rm -rf' | Major | . | Yoram Arnon | Sameer Paranjpye |
| [HADOOP-263](https://issues.apache.org/jira/browse/HADOOP-263) | task status should include timestamps for when a job transitions | Major | . | Owen O'Malley | Sanjay Dahiya |
+| [HADOOP-556](https://issues.apache.org/jira/browse/HADOOP-556) | Streaming should send keep-alive signals to Reporter every 10 seconds, not every 100 records | Major | . | Michel Tourn | |
+| [HADOOP-487](https://issues.apache.org/jira/browse/HADOOP-487) | misspelt DFS host name gives null pointer exception in getProtocolVersion | Major | . | Dick King | Sameer Paranjpye |
+| [HADOOP-560](https://issues.apache.org/jira/browse/HADOOP-560) | tasks should have a "killed" state | Major | . | Owen O'Malley | Owen O'Malley |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-581](https://issues.apache.org/jira/browse/HADOOP-581) | Datanode's offerService does not handle rpc timeouts | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-568](https://issues.apache.org/jira/browse/HADOOP-568) | small jobs benchmark fails: task is UNASSIGNED | Major | . | Yoram Arnon | Owen O'Malley |
-| [HADOOP-566](https://issues.apache.org/jira/browse/HADOOP-566) | hadoop-daemons.sh fails with "no such file or directory" when used from a relative symlinked path | Major | scripts | Lee Faris | Doug Cutting |
-| [HADOOP-552](https://issues.apache.org/jira/browse/HADOOP-552) | getMapOutput doesn't reliably detect errors and throw to the caller | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-550](https://issues.apache.org/jira/browse/HADOOP-550) | Text constructure can throw exception | Major | . | Bryan Pendleton | Hairong Kuang |
-| [HADOOP-547](https://issues.apache.org/jira/browse/HADOOP-547) | ReduceTaskRunner can miss sending hearbeats if no map output copy finishes within "mapred.task.timeout" | Major | . | Sanjay Dahiya | Sanjay Dahiya |
-| [HADOOP-545](https://issues.apache.org/jira/browse/HADOOP-545) | Unused parameter in hadoop-default.xml | Trivial | conf | Philippe Gassmann | |
+| [HADOOP-243](https://issues.apache.org/jira/browse/HADOOP-243) | WI shows progress as 100.00% before actual completion (rounding error) | Trivial | . | Yoram Arnon | Owen O'Malley |
+| [HADOOP-438](https://issues.apache.org/jira/browse/HADOOP-438) | DFS pathname limitation. | Major | . | Konstantin Shvachko | Wendy Chien |
+| [HADOOP-530](https://issues.apache.org/jira/browse/HADOOP-530) | Error message does not expose mismached key or value class name correctly in Sequence file | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-288](https://issues.apache.org/jira/browse/HADOOP-288) | RFC: Efficient file caching | Major | . | Michel Tourn | Mahadev konar |
+| [HADOOP-533](https://issues.apache.org/jira/browse/HADOOP-533) | TestDFSShellGenericOptions creates a sub-directory in conf/ | Minor | . | Doug Cutting | Hairong Kuang |
+| [HADOOP-536](https://issues.apache.org/jira/browse/HADOOP-536) | Broke ant test on windows | Major | . | Mahadev konar | |
| [HADOOP-540](https://issues.apache.org/jira/browse/HADOOP-540) | Streaming should send keep-alive signals to Reporter | Major | . | Michel Tourn | |
+| [HADOOP-545](https://issues.apache.org/jira/browse/HADOOP-545) | Unused parameter in hadoop-default.xml | Trivial | conf | Philippe Gassmann | |
+| [HADOOP-261](https://issues.apache.org/jira/browse/HADOOP-261) | when map outputs are lost, nothing is shown in the webapp about why the map task failed | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-293](https://issues.apache.org/jira/browse/HADOOP-293) | map reduce job fail without reporting a reason | Major | . | Yoram Arnon | Owen O'Malley |
+| [HADOOP-444](https://issues.apache.org/jira/browse/HADOOP-444) | In streaming with a NONE reducer, you get duplicate files if a mapper fails, is restarted, and succeeds next time. | Major | . | Dick King | Michel Tourn |
+| [HADOOP-547](https://issues.apache.org/jira/browse/HADOOP-547) | ReduceTaskRunner can miss sending hearbeats if no map output copy finishes within "mapred.task.timeout" | Major | . | Sanjay Dahiya | Sanjay Dahiya |
| [HADOOP-537](https://issues.apache.org/jira/browse/HADOOP-537) | clean-libhdfs target of build.xml does not work on windows | Major | . | Konstantin Shvachko | Arun C Murthy |
-| [HADOOP-536](https://issues.apache.org/jira/browse/HADOOP-536) | Broke ant test on windows | Major | . | Mahadev konar | |
-| [HADOOP-533](https://issues.apache.org/jira/browse/HADOOP-533) | TestDFSShellGenericOptions creates a sub-directory in conf/ | Minor | . | Doug Cutting | Hairong Kuang |
-| [HADOOP-530](https://issues.apache.org/jira/browse/HADOOP-530) | Error message does not expose mismached key or value class name correctly in Sequence file | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-513](https://issues.apache.org/jira/browse/HADOOP-513) | IllegalStateException is thrown by TaskTracker | Major | . | Konstantin Shvachko | Owen O'Malley |
| [HADOOP-508](https://issues.apache.org/jira/browse/HADOOP-508) | random seeks using FSDataInputStream can become invalid such that reads return invalid data | Major | . | Christian Kunz | Milind Bhandarkar |
-| [HADOOP-506](https://issues.apache.org/jira/browse/HADOOP-506) | job tracker hangs on to dead task trackers "forever" | Minor | . | Yoram Arnon | Sanjay Dahiya |
-| [HADOOP-444](https://issues.apache.org/jira/browse/HADOOP-444) | In streaming with a NONE reducer, you get duplicate files if a mapper fails, is restarted, and succeeds next time. | Major | . | Dick King | Michel Tourn |
-| [HADOOP-438](https://issues.apache.org/jira/browse/HADOOP-438) | DFS pathname limitation. | Major | . | Konstantin Shvachko | Wendy Chien |
| [HADOOP-423](https://issues.apache.org/jira/browse/HADOOP-423) | file paths are not normalized | Major | . | Christian Kunz | Wendy Chien |
+| [HADOOP-513](https://issues.apache.org/jira/browse/HADOOP-513) | IllegalStateException is thrown by TaskTracker | Major | . | Konstantin Shvachko | Owen O'Malley |
+| [HADOOP-552](https://issues.apache.org/jira/browse/HADOOP-552) | getMapOutput doesn't reliably detect errors and throw to the caller | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-566](https://issues.apache.org/jira/browse/HADOOP-566) | hadoop-daemons.sh fails with "no such file or directory" when used from a relative symlinked path | Major | scripts | Lee Faris | Doug Cutting |
+| [HADOOP-568](https://issues.apache.org/jira/browse/HADOOP-568) | small jobs benchmark fails: task is UNASSIGNED | Major | . | Yoram Arnon | Owen O'Malley |
| [HADOOP-343](https://issues.apache.org/jira/browse/HADOOP-343) | In case of dead task tracker, the copy mapouts try copying all mapoutputs from this tasktracker | Major | . | Mahadev konar | Sameer Paranjpye |
-| [HADOOP-293](https://issues.apache.org/jira/browse/HADOOP-293) | map reduce job fail without reporting a reason | Major | . | Yoram Arnon | Owen O'Malley |
-| [HADOOP-288](https://issues.apache.org/jira/browse/HADOOP-288) | RFC: Efficient file caching | Major | . | Michel Tourn | Mahadev konar |
-| [HADOOP-261](https://issues.apache.org/jira/browse/HADOOP-261) | when map outputs are lost, nothing is shown in the webapp about why the map task failed | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-255](https://issues.apache.org/jira/browse/HADOOP-255) | Client Calls are not cancelled after a call timeout | Major | ipc | Naveen Nalam | Owen O'Malley |
-| [HADOOP-243](https://issues.apache.org/jira/browse/HADOOP-243) | WI shows progress as 100.00% before actual completion (rounding error) | Trivial | . | Yoram Arnon | Owen O'Malley |
+| [HADOOP-550](https://issues.apache.org/jira/browse/HADOOP-550) | Text constructure can throw exception | Major | . | Bryan Pendleton | Hairong Kuang |
| [HADOOP-239](https://issues.apache.org/jira/browse/HADOOP-239) | job tracker WI drops jobs after 24 hours | Minor | . | Yoram Arnon | Sanjay Dahiya |
+| [HADOOP-255](https://issues.apache.org/jira/browse/HADOOP-255) | Client Calls are not cancelled after a call timeout | Major | ipc | Naveen Nalam | Owen O'Malley |
+| [HADOOP-581](https://issues.apache.org/jira/browse/HADOOP-581) | Datanode's offerService does not handle rpc timeouts | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-506](https://issues.apache.org/jira/browse/HADOOP-506) | job tracker hangs on to dead task trackers "forever" | Minor | . | Yoram Arnon | Sanjay Dahiya |
### TESTS:
@@ -95,15 +85,3 @@
| [HADOOP-548](https://issues.apache.org/jira/browse/HADOOP-548) | add a switch to allow unit tests to show output | Minor | . | Owen O'Malley | Owen O'Malley |
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.7.1/CHANGES.0.7.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.7.1/CHANGES.0.7.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.7.1/CHANGES.0.7.1.md
index a0a134b..8dc938f 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.7.1/CHANGES.0.7.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.7.1/CHANGES.0.7.1.md
@@ -20,22 +20,6 @@
## Release 0.7.1 - 2006-10-11
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### IMPROVEMENTS:
@@ -49,27 +33,9 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-598](https://issues.apache.org/jira/browse/HADOOP-598) | rpc timeout in Task.done kills task | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-597](https://issues.apache.org/jira/browse/HADOOP-597) | transmission errors to the reduce will cause map output to be considered lost | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-593](https://issues.apache.org/jira/browse/HADOOP-593) | NullPointerException in JobTracker's ExireTaskTracker thread | Critical | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-592](https://issues.apache.org/jira/browse/HADOOP-592) | NullPointerException in toString for RPC connection objects | Minor | . | Owen O'Malley | Owen O'Malley |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-598](https://issues.apache.org/jira/browse/HADOOP-598) | rpc timeout in Task.done kills task | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-597](https://issues.apache.org/jira/browse/HADOOP-597) | transmission errors to the reduce will cause map output to be considered lost | Major | . | Owen O'Malley | Owen O'Malley |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.7.2/CHANGES.0.7.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.7.2/CHANGES.0.7.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.7.2/CHANGES.0.7.2.md
index 6c84a2a..b38320e 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.7.2/CHANGES.0.7.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.7.2/CHANGES.0.7.2.md
@@ -20,36 +20,14 @@
## Release 0.7.2 - 2006-10-18
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-666](https://issues.apache.org/jira/browse/HADOOP-666) | hadoop dfs does not complain about unknown option | Minor | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-607](https://issues.apache.org/jira/browse/HADOOP-607) | Classpath of tasks is not set correctly (bug happens for multiple mapred local dirs only) | Critical | . | Mahadev konar | Mahadev konar |
+| [HADOOP-666](https://issues.apache.org/jira/browse/HADOOP-666) | hadoop dfs does not complain about unknown option | Minor | . | dhruba borthakur | dhruba borthakur |
### TESTS:
@@ -59,15 +37,3 @@
| [HADOOP-609](https://issues.apache.org/jira/browse/HADOOP-609) | Mini map/reduce cluster should use multiple temp directories | Major | . | Owen O'Malley | Mahadev konar |
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.8.0/CHANGES.0.8.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.8.0/CHANGES.0.8.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.8.0/CHANGES.0.8.0.md
index 4db1e35..c545905 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.8.0/CHANGES.0.8.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.8.0/CHANGES.0.8.0.md
@@ -20,91 +20,63 @@
## Release 0.8.0 - 2006-11-03
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-636](https://issues.apache.org/jira/browse/HADOOP-636) | MapFile constructor should accept Progressible | Major | io | Doug Cutting | Doug Cutting |
| [HADOOP-635](https://issues.apache.org/jira/browse/HADOOP-635) | hadoop dfs copy, move commands should accept multiple source files as arguments | Major | . | dhruba borthakur | |
+| [HADOOP-636](https://issues.apache.org/jira/browse/HADOOP-636) | MapFile constructor should accept Progressible | Major | io | Doug Cutting | Doug Cutting |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-670](https://issues.apache.org/jira/browse/HADOOP-670) | Generic types for FSNamesystem | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-660](https://issues.apache.org/jira/browse/HADOOP-660) | Format of junit output should be configurable | Minor | . | Nigel Daley | Nigel Daley |
-| [HADOOP-647](https://issues.apache.org/jira/browse/HADOOP-647) | Map outputs can't have a different type of compression from the reduce outputs | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-626](https://issues.apache.org/jira/browse/HADOOP-626) | NNBench example comments are incorrect and code contains cut-and-paste error | Trivial | . | Nigel Daley | Nigel Daley |
-| [HADOOP-625](https://issues.apache.org/jira/browse/HADOOP-625) | add a little servlet to display the server's thread call stacks | Minor | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-586](https://issues.apache.org/jira/browse/HADOOP-586) | Job Name should not ben empty, if its is not given bu user, Hadoop should use original Jar name as the job name. | Trivial | . | Sanjay Dahiya | Sanjay Dahiya |
| [HADOOP-583](https://issues.apache.org/jira/browse/HADOOP-583) | DFSClient should use debug level to log missing data-node. | Minor | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-578](https://issues.apache.org/jira/browse/HADOOP-578) | Failed tasks should not be put at the end of the job tracker's queue | Major | . | Owen O'Malley | Sanjay Dahiya |
| [HADOOP-498](https://issues.apache.org/jira/browse/HADOOP-498) | fsck should execute faster | Major | . | Yoram Arnon | Milind Bhandarkar |
+| [HADOOP-586](https://issues.apache.org/jira/browse/HADOOP-586) | Job Name should not ben empty, if its is not given bu user, Hadoop should use original Jar name as the job name. | Trivial | . | Sanjay Dahiya | Sanjay Dahiya |
+| [HADOOP-625](https://issues.apache.org/jira/browse/HADOOP-625) | add a little servlet to display the server's thread call stacks | Minor | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-626](https://issues.apache.org/jira/browse/HADOOP-626) | NNBench example comments are incorrect and code contains cut-and-paste error | Trivial | . | Nigel Daley | Nigel Daley |
+| [HADOOP-578](https://issues.apache.org/jira/browse/HADOOP-578) | Failed tasks should not be put at the end of the job tracker's queue | Major | . | Owen O'Malley | Sanjay Dahiya |
+| [HADOOP-660](https://issues.apache.org/jira/browse/HADOOP-660) | Format of junit output should be configurable | Minor | . | Nigel Daley | Nigel Daley |
+| [HADOOP-670](https://issues.apache.org/jira/browse/HADOOP-670) | Generic types for FSNamesystem | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-647](https://issues.apache.org/jira/browse/HADOOP-647) | Map outputs can't have a different type of compression from the reduce outputs | Major | . | Owen O'Malley | Owen O'Malley |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-671](https://issues.apache.org/jira/browse/HADOOP-671) | Distributed cache creates unnecessary symlinks if asked for creating symlinks | Major | . | Mahadev konar | Mahadev konar |
-| [HADOOP-669](https://issues.apache.org/jira/browse/HADOOP-669) | Upgrade to trunk causes data loss. | Blocker | . | Milind Bhandarkar | Milind Bhandarkar |
-| [HADOOP-665](https://issues.apache.org/jira/browse/HADOOP-665) | hadoop -rmr does NOT process multiple arguments and does not complain | Minor | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-664](https://issues.apache.org/jira/browse/HADOOP-664) | build doesn't fail if libhdfs test(s) fail | Minor | . | Nigel Daley | Nigel Daley |
-| [HADOOP-663](https://issues.apache.org/jira/browse/HADOOP-663) | ant test is failing | Major | . | Mahadev konar | Mahadev konar |
-| [HADOOP-658](https://issues.apache.org/jira/browse/HADOOP-658) | source headers must conform to new Apache guidelines | Major | . | Doug Cutting | Doug Cutting |
-| [HADOOP-651](https://issues.apache.org/jira/browse/HADOOP-651) | fsck does not handle arguments -blocks and -locations correctly | Major | . | Milind Bhandarkar | Milind Bhandarkar |
-| [HADOOP-642](https://issues.apache.org/jira/browse/HADOOP-642) | Explicit timeout for ipc.Client | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-641](https://issues.apache.org/jira/browse/HADOOP-641) | Name-node should demand a block report from resurrected data-nodes. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-638](https://issues.apache.org/jira/browse/HADOOP-638) | TaskTracker missing synchronization around tasks variable access | Major | . | Nigel Daley | Nigel Daley |
-| [HADOOP-634](https://issues.apache.org/jira/browse/HADOOP-634) | Test files missing copyright headers | Trivial | . | Nigel Daley | Nigel Daley |
-| [HADOOP-633](https://issues.apache.org/jira/browse/HADOOP-633) | if the jobinit thread gets killed the jobtracker keeps running without doing anything. | Minor | . | Mahadev konar | Owen O'Malley |
-| [HADOOP-627](https://issues.apache.org/jira/browse/HADOOP-627) | MiniMRCluster missing synchronization | Major | . | Nigel Daley | Nigel Daley |
-| [HADOOP-624](https://issues.apache.org/jira/browse/HADOOP-624) | fix warning about pathSpec should start with '/' or '\*' : mapOutput | Minor | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-610](https://issues.apache.org/jira/browse/HADOOP-610) | Task Tracker offerService does not adequately protect from exceptions | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-599](https://issues.apache.org/jira/browse/HADOOP-599) | DFS Always Reports 0 Bytes Used | Minor | . | Albert Chern | Raghu Angadi |
+| [HADOOP-477](https://issues.apache.org/jira/browse/HADOOP-477) | Streaming should execute Unix commands and scripts in well known languages without user specifying the path | Major | . | arkady borkovsky | dhruba borthakur |
+| [HADOOP-514](https://issues.apache.org/jira/browse/HADOOP-514) | namenode heartbeat interval should be configurable | Major | . | Wendy Chien | Milind Bhandarkar |
| [HADOOP-588](https://issues.apache.org/jira/browse/HADOOP-588) | JobTracker History bug - kill() ed tasks are logged wrongly as finished. | Major | . | Sanjay Dahiya | Sanjay Dahiya |
-| [HADOOP-572](https://issues.apache.org/jira/browse/HADOOP-572) | Chain reaction in a big cluster caused by simultaneous failure of only a few data-nodes. | Major | . | Konstantin Shvachko | Sameer Paranjpye |
-| [HADOOP-563](https://issues.apache.org/jira/browse/HADOOP-563) | DFS client should try to re-new lease if it gets a lease expiration exception when it adds a block to a file | Major | . | Runping Qi | dhruba borthakur |
+| [HADOOP-462](https://issues.apache.org/jira/browse/HADOOP-462) | DFSShell throws out arrayoutofbounds exceptions if the number of arguments is not right | Minor | . | Mahadev konar | dhruba borthakur |
| [HADOOP-561](https://issues.apache.org/jira/browse/HADOOP-561) | one replica of a file should be written locally if possible | Major | . | Yoram Arnon | dhruba borthakur |
+| [HADOOP-610](https://issues.apache.org/jira/browse/HADOOP-610) | Task Tracker offerService does not adequately protect from exceptions | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-554](https://issues.apache.org/jira/browse/HADOOP-554) | hadoop dfs command line doesn't exit with status code on error | Major | . | Marco Nicosia | dhruba borthakur |
-| [HADOOP-553](https://issues.apache.org/jira/browse/HADOOP-553) | DataNode and NameNode main() should catch and report exceptions. | Major | . | Konstantin Shvachko | Raghu Angadi |
-| [HADOOP-514](https://issues.apache.org/jira/browse/HADOOP-514) | namenode heartbeat interval should be configurable | Major | . | Wendy Chien | Milind Bhandarkar |
+| [HADOOP-634](https://issues.apache.org/jira/browse/HADOOP-634) | Test files missing copyright headers | Trivial | . | Nigel Daley | Nigel Daley |
+| [HADOOP-627](https://issues.apache.org/jira/browse/HADOOP-627) | MiniMRCluster missing synchronization | Major | . | Nigel Daley | Nigel Daley |
+| [HADOOP-563](https://issues.apache.org/jira/browse/HADOOP-563) | DFS client should try to re-new lease if it gets a lease expiration exception when it adds a block to a file | Major | . | Runping Qi | dhruba borthakur |
+| [HADOOP-641](https://issues.apache.org/jira/browse/HADOOP-641) | Name-node should demand a block report from resurrected data-nodes. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-642](https://issues.apache.org/jira/browse/HADOOP-642) | Explicit timeout for ipc.Client | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-638](https://issues.apache.org/jira/browse/HADOOP-638) | TaskTracker missing synchronization around tasks variable access | Major | . | Nigel Daley | Nigel Daley |
+| [HADOOP-624](https://issues.apache.org/jira/browse/HADOOP-624) | fix warning about pathSpec should start with '/' or '\*' : mapOutput | Minor | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-658](https://issues.apache.org/jira/browse/HADOOP-658) | source headers must conform to new Apache guidelines | Major | . | Doug Cutting | Doug Cutting |
| [HADOOP-482](https://issues.apache.org/jira/browse/HADOOP-482) | unit test hangs when a cluster is running on the same machine | Minor | . | Wendy Chien | Wendy Chien |
-| [HADOOP-477](https://issues.apache.org/jira/browse/HADOOP-477) | Streaming should execute Unix commands and scripts in well known languages without user specifying the path | Major | . | arkady borkovsky | dhruba borthakur |
-| [HADOOP-462](https://issues.apache.org/jira/browse/HADOOP-462) | DFSShell throws out arrayoutofbounds exceptions if the number of arguments is not right | Minor | . | Mahadev konar | dhruba borthakur |
+| [HADOOP-90](https://issues.apache.org/jira/browse/HADOOP-90) | DFS is succeptible to data loss in case of name node failure | Major | . | Yoram Arnon | Konstantin Shvachko |
+| [HADOOP-651](https://issues.apache.org/jira/browse/HADOOP-651) | fsck does not handle arguments -blocks and -locations correctly | Major | . | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-553](https://issues.apache.org/jira/browse/HADOOP-553) | DataNode and NameNode main() should catch and report exceptions. | Major | . | Konstantin Shvachko | Raghu Angadi |
| [HADOOP-399](https://issues.apache.org/jira/browse/HADOOP-399) | the javadoc currently generates lot of warnings about bad fields | Trivial | . | Owen O'Malley | Nigel Daley |
+| [HADOOP-599](https://issues.apache.org/jira/browse/HADOOP-599) | DFS Always Reports 0 Bytes Used | Minor | . | Albert Chern | Raghu Angadi |
+| [HADOOP-663](https://issues.apache.org/jira/browse/HADOOP-663) | ant test is failing | Major | . | Mahadev konar | Mahadev konar |
+| [HADOOP-664](https://issues.apache.org/jira/browse/HADOOP-664) | build doesn't fail if libhdfs test(s) fail | Minor | . | Nigel Daley | Nigel Daley |
+| [HADOOP-633](https://issues.apache.org/jira/browse/HADOOP-633) | if the jobinit thread gets killed the jobtracker keeps running without doing anything. | Minor | . | Mahadev konar | Owen O'Malley |
+| [HADOOP-669](https://issues.apache.org/jira/browse/HADOOP-669) | Upgrade to trunk causes data loss. | Blocker | . | Milind Bhandarkar | Milind Bhandarkar |
| [HADOOP-373](https://issues.apache.org/jira/browse/HADOOP-373) | Some calls to mkdirs do not check return value | Major | . | Wendy Chien | Wendy Chien |
-| [HADOOP-90](https://issues.apache.org/jira/browse/HADOOP-90) | DFS is succeptible to data loss in case of name node failure | Major | . | Yoram Arnon | Konstantin Shvachko |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-671](https://issues.apache.org/jira/browse/HADOOP-671) | Distributed cache creates unnecessary symlinks if asked for creating symlinks | Major | . | Mahadev konar | Mahadev konar |
+| [HADOOP-665](https://issues.apache.org/jira/browse/HADOOP-665) | hadoop -rmr does NOT process multiple arguments and does not complain | Minor | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-572](https://issues.apache.org/jira/browse/HADOOP-572) | Chain reaction in a big cluster caused by simultaneous failure of only a few data-nodes. | Major | . | Konstantin Shvachko | Sameer Paranjpye |
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[47/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.0/CHANGES.0.16.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.0/CHANGES.0.16.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.0/CHANGES.0.16.0.md
index 4be7a96..1746fd5 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.0/CHANGES.0.16.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.0/CHANGES.0.16.0.md
@@ -20,228 +20,206 @@
## Release 0.16.0 - 2008-02-07
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-2603](https://issues.apache.org/jira/browse/HADOOP-2603) | SequenceFileAsBinaryInputFormat | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-2567](https://issues.apache.org/jira/browse/HADOOP-2567) | add FileSystem#getHomeDirectory() method | Major | fs | Doug Cutting | Doug Cutting |
-| [HADOOP-2543](https://issues.apache.org/jira/browse/HADOOP-2543) | No-permission-checking mode for smooth transition to 0.16's permissions features. | Major | . | Sanjay Radia | Hairong Kuang |
-| [HADOOP-2529](https://issues.apache.org/jira/browse/HADOOP-2529) | DFS User Guide | Major | documentation | Raghu Angadi | Raghu Angadi |
-| [HADOOP-2514](https://issues.apache.org/jira/browse/HADOOP-2514) | Trash and permissions don't mix | Major | . | Robert Chansler | Doug Cutting |
-| [HADOOP-2487](https://issues.apache.org/jira/browse/HADOOP-2487) | Provide an option to get job status for all jobs run by or submitted to a job tracker | Major | . | Hemanth Yamijala | Amareshwari Sriramadasu |
-| [HADOOP-2447](https://issues.apache.org/jira/browse/HADOOP-2447) | HDFS should be capable of limiting the total number of inodes in the system | Major | . | Sameer Paranjpye | dhruba borthakur |
-| [HADOOP-2398](https://issues.apache.org/jira/browse/HADOOP-2398) | Additional Instrumentation for NameNode, RPC Layer and JMX support | Major | . | Sanjay Radia | Sanjay Radia |
-| [HADOOP-2381](https://issues.apache.org/jira/browse/HADOOP-2381) | Support permission information in FileStatus | Major | fs | Tsz Wo Nicholas Sze | Raghu Angadi |
-| [HADOOP-2367](https://issues.apache.org/jira/browse/HADOOP-2367) | Get representative hprof information from tasks | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-2336](https://issues.apache.org/jira/browse/HADOOP-2336) | Shell commands to access and modify file permissions | Major | fs | Raghu Angadi | Raghu Angadi |
+| [HADOOP-2045](https://issues.apache.org/jira/browse/HADOOP-2045) | credits page should have more information | Major | documentation | Doug Cutting | Doug Cutting |
+| [HADOOP-1604](https://issues.apache.org/jira/browse/HADOOP-1604) | admins should be able to finalize namenode upgrades without running the cluster | Critical | . | Owen O'Malley | Konstantin Shvachko |
+| [HADOOP-1912](https://issues.apache.org/jira/browse/HADOOP-1912) | Datanode should support block replacement | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-2288](https://issues.apache.org/jira/browse/HADOOP-2288) | Change FileSystem API to support access control. | Major | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-2229](https://issues.apache.org/jira/browse/HADOOP-2229) | Provide a simple login implementation | Major | fs | Tsz Wo Nicholas Sze | Hairong Kuang |
| [HADOOP-2184](https://issues.apache.org/jira/browse/HADOOP-2184) | RPC Support for user permissions and authentication. | Major | ipc | Tsz Wo Nicholas Sze | Raghu Angadi |
+| [HADOOP-1652](https://issues.apache.org/jira/browse/HADOOP-1652) | Rebalance data blocks when new data nodes added or data nodes become full | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-2145](https://issues.apache.org/jira/browse/HADOOP-2145) | need 'doc' target that runs forrest | Major | build | Doug Cutting | Doug Cutting |
| [HADOOP-2085](https://issues.apache.org/jira/browse/HADOOP-2085) | Map-side joins on sorted, equally-partitioned datasets | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-2045](https://issues.apache.org/jira/browse/HADOOP-2045) | credits page should have more information | Major | documentation | Doug Cutting | Doug Cutting |
-| [HADOOP-2012](https://issues.apache.org/jira/browse/HADOOP-2012) | Periodic verification at the Datanode | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-1912](https://issues.apache.org/jira/browse/HADOOP-1912) | Datanode should support block replacement | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1652](https://issues.apache.org/jira/browse/HADOOP-1652) | Rebalance data blocks when new data nodes added or data nodes become full | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1604](https://issues.apache.org/jira/browse/HADOOP-1604) | admins should be able to finalize namenode upgrades without running the cluster | Critical | . | Owen O'Malley | Konstantin Shvachko |
+| [HADOOP-2381](https://issues.apache.org/jira/browse/HADOOP-2381) | Support permission information in FileStatus | Major | fs | Tsz Wo Nicholas Sze | Raghu Angadi |
+| [HADOOP-2336](https://issues.apache.org/jira/browse/HADOOP-2336) | Shell commands to access and modify file permissions | Major | fs | Raghu Angadi | Raghu Angadi |
| [HADOOP-1301](https://issues.apache.org/jira/browse/HADOOP-1301) | resource management proviosioning for Hadoop | Major | . | Pete Wyckoff | Hemanth Yamijala |
| [HADOOP-1298](https://issues.apache.org/jira/browse/HADOOP-1298) | adding user info to file | Major | fs | Kurtis Heimerl | Tsz Wo Nicholas Sze |
+| [HADOOP-2447](https://issues.apache.org/jira/browse/HADOOP-2447) | HDFS should be capable of limiting the total number of inodes in the system | Major | . | Sameer Paranjpye | dhruba borthakur |
+| [HADOOP-2487](https://issues.apache.org/jira/browse/HADOOP-2487) | Provide an option to get job status for all jobs run by or submitted to a job tracker | Major | . | Hemanth Yamijala | Amareshwari Sriramadasu |
+| [HADOOP-2398](https://issues.apache.org/jira/browse/HADOOP-2398) | Additional Instrumentation for NameNode, RPC Layer and JMX support | Major | . | Sanjay Radia | Sanjay Radia |
+| [HADOOP-2514](https://issues.apache.org/jira/browse/HADOOP-2514) | Trash and permissions don't mix | Major | . | Robert Chansler | Doug Cutting |
+| [HADOOP-2012](https://issues.apache.org/jira/browse/HADOOP-2012) | Periodic verification at the Datanode | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-2543](https://issues.apache.org/jira/browse/HADOOP-2543) | No-permission-checking mode for smooth transition to 0.16's permissions features. | Major | . | Sanjay Radia | Hairong Kuang |
+| [HADOOP-2603](https://issues.apache.org/jira/browse/HADOOP-2603) | SequenceFileAsBinaryInputFormat | Major | . | Chris Douglas | Chris Douglas |
+| [HADOOP-2367](https://issues.apache.org/jira/browse/HADOOP-2367) | Get representative hprof information from tasks | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-2567](https://issues.apache.org/jira/browse/HADOOP-2567) | add FileSystem#getHomeDirectory() method | Major | fs | Doug Cutting | Doug Cutting |
+| [HADOOP-2529](https://issues.apache.org/jira/browse/HADOOP-2529) | DFS User Guide | Major | documentation | Raghu Angadi | Raghu Angadi |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-2645](https://issues.apache.org/jira/browse/HADOOP-2645) | Additional metrics & jmx beans and cleanup to use the recent metrics libraries | Major | . | Sanjay Radia | Sanjay Radia |
-| [HADOOP-2596](https://issues.apache.org/jira/browse/HADOOP-2596) | add SequenceFile.createWriter() method that takes block size as parameter | Minor | io | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-2566](https://issues.apache.org/jira/browse/HADOOP-2566) | need FileSystem#globStatus method | Major | fs | Doug Cutting | Hairong Kuang |
-| [HADOOP-2552](https://issues.apache.org/jira/browse/HADOOP-2552) | enable hdfs permission checking by default | Major | . | Doug Cutting | Doug Cutting |
-| [HADOOP-2547](https://issues.apache.org/jira/browse/HADOOP-2547) | remove use of 'magic number' in build.xml | Trivial | build | Hrishikesh | Hrishikesh |
-| [HADOOP-2469](https://issues.apache.org/jira/browse/HADOOP-2469) | WritableUtils.clone should take Configuration rather than JobConf | Minor | io | stack | stack |
-| [HADOOP-2466](https://issues.apache.org/jira/browse/HADOOP-2466) | FileInputFormat computeSplitSize() method, change visibility to protected and make it a member method | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-2464](https://issues.apache.org/jira/browse/HADOOP-2464) | Test permissions related shell commands with DFS | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-2457](https://issues.apache.org/jira/browse/HADOOP-2457) | Add a 'forrest.home' property for the 'docs' target in build.xml | Minor | documentation | Arun C Murthy | Arun C Murthy |
+| [HADOOP-2058](https://issues.apache.org/jira/browse/HADOOP-2058) | Allow adding additional datanodes to MiniDFSCluster | Major | test | Hairong Kuang | Hairong Kuang |
+| [HADOOP-1855](https://issues.apache.org/jira/browse/HADOOP-1855) | fsck should verify block placement | Major | . | dhruba borthakur | Konstantin Shvachko |
+| [HADOOP-1839](https://issues.apache.org/jira/browse/HADOOP-1839) | Link-ify the Pending/Running/Complete/Killed tasks/task-attempts on jobdetails.jsp | Major | . | Arun C Murthy | Amar Kamat |
+| [HADOOP-1848](https://issues.apache.org/jira/browse/HADOOP-1848) | Redesign of Eclipse plug-in interface with Hadoop | Major | . | Christophe Taton | Christophe Taton |
+| [HADOOP-1857](https://issues.apache.org/jira/browse/HADOOP-1857) | Ability to run a script when a task fails to capture stack traces | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-1210](https://issues.apache.org/jira/browse/HADOOP-1210) | Log counters in job history | Minor | . | Albert Chern | Owen O'Malley |
+| [HADOOP-2105](https://issues.apache.org/jira/browse/HADOOP-2105) | Clarify requirements for Hadoop in overview.html | Minor | . | Jim Kellerman | Jim Kellerman |
+| [HADOOP-2086](https://issues.apache.org/jira/browse/HADOOP-2086) | ability to add dependencies to a job after construction | Major | . | Adrian Woodhead | Adrian Woodhead |
+| [HADOOP-1185](https://issues.apache.org/jira/browse/HADOOP-1185) | dynamically change log levels | Major | util | dhruba borthakur | Tsz Wo Nicholas Sze |
+| [HADOOP-2134](https://issues.apache.org/jira/browse/HADOOP-2134) | Remove developer-centric requirements from overview.html | Major | documentation | Arun C Murthy | Jim Kellerman |
+| [HADOOP-1274](https://issues.apache.org/jira/browse/HADOOP-1274) | Configuring different number of mappers and reducers per TaskTracker | Major | . | Koji Noguchi | Amareshwari Sriramadasu |
+| [HADOOP-2127](https://issues.apache.org/jira/browse/HADOOP-2127) | Add pipes sort example | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-1843](https://issues.apache.org/jira/browse/HADOOP-1843) | Remove deprecated code in Configuration/JobConf | Major | conf | Arun C Murthy | Arun C Murthy |
+| [HADOOP-2113](https://issues.apache.org/jira/browse/HADOOP-2113) | Add "-text" command to FsShell to decode SequenceFile to stdout | Minor | fs | Chris Douglas | Chris Douglas |
+| [HADOOP-1900](https://issues.apache.org/jira/browse/HADOOP-1900) | the heartbeat and task event queries interval should be set dynamically by the JobTracker | Major | . | Owen O'Malley | Amareshwari Sriramadasu |
+| [HADOOP-1302](https://issues.apache.org/jira/browse/HADOOP-1302) | Remove deprecated contrib/abacus code | Major | . | Doug Cutting | Enis Soztutar |
+| [HADOOP-2349](https://issues.apache.org/jira/browse/HADOOP-2349) | FSEditLog.logEdit(byte op, Writable w1, Writable w2) should accept variable numbers of Writable, instead of two. | Minor | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-2185](https://issues.apache.org/jira/browse/HADOOP-2185) | Server ports: to roll or not to roll. | Major | conf | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-2401](https://issues.apache.org/jira/browse/HADOOP-2401) | Lease holder information should be passed in ClientProtocol.abandonBlock(...) | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-1841](https://issues.apache.org/jira/browse/HADOOP-1841) | IPC server should write repsonses asynchronously | Major | ipc | Doug Cutting | dhruba borthakur |
| [HADOOP-2432](https://issues.apache.org/jira/browse/HADOOP-2432) | If HDFS is going to throw an exception "File does not exist" it should include the name of the file | Minor | . | Jim Kellerman | Jim Kellerman |
+| [HADOOP-2457](https://issues.apache.org/jira/browse/HADOOP-2457) | Add a 'forrest.home' property for the 'docs' target in build.xml | Minor | documentation | Arun C Murthy | Arun C Murthy |
+| [HADOOP-2149](https://issues.apache.org/jira/browse/HADOOP-2149) | Pure name-node benchmarks. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-2466](https://issues.apache.org/jira/browse/HADOOP-2466) | FileInputFormat computeSplitSize() method, change visibility to protected and make it a member method | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
| [HADOOP-2425](https://issues.apache.org/jira/browse/HADOOP-2425) | TextOutputFormat should special case Text | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-2401](https://issues.apache.org/jira/browse/HADOOP-2401) | Lease holder information should be passed in ClientProtocol.abandonBlock(...) | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-2208](https://issues.apache.org/jira/browse/HADOOP-2208) | Reduce frequency of Counter updates in the task tracker status | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-1719](https://issues.apache.org/jira/browse/HADOOP-1719) | Improve the utilization of shuffle copier threads | Major | . | Devaraj Das | Amar Kamat |
| [HADOOP-2390](https://issues.apache.org/jira/browse/HADOOP-2390) | Document the user-controls for intermediate/output compression via forrest | Major | documentation | Arun C Murthy | Arun C Murthy |
-| [HADOOP-2349](https://issues.apache.org/jira/browse/HADOOP-2349) | FSEditLog.logEdit(byte op, Writable w1, Writable w2) should accept variable numbers of Writable, instead of two. | Minor | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-2298](https://issues.apache.org/jira/browse/HADOOP-2298) | ant target without source and docs | Major | build | Gautam Kowshik | Hrishikesh |
-| [HADOOP-2268](https://issues.apache.org/jira/browse/HADOOP-2268) | JobControl classes should use interfaces rather than implemenations | Minor | . | Adrian Woodhead | Adrian Woodhead |
+| [HADOOP-1660](https://issues.apache.org/jira/browse/HADOOP-1660) | add support for native library toDistributedCache | Major | . | Alejandro Abdelnur | Arun C Murthy |
| [HADOOP-2233](https://issues.apache.org/jira/browse/HADOOP-2233) | General example for modeling m/r load in Java | Minor | test | Chris Douglas | Chris Douglas |
-| [HADOOP-2232](https://issues.apache.org/jira/browse/HADOOP-2232) | Add option to disable nagles algorithm in the IPC Server | Major | ipc | Clint Morgan | Clint Morgan |
-| [HADOOP-2208](https://issues.apache.org/jira/browse/HADOOP-2208) | Reduce frequency of Counter updates in the task tracker status | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-2185](https://issues.apache.org/jira/browse/HADOOP-2185) | Server ports: to roll or not to roll. | Major | conf | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-2149](https://issues.apache.org/jira/browse/HADOOP-2149) | Pure name-node benchmarks. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-2134](https://issues.apache.org/jira/browse/HADOOP-2134) | Remove developer-centric requirements from overview.html | Major | documentation | Arun C Murthy | Jim Kellerman |
+| [HADOOP-2547](https://issues.apache.org/jira/browse/HADOOP-2547) | remove use of 'magic number' in build.xml | Trivial | build | Hrishikesh | Hrishikesh |
+| [HADOOP-2268](https://issues.apache.org/jira/browse/HADOOP-2268) | JobControl classes should use interfaces rather than implemenations | Minor | . | Adrian Woodhead | Adrian Woodhead |
+| [HADOOP-2552](https://issues.apache.org/jira/browse/HADOOP-2552) | enable hdfs permission checking by default | Major | . | Doug Cutting | Doug Cutting |
| [HADOOP-2131](https://issues.apache.org/jira/browse/HADOOP-2131) | Speculative execution should be allowed for reducers only | Critical | . | Srikanth Kakani | Amareshwari Sriramadasu |
-| [HADOOP-2127](https://issues.apache.org/jira/browse/HADOOP-2127) | Add pipes sort example | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-2113](https://issues.apache.org/jira/browse/HADOOP-2113) | Add "-text" command to FsShell to decode SequenceFile to stdout | Minor | fs | Chris Douglas | Chris Douglas |
-| [HADOOP-2105](https://issues.apache.org/jira/browse/HADOOP-2105) | Clarify requirements for Hadoop in overview.html | Minor | . | Jim Kellerman | Jim Kellerman |
-| [HADOOP-2086](https://issues.apache.org/jira/browse/HADOOP-2086) | ability to add dependencies to a job after construction | Major | . | Adrian Woodhead | Adrian Woodhead |
-| [HADOOP-2077](https://issues.apache.org/jira/browse/HADOOP-2077) | Logging version number (and compiled date) at STARTUP\_MSG | Trivial | . | Koji Noguchi | Arun C Murthy |
-| [HADOOP-2058](https://issues.apache.org/jira/browse/HADOOP-2058) | Allow adding additional datanodes to MiniDFSCluster | Major | test | Hairong Kuang | Hairong Kuang |
-| [HADOOP-1989](https://issues.apache.org/jira/browse/HADOOP-1989) | Add support for simulated Data Nodes - helpful for testing and performance benchmarking of the Name Node without having a large cluster | Minor | . | Sanjay Radia | Sanjay Radia |
+| [HADOOP-1873](https://issues.apache.org/jira/browse/HADOOP-1873) | User permissions for Map/Reduce | Major | . | Raghu Angadi | Hairong Kuang |
| [HADOOP-1965](https://issues.apache.org/jira/browse/HADOOP-1965) | Handle map output buffers better | Major | . | Devaraj Das | Amar Kamat |
-| [HADOOP-1900](https://issues.apache.org/jira/browse/HADOOP-1900) | the heartbeat and task event queries interval should be set dynamically by the JobTracker | Major | . | Owen O'Malley | Amareshwari Sriramadasu |
+| [HADOOP-2464](https://issues.apache.org/jira/browse/HADOOP-2464) | Test permissions related shell commands with DFS | Major | . | Raghu Angadi | Raghu Angadi |
| [HADOOP-1876](https://issues.apache.org/jira/browse/HADOOP-1876) | Persisting completed jobs status | Critical | . | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-1873](https://issues.apache.org/jira/browse/HADOOP-1873) | User permissions for Map/Reduce | Major | . | Raghu Angadi | Hairong Kuang |
-| [HADOOP-1857](https://issues.apache.org/jira/browse/HADOOP-1857) | Ability to run a script when a task fails to capture stack traces | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-1855](https://issues.apache.org/jira/browse/HADOOP-1855) | fsck should verify block placement | Major | . | dhruba borthakur | Konstantin Shvachko |
-| [HADOOP-1848](https://issues.apache.org/jira/browse/HADOOP-1848) | Redesign of Eclipse plug-in interface with Hadoop | Major | . | Christophe Taton | Christophe Taton |
-| [HADOOP-1843](https://issues.apache.org/jira/browse/HADOOP-1843) | Remove deprecated code in Configuration/JobConf | Major | conf | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1841](https://issues.apache.org/jira/browse/HADOOP-1841) | IPC server should write repsonses asynchronously | Major | ipc | Doug Cutting | dhruba borthakur |
-| [HADOOP-1839](https://issues.apache.org/jira/browse/HADOOP-1839) | Link-ify the Pending/Running/Complete/Killed tasks/task-attempts on jobdetails.jsp | Major | . | Arun C Murthy | Amar Kamat |
+| [HADOOP-2077](https://issues.apache.org/jira/browse/HADOOP-2077) | Logging version number (and compiled date) at STARTUP\_MSG | Trivial | . | Koji Noguchi | Arun C Murthy |
+| [HADOOP-1989](https://issues.apache.org/jira/browse/HADOOP-1989) | Add support for simulated Data Nodes - helpful for testing and performance benchmarking of the Name Node without having a large cluster | Minor | . | Sanjay Radia | Sanjay Radia |
| [HADOOP-1742](https://issues.apache.org/jira/browse/HADOOP-1742) | FSNamesystem.startFile() javadoc is inconsistent | Minor | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-1719](https://issues.apache.org/jira/browse/HADOOP-1719) | Improve the utilization of shuffle copier threads | Major | . | Devaraj Das | Amar Kamat |
| [HADOOP-1707](https://issues.apache.org/jira/browse/HADOOP-1707) | Remove the DFS Client disk-based cache | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-1660](https://issues.apache.org/jira/browse/HADOOP-1660) | add support for native library toDistributedCache | Major | . | Alejandro Abdelnur | Arun C Murthy |
-| [HADOOP-1302](https://issues.apache.org/jira/browse/HADOOP-1302) | Remove deprecated contrib/abacus code | Major | . | Doug Cutting | Enis Soztutar |
-| [HADOOP-1274](https://issues.apache.org/jira/browse/HADOOP-1274) | Configuring different number of mappers and reducers per TaskTracker | Major | . | Koji Noguchi | Amareshwari Sriramadasu |
-| [HADOOP-1210](https://issues.apache.org/jira/browse/HADOOP-1210) | Log counters in job history | Minor | . | Albert Chern | Owen O'Malley |
-| [HADOOP-1185](https://issues.apache.org/jira/browse/HADOOP-1185) | dynamically change log levels | Major | util | dhruba borthakur | Tsz Wo Nicholas Sze |
+| [HADOOP-2298](https://issues.apache.org/jira/browse/HADOOP-2298) | ant target without source and docs | Major | build | Gautam Kowshik | Hrishikesh |
+| [HADOOP-2469](https://issues.apache.org/jira/browse/HADOOP-2469) | WritableUtils.clone should take Configuration rather than JobConf | Minor | io | stack | stack |
+| [HADOOP-2596](https://issues.apache.org/jira/browse/HADOOP-2596) | add SequenceFile.createWriter() method that takes block size as parameter | Minor | io | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-2645](https://issues.apache.org/jira/browse/HADOOP-2645) | Additional metrics & jmx beans and cleanup to use the recent metrics libraries | Major | . | Sanjay Radia | Sanjay Radia |
+| [HADOOP-2232](https://issues.apache.org/jira/browse/HADOOP-2232) | Add option to disable nagles algorithm in the IPC Server | Major | ipc | Clint Morgan | Clint Morgan |
+| [HADOOP-2566](https://issues.apache.org/jira/browse/HADOOP-2566) | need FileSystem#globStatus method | Major | fs | Doug Cutting | Hairong Kuang |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-2768](https://issues.apache.org/jira/browse/HADOOP-2768) | DFSIO write performance benchmark shows a regression | Blocker | . | Mukund Madhugiri | dhruba borthakur |
-| [HADOOP-2755](https://issues.apache.org/jira/browse/HADOOP-2755) | dfs fsck extremely slow, dfs ls times out | Blocker | . | Christian Kunz | Tsz Wo Nicholas Sze |
-| [HADOOP-2740](https://issues.apache.org/jira/browse/HADOOP-2740) | Modify HOD to work with changes mentioned in HADOOP-2404 | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-2734](https://issues.apache.org/jira/browse/HADOOP-2734) | docs link to lucene.apache.org | Major | documentation | Doug Cutting | Doug Cutting |
-| [HADOOP-2732](https://issues.apache.org/jira/browse/HADOOP-2732) | ab{5[6-9],[6-9][6-9]}.gz should not be treated as an illegal glob | Blocker | fs | Hairong Kuang | Hairong Kuang |
-| [HADOOP-2723](https://issues.apache.org/jira/browse/HADOOP-2723) | Hadoop 2367- Does not respect JobConf.getProfileEnabled() | Blocker | . | Clint Morgan | Amareshwari Sriramadasu |
-| [HADOOP-2720](https://issues.apache.org/jira/browse/HADOOP-2720) | Update HOD in Hadoop 0.16 | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-2714](https://issues.apache.org/jira/browse/HADOOP-2714) | Unit test fails on Windows: rg.apache.hadoop.dfs.TestDecommission | Blocker | . | Mukund Madhugiri | dhruba borthakur |
-| [HADOOP-2713](https://issues.apache.org/jira/browse/HADOOP-2713) | Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath | Blocker | . | Mukund Madhugiri | dhruba borthakur |
-| [HADOOP-2691](https://issues.apache.org/jira/browse/HADOOP-2691) | Some junit tests fail with the exception: All datanodes are bad. Aborting... | Major | . | Hairong Kuang | dhruba borthakur |
-| [HADOOP-2687](https://issues.apache.org/jira/browse/HADOOP-2687) | 1707 added errant INFO-level logging to DFSClient | Blocker | . | stack | stack |
-| [HADOOP-2659](https://issues.apache.org/jira/browse/HADOOP-2659) | The commands in DFSAdmin should require admin privilege | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-2652](https://issues.apache.org/jira/browse/HADOOP-2652) | Fix permission issues for HftpFileSystem | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-2649](https://issues.apache.org/jira/browse/HADOOP-2649) | The ReplicationMonitor sleep period should be configurable | Blocker | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-2646](https://issues.apache.org/jira/browse/HADOOP-2646) | SortValidator broken with fully-qualified working directories | Blocker | test | Doug Cutting | Arun C Murthy |
-| [HADOOP-2640](https://issues.apache.org/jira/browse/HADOOP-2640) | MultiFileSplitInputFormat always returns 1 split when avgLengthPerSplit \> Integer.MAX\_VALUE | Blocker | . | Frédéric Bertin | Enis Soztutar |
-| [HADOOP-2639](https://issues.apache.org/jira/browse/HADOOP-2639) | Reducers stuck in shuffle | Blocker | . | Amareshwari Sriramadasu | Arun C Murthy |
-| [HADOOP-2633](https://issues.apache.org/jira/browse/HADOOP-2633) | Revert change to fsck made as part of permissions implementation | Blocker | . | Robert Chansler | Tsz Wo Nicholas Sze |
-| [HADOOP-2626](https://issues.apache.org/jira/browse/HADOOP-2626) | RawLocalFileStatus is badly handling URIs | Major | fs | Frédéric Bertin | Doug Cutting |
-| [HADOOP-2620](https://issues.apache.org/jira/browse/HADOOP-2620) | 'bin/hadoop fs -help' does not list file permissions commands. | Trivial | fs | Raghu Angadi | Raghu Angadi |
-| [HADOOP-2614](https://issues.apache.org/jira/browse/HADOOP-2614) | dfs web interfaces should run as a configurable user account | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-2605](https://issues.apache.org/jira/browse/HADOOP-2605) | leading slash in mapred.task.tracker.report.bindAddress | Major | conf | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-2601](https://issues.apache.org/jira/browse/HADOOP-2601) | TestNNThroughput should not use a fixed namenode port | Major | . | Hairong Kuang | Konstantin Shvachko |
-| [HADOOP-2583](https://issues.apache.org/jira/browse/HADOOP-2583) | Potential Eclipse plug-in UI loop when editing location parameters | Minor | contrib/eclipse-plugin | Christophe Taton | Christophe Taton |
-| [HADOOP-2582](https://issues.apache.org/jira/browse/HADOOP-2582) | hadoop dfs -copyToLocal creates zero byte files, when source file does not exists | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-2576](https://issues.apache.org/jira/browse/HADOOP-2576) | Namenode performance degradation over time | Blocker | . | Christian Kunz | Raghu Angadi |
-| [HADOOP-2571](https://issues.apache.org/jira/browse/HADOOP-2571) | javac generates a warning in test/o.a.h.io.FileBench | Trivial | test | Chris Douglas | Chris Douglas |
-| [HADOOP-2549](https://issues.apache.org/jira/browse/HADOOP-2549) | hdfs does not honor dfs.du.reserved setting | Critical | . | Joydeep Sen Sarma | Hairong Kuang |
-| [HADOOP-2538](https://issues.apache.org/jira/browse/HADOOP-2538) | NPE in TaskLog.java | Trivial | . | Michael Bieniosek | Michael Bieniosek |
-| [HADOOP-2537](https://issues.apache.org/jira/browse/HADOOP-2537) | make build process compatible with Ant 1.7.0 | Major | build | Nigel Daley | Hrishikesh |
-| [HADOOP-2535](https://issues.apache.org/jira/browse/HADOOP-2535) | Remove support for deprecated mapred.child.heap.size and indentation fix in TaskRunner.java | Minor | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-2523](https://issues.apache.org/jira/browse/HADOOP-2523) | Unit test fails on Windows: TestDFSShell.testFilePermissions | Blocker | . | Mukund Madhugiri | Raghu Angadi |
-| [HADOOP-2512](https://issues.apache.org/jira/browse/HADOOP-2512) | error stream handling in Shell executor | Blocker | util | Raghu Angadi | Raghu Angadi |
-| [HADOOP-2511](https://issues.apache.org/jira/browse/HADOOP-2511) | HADOOP-2344 introduced a javadoc warning | Major | documentation | Arun C Murthy | Arun C Murthy |
-| [HADOOP-2509](https://issues.apache.org/jira/browse/HADOOP-2509) | Add rat target to build | Major | build | Nigel Daley | Hrishikesh |
-| [HADOOP-2503](https://issues.apache.org/jira/browse/HADOOP-2503) | REST Insert / Select | Critical | . | Billy Pearson | Bryan Duxbury |
-| [HADOOP-2494](https://issues.apache.org/jira/browse/HADOOP-2494) | Set +x on contrib/\*/bin/\* in packaged tar bundle | Major | scripts | stack | stack |
-| [HADOOP-2492](https://issues.apache.org/jira/browse/HADOOP-2492) | ConcurrentModificationException in org.apache.hadoop.ipc.Server.Responder | Major | ipc | Devaraj Das | dhruba borthakur |
-| [HADOOP-2481](https://issues.apache.org/jira/browse/HADOOP-2481) | NNBench should periodically report its progress | Major | test | Hairong Kuang | Hairong Kuang |
-| [HADOOP-2476](https://issues.apache.org/jira/browse/HADOOP-2476) | Unit test fails on Windows: TestCopyFiles.testCopyFromLocalToLocal | Blocker | fs | Mukund Madhugiri | Raghu Angadi |
-| [HADOOP-2459](https://issues.apache.org/jira/browse/HADOOP-2459) | Running 'ant docs tar' includes src/docs/build in the resulting tar file | Minor | build | Nigel Daley | Nigel Daley |
-| [HADOOP-2453](https://issues.apache.org/jira/browse/HADOOP-2453) | wordcount-simple example gives ParseException with examples configuration file | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-2452](https://issues.apache.org/jira/browse/HADOOP-2452) | Eclipse plug-in build.xml issue | Trivial | build | Christophe Taton | Christophe Taton |
-| [HADOOP-2446](https://issues.apache.org/jira/browse/HADOOP-2446) | TestHDFSServerPorts fails. | Major | test | Raghu Angadi | Nigel Daley |
-| [HADOOP-2442](https://issues.apache.org/jira/browse/HADOOP-2442) | Unit test failed: org.apache.hadoop.fs.TestLocalFileSystemPermission.testLocalFSsetOwner | Critical | fs | Mukund Madhugiri | Raghu Angadi |
-| [HADOOP-2434](https://issues.apache.org/jira/browse/HADOOP-2434) | MapFile.get on HDFS in TRUNK is WAY!!! slower than 0.15.x | Blocker | io | stack | stack |
-| [HADOOP-2420](https://issues.apache.org/jira/browse/HADOOP-2420) | Use exit code to detect normal errors while excuting 'ls' in Local FS | Blocker | fs | Raghu Angadi | Raghu Angadi |
-| [HADOOP-2404](https://issues.apache.org/jira/browse/HADOOP-2404) | HADOOP-2185 breaks compatibility with hadoop-0.15.0 | Blocker | conf | Arun C Murthy | Owen O'Malley |
-| [HADOOP-2402](https://issues.apache.org/jira/browse/HADOOP-2402) | Lzo compression compresses each write from TextOutputFormat | Major | io, native | Chris Douglas | Chris Douglas |
-| [HADOOP-2376](https://issues.apache.org/jira/browse/HADOOP-2376) | The sort example shouldn't override the number of maps | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-2072](https://issues.apache.org/jira/browse/HADOOP-2072) | RawLocalFileStatus is causing Path problems | Major | fs | Dennis Kubes | |
+| [HADOOP-1245](https://issues.apache.org/jira/browse/HADOOP-1245) | value for mapred.tasktracker.tasks.maximum taken from jobtracker, not tasktracker | Major | . | Michael Bieniosek | Michael Bieniosek |
+| [HADOOP-1898](https://issues.apache.org/jira/browse/HADOOP-1898) | locking for the ReflectionUtils.logThreadInfo is too conservative | Major | util | Owen O'Malley | Amareshwari Sriramadasu |
+| [HADOOP-2100](https://issues.apache.org/jira/browse/HADOOP-2100) | hadoop-daemon.sh script fails if HADOOP\_PID\_DIR doesn't exist | Major | scripts | Arun C Murthy | Michael Bieniosek |
+| [HADOOP-2096](https://issues.apache.org/jira/browse/HADOOP-2096) | The file used to localize job.xml should be closed. | Minor | . | Amar Kamat | Amar Kamat |
+| [HADOOP-2098](https://issues.apache.org/jira/browse/HADOOP-2098) | File handles for log files are still open in case of jobs with 0 maps | Major | . | Amar Kamat | Amar Kamat |
+| [HADOOP-2112](https://issues.apache.org/jira/browse/HADOOP-2112) | TestMiniMRMapRedDebugScript fails due to a missing file | Blocker | . | Devaraj Das | Arun C Murthy |
+| [HADOOP-2089](https://issues.apache.org/jira/browse/HADOOP-2089) | Multiple caheArchive does not work in Hadoop streaming | Critical | . | Milind Bhandarkar | Lohit Vijayarenu |
+| [HADOOP-2071](https://issues.apache.org/jira/browse/HADOOP-2071) | StreamXmlRecordReader throws java.io.IOException: Mark/reset exception in hadoop 0.14 | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-1348](https://issues.apache.org/jira/browse/HADOOP-1348) | Configuration XML bug: comments inside values | Critical | conf | Eelco Lempsink | Rajagopal Natarajan |
+| [HADOOP-1952](https://issues.apache.org/jira/browse/HADOOP-1952) | Streaming does not handle invalid -inputformat (typo by users for example) | Minor | . | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-2151](https://issues.apache.org/jira/browse/HADOOP-2151) | FileSyste.globPaths does not validate the return list of Paths | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-2121](https://issues.apache.org/jira/browse/HADOOP-2121) | Unexpected IOException in DFSOutputStream.close() | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-1130](https://issues.apache.org/jira/browse/HADOOP-1130) | Remove unused ClientFinalizer in DFSClient | Major | . | Philippe Gassmann | Chris Douglas |
+| [HADOOP-2204](https://issues.apache.org/jira/browse/HADOOP-2204) | DFSTestUtil.waitReplication does not wait. | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-2078](https://issues.apache.org/jira/browse/HADOOP-2078) | Name-node should be able to close empty files. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-1642](https://issues.apache.org/jira/browse/HADOOP-1642) | Jobs using LocalJobRunner + JobControl fails | Critical | . | Johan Oskarsson | Doug Cutting |
+| [HADOOP-2104](https://issues.apache.org/jira/browse/HADOOP-2104) | clover description attribute suppresses all other targets in -projecthelp | Trivial | build | Chris Douglas | Chris Douglas |
+| [HADOOP-2212](https://issues.apache.org/jira/browse/HADOOP-2212) | java.lang.ArithmeticException: / by zero in ChecksumFileSystem.open | Critical | fs | Michael Bieniosek | Michael Bieniosek |
+| [HADOOP-2216](https://issues.apache.org/jira/browse/HADOOP-2216) | Job UI doesnot show running tasks and complete tasks correctly. | Major | . | Amareshwari Sriramadasu | Amar Kamat |
+| [HADOOP-2272](https://issues.apache.org/jira/browse/HADOOP-2272) | findbugs currently fails due to hadoop-streaming having moved | Major | build | Adrian Woodhead | stack |
+| [HADOOP-2244](https://issues.apache.org/jira/browse/HADOOP-2244) | MapWritable.readFields needs to clear internal hash else instance accumulates entries forever | Major | io | stack | stack |
+| [HADOOP-1984](https://issues.apache.org/jira/browse/HADOOP-1984) | some reducer stuck at copy phase and progress extremely slowly | Critical | . | Runping Qi | Amar Kamat |
+| [HADOOP-2245](https://issues.apache.org/jira/browse/HADOOP-2245) | TestRecordMR and TestAggregates fail once in a while | Major | . | Devaraj Das | Adrian Woodhead |
+| [HADOOP-2275](https://issues.apache.org/jira/browse/HADOOP-2275) | Erroneous detection of corrupted file when namenode fails to allocate any datanodes for newly allocated block | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-2256](https://issues.apache.org/jira/browse/HADOOP-2256) | TestBlockReplacement unit test failed. | Major | . | Raghu Angadi | Hairong Kuang |
+| [HADOOP-2209](https://issues.apache.org/jira/browse/HADOOP-2209) | SecondaryNamenode process should exit if it encounters Runtime exceptions | Major | . | dhruba borthakur | |
+| [HADOOP-2314](https://issues.apache.org/jira/browse/HADOOP-2314) | TestBlockReplacement occasionally get into an infinite loop | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-2300](https://issues.apache.org/jira/browse/HADOOP-2300) | mapred.tasktracker.tasks.maximum is completely ignored | Blocker | . | Owen O'Malley | Amareshwari Sriramadasu |
| [HADOOP-2368](https://issues.apache.org/jira/browse/HADOOP-2368) | Lots of unit tests fail on Windows with exception: Login failed: CreateProcess | Blocker | . | Mukund Madhugiri | Tsz Wo Nicholas Sze |
-| [HADOOP-2365](https://issues.apache.org/jira/browse/HADOOP-2365) | Result of HashFunction.hash() contains all identical values | Minor | . | Andrzej Bialecki | Jim Kellerman |
| [HADOOP-2363](https://issues.apache.org/jira/browse/HADOOP-2363) | Unit tests fail if there is another instance of Hadoop | Major | test | Raghu Angadi | Konstantin Shvachko |
+| [HADOOP-2271](https://issues.apache.org/jira/browse/HADOOP-2271) | chmod in ant package target fails | Major | build | Adrian Woodhead | Adrian Woodhead |
+| [HADOOP-2313](https://issues.apache.org/jira/browse/HADOOP-2313) | build does not fail when libhdfs build fails | Minor | . | Nigel Daley | Nigel Daley |
| [HADOOP-2359](https://issues.apache.org/jira/browse/HADOOP-2359) | PendingReplicationMonitor thread received exception. java.lang.InterruptedException | Major | . | Owen O'Malley | dhruba borthakur |
-| [HADOOP-2352](https://issues.apache.org/jira/browse/HADOOP-2352) | Remove AC\_LIB\_CHECK from src/native/configure.ac to ensure libhadoop.so doesn't have a dependency on libz.so/liblzo.so | Major | native | Arun C Murthy | Arun C Murthy |
-| [HADOOP-2344](https://issues.apache.org/jira/browse/HADOOP-2344) | Free up the buffers (input and error) while executing a shell command before waiting for it to finish. | Major | . | Amar Kamat | Amar Kamat |
+| [HADOOP-2365](https://issues.apache.org/jira/browse/HADOOP-2365) | Result of HashFunction.hash() contains all identical values | Minor | . | Andrzej Bialecki | Jim Kellerman |
| [HADOOP-2323](https://issues.apache.org/jira/browse/HADOOP-2323) | JobTracker.close() prints stack traces for exceptions that are not errors | Minor | . | Jim Kellerman | Jim Kellerman |
-| [HADOOP-2314](https://issues.apache.org/jira/browse/HADOOP-2314) | TestBlockReplacement occasionally get into an infinite loop | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-2313](https://issues.apache.org/jira/browse/HADOOP-2313) | build does not fail when libhdfs build fails | Minor | . | Nigel Daley | Nigel Daley |
-| [HADOOP-2300](https://issues.apache.org/jira/browse/HADOOP-2300) | mapred.tasktracker.tasks.maximum is completely ignored | Blocker | . | Owen O'Malley | Amareshwari Sriramadasu |
-| [HADOOP-2285](https://issues.apache.org/jira/browse/HADOOP-2285) | TextInputFormat is slow compared to reading files. | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-2284](https://issues.apache.org/jira/browse/HADOOP-2284) | BasicTypeSorterBase.compare calls progress on each compare | Major | . | Owen O'Malley | Amar Kamat |
-| [HADOOP-2275](https://issues.apache.org/jira/browse/HADOOP-2275) | Erroneous detection of corrupted file when namenode fails to allocate any datanodes for newly allocated block | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-2272](https://issues.apache.org/jira/browse/HADOOP-2272) | findbugs currently fails due to hadoop-streaming having moved | Major | build | Adrian Woodhead | stack |
-| [HADOOP-2271](https://issues.apache.org/jira/browse/HADOOP-2271) | chmod in ant package target fails | Major | build | Adrian Woodhead | Adrian Woodhead |
-| [HADOOP-2256](https://issues.apache.org/jira/browse/HADOOP-2256) | TestBlockReplacement unit test failed. | Major | . | Raghu Angadi | Hairong Kuang |
+| [HADOOP-2376](https://issues.apache.org/jira/browse/HADOOP-2376) | The sort example shouldn't override the number of maps | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-2248](https://issues.apache.org/jira/browse/HADOOP-2248) | Word count example is spending 24% of the time in incrCounter | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-2247](https://issues.apache.org/jira/browse/HADOOP-2247) | Mappers fail easily due to repeated failures | Blocker | . | Srikanth Kakani | Amar Kamat |
-| [HADOOP-2245](https://issues.apache.org/jira/browse/HADOOP-2245) | TestRecordMR and TestAggregates fail once in a while | Major | . | Devaraj Das | Adrian Woodhead |
-| [HADOOP-2244](https://issues.apache.org/jira/browse/HADOOP-2244) | MapWritable.readFields needs to clear internal hash else instance accumulates entries forever | Major | io | stack | stack |
| [HADOOP-2228](https://issues.apache.org/jira/browse/HADOOP-2228) | Jobs fail because job.xml exists | Major | . | Johan Oskarsson | Johan Oskarsson |
-| [HADOOP-2220](https://issues.apache.org/jira/browse/HADOOP-2220) | Reduce tasks fail too easily because of repeated fetch failures | Blocker | . | Christian Kunz | Amar Kamat |
-| [HADOOP-2216](https://issues.apache.org/jira/browse/HADOOP-2216) | Job UI doesnot show running tasks and complete tasks correctly. | Major | . | Amareshwari Sriramadasu | Amar Kamat |
+| [HADOOP-2434](https://issues.apache.org/jira/browse/HADOOP-2434) | MapFile.get on HDFS in TRUNK is WAY!!! slower than 0.15.x | Blocker | io | stack | stack |
+| [HADOOP-2459](https://issues.apache.org/jira/browse/HADOOP-2459) | Running 'ant docs tar' includes src/docs/build in the resulting tar file | Minor | build | Nigel Daley | Nigel Daley |
+| [HADOOP-2453](https://issues.apache.org/jira/browse/HADOOP-2453) | wordcount-simple example gives ParseException with examples configuration file | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
| [HADOOP-2215](https://issues.apache.org/jira/browse/HADOOP-2215) | Change documentation in cluster\_setup.html and mapred\_tutorial.html post HADOOP-1274 | Major | documentation | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-2212](https://issues.apache.org/jira/browse/HADOOP-2212) | java.lang.ArithmeticException: / by zero in ChecksumFileSystem.open | Critical | fs | Michael Bieniosek | Michael Bieniosek |
-| [HADOOP-2209](https://issues.apache.org/jira/browse/HADOOP-2209) | SecondaryNamenode process should exit if it encounters Runtime exceptions | Major | . | dhruba borthakur | |
-| [HADOOP-2204](https://issues.apache.org/jira/browse/HADOOP-2204) | DFSTestUtil.waitReplication does not wait. | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-2189](https://issues.apache.org/jira/browse/HADOOP-2189) | Incrementing user counters should count as progress | Blocker | . | Owen O'Malley | Devaraj Das |
-| [HADOOP-2151](https://issues.apache.org/jira/browse/HADOOP-2151) | FileSyste.globPaths does not validate the return list of Paths | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-2121](https://issues.apache.org/jira/browse/HADOOP-2121) | Unexpected IOException in DFSOutputStream.close() | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-2112](https://issues.apache.org/jira/browse/HADOOP-2112) | TestMiniMRMapRedDebugScript fails due to a missing file | Blocker | . | Devaraj Das | Arun C Murthy |
-| [HADOOP-2104](https://issues.apache.org/jira/browse/HADOOP-2104) | clover description attribute suppresses all other targets in -projecthelp | Trivial | build | Chris Douglas | Chris Douglas |
-| [HADOOP-2100](https://issues.apache.org/jira/browse/HADOOP-2100) | hadoop-daemon.sh script fails if HADOOP\_PID\_DIR doesn't exist | Major | scripts | Arun C Murthy | Michael Bieniosek |
-| [HADOOP-2098](https://issues.apache.org/jira/browse/HADOOP-2098) | File handles for log files are still open in case of jobs with 0 maps | Major | . | Amar Kamat | Amar Kamat |
-| [HADOOP-2096](https://issues.apache.org/jira/browse/HADOOP-2096) | The file used to localize job.xml should be closed. | Minor | . | Amar Kamat | Amar Kamat |
-| [HADOOP-2092](https://issues.apache.org/jira/browse/HADOOP-2092) | Pipes C++ task does not die even if the Java tasks die | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-2089](https://issues.apache.org/jira/browse/HADOOP-2089) | Multiple caheArchive does not work in Hadoop streaming | Critical | . | Milind Bhandarkar | Lohit Vijayarenu |
-| [HADOOP-2078](https://issues.apache.org/jira/browse/HADOOP-2078) | Name-node should be able to close empty files. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-2072](https://issues.apache.org/jira/browse/HADOOP-2072) | RawLocalFileStatus is causing Path problems | Major | fs | Dennis Kubes | |
-| [HADOOP-2071](https://issues.apache.org/jira/browse/HADOOP-2071) | StreamXmlRecordReader throws java.io.IOException: Mark/reset exception in hadoop 0.14 | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-1984](https://issues.apache.org/jira/browse/HADOOP-1984) | some reducer stuck at copy phase and progress extremely slowly | Critical | . | Runping Qi | Amar Kamat |
-| [HADOOP-1952](https://issues.apache.org/jira/browse/HADOOP-1952) | Streaming does not handle invalid -inputformat (typo by users for example) | Minor | . | Lohit Vijayarenu | Lohit Vijayarenu |
-| [HADOOP-1898](https://issues.apache.org/jira/browse/HADOOP-1898) | locking for the ReflectionUtils.logThreadInfo is too conservative | Major | util | Owen O'Malley | Amareshwari Sriramadasu |
-| [HADOOP-1642](https://issues.apache.org/jira/browse/HADOOP-1642) | Jobs using LocalJobRunner + JobControl fails | Critical | . | Johan Oskarsson | Doug Cutting |
-| [HADOOP-1348](https://issues.apache.org/jira/browse/HADOOP-1348) | Configuration XML bug: comments inside values | Critical | conf | Eelco Lempsink | Rajagopal Natarajan |
+| [HADOOP-2352](https://issues.apache.org/jira/browse/HADOOP-2352) | Remove AC\_LIB\_CHECK from src/native/configure.ac to ensure libhadoop.so doesn't have a dependency on libz.so/liblzo.so | Major | native | Arun C Murthy | Arun C Murthy |
+| [HADOOP-2220](https://issues.apache.org/jira/browse/HADOOP-2220) | Reduce tasks fail too easily because of repeated fetch failures | Blocker | . | Christian Kunz | Amar Kamat |
+| [HADOOP-2247](https://issues.apache.org/jira/browse/HADOOP-2247) | Mappers fail easily due to repeated failures | Blocker | . | Srikanth Kakani | Amar Kamat |
+| [HADOOP-2452](https://issues.apache.org/jira/browse/HADOOP-2452) | Eclipse plug-in build.xml issue | Trivial | build | Christophe Taton | Christophe Taton |
+| [HADOOP-2476](https://issues.apache.org/jira/browse/HADOOP-2476) | Unit test fails on Windows: TestCopyFiles.testCopyFromLocalToLocal | Blocker | fs | Mukund Madhugiri | Raghu Angadi |
+| [HADOOP-2503](https://issues.apache.org/jira/browse/HADOOP-2503) | REST Insert / Select | Critical | . | Billy Pearson | Bryan Duxbury |
+| [HADOOP-2492](https://issues.apache.org/jira/browse/HADOOP-2492) | ConcurrentModificationException in org.apache.hadoop.ipc.Server.Responder | Major | ipc | Devaraj Das | dhruba borthakur |
+| [HADOOP-2344](https://issues.apache.org/jira/browse/HADOOP-2344) | Free up the buffers (input and error) while executing a shell command before waiting for it to finish. | Major | . | Amar Kamat | Amar Kamat |
+| [HADOOP-2511](https://issues.apache.org/jira/browse/HADOOP-2511) | HADOOP-2344 introduced a javadoc warning | Major | documentation | Arun C Murthy | Arun C Murthy |
+| [HADOOP-2442](https://issues.apache.org/jira/browse/HADOOP-2442) | Unit test failed: org.apache.hadoop.fs.TestLocalFileSystemPermission.testLocalFSsetOwner | Critical | fs | Mukund Madhugiri | Raghu Angadi |
+| [HADOOP-2523](https://issues.apache.org/jira/browse/HADOOP-2523) | Unit test fails on Windows: TestDFSShell.testFilePermissions | Blocker | . | Mukund Madhugiri | Raghu Angadi |
+| [HADOOP-2535](https://issues.apache.org/jira/browse/HADOOP-2535) | Remove support for deprecated mapred.child.heap.size and indentation fix in TaskRunner.java | Minor | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-2512](https://issues.apache.org/jira/browse/HADOOP-2512) | error stream handling in Shell executor | Blocker | util | Raghu Angadi | Raghu Angadi |
+| [HADOOP-2420](https://issues.apache.org/jira/browse/HADOOP-2420) | Use exit code to detect normal errors while excuting 'ls' in Local FS | Blocker | fs | Raghu Angadi | Raghu Angadi |
+| [HADOOP-2285](https://issues.apache.org/jira/browse/HADOOP-2285) | TextInputFormat is slow compared to reading files. | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-2446](https://issues.apache.org/jira/browse/HADOOP-2446) | TestHDFSServerPorts fails. | Major | test | Raghu Angadi | Nigel Daley |
+| [HADOOP-2537](https://issues.apache.org/jira/browse/HADOOP-2537) | make build process compatible with Ant 1.7.0 | Major | build | Nigel Daley | Hrishikesh |
| [HADOOP-1281](https://issues.apache.org/jira/browse/HADOOP-1281) | Speculative map tasks aren't getting killed although the TIP completed | Critical | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-1245](https://issues.apache.org/jira/browse/HADOOP-1245) | value for mapred.tasktracker.tasks.maximum taken from jobtracker, not tasktracker | Major | . | Michael Bieniosek | Michael Bieniosek |
-| [HADOOP-1195](https://issues.apache.org/jira/browse/HADOOP-1195) | NullPointerException in FSNamesystem due to getDatanode() return value is not checked | Major | . | Konstantin Shvachko | dhruba borthakur |
-| [HADOOP-1130](https://issues.apache.org/jira/browse/HADOOP-1130) | Remove unused ClientFinalizer in DFSClient | Major | . | Philippe Gassmann | Chris Douglas |
+| [HADOOP-2571](https://issues.apache.org/jira/browse/HADOOP-2571) | javac generates a warning in test/o.a.h.io.FileBench | Trivial | test | Chris Douglas | Chris Douglas |
+| [HADOOP-2583](https://issues.apache.org/jira/browse/HADOOP-2583) | Potential Eclipse plug-in UI loop when editing location parameters | Minor | contrib/eclipse-plugin | Christophe Taton | Christophe Taton |
+| [HADOOP-2481](https://issues.apache.org/jira/browse/HADOOP-2481) | NNBench should periodically report its progress | Major | test | Hairong Kuang | Hairong Kuang |
+| [HADOOP-2601](https://issues.apache.org/jira/browse/HADOOP-2601) | TestNNThroughput should not use a fixed namenode port | Major | . | Hairong Kuang | Konstantin Shvachko |
+| [HADOOP-2494](https://issues.apache.org/jira/browse/HADOOP-2494) | Set +x on contrib/\*/bin/\* in packaged tar bundle | Major | scripts | stack | stack |
+| [HADOOP-2605](https://issues.apache.org/jira/browse/HADOOP-2605) | leading slash in mapred.task.tracker.report.bindAddress | Major | conf | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-2620](https://issues.apache.org/jira/browse/HADOOP-2620) | 'bin/hadoop fs -help' does not list file permissions commands. | Trivial | fs | Raghu Angadi | Raghu Angadi |
+| [HADOOP-2614](https://issues.apache.org/jira/browse/HADOOP-2614) | dfs web interfaces should run as a configurable user account | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-290](https://issues.apache.org/jira/browse/HADOOP-290) | Fix Datanode transfer thread logging | Minor | . | Dennis Kubes | dhruba borthakur |
+| [HADOOP-2538](https://issues.apache.org/jira/browse/HADOOP-2538) | NPE in TaskLog.java | Trivial | . | Michael Bieniosek | Michael Bieniosek |
+| [HADOOP-2582](https://issues.apache.org/jira/browse/HADOOP-2582) | hadoop dfs -copyToLocal creates zero byte files, when source file does not exists | Major | . | Lohit Vijayarenu | Lohit Vijayarenu |
+| [HADOOP-2189](https://issues.apache.org/jira/browse/HADOOP-2189) | Incrementing user counters should count as progress | Blocker | . | Owen O'Malley | Devaraj Das |
+| [HADOOP-2284](https://issues.apache.org/jira/browse/HADOOP-2284) | BasicTypeSorterBase.compare calls progress on each compare | Major | . | Owen O'Malley | Amar Kamat |
+| [HADOOP-2649](https://issues.apache.org/jira/browse/HADOOP-2649) | The ReplicationMonitor sleep period should be configurable | Blocker | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-2549](https://issues.apache.org/jira/browse/HADOOP-2549) | hdfs does not honor dfs.du.reserved setting | Critical | . | Joydeep Sen Sarma | Hairong Kuang |
+| [HADOOP-2509](https://issues.apache.org/jira/browse/HADOOP-2509) | Add rat target to build | Major | build | Nigel Daley | Hrishikesh |
+| [HADOOP-2659](https://issues.apache.org/jira/browse/HADOOP-2659) | The commands in DFSAdmin should require admin privilege | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-2633](https://issues.apache.org/jira/browse/HADOOP-2633) | Revert change to fsck made as part of permissions implementation | Blocker | . | Robert Chansler | Tsz Wo Nicholas Sze |
+| [HADOOP-2687](https://issues.apache.org/jira/browse/HADOOP-2687) | 1707 added errant INFO-level logging to DFSClient | Blocker | . | stack | stack |
+| [HADOOP-2402](https://issues.apache.org/jira/browse/HADOOP-2402) | Lzo compression compresses each write from TextOutputFormat | Major | io, native | Chris Douglas | Chris Douglas |
+| [HADOOP-2691](https://issues.apache.org/jira/browse/HADOOP-2691) | Some junit tests fail with the exception: All datanodes are bad. Aborting... | Major | . | Hairong Kuang | dhruba borthakur |
+| [HADOOP-1195](https://issues.apache.org/jira/browse/HADOOP-1195) | NullPointerException in FSNamesystem due to getDatanode() return value is not checked | Major | . | Konstantin Shvachko | dhruba borthakur |
+| [HADOOP-2640](https://issues.apache.org/jira/browse/HADOOP-2640) | MultiFileSplitInputFormat always returns 1 split when avgLengthPerSplit \> Integer.MAX\_VALUE | Blocker | . | Frédéric Bertin | Enis Soztutar |
+| [HADOOP-2626](https://issues.apache.org/jira/browse/HADOOP-2626) | RawLocalFileStatus is badly handling URIs | Major | fs | Frédéric Bertin | Doug Cutting |
+| [HADOOP-2646](https://issues.apache.org/jira/browse/HADOOP-2646) | SortValidator broken with fully-qualified working directories | Blocker | test | Doug Cutting | Arun C Murthy |
+| [HADOOP-2652](https://issues.apache.org/jira/browse/HADOOP-2652) | Fix permission issues for HftpFileSystem | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-2092](https://issues.apache.org/jira/browse/HADOOP-2092) | Pipes C++ task does not die even if the Java tasks die | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-2714](https://issues.apache.org/jira/browse/HADOOP-2714) | Unit test fails on Windows: rg.apache.hadoop.dfs.TestDecommission | Blocker | . | Mukund Madhugiri | dhruba borthakur |
+| [HADOOP-2576](https://issues.apache.org/jira/browse/HADOOP-2576) | Namenode performance degradation over time | Blocker | . | Christian Kunz | Raghu Angadi |
+| [HADOOP-2720](https://issues.apache.org/jira/browse/HADOOP-2720) | Update HOD in Hadoop 0.16 | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-2713](https://issues.apache.org/jira/browse/HADOOP-2713) | Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath | Blocker | . | Mukund Madhugiri | dhruba borthakur |
+| [HADOOP-2639](https://issues.apache.org/jira/browse/HADOOP-2639) | Reducers stuck in shuffle | Blocker | . | Amareshwari Sriramadasu | Arun C Murthy |
+| [HADOOP-2723](https://issues.apache.org/jira/browse/HADOOP-2723) | Hadoop 2367- Does not respect JobConf.getProfileEnabled() | Blocker | . | Clint Morgan | Amareshwari Sriramadasu |
+| [HADOOP-2734](https://issues.apache.org/jira/browse/HADOOP-2734) | docs link to lucene.apache.org | Major | documentation | Doug Cutting | Doug Cutting |
+| [HADOOP-2732](https://issues.apache.org/jira/browse/HADOOP-2732) | ab{5[6-9],[6-9][6-9]}.gz should not be treated as an illegal glob | Blocker | fs | Hairong Kuang | Hairong Kuang |
+| [HADOOP-2404](https://issues.apache.org/jira/browse/HADOOP-2404) | HADOOP-2185 breaks compatibility with hadoop-0.15.0 | Blocker | conf | Arun C Murthy | Owen O'Malley |
+| [HADOOP-2740](https://issues.apache.org/jira/browse/HADOOP-2740) | Modify HOD to work with changes mentioned in HADOOP-2404 | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-2755](https://issues.apache.org/jira/browse/HADOOP-2755) | dfs fsck extremely slow, dfs ls times out | Blocker | . | Christian Kunz | Tsz Wo Nicholas Sze |
+| [HADOOP-2768](https://issues.apache.org/jira/browse/HADOOP-2768) | DFSIO write performance benchmark shows a regression | Blocker | . | Mukund Madhugiri | dhruba borthakur |
### TESTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-2000](https://issues.apache.org/jira/browse/HADOOP-2000) | Re-write NNBench to use MapReduce | Major | test | Mukund Madhugiri | Mukund Madhugiri |
+| [HADOOP-2369](https://issues.apache.org/jira/browse/HADOOP-2369) | Representative mix of jobs for large cluster throughput benchmarking | Major | test | Chris Douglas | Runping Qi |
+| [HADOOP-2406](https://issues.apache.org/jira/browse/HADOOP-2406) | Micro-benchmark to measure read/write times through InputFormats | Major | fs, test | Chris Douglas | Chris Douglas |
| [HADOOP-2449](https://issues.apache.org/jira/browse/HADOOP-2449) | Restore the old NN Bench that was replaced by a MR NN Bench | Major | . | Sanjay Radia | Sanjay Radia |
| [HADOOP-2431](https://issues.apache.org/jira/browse/HADOOP-2431) | Test HDFS File Permissions | Major | test | Hairong Kuang | Hairong Kuang |
-| [HADOOP-2406](https://issues.apache.org/jira/browse/HADOOP-2406) | Micro-benchmark to measure read/write times through InputFormats | Major | fs, test | Chris Douglas | Chris Douglas |
-| [HADOOP-2369](https://issues.apache.org/jira/browse/HADOOP-2369) | Representative mix of jobs for large cluster throughput benchmarking | Major | test | Chris Douglas | Runping Qi |
| [HADOOP-2342](https://issues.apache.org/jira/browse/HADOOP-2342) | create a micro-benchmark for measure local-file versus hdfs read | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-2000](https://issues.apache.org/jira/browse/HADOOP-2000) | Re-write NNBench to use MapReduce | Major | test | Mukund Madhugiri | Mukund Madhugiri |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.1/CHANGES.0.16.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.1/CHANGES.0.16.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.1/CHANGES.0.16.1.md
index c989fd7..4111e44 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.1/CHANGES.0.16.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.1/CHANGES.0.16.1.md
@@ -20,72 +20,62 @@
## Release 0.16.1 - 2008-03-14
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-2923](https://issues.apache.org/jira/browse/HADOOP-2923) | Check in missing files from HADOOP-2603 | Major | . | Owen O'Malley | Chris Douglas |
| [HADOOP-2735](https://issues.apache.org/jira/browse/HADOOP-2735) | Setting default tmp directory for java createTempFile (java.io.tmpdir) | Critical | . | Koji Noguchi | Amareshwari Sriramadasu |
| [HADOOP-2371](https://issues.apache.org/jira/browse/HADOOP-2371) | Candidate user guide for permissions feature of Hadoop DFS | Major | . | Robert Chansler | Robert Chansler |
+| [HADOOP-2923](https://issues.apache.org/jira/browse/HADOOP-2923) | Check in missing files from HADOOP-2603 | Major | . | Owen O'Malley | Chris Douglas |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-2911](https://issues.apache.org/jira/browse/HADOOP-2911) | [HOD] Make the information printed by allocate and info commands less verbose and clearer | Major | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-| [HADOOP-2861](https://issues.apache.org/jira/browse/HADOOP-2861) | [HOD] Improve the user interface for the HOD commands | Major | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
| [HADOOP-2730](https://issues.apache.org/jira/browse/HADOOP-2730) | Update HOD documentation | Major | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-2861](https://issues.apache.org/jira/browse/HADOOP-2861) | [HOD] Improve the user interface for the HOD commands | Major | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-2911](https://issues.apache.org/jira/browse/HADOOP-2911) | [HOD] Make the information printed by allocate and info commands less verbose and clearer | Major | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-2958](https://issues.apache.org/jira/browse/HADOOP-2958) | Test utility no longer works in trunk | Minor | test | Chris Douglas | Chris Douglas |
-| [HADOOP-2931](https://issues.apache.org/jira/browse/HADOOP-2931) | exception in DFSClient.create: Stream closed | Major | . | Michael Bieniosek | Michael Bieniosek |
-| [HADOOP-2925](https://issues.apache.org/jira/browse/HADOOP-2925) | [HOD] Create mapred system directory using a naming convention that will avoid clashes in multi-user shared cluster scenario. | Major | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-2915](https://issues.apache.org/jira/browse/HADOOP-2915) | mapred output files and directories should be created as the job submitter, not tasktracker or jobtracker | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-2904](https://issues.apache.org/jira/browse/HADOOP-2904) | 3 minor fixes in the rpc metrics area. | Major | . | girish vaitheeswaran | dhruba borthakur |
-| [HADOOP-2903](https://issues.apache.org/jira/browse/HADOOP-2903) | Data type mismatch exception raised from pushMetric | Major | metrics | girish vaitheeswaran | girish vaitheeswaran |
-| [HADOOP-2894](https://issues.apache.org/jira/browse/HADOOP-2894) | task trackers can't survive a job tracker bounce | Blocker | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-2883](https://issues.apache.org/jira/browse/HADOOP-2883) | Extensive write failures | Blocker | . | Christian Kunz | dhruba borthakur |
-| [HADOOP-2869](https://issues.apache.org/jira/browse/HADOOP-2869) | Deprecate and remove SequenceFile.setCompressionType | Major | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-2847](https://issues.apache.org/jira/browse/HADOOP-2847) | [HOD] Idle cluster cleanup does not work if the JobTracker becomes unresponsive to RPC calls | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-2843](https://issues.apache.org/jira/browse/HADOOP-2843) | mapred.join access control is overly restrictive | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-2840](https://issues.apache.org/jira/browse/HADOOP-2840) | Gridmix test script fails to run java sort tests | Major | test | Mukund Madhugiri | Mukund Madhugiri |
-| [HADOOP-2814](https://issues.apache.org/jira/browse/HADOOP-2814) | NPE in datanode during TestDataTransferProtocol. | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-2813](https://issues.apache.org/jira/browse/HADOOP-2813) | Unit test fails on Linux: org.apache.hadoop.fs.TestDU.testDU | Blocker | fs | Mukund Madhugiri | Mahadev konar |
-| [HADOOP-2811](https://issues.apache.org/jira/browse/HADOOP-2811) | method Counters.makeCompactString() does not insert separator char ',' between the counters of different groups. | Critical | . | Runping Qi | Runping Qi |
-| [HADOOP-2809](https://issues.apache.org/jira/browse/HADOOP-2809) | [HOD] Syslog configuration, syslog-address, does not work in HOD 0.4 | Critical | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-| [HADOOP-2808](https://issues.apache.org/jira/browse/HADOOP-2808) | FileUtil::copy ignores "overwrite" formal | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-2789](https://issues.apache.org/jira/browse/HADOOP-2789) | Race condition in ipc.Server prevents responce being written back to client. | Critical | ipc | Clint Morgan | Raghu Angadi |
-| [HADOOP-2788](https://issues.apache.org/jira/browse/HADOOP-2788) | chgrp missing from hadoop dfs options | Critical | . | Mukund Madhugiri | Raghu Angadi |
+| [HADOOP-2754](https://issues.apache.org/jira/browse/HADOOP-2754) | Path filter for Local file system list .crc files | Major | . | Amareshwari Sriramadasu | Hairong Kuang |
+| [HADOOP-1188](https://issues.apache.org/jira/browse/HADOOP-1188) | processIOError() should update fstime file | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
| [HADOOP-2787](https://issues.apache.org/jira/browse/HADOOP-2787) | The constant org.apache.hadoop.fs.permission.FsPermission.UMASK\_LABEL should be "dfs.umask", instead of "hadoop.dfs.umask" | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-2788](https://issues.apache.org/jira/browse/HADOOP-2788) | chgrp missing from hadoop dfs options | Critical | . | Mukund Madhugiri | Raghu Angadi |
| [HADOOP-2785](https://issues.apache.org/jira/browse/HADOOP-2785) | Typo in peridioc block verification patch | Trivial | . | Raghu Angadi | Raghu Angadi |
| [HADOOP-2780](https://issues.apache.org/jira/browse/HADOOP-2780) | Socket receive buffer size on datanode too large | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-2769](https://issues.apache.org/jira/browse/HADOOP-2769) | TestNNThroughputBenchmark should not used a fixed http port | Major | test | Owen O'Malley | Owen O'Malley |
-| [HADOOP-2766](https://issues.apache.org/jira/browse/HADOOP-2766) | [HOD] No way to set HADOOP\_OPTS environment variable to the Hadoop daemons through HOD | Critical | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-| [HADOOP-2756](https://issues.apache.org/jira/browse/HADOOP-2756) | NPE in DFSClient in hbase under load | Minor | . | stack | Raghu Angadi |
-| [HADOOP-2754](https://issues.apache.org/jira/browse/HADOOP-2754) | Path filter for Local file system list .crc files | Major | . | Amareshwari Sriramadasu | Hairong Kuang |
+| [HADOOP-2716](https://issues.apache.org/jira/browse/HADOOP-2716) | Balancer should require superuser privilege | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-2733](https://issues.apache.org/jira/browse/HADOOP-2733) | Compiler warnings in TestClusterMapReduceTestCase and TestJobStatusPersistency | Major | test | Konstantin Shvachko | Tsz Wo Nicholas Sze |
| [HADOOP-2725](https://issues.apache.org/jira/browse/HADOOP-2725) | Distcp truncates some files when copying | Critical | util | Murtaza A. Basrai | Tsz Wo Nicholas Sze |
-| [HADOOP-2716](https://issues.apache.org/jira/browse/HADOOP-2716) | Balancer should require superuser privilege | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-2683](https://issues.apache.org/jira/browse/HADOOP-2683) | Provide a way to specifiy login out side an RPC | Blocker | . | Raghu Angadi | Tsz Wo Nicholas Sze |
+| [HADOOP-2789](https://issues.apache.org/jira/browse/HADOOP-2789) | Race condition in ipc.Server prevents responce being written back to client. | Critical | ipc | Clint Morgan | Raghu Angadi |
| [HADOOP-2391](https://issues.apache.org/jira/browse/HADOOP-2391) | Speculative Execution race condition with output paths | Major | . | Dennis Kubes | Amareshwari Sriramadasu |
-| [HADOOP-1188](https://issues.apache.org/jira/browse/HADOOP-1188) | processIOError() should update fstime file | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-2808](https://issues.apache.org/jira/browse/HADOOP-2808) | FileUtil::copy ignores "overwrite" formal | Major | . | Chris Douglas | Chris Douglas |
+| [HADOOP-2683](https://issues.apache.org/jira/browse/HADOOP-2683) | Provide a way to specifiy login out side an RPC | Blocker | . | Raghu Angadi | Tsz Wo Nicholas Sze |
+| [HADOOP-2814](https://issues.apache.org/jira/browse/HADOOP-2814) | NPE in datanode during TestDataTransferProtocol. | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-2811](https://issues.apache.org/jira/browse/HADOOP-2811) | method Counters.makeCompactString() does not insert separator char ',' between the counters of different groups. | Critical | . | Runping Qi | Runping Qi |
+| [HADOOP-2843](https://issues.apache.org/jira/browse/HADOOP-2843) | mapred.join access control is overly restrictive | Major | . | Chris Douglas | Chris Douglas |
+| [HADOOP-2813](https://issues.apache.org/jira/browse/HADOOP-2813) | Unit test fails on Linux: org.apache.hadoop.fs.TestDU.testDU | Blocker | fs | Mukund Madhugiri | Mahadev konar |
+| [HADOOP-2840](https://issues.apache.org/jira/browse/HADOOP-2840) | Gridmix test script fails to run java sort tests | Major | test | Mukund Madhugiri | Mukund Madhugiri |
+| [HADOOP-2766](https://issues.apache.org/jira/browse/HADOOP-2766) | [HOD] No way to set HADOOP\_OPTS environment variable to the Hadoop daemons through HOD | Critical | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-2769](https://issues.apache.org/jira/browse/HADOOP-2769) | TestNNThroughputBenchmark should not used a fixed http port | Major | test | Owen O'Malley | Owen O'Malley |
+| [HADOOP-2894](https://issues.apache.org/jira/browse/HADOOP-2894) | task trackers can't survive a job tracker bounce | Blocker | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-2904](https://issues.apache.org/jira/browse/HADOOP-2904) | 3 minor fixes in the rpc metrics area. | Major | . | girish vaitheeswaran | dhruba borthakur |
+| [HADOOP-2903](https://issues.apache.org/jira/browse/HADOOP-2903) | Data type mismatch exception raised from pushMetric | Major | metrics | girish vaitheeswaran | girish vaitheeswaran |
+| [HADOOP-2847](https://issues.apache.org/jira/browse/HADOOP-2847) | [HOD] Idle cluster cleanup does not work if the JobTracker becomes unresponsive to RPC calls | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-2809](https://issues.apache.org/jira/browse/HADOOP-2809) | [HOD] Syslog configuration, syslog-address, does not work in HOD 0.4 | Critical | contrib/hod | Hemanth Yamijala | Vinod Kumar Vavilapalli |
+| [HADOOP-2931](https://issues.apache.org/jira/browse/HADOOP-2931) | exception in DFSClient.create: Stream closed | Major | . | Michael Bieniosek | Michael Bieniosek |
+| [HADOOP-2883](https://issues.apache.org/jira/browse/HADOOP-2883) | Extensive write failures | Blocker | . | Christian Kunz | dhruba borthakur |
+| [HADOOP-2925](https://issues.apache.org/jira/browse/HADOOP-2925) | [HOD] Create mapred system directory using a naming convention that will avoid clashes in multi-user shared cluster scenario. | Major | contrib/hod | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-2756](https://issues.apache.org/jira/browse/HADOOP-2756) | NPE in DFSClient in hbase under load | Minor | . | stack | Raghu Angadi |
+| [HADOOP-2869](https://issues.apache.org/jira/browse/HADOOP-2869) | Deprecate and remove SequenceFile.setCompressionType | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-2958](https://issues.apache.org/jira/browse/HADOOP-2958) | Test utility no longer works in trunk | Minor | test | Chris Douglas | Chris Douglas |
+| [HADOOP-2915](https://issues.apache.org/jira/browse/HADOOP-2915) | mapred output files and directories should be created as the job submitter, not tasktracker or jobtracker | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
### TESTS:
@@ -95,12 +85,6 @@
| [HADOOP-2852](https://issues.apache.org/jira/browse/HADOOP-2852) | Update gridmix to avoid artificially long tail | Major | test | Chris Douglas | Chris Douglas |
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### OTHER:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.2/CHANGES.0.16.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.2/CHANGES.0.16.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.2/CHANGES.0.16.2.md
index dee3d74..6dd4b94 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.2/CHANGES.0.16.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.2/CHANGES.0.16.2.md
@@ -20,68 +20,34 @@
## Release 0.16.2 - 2008-04-02
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-3128](https://issues.apache.org/jira/browse/HADOOP-3128) | TestDFSPermission due to not throwing exception. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-3108](https://issues.apache.org/jira/browse/HADOOP-3108) | NPE in FSDirectory.unprotectedSetPermission | Blocker | . | Koji Noguchi | Konstantin Shvachko |
+| [HADOOP-2833](https://issues.apache.org/jira/browse/HADOOP-2833) | JobClient.submitJob(...) should not use "Dr Who" as a default username | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3011](https://issues.apache.org/jira/browse/HADOOP-3011) | Distcp deleting target directory | Blocker | util | Koji Noguchi | Chris Douglas |
+| [HADOOP-3033](https://issues.apache.org/jira/browse/HADOOP-3033) | Datanode fails write to DFS file with exception message "Trying to change block file offset" | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-2978](https://issues.apache.org/jira/browse/HADOOP-2978) | JobHistory log format for COUNTER is ambigurous | Major | . | Runping Qi | Runping Qi |
+| [HADOOP-2985](https://issues.apache.org/jira/browse/HADOOP-2985) | LocalJobRunner gets NullPointerException if there is no output directory | Critical | . | Owen O'Malley | Amareshwari Sriramadasu |
+| [HADOOP-3003](https://issues.apache.org/jira/browse/HADOOP-3003) | FileSystem cache key should be updated after a FileSystem object is created | Major | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3042](https://issues.apache.org/jira/browse/HADOOP-3042) | Update the Javadoc in JobConf.getOutputPath to reflect the actual temporary path | Major | documentation | Devaraj Das | Amareshwari Sriramadasu |
+| [HADOOP-3007](https://issues.apache.org/jira/browse/HADOOP-3007) | DataNode pipelining : failure on mirror results in failure on upstream datanode | Blocker | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-2944](https://issues.apache.org/jira/browse/HADOOP-2944) | redesigned plugin has missing functionality | Major | contrib/eclipse-plugin | Chris Dyer | Christophe Taton |
+| [HADOOP-3049](https://issues.apache.org/jira/browse/HADOOP-3049) | MultithreadedMapRunner eats RuntimeExceptions | Blocker | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-3039](https://issues.apache.org/jira/browse/HADOOP-3039) | Runtime exceptions not killing job | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-3027](https://issues.apache.org/jira/browse/HADOOP-3027) | JobTracker shuts down during initialization if the NameNode is down | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-3056](https://issues.apache.org/jira/browse/HADOOP-3056) | distcp seems to be broken in 0.16.1 | Blocker | util | Christian Kunz | Chris Douglas |
+| [HADOOP-3070](https://issues.apache.org/jira/browse/HADOOP-3070) | Trash not being expunged, Trash Emptier thread gone by NPE | Blocker | fs | Koji Noguchi | Koji Noguchi |
+| [HADOOP-3084](https://issues.apache.org/jira/browse/HADOOP-3084) | distcp fails for files with zero length | Blocker | util | Mukund Madhugiri | Chris Douglas |
| [HADOOP-3107](https://issues.apache.org/jira/browse/HADOOP-3107) | fsck failing with NPE | Blocker | . | Koji Noguchi | dhruba borthakur |
| [HADOOP-3105](https://issues.apache.org/jira/browse/HADOOP-3105) | compile-core-test fails for branch 0.16 | Blocker | . | Amareshwari Sriramadasu | Alejandro Abdelnur |
-| [HADOOP-3104](https://issues.apache.org/jira/browse/HADOOP-3104) | MultithreadMapRunner keeps consuming records even if trheads are not available | Critical | . | Alejandro Abdelnur | Alejandro Abdelnur |
| [HADOOP-3103](https://issues.apache.org/jira/browse/HADOOP-3103) | [HOD] Hadoop.tmp.dir should not be set to cluster directory | Blocker | contrib/hod | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
| [HADOOP-3098](https://issues.apache.org/jira/browse/HADOOP-3098) | dfs -chown does not like "\_" underscore in user name | Blocker | fs | Koji Noguchi | Raghu Angadi |
-| [HADOOP-3084](https://issues.apache.org/jira/browse/HADOOP-3084) | distcp fails for files with zero length | Blocker | util | Mukund Madhugiri | Chris Douglas |
-| [HADOOP-3070](https://issues.apache.org/jira/browse/HADOOP-3070) | Trash not being expunged, Trash Emptier thread gone by NPE | Blocker | fs | Koji Noguchi | Koji Noguchi |
-| [HADOOP-3056](https://issues.apache.org/jira/browse/HADOOP-3056) | distcp seems to be broken in 0.16.1 | Blocker | util | Christian Kunz | Chris Douglas |
-| [HADOOP-3049](https://issues.apache.org/jira/browse/HADOOP-3049) | MultithreadedMapRunner eats RuntimeExceptions | Blocker | . | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-3042](https://issues.apache.org/jira/browse/HADOOP-3042) | Update the Javadoc in JobConf.getOutputPath to reflect the actual temporary path | Major | documentation | Devaraj Das | Amareshwari Sriramadasu |
-| [HADOOP-3039](https://issues.apache.org/jira/browse/HADOOP-3039) | Runtime exceptions not killing job | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-3033](https://issues.apache.org/jira/browse/HADOOP-3033) | Datanode fails write to DFS file with exception message "Trying to change block file offset" | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-3027](https://issues.apache.org/jira/browse/HADOOP-3027) | JobTracker shuts down during initialization if the NameNode is down | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-3011](https://issues.apache.org/jira/browse/HADOOP-3011) | Distcp deleting target directory | Blocker | util | Koji Noguchi | Chris Douglas |
-| [HADOOP-3007](https://issues.apache.org/jira/browse/HADOOP-3007) | DataNode pipelining : failure on mirror results in failure on upstream datanode | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-3003](https://issues.apache.org/jira/browse/HADOOP-3003) | FileSystem cache key should be updated after a FileSystem object is created | Major | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-2985](https://issues.apache.org/jira/browse/HADOOP-2985) | LocalJobRunner gets NullPointerException if there is no output directory | Critical | . | Owen O'Malley | Amareshwari Sriramadasu |
-| [HADOOP-2978](https://issues.apache.org/jira/browse/HADOOP-2978) | JobHistory log format for COUNTER is ambigurous | Major | . | Runping Qi | Runping Qi |
-| [HADOOP-2944](https://issues.apache.org/jira/browse/HADOOP-2944) | redesigned plugin has missing functionality | Major | contrib/eclipse-plugin | Chris Dyer | Christophe Taton |
-| [HADOOP-2833](https://issues.apache.org/jira/browse/HADOOP-2833) | JobClient.submitJob(...) should not use "Dr Who" as a default username | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-3108](https://issues.apache.org/jira/browse/HADOOP-3108) | NPE in FSDirectory.unprotectedSetPermission | Blocker | . | Koji Noguchi | Konstantin Shvachko |
+| [HADOOP-3104](https://issues.apache.org/jira/browse/HADOOP-3104) | MultithreadMapRunner keeps consuming records even if trheads are not available | Critical | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-3128](https://issues.apache.org/jira/browse/HADOOP-3128) | TestDFSPermission due to not throwing exception. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
### OTHER:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.3/CHANGES.0.16.3.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.3/CHANGES.0.16.3.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.3/CHANGES.0.16.3.md
index b4552bb..6a4e53a 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.3/CHANGES.0.16.3.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.16.3/CHANGES.0.16.3.md
@@ -20,58 +20,18 @@
## Release 0.16.3 - 2008-04-16
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-3195](https://issues.apache.org/jira/browse/HADOOP-3195) | TestFileSystem fails randomly | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3182](https://issues.apache.org/jira/browse/HADOOP-3182) | JobClient creates submitJobDir with SYSTEM\_DIR\_PERMISSION ( rwx-wx-wx) | Blocker | . | Lohit Vijayarenu | Tsz Wo Nicholas Sze |
+| [HADOOP-3010](https://issues.apache.org/jira/browse/HADOOP-3010) | ConcurrentModificationException from org.apache.hadoop.ipc.Server$Responder in JobTracker | Major | ipc | Amar Kamat | Raghu Angadi |
| [HADOOP-3159](https://issues.apache.org/jira/browse/HADOOP-3159) | FileSystem cache keep overwriting cached value | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-3154](https://issues.apache.org/jira/browse/HADOOP-3154) | Job successful but dropping records (when disk full) | Blocker | . | Koji Noguchi | Devaraj Das |
| [HADOOP-3139](https://issues.apache.org/jira/browse/HADOOP-3139) | DistributedFileSystem.close() deadlock and FileSystem.closeAll() warning | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3195](https://issues.apache.org/jira/browse/HADOOP-3195) | TestFileSystem fails randomly | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-3069](https://issues.apache.org/jira/browse/HADOOP-3069) | A failure on SecondaryNameNode truncates the primary NameNode image. | Blocker | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-3010](https://issues.apache.org/jira/browse/HADOOP-3010) | ConcurrentModificationException from org.apache.hadoop.ipc.Server$Responder in JobTracker | Major | ipc | Amar Kamat | Raghu Angadi |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-3182](https://issues.apache.org/jira/browse/HADOOP-3182) | JobClient creates submitJobDir with SYSTEM\_DIR\_PERMISSION ( rwx-wx-wx) | Blocker | . | Lohit Vijayarenu | Tsz Wo Nicholas Sze |
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[04/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.4.0/CHANGES.2.4.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.4.0/CHANGES.2.4.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.4.0/CHANGES.2.4.0.md
index 06e9c9b..4426ba9 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.4.0/CHANGES.2.4.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.4.0/CHANGES.2.4.0.md
@@ -24,27 +24,21 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8691](https://issues.apache.org/jira/browse/HADOOP-8691) | FsShell can print "Found xxx items" unnecessarily often | Minor | fs | Jason Lowe | Daryn Sharp |
-| [HDFS-6102](https://issues.apache.org/jira/browse/HDFS-6102) | Lower the default maximum items per directory to fix PB fsimage loading | Blocker | namenode | Andrew Wang | Andrew Wang |
-| [HDFS-6055](https://issues.apache.org/jira/browse/HDFS-6055) | Change default configuration to limit file name length in HDFS | Major | namenode | Suresh Srinivas | Chris Nauroth |
| [HDFS-5804](https://issues.apache.org/jira/browse/HDFS-5804) | HDFS NFS Gateway fails to mount and proxy when using Kerberos | Major | nfs | Abin Shahab | Abin Shahab |
+| [HADOOP-8691](https://issues.apache.org/jira/browse/HADOOP-8691) | FsShell can print "Found xxx items" unnecessarily often | Minor | fs | Jason Lowe | Daryn Sharp |
| [HDFS-5321](https://issues.apache.org/jira/browse/HDFS-5321) | Clean up the HTTP-related configuration in HDFS | Major | . | Haohui Mai | Haohui Mai |
+| [HDFS-6055](https://issues.apache.org/jira/browse/HDFS-6055) | Change default configuration to limit file name length in HDFS | Major | namenode | Suresh Srinivas | Chris Nauroth |
+| [HDFS-6102](https://issues.apache.org/jira/browse/HDFS-6102) | Lower the default maximum items per directory to fix PB fsimage loading | Blocker | namenode | Andrew Wang | Andrew Wang |
| [HDFS-5138](https://issues.apache.org/jira/browse/HDFS-5138) | Support HDFS upgrade in HA | Blocker | . | Kihwal Lee | Aaron T. Myers |
| [MAPREDUCE-5036](https://issues.apache.org/jira/browse/MAPREDUCE-5036) | Default shuffle handler port should not be 8080 | Major | . | Sandy Ryza | Sandy Ryza |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10184](https://issues.apache.org/jira/browse/HADOOP-10184) | Hadoop Common changes required to support HDFS ACLs. | Major | fs, security | Chris Nauroth | Chris Nauroth |
| [HDFS-5535](https://issues.apache.org/jira/browse/HDFS-5535) | Umbrella jira for improved HDFS rolling upgrades | Major | datanode, ha, hdfs-client, namenode | Nathan Roberts | Tsz Wo Nicholas Sze |
+| [HADOOP-10184](https://issues.apache.org/jira/browse/HADOOP-10184) | Hadoop Common changes required to support HDFS ACLs. | Major | fs, security | Chris Nauroth | Chris Nauroth |
| [HDFS-4685](https://issues.apache.org/jira/browse/HDFS-4685) | Implementation of ACLs in HDFS | Major | hdfs-client, namenode, security | Sachin Jose | Chris Nauroth |
@@ -52,432 +46,432 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10423](https://issues.apache.org/jira/browse/HADOOP-10423) | Clarify compatibility policy document for combination of new client and old server. | Minor | documentation | Chris Nauroth | Chris Nauroth |
-| [HADOOP-10386](https://issues.apache.org/jira/browse/HADOOP-10386) | Log proxy hostname in various exceptions being thrown in a HA setup | Minor | ha | Arpit Gupta | Haohui Mai |
-| [HADOOP-10383](https://issues.apache.org/jira/browse/HADOOP-10383) | InterfaceStability annotations should have RetentionPolicy.RUNTIME | Major | . | Enis Soztutar | Enis Soztutar |
-| [HADOOP-10379](https://issues.apache.org/jira/browse/HADOOP-10379) | Protect authentication cookies with the HttpOnly and Secure flags | Major | . | Haohui Mai | Haohui Mai |
-| [HADOOP-10374](https://issues.apache.org/jira/browse/HADOOP-10374) | InterfaceAudience annotations should have RetentionPolicy.RUNTIME | Major | . | Enis Soztutar | Enis Soztutar |
-| [HADOOP-10348](https://issues.apache.org/jira/browse/HADOOP-10348) | Deprecate hadoop.ssl.configuration in branch-2, and remove it in trunk | Major | . | Haohui Mai | Haohui Mai |
-| [HADOOP-10343](https://issues.apache.org/jira/browse/HADOOP-10343) | Change info to debug log in LossyRetryInvocationHandler | Minor | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-10333](https://issues.apache.org/jira/browse/HADOOP-10333) | Fix grammatical error in overview.html document | Trivial | . | René Nyffenegger | René Nyffenegger |
-| [HADOOP-10295](https://issues.apache.org/jira/browse/HADOOP-10295) | Allow distcp to automatically identify the checksum type of source files and use it for the target | Major | tools/distcp | Jing Zhao | Jing Zhao |
-| [HADOOP-10221](https://issues.apache.org/jira/browse/HADOOP-10221) | Add a plugin to specify SaslProperties for RPC protocol based on connection properties | Major | security | Benoy Antony | Benoy Antony |
-| [HADOOP-10211](https://issues.apache.org/jira/browse/HADOOP-10211) | Enable RPC protocol to negotiate SASL-QOP values between clients and servers | Major | security | Benoy Antony | Benoy Antony |
-| [HADOOP-10139](https://issues.apache.org/jira/browse/HADOOP-10139) | Update and improve the Single Cluster Setup document | Major | documentation | Akira AJISAKA | Akira AJISAKA |
-| [HADOOP-9454](https://issues.apache.org/jira/browse/HADOOP-9454) | Support multipart uploads for s3native | Major | fs/s3 | Jordan Mendelson | Akira AJISAKA |
-| [HDFS-6150](https://issues.apache.org/jira/browse/HDFS-6150) | Add inode id information in the logs to make debugging easier | Minor | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-6138](https://issues.apache.org/jira/browse/HDFS-6138) | User Guide for how to use viewfs with federation | Minor | documentation | Sanjay Radia | Sanjay Radia |
-| [HDFS-6123](https://issues.apache.org/jira/browse/HDFS-6123) | Improve datanode error messages | Minor | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-6120](https://issues.apache.org/jira/browse/HDFS-6120) | Fix and improve safe mode log messages | Major | namenode | Arpit Agarwal | Arpit Agarwal |
-| [HDFS-6090](https://issues.apache.org/jira/browse/HDFS-6090) | Use MiniDFSCluster.Builder instead of deprecated constructors | Minor | test | Akira AJISAKA | Akira AJISAKA |
-| [HDFS-6085](https://issues.apache.org/jira/browse/HDFS-6085) | Improve CacheReplicationMonitor log messages a bit | Major | namenode | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-6084](https://issues.apache.org/jira/browse/HDFS-6084) | Namenode UI - "Hadoop" logo link shouldn't go to hadoop homepage | Minor | namenode | Travis Thompson | Travis Thompson |
-| [HDFS-6080](https://issues.apache.org/jira/browse/HDFS-6080) | Improve NFS gateway performance by making rtmax and wtmax configurable | Major | nfs, performance | Abin Shahab | Abin Shahab |
-| [HDFS-6072](https://issues.apache.org/jira/browse/HDFS-6072) | Clean up dead code of FSImage | Major | . | Haohui Mai | Haohui Mai |
-| [HDFS-6070](https://issues.apache.org/jira/browse/HDFS-6070) | Cleanup use of ReadStatistics in DFSInputStream | Trivial | . | Andrew Wang | Andrew Wang |
-| [HDFS-6069](https://issues.apache.org/jira/browse/HDFS-6069) | Quash stack traces when ACLs are disabled | Trivial | namenode | Andrew Wang | Chris Nauroth |
-| [HDFS-6044](https://issues.apache.org/jira/browse/HDFS-6044) | Add property for setting the NFS look up time for users | Minor | nfs | Brandon Li | Brandon Li |
-| [HDFS-6043](https://issues.apache.org/jira/browse/HDFS-6043) | Give HDFS daemons NFS3 and Portmap their own OPTS | Major | nfs | Brandon Li | Brandon Li |
-| [HDFS-6018](https://issues.apache.org/jira/browse/HDFS-6018) | Exception recorded in LOG when IPCLoggerChannel#close is called | Trivial | . | Jing Zhao | Jing Zhao |
-| [HDFS-6006](https://issues.apache.org/jira/browse/HDFS-6006) | Remove duplicate code in FSNameSystem#getFileInfo | Trivial | namenode | Akira AJISAKA | Akira AJISAKA |
-| [HDFS-5979](https://issues.apache.org/jira/browse/HDFS-5979) | Typo and logger fix for fsimage PB code | Minor | . | Andrew Wang | Andrew Wang |
-| [HDFS-5939](https://issues.apache.org/jira/browse/HDFS-5939) | WebHdfs returns misleading error code and logs nothing if trying to create a file with no DNs in cluster | Major | hdfs-client | Yongjun Zhang | Yongjun Zhang |
-| [HDFS-5935](https://issues.apache.org/jira/browse/HDFS-5935) | New Namenode UI FS browser should throw smarter error messages | Minor | namenode | Travis Thompson | Travis Thompson |
-| [HDFS-5929](https://issues.apache.org/jira/browse/HDFS-5929) | Add Block pool % usage to HDFS federated nn page | Major | federation | Siqi Li | Siqi Li |
-| [HDFS-5910](https://issues.apache.org/jira/browse/HDFS-5910) | Enhance DataTransferProtocol to allow per-connection choice of encryption/plain-text | Major | security | Benoy Antony | Benoy Antony |
-| [HDFS-5908](https://issues.apache.org/jira/browse/HDFS-5908) | Change AclFeature to capture list of ACL entries in an ImmutableList. | Minor | namenode | Chris Nauroth | Chris Nauroth |
-| [HDFS-5781](https://issues.apache.org/jira/browse/HDFS-5781) | Use an array to record the mapping between FSEditLogOpCode and the corresponding byte value | Minor | namenode | Jing Zhao | Jing Zhao |
-| [HDFS-5776](https://issues.apache.org/jira/browse/HDFS-5776) | Support 'hedged' reads in DFSClient | Major | hdfs-client | Liang Xie | Liang Xie |
-| [HDFS-5775](https://issues.apache.org/jira/browse/HDFS-5775) | Consolidate the code for serialization in CacheManager | Major | namenode | Haohui Mai | Haohui Mai |
| [HDFS-5768](https://issues.apache.org/jira/browse/HDFS-5768) | Consolidate the serialization code in DelegationTokenSecretManager | Major | namenode | Haohui Mai | Haohui Mai |
+| [HDFS-5775](https://issues.apache.org/jira/browse/HDFS-5775) | Consolidate the code for serialization in CacheManager | Major | namenode | Haohui Mai | Haohui Mai |
+| [HDFS-5781](https://issues.apache.org/jira/browse/HDFS-5781) | Use an array to record the mapping between FSEditLogOpCode and the corresponding byte value | Minor | namenode | Jing Zhao | Jing Zhao |
+| [MAPREDUCE-5732](https://issues.apache.org/jira/browse/MAPREDUCE-5732) | Report proper queue when job has been automatically placed | Major | . | Sandy Ryza | Sandy Ryza |
+| [HADOOP-10139](https://issues.apache.org/jira/browse/HADOOP-10139) | Update and improve the Single Cluster Setup document | Major | documentation | Akira Ajisaka | Akira Ajisaka |
+| [HADOOP-10295](https://issues.apache.org/jira/browse/HADOOP-10295) | Allow distcp to automatically identify the checksum type of source files and use it for the target | Major | tools/distcp | Jing Zhao | Jing Zhao |
+| [HDFS-5153](https://issues.apache.org/jira/browse/HDFS-5153) | Datanode should send block reports for each storage in a separate message | Major | datanode | Arpit Agarwal | Arpit Agarwal |
| [HDFS-5709](https://issues.apache.org/jira/browse/HDFS-5709) | Improve NameNode upgrade with existing reserved paths and path components | Major | namenode | Andrew Wang | Andrew Wang |
+| [HDFS-4911](https://issues.apache.org/jira/browse/HDFS-4911) | Reduce PeerCache timeout to be commensurate with dfs.datanode.socket.reuse.keepalive | Minor | . | Colin P. McCabe | Colin P. McCabe |
| [HDFS-5698](https://issues.apache.org/jira/browse/HDFS-5698) | Use protobuf to serialize / deserialize FSImage | Major | namenode | Haohui Mai | Haohui Mai |
-| [HDFS-5318](https://issues.apache.org/jira/browse/HDFS-5318) | Support read-only and read-write paths to shared replicas | Major | namenode | Eric Sirianni | |
-| [HDFS-5153](https://issues.apache.org/jira/browse/HDFS-5153) | Datanode should send block reports for each storage in a separate message | Major | datanode | Arpit Agarwal | Arpit Agarwal |
-| [HDFS-4911](https://issues.apache.org/jira/browse/HDFS-4911) | Reduce PeerCache timeout to be commensurate with dfs.datanode.socket.reuse.keepalive | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
| [HDFS-4370](https://issues.apache.org/jira/browse/HDFS-4370) | Fix typo Blanacer in DataNode | Major | datanode | Konstantin Shvachko | Chu Tong |
-| [HDFS-4200](https://issues.apache.org/jira/browse/HDFS-4200) | Reduce the size of synchronized sections in PacketResponder | Major | datanode | Suresh Srinivas | Andrew Wang |
-| [HDFS-3405](https://issues.apache.org/jira/browse/HDFS-3405) | Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages | Major | . | Aaron T. Myers | Vinayakumar B |
-| [MAPREDUCE-5773](https://issues.apache.org/jira/browse/MAPREDUCE-5773) | Provide dedicated MRAppMaster syslog length limit | Blocker | mr-am | Gera Shegalov | Gera Shegalov |
+| [HADOOP-10333](https://issues.apache.org/jira/browse/HADOOP-10333) | Fix grammatical error in overview.html document | Trivial | . | René Nyffenegger | René Nyffenegger |
+| [HDFS-5929](https://issues.apache.org/jira/browse/HDFS-5929) | Add Block pool % usage to HDFS federated nn page | Major | federation | Siqi Li | Siqi Li |
+| [HADOOP-10343](https://issues.apache.org/jira/browse/HADOOP-10343) | Change info to debug log in LossyRetryInvocationHandler | Minor | . | Arpit Gupta | Arpit Gupta |
+| [YARN-1171](https://issues.apache.org/jira/browse/YARN-1171) | Add default queue properties to Fair Scheduler documentation | Major | documentation, scheduler | Sandy Ryza | Naren Koneru |
+| [HDFS-5318](https://issues.apache.org/jira/browse/HDFS-5318) | Support read-only and read-write paths to shared replicas | Major | namenode | Eric Sirianni | |
+| [HDFS-5979](https://issues.apache.org/jira/browse/HDFS-5979) | Typo and logger fix for fsimage PB code | Minor | . | Andrew Wang | Andrew Wang |
+| [HADOOP-10348](https://issues.apache.org/jira/browse/HADOOP-10348) | Deprecate hadoop.ssl.configuration in branch-2, and remove it in trunk | Major | . | Haohui Mai | Haohui Mai |
+| [HDFS-5935](https://issues.apache.org/jira/browse/HDFS-5935) | New Namenode UI FS browser should throw smarter error messages | Minor | namenode | Travis Thompson | Travis Thompson |
+| [HDFS-5776](https://issues.apache.org/jira/browse/HDFS-5776) | Support 'hedged' reads in DFSClient | Major | hdfs-client | Liang Xie | Liang Xie |
| [MAPREDUCE-5761](https://issues.apache.org/jira/browse/MAPREDUCE-5761) | Add a log message like "encrypted shuffle is ON" in nodemanager logs | Trivial | . | Yesha Vora | Jian He |
+| [HDFS-5939](https://issues.apache.org/jira/browse/HDFS-5939) | WebHdfs returns misleading error code and logs nothing if trying to create a file with no DNs in cluster | Major | hdfs-client | Yongjun Zhang | Yongjun Zhang |
+| [HDFS-6006](https://issues.apache.org/jira/browse/HDFS-6006) | Remove duplicate code in FSNameSystem#getFileInfo | Trivial | namenode | Akira Ajisaka | Akira Ajisaka |
+| [HDFS-5908](https://issues.apache.org/jira/browse/HDFS-5908) | Change AclFeature to capture list of ACL entries in an ImmutableList. | Minor | namenode | Chris Nauroth | Chris Nauroth |
+| [HDFS-6018](https://issues.apache.org/jira/browse/HDFS-6018) | Exception recorded in LOG when IPCLoggerChannel#close is called | Trivial | . | Jing Zhao | Jing Zhao |
+| [HADOOP-9454](https://issues.apache.org/jira/browse/HADOOP-9454) | Support multipart uploads for s3native | Major | fs/s3 | Jordan Mendelson | Akira Ajisaka |
| [MAPREDUCE-5754](https://issues.apache.org/jira/browse/MAPREDUCE-5754) | Preserve Job diagnostics in history | Major | jobhistoryserver, mr-am | Gera Shegalov | Gera Shegalov |
-| [MAPREDUCE-5732](https://issues.apache.org/jira/browse/MAPREDUCE-5732) | Report proper queue when job has been automatically placed | Major | . | Sandy Ryza | Sandy Ryza |
+| [HADOOP-10374](https://issues.apache.org/jira/browse/HADOOP-10374) | InterfaceAudience annotations should have RetentionPolicy.RUNTIME | Major | . | Enis Soztutar | Enis Soztutar |
+| [HDFS-4200](https://issues.apache.org/jira/browse/HDFS-4200) | Reduce the size of synchronized sections in PacketResponder | Major | datanode | Suresh Srinivas | Andrew Wang |
+| [MAPREDUCE-5773](https://issues.apache.org/jira/browse/MAPREDUCE-5773) | Provide dedicated MRAppMaster syslog length limit | Blocker | mr-am | Gera Shegalov | Gera Shegalov |
+| [HADOOP-10379](https://issues.apache.org/jira/browse/HADOOP-10379) | Protect authentication cookies with the HttpOnly and Secure flags | Major | . | Haohui Mai | Haohui Mai |
+| [HDFS-6043](https://issues.apache.org/jira/browse/HDFS-6043) | Give HDFS daemons NFS3 and Portmap their own OPTS | Major | nfs | Brandon Li | Brandon Li |
+| [HDFS-6044](https://issues.apache.org/jira/browse/HDFS-6044) | Add property for setting the NFS look up time for users | Minor | nfs | Brandon Li | Brandon Li |
+| [HADOOP-10211](https://issues.apache.org/jira/browse/HADOOP-10211) | Enable RPC protocol to negotiate SASL-QOP values between clients and servers | Major | security | Benoy Antony | Benoy Antony |
+| [HADOOP-10386](https://issues.apache.org/jira/browse/HADOOP-10386) | Log proxy hostname in various exceptions being thrown in a HA setup | Minor | ha | Arpit Gupta | Haohui Mai |
+| [HDFS-6069](https://issues.apache.org/jira/browse/HDFS-6069) | Quash stack traces when ACLs are disabled | Trivial | namenode | Andrew Wang | Chris Nauroth |
+| [HDFS-6070](https://issues.apache.org/jira/browse/HDFS-6070) | Cleanup use of ReadStatistics in DFSInputStream | Trivial | . | Andrew Wang | Andrew Wang |
+| [HDFS-3405](https://issues.apache.org/jira/browse/HDFS-3405) | Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages | Major | . | Aaron T. Myers | Vinayakumar B |
+| [HDFS-6085](https://issues.apache.org/jira/browse/HDFS-6085) | Improve CacheReplicationMonitor log messages a bit | Major | namenode | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-6072](https://issues.apache.org/jira/browse/HDFS-6072) | Clean up dead code of FSImage | Major | . | Haohui Mai | Haohui Mai |
| [MAPREDUCE-5553](https://issues.apache.org/jira/browse/MAPREDUCE-5553) | Add task state filters on Application/MRJob page for MR Application master | Minor | applicationmaster | Paul Han | Paul Han |
-| [MAPREDUCE-2349](https://issues.apache.org/jira/browse/MAPREDUCE-2349) | speed up list[located]status calls from input formats | Major | task | Joydeep Sen Sarma | Siddharth Seth |
-| [YARN-1789](https://issues.apache.org/jira/browse/YARN-1789) | ApplicationSummary does not escape newlines in the app name | Minor | resourcemanager | Akira AJISAKA | Tsuyoshi Ozawa |
+| [YARN-1789](https://issues.apache.org/jira/browse/YARN-1789) | ApplicationSummary does not escape newlines in the app name | Minor | resourcemanager | Akira Ajisaka | Tsuyoshi Ozawa |
+| [HDFS-6080](https://issues.apache.org/jira/browse/HDFS-6080) | Improve NFS gateway performance by making rtmax and wtmax configurable | Major | nfs, performance | Abin Shahab | Abin Shahab |
| [YARN-1771](https://issues.apache.org/jira/browse/YARN-1771) | many getFileStatus calls made from node manager for localizing a public distributed cache resource | Critical | nodemanager | Sangjin Lee | Sangjin Lee |
-| [YARN-1570](https://issues.apache.org/jira/browse/YARN-1570) | Formatting the lines within 80 chars in YarnCommands.apt.vm | Minor | documentation | Akira AJISAKA | Akira AJISAKA |
-| [YARN-1536](https://issues.apache.org/jira/browse/YARN-1536) | Cleanup: Get rid of ResourceManager#get\*SecretManager() methods and use the RMContext methods instead | Minor | resourcemanager | Karthik Kambatla | Anubhav Dhoot |
+| [HDFS-6084](https://issues.apache.org/jira/browse/HDFS-6084) | Namenode UI - "Hadoop" logo link shouldn't go to hadoop homepage | Minor | namenode | Travis Thompson | Travis Thompson |
+| [HDFS-6090](https://issues.apache.org/jira/browse/HDFS-6090) | Use MiniDFSCluster.Builder instead of deprecated constructors | Minor | test | Akira Ajisaka | Akira Ajisaka |
+| [HADOOP-10383](https://issues.apache.org/jira/browse/HADOOP-10383) | InterfaceStability annotations should have RetentionPolicy.RUNTIME | Major | . | Enis Soztutar | Enis Soztutar |
| [YARN-1512](https://issues.apache.org/jira/browse/YARN-1512) | Enhance CS to decouple scheduling from node heartbeats | Major | . | Arun C Murthy | Arun C Murthy |
-| [YARN-1171](https://issues.apache.org/jira/browse/YARN-1171) | Add default queue properties to Fair Scheduler documentation | Major | documentation, scheduler | Sandy Ryza | Naren Koneru |
+| [HADOOP-10221](https://issues.apache.org/jira/browse/HADOOP-10221) | Add a plugin to specify SaslProperties for RPC protocol based on connection properties | Major | security | Benoy Antony | Benoy Antony |
+| [HDFS-6123](https://issues.apache.org/jira/browse/HDFS-6123) | Improve datanode error messages | Minor | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-2349](https://issues.apache.org/jira/browse/MAPREDUCE-2349) | speed up list[located]status calls from input formats | Major | task | Joydeep Sen Sarma | Siddharth Seth |
+| [YARN-1570](https://issues.apache.org/jira/browse/YARN-1570) | Formatting the lines within 80 chars in YarnCommands.apt.vm | Minor | documentation | Akira Ajisaka | Akira Ajisaka |
+| [HDFS-6138](https://issues.apache.org/jira/browse/HDFS-6138) | User Guide for how to use viewfs with federation | Minor | documentation | Sanjay Radia | Sanjay Radia |
+| [HDFS-6120](https://issues.apache.org/jira/browse/HDFS-6120) | Fix and improve safe mode log messages | Major | namenode | Arpit Agarwal | Arpit Agarwal |
+| [YARN-1536](https://issues.apache.org/jira/browse/YARN-1536) | Cleanup: Get rid of ResourceManager#get\*SecretManager() methods and use the RMContext methods instead | Minor | resourcemanager | Karthik Kambatla | Anubhav Dhoot |
+| [HADOOP-10423](https://issues.apache.org/jira/browse/HADOOP-10423) | Clarify compatibility policy document for combination of new client and old server. | Minor | documentation | Chris Nauroth | Chris Nauroth |
+| [HDFS-5910](https://issues.apache.org/jira/browse/HDFS-5910) | Enhance DataTransferProtocol to allow per-connection choice of encryption/plain-text | Major | security | Benoy Antony | Benoy Antony |
+| [HDFS-6150](https://issues.apache.org/jira/browse/HDFS-6150) | Add inode id information in the logs to make debugging easier | Minor | namenode | Suresh Srinivas | Suresh Srinivas |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-10450](https://issues.apache.org/jira/browse/HADOOP-10450) | Build zlib native code bindings in hadoop.dll for Windows. | Major | io, native | Chris Nauroth | Chris Nauroth |
-| [HADOOP-10442](https://issues.apache.org/jira/browse/HADOOP-10442) | Group look-up can cause segmentation fault when certain JNI-based mapping module is used. | Blocker | . | Kihwal Lee | Kihwal Lee |
-| [HADOOP-10441](https://issues.apache.org/jira/browse/HADOOP-10441) | Namenode metric "rpc.RetryCache/NameNodeRetryCache.CacheHit" can't be correctly processed by Ganglia | Blocker | metrics | Jing Zhao | Jing Zhao |
-| [HADOOP-10440](https://issues.apache.org/jira/browse/HADOOP-10440) | HarFsInputStream of HarFileSystem, when reading data, computing the position has bug | Major | fs | guodongdong | guodongdong |
-| [HADOOP-10425](https://issues.apache.org/jira/browse/HADOOP-10425) | Incompatible behavior of LocalFileSystem:getContentSummary | Critical | fs | Brandon Li | Tsz Wo Nicholas Sze |
-| [HADOOP-10422](https://issues.apache.org/jira/browse/HADOOP-10422) | Remove redundant logging of RPC retry attempts. | Minor | ipc | Chris Nauroth | Chris Nauroth |
-| [HADOOP-10395](https://issues.apache.org/jira/browse/HADOOP-10395) | TestCallQueueManager is flaky | Minor | test | Arpit Agarwal | Arpit Agarwal |
-| [HADOOP-10394](https://issues.apache.org/jira/browse/HADOOP-10394) | TestAuthenticationFilter is flaky | Major | test | Arpit Agarwal | Arpit Agarwal |
-| [HADOOP-10368](https://issues.apache.org/jira/browse/HADOOP-10368) | InputStream is not closed in VersionInfo ctor | Minor | util | Ted Yu | Tsuyoshi Ozawa |
-| [HADOOP-10361](https://issues.apache.org/jira/browse/HADOOP-10361) | Correct alignment in CLI output for ACLs. | Minor | fs | Chris Nauroth | Chris Nauroth |
-| [HADOOP-10355](https://issues.apache.org/jira/browse/HADOOP-10355) | TestLoadGenerator#testLoadGenerator fails | Major | . | Akira AJISAKA | Haohui Mai |
-| [HADOOP-10354](https://issues.apache.org/jira/browse/HADOOP-10354) | TestWebHDFS fails after merge of HDFS-4685 to trunk | Major | fs | Yongjun Zhang | Chris Nauroth |
-| [HADOOP-10353](https://issues.apache.org/jira/browse/HADOOP-10353) | FsUrlStreamHandlerFactory is not thread safe | Major | fs | Tudor Scurtu | Tudor Scurtu |
-| [HADOOP-10352](https://issues.apache.org/jira/browse/HADOOP-10352) | Recursive setfacl erroneously attempts to apply default ACL to files. | Major | fs | Chris Nauroth | Chris Nauroth |
-| [HADOOP-10346](https://issues.apache.org/jira/browse/HADOOP-10346) | Deadlock while logging tokens | Blocker | security | Jason Lowe | Jason Lowe |
-| [HADOOP-10338](https://issues.apache.org/jira/browse/HADOOP-10338) | Cannot get the FileStatus of the root inode from the new Globber | Major | . | Andrew Wang | Colin Patrick McCabe |
-| [HADOOP-10337](https://issues.apache.org/jira/browse/HADOOP-10337) | ConcurrentModificationException from MetricsDynamicMBeanBase.createMBeanInfo() | Major | metrics | Liang Xie | Liang Xie |
-| [HADOOP-10330](https://issues.apache.org/jira/browse/HADOOP-10330) | TestFrameDecoder fails if it cannot bind port 12345 | Major | test | Arpit Agarwal | Arpit Agarwal |
-| [HADOOP-10328](https://issues.apache.org/jira/browse/HADOOP-10328) | loadGenerator exit code is not reliable | Major | tools | Arpit Gupta | Haohui Mai |
-| [HADOOP-10327](https://issues.apache.org/jira/browse/HADOOP-10327) | Trunk windows build broken after HDFS-5746 | Blocker | native | Vinayakumar B | Vinayakumar B |
-| [HADOOP-10326](https://issues.apache.org/jira/browse/HADOOP-10326) | M/R jobs can not access S3 if Kerberos is enabled | Major | security | Manuel DE FERRAN | bc Wong |
+| [HDFS-5626](https://issues.apache.org/jira/browse/HDFS-5626) | dfsadmin -report shows incorrect cache values | Major | caching | Stephen Chu | Colin P. McCabe |
+| [HDFS-5705](https://issues.apache.org/jira/browse/HDFS-5705) | TestSecondaryNameNodeUpgrade#testChangeNsIDFails may fail due to ConcurrentModificationException | Major | datanode | Ted Yu | Ted Yu |
+| [YARN-1166](https://issues.apache.org/jira/browse/YARN-1166) | YARN 'appsFailed' metric should be of type 'counter' | Blocker | resourcemanager | Srimanth Gunturi | Zhijie Shen |
+| [HDFS-5492](https://issues.apache.org/jira/browse/HDFS-5492) | Port HDFS-2069 (Incorrect default trash interval in the docs) to trunk | Minor | documentation | Akira Ajisaka | Akira Ajisaka |
+| [HDFS-5843](https://issues.apache.org/jira/browse/HDFS-5843) | DFSClient.getFileChecksum() throws IOException if checksum is disabled | Major | datanode | Laurent Goujon | Laurent Goujon |
+| [HDFS-5790](https://issues.apache.org/jira/browse/HDFS-5790) | LeaseManager.findPath is very slow when many leases need recovery | Major | namenode, performance | Todd Lipcon | Todd Lipcon |
+| [YARN-1617](https://issues.apache.org/jira/browse/YARN-1617) | Remove ancient comment and surround LOG.debug in AppSchedulingInfo.allocate | Major | scheduler | Sandy Ryza | Sandy Ryza |
+| [HDFS-5856](https://issues.apache.org/jira/browse/HDFS-5856) | DataNode.checkDiskError might throw NPE | Minor | datanode | Josh Elser | Josh Elser |
+| [YARN-1632](https://issues.apache.org/jira/browse/YARN-1632) | TestApplicationMasterServices should be under org.apache.hadoop.yarn.server.resourcemanager package | Minor | . | Chen He | Chen He |
| [HADOOP-10320](https://issues.apache.org/jira/browse/HADOOP-10320) | Javadoc in InterfaceStability.java lacks final \</ul\> | Trivial | documentation | René Nyffenegger | René Nyffenegger |
-| [HADOOP-10314](https://issues.apache.org/jira/browse/HADOOP-10314) | The ls command help still shows outdated 0.16 format. | Major | . | Kihwal Lee | Rushabh S Shah |
-| [HADOOP-10301](https://issues.apache.org/jira/browse/HADOOP-10301) | AuthenticationFilter should return Forbidden for failed authentication | Blocker | security | Daryn Sharp | Daryn Sharp |
-| [HADOOP-10249](https://issues.apache.org/jira/browse/HADOOP-10249) | LdapGroupsMapping should trim ldap password read from file | Major | . | Dilli Arumugam | Dilli Arumugam |
-| [HADOOP-10191](https://issues.apache.org/jira/browse/HADOOP-10191) | Missing executable permission on viewfs internal dirs | Blocker | viewfs | Gera Shegalov | Gera Shegalov |
+| [HDFS-5859](https://issues.apache.org/jira/browse/HDFS-5859) | DataNode#checkBlockToken should check block tokens even if security is not enabled | Major | datanode | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-5828](https://issues.apache.org/jira/browse/HDFS-5828) | BlockPlacementPolicyWithNodeGroup can place multiple replicas on the same node group when dfs.namenode.avoid.write.stale.datanode is true | Major | namenode | Taylor, Buddy | Taylor, Buddy |
| [HADOOP-10085](https://issues.apache.org/jira/browse/HADOOP-10085) | CompositeService should allow adding services while being inited | Blocker | . | Karthik Kambatla | Steve Loughran |
-| [HADOOP-10070](https://issues.apache.org/jira/browse/HADOOP-10070) | RPC client doesn't use per-connection conf to determine server's expected Kerberos principal name | Major | security | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-10015](https://issues.apache.org/jira/browse/HADOOP-10015) | UserGroupInformation prints out excessive ERROR warnings | Minor | security | Haohui Mai | Nicolas Liochon |
-| [HDFS-6237](https://issues.apache.org/jira/browse/HDFS-6237) | TestDFSShell#testGet fails on Windows due to invalid file system path. | Trivial | hdfs-client, test | Chris Nauroth | Chris Nauroth |
-| [HDFS-6166](https://issues.apache.org/jira/browse/HDFS-6166) | revisit balancer so\_timeout | Blocker | balancer & mover | Nathan Roberts | Nathan Roberts |
-| [HDFS-6163](https://issues.apache.org/jira/browse/HDFS-6163) | Fix a minor bug in the HA upgrade document | Minor | documentation | Fengdong Yu | Fengdong Yu |
-| [HDFS-6157](https://issues.apache.org/jira/browse/HDFS-6157) | Fix the entry point of OfflineImageViewer for hdfs.cmd | Major | . | Haohui Mai | Haohui Mai |
-| [HDFS-6140](https://issues.apache.org/jira/browse/HDFS-6140) | WebHDFS cannot create a file with spaces in the name after HA failover changes. | Major | webhdfs | Chris Nauroth | Chris Nauroth |
-| [HDFS-6135](https://issues.apache.org/jira/browse/HDFS-6135) | In HDFS upgrade with HA setup, JournalNode cannot handle layout version bump when rolling back | Blocker | journal-node | Jing Zhao | Jing Zhao |
-| [HDFS-6131](https://issues.apache.org/jira/browse/HDFS-6131) | Move HDFSHighAvailabilityWithNFS.apt.vm and HDFSHighAvailabilityWithQJM.apt.vm from Yarn to HDFS | Major | documentation | Jing Zhao | Jing Zhao |
-| [HDFS-6130](https://issues.apache.org/jira/browse/HDFS-6130) | NPE when upgrading namenode from fsimages older than -32 | Blocker | namenode | Fengdong Yu | Haohui Mai |
-| [HDFS-6129](https://issues.apache.org/jira/browse/HDFS-6129) | When a replica is not found for deletion, do not throw exception. | Minor | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-6127](https://issues.apache.org/jira/browse/HDFS-6127) | WebHDFS tokens cannot be renewed in HA setup | Major | ha | Arpit Gupta | Haohui Mai |
-| [HDFS-6117](https://issues.apache.org/jira/browse/HDFS-6117) | Print file path information in FileNotFoundException | Minor | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-6115](https://issues.apache.org/jira/browse/HDFS-6115) | flush() should be called for every append on block scan verification log | Minor | datanode | Vinayakumar B | Vinayakumar B |
-| [HDFS-6107](https://issues.apache.org/jira/browse/HDFS-6107) | When a block can't be cached due to limited space on the DataNode, that block becomes uncacheable | Major | datanode | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-6106](https://issues.apache.org/jira/browse/HDFS-6106) | Reduce default for dfs.namenode.path.based.cache.refresh.interval.ms | Major | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-6105](https://issues.apache.org/jira/browse/HDFS-6105) | NN web UI for DN list loads the same jmx page multiple times. | Major | . | Kihwal Lee | Haohui Mai |
-| [HDFS-6100](https://issues.apache.org/jira/browse/HDFS-6100) | DataNodeWebHdfsMethods does not failover in HA mode | Major | ha | Arpit Gupta | Haohui Mai |
-| [HDFS-6099](https://issues.apache.org/jira/browse/HDFS-6099) | HDFS file system limits not enforced on renames. | Major | namenode | Chris Nauroth | Chris Nauroth |
-| [HDFS-6097](https://issues.apache.org/jira/browse/HDFS-6097) | zero-copy reads are incorrectly disabled on file offsets above 2GB | Major | hdfs-client | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-6096](https://issues.apache.org/jira/browse/HDFS-6096) | TestWebHdfsTokens may timeout | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-6094](https://issues.apache.org/jira/browse/HDFS-6094) | The same block can be counted twice towards safe mode threshold | Major | namenode | Arpit Agarwal | Arpit Agarwal |
-| [HDFS-6089](https://issues.apache.org/jira/browse/HDFS-6089) | Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspended | Major | ha | Arpit Gupta | Jing Zhao |
-| [HDFS-6079](https://issues.apache.org/jira/browse/HDFS-6079) | Timeout for getFileBlockStorageLocations does not work | Major | hdfs-client | Andrew Wang | Andrew Wang |
-| [HDFS-6078](https://issues.apache.org/jira/browse/HDFS-6078) | TestIncrementalBlockReports is flaky | Minor | test | Arpit Agarwal | Arpit Agarwal |
-| [HDFS-6077](https://issues.apache.org/jira/browse/HDFS-6077) | running slive with webhdfs on secure HA cluster fails with unkown host exception | Major | . | Arpit Gupta | Jing Zhao |
-| [HDFS-6071](https://issues.apache.org/jira/browse/HDFS-6071) | BlockReaderLocal doesn't return -1 on EOF when doing a zero-length read on a short file | Major | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-6068](https://issues.apache.org/jira/browse/HDFS-6068) | Disallow snapshot names that are also invalid directory names | Major | snapshots | Andrew Wang | sathish |
-| [HDFS-6067](https://issues.apache.org/jira/browse/HDFS-6067) | TestPread.testMaxOutHedgedReadPool is flaky | Major | hdfs-client | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-6065](https://issues.apache.org/jira/browse/HDFS-6065) | HDFS zero-copy reads should return null on EOF when doing ZCR | Major | hdfs-client | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-6064](https://issues.apache.org/jira/browse/HDFS-6064) | DFSConfigKeys.DFS\_BLOCKREPORT\_INTERVAL\_MSEC\_DEFAULT is not updated with latest block report interval of 6 hrs | Minor | datanode | Vinayakumar B | Vinayakumar B |
-| [HDFS-6063](https://issues.apache.org/jira/browse/HDFS-6063) | TestAclCLI fails intermittently when running test 24: copyFromLocal | Minor | test, tools | Colin Patrick McCabe | Chris Nauroth |
-| [HDFS-6062](https://issues.apache.org/jira/browse/HDFS-6062) | TestRetryCacheWithHA#testConcat is flaky | Minor | . | Jing Zhao | Jing Zhao |
-| [HDFS-6059](https://issues.apache.org/jira/browse/HDFS-6059) | TestBlockReaderLocal fails if native library is not available | Major | . | Akira AJISAKA | Akira AJISAKA |
-| [HDFS-6058](https://issues.apache.org/jira/browse/HDFS-6058) | Fix TestHDFSCLI failures after HADOOP-8691 change | Major | . | Vinayakumar B | Haohui Mai |
-| [HDFS-6057](https://issues.apache.org/jira/browse/HDFS-6057) | DomainSocketWatcher.watcherThread should be marked as daemon thread | Blocker | hdfs-client | Eric Sirianni | Colin Patrick McCabe |
-| [HDFS-6053](https://issues.apache.org/jira/browse/HDFS-6053) | Fix TestDecommissioningStatus and TestDecommission in branch-2 | Major | namenode | Jing Zhao | Jing Zhao |
-| [HDFS-6051](https://issues.apache.org/jira/browse/HDFS-6051) | HDFS cannot run on Windows since short-circuit shared memory segment changes. | Blocker | hdfs-client | Chris Nauroth | Colin Patrick McCabe |
-| [HDFS-6047](https://issues.apache.org/jira/browse/HDFS-6047) | TestPread NPE inside in DFSInputStream hedgedFetchBlockByteRange | Major | . | stack | stack |
-| [HDFS-6039](https://issues.apache.org/jira/browse/HDFS-6039) | Uploading a File under a Dir with default acls throws "Duplicated ACLFeature" | Major | namenode | Yesha Vora | Chris Nauroth |
-| [HDFS-6033](https://issues.apache.org/jira/browse/HDFS-6033) | PBImageXmlWriter incorrectly handles processing cache directives | Major | caching | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-6028](https://issues.apache.org/jira/browse/HDFS-6028) | Print clearer error message when user attempts to delete required mask entry from ACL. | Trivial | namenode | Chris Nauroth | Chris Nauroth |
-| [HDFS-6008](https://issues.apache.org/jira/browse/HDFS-6008) | Namenode dead node link is giving HTTP error 500 | Minor | namenode | Benoy Antony | Benoy Antony |
-| [HDFS-5988](https://issues.apache.org/jira/browse/HDFS-5988) | Bad fsimage always generated after upgrade | Blocker | namenode | Andrew Wang | Andrew Wang |
-| [HDFS-5982](https://issues.apache.org/jira/browse/HDFS-5982) | Need to update snapshot manager when applying editlog for deleting a snapshottable directory | Critical | namenode | Tassapol Athiapinya | Jing Zhao |
-| [HDFS-5981](https://issues.apache.org/jira/browse/HDFS-5981) | PBImageXmlWriter generates malformed XML | Minor | tools | Haohui Mai | Haohui Mai |
-| [HDFS-5962](https://issues.apache.org/jira/browse/HDFS-5962) | Mtime and atime are not persisted for symbolic links | Critical | . | Kihwal Lee | Akira AJISAKA |
-| [HDFS-5961](https://issues.apache.org/jira/browse/HDFS-5961) | OIV cannot load fsimages containing a symbolic link | Critical | . | Kihwal Lee | Kihwal Lee |
-| [HDFS-5959](https://issues.apache.org/jira/browse/HDFS-5959) | Fix typo at section name in FSImageFormatProtobuf.java | Minor | . | Akira AJISAKA | Akira AJISAKA |
-| [HDFS-5949](https://issues.apache.org/jira/browse/HDFS-5949) | New Namenode UI when trying to download a file, the browser doesn't know the file name | Minor | namenode | Travis Thompson | Travis Thompson |
-| [HDFS-5948](https://issues.apache.org/jira/browse/HDFS-5948) | TestBackupNode flakes with port in use error | Major | . | Andrew Wang | Haohui Mai |
-| [HDFS-5944](https://issues.apache.org/jira/browse/HDFS-5944) | LeaseManager:findLeaseWithPrefixPath can't handle path like /a/b/ right and cause SecondaryNameNode failed do checkpoint | Major | namenode | zhaoyunjiong | zhaoyunjiong |
-| [HDFS-5943](https://issues.apache.org/jira/browse/HDFS-5943) | 'dfs.namenode.https-address.ns1' property is not used in federation setup | Major | . | Yesha Vora | Suresh Srinivas |
-| [HDFS-5941](https://issues.apache.org/jira/browse/HDFS-5941) | add dfs.namenode.secondary.https-address and dfs.namenode.secondary.https-address in hdfs-default.xml | Major | documentation, namenode | Haohui Mai | Haohui Mai |
-| [HDFS-5934](https://issues.apache.org/jira/browse/HDFS-5934) | New Namenode UI back button doesn't work as expected | Minor | namenode | Travis Thompson | Travis Thompson |
-| [HDFS-5922](https://issues.apache.org/jira/browse/HDFS-5922) | DN heartbeat thread can get stuck in tight loop | Major | datanode | Aaron T. Myers | Arpit Agarwal |
-| [HDFS-5915](https://issues.apache.org/jira/browse/HDFS-5915) | Refactor FSImageFormatProtobuf to simplify cross section reads | Major | namenode | Haohui Mai | Haohui Mai |
-| [HDFS-5913](https://issues.apache.org/jira/browse/HDFS-5913) | Nfs3Utils#getWccAttr() should check attr parameter against null | Minor | nfs | Ted Yu | Brandon Li |
-| [HDFS-5904](https://issues.apache.org/jira/browse/HDFS-5904) | TestFileStatus fails intermittently on trunk and branch2 | Major | . | Mit Desai | Mit Desai |
-| [HDFS-5901](https://issues.apache.org/jira/browse/HDFS-5901) | NameNode new UI doesn't support IE8 and IE9 on windows 7 | Major | namenode | Vinayakumar B | Vinayakumar B |
-| [HDFS-5900](https://issues.apache.org/jira/browse/HDFS-5900) | Cannot set cache pool limit of "unlimited" via CacheAdmin | Major | caching | Tassapol Athiapinya | Andrew Wang |
+| [HDFS-5767](https://issues.apache.org/jira/browse/HDFS-5767) | NFS implementation assumes userName userId mapping to be unique, which is not true sometimes | Blocker | nfs | Yongjun Zhang | Yongjun Zhang |
+| [YARN-1673](https://issues.apache.org/jira/browse/YARN-1673) | Valid yarn kill application prints out help message. | Blocker | client | Tassapol Athiapinya | Mayank Bansal |
+| [YARN-1285](https://issues.apache.org/jira/browse/YARN-1285) | Inconsistency of default "yarn.acl.enable" value | Major | . | Zhijie Shen | Kenji Kikushima |
+| [HDFS-5791](https://issues.apache.org/jira/browse/HDFS-5791) | TestHttpsFileSystem should use a random port to avoid binding error during testing | Major | test | Brandon Li | Haohui Mai |
+| [HDFS-5881](https://issues.apache.org/jira/browse/HDFS-5881) | Fix skip() of the short-circuit local reader (legacy). | Critical | . | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-5699](https://issues.apache.org/jira/browse/MAPREDUCE-5699) | Allow setting tags on MR jobs | Major | applicationmaster | Karthik Kambatla | Karthik Kambatla |
+| [HADOOP-10327](https://issues.apache.org/jira/browse/HADOOP-10327) | Trunk windows build broken after HDFS-5746 | Blocker | native | Vinayakumar B | Vinayakumar B |
+| [YARN-1661](https://issues.apache.org/jira/browse/YARN-1661) | AppMaster logs says failing even if an application does succeed. | Major | applications/distributed-shell | Tassapol Athiapinya | Vinod Kumar Vavilapalli |
| [HDFS-5895](https://issues.apache.org/jira/browse/HDFS-5895) | HDFS cacheadmin -listPools has exit\_code of 1 when the command returns 0 result. | Major | tools | Tassapol Athiapinya | Tassapol Athiapinya |
-| [HDFS-5893](https://issues.apache.org/jira/browse/HDFS-5893) | HftpFileSystem.RangeHeaderUrlOpener uses the default URLConnectionFactory which does not import SSL certificates | Major | . | Yesha Vora | Haohui Mai |
-| [HDFS-5891](https://issues.apache.org/jira/browse/HDFS-5891) | webhdfs should not try connecting the DN during redirection | Major | namenode, webhdfs | Haohui Mai | Haohui Mai |
+| [YARN-1689](https://issues.apache.org/jira/browse/YARN-1689) | RMAppAttempt is not killed when RMApp is at ACCEPTED | Critical | resourcemanager | Deepesh Khandelwal | Vinod Kumar Vavilapalli |
+| [HADOOP-10330](https://issues.apache.org/jira/browse/HADOOP-10330) | TestFrameDecoder fails if it cannot bind port 12345 | Major | test | Arpit Agarwal | Arpit Agarwal |
+| [HDFS-5900](https://issues.apache.org/jira/browse/HDFS-5900) | Cannot set cache pool limit of "unlimited" via CacheAdmin | Major | caching | Tassapol Athiapinya | Andrew Wang |
+| [YARN-1672](https://issues.apache.org/jira/browse/YARN-1672) | YarnConfiguration is missing a default for yarn.nodemanager.log.retain-seconds | Trivial | nodemanager | Karthik Kambatla | Naren Koneru |
| [HDFS-5886](https://issues.apache.org/jira/browse/HDFS-5886) | Potential null pointer deference in RpcProgramNfs3#readlink() | Major | nfs | Ted Yu | Brandon Li |
-| [HDFS-5881](https://issues.apache.org/jira/browse/HDFS-5881) | Fix skip() of the short-circuit local reader (legacy). | Critical | . | Kihwal Lee | Kihwal Lee |
+| [HDFS-5915](https://issues.apache.org/jira/browse/HDFS-5915) | Refactor FSImageFormatProtobuf to simplify cross section reads | Major | namenode | Haohui Mai | Haohui Mai |
+| [HADOOP-10326](https://issues.apache.org/jira/browse/HADOOP-10326) | M/R jobs can not access S3 if Kerberos is enabled | Major | security | Manuel DE FERRAN | bc Wong |
+| [YARN-1697](https://issues.apache.org/jira/browse/YARN-1697) | NodeManager reports negative running containers | Major | nodemanager | Sandy Ryza | Sandy Ryza |
+| [HADOOP-10338](https://issues.apache.org/jira/browse/HADOOP-10338) | Cannot get the FileStatus of the root inode from the new Globber | Major | . | Andrew Wang | Colin P. McCabe |
+| [HDFS-4858](https://issues.apache.org/jira/browse/HDFS-4858) | HDFS DataNode to NameNode RPC should timeout | Minor | datanode | Jagane Sundar | Henry Wang |
+| [MAPREDUCE-5746](https://issues.apache.org/jira/browse/MAPREDUCE-5746) | Job diagnostics can implicate wrong task for a failed job | Major | jobhistoryserver | Jason Lowe | Jason Lowe |
| [HDFS-5879](https://issues.apache.org/jira/browse/HDFS-5879) | Some TestHftpFileSystem tests do not close streams | Major | test | Gera Shegalov | Gera Shegalov |
-| [HDFS-5859](https://issues.apache.org/jira/browse/HDFS-5859) | DataNode#checkBlockToken should check block tokens even if security is not enabled | Major | datanode | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-5857](https://issues.apache.org/jira/browse/HDFS-5857) | TestWebHDFS#testNamenodeRestart fails intermittently with NPE | Major | . | Mit Desai | Mit Desai |
-| [HDFS-5856](https://issues.apache.org/jira/browse/HDFS-5856) | DataNode.checkDiskError might throw NPE | Minor | datanode | Josh Elser | Josh Elser |
-| [HDFS-5846](https://issues.apache.org/jira/browse/HDFS-5846) | Assigning DEFAULT\_RACK in resolveNetworkLocation method can break data resiliency | Major | namenode | Nikola Vujic | Nikola Vujic |
-| [HDFS-5843](https://issues.apache.org/jira/browse/HDFS-5843) | DFSClient.getFileChecksum() throws IOException if checksum is disabled | Major | datanode | Laurent Goujon | Laurent Goujon |
-| [HDFS-5840](https://issues.apache.org/jira/browse/HDFS-5840) | Follow-up to HDFS-5138 to improve error handling during partial upgrade failures | Blocker | ha, journal-node, namenode | Aaron T. Myers | Jing Zhao |
-| [HDFS-5828](https://issues.apache.org/jira/browse/HDFS-5828) | BlockPlacementPolicyWithNodeGroup can place multiple replicas on the same node group when dfs.namenode.avoid.write.stale.datanode is true | Major | namenode | Taylor, Buddy | Taylor, Buddy |
-| [HDFS-5821](https://issues.apache.org/jira/browse/HDFS-5821) | TestHDFSCLI fails for user names with the dash character | Major | test | Gera Shegalov | Gera Shegalov |
-| [HDFS-5807](https://issues.apache.org/jira/browse/HDFS-5807) | TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails intermittently on Branch-2 | Major | test | Mit Desai | Chen He |
-| [HDFS-5803](https://issues.apache.org/jira/browse/HDFS-5803) | TestBalancer.testBalancer0 fails | Major | . | Mit Desai | Chen He |
-| [HDFS-5791](https://issues.apache.org/jira/browse/HDFS-5791) | TestHttpsFileSystem should use a random port to avoid binding error during testing | Major | test | Brandon Li | Haohui Mai |
-| [HDFS-5790](https://issues.apache.org/jira/browse/HDFS-5790) | LeaseManager.findPath is very slow when many leases need recovery | Major | namenode, performance | Todd Lipcon | Todd Lipcon |
-| [HDFS-5780](https://issues.apache.org/jira/browse/HDFS-5780) | TestRBWBlockInvalidation times out intemittently on branch-2 | Major | . | Mit Desai | Mit Desai |
-| [HDFS-5767](https://issues.apache.org/jira/browse/HDFS-5767) | NFS implementation assumes userName userId mapping to be unique, which is not true sometimes | Blocker | nfs | Yongjun Zhang | Yongjun Zhang |
+| [YARN-1531](https://issues.apache.org/jira/browse/YARN-1531) | True up yarn command documentation | Major | documentation | Akira Ajisaka | Akira Ajisaka |
+| [YARN-1692](https://issues.apache.org/jira/browse/YARN-1692) | ConcurrentModificationException in fair scheduler AppSchedulable | Major | scheduler | Sangjin Lee | Sangjin Lee |
+| [HDFS-5891](https://issues.apache.org/jira/browse/HDFS-5891) | webhdfs should not try connecting the DN during redirection | Major | namenode, webhdfs | Haohui Mai | Haohui Mai |
+| [HDFS-5904](https://issues.apache.org/jira/browse/HDFS-5904) | TestFileStatus fails intermittently on trunk and branch2 | Major | . | Mit Desai | Mit Desai |
+| [HDFS-5941](https://issues.apache.org/jira/browse/HDFS-5941) | add dfs.namenode.secondary.https-address and dfs.namenode.secondary.https-address in hdfs-default.xml | Major | documentation, namenode | Haohui Mai | Haohui Mai |
+| [YARN-1417](https://issues.apache.org/jira/browse/YARN-1417) | RM may issue expired container tokens to AM while issuing new containers. | Blocker | . | Omkar Vinit Joshi | Jian He |
+| [HDFS-5913](https://issues.apache.org/jira/browse/HDFS-5913) | Nfs3Utils#getWccAttr() should check attr parameter against null | Minor | nfs | Ted Yu | Brandon Li |
+| [MAPREDUCE-5670](https://issues.apache.org/jira/browse/MAPREDUCE-5670) | CombineFileRecordReader should report progress when moving to the next file | Minor | mrv2 | Jason Lowe | Chen He |
+| [HADOOP-10249](https://issues.apache.org/jira/browse/HADOOP-10249) | LdapGroupsMapping should trim ldap password read from file | Major | . | Dilli Arumugam | Dilli Arumugam |
+| [HDFS-5934](https://issues.apache.org/jira/browse/HDFS-5934) | New Namenode UI back button doesn't work as expected | Minor | namenode | Travis Thompson | Travis Thompson |
+| [HDFS-5901](https://issues.apache.org/jira/browse/HDFS-5901) | NameNode new UI doesn't support IE8 and IE9 on windows 7 | Major | namenode | Vinayakumar B | Vinayakumar B |
+| [HDFS-5943](https://issues.apache.org/jira/browse/HDFS-5943) | 'dfs.namenode.https-address.ns1' property is not used in federation setup | Major | . | Yesha Vora | Suresh Srinivas |
+| [HDFS-3128](https://issues.apache.org/jira/browse/HDFS-3128) | Unit tests should not use a test root in /tmp | Minor | test | Eli Collins | Andrew Wang |
+| [HDFS-5948](https://issues.apache.org/jira/browse/HDFS-5948) | TestBackupNode flakes with port in use error | Major | . | Andrew Wang | Haohui Mai |
+| [HDFS-5949](https://issues.apache.org/jira/browse/HDFS-5949) | New Namenode UI when trying to download a file, the browser doesn't know the file name | Minor | namenode | Travis Thompson | Travis Thompson |
+| [YARN-1553](https://issues.apache.org/jira/browse/YARN-1553) | Do not use HttpConfig.isSecure() in YARN | Major | . | Haohui Mai | Haohui Mai |
+| [HDFS-5716](https://issues.apache.org/jira/browse/HDFS-5716) | Allow WebHDFS to use pluggable authentication filter | Major | webhdfs | Haohui Mai | Haohui Mai |
| [HDFS-5759](https://issues.apache.org/jira/browse/HDFS-5759) | Web UI does not show up during the period of loading FSImage | Major | . | Haohui Mai | Haohui Mai |
+| [MAPREDUCE-5757](https://issues.apache.org/jira/browse/MAPREDUCE-5757) | ConcurrentModificationException in JobControl.toList | Major | client | Jason Lowe | Jason Lowe |
+| [HDFS-5959](https://issues.apache.org/jira/browse/HDFS-5959) | Fix typo at section name in FSImageFormatProtobuf.java | Minor | . | Akira Ajisaka | Akira Ajisaka |
+| [HDFS-5780](https://issues.apache.org/jira/browse/HDFS-5780) | TestRBWBlockInvalidation times out intemittently on branch-2 | Major | . | Mit Desai | Mit Desai |
+| [HADOOP-10346](https://issues.apache.org/jira/browse/HADOOP-10346) | Deadlock while logging tokens | Blocker | security | Jason Lowe | Jason Lowe |
+| [HDFS-5803](https://issues.apache.org/jira/browse/HDFS-5803) | TestBalancer.testBalancer0 fails | Major | . | Mit Desai | Chen He |
+| [YARN-1721](https://issues.apache.org/jira/browse/YARN-1721) | When moving app between queues in Fair Scheduler, grab lock on FSSchedulerApp | Critical | scheduler | Sandy Ryza | Sandy Ryza |
+| [YARN-1724](https://issues.apache.org/jira/browse/YARN-1724) | Race condition in Fair Scheduler when continuous scheduling is turned on | Critical | scheduler | Sandy Ryza | Sandy Ryza |
+| [HDFS-5893](https://issues.apache.org/jira/browse/HDFS-5893) | HftpFileSystem.RangeHeaderUrlOpener uses the default URLConnectionFactory which does not import SSL certificates | Major | . | Yesha Vora | Haohui Mai |
+| [YARN-1590](https://issues.apache.org/jira/browse/YARN-1590) | \_HOST doesn't expand properly for RM, NM, ProxyServer and JHS | Major | resourcemanager | Mohammad Kamrul Islam | Mohammad Kamrul Islam |
+| [HDFS-5961](https://issues.apache.org/jira/browse/HDFS-5961) | OIV cannot load fsimages containing a symbolic link | Critical | . | Kihwal Lee | Kihwal Lee |
+| [YARN-713](https://issues.apache.org/jira/browse/YARN-713) | ResourceManager can exit unexpectedly if DNS is unavailable | Critical | resourcemanager | Jason Lowe | Jian He |
| [HDFS-5742](https://issues.apache.org/jira/browse/HDFS-5742) | DatanodeCluster (mini cluster of DNs) fails to start | Minor | test | Arpit Agarwal | Arpit Agarwal |
-| [HDFS-5716](https://issues.apache.org/jira/browse/HDFS-5716) | Allow WebHDFS to use pluggable authentication filter | Major | webhdfs | Haohui Mai | Haohui Mai |
-| [HDFS-5705](https://issues.apache.org/jira/browse/HDFS-5705) | TestSecondaryNameNodeUpgrade#testChangeNsIDFails may fail due to ConcurrentModificationException | Major | datanode | Ted Yu | Ted Yu |
-| [HDFS-5626](https://issues.apache.org/jira/browse/HDFS-5626) | dfsadmin -report shows incorrect cache values | Major | caching | Stephen Chu | Colin Patrick McCabe |
-| [HDFS-5516](https://issues.apache.org/jira/browse/HDFS-5516) | WebHDFS does not require user name when anonymous http requests are disallowed. | Major | webhdfs | Chris Nauroth | Miodrag Radulovic |
-| [HDFS-5492](https://issues.apache.org/jira/browse/HDFS-5492) | Port HDFS-2069 (Incorrect default trash interval in the docs) to trunk | Minor | documentation | Akira AJISAKA | Akira AJISAKA |
-| [HDFS-5339](https://issues.apache.org/jira/browse/HDFS-5339) | WebHDFS URI does not accept logical nameservices when security is enabled | Major | webhdfs | Stephen Chu | Haohui Mai |
-| [HDFS-5244](https://issues.apache.org/jira/browse/HDFS-5244) | TestNNStorageRetentionManager#testPurgeMultipleDirs fails | Major | test | Jinghui Wang | Jinghui Wang |
-| [HDFS-5064](https://issues.apache.org/jira/browse/HDFS-5064) | Standby checkpoints should not block concurrent readers | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-4858](https://issues.apache.org/jira/browse/HDFS-4858) | HDFS DataNode to NameNode RPC should timeout | Minor | datanode | Jagane Sundar | Henry Wang |
+| [HDFS-5962](https://issues.apache.org/jira/browse/HDFS-5962) | Mtime and atime are not persisted for symbolic links | Critical | . | Kihwal Lee | Akira Ajisaka |
+| [HADOOP-10328](https://issues.apache.org/jira/browse/HADOOP-10328) | loadGenerator exit code is not reliable | Major | tools | Arpit Gupta | Haohui Mai |
+| [HDFS-5944](https://issues.apache.org/jira/browse/HDFS-5944) | LeaseManager:findLeaseWithPrefixPath can't handle path like /a/b/ right and cause SecondaryNameNode failed do checkpoint | Major | namenode | yunjiong zhao | yunjiong zhao |
+| [HDFS-5982](https://issues.apache.org/jira/browse/HDFS-5982) | Need to update snapshot manager when applying editlog for deleting a snapshottable directory | Critical | namenode | Tassapol Athiapinya | Jing Zhao |
+| [YARN-1398](https://issues.apache.org/jira/browse/YARN-1398) | Deadlock in capacity scheduler leaf queue and parent queue for getQueueInfo and completedContainer call | Blocker | resourcemanager | Sunil G | Vinod Kumar Vavilapalli |
+| [HDFS-5988](https://issues.apache.org/jira/browse/HDFS-5988) | Bad fsimage always generated after upgrade | Blocker | namenode | Andrew Wang | Andrew Wang |
+| [HADOOP-10355](https://issues.apache.org/jira/browse/HADOOP-10355) | TestLoadGenerator#testLoadGenerator fails | Major | . | Akira Ajisaka | Haohui Mai |
+| [HADOOP-10352](https://issues.apache.org/jira/browse/HADOOP-10352) | Recursive setfacl erroneously attempts to apply default ACL to files. | Major | fs | Chris Nauroth | Chris Nauroth |
+| [YARN-1071](https://issues.apache.org/jira/browse/YARN-1071) | ResourceManager's decommissioned and lost node count is 0 after restart | Major | resourcemanager | Srimanth Gunturi | Jian He |
+| [HDFS-5981](https://issues.apache.org/jira/browse/HDFS-5981) | PBImageXmlWriter generates malformed XML | Minor | tools | Haohui Mai | Haohui Mai |
+| [HADOOP-10354](https://issues.apache.org/jira/browse/HADOOP-10354) | TestWebHDFS fails after merge of HDFS-4685 to trunk | Major | fs | Yongjun Zhang | Chris Nauroth |
+| [MAPREDUCE-5688](https://issues.apache.org/jira/browse/MAPREDUCE-5688) | TestStagingCleanup fails intermittently with JDK7 | Major | . | Mit Desai | Mit Desai |
+| [YARN-1470](https://issues.apache.org/jira/browse/YARN-1470) | Add audience annotation to MiniYARNCluster | Major | . | Sandy Ryza | Anubhav Dhoot |
+| [YARN-1742](https://issues.apache.org/jira/browse/YARN-1742) | Fix javadoc of parameter DEFAULT\_NM\_MIN\_HEALTHY\_DISKS\_FRACTION | Trivial | documentation | Akira Ajisaka | Akira Ajisaka |
+| [YARN-1686](https://issues.apache.org/jira/browse/YARN-1686) | NodeManager.resyncWithRM() does not handle exception which cause NodeManger to Hang. | Major | nodemanager | Rohith Sharma K S | Rohith Sharma K S |
+| [HDFS-5922](https://issues.apache.org/jira/browse/HDFS-5922) | DN heartbeat thread can get stuck in tight loop | Major | datanode | Aaron T. Myers | Arpit Agarwal |
+| [HADOOP-10361](https://issues.apache.org/jira/browse/HADOOP-10361) | Correct alignment in CLI output for ACLs. | Minor | fs | Chris Nauroth | Chris Nauroth |
+| [HDFS-6008](https://issues.apache.org/jira/browse/HDFS-6008) | Namenode dead node link is giving HTTP error 500 | Minor | namenode | Benoy Antony | Benoy Antony |
+| [HADOOP-10368](https://issues.apache.org/jira/browse/HADOOP-10368) | InputStream is not closed in VersionInfo ctor | Minor | util | Ted Yu | Tsuyoshi Ozawa |
| [HDFS-3969](https://issues.apache.org/jira/browse/HDFS-3969) | Small bug fixes and improvements for disk locations API | Major | hdfs-client | Todd Lipcon | Todd Lipcon |
-| [HDFS-3128](https://issues.apache.org/jira/browse/HDFS-3128) | Unit tests should not use a test root in /tmp | Minor | test | Eli Collins | Andrew Wang |
-| [MAPREDUCE-5813](https://issues.apache.org/jira/browse/MAPREDUCE-5813) | YarnChild does not load job.xml with mapreduce.job.classloader=true | Blocker | mrv2, task | Gera Shegalov | Gera Shegalov |
-| [MAPREDUCE-5810](https://issues.apache.org/jira/browse/MAPREDUCE-5810) | TestStreamingTaskLog#testStreamingTaskLogWithHadoopCmd is failing | Major | contrib/streaming | Mit Desai | Akira AJISAKA |
-| [MAPREDUCE-5806](https://issues.apache.org/jira/browse/MAPREDUCE-5806) | Log4j settings in container-log4j.properties cannot be overridden | Major | . | Eugene Koifman | Varun Vasudev |
-| [MAPREDUCE-5805](https://issues.apache.org/jira/browse/MAPREDUCE-5805) | Unable to parse launch time from job history file | Major | jobhistoryserver | Fengdong Yu | Akira AJISAKA |
-| [MAPREDUCE-5795](https://issues.apache.org/jira/browse/MAPREDUCE-5795) | Job should be marked as Failed if it is recovered from commit. | Major | . | Yesha Vora | Xuan Gong |
-| [MAPREDUCE-5794](https://issues.apache.org/jira/browse/MAPREDUCE-5794) | SliveMapper always uses default FileSystem. | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [MAPREDUCE-5791](https://issues.apache.org/jira/browse/MAPREDUCE-5791) | Shuffle phase is slow in Windows - FadviseFileRegion::transferTo does not read disks efficiently | Major | client | Nikola Vujic | Nikola Vujic |
-| [MAPREDUCE-5789](https://issues.apache.org/jira/browse/MAPREDUCE-5789) | Average Reduce time is incorrect on Job Overview page | Major | jobhistoryserver, webapps | Rushabh S Shah | Rushabh S Shah |
-| [MAPREDUCE-5780](https://issues.apache.org/jira/browse/MAPREDUCE-5780) | SliveTest always uses default FileSystem | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [MAPREDUCE-5778](https://issues.apache.org/jira/browse/MAPREDUCE-5778) | JobSummary does not escape newlines in the job name | Major | jobhistoryserver | Jason Lowe | Akira AJISAKA |
+| [MAPREDUCE-5766](https://issues.apache.org/jira/browse/MAPREDUCE-5766) | Ping messages from attempts should be moved to DEBUG | Minor | applicationmaster | Ramya Sunil | Jian He |
+| [YARN-1301](https://issues.apache.org/jira/browse/YARN-1301) | Need to log the blacklist additions/removals when YarnSchedule#allocate | Minor | . | Zhijie Shen | Tsuyoshi Ozawa |
+| [HADOOP-10353](https://issues.apache.org/jira/browse/HADOOP-10353) | FsUrlStreamHandlerFactory is not thread safe | Major | fs | Tudor Scurtu | Tudor Scurtu |
| [MAPREDUCE-5770](https://issues.apache.org/jira/browse/MAPREDUCE-5770) | Redirection from AM-URL is broken with HTTPS\_ONLY policy | Major | . | Yesha Vora | Jian He |
-| [MAPREDUCE-5769](https://issues.apache.org/jira/browse/MAPREDUCE-5769) | Unregistration to RM should not be called if AM is crashed before registering with RM | Major | . | Rohith Sharma K S | Rohith Sharma K S |
+| [HDFS-6028](https://issues.apache.org/jira/browse/HDFS-6028) | Print clearer error message when user attempts to delete required mask entry from ACL. | Trivial | namenode | Chris Nauroth | Chris Nauroth |
+| [YARN-1528](https://issues.apache.org/jira/browse/YARN-1528) | Allow setting auth for ZK connections | Blocker | resourcemanager | Karthik Kambatla | Karthik Kambatla |
+| [HDFS-5339](https://issues.apache.org/jira/browse/HDFS-5339) | WebHDFS URI does not accept logical nameservices when security is enabled | Major | webhdfs | Stephen Chu | Haohui Mai |
| [MAPREDUCE-5768](https://issues.apache.org/jira/browse/MAPREDUCE-5768) | TestMRJobs.testContainerRollingLog fails on trunk | Major | . | Zhijie Shen | Gera Shegalov |
-| [MAPREDUCE-5766](https://issues.apache.org/jira/browse/MAPREDUCE-5766) | Ping messages from attempts should be moved to DEBUG | Minor | applicationmaster | Ramya Sunil | Jian He |
-| [MAPREDUCE-5757](https://issues.apache.org/jira/browse/MAPREDUCE-5757) | ConcurrentModificationException in JobControl.toList | Major | client | Jason Lowe | Jason Lowe |
+| [HDFS-6033](https://issues.apache.org/jira/browse/HDFS-6033) | PBImageXmlWriter incorrectly handles processing cache directives | Major | caching | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-5821](https://issues.apache.org/jira/browse/HDFS-5821) | TestHDFSCLI fails for user names with the dash character | Major | test | Gera Shegalov | Gera Shegalov |
+| [YARN-1760](https://issues.apache.org/jira/browse/YARN-1760) | TestRMAdminService assumes CapacityScheduler | Trivial | . | Karthik Kambatla | Karthik Kambatla |
+| [HADOOP-10314](https://issues.apache.org/jira/browse/HADOOP-10314) | The ls command help still shows outdated 0.16 format. | Major | . | Kihwal Lee | Rushabh S Shah |
+| [YARN-1758](https://issues.apache.org/jira/browse/YARN-1758) | MiniYARNCluster broken post YARN-1666 | Blocker | . | Hitesh Shah | Xuan Gong |
+| [YARN-1748](https://issues.apache.org/jira/browse/YARN-1748) | hadoop-yarn-server-tests packages core-site.xml breaking downstream tests | Blocker | . | Sravya Tirukkovalur | Sravya Tirukkovalur |
+| [HDFS-6039](https://issues.apache.org/jira/browse/HDFS-6039) | Uploading a File under a Dir with default acls throws "Duplicated ACLFeature" | Major | namenode | Yesha Vora | Chris Nauroth |
+| [HADOOP-10070](https://issues.apache.org/jira/browse/HADOOP-10070) | RPC client doesn't use per-connection conf to determine server's expected Kerberos principal name | Major | security | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-6053](https://issues.apache.org/jira/browse/HDFS-6053) | Fix TestDecommissioningStatus and TestDecommission in branch-2 | Major | namenode | Jing Zhao | Jing Zhao |
+| [HDFS-6047](https://issues.apache.org/jira/browse/HDFS-6047) | TestPread NPE inside in DFSInputStream hedgedFetchBlockByteRange | Major | . | stack | stack |
+| [HDFS-6051](https://issues.apache.org/jira/browse/HDFS-6051) | HDFS cannot run on Windows since short-circuit shared memory segment changes. | Blocker | hdfs-client | Chris Nauroth | Colin P. McCabe |
+| [YARN-1768](https://issues.apache.org/jira/browse/YARN-1768) | yarn kill non-existent application is too verbose | Minor | client | Hitesh Shah | Tsuyoshi Ozawa |
+| [YARN-1785](https://issues.apache.org/jira/browse/YARN-1785) | FairScheduler treats app lookup failures as ERRORs | Major | . | bc Wong | bc Wong |
+| [YARN-1752](https://issues.apache.org/jira/browse/YARN-1752) | Unexpected Unregistered event at Attempt Launched state | Major | . | Jian He | Rohith Sharma K S |
+| [HDFS-5857](https://issues.apache.org/jira/browse/HDFS-5857) | TestWebHDFS#testNamenodeRestart fails intermittently with NPE | Major | . | Mit Desai | Mit Desai |
+| [HDFS-6057](https://issues.apache.org/jira/browse/HDFS-6057) | DomainSocketWatcher.watcherThread should be marked as daemon thread | Blocker | hdfs-client | Eric Sirianni | Colin P. McCabe |
+| [HDFS-6058](https://issues.apache.org/jira/browse/HDFS-6058) | Fix TestHDFSCLI failures after HADOOP-8691 change | Major | . | Vinayakumar B | Haohui Mai |
+| [HDFS-6059](https://issues.apache.org/jira/browse/HDFS-6059) | TestBlockReaderLocal fails if native library is not available | Major | . | Akira Ajisaka | Akira Ajisaka |
+| [HDFS-6062](https://issues.apache.org/jira/browse/HDFS-6062) | TestRetryCacheWithHA#testConcat is flaky | Minor | . | Jing Zhao | Jing Zhao |
+| [MAPREDUCE-5780](https://issues.apache.org/jira/browse/MAPREDUCE-5780) | SliveTest always uses default FileSystem | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-6064](https://issues.apache.org/jira/browse/HDFS-6064) | DFSConfigKeys.DFS\_BLOCKREPORT\_INTERVAL\_MSEC\_DEFAULT is not updated with latest block report interval of 6 hrs | Minor | datanode | Vinayakumar B | Vinayakumar B |
+| [HDFS-6067](https://issues.apache.org/jira/browse/HDFS-6067) | TestPread.testMaxOutHedgedReadPool is flaky | Major | hdfs-client | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-6065](https://issues.apache.org/jira/browse/HDFS-6065) | HDFS zero-copy reads should return null on EOF when doing ZCR | Major | hdfs-client | Colin P. McCabe | Colin P. McCabe |
+| [YARN-1774](https://issues.apache.org/jira/browse/YARN-1774) | FS: Submitting to non-leaf queue throws NPE | Blocker | fairscheduler | Anubhav Dhoot | Anubhav Dhoot |
+| [YARN-1783](https://issues.apache.org/jira/browse/YARN-1783) | yarn application does not make any progress even when no other application is running when RM is being restarted in the background | Critical | . | Arpit Gupta | Jian He |
+| [HDFS-5064](https://issues.apache.org/jira/browse/HDFS-5064) | Standby checkpoints should not block concurrent readers | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-6078](https://issues.apache.org/jira/browse/HDFS-6078) | TestIncrementalBlockReports is flaky | Minor | test | Arpit Agarwal | Arpit Agarwal |
+| [HDFS-6071](https://issues.apache.org/jira/browse/HDFS-6071) | BlockReaderLocal doesn't return -1 on EOF when doing a zero-length read on a short file | Major | . | Colin P. McCabe | Colin P. McCabe |
+| [YARN-1793](https://issues.apache.org/jira/browse/YARN-1793) | yarn application -kill doesn't kill UnmanagedAMs | Critical | resourcemanager | Karthik Kambatla | Karthik Kambatla |
+| [YARN-1788](https://issues.apache.org/jira/browse/YARN-1788) | AppsCompleted/AppsKilled metric is incorrect when MR job is killed with yarn application -kill | Critical | resourcemanager | Tassapol Athiapinya | Varun Vasudev |
+| [HDFS-6077](https://issues.apache.org/jira/browse/HDFS-6077) | running slive with webhdfs on secure HA cluster fails with unkown host exception | Major | . | Arpit Gupta | Jing Zhao |
+| [HADOOP-10395](https://issues.apache.org/jira/browse/HADOOP-10395) | TestCallQueueManager is flaky | Minor | test | Arpit Agarwal | Arpit Agarwal |
+| [HADOOP-10394](https://issues.apache.org/jira/browse/HADOOP-10394) | TestAuthenticationFilter is flaky | Major | test | Arpit Agarwal | Arpit Agarwal |
+| [MAPREDUCE-5028](https://issues.apache.org/jira/browse/MAPREDUCE-5028) | Maps fail when io.sort.mb is set to high value | Critical | . | Karthik Kambatla | Karthik Kambatla |
+| [HADOOP-10337](https://issues.apache.org/jira/browse/HADOOP-10337) | ConcurrentModificationException from MetricsDynamicMBeanBase.createMBeanInfo() | Major | metrics | Liang Xie | Liang Xie |
+| [YARN-1444](https://issues.apache.org/jira/browse/YARN-1444) | RM crashes when node resource request sent without corresponding off-switch request | Blocker | client, resourcemanager | Robert Grandl | Wangda Tan |
+| [MAPREDUCE-5778](https://issues.apache.org/jira/browse/MAPREDUCE-5778) | JobSummary does not escape newlines in the job name | Major | jobhistoryserver | Jason Lowe | Akira Ajisaka |
+| [HDFS-6079](https://issues.apache.org/jira/browse/HDFS-6079) | Timeout for getFileBlockStorageLocations does not work | Major | hdfs-client | Andrew Wang | Andrew Wang |
+| [HDFS-6096](https://issues.apache.org/jira/browse/HDFS-6096) | TestWebHdfsTokens may timeout | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-5789](https://issues.apache.org/jira/browse/MAPREDUCE-5789) | Average Reduce time is incorrect on Job Overview page | Major | jobhistoryserver, webapps | Rushabh S Shah | Rushabh S Shah |
+| [HDFS-5244](https://issues.apache.org/jira/browse/HDFS-5244) | TestNNStorageRetentionManager#testPurgeMultipleDirs fails | Major | test | Jinghui Wang | Jinghui Wang |
+| [MAPREDUCE-5794](https://issues.apache.org/jira/browse/MAPREDUCE-5794) | SliveMapper always uses default FileSystem. | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-6097](https://issues.apache.org/jira/browse/HDFS-6097) | zero-copy reads are incorrectly disabled on file offsets above 2GB | Major | hdfs-client | Colin P. McCabe | Colin P. McCabe |
| [MAPREDUCE-5751](https://issues.apache.org/jira/browse/MAPREDUCE-5751) | MR app master fails to start in some cases if mapreduce.job.classloader is true | Major | . | Sangjin Lee | Sangjin Lee |
-| [MAPREDUCE-5746](https://issues.apache.org/jira/browse/MAPREDUCE-5746) | Job diagnostics can implicate wrong task for a failed job | Major | jobhistoryserver | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-5699](https://issues.apache.org/jira/browse/MAPREDUCE-5699) | Allow setting tags on MR jobs | Major | applicationmaster | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-5688](https://issues.apache.org/jira/browse/MAPREDUCE-5688) | TestStagingCleanup fails intermittently with JDK7 | Major | . | Mit Desai | Mit Desai |
-| [MAPREDUCE-5670](https://issues.apache.org/jira/browse/MAPREDUCE-5670) | CombineFileRecordReader should report progress when moving to the next file | Minor | mrv2 | Jason Lowe | Chen He |
+| [MAPREDUCE-5769](https://issues.apache.org/jira/browse/MAPREDUCE-5769) | Unregistration to RM should not be called if AM is crashed before registering with RM | Major | . | Rohith Sharma K S | Rohith Sharma K S |
| [MAPREDUCE-5570](https://issues.apache.org/jira/browse/MAPREDUCE-5570) | Map task attempt with fetch failure has incorrect attempt finish time | Major | mr-am, mrv2 | Jason Lowe | Rushabh S Shah |
-| [MAPREDUCE-5028](https://issues.apache.org/jira/browse/MAPREDUCE-5028) | Maps fail when io.sort.mb is set to high value | Critical | . | Karthik Kambatla | Karthik Kambatla |
+| [YARN-1833](https://issues.apache.org/jira/browse/YARN-1833) | TestRMAdminService Fails in trunk and branch-2 : Assert Fails due to different count of UserGroups for currentUser() | Major | . | Mit Desai | Mit Desai |
+| [HDFS-6106](https://issues.apache.org/jira/browse/HDFS-6106) | Reduce default for dfs.namenode.path.based.cache.refresh.interval.ms | Major | . | Colin P. McCabe | Colin P. McCabe |
| [MAPREDUCE-4052](https://issues.apache.org/jira/browse/MAPREDUCE-4052) | Windows eclipse cannot submit job from Windows client to Linux/Unix Hadoop cluster. | Major | job submission | xieguiming | Jian He |
-| [YARN-1873](https://issues.apache.org/jira/browse/YARN-1873) | TestDistributedShell#testDSShell fails when the test cases are out of order | Major | . | Mit Desai | Mit Desai |
-| [YARN-1867](https://issues.apache.org/jira/browse/YARN-1867) | NPE while fetching apps via the REST API | Blocker | resourcemanager | Karthik Kambatla | Vinod Kumar Vavilapalli |
-| [YARN-1866](https://issues.apache.org/jira/browse/YARN-1866) | YARN RM fails to load state store with delegation token parsing error | Blocker | . | Arpit Gupta | Jian He |
+| [YARN-1824](https://issues.apache.org/jira/browse/YARN-1824) | Make Windows client work with Linux/Unix cluster | Major | . | Jian He | Jian He |
+| [HDFS-6094](https://issues.apache.org/jira/browse/HDFS-6094) | The same block can be counted twice towards safe mode threshold | Major | namenode | Arpit Agarwal | Arpit Agarwal |
+| [HDFS-6107](https://issues.apache.org/jira/browse/HDFS-6107) | When a block can't be cached due to limited space on the DataNode, that block becomes uncacheable | Major | datanode | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-5516](https://issues.apache.org/jira/browse/HDFS-5516) | WebHDFS does not require user name when anonymous http requests are disallowed. | Major | webhdfs | Chris Nauroth | Miodrag Radulovic |
+| [YARN-1206](https://issues.apache.org/jira/browse/YARN-1206) | AM container log link broken on NM web page | Blocker | . | Jian He | Rohith Sharma K S |
+| [YARN-1591](https://issues.apache.org/jira/browse/YARN-1591) | TestResourceTrackerService fails randomly on trunk | Major | . | Vinod Kumar Vavilapalli | Tsuyoshi Ozawa |
+| [YARN-1839](https://issues.apache.org/jira/browse/YARN-1839) | Capacity scheduler preempts an AM out. AM attempt 2 fails to launch task container with SecretManager$InvalidToken: No NMToken sent | Critical | applications, capacityscheduler | Tassapol Athiapinya | Jian He |
+| [YARN-1846](https://issues.apache.org/jira/browse/YARN-1846) | TestRM#testNMTokenSentForNormalContainer assumes CapacityScheduler | Major | . | Robert Kanter | Robert Kanter |
+| [HDFS-6068](https://issues.apache.org/jira/browse/HDFS-6068) | Disallow snapshot names that are also invalid directory names | Major | snapshots | Andrew Wang | sathish |
+| [HDFS-6117](https://issues.apache.org/jira/browse/HDFS-6117) | Print file path information in FileNotFoundException | Minor | namenode | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-6099](https://issues.apache.org/jira/browse/HDFS-6099) | HDFS file system limits not enforced on renames. | Major | namenode | Chris Nauroth | Chris Nauroth |
+| [HDFS-6100](https://issues.apache.org/jira/browse/HDFS-6100) | DataNodeWebHdfsMethods does not failover in HA mode | Major | ha | Arpit Gupta | Haohui Mai |
+| [HDFS-6105](https://issues.apache.org/jira/browse/HDFS-6105) | NN web UI for DN list loads the same jmx page multiple times. | Major | . | Kihwal Lee | Haohui Mai |
+| [HDFS-6127](https://issues.apache.org/jira/browse/HDFS-6127) | WebHDFS tokens cannot be renewed in HA setup | Major | ha | Arpit Gupta | Haohui Mai |
+| [HDFS-6129](https://issues.apache.org/jira/browse/HDFS-6129) | When a replica is not found for deletion, do not throw exception. | Minor | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-6089](https://issues.apache.org/jira/browse/HDFS-6089) | Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspended | Major | ha | Arpit Gupta | Jing Zhao |
+| [HDFS-6131](https://issues.apache.org/jira/browse/HDFS-6131) | Move HDFSHighAvailabilityWithNFS.apt.vm and HDFSHighAvailabilityWithQJM.apt.vm from Yarn to HDFS | Major | documentation | Jing Zhao | Jing Zhao |
| [YARN-1859](https://issues.apache.org/jira/browse/YARN-1859) | WebAppProxyServlet will throw ApplicationNotFoundException if the app is no longer cached in RM | Major | . | Zhijie Shen | Zhijie Shen |
-| [YARN-1852](https://issues.apache.org/jira/browse/YARN-1852) | Application recovery throws InvalidStateTransitonException for FAILED and KILLED jobs | Major | resourcemanager | Rohith Sharma K S | Rohith Sharma K S |
| [YARN-1849](https://issues.apache.org/jira/browse/YARN-1849) | NPE in ResourceTrackerService#registerNodeManager for UAM | Blocker | resourcemanager | Karthik Kambatla | Karthik Kambatla |
-| [YARN-1846](https://issues.apache.org/jira/browse/YARN-1846) | TestRM#testNMTokenSentForNormalContainer assumes CapacityScheduler | Major | . | Robert Kanter | Robert Kanter |
-| [YARN-1839](https://issues.apache.org/jira/browse/YARN-1839) | Capacity scheduler preempts an AM out. AM attempt 2 fails to launch task container with SecretManager$InvalidToken: No NMToken sent | Critical | applications, capacityscheduler | Tassapol Athiapinya | Jian He |
-| [YARN-1833](https://issues.apache.org/jira/browse/YARN-1833) | TestRMAdminService Fails in trunk and branch-2 : Assert Fails due to different count of UserGroups for currentUser() | Major | . | Mit Desai | Mit Desai |
-| [YARN-1830](https://issues.apache.org/jira/browse/YARN-1830) | TestRMRestart.testQueueMetricsOnRMRestart failure | Major | resourcemanager | Karthik Kambatla | Zhijie Shen |
-| [YARN-1824](https://issues.apache.org/jira/browse/YARN-1824) | Make Windows client work with Linux/Unix cluster | Major | . | Jian He | Jian He |
-| [YARN-1793](https://issues.apache.org/jira/browse/YARN-1793) | yarn application -kill doesn't kill UnmanagedAMs | Critical | resourcemanager | Karthik Kambatla | Karthik Kambatla |
-| [YARN-1788](https://issues.apache.org/jira/browse/YARN-1788) | AppsCompleted/AppsKilled metric is incorrect when MR job is killed with yarn application -kill | Critical | resourcemanager | Tassapol Athiapinya | Varun Vasudev |
-| [YARN-1785](https://issues.apache.org/jira/browse/YARN-1785) | FairScheduler treats app lookup failures as ERRORs | Major | . | bc Wong | bc Wong |
-| [YARN-1783](https://issues.apache.org/jira/browse/YARN-1783) | yarn application does not make any progress even when no other application is running when RM is being restarted in the background | Critical | . | Arpit Gupta | Jian He |
-| [YARN-1774](https://issues.apache.org/jira/browse/YARN-1774) | FS: Submitting to non-leaf queue throws NPE | Blocker | fairscheduler | Anubhav Dhoot | Anubhav Dhoot |
-| [YARN-1768](https://issues.apache.org/jira/browse/YARN-1768) | yarn kill non-existent application is too verbose | Minor | client | Hitesh Shah | Tsuyoshi Ozawa |
-| [YARN-1760](https://issues.apache.org/jira/browse/YARN-1760) | TestRMAdminService assumes CapacityScheduler | Trivial | . | Karthik Kambatla | Karthik Kambatla |
-| [YARN-1758](https://issues.apache.org/jira/browse/YARN-1758) | MiniYARNCluster broken post YARN-1666 | Blocker | . | Hitesh Shah | Xuan Gong |
-| [YARN-1752](https://issues.apache.org/jira/browse/YARN-1752) | Unexpected Unregistered event at Attempt Launched state | Major | . | Jian He | Rohith Sharma K S |
-| [YARN-1748](https://issues.apache.org/jira/browse/YARN-1748) | hadoop-yarn-server-tests packages core-site.xml breaking downstream tests | Blocker | . | Sravya Tirukkovalur | Sravya Tirukkovalur |
-| [YARN-1742](https://issues.apache.org/jira/browse/YARN-1742) | Fix javadoc of parameter DEFAULT\_NM\_MIN\_HEALTHY\_DISKS\_FRACTION | Trivial | documentation | Akira AJISAKA | Akira AJISAKA |
-| [YARN-1724](https://issues.apache.org/jira/browse/YARN-1724) | Race condition in Fair Scheduler when continuous scheduling is turned on | Critical | scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-1721](https://issues.apache.org/jira/browse/YARN-1721) | When moving app between queues in Fair Scheduler, grab lock on FSSchedulerApp | Critical | scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-1697](https://issues.apache.org/jira/browse/YARN-1697) | NodeManager reports negative running containers | Major | nodemanager | Sandy Ryza | Sandy Ryza |
-| [YARN-1692](https://issues.apache.org/jira/browse/YARN-1692) | ConcurrentModificationException in fair scheduler AppSchedulable | Major | scheduler | Sangjin Lee | Sangjin Lee |
-| [YARN-1689](https://issues.apache.org/jira/browse/YARN-1689) | RMAppAttempt is not killed when RMApp is at ACCEPTED | Critical | resourcemanager | Deepesh Khandelwal | Vinod Kumar Vavilapalli |
-| [YARN-1686](https://issues.apache.org/jira/browse/YARN-1686) | NodeManager.resyncWithRM() does not handle exception which cause NodeManger to Hang. | Major | nodemanager | Rohith Sharma K S | Rohith Sharma K S |
-| [YARN-1673](https://issues.apache.org/jira/browse/YARN-1673) | Valid yarn kill application prints out help message. | Blocker | client | Tassapol Athiapinya | Mayank Bansal |
-| [YARN-1672](https://issues.apache.org/jira/browse/YARN-1672) | YarnConfiguration is missing a default for yarn.nodemanager.log.retain-seconds | Trivial | nodemanager | Karthik Kambatla | Naren Koneru |
+| [MAPREDUCE-5806](https://issues.apache.org/jira/browse/MAPREDUCE-5806) | Log4j settings in container-log4j.properties cannot be overridden | Major | . | Eugene Koifman | Varun Vasudev |
+| [HADOOP-10191](https://issues.apache.org/jira/browse/HADOOP-10191) | Missing executable permission on viewfs internal dirs | Blocker | viewfs | Gera Shegalov | Gera Shegalov |
+| [HDFS-6140](https://issues.apache.org/jira/browse/HDFS-6140) | WebHDFS cannot create a file with spaces in the name after HA failover changes. | Major | webhdfs | Chris Nauroth | Chris Nauroth |
| [YARN-1670](https://issues.apache.org/jira/browse/YARN-1670) | aggregated log writer can write more log data then it says is the log length | Critical | . | Thomas Graves | Mit Desai |
-| [YARN-1661](https://issues.apache.org/jira/browse/YARN-1661) | AppMaster logs says failing even if an application does succeed. | Major | applications/distributed-shell | Tassapol Athiapinya | Vinod Kumar Vavilapalli |
-| [YARN-1632](https://issues.apache.org/jira/browse/YARN-1632) | TestApplicationMasterServices should be under org.apache.hadoop.yarn.server.resourcemanager package | Minor | . | Chen He | Chen He |
-| [YARN-1617](https://issues.apache.org/jira/browse/YARN-1617) | Remove ancient comment and surround LOG.debug in AppSchedulingInfo.allocate | Major | scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-1591](https://issues.apache.org/jira/browse/YARN-1591) | TestResourceTrackerService fails randomly on trunk | Major | . | Vinod Kumar Vavilapalli | Tsuyoshi Ozawa |
-| [YARN-1590](https://issues.apache.org/jira/browse/YARN-1590) | \_HOST doesn't expand properly for RM, NM, ProxyServer and JHS | Major | resourcemanager | Mohammad Kamrul Islam | Mohammad Kamrul Islam |
-| [YARN-1553](https://issues.apache.org/jira/browse/YARN-1553) | Do not use HttpConfig.isSecure() in YARN | Major | . | Haohui Mai | Haohui Mai |
-| [YARN-1531](https://issues.apache.org/jira/browse/YARN-1531) | True up yarn command documentation | Major | documentation | Akira AJISAKA | Akira AJISAKA |
-| [YARN-1528](https://issues.apache.org/jira/browse/YARN-1528) | Allow setting auth for ZK connections | Blocker | resourcemanager | Karthik Kambatla | Karthik Kambatla |
-| [YARN-1470](https://issues.apache.org/jira/browse/YARN-1470) | Add audience annotation to MiniYARNCluster | Major | . | Sandy Ryza | Anubhav Dhoot |
-| [YARN-1444](https://issues.apache.org/jira/browse/YARN-1444) | RM crashes when node resource request sent without corresponding off-switch request | Blocker | client, resourcemanager | Robert Grandl | Wangda Tan |
-| [YARN-1417](https://issues.apache.org/jira/browse/YARN-1417) | RM may issue expired container tokens to AM while issuing new containers. | Blocker | . | Omkar Vinit Joshi | Jian He |
-| [YARN-1398](https://issues.apache.org/jira/browse/YARN-1398) | Deadlock in capacity scheduler leaf queue and parent queue for getQueueInfo and completedContainer call | Blocker | resourcemanager | Sunil G | Vinod Kumar Vavilapalli |
-| [YARN-1301](https://issues.apache.org/jira/browse/YARN-1301) | Need to log the blacklist additions/removals when YarnSchedule#allocate | Minor | . | Zhijie Shen | Tsuyoshi Ozawa |
-| [YARN-1285](https://issues.apache.org/jira/browse/YARN-1285) | Inconsistency of default "yarn.acl.enable" value | Major | . | Zhijie Shen | Kenji Kikushima |
-| [YARN-1206](https://issues.apache.org/jira/browse/YARN-1206) | AM container log link broken on NM web page | Blocker | . | Jian He | Rohith Sharma K S |
-| [YARN-1166](https://issues.apache.org/jira/browse/YARN-1166) | YARN 'appsFailed' metric should be of type 'counter' | Blocker | resourcemanager | Srimanth Gunturi | Zhijie Shen |
-| [YARN-1071](https://issues.apache.org/jira/browse/YARN-1071) | ResourceManager's decommissioned and lost node count is 0 after restart | Major | resourcemanager | Srimanth Gunturi | Jian He |
-| [YARN-713](https://issues.apache.org/jira/browse/YARN-713) | ResourceManager can exit unexpectedly if DNS is unavailable | Critical | resourcemanager | Jason Lowe | Jian He |
+| [HADOOP-10015](https://issues.apache.org/jira/browse/HADOOP-10015) | UserGroupInformation prints out excessive ERROR warnings | Minor | security | Haohui Mai | Nicolas Liochon |
+| [YARN-1852](https://issues.apache.org/jira/browse/YARN-1852) | Application recovery throws InvalidStateTransitonException for FAILED and KILLED jobs | Major | resourcemanager | Rohith Sharma K S | Rohith Sharma K S |
+| [MAPREDUCE-5791](https://issues.apache.org/jira/browse/MAPREDUCE-5791) | Shuffle phase is slow in Windows - FadviseFileRegion::transferTo does not read disks efficiently | Major | client | Nikola Vujic | Nikola Vujic |
+| [HDFS-6135](https://issues.apache.org/jira/browse/HDFS-6135) | In HDFS upgrade with HA setup, JournalNode cannot handle layout version bump when rolling back | Blocker | journal-node | Jing Zhao | Jing Zhao |
+| [HDFS-5846](https://issues.apache.org/jira/browse/HDFS-5846) | Assigning DEFAULT\_RACK in resolveNetworkLocation method can break data resiliency | Major | namenode | Nikola Vujic | Nikola Vujic |
+| [HADOOP-10422](https://issues.apache.org/jira/browse/HADOOP-10422) | Remove redundant logging of RPC retry attempts. | Minor | ipc | Chris Nauroth | Chris Nauroth |
+| [MAPREDUCE-5795](https://issues.apache.org/jira/browse/MAPREDUCE-5795) | Job should be marked as Failed if it is recovered from commit. | Major | . | Yesha Vora | Xuan Gong |
+| [HADOOP-10425](https://issues.apache.org/jira/browse/HADOOP-10425) | Incompatible behavior of LocalFileSystem:getContentSummary | Critical | fs | Brandon Li | Tsz Wo Nicholas Sze |
+| [HDFS-5840](https://issues.apache.org/jira/browse/HDFS-5840) | Follow-up to HDFS-5138 to improve error handling during partial upgrade failures | Blocker | ha, journal-node, namenode | Aaron T. Myers | Jing Zhao |
+| [HDFS-5807](https://issues.apache.org/jira/browse/HDFS-5807) | TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails intermittently on Branch-2 | Major | test | Mit Desai | Chen He |
+| [YARN-1866](https://issues.apache.org/jira/browse/YARN-1866) | YARN RM fails to load state store with delegation token parsing error | Blocker | . | Arpit Gupta | Jian He |
+| [YARN-1867](https://issues.apache.org/jira/browse/YARN-1867) | NPE while fetching apps via the REST API | Blocker | resourcemanager | Karthik Kambatla | Vinod Kumar Vavilapalli |
+| [HDFS-6130](https://issues.apache.org/jira/browse/HDFS-6130) | NPE when upgrading namenode from fsimages older than -32 | Blocker | namenode | Fengdong Yu | Haohui Mai |
+| [HDFS-6115](https://issues.apache.org/jira/browse/HDFS-6115) | flush() should be called for every append on block scan verification log | Minor | datanode | Vinayakumar B | Vinayakumar B |
+| [HADOOP-10440](https://issues.apache.org/jira/browse/HADOOP-10440) | HarFsInputStream of HarFileSystem, when reading data, computing the position has bug | Major | fs | guodongdong | guodongdong |
+| [HADOOP-10441](https://issues.apache.org/jira/browse/HADOOP-10441) | Namenode metric "rpc.RetryCache/NameNodeRetryCache.CacheHit" can't be correctly processed by Ganglia | Blocker | metrics | Jing Zhao | Jing Zhao |
+| [YARN-1873](https://issues.apache.org/jira/browse/YARN-1873) | TestDistributedShell#testDSShell fails when the test cases are ou
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[35/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.205.0/CHANGES.0.20.205.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.205.0/CHANGES.0.20.205.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.205.0/CHANGES.0.20.205.0.md
index 1e26cb4..a130003 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.205.0/CHANGES.0.20.205.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.205.0/CHANGES.0.20.205.0.md
@@ -24,26 +24,20 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HDFS-2202](https://issues.apache.org/jira/browse/HDFS-2202) | Changes to balancer bandwidth should not require datanode restart. | Major | balancer & mover, datanode | Eric Payne | Eric Payne |
-| [HDFS-1554](https://issues.apache.org/jira/browse/HDFS-1554) | Append 0.20: New semantics for recoverLease | Major | . | Hairong Kuang | Hairong Kuang |
| [HDFS-630](https://issues.apache.org/jira/browse/HDFS-630) | In DFSOutputStream.nextBlockOutputStream(), the client can exclude specific datanodes when locating the next block. | Major | hdfs-client, namenode | Ruyue Ma | Cosmin Lehene |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-1554](https://issues.apache.org/jira/browse/HDFS-1554) | Append 0.20: New semantics for recoverLease | Major | . | Hairong Kuang | Hairong Kuang |
+| [HDFS-2202](https://issues.apache.org/jira/browse/HDFS-2202) | Changes to balancer bandwidth should not require datanode restart. | Major | balancer & mover, datanode | Eric Payne | Eric Payne |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-200](https://issues.apache.org/jira/browse/HDFS-200) | In HDFS, sync() not yet guarantees data available to the new readers | Blocker | . | Tsz Wo Nicholas Sze | dhruba borthakur |
+| [HDFS-1520](https://issues.apache.org/jira/browse/HDFS-1520) | HDFS 20 append: Lightweight NameNode operation to trigger lease recovery | Major | namenode | Hairong Kuang | Hairong Kuang |
| [HADOOP-7594](https://issues.apache.org/jira/browse/HADOOP-7594) | Support HTTP REST in HttpServer | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-7119](https://issues.apache.org/jira/browse/HADOOP-7119) | add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
| [HADOOP-6889](https://issues.apache.org/jira/browse/HADOOP-6889) | Make RPC to have an option to timeout | Major | ipc | Hairong Kuang | John George |
-| [HDFS-1520](https://issues.apache.org/jira/browse/HDFS-1520) | HDFS 20 append: Lightweight NameNode operation to trigger lease recovery | Major | namenode | Hairong Kuang | Hairong Kuang |
-| [HDFS-200](https://issues.apache.org/jira/browse/HDFS-200) | In HDFS, sync() not yet guarantees data available to the new readers | Blocker | . | Tsz Wo Nicholas Sze | dhruba borthakur |
| [MAPREDUCE-2777](https://issues.apache.org/jira/browse/MAPREDUCE-2777) | Backport MAPREDUCE-220 to Hadoop 20 security branch | Major | . | Jonathan Eagles | Amar Kamat |
@@ -51,140 +45,140 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7720](https://issues.apache.org/jira/browse/HADOOP-7720) | improve the hadoop-setup-conf.sh to read in the hbase user and setup the configs | Major | conf | Arpit Gupta | Arpit Gupta |
-| [HADOOP-7707](https://issues.apache.org/jira/browse/HADOOP-7707) | improve config generator to allow users to specify proxy user, turn append on or off, turn webhdfs on or off | Major | conf | Arpit Gupta | Arpit Gupta |
-| [HADOOP-7655](https://issues.apache.org/jira/browse/HADOOP-7655) | provide a small validation script that smoke tests the installed cluster | Major | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-7472](https://issues.apache.org/jira/browse/HADOOP-7472) | RPC client should deal with the IP address changes | Minor | ipc | Kihwal Lee | Kihwal Lee |
-| [HADOOP-7432](https://issues.apache.org/jira/browse/HADOOP-7432) | Back-port HADOOP-7110 to 0.20-security | Major | . | Sherry Chen | Sherry Chen |
-| [HADOOP-7343](https://issues.apache.org/jira/browse/HADOOP-7343) | backport HADOOP-7008 and HADOOP-7042 to branch-0.20-security | Minor | test | Thomas Graves | Thomas Graves |
-| [HADOOP-7314](https://issues.apache.org/jira/browse/HADOOP-7314) | Add support for throwing UnknownHostException when a host doesn't resolve | Major | . | Jeffrey Naisbitt | Jeffrey Naisbitt |
-| [HDFS-1555](https://issues.apache.org/jira/browse/HDFS-1555) | HDFS 20 append: Disallow pipeline recovery if a file is already being lease recovered | Major | . | Hairong Kuang | Hairong Kuang |
-| [HDFS-1211](https://issues.apache.org/jira/browse/HDFS-1211) | 0.20 append: Block receiver should not log "rewind" packets at INFO level | Minor | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-1210](https://issues.apache.org/jira/browse/HDFS-1210) | DFSClient should log exception when block recovery fails | Trivial | hdfs-client | Todd Lipcon | Todd Lipcon |
+| [HDFS-826](https://issues.apache.org/jira/browse/HDFS-826) | Allow a mechanism for an application to detect that datanode(s) have died in the write pipeline | Major | hdfs-client | dhruba borthakur | dhruba borthakur |
| [HDFS-1054](https://issues.apache.org/jira/browse/HDFS-1054) | Remove unnecessary sleep after failure in nextBlockOutputStream | Major | hdfs-client | Todd Lipcon | Todd Lipcon |
+| [HDFS-1210](https://issues.apache.org/jira/browse/HDFS-1210) | DFSClient should log exception when block recovery fails | Trivial | hdfs-client | Todd Lipcon | Todd Lipcon |
+| [HDFS-1211](https://issues.apache.org/jira/browse/HDFS-1211) | 0.20 append: Block receiver should not log "rewind" packets at INFO level | Minor | datanode | Todd Lipcon | Todd Lipcon |
| [HDFS-895](https://issues.apache.org/jira/browse/HDFS-895) | Allow hflush/sync to occur in parallel with new writes to the file | Major | hdfs-client | dhruba borthakur | Todd Lipcon |
-| [HDFS-826](https://issues.apache.org/jira/browse/HDFS-826) | Allow a mechanism for an application to detect that datanode(s) have died in the write pipeline | Major | hdfs-client | dhruba borthakur | dhruba borthakur |
-| [MAPREDUCE-2981](https://issues.apache.org/jira/browse/MAPREDUCE-2981) | Backport trunk fairscheduler to 0.20-security branch | Major | contrib/fair-share | Matei Zaharia | Matei Zaharia |
-| [MAPREDUCE-2729](https://issues.apache.org/jira/browse/MAPREDUCE-2729) | Reducers are always counted having "pending tasks" even if they can't be scheduled yet because not enough of their mappers have completed | Major | . | Sherry Chen | Sherry Chen |
+| [HDFS-1555](https://issues.apache.org/jira/browse/HDFS-1555) | HDFS 20 append: Disallow pipeline recovery if a file is already being lease recovered | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-7343](https://issues.apache.org/jira/browse/HADOOP-7343) | backport HADOOP-7008 and HADOOP-7042 to branch-0.20-security | Minor | test | Thomas Graves | Thomas Graves |
+| [HADOOP-7432](https://issues.apache.org/jira/browse/HADOOP-7432) | Back-port HADOOP-7110 to 0.20-security | Major | . | Sherry Chen | Sherry Chen |
+| [HADOOP-7314](https://issues.apache.org/jira/browse/HADOOP-7314) | Add support for throwing UnknownHostException when a host doesn't resolve | Major | . | Jeffrey Naisbitt | Jeffrey Naisbitt |
| [MAPREDUCE-2494](https://issues.apache.org/jira/browse/MAPREDUCE-2494) | Make the distributed cache delete entires using LRU priority | Major | distributed-cache | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-2729](https://issues.apache.org/jira/browse/MAPREDUCE-2729) | Reducers are always counted having "pending tasks" even if they can't be scheduled yet because not enough of their mappers have completed | Major | . | Sherry Chen | Sherry Chen |
+| [HADOOP-7472](https://issues.apache.org/jira/browse/HADOOP-7472) | RPC client should deal with the IP address changes | Minor | ipc | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-2981](https://issues.apache.org/jira/browse/MAPREDUCE-2981) | Backport trunk fairscheduler to 0.20-security branch | Major | contrib/fair-share | Matei Zaharia | Matei Zaharia |
+| [HADOOP-7707](https://issues.apache.org/jira/browse/HADOOP-7707) | improve config generator to allow users to specify proxy user, turn append on or off, turn webhdfs on or off | Major | conf | Arpit Gupta | Arpit Gupta |
+| [HADOOP-7720](https://issues.apache.org/jira/browse/HADOOP-7720) | improve the hadoop-setup-conf.sh to read in the hbase user and setup the configs | Major | conf | Arpit Gupta | Arpit Gupta |
+| [HADOOP-7655](https://issues.apache.org/jira/browse/HADOOP-7655) | provide a small validation script that smoke tests the installed cluster | Major | . | Arpit Gupta | Arpit Gupta |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7724](https://issues.apache.org/jira/browse/HADOOP-7724) | hadoop-setup-conf.sh should put proxy user info into the core-site.xml | Major | . | Giridharan Kesavan | Arpit Gupta |
-| [HADOOP-7721](https://issues.apache.org/jira/browse/HADOOP-7721) | dfs.web.authentication.kerberos.principal expects the full hostname and does not replace \_HOST with the hostname | Major | . | Arpit Gupta | Jitendra Nath Pandey |
-| [HADOOP-7715](https://issues.apache.org/jira/browse/HADOOP-7715) | see log4j Error when running mr jobs and certain dfs calls | Major | conf | Arpit Gupta | Eric Yang |
-| [HADOOP-7711](https://issues.apache.org/jira/browse/HADOOP-7711) | hadoop-env.sh generated from templates has duplicate info | Major | conf | Arpit Gupta | Arpit Gupta |
-| [HADOOP-7708](https://issues.apache.org/jira/browse/HADOOP-7708) | config generator does not update the properties file if on exists already | Critical | conf | Arpit Gupta | Eric Yang |
-| [HADOOP-7691](https://issues.apache.org/jira/browse/HADOOP-7691) | hadoop deb pkg should take a diff group id | Major | . | Giridharan Kesavan | Eric Yang |
-| [HADOOP-7684](https://issues.apache.org/jira/browse/HADOOP-7684) | jobhistory server and secondarynamenode should have init.d script | Major | scripts | Eric Yang | Eric Yang |
-| [HADOOP-7683](https://issues.apache.org/jira/browse/HADOOP-7683) | hdfs-site.xml template has properties that are not used in 20 | Minor | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-7681](https://issues.apache.org/jira/browse/HADOOP-7681) | log4j.properties is missing properties for security audit and hdfs audit should be changed to info | Minor | conf | Arpit Gupta | Arpit Gupta |
-| [HADOOP-7679](https://issues.apache.org/jira/browse/HADOOP-7679) | log4j.properties templates does not define mapred.jobsummary.logger | Major | conf | Ramya Sunil | Ramya Sunil |
-| [HADOOP-7674](https://issues.apache.org/jira/browse/HADOOP-7674) | TestKerberosName fails in 20 branch. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-7658](https://issues.apache.org/jira/browse/HADOOP-7658) | to fix hadoop config template | Major | . | Giridharan Kesavan | Eric Yang |
-| [HADOOP-7649](https://issues.apache.org/jira/browse/HADOOP-7649) | TestMapredGroupMappingServiceRefresh and TestRefreshUserMappings fail after HADOOP-7625 | Blocker | security, test | Kihwal Lee | Jitendra Nath Pandey |
-| [HADOOP-7645](https://issues.apache.org/jira/browse/HADOOP-7645) | HTTP auth tests requiring Kerberos infrastructure are not disabled on branch-0.20-security | Blocker | security | Aaron T. Myers | Jitendra Nath Pandey |
-| [HADOOP-7644](https://issues.apache.org/jira/browse/HADOOP-7644) | Fix the delegation token tests to use the new style renewers | Blocker | security | Owen O'Malley | Owen O'Malley |
+| [HDFS-606](https://issues.apache.org/jira/browse/HDFS-606) | ConcurrentModificationException in invalidateCorruptReplicas() | Major | namenode | Konstantin Shvachko | Konstantin Shvachko |
+| [HDFS-724](https://issues.apache.org/jira/browse/HDFS-724) | Pipeline close hangs if one of the datanode is not responsive. | Blocker | datanode, hdfs-client | Tsz Wo Nicholas Sze | Hairong Kuang |
+| [HADOOP-6722](https://issues.apache.org/jira/browse/HADOOP-6722) | NetUtils.connect should check that it hasn't connected a socket to itself | Major | util | Todd Lipcon | Todd Lipcon |
+| [HDFS-142](https://issues.apache.org/jira/browse/HDFS-142) | In 0.20, move blocks being written into a blocksBeingWritten directory | Blocker | . | Raghu Angadi | dhruba borthakur |
+| [HDFS-1141](https://issues.apache.org/jira/browse/HDFS-1141) | completeFile does not check lease ownership | Blocker | namenode | Todd Lipcon | Todd Lipcon |
+| [HDFS-1207](https://issues.apache.org/jira/browse/HDFS-1207) | 0.20-append: stallReplicationWork should be volatile | Major | namenode | Todd Lipcon | Todd Lipcon |
+| [HDFS-1204](https://issues.apache.org/jira/browse/HDFS-1204) | 0.20: Lease expiration should recover single files, not entire lease holder | Major | . | Todd Lipcon | sam rash |
+| [HDFS-1118](https://issues.apache.org/jira/browse/HDFS-1118) | DFSOutputStream socket leak when cannot connect to DataNode | Major | . | Zheng Shao | Zheng Shao |
+| [HDFS-1202](https://issues.apache.org/jira/browse/HDFS-1202) | DataBlockScanner throws NPE when updated before initialized | Major | datanode | Todd Lipcon | Todd Lipcon |
+| [HADOOP-6833](https://issues.apache.org/jira/browse/HADOOP-6833) | IPC leaks call parameters when exceptions thrown | Blocker | . | Todd Lipcon | Todd Lipcon |
+| [HDFS-1346](https://issues.apache.org/jira/browse/HDFS-1346) | DFSClient receives out of order packet ack | Major | datanode, hdfs-client | Hairong Kuang | Hairong Kuang |
+| [HDFS-1164](https://issues.apache.org/jira/browse/HDFS-1164) | TestHdfsProxy is failing | Major | contrib/hdfsproxy | Eli Collins | Todd Lipcon |
+| [HDFS-988](https://issues.apache.org/jira/browse/HDFS-988) | saveNamespace race can corrupt the edits log | Blocker | namenode | dhruba borthakur | Eli Collins |
+| [HDFS-1836](https://issues.apache.org/jira/browse/HDFS-1836) | Thousand of CLOSE\_WAIT socket | Major | hdfs-client | Dennis Cheung | Bharath Mundlapudi |
+| [HADOOP-7400](https://issues.apache.org/jira/browse/HADOOP-7400) | HdfsProxyTests fails when the -Dtest.build.dir and -Dbuild.test is set | Major | build | Giridharan Kesavan | Giridharan Kesavan |
+| [MAPREDUCE-2650](https://issues.apache.org/jira/browse/MAPREDUCE-2650) | back-port MAPREDUCE-2238 to 0.20-security | Major | . | Sherry Chen | Sherry Chen |
+| [MAPREDUCE-2324](https://issues.apache.org/jira/browse/MAPREDUCE-2324) | Job should fail if a reduce task can't be scheduled anywhere | Major | . | Todd Lipcon | Robert Joseph Evans |
+| [MAPREDUCE-2187](https://issues.apache.org/jira/browse/MAPREDUCE-2187) | map tasks timeout during sorting | Major | . | Gianmarco De Francisci Morales | Anupam Seth |
+| [HDFS-2053](https://issues.apache.org/jira/browse/HDFS-2053) | Bug in INodeDirectory#computeContentSummary warning | Minor | namenode | Michael Noll | Michael Noll |
+| [HDFS-2117](https://issues.apache.org/jira/browse/HDFS-2117) | DiskChecker#mkdirsWithExistsAndPermissionCheck may return true even when the dir is not created | Minor | datanode | Eli Collins | Eli Collins |
+| [MAPREDUCE-2705](https://issues.apache.org/jira/browse/MAPREDUCE-2705) | tasks localized and launched serially by TaskLauncher - causing other tasks to be delayed | Major | tasktracker | Thomas Graves | Thomas Graves |
+| [HDFS-2190](https://issues.apache.org/jira/browse/HDFS-2190) | NN fails to start if it encounters an empty or malformed fstime file | Major | namenode | Aaron T. Myers | Aaron T. Myers |
+| [MAPREDUCE-2489](https://issues.apache.org/jira/browse/MAPREDUCE-2489) | Jobsplits with random hostnames can make the queue unusable | Major | jobtracker | Jeffrey Naisbitt | Jeffrey Naisbitt |
+| [HDFS-2259](https://issues.apache.org/jira/browse/HDFS-2259) | DN web-UI doesn't work with paths that contain html | Minor | datanode | Eli Collins | Eli Collins |
+| [MAPREDUCE-2852](https://issues.apache.org/jira/browse/MAPREDUCE-2852) | Jira for YDH bug 2854624 | Major | tasktracker | Eli Collins | Kihwal Lee |
+| [HADOOP-7539](https://issues.apache.org/jira/browse/HADOOP-7539) | merge hadoop archive goodness from trunk to .20 | Major | . | John George | John George |
+| [HADOOP-7596](https://issues.apache.org/jira/browse/HADOOP-7596) | Enable jsvc to work with Hadoop RPM package | Major | build | Eric Yang | Eric Yang |
+| [HDFS-2309](https://issues.apache.org/jira/browse/HDFS-2309) | TestRenameWhileOpen fails in branch-0.20-security | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HDFS-2320](https://issues.apache.org/jira/browse/HDFS-2320) | Make merged protocol changes from 0.20-append to 0.20-security compatible with previous releases. | Major | datanode, hdfs-client, namenode | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-2610](https://issues.apache.org/jira/browse/MAPREDUCE-2610) | Inconsistent API JobClient.getQueueAclsForCurrentUser | Major | client | Joep Rottinghuis | Joep Rottinghuis |
+| [MAPREDUCE-2915](https://issues.apache.org/jira/browse/MAPREDUCE-2915) | LinuxTaskController does not work when JniBasedUnixGroupsNetgroupMapping or JniBasedUnixGroupsMapping is enabled | Major | task-controller | Kihwal Lee | Kihwal Lee |
+| [HADOOP-7610](https://issues.apache.org/jira/browse/HADOOP-7610) | /etc/profile.d does not exist on Debian | Major | scripts | Eric Yang | Eric Yang |
+| [HADOOP-7599](https://issues.apache.org/jira/browse/HADOOP-7599) | Improve hadoop setup conf script to setup secure Hadoop cluster | Major | scripts | Eric Yang | Eric Yang |
+| [HADOOP-7626](https://issues.apache.org/jira/browse/HADOOP-7626) | Allow overwrite of HADOOP\_CLASSPATH and HADOOP\_OPTS | Major | scripts | Eric Yang | Eric Yang |
+| [MAPREDUCE-2549](https://issues.apache.org/jira/browse/MAPREDUCE-2549) | Potential resource leaks in HadoopServer.java, RunOnHadoopWizard.java and Environment.java | Major | contrib/eclipse-plugin, contrib/streaming | Devaraj K | Devaraj K |
+| [HDFS-2328](https://issues.apache.org/jira/browse/HDFS-2328) | hftp throws NPE if security is not enabled on remote cluster | Critical | . | Daryn Sharp | Owen O'Malley |
+| [HDFS-1779](https://issues.apache.org/jira/browse/HDFS-1779) | After NameNode restart , Clients can not read partial files even after client invokes Sync. | Major | datanode, namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [HDFS-2331](https://issues.apache.org/jira/browse/HDFS-2331) | Hdfs compilation fails | Major | hdfs-client | Abhijit Suresh Shingate | Abhijit Suresh Shingate |
+| [HDFS-2333](https://issues.apache.org/jira/browse/HDFS-2333) | HDFS-2284 introduced 2 findbugs warnings on trunk | Major | . | Ivan Kelly | Tsz Wo Nicholas Sze |
+| [HADOOP-7625](https://issues.apache.org/jira/browse/HADOOP-7625) | TestDelegationToken is failing in 205 | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-7637](https://issues.apache.org/jira/browse/HADOOP-7637) | Fair scheduler configuration file is not bundled in RPM | Major | build | Eric Yang | Eric Yang |
-| [HADOOP-7633](https://issues.apache.org/jira/browse/HADOOP-7633) | log4j.properties should be added to the hadoop conf on deploy | Major | conf | Arpit Gupta | Eric Yang |
| [HADOOP-7631](https://issues.apache.org/jira/browse/HADOOP-7631) | In mapred-site.xml, stream.tmpdir is mapped to ${mapred.temp.dir} which is undeclared. | Major | conf | Ramya Sunil | Eric Yang |
| [HADOOP-7630](https://issues.apache.org/jira/browse/HADOOP-7630) | hadoop-metrics2.properties should have a property \*.period set to a default value foe metrics | Major | conf | Arpit Gupta | Eric Yang |
-| [HADOOP-7626](https://issues.apache.org/jira/browse/HADOOP-7626) | Allow overwrite of HADOOP\_CLASSPATH and HADOOP\_OPTS | Major | scripts | Eric Yang | Eric Yang |
-| [HADOOP-7625](https://issues.apache.org/jira/browse/HADOOP-7625) | TestDelegationToken is failing in 205 | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-7615](https://issues.apache.org/jira/browse/HADOOP-7615) | Binary layout does not put share/hadoop/contrib/\*.jar into the class path | Major | scripts | Eric Yang | Eric Yang |
-| [HADOOP-7610](https://issues.apache.org/jira/browse/HADOOP-7610) | /etc/profile.d does not exist on Debian | Major | scripts | Eric Yang | Eric Yang |
-| [HADOOP-7603](https://issues.apache.org/jira/browse/HADOOP-7603) | Set default hdfs, mapred uid, and hadoop group gid for RPM packages | Major | . | Eric Yang | Eric Yang |
-| [HADOOP-7602](https://issues.apache.org/jira/browse/HADOOP-7602) | wordcount, sort etc on har files fails with NPE | Major | . | John George | John George |
-| [HADOOP-7599](https://issues.apache.org/jira/browse/HADOOP-7599) | Improve hadoop setup conf script to setup secure Hadoop cluster | Major | scripts | Eric Yang | Eric Yang |
-| [HADOOP-7596](https://issues.apache.org/jira/browse/HADOOP-7596) | Enable jsvc to work with Hadoop RPM package | Major | build | Eric Yang | Eric Yang |
-| [HADOOP-7539](https://issues.apache.org/jira/browse/HADOOP-7539) | merge hadoop archive goodness from trunk to .20 | Major | . | John George | John George |
-| [HADOOP-7400](https://issues.apache.org/jira/browse/HADOOP-7400) | HdfsProxyTests fails when the -Dtest.build.dir and -Dbuild.test is set | Major | build | Giridharan Kesavan | Giridharan Kesavan |
-| [HADOOP-6833](https://issues.apache.org/jira/browse/HADOOP-6833) | IPC leaks call parameters when exceptions thrown | Blocker | . | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6722](https://issues.apache.org/jira/browse/HADOOP-6722) | NetUtils.connect should check that it hasn't connected a socket to itself | Major | util | Todd Lipcon | Todd Lipcon |
-| [HDFS-2411](https://issues.apache.org/jira/browse/HDFS-2411) | with webhdfs enabled in secure mode the auth to local mappings are not being respected. | Major | webhdfs | Arpit Gupta | Jitendra Nath Pandey |
-| [HDFS-2408](https://issues.apache.org/jira/browse/HDFS-2408) | DFSClient#getNumCurrentReplicas is package private in 205 but public in branch-0.20-append | Blocker | hdfs-client | stack | stack |
-| [HDFS-2405](https://issues.apache.org/jira/browse/HDFS-2405) | hadoop dfs command with webhdfs fails on secure hadoop | Critical | webhdfs | Arpit Gupta | Jitendra Nath Pandey |
-| [HDFS-2392](https://issues.apache.org/jira/browse/HDFS-2392) | Dist with hftp is failing again | Critical | namenode | Rajit Saha | Daryn Sharp |
+| [HADOOP-7633](https://issues.apache.org/jira/browse/HADOOP-7633) | log4j.properties should be added to the hadoop conf on deploy | Major | conf | Arpit Gupta | Eric Yang |
+| [HADOOP-7644](https://issues.apache.org/jira/browse/HADOOP-7644) | Fix the delegation token tests to use the new style renewers | Blocker | security | Owen O'Malley | Owen O'Malley |
+| [MAPREDUCE-3076](https://issues.apache.org/jira/browse/MAPREDUCE-3076) | TestSleepJob fails | Blocker | test | Arun C Murthy | Arun C Murthy |
+| [HADOOP-7645](https://issues.apache.org/jira/browse/HADOOP-7645) | HTTP auth tests requiring Kerberos infrastructure are not disabled on branch-0.20-security | Blocker | security | Aaron T. Myers | Jitendra Nath Pandey |
+| [HADOOP-7674](https://issues.apache.org/jira/browse/HADOOP-7674) | TestKerberosName fails in 20 branch. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HDFS-2342](https://issues.apache.org/jira/browse/HDFS-2342) | TestSleepJob and TestHdfsProxy broken after HDFS-2284 | Blocker | build | Kihwal Lee | Tsz Wo Nicholas Sze |
+| [HDFS-2325](https://issues.apache.org/jira/browse/HDFS-2325) | Fuse-DFS fails to build on Hadoop 20.203.0 | Blocker | fuse-dfs, libhdfs | Charles Earl | Kihwal Lee |
+| [HADOOP-7679](https://issues.apache.org/jira/browse/HADOOP-7679) | log4j.properties templates does not define mapred.jobsummary.logger | Major | conf | Ramya Sunil | Ramya Sunil |
+| [HDFS-2359](https://issues.apache.org/jira/browse/HDFS-2359) | NPE found in Datanode log while Disk failed during different HDFS operation | Major | datanode | Rajit Saha | Jonathan Eagles |
| [HDFS-2375](https://issues.apache.org/jira/browse/HDFS-2375) | TestFileAppend4 fails in 0.20.205 branch | Blocker | hdfs-client | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-3081](https://issues.apache.org/jira/browse/MAPREDUCE-3081) | Change the name format for hadoop core and vaidya jar to be hadoop-{core/vaidya}-{version}.jar in vaidya.sh | Major | contrib/vaidya | vitthal (Suhas) Gogate | |
| [HDFS-2373](https://issues.apache.org/jira/browse/HDFS-2373) | Commands using webhdfs and hftp print unnecessary debug information on the console with security enabled | Major | webhdfs | Arpit Gupta | Arpit Gupta |
| [HDFS-2368](https://issues.apache.org/jira/browse/HDFS-2368) | defaults created for web keytab and principal, these properties should not have defaults | Major | . | Arpit Gupta | Tsz Wo Nicholas Sze |
| [HDFS-2361](https://issues.apache.org/jira/browse/HDFS-2361) | hftp is broken | Critical | namenode | Rajit Saha | Jitendra Nath Pandey |
-| [HDFS-2359](https://issues.apache.org/jira/browse/HDFS-2359) | NPE found in Datanode log while Disk failed during different HDFS operation | Major | datanode | Rajit Saha | Jonathan Eagles |
-| [HDFS-2358](https://issues.apache.org/jira/browse/HDFS-2358) | NPE when the default filesystem's uri has no authority | Major | namenode | Rajit Saha | Daryn Sharp |
-| [HDFS-2342](https://issues.apache.org/jira/browse/HDFS-2342) | TestSleepJob and TestHdfsProxy broken after HDFS-2284 | Blocker | build | Kihwal Lee | Tsz Wo Nicholas Sze |
-| [HDFS-2333](https://issues.apache.org/jira/browse/HDFS-2333) | HDFS-2284 introduced 2 findbugs warnings on trunk | Major | . | Ivan Kelly | Tsz Wo Nicholas Sze |
-| [HDFS-2331](https://issues.apache.org/jira/browse/HDFS-2331) | Hdfs compilation fails | Major | hdfs-client | Abhijit Suresh Shingate | Abhijit Suresh Shingate |
-| [HDFS-2328](https://issues.apache.org/jira/browse/HDFS-2328) | hftp throws NPE if security is not enabled on remote cluster | Critical | . | Daryn Sharp | Owen O'Malley |
-| [HDFS-2325](https://issues.apache.org/jira/browse/HDFS-2325) | Fuse-DFS fails to build on Hadoop 20.203.0 | Blocker | fuse-dfs, libhdfs | Charles Earl | Kihwal Lee |
-| [HDFS-2320](https://issues.apache.org/jira/browse/HDFS-2320) | Make merged protocol changes from 0.20-append to 0.20-security compatible with previous releases. | Major | datanode, hdfs-client, namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-2309](https://issues.apache.org/jira/browse/HDFS-2309) | TestRenameWhileOpen fails in branch-0.20-security | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HDFS-2300](https://issues.apache.org/jira/browse/HDFS-2300) | TestFileAppend4 and TestMultiThreadedSync fail on 20.append and 20-security. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HDFS-2259](https://issues.apache.org/jira/browse/HDFS-2259) | DN web-UI doesn't work with paths that contain html | Minor | datanode | Eli Collins | Eli Collins |
-| [HDFS-2190](https://issues.apache.org/jira/browse/HDFS-2190) | NN fails to start if it encounters an empty or malformed fstime file | Major | namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-2117](https://issues.apache.org/jira/browse/HDFS-2117) | DiskChecker#mkdirsWithExistsAndPermissionCheck may return true even when the dir is not created | Minor | datanode | Eli Collins | Eli Collins |
-| [HDFS-2053](https://issues.apache.org/jira/browse/HDFS-2053) | Bug in INodeDirectory#computeContentSummary warning | Minor | namenode | Michael Noll | Michael Noll |
-| [HDFS-1836](https://issues.apache.org/jira/browse/HDFS-1836) | Thousand of CLOSE\_WAIT socket | Major | hdfs-client | Dennis Cheung | Bharath Mundlapudi |
-| [HDFS-1779](https://issues.apache.org/jira/browse/HDFS-1779) | After NameNode restart , Clients can not read partial files even after client invokes Sync. | Major | datanode, namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HDFS-1346](https://issues.apache.org/jira/browse/HDFS-1346) | DFSClient receives out of order packet ack | Major | datanode, hdfs-client | Hairong Kuang | Hairong Kuang |
+| [HADOOP-7683](https://issues.apache.org/jira/browse/HADOOP-7683) | hdfs-site.xml template has properties that are not used in 20 | Minor | . | Arpit Gupta | Arpit Gupta |
| [HDFS-1260](https://issues.apache.org/jira/browse/HDFS-1260) | 0.20: Block lost when multiple DNs trying to recover it to different genstamps | Critical | . | Todd Lipcon | Todd Lipcon |
-| [HDFS-1218](https://issues.apache.org/jira/browse/HDFS-1218) | 20 append: Blocks recovered on startup should be treated with lower priority during block synchronization | Critical | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-1207](https://issues.apache.org/jira/browse/HDFS-1207) | 0.20-append: stallReplicationWork should be volatile | Major | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-1204](https://issues.apache.org/jira/browse/HDFS-1204) | 0.20: Lease expiration should recover single files, not entire lease holder | Major | . | Todd Lipcon | sam rash |
-| [HDFS-1202](https://issues.apache.org/jira/browse/HDFS-1202) | DataBlockScanner throws NPE when updated before initialized | Major | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-1197](https://issues.apache.org/jira/browse/HDFS-1197) | Blocks are considered "complete" prematurely after commitBlockSynchronization or DN restart | Major | datanode, hdfs-client, namenode | Todd Lipcon | Todd Lipcon |
| [HDFS-1186](https://issues.apache.org/jira/browse/HDFS-1186) | 0.20: DNs should interrupt writers at start of recovery | Blocker | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-1164](https://issues.apache.org/jira/browse/HDFS-1164) | TestHdfsProxy is failing | Major | contrib/hdfsproxy | Eli Collins | Todd Lipcon |
-| [HDFS-1141](https://issues.apache.org/jira/browse/HDFS-1141) | completeFile does not check lease ownership | Blocker | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-1118](https://issues.apache.org/jira/browse/HDFS-1118) | DFSOutputStream socket leak when cannot connect to DataNode | Major | . | Zheng Shao | Zheng Shao |
-| [HDFS-988](https://issues.apache.org/jira/browse/HDFS-988) | saveNamespace race can corrupt the edits log | Blocker | namenode | dhruba borthakur | Eli Collins |
-| [HDFS-724](https://issues.apache.org/jira/browse/HDFS-724) | Pipeline close hangs if one of the datanode is not responsive. | Blocker | datanode, hdfs-client | Tsz Wo Nicholas Sze | Hairong Kuang |
-| [HDFS-606](https://issues.apache.org/jira/browse/HDFS-606) | ConcurrentModificationException in invalidateCorruptReplicas() | Major | namenode | Konstantin Shvachko | Konstantin Shvachko |
-| [HDFS-142](https://issues.apache.org/jira/browse/HDFS-142) | In 0.20, move blocks being written into a blocksBeingWritten directory | Blocker | . | Raghu Angadi | dhruba borthakur |
+| [HDFS-1218](https://issues.apache.org/jira/browse/HDFS-1218) | 20 append: Blocks recovered on startup should be treated with lower priority during block synchronization | Critical | datanode | Todd Lipcon | Todd Lipcon |
+| [HADOOP-7691](https://issues.apache.org/jira/browse/HADOOP-7691) | hadoop deb pkg should take a diff group id | Major | . | Giridharan Kesavan | Eric Yang |
+| [HADOOP-7603](https://issues.apache.org/jira/browse/HADOOP-7603) | Set default hdfs, mapred uid, and hadoop group gid for RPM packages | Major | . | Eric Yang | Eric Yang |
+| [HADOOP-7658](https://issues.apache.org/jira/browse/HADOOP-7658) | to fix hadoop config template | Major | . | Giridharan Kesavan | Eric Yang |
+| [HADOOP-7684](https://issues.apache.org/jira/browse/HADOOP-7684) | jobhistory server and secondarynamenode should have init.d script | Major | scripts | Eric Yang | Eric Yang |
| [MAPREDUCE-3112](https://issues.apache.org/jira/browse/MAPREDUCE-3112) | Calling hadoop cli inside mapreduce job leads to errors | Major | contrib/streaming | Eric Yang | Eric Yang |
-| [MAPREDUCE-3081](https://issues.apache.org/jira/browse/MAPREDUCE-3081) | Change the name format for hadoop core and vaidya jar to be hadoop-{core/vaidya}-{version}.jar in vaidya.sh | Major | contrib/vaidya | vitthal (Suhas) Gogate | |
-| [MAPREDUCE-3076](https://issues.apache.org/jira/browse/MAPREDUCE-3076) | TestSleepJob fails | Blocker | test | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-2915](https://issues.apache.org/jira/browse/MAPREDUCE-2915) | LinuxTaskController does not work when JniBasedUnixGroupsNetgroupMapping or JniBasedUnixGroupsMapping is enabled | Major | task-controller | Kihwal Lee | Kihwal Lee |
-| [MAPREDUCE-2852](https://issues.apache.org/jira/browse/MAPREDUCE-2852) | Jira for YDH bug 2854624 | Major | tasktracker | Eli Collins | Kihwal Lee |
+| [HADOOP-7715](https://issues.apache.org/jira/browse/HADOOP-7715) | see log4j Error when running mr jobs and certain dfs calls | Major | conf | Arpit Gupta | Eric Yang |
+| [HADOOP-7711](https://issues.apache.org/jira/browse/HADOOP-7711) | hadoop-env.sh generated from templates has duplicate info | Major | conf | Arpit Gupta | Arpit Gupta |
+| [HADOOP-7681](https://issues.apache.org/jira/browse/HADOOP-7681) | log4j.properties is missing properties for security audit and hdfs audit should be changed to info | Minor | conf | Arpit Gupta | Arpit Gupta |
+| [HADOOP-7708](https://issues.apache.org/jira/browse/HADOOP-7708) | config generator does not update the properties file if on exists already | Critical | conf | Arpit Gupta | Eric Yang |
+| [HDFS-2358](https://issues.apache.org/jira/browse/HDFS-2358) | NPE when the default filesystem's uri has no authority | Major | namenode | Rajit Saha | Daryn Sharp |
+| [HDFS-2392](https://issues.apache.org/jira/browse/HDFS-2392) | Dist with hftp is failing again | Critical | namenode | Rajit Saha | Daryn Sharp |
+| [HDFS-2408](https://issues.apache.org/jira/browse/HDFS-2408) | DFSClient#getNumCurrentReplicas is package private in 205 but public in branch-0.20-append | Blocker | hdfs-client | stack | stack |
+| [HADOOP-7721](https://issues.apache.org/jira/browse/HADOOP-7721) | dfs.web.authentication.kerberos.principal expects the full hostname and does not replace \_HOST with the hostname | Major | . | Arpit Gupta | Jitendra Nath Pandey |
+| [HDFS-2405](https://issues.apache.org/jira/browse/HDFS-2405) | hadoop dfs command with webhdfs fails on secure hadoop | Critical | webhdfs | Arpit Gupta | Jitendra Nath Pandey |
+| [HADOOP-7724](https://issues.apache.org/jira/browse/HADOOP-7724) | hadoop-setup-conf.sh should put proxy user info into the core-site.xml | Major | . | Giridharan Kesavan | Arpit Gupta |
| [MAPREDUCE-2764](https://issues.apache.org/jira/browse/MAPREDUCE-2764) | Fix renewal of dfs delegation tokens | Major | . | Daryn Sharp | Owen O'Malley |
-| [MAPREDUCE-2705](https://issues.apache.org/jira/browse/MAPREDUCE-2705) | tasks localized and launched serially by TaskLauncher - causing other tasks to be delayed | Major | tasktracker | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-2650](https://issues.apache.org/jira/browse/MAPREDUCE-2650) | back-port MAPREDUCE-2238 to 0.20-security | Major | . | Sherry Chen | Sherry Chen |
-| [MAPREDUCE-2610](https://issues.apache.org/jira/browse/MAPREDUCE-2610) | Inconsistent API JobClient.getQueueAclsForCurrentUser | Major | client | Joep Rottinghuis | Joep Rottinghuis |
-| [MAPREDUCE-2549](https://issues.apache.org/jira/browse/MAPREDUCE-2549) | Potential resource leaks in HadoopServer.java, RunOnHadoopWizard.java and Environment.java | Major | contrib/eclipse-plugin, contrib/streaming | Devaraj K | Devaraj K |
-| [MAPREDUCE-2489](https://issues.apache.org/jira/browse/MAPREDUCE-2489) | Jobsplits with random hostnames can make the queue unusable | Major | jobtracker | Jeffrey Naisbitt | Jeffrey Naisbitt |
-| [MAPREDUCE-2324](https://issues.apache.org/jira/browse/MAPREDUCE-2324) | Job should fail if a reduce task can't be scheduled anywhere | Major | . | Todd Lipcon | Robert Joseph Evans |
-| [MAPREDUCE-2187](https://issues.apache.org/jira/browse/MAPREDUCE-2187) | map tasks timeout during sorting | Major | . | Gianmarco De Francisci Morales | Anupam Seth |
+| [HADOOP-7602](https://issues.apache.org/jira/browse/HADOOP-7602) | wordcount, sort etc on har files fails with NPE | Major | . | John George | John George |
+| [HADOOP-7649](https://issues.apache.org/jira/browse/HADOOP-7649) | TestMapredGroupMappingServiceRefresh and TestRefreshUserMappings fail after HADOOP-7625 | Blocker | security, test | Kihwal Lee | Jitendra Nath Pandey |
+| [HDFS-2411](https://issues.apache.org/jira/browse/HDFS-2411) | with webhdfs enabled in secure mode the auth to local mappings are not being respected. | Major | webhdfs | Arpit Gupta | Jitendra Nath Pandey |
+| [HDFS-1197](https://issues.apache.org/jira/browse/HDFS-1197) | Blocks are considered "complete" prematurely after commitBlockSynchronization or DN restart | Major | datanode, hdfs-client, namenode | Todd Lipcon | Todd Lipcon |
+| [HADOOP-7615](https://issues.apache.org/jira/browse/HADOOP-7615) | Binary layout does not put share/hadoop/contrib/\*.jar into the class path | Major | scripts | Eric Yang | Eric Yang |
+| [HDFS-2300](https://issues.apache.org/jira/browse/HDFS-2300) | TestFileAppend4 and TestMultiThreadedSync fail on 20.append and 20-security. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
### TESTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HDFS-1252](https://issues.apache.org/jira/browse/HDFS-1252) | TestDFSConcurrentFileOperations broken in 0.20-appendj | Major | test | Todd Lipcon | Todd Lipcon |
| [HDFS-1242](https://issues.apache.org/jira/browse/HDFS-1242) | 0.20 append: Add test for appendFile() race solved in HDFS-142 | Major | . | Todd Lipcon | Todd Lipcon |
+| [HDFS-1252](https://issues.apache.org/jira/browse/HDFS-1252) | TestDFSConcurrentFileOperations broken in 0.20-appendj | Major | test | Todd Lipcon | Todd Lipcon |
### SUB-TASKS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HDFS-2404](https://issues.apache.org/jira/browse/HDFS-2404) | webhdfs liststatus json response is not correct | Major | webhdfs | Arpit Gupta | Suresh Srinivas |
-| [HDFS-2403](https://issues.apache.org/jira/browse/HDFS-2403) | The renewer in NamenodeWebHdfsMethods.generateDelegationToken(..) is not used | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2395](https://issues.apache.org/jira/browse/HDFS-2395) | webhdfs api's should return a root element in the json response | Critical | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
-| [HDFS-2385](https://issues.apache.org/jira/browse/HDFS-2385) | Support delegation token renewal in webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2366](https://issues.apache.org/jira/browse/HDFS-2366) | webhdfs throws a npe when ugi is null from getDelegationToken | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
-| [HDFS-2356](https://issues.apache.org/jira/browse/HDFS-2356) | webhdfs: support case insensitive query parameter names | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2348](https://issues.apache.org/jira/browse/HDFS-2348) | Support getContentSummary and getFileChecksum in webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2340](https://issues.apache.org/jira/browse/HDFS-2340) | Support getFileBlockLocations and getDelegationToken in webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-561](https://issues.apache.org/jira/browse/HDFS-561) | Fix write pipeline READ\_TIMEOUT | Major | datanode, hdfs-client | Kan Zhang | Kan Zhang |
+| [HDFS-1057](https://issues.apache.org/jira/browse/HDFS-1057) | Concurrent readers hit ChecksumExceptions if following a writer to very end of file | Blocker | datanode | Todd Lipcon | sam rash |
+| [HDFS-2284](https://issues.apache.org/jira/browse/HDFS-2284) | Write Http access to HDFS | Major | . | Sanjay Radia | Tsz Wo Nicholas Sze |
+| [HDFS-2317](https://issues.apache.org/jira/browse/HDFS-2317) | Read access to HDFS using HTTP REST | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HDFS-2338](https://issues.apache.org/jira/browse/HDFS-2338) | Configuration option to enable/disable webhdfs. | Major | webhdfs | Jitendra Nath Pandey | Jitendra Nath Pandey |
| [HDFS-2318](https://issues.apache.org/jira/browse/HDFS-2318) | Provide authentication to webhdfs using SPNEGO | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2317](https://issues.apache.org/jira/browse/HDFS-2317) | Read access to HDFS using HTTP REST | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2284](https://issues.apache.org/jira/browse/HDFS-2284) | Write Http access to HDFS | Major | . | Sanjay Radia | Tsz Wo Nicholas Sze |
-| [HDFS-1057](https://issues.apache.org/jira/browse/HDFS-1057) | Concurrent readers hit ChecksumExceptions if following a writer to very end of file | Blocker | datanode | Todd Lipcon | sam rash |
-| [HDFS-561](https://issues.apache.org/jira/browse/HDFS-561) | Fix write pipeline READ\_TIMEOUT | Major | datanode, hdfs-client | Kan Zhang | Kan Zhang |
+| [HDFS-2340](https://issues.apache.org/jira/browse/HDFS-2340) | Support getFileBlockLocations and getDelegationToken in webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [MAPREDUCE-2928](https://issues.apache.org/jira/browse/MAPREDUCE-2928) | MR-2413 improvements | Major | tasktracker | Eli Collins | Eli Collins |
+| [HDFS-2356](https://issues.apache.org/jira/browse/HDFS-2356) | webhdfs: support case insensitive query parameter names | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-2366](https://issues.apache.org/jira/browse/HDFS-2366) | webhdfs throws a npe when ugi is null from getDelegationToken | Major | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
+| [HDFS-2348](https://issues.apache.org/jira/browse/HDFS-2348) | Support getContentSummary and getFileChecksum in webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-2395](https://issues.apache.org/jira/browse/HDFS-2395) | webhdfs api's should return a root element in the json response | Critical | webhdfs | Arpit Gupta | Tsz Wo Nicholas Sze |
+| [HDFS-2403](https://issues.apache.org/jira/browse/HDFS-2403) | The renewer in NamenodeWebHdfsMethods.generateDelegationToken(..) is not used | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-2404](https://issues.apache.org/jira/browse/HDFS-2404) | webhdfs liststatus json response is not correct | Major | webhdfs | Arpit Gupta | Suresh Srinivas |
+| [HDFS-2385](https://issues.apache.org/jira/browse/HDFS-2385) | Support delegation token renewal in webhdfs | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [MAPREDUCE-2780](https://issues.apache.org/jira/browse/MAPREDUCE-2780) | Standardize the value of token service | Major | . | Daryn Sharp | Daryn Sharp |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.205.0/RELEASENOTES.0.20.205.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.205.0/RELEASENOTES.0.20.205.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.205.0/RELEASENOTES.0.20.205.0.md
index c70b653..35df581 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.205.0/RELEASENOTES.0.20.205.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.205.0/RELEASENOTES.0.20.205.0.md
@@ -23,73 +23,74 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-7724](https://issues.apache.org/jira/browse/HADOOP-7724) | *Major* | **hadoop-setup-conf.sh should put proxy user info into the core-site.xml**
+* [HDFS-630](https://issues.apache.org/jira/browse/HDFS-630) | *Major* | **In DFSOutputStream.nextBlockOutputStream(), the client can exclude specific datanodes when locating the next block.**
-Fixed hadoop-setup-conf.sh to put proxy user in core-site.xml. (Arpit Gupta via Eric Yang)
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-7720](https://issues.apache.org/jira/browse/HADOOP-7720) | *Major* | **improve the hadoop-setup-conf.sh to read in the hbase user and setup the configs**
+* [HDFS-1554](https://issues.apache.org/jira/browse/HDFS-1554) | *Major* | **Append 0.20: New semantics for recoverLease**
-Added parameter for HBase user to setup config script. (Arpit Gupta via Eric Yang)
+Change recoverLease API to return if the file is closed or not. It also change the semantics of recoverLease to start lease recovery immediately.
---
-* [HADOOP-7715](https://issues.apache.org/jira/browse/HADOOP-7715) | *Major* | **see log4j Error when running mr jobs and certain dfs calls**
+* [HDFS-2202](https://issues.apache.org/jira/browse/HDFS-2202) | *Major* | **Changes to balancer bandwidth should not require datanode restart.**
-Removed unnecessary security logger configuration. (Eric Yang)
+New dfsadmin command added: [-setBalancerBandwidth \<bandwidth\>] where bandwidth is max network bandwidth in bytes per second that the balancer is allowed to use on each datanode during balacing.
+
+This is an incompatible change in 0.23. The versions of ClientProtocol and DatanodeProtocol are changed.
---
-* [HADOOP-7711](https://issues.apache.org/jira/browse/HADOOP-7711) | *Major* | **hadoop-env.sh generated from templates has duplicate info**
+* [MAPREDUCE-2494](https://issues.apache.org/jira/browse/MAPREDUCE-2494) | *Major* | **Make the distributed cache delete entires using LRU priority**
-Fixed recursive sourcing of HADOOP\_OPTS environment variables (Arpit Gupta via Eric Yang)
+Added config option mapreduce.tasktracker.cache.local.keep.pct to the TaskTracker. It is the target percentage of the local distributed cache that should be kept in between garbage collection runs. In practice it will delete unused distributed cache entries in LRU order until the size of the cache is less than mapreduce.tasktracker.cache.local.keep.pct of the maximum cache size. This is a floating point value between 0.0 and 1.0. The default is 0.95.
---
-* [HADOOP-7708](https://issues.apache.org/jira/browse/HADOOP-7708) | *Critical* | **config generator does not update the properties file if on exists already**
+* [MAPREDUCE-2187](https://issues.apache.org/jira/browse/MAPREDUCE-2187) | *Major* | **map tasks timeout during sorting**
-Fixed hadoop-setup-conf.sh to handle config file consistently. (Eric Yang)
+I just committed this. Thanks Anupam!
---
-* [HADOOP-7707](https://issues.apache.org/jira/browse/HADOOP-7707) | *Major* | **improve config generator to allow users to specify proxy user, turn append on or off, turn webhdfs on or off**
+* [HADOOP-7119](https://issues.apache.org/jira/browse/HADOOP-7119) | *Major* | **add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles**
-Added toggle for dfs.support.append, webhdfs and hadoop proxy user to setup config script. (Arpit Gupta via Eric Yang)
+Adding support for Kerberos HTTP SPNEGO authentication to the Hadoop web-consoles
---
-* [HADOOP-7691](https://issues.apache.org/jira/browse/HADOOP-7691) | *Major* | **hadoop deb pkg should take a diff group id**
+* [HDFS-2338](https://issues.apache.org/jira/browse/HDFS-2338) | *Major* | **Configuration option to enable/disable webhdfs.**
-Fixed conflict uid for install packages. (Eric Yang)
+Added a conf property dfs.webhdfs.enabled for enabling/disabling webhdfs.
---
-* [HADOOP-7684](https://issues.apache.org/jira/browse/HADOOP-7684) | *Major* | **jobhistory server and secondarynamenode should have init.d script**
+* [HDFS-2318](https://issues.apache.org/jira/browse/HDFS-2318) | *Major* | **Provide authentication to webhdfs using SPNEGO**
-Added init.d script for jobhistory server and secondary namenode. (Eric Yang)
+Added two new conf properties dfs.web.authentication.kerberos.principal and dfs.web.authentication.kerberos.keytab for the SPNEGO servlet filter.
---
-* [HADOOP-7681](https://issues.apache.org/jira/browse/HADOOP-7681) | *Minor* | **log4j.properties is missing properties for security audit and hdfs audit should be changed to info**
+* [MAPREDUCE-3081](https://issues.apache.org/jira/browse/MAPREDUCE-3081) | *Major* | **Change the name format for hadoop core and vaidya jar to be hadoop-{core/vaidya}-{version}.jar in vaidya.sh**
-HADOOP-7681. Fixed security and hdfs audit log4j properties
-(Arpit Gupta via Eric Yang)
+contrib/vaidya/bin/vaidya.sh script fixed to use appropriate jars and classpath
---
-* [HADOOP-7655](https://issues.apache.org/jira/browse/HADOOP-7655) | *Major* | **provide a small validation script that smoke tests the installed cluster**
+* [HADOOP-7691](https://issues.apache.org/jira/browse/HADOOP-7691) | *Major* | **hadoop deb pkg should take a diff group id**
-Committed to trunk and v23, since code reviewed by Eric.
+Fixed conflict uid for install packages. (Eric Yang)
---
@@ -101,95 +102,94 @@ Set hdfs uid, mapred uid, and hadoop gid to fixed numbers (201, 202, and 123, re
---
-* [HADOOP-7119](https://issues.apache.org/jira/browse/HADOOP-7119) | *Major* | **add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles**
+* [HADOOP-7684](https://issues.apache.org/jira/browse/HADOOP-7684) | *Major* | **jobhistory server and secondarynamenode should have init.d script**
-Adding support for Kerberos HTTP SPNEGO authentication to the Hadoop web-consoles
+Added init.d script for jobhistory server and secondary namenode. (Eric Yang)
---
-* [HDFS-2358](https://issues.apache.org/jira/browse/HDFS-2358) | *Major* | **NPE when the default filesystem's uri has no authority**
+* [MAPREDUCE-3112](https://issues.apache.org/jira/browse/MAPREDUCE-3112) | *Major* | **Calling hadoop cli inside mapreduce job leads to errors**
-Give meaningful error message instead of NPE.
+Removed inheritance of certain server environment variables (HADOOP\_OPTS and HADOOP\_ROOT\_LOGGER) in task attempt process.
---
-* [HDFS-2338](https://issues.apache.org/jira/browse/HDFS-2338) | *Major* | **Configuration option to enable/disable webhdfs.**
+* [HADOOP-7715](https://issues.apache.org/jira/browse/HADOOP-7715) | *Major* | **see log4j Error when running mr jobs and certain dfs calls**
-Added a conf property dfs.webhdfs.enabled for enabling/disabling webhdfs.
+Removed unnecessary security logger configuration. (Eric Yang)
---
-* [HDFS-2318](https://issues.apache.org/jira/browse/HDFS-2318) | *Major* | **Provide authentication to webhdfs using SPNEGO**
+* [HADOOP-7711](https://issues.apache.org/jira/browse/HADOOP-7711) | *Major* | **hadoop-env.sh generated from templates has duplicate info**
-Added two new conf properties dfs.web.authentication.kerberos.principal and dfs.web.authentication.kerberos.keytab for the SPNEGO servlet filter.
+Fixed recursive sourcing of HADOOP\_OPTS environment variables (Arpit Gupta via Eric Yang)
---
-* [HDFS-2202](https://issues.apache.org/jira/browse/HDFS-2202) | *Major* | **Changes to balancer bandwidth should not require datanode restart.**
-
-New dfsadmin command added: [-setBalancerBandwidth \<bandwidth\>] where bandwidth is max network bandwidth in bytes per second that the balancer is allowed to use on each datanode during balacing.
+* [HADOOP-7681](https://issues.apache.org/jira/browse/HADOOP-7681) | *Minor* | **log4j.properties is missing properties for security audit and hdfs audit should be changed to info**
-This is an incompatible change in 0.23. The versions of ClientProtocol and DatanodeProtocol are changed.
+HADOOP-7681. Fixed security and hdfs audit log4j properties
+(Arpit Gupta via Eric Yang)
---
-* [HDFS-1554](https://issues.apache.org/jira/browse/HDFS-1554) | *Major* | **Append 0.20: New semantics for recoverLease**
+* [HADOOP-7708](https://issues.apache.org/jira/browse/HADOOP-7708) | *Critical* | **config generator does not update the properties file if on exists already**
-Change recoverLease API to return if the file is closed or not. It also change the semantics of recoverLease to start lease recovery immediately.
+Fixed hadoop-setup-conf.sh to handle config file consistently. (Eric Yang)
---
-* [HDFS-630](https://issues.apache.org/jira/browse/HDFS-630) | *Major* | **In DFSOutputStream.nextBlockOutputStream(), the client can exclude specific datanodes when locating the next block.**
+* [HADOOP-7707](https://issues.apache.org/jira/browse/HADOOP-7707) | *Major* | **improve config generator to allow users to specify proxy user, turn append on or off, turn webhdfs on or off**
-**WARNING: No release note provided for this incompatible change.**
+Added toggle for dfs.support.append, webhdfs and hadoop proxy user to setup config script. (Arpit Gupta via Eric Yang)
---
-* [MAPREDUCE-3112](https://issues.apache.org/jira/browse/MAPREDUCE-3112) | *Major* | **Calling hadoop cli inside mapreduce job leads to errors**
+* [HADOOP-7720](https://issues.apache.org/jira/browse/HADOOP-7720) | *Major* | **improve the hadoop-setup-conf.sh to read in the hbase user and setup the configs**
-Removed inheritance of certain server environment variables (HADOOP\_OPTS and HADOOP\_ROOT\_LOGGER) in task attempt process.
+Added parameter for HBase user to setup config script. (Arpit Gupta via Eric Yang)
---
-* [MAPREDUCE-3081](https://issues.apache.org/jira/browse/MAPREDUCE-3081) | *Major* | **Change the name format for hadoop core and vaidya jar to be hadoop-{core/vaidya}-{version}.jar in vaidya.sh**
+* [MAPREDUCE-2777](https://issues.apache.org/jira/browse/MAPREDUCE-2777) | *Major* | **Backport MAPREDUCE-220 to Hadoop 20 security branch**
-contrib/vaidya/bin/vaidya.sh script fixed to use appropriate jars and classpath
+Adds cumulative cpu usage and total heap usage to task counters. This is a backport of MAPREDUCE-220 and MAPREDUCE-2469.
---
-* [MAPREDUCE-2777](https://issues.apache.org/jira/browse/MAPREDUCE-2777) | *Major* | **Backport MAPREDUCE-220 to Hadoop 20 security branch**
+* [HDFS-2358](https://issues.apache.org/jira/browse/HDFS-2358) | *Major* | **NPE when the default filesystem's uri has no authority**
-Adds cumulative cpu usage and total heap usage to task counters. This is a backport of MAPREDUCE-220 and MAPREDUCE-2469.
+Give meaningful error message instead of NPE.
---
-* [MAPREDUCE-2764](https://issues.apache.org/jira/browse/MAPREDUCE-2764) | *Major* | **Fix renewal of dfs delegation tokens**
+* [HADOOP-7724](https://issues.apache.org/jira/browse/HADOOP-7724) | *Major* | **hadoop-setup-conf.sh should put proxy user info into the core-site.xml**
-Generalizes token renewal and canceling to a common interface and provides a plugin interface for adding renewers for new kinds of tokens. Hftp changed to store the tokens as HFTP and renew them over http.
+Fixed hadoop-setup-conf.sh to put proxy user in core-site.xml. (Arpit Gupta via Eric Yang)
---
-* [MAPREDUCE-2494](https://issues.apache.org/jira/browse/MAPREDUCE-2494) | *Major* | **Make the distributed cache delete entires using LRU priority**
+* [MAPREDUCE-2764](https://issues.apache.org/jira/browse/MAPREDUCE-2764) | *Major* | **Fix renewal of dfs delegation tokens**
-Added config option mapreduce.tasktracker.cache.local.keep.pct to the TaskTracker. It is the target percentage of the local distributed cache that should be kept in between garbage collection runs. In practice it will delete unused distributed cache entries in LRU order until the size of the cache is less than mapreduce.tasktracker.cache.local.keep.pct of the maximum cache size. This is a floating point value between 0.0 and 1.0. The default is 0.95.
+Generalizes token renewal and canceling to a common interface and provides a plugin interface for adding renewers for new kinds of tokens. Hftp changed to store the tokens as HFTP and renew them over http.
---
-* [MAPREDUCE-2187](https://issues.apache.org/jira/browse/MAPREDUCE-2187) | *Major* | **map tasks timeout during sorting**
+* [HADOOP-7655](https://issues.apache.org/jira/browse/HADOOP-7655) | *Major* | **provide a small validation script that smoke tests the installed cluster**
-I just committed this. Thanks Anupam!
+Committed to trunk and v23, since code reviewed by Eric.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.3/CHANGES.0.20.3.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.3/CHANGES.0.20.3.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.3/CHANGES.0.20.3.md
index 3a5e749..82644f4 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.3/CHANGES.0.20.3.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.3/CHANGES.0.20.3.md
@@ -18,72 +18,60 @@
-->
# Apache Hadoop Changelog
-## Release 0.20.3 - Unreleased (as of 2016-03-04)
+## Release 0.20.3 - Unreleased (as of 2017-08-28)
### INCOMPATIBLE CHANGES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-6701](https://issues.apache.org/jira/browse/HADOOP-6701) | Incorrect exit codes for "dfs -chown", "dfs -chgrp" | Minor | fs | Ravi Phulari | Ravi Phulari |
| [HADOOP-6382](https://issues.apache.org/jira/browse/HADOOP-6382) | publish hadoop jars to apache mvn repo. | Major | build | Giridharan Kesavan | Giridharan Kesavan |
| [HDFS-132](https://issues.apache.org/jira/browse/HDFS-132) | Namenode in Safemode reports to Simon non-zero number of deleted files during startup | Minor | namenode | Hairong Kuang | Suresh Srinivas |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-6701](https://issues.apache.org/jira/browse/HADOOP-6701) | Incorrect exit codes for "dfs -chown", "dfs -chgrp" | Minor | fs | Ravi Phulari | Ravi Phulari |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7240](https://issues.apache.org/jira/browse/HADOOP-7240) | Update eclipse .classpath template | Major | . | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-6882](https://issues.apache.org/jira/browse/HADOOP-6882) | Update the patch level of Jetty | Major | . | Owen O'Malley | Owen O'Malley |
-| [HDFS-1013](https://issues.apache.org/jira/browse/HDFS-1013) | Miscellaneous improvements to HTML markup for web UIs | Minor | . | Todd Lipcon | Eugene Koontz |
| [MAPREDUCE-1832](https://issues.apache.org/jira/browse/MAPREDUCE-1832) | Support for file sizes less than 1MB in DFSIO benchmark. | Major | benchmarks | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-7240](https://issues.apache.org/jira/browse/HADOOP-7240) | Update eclipse .classpath template | Major | . | Aaron T. Myers | Aaron T. Myers |
| [MAPREDUCE-1734](https://issues.apache.org/jira/browse/MAPREDUCE-1734) | Un-deprecate the old MapReduce API in the 0.20 branch | Blocker | documentation | Tom White | Todd Lipcon |
+| [HDFS-1013](https://issues.apache.org/jira/browse/HDFS-1013) | Miscellaneous improvements to HTML markup for web UIs | Minor | . | Todd Lipcon | Eugene Koontz |
+| [HADOOP-6882](https://issues.apache.org/jira/browse/HADOOP-6882) | Update the patch level of Jetty | Major | . | Owen O'Malley | Owen O'Malley |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7116](https://issues.apache.org/jira/browse/HADOOP-7116) | raise contrib junit test jvm memory size to 512mb | Major | test | Owen O'Malley | Owen O'Malley |
-| [HADOOP-6928](https://issues.apache.org/jira/browse/HADOOP-6928) | Fix BooleanWritable comparator in 0.20 | Major | io | Owen O'Malley | Johannes Zillmann |
-| [HADOOP-6923](https://issues.apache.org/jira/browse/HADOOP-6923) | Native Libraries do not load if a different platform signature is returned from org.apache.hadoop.util.PlatformName | Major | native | Stephen Watt | Stephen Watt |
+| [HDFS-15](https://issues.apache.org/jira/browse/HDFS-15) | Rack replication policy can be violated for over replicated blocks | Critical | . | Hairong Kuang | Jitendra Nath Pandey |
+| [MAPREDUCE-1522](https://issues.apache.org/jira/browse/MAPREDUCE-1522) | FileInputFormat may change the file system of an input path | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-1407](https://issues.apache.org/jira/browse/MAPREDUCE-1407) | Invalid example in the documentation of org.apache.hadoop.mapreduce.{Mapper,Reducer} | Trivial | documentation | Benoit Sigoure | Benoit Sigoure |
+| [HDFS-955](https://issues.apache.org/jira/browse/HDFS-955) | FSImage.saveFSImage can lose edits | Blocker | namenode | Todd Lipcon | Konstantin Shvachko |
+| [HDFS-1041](https://issues.apache.org/jira/browse/HDFS-1041) | DFSClient does not retry in getFileChecksum(..) | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-909](https://issues.apache.org/jira/browse/HDFS-909) | Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log | Blocker | namenode | Cosmin Lehene | Todd Lipcon |
+| [HADOOP-6702](https://issues.apache.org/jira/browse/HADOOP-6702) | Incorrect exit codes for "dfs -chown", "dfs -chgrp" when input is given in wildcard format. | Minor | fs | Ravi Phulari | Ravi Phulari |
+| [HADOOP-6760](https://issues.apache.org/jira/browse/HADOOP-6760) | WebServer shouldn't increase port number in case of negative port setting caused by Jetty's race | Major | . | Konstantin Boudnik | Konstantin Boudnik |
+| [MAPREDUCE-1372](https://issues.apache.org/jira/browse/MAPREDUCE-1372) | ConcurrentModificationException in JobInProgress | Blocker | jobtracker | Amareshwari Sriramadasu | Dick King |
+| [MAPREDUCE-118](https://issues.apache.org/jira/browse/MAPREDUCE-118) | Job.getJobID() will always return null | Blocker | client | Amar Kamat | Amareshwari Sriramadasu |
+| [MAPREDUCE-1880](https://issues.apache.org/jira/browse/MAPREDUCE-1880) | "java.lang.ArithmeticException: Non-terminating decimal expansion; no exact representable decimal result." while running "hadoop jar hadoop-0.20.1+169.89-examples.jar pi 4 30" | Minor | examples | Victor Pakhomov | Tsz Wo Nicholas Sze |
+| [HDFS-1258](https://issues.apache.org/jira/browse/HDFS-1258) | Clearing namespace quota on "/" corrupts FS image | Blocker | namenode | Aaron T. Myers | Aaron T. Myers |
| [HADOOP-6881](https://issues.apache.org/jira/browse/HADOOP-6881) | The efficient comparators aren't always used except for BytesWritable and Text | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-6833](https://issues.apache.org/jira/browse/HADOOP-6833) | IPC leaks call parameters when exceptions thrown | Blocker | . | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6760](https://issues.apache.org/jira/browse/HADOOP-6760) | WebServer shouldn't increase port number in case of negative port setting caused by Jetty's race | Major | . | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-6724](https://issues.apache.org/jira/browse/HADOOP-6724) | IPC doesn't properly handle IOEs thrown by socket factory | Major | ipc | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6702](https://issues.apache.org/jira/browse/HADOOP-6702) | Incorrect exit codes for "dfs -chown", "dfs -chgrp" when input is given in wildcard format. | Minor | fs | Ravi Phulari | Ravi Phulari |
-| [HDFS-1836](https://issues.apache.org/jira/browse/HDFS-1836) | Thousand of CLOSE\_WAIT socket | Major | hdfs-client | Dennis Cheung | Bharath Mundlapudi |
-| [HDFS-1543](https://issues.apache.org/jira/browse/HDFS-1543) | Reduce dev. cycle time by moving system testing artifacts from default build and push to maven for HDFS | Major | . | Arun C Murthy | Luke Lu |
-| [HDFS-1406](https://issues.apache.org/jira/browse/HDFS-1406) | TestCLI fails on Ubuntu with default /etc/hosts | Minor | . | Todd Lipcon | Konstantin Boudnik |
+| [HADOOP-6928](https://issues.apache.org/jira/browse/HADOOP-6928) | Fix BooleanWritable comparator in 0.20 | Major | io | Owen O'Malley | Johannes Zillmann |
| [HDFS-1404](https://issues.apache.org/jira/browse/HDFS-1404) | TestNodeCount logic incorrect in branch-0.20 | Minor | namenode, test | Todd Lipcon | Todd Lipcon |
-| [HDFS-1377](https://issues.apache.org/jira/browse/HDFS-1377) | Quota bug for partial blocks allows quotas to be violated | Blocker | namenode | Eli Collins | Eli Collins |
-| [HDFS-1258](https://issues.apache.org/jira/browse/HDFS-1258) | Clearing namespace quota on "/" corrupts FS image | Blocker | namenode | Aaron T. Myers | Aaron T. Myers |
+| [MAPREDUCE-1280](https://issues.apache.org/jira/browse/MAPREDUCE-1280) | Eclipse Plugin does not work with Eclipse Ganymede (3.4) | Major | . | Aaron Kimball | Alex Kozlov |
+| [HADOOP-6724](https://issues.apache.org/jira/browse/HADOOP-6724) | IPC doesn't properly handle IOEs thrown by socket factory | Major | ipc | Todd Lipcon | Todd Lipcon |
| [HDFS-1240](https://issues.apache.org/jira/browse/HDFS-1240) | TestDFSShell failing in branch-20 | Critical | test | Todd Lipcon | Todd Lipcon |
-| [HDFS-1041](https://issues.apache.org/jira/browse/HDFS-1041) | DFSClient does not retry in getFileChecksum(..) | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-955](https://issues.apache.org/jira/browse/HDFS-955) | FSImage.saveFSImage can lose edits | Blocker | namenode | Todd Lipcon | Konstantin Shvachko |
-| [HDFS-909](https://issues.apache.org/jira/browse/HDFS-909) | Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log | Blocker | namenode | Cosmin Lehene | Todd Lipcon |
-| [HDFS-908](https://issues.apache.org/jira/browse/HDFS-908) | TestDistributedFileSystem fails with Wrong FS on weird hosts | Minor | test | Todd Lipcon | Todd Lipcon |
| [HDFS-727](https://issues.apache.org/jira/browse/HDFS-727) | bug setting block size hdfsOpenFile | Blocker | libhdfs | Eli Collins | Eli Collins |
-| [HDFS-15](https://issues.apache.org/jira/browse/HDFS-15) | Rack replication policy can be violated for over replicated blocks | Critical | . | Hairong Kuang | Jitendra Nath Pandey |
+| [HDFS-908](https://issues.apache.org/jira/browse/HDFS-908) | TestDistributedFileSystem fails with Wrong FS on weird hosts | Minor | test | Todd Lipcon | Todd Lipcon |
+| [HDFS-1377](https://issues.apache.org/jira/browse/HDFS-1377) | Quota bug for partial blocks allows quotas to be violated | Blocker | namenode | Eli Collins | Eli Collins |
+| [HDFS-1406](https://issues.apache.org/jira/browse/HDFS-1406) | TestCLI fails on Ubuntu with default /etc/hosts | Minor | . | Todd Lipcon | Konstantin Boudnik |
| [MAPREDUCE-2262](https://issues.apache.org/jira/browse/MAPREDUCE-2262) | Capacity Scheduler unit tests fail with class not found | Major | capacity-sched | Owen O'Malley | Owen O'Malley |
-| [MAPREDUCE-1880](https://issues.apache.org/jira/browse/MAPREDUCE-1880) | "java.lang.ArithmeticException: Non-terminating decimal expansion; no exact representable decimal result." while running "hadoop jar hadoop-0.20.1+169.89-examples.jar pi 4 30" | Minor | examples | Victor Pakhomov | Tsz Wo Nicholas Sze |
-| [MAPREDUCE-1522](https://issues.apache.org/jira/browse/MAPREDUCE-1522) | FileInputFormat may change the file system of an input path | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [MAPREDUCE-1407](https://issues.apache.org/jira/browse/MAPREDUCE-1407) | Invalid example in the documentation of org.apache.hadoop.mapreduce.{Mapper,Reducer} | Trivial | documentation | Benoit Sigoure | Benoit Sigoure |
-| [MAPREDUCE-1372](https://issues.apache.org/jira/browse/MAPREDUCE-1372) | ConcurrentModificationException in JobInProgress | Blocker | jobtracker | Amareshwari Sriramadasu | Dick King |
-| [MAPREDUCE-1280](https://issues.apache.org/jira/browse/MAPREDUCE-1280) | Eclipse Plugin does not work with Eclipse Ganymede (3.4) | Major | . | Aaron Kimball | Alex Kozlov |
-| [MAPREDUCE-118](https://issues.apache.org/jira/browse/MAPREDUCE-118) | Job.getJobID() will always return null | Blocker | client | Amar Kamat | Amareshwari Sriramadasu |
+| [HADOOP-6923](https://issues.apache.org/jira/browse/HADOOP-6923) | Native Libraries do not load if a different platform signature is returned from org.apache.hadoop.util.PlatformName | Major | native | Stephen Watt | Stephen Watt |
+| [HDFS-1543](https://issues.apache.org/jira/browse/HDFS-1543) | Reduce dev. cycle time by moving system testing artifacts from default build and push to maven for HDFS | Major | . | Arun C Murthy | Luke Lu |
+| [HDFS-1836](https://issues.apache.org/jira/browse/HDFS-1836) | Thousand of CLOSE\_WAIT socket | Major | hdfs-client | Dennis Cheung | Bharath Mundlapudi |
+| [HADOOP-7116](https://issues.apache.org/jira/browse/HADOOP-7116) | raise contrib junit test jvm memory size to 512mb | Major | test | Owen O'Malley | Owen O'Malley |
### TESTS:
@@ -93,17 +81,11 @@
| [HADOOP-6637](https://issues.apache.org/jira/browse/HADOOP-6637) | Benchmark overhead of RPC session establishment | Major | benchmarks | Konstantin Shvachko | Konstantin Shvachko |
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### OTHER:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7372](https://issues.apache.org/jira/browse/HADOOP-7372) | Remove ref of 20.3 release from branch-0.20 CHANGES.txt | Major | documentation | Eli Collins | Eli Collins |
| [HDFS-1286](https://issues.apache.org/jira/browse/HDFS-1286) | Dry entropy pool on Hudson boxes causing test timeouts | Major | test | Todd Lipcon | Konstantin Boudnik |
+| [HADOOP-7372](https://issues.apache.org/jira/browse/HADOOP-7372) | Remove ref of 20.3 release from branch-0.20 CHANGES.txt | Major | documentation | Eli Collins | Eli Collins |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.3/RELEASENOTES.0.20.3.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.3/RELEASENOTES.0.20.3.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.3/RELEASENOTES.0.20.3.md
index 4f48cfc..17f4610 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.3/RELEASENOTES.0.20.3.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.3/RELEASENOTES.0.20.3.md
@@ -23,23 +23,23 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-6701](https://issues.apache.org/jira/browse/HADOOP-6701) | *Minor* | ** Incorrect exit codes for "dfs -chown", "dfs -chgrp"**
+* [HADOOP-6382](https://issues.apache.org/jira/browse/HADOOP-6382) | *Major* | **publish hadoop jars to apache mvn repo.**
-Commands chmod, chown and chgrp now returns non zero exit code and an error message on failure instead of returning zero.
+The hadoop jars are renamed from previous hadoop-\<version\>-\<name\>.jar to hadoop-\<name\>-\<version\>.jar. Applications and documentation need to be updated to use the new file naming scheme.
---
-* [HADOOP-6382](https://issues.apache.org/jira/browse/HADOOP-6382) | *Major* | **publish hadoop jars to apache mvn repo.**
+* [HDFS-132](https://issues.apache.org/jira/browse/HDFS-132) | *Minor* | **Namenode in Safemode reports to Simon non-zero number of deleted files during startup**
-The hadoop jars are renamed from previous hadoop-\<version\>-\<name\>.jar to hadoop-\<name\>-\<version\>.jar. Applications and documentation need to be updated to use the new file naming scheme.
+With this incompatible change, under metrics context "dfs", the record name "FSDirectory" is no longer available. The metrics "files\_deleted" from the deleted record "FSDirectory" is now available in metrics context "dfs", record name "namenode" with the metrics name "FilesDeleted".
---
-* [HDFS-132](https://issues.apache.org/jira/browse/HDFS-132) | *Minor* | **Namenode in Safemode reports to Simon non-zero number of deleted files during startup**
+* [HADOOP-6701](https://issues.apache.org/jira/browse/HADOOP-6701) | *Minor* | ** Incorrect exit codes for "dfs -chown", "dfs -chgrp"**
-With this incompatible change, under metrics context "dfs", the record name "FSDirectory" is no longer available. The metrics "files\_deleted" from the deleted record "FSDirectory" is now available in metrics context "dfs", record name "namenode" with the metrics name "FilesDeleted".
+Commands chmod, chown and chgrp now returns non zero exit code and an error message on failure instead of returning zero.
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[38/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.0/CHANGES.0.20.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.0/CHANGES.0.20.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.0/CHANGES.0.20.0.md
index 4c1dd51..9e1b766 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.0/CHANGES.0.20.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.20.0/CHANGES.0.20.0.md
@@ -24,120 +24,114 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-5531](https://issues.apache.org/jira/browse/HADOOP-5531) | Remove Chukwa on branch-0.20 | Blocker | . | Nigel Daley | Nigel Daley |
-| [HADOOP-4970](https://issues.apache.org/jira/browse/HADOOP-4970) | Use the full path when move files to .Trash/Current | Major | . | Prasad Chakka | Prasad Chakka |
-| [HADOOP-4826](https://issues.apache.org/jira/browse/HADOOP-4826) | Admin command saveNamespace. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-4789](https://issues.apache.org/jira/browse/HADOOP-4789) | Change fair scheduler to share between pools by default, not between invidual jobs | Minor | . | Matei Zaharia | Matei Zaharia |
-| [HADOOP-4783](https://issues.apache.org/jira/browse/HADOOP-4783) | History files are given world readable permissions. | Blocker | . | Hemanth Yamijala | Amareshwari Sriramadasu |
-| [HADOOP-4631](https://issues.apache.org/jira/browse/HADOOP-4631) | Split the default configurations into 3 parts | Major | conf | Owen O'Malley | Sharad Agarwal |
-| [HADOOP-4618](https://issues.apache.org/jira/browse/HADOOP-4618) | Move http server from FSNamesystem into NameNode. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-4576](https://issues.apache.org/jira/browse/HADOOP-4576) | Modify pending tasks count in the UI to pending jobs count in the UI | Major | . | Hemanth Yamijala | Sreekanth Ramakrishnan |
+| [HADOOP-4210](https://issues.apache.org/jira/browse/HADOOP-4210) | Findbugs warnings are printed related to equals implementation of several classes | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-4253](https://issues.apache.org/jira/browse/HADOOP-4253) | Fix warnings generated by FindBugs | Major | conf, fs, record | Suresh Srinivas | Suresh Srinivas |
| [HADOOP-4572](https://issues.apache.org/jira/browse/HADOOP-4572) | INode and its sub-classes should be package private | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4618](https://issues.apache.org/jira/browse/HADOOP-4618) | Move http server from FSNamesystem into NameNode. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
| [HADOOP-4567](https://issues.apache.org/jira/browse/HADOOP-4567) | GetFileBlockLocations should return the NetworkTopology information of the machines that hosts those blocks | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-4445](https://issues.apache.org/jira/browse/HADOOP-4445) | Wrong number of running map/reduce tasks are displayed in queue information. | Major | . | Karam Singh | Sreekanth Ramakrishnan |
| [HADOOP-4435](https://issues.apache.org/jira/browse/HADOOP-4435) | The JobTracker should display the amount of heap memory used | Minor | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-4422](https://issues.apache.org/jira/browse/HADOOP-4422) | S3 file systems should not create bucket | Major | fs/s3 | David Phillips | David Phillips |
-| [HADOOP-4253](https://issues.apache.org/jira/browse/HADOOP-4253) | Fix warnings generated by FindBugs | Major | conf, fs, record | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-4210](https://issues.apache.org/jira/browse/HADOOP-4210) | Findbugs warnings are printed related to equals implementation of several classes | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-3923](https://issues.apache.org/jira/browse/HADOOP-3923) | Deprecate org.apache.hadoop.mapred.StatusHttpServer | Minor | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-4188](https://issues.apache.org/jira/browse/HADOOP-4188) | Remove Task's dependency on concrete file systems | Major | . | Tom White | Sharad Agarwal |
-| [HADOOP-4103](https://issues.apache.org/jira/browse/HADOOP-4103) | Alert for missing blocks | Major | . | Christian Kunz | Raghu Angadi |
-| [HADOOP-4035](https://issues.apache.org/jira/browse/HADOOP-4035) | Modify the capacity scheduler (HADOOP-3445) to schedule tasks based on memory requirements and task trackers free memory | Blocker | . | Hemanth Yamijala | Vinod Kumar Vavilapalli |
-| [HADOOP-4029](https://issues.apache.org/jira/browse/HADOOP-4029) | NameNode should report status and performance for each replica of image and log | Major | . | Robert Chansler | Boris Shkolnik |
+| [HADOOP-1650](https://issues.apache.org/jira/browse/HADOOP-1650) | Upgrade Jetty to 6.x | Major | . | Devaraj Das | Chris Douglas |
| [HADOOP-3986](https://issues.apache.org/jira/browse/HADOOP-3986) | JobClient should not have a static configuration | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-3923](https://issues.apache.org/jira/browse/HADOOP-3923) | Deprecate org.apache.hadoop.mapred.StatusHttpServer | Minor | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4422](https://issues.apache.org/jira/browse/HADOOP-4422) | S3 file systems should not create bucket | Major | fs/s3 | David Phillips | David Phillips |
+| [HADOOP-3422](https://issues.apache.org/jira/browse/HADOOP-3422) | Ganglia counter metrics are all reported with the metric name "value", so the counter values can not be seen | Major | metrics | Jason | stack |
+| [HADOOP-4035](https://issues.apache.org/jira/browse/HADOOP-4035) | Modify the capacity scheduler (HADOOP-3445) to schedule tasks based on memory requirements and task trackers free memory | Blocker | . | Hemanth Yamijala | Vinod Kumar Vavilapalli |
| [HADOOP-3750](https://issues.apache.org/jira/browse/HADOOP-3750) | Fix and enforce module dependencies | Major | . | Tom White | Sharad Agarwal |
| [HADOOP-3497](https://issues.apache.org/jira/browse/HADOOP-3497) | File globbing with a PathFilter is too restrictive | Major | fs | Tom White | Tom White |
-| [HADOOP-3422](https://issues.apache.org/jira/browse/HADOOP-3422) | Ganglia counter metrics are all reported with the metric name "value", so the counter values can not be seen | Major | metrics | Jason | stack |
+| [HADOOP-4576](https://issues.apache.org/jira/browse/HADOOP-4576) | Modify pending tasks count in the UI to pending jobs count in the UI | Major | . | Hemanth Yamijala | Sreekanth Ramakrishnan |
+| [HADOOP-4445](https://issues.apache.org/jira/browse/HADOOP-4445) | Wrong number of running map/reduce tasks are displayed in queue information. | Major | . | Karam Singh | Sreekanth Ramakrishnan |
+| [HADOOP-4029](https://issues.apache.org/jira/browse/HADOOP-4029) | NameNode should report status and performance for each replica of image and log | Major | . | Robert Chansler | Boris Shkolnik |
+| [HADOOP-4826](https://issues.apache.org/jira/browse/HADOOP-4826) | Admin command saveNamespace. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-4631](https://issues.apache.org/jira/browse/HADOOP-4631) | Split the default configurations into 3 parts | Major | conf | Owen O'Malley | Sharad Agarwal |
| [HADOOP-3344](https://issues.apache.org/jira/browse/HADOOP-3344) | libhdfs: always builds 32bit, even when x86\_64 Java used | Major | build | Craig Macdonald | Giridharan Kesavan |
-| [HADOOP-1650](https://issues.apache.org/jira/browse/HADOOP-1650) | Upgrade Jetty to 6.x | Major | . | Devaraj Das | Chris Douglas |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-4789](https://issues.apache.org/jira/browse/HADOOP-4789) | Change fair scheduler to share between pools by default, not between invidual jobs | Minor | . | Matei Zaharia | Matei Zaharia |
+| [HADOOP-4970](https://issues.apache.org/jira/browse/HADOOP-4970) | Use the full path when move files to .Trash/Current | Major | . | Prasad Chakka | Prasad Chakka |
+| [HADOOP-4103](https://issues.apache.org/jira/browse/HADOOP-4103) | Alert for missing blocks | Major | . | Christian Kunz | Raghu Angadi |
+| [HADOOP-4783](https://issues.apache.org/jira/browse/HADOOP-4783) | History files are given world readable permissions. | Blocker | . | Hemanth Yamijala | Amareshwari Sriramadasu |
+| [HADOOP-5531](https://issues.apache.org/jira/browse/HADOOP-5531) | Remove Chukwa on branch-0.20 | Blocker | . | Nigel Daley | Nigel Daley |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-4937](https://issues.apache.org/jira/browse/HADOOP-4937) | [HOD] Include ringmaster RPC port information in the notes attribute | Major | contrib/hod | Hemanth Yamijala | Peeyush Bishnoi |
-| [HADOOP-4804](https://issues.apache.org/jira/browse/HADOOP-4804) | Create Forrest documentation for the fair scheduler | Minor | . | Matei Zaharia | Sreekanth Ramakrishnan |
-| [HADOOP-4661](https://issues.apache.org/jira/browse/HADOOP-4661) | distch: a tool for distributed ch{mod,own} | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4622](https://issues.apache.org/jira/browse/HADOOP-4622) | Explicitly specify interpretor for non-native binaries | Minor | . | Fredrik Hedberg | Fredrik Hedberg |
-| [HADOOP-4575](https://issues.apache.org/jira/browse/HADOOP-4575) | An independent HTTPS proxy for HDFS | Major | security | Kan Zhang | Kan Zhang |
-| [HADOOP-4348](https://issues.apache.org/jira/browse/HADOOP-4348) | Adding service-level authorization to Hadoop | Major | security | Kan Zhang | Arun C Murthy |
| [HADOOP-4284](https://issues.apache.org/jira/browse/HADOOP-4284) | Support for user configurable global filters on HttpServer | Major | security | Kan Zhang | Kan Zhang |
+| [HADOOP-4575](https://issues.apache.org/jira/browse/HADOOP-4575) | An independent HTTPS proxy for HDFS | Major | security | Kan Zhang | Kan Zhang |
+| [HADOOP-4622](https://issues.apache.org/jira/browse/HADOOP-4622) | Explicitly specify interpretor for non-native binaries | Minor | . | Fredrik Hedberg | Fredrik Hedberg |
+| [HADOOP-4661](https://issues.apache.org/jira/browse/HADOOP-4661) | distch: a tool for distributed ch{mod,own} | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-4179](https://issues.apache.org/jira/browse/HADOOP-4179) | Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs | Major | . | Suhas Gogate | Suhas Gogate |
+| [HADOOP-4348](https://issues.apache.org/jira/browse/HADOOP-4348) | Adding service-level authorization to Hadoop | Major | security | Kan Zhang | Arun C Murthy |
+| [HADOOP-4937](https://issues.apache.org/jira/browse/HADOOP-4937) | [HOD] Include ringmaster RPC port information in the notes attribute | Major | contrib/hod | Hemanth Yamijala | Peeyush Bishnoi |
+| [HADOOP-4804](https://issues.apache.org/jira/browse/HADOOP-4804) | Create Forrest documentation for the fair scheduler | Minor | . | Matei Zaharia | Sreekanth Ramakrishnan |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-6150](https://issues.apache.org/jira/browse/HADOOP-6150) | Need to be able to instantiate a comparator instance from a comparator string without creating a TFile.Reader object | Minor | io | Hong Tang | Hong Tang |
-| [HADOOP-5521](https://issues.apache.org/jira/browse/HADOOP-5521) | Remove dependency of testcases on RESTART\_COUNT | Major | test | Amar Kamat | Ravi Gummadi |
-| [HADOOP-5520](https://issues.apache.org/jira/browse/HADOOP-5520) | Typo in diskQuota help documentation | Trivial | documentation | Ravi Phulari | Ravi Phulari |
-| [HADOOP-5519](https://issues.apache.org/jira/browse/HADOOP-5519) | Remove claims from mapred-default.xml that prime numbers of tasks are helpful. | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-5514](https://issues.apache.org/jira/browse/HADOOP-5514) | Add waiting/failed tasks to JobTracker metrics | Major | metrics | Chris Douglas | Chris Douglas |
-| [HADOOP-5468](https://issues.apache.org/jira/browse/HADOOP-5468) | Change Hadoop doc menu to sub-menus | Major | documentation | Corinne Chandel | Corinne Chandel |
-| [HADOOP-5466](https://issues.apache.org/jira/browse/HADOOP-5466) | CSS Style Changes for Hadoop Doc Headers and Code | Major | documentation | Corinne Chandel | Corinne Chandel |
-| [HADOOP-5395](https://issues.apache.org/jira/browse/HADOOP-5395) | When queue ACLs are enabled, the error message shown when a job is submitted to a non-existent queue is misleading | Major | . | Hemanth Yamijala | rahul k singh |
-| [HADOOP-5379](https://issues.apache.org/jira/browse/HADOOP-5379) | Throw exception instead of writing to System.err when there is a CRC error on CBZip2InputStream | Minor | io | Rodrigo Schmidt | Rodrigo Schmidt |
-| [HADOOP-5275](https://issues.apache.org/jira/browse/HADOOP-5275) | ivy directory should be there in hadoop tar ball | Major | build | Suman Sehgal | Giridharan Kesavan |
-| [HADOOP-5122](https://issues.apache.org/jira/browse/HADOOP-5122) | libhdfs test conf uses deprecated fs.default.name value | Trivial | test | Craig Macdonald | Craig Macdonald |
-| [HADOOP-5030](https://issues.apache.org/jira/browse/HADOOP-5030) | Chukwa RPM build improvements | Major | . | Eric Yang | Eric Yang |
-| [HADOOP-4980](https://issues.apache.org/jira/browse/HADOOP-4980) | Cleanup the Capacity Scheduler code | Major | . | Vivek Ratan | Vivek Ratan |
-| [HADOOP-4950](https://issues.apache.org/jira/browse/HADOOP-4950) | CompressorStream and BlockCompressorStream should be public | Major | io | Owen O'Malley | Owen O'Malley |
-| [HADOOP-4944](https://issues.apache.org/jira/browse/HADOOP-4944) | Allow Xinclude in hadoop config file | Minor | conf | Rama, Ramasamy | Rama, Ramasamy |
-| [HADOOP-4920](https://issues.apache.org/jira/browse/HADOOP-4920) | do not keep forrest output in subversion | Major | documentation | Doug Cutting | Doug Cutting |
-| [HADOOP-4916](https://issues.apache.org/jira/browse/HADOOP-4916) | adjust build.xml to reference external properties when building the "init.d" for the rpm | Major | . | Eric Yang | Eric Yang |
-| [HADOOP-4909](https://issues.apache.org/jira/browse/HADOOP-4909) | Clean up map/reduce api to take JobContext in the static methods | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-4880](https://issues.apache.org/jira/browse/HADOOP-4880) | Improvements to TestJobTrackerRestart | Major | test | Arun C Murthy | Amar Kamat |
-| [HADOOP-4843](https://issues.apache.org/jira/browse/HADOOP-4843) | Collect Job History log file and Job Conf file into Chukwa | Major | . | Eric Yang | Eric Yang |
-| [HADOOP-4838](https://issues.apache.org/jira/browse/HADOOP-4838) | Cleanup Metrics and the MBeans | Major | . | Sanjay Radia | Sanjay Radia |
-| [HADOOP-4837](https://issues.apache.org/jira/browse/HADOOP-4837) | Move HADOOP\_CONF\_DIR to chukwa-env.sh | Major | . | Jerome Boulon | Jerome Boulon |
-| [HADOOP-4828](https://issues.apache.org/jira/browse/HADOOP-4828) | Update documentation for default configuration | Major | documentation | Sharad Agarwal | Sharad Agarwal |
-| [HADOOP-4827](https://issues.apache.org/jira/browse/HADOOP-4827) | Improve data aggregation in database | Major | . | Eric Yang | Eric Yang |
-| [HADOOP-4758](https://issues.apache.org/jira/browse/HADOOP-4758) | Add a splitter for metrics contexts | Minor | metrics | Chris Douglas | Chris Douglas |
-| [HADOOP-4753](https://issues.apache.org/jira/browse/HADOOP-4753) | gridmix2 code can be condensed | Minor | benchmarks | Chris Douglas | Chris Douglas |
-| [HADOOP-4749](https://issues.apache.org/jira/browse/HADOOP-4749) | reducer should output input data size when shuffling is done | Major | . | Zheng Shao | He Yongqiang |
-| [HADOOP-4747](https://issues.apache.org/jira/browse/HADOOP-4747) | Reuse FileStatus in FsShell where possible | Minor | fs | David Phillips | David Phillips |
-| [HADOOP-4708](https://issues.apache.org/jira/browse/HADOOP-4708) | Add support for dfsadmin commands for test TestCLI unit test | Major | test | Boris Shkolnik | Boris Shkolnik |
-| [HADOOP-4705](https://issues.apache.org/jira/browse/HADOOP-4705) | [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters | Major | contrib/hod | Hemanth Yamijala | Peeyush Bishnoi |
-| [HADOOP-4699](https://issues.apache.org/jira/browse/HADOOP-4699) | Change TaskTracker.MapOutputServlet to send only the IFile segment, validate checksum in Reduce | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-4690](https://issues.apache.org/jira/browse/HADOOP-4690) | fuse-dfs - create source file/function + utils + config + main source files | Minor | . | Pete Wyckoff | Pete Wyckoff |
-| [HADOOP-4668](https://issues.apache.org/jira/browse/HADOOP-4668) | Improve JavaDoc on JobConf.setCombinerClass to better document restrictions on combiners | Major | documentation | Owen O'Malley | Owen O'Malley |
-| [HADOOP-4666](https://issues.apache.org/jira/browse/HADOOP-4666) | Launch reduces only after a few maps have run in the Fair Scheduler | Major | . | Matei Zaharia | Matei Zaharia |
-| [HADOOP-4664](https://issues.apache.org/jira/browse/HADOOP-4664) | Parallelize job initialization | Blocker | . | Matei Zaharia | Jothi Padmanabhan |
-| [HADOOP-4649](https://issues.apache.org/jira/browse/HADOOP-4649) | Improve abstraction for spill indices | Minor | . | Chris Douglas | Chris Douglas |
-| [HADOOP-4640](https://issues.apache.org/jira/browse/HADOOP-4640) | Add ability to split text files compressed with lzo | Trivial | io | Johan Oskarsson | Johan Oskarsson |
-| [HADOOP-4628](https://issues.apache.org/jira/browse/HADOOP-4628) | Move Hive out of Core | Major | . | Owen O'Malley | |
-| [HADOOP-4599](https://issues.apache.org/jira/browse/HADOOP-4599) | BlocksMap and BlockInfo should be package private. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-4565](https://issues.apache.org/jira/browse/HADOOP-4565) | MultiFileInputSplit can use data locality information to create splits | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-4545](https://issues.apache.org/jira/browse/HADOOP-4545) | Add an example of a secondary sort | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-4523](https://issues.apache.org/jira/browse/HADOOP-4523) | Enhance how memory-intensive user tasks are handled | Major | . | Vivek Ratan | Vinod Kumar Vavilapalli |
+| [HADOOP-4234](https://issues.apache.org/jira/browse/HADOOP-4234) | KFS: Allow KFS layer to interface with multiple KFS namenodes | Minor | fs | Sriram Rao | Sriram Rao |
+| [HADOOP-4244](https://issues.apache.org/jira/browse/HADOOP-4244) | In "ant test-patch", runContribTestOnEclipseFiles should not be run on Hudson only | Major | build, test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-3180](https://issues.apache.org/jira/browse/HADOOP-3180) | add name of faulty class to WritableName.getClass IOException upon ClassNotFoundException | Trivial | io | Pete Wyckoff | Pete Wyckoff |
+| [HADOOP-4178](https://issues.apache.org/jira/browse/HADOOP-4178) | The capacity scheduler's defaults for queues should be configurable. | Blocker | . | Owen O'Malley | Sreekanth Ramakrishnan |
+| [HADOOP-4226](https://issues.apache.org/jira/browse/HADOOP-4226) | LineReader::readLine cleanup | Minor | . | Yuri Pradkin | Yuri Pradkin |
+| [HADOOP-4440](https://issues.apache.org/jira/browse/HADOOP-4440) | TestJobInProgressListener should also test for jobs killed in queued state | Minor | test | Amar Kamat | Amar Kamat |
+| [HADOOP-4276](https://issues.apache.org/jira/browse/HADOOP-4276) | The mapred.\*ID classes are inefficient for hashCode and serialization | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-4485](https://issues.apache.org/jira/browse/HADOOP-4485) | ant compile-native shorthand | Trivial | build | Enis Soztutar | Enis Soztutar |
| [HADOOP-4454](https://issues.apache.org/jira/browse/HADOOP-4454) | Support comments in 'slaves' file | Minor | conf, scripts | Rama, Ramasamy | Rama, Ramasamy |
-| [HADOOP-4453](https://issues.apache.org/jira/browse/HADOOP-4453) | Improve ssl handling for distcp | Major | . | Chris Douglas | Kan Zhang |
-| [HADOOP-4440](https://issues.apache.org/jira/browse/HADOOP-4440) | TestJobInProgressListener should also test for jobs killed in queued state | Minor | test | Amar Kamat | Amar Kamat |
+| [HADOOP-3461](https://issues.apache.org/jira/browse/HADOOP-3461) | Remove dfs.StringBytesWritbale | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HADOOP-4437](https://issues.apache.org/jira/browse/HADOOP-4437) | Use qMC sequence to improve the accuracy of PiEstimator | Minor | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4339](https://issues.apache.org/jira/browse/HADOOP-4339) | Improve FsShell -du/-dus and FileSystem.getContentSummary efficiency | Major | fs | David Phillips | David Phillips |
-| [HADOOP-4305](https://issues.apache.org/jira/browse/HADOOP-4305) | repeatedly blacklisted tasktrackers should get declared dead | Major | . | Christian Kunz | Amareshwari Sriramadasu |
-| [HADOOP-4276](https://issues.apache.org/jira/browse/HADOOP-4276) | The mapred.\*ID classes are inefficient for hashCode and serialization | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-4244](https://issues.apache.org/jira/browse/HADOOP-4244) | In "ant test-patch", runContribTestOnEclipseFiles should not be run on Hudson only | Major | build, test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4234](https://issues.apache.org/jira/browse/HADOOP-4234) | KFS: Allow KFS layer to interface with multiple KFS namenodes | Minor | fs | Sriram Rao | Sriram Rao |
-| [HADOOP-4226](https://issues.apache.org/jira/browse/HADOOP-4226) | LineReader::readLine cleanup | Minor | . | Yuri Pradkin | Yuri Pradkin |
-| [HADOOP-4178](https://issues.apache.org/jira/browse/HADOOP-4178) | The capacity scheduler's defaults for queues should be configurable. | Blocker | . | Owen O'Malley | Sreekanth Ramakrishnan |
+| [HADOOP-4599](https://issues.apache.org/jira/browse/HADOOP-4599) | BlocksMap and BlockInfo should be package private. | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-4453](https://issues.apache.org/jira/browse/HADOOP-4453) | Improve ssl handling for distcp | Major | . | Chris Douglas | Kan Zhang |
| [HADOOP-4126](https://issues.apache.org/jira/browse/HADOOP-4126) | Allow access to HDFS web UI on EC2 | Major | contrib/cloud | Tom White | Tom White |
+| [HADOOP-4523](https://issues.apache.org/jira/browse/HADOOP-4523) | Enhance how memory-intensive user tasks are handled | Major | . | Vivek Ratan | Vinod Kumar Vavilapalli |
+| [HADOOP-4668](https://issues.apache.org/jira/browse/HADOOP-4668) | Improve JavaDoc on JobConf.setCombinerClass to better document restrictions on combiners | Major | documentation | Owen O'Malley | Owen O'Malley |
+| [HADOOP-4640](https://issues.apache.org/jira/browse/HADOOP-4640) | Add ability to split text files compressed with lzo | Trivial | io | Johan Oskarsson | Johan Oskarsson |
+| [HADOOP-4666](https://issues.apache.org/jira/browse/HADOOP-4666) | Launch reduces only after a few maps have run in the Fair Scheduler | Major | . | Matei Zaharia | Matei Zaharia |
+| [HADOOP-4339](https://issues.apache.org/jira/browse/HADOOP-4339) | Improve FsShell -du/-dus and FileSystem.getContentSummary efficiency | Major | fs | David Phillips | David Phillips |
+| [HADOOP-2774](https://issues.apache.org/jira/browse/HADOOP-2774) | Add counters to show number of key/values that have been sorted and merged in the maps and reduces | Major | . | Owen O'Malley | Ravi Gummadi |
+| [HADOOP-4705](https://issues.apache.org/jira/browse/HADOOP-4705) | [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters | Major | contrib/hod | Hemanth Yamijala | Peeyush Bishnoi |
+| [HADOOP-4649](https://issues.apache.org/jira/browse/HADOOP-4649) | Improve abstraction for spill indices | Minor | . | Chris Douglas | Chris Douglas |
| [HADOOP-3770](https://issues.apache.org/jira/browse/HADOOP-3770) | improve composition, submission and result collection of gridmix | Major | benchmarks | Lingyun Yang | Runping Qi |
-| [HADOOP-3461](https://issues.apache.org/jira/browse/HADOOP-3461) | Remove dfs.StringBytesWritbale | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-3180](https://issues.apache.org/jira/browse/HADOOP-3180) | add name of faulty class to WritableName.getClass IOException upon ClassNotFoundException | Trivial | io | Pete Wyckoff | Pete Wyckoff |
-| [HADOOP-3136](https://issues.apache.org/jira/browse/HADOOP-3136) | Assign multiple tasks per TaskTracker heartbeat | Major | . | Devaraj Das | Arun C Murthy |
+| [HADOOP-4708](https://issues.apache.org/jira/browse/HADOOP-4708) | Add support for dfsadmin commands for test TestCLI unit test | Major | test | Boris Shkolnik | Boris Shkolnik |
+| [HADOOP-4758](https://issues.apache.org/jira/browse/HADOOP-4758) | Add a splitter for metrics contexts | Minor | metrics | Chris Douglas | Chris Douglas |
+| [HADOOP-4690](https://issues.apache.org/jira/browse/HADOOP-4690) | fuse-dfs - create source file/function + utils + config + main source files | Minor | . | Pete Wyckoff | Pete Wyckoff |
+| [HADOOP-4747](https://issues.apache.org/jira/browse/HADOOP-4747) | Reuse FileStatus in FsShell where possible | Minor | fs | David Phillips | David Phillips |
+| [HADOOP-4305](https://issues.apache.org/jira/browse/HADOOP-4305) | repeatedly blacklisted tasktrackers should get declared dead | Major | . | Christian Kunz | Amareshwari Sriramadasu |
+| [HADOOP-4628](https://issues.apache.org/jira/browse/HADOOP-4628) | Move Hive out of Core | Major | . | Owen O'Malley | |
+| [HADOOP-4749](https://issues.apache.org/jira/browse/HADOOP-4749) | reducer should output input data size when shuffling is done | Major | . | Zheng Shao | He Yongqiang |
+| [HADOOP-4837](https://issues.apache.org/jira/browse/HADOOP-4837) | Move HADOOP\_CONF\_DIR to chukwa-env.sh | Major | . | Jerome Boulon | Jerome Boulon |
+| [HADOOP-4699](https://issues.apache.org/jira/browse/HADOOP-4699) | Change TaskTracker.MapOutputServlet to send only the IFile segment, validate checksum in Reduce | Major | . | Chris Douglas | Chris Douglas |
| [HADOOP-3063](https://issues.apache.org/jira/browse/HADOOP-3063) | BloomMapFile - fail-fast version of MapFile for sparsely populated key space | Major | io | Andrzej Bialecki | Andrzej Bialecki |
-| [HADOOP-2774](https://issues.apache.org/jira/browse/HADOOP-2774) | Add counters to show number of key/values that have been sorted and merged in the maps and reduces | Major | . | Owen O'Malley | Ravi Gummadi |
| [HADOOP-1230](https://issues.apache.org/jira/browse/HADOOP-1230) | Replace parameters with context objects in Mapper, Reducer, Partitioner, InputFormat, and OutputFormat classes | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-4838](https://issues.apache.org/jira/browse/HADOOP-4838) | Cleanup Metrics and the MBeans | Major | . | Sanjay Radia | Sanjay Radia |
+| [HADOOP-3136](https://issues.apache.org/jira/browse/HADOOP-3136) | Assign multiple tasks per TaskTracker heartbeat | Major | . | Devaraj Das | Arun C Murthy |
+| [HADOOP-4545](https://issues.apache.org/jira/browse/HADOOP-4545) | Add an example of a secondary sort | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-4753](https://issues.apache.org/jira/browse/HADOOP-4753) | gridmix2 code can be condensed | Minor | benchmarks | Chris Douglas | Chris Douglas |
+| [HADOOP-4827](https://issues.apache.org/jira/browse/HADOOP-4827) | Improve data aggregation in database | Major | . | Eric Yang | Eric Yang |
+| [HADOOP-4880](https://issues.apache.org/jira/browse/HADOOP-4880) | Improvements to TestJobTrackerRestart | Major | test | Arun C Murthy | Amar Kamat |
+| [HADOOP-4909](https://issues.apache.org/jira/browse/HADOOP-4909) | Clean up map/reduce api to take JobContext in the static methods | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-4920](https://issues.apache.org/jira/browse/HADOOP-4920) | do not keep forrest output in subversion | Major | documentation | Doug Cutting | Doug Cutting |
+| [HADOOP-4980](https://issues.apache.org/jira/browse/HADOOP-4980) | Cleanup the Capacity Scheduler code | Major | . | Vivek Ratan | Vivek Ratan |
+| [HADOOP-4916](https://issues.apache.org/jira/browse/HADOOP-4916) | adjust build.xml to reference external properties when building the "init.d" for the rpm | Major | . | Eric Yang | Eric Yang |
+| [HADOOP-4950](https://issues.apache.org/jira/browse/HADOOP-4950) | CompressorStream and BlockCompressorStream should be public | Major | io | Owen O'Malley | Owen O'Malley |
+| [HADOOP-4843](https://issues.apache.org/jira/browse/HADOOP-4843) | Collect Job History log file and Job Conf file into Chukwa | Major | . | Eric Yang | Eric Yang |
+| [HADOOP-5030](https://issues.apache.org/jira/browse/HADOOP-5030) | Chukwa RPM build improvements | Major | . | Eric Yang | Eric Yang |
+| [HADOOP-4828](https://issues.apache.org/jira/browse/HADOOP-4828) | Update documentation for default configuration | Major | documentation | Sharad Agarwal | Sharad Agarwal |
+| [HADOOP-5122](https://issues.apache.org/jira/browse/HADOOP-5122) | libhdfs test conf uses deprecated fs.default.name value | Trivial | test | Craig Macdonald | Craig Macdonald |
+| [HADOOP-4565](https://issues.apache.org/jira/browse/HADOOP-4565) | MultiFileInputSplit can use data locality information to create splits | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-5275](https://issues.apache.org/jira/browse/HADOOP-5275) | ivy directory should be there in hadoop tar ball | Major | build | Suman Sehgal | Giridharan Kesavan |
+| [HADOOP-5379](https://issues.apache.org/jira/browse/HADOOP-5379) | Throw exception instead of writing to System.err when there is a CRC error on CBZip2InputStream | Minor | io | Rodrigo Schmidt | Rodrigo Schmidt |
+| [HADOOP-5395](https://issues.apache.org/jira/browse/HADOOP-5395) | When queue ACLs are enabled, the error message shown when a job is submitted to a non-existent queue is misleading | Major | . | Hemanth Yamijala | rahul k singh |
+| [HADOOP-4664](https://issues.apache.org/jira/browse/HADOOP-4664) | Parallelize job initialization | Blocker | . | Matei Zaharia | Jothi Padmanabhan |
+| [HADOOP-5466](https://issues.apache.org/jira/browse/HADOOP-5466) | CSS Style Changes for Hadoop Doc Headers and Code | Major | documentation | Corinne Chandel | Corinne Chandel |
+| [HADOOP-5514](https://issues.apache.org/jira/browse/HADOOP-5514) | Add waiting/failed tasks to JobTracker metrics | Major | metrics | Chris Douglas | Chris Douglas |
+| [HADOOP-5521](https://issues.apache.org/jira/browse/HADOOP-5521) | Remove dependency of testcases on RESTART\_COUNT | Major | test | Amar Kamat | Ravi Gummadi |
+| [HADOOP-5468](https://issues.apache.org/jira/browse/HADOOP-5468) | Change Hadoop doc menu to sub-menus | Major | documentation | Corinne Chandel | Corinne Chandel |
+| [HADOOP-5520](https://issues.apache.org/jira/browse/HADOOP-5520) | Typo in diskQuota help documentation | Trivial | documentation | Ravi Phulari | Ravi Phulari |
+| [HADOOP-5519](https://issues.apache.org/jira/browse/HADOOP-5519) | Remove claims from mapred-default.xml that prime numbers of tasks are helpful. | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-4944](https://issues.apache.org/jira/browse/HADOOP-4944) | Allow Xinclude in hadoop config file | Minor | conf | Rama, Ramasamy | Rama, Ramasamy |
+| [HADOOP-6150](https://issues.apache.org/jira/browse/HADOOP-6150) | Need to be able to instantiate a comparator instance from a comparator string without creating a TFile.Reader object | Minor | io | Hong Tang | Hong Tang |
| [HADOOP-466](https://issues.apache.org/jira/browse/HADOOP-466) | Startup scripts will not start instances of Hadoop daemons w/different configs w/o setting separate PID directories | Major | conf | Vetle Roeim | |
@@ -145,193 +139,193 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-5645](https://issues.apache.org/jira/browse/HADOOP-5645) | After HADOOP-4920 we need a place to checkin releasenotes.html | Major | build | Nigel Daley | Nigel Daley |
-| [HADOOP-5644](https://issues.apache.org/jira/browse/HADOOP-5644) | Namnode is stuck in safe mode | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-5607](https://issues.apache.org/jira/browse/HADOOP-5607) | TestCapacityScheduler fails with NPE | Major | test | Chris Douglas | Chris Douglas |
-| [HADOOP-5605](https://issues.apache.org/jira/browse/HADOOP-5605) | All the replicas incorrectly got marked as corrupt. | Blocker | . | Raghu Angadi | Hairong Kuang |
-| [HADOOP-5588](https://issues.apache.org/jira/browse/HADOOP-5588) | hadoop commands seem extremely slow in 0.20 branch | Blocker | fs | Koji Noguchi | Hairong Kuang |
-| [HADOOP-5585](https://issues.apache.org/jira/browse/HADOOP-5585) | FileSystem statistic counters are too high when JVM reuse is enabled. | Blocker | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-5577](https://issues.apache.org/jira/browse/HADOOP-5577) | The Job.waitForCompletion doesn't print status as the job runs | Blocker | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-5576](https://issues.apache.org/jira/browse/HADOOP-5576) | LocalJobRunner does not run jobs using new MapReduce API | Blocker | . | Tom White | Tom White |
-| [HADOOP-5571](https://issues.apache.org/jira/browse/HADOOP-5571) | TupleWritable can return incorrect results if it contains more than 32 values | Major | . | Jingkei Ly | Jingkei Ly |
-| [HADOOP-5565](https://issues.apache.org/jira/browse/HADOOP-5565) | The job instrumentation API needs to have a method for finalizeJob, | Major | . | Jerome Boulon | Jerome Boulon |
-| [HADOOP-5564](https://issues.apache.org/jira/browse/HADOOP-5564) | hadoop command uses large JVM heap size | Blocker | build | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-5557](https://issues.apache.org/jira/browse/HADOOP-5557) | Two minor problems in TestOverReplicatedBlocks | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-5554](https://issues.apache.org/jira/browse/HADOOP-5554) | DataNodeCluster should create blocks with the same generation stamp as the blocks created in CreateEditsLog | Major | test | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5551](https://issues.apache.org/jira/browse/HADOOP-5551) | Namenode permits directory destruction on overwrite | Critical | . | Brian Bockelman | Brian Bockelman |
-| [HADOOP-5549](https://issues.apache.org/jira/browse/HADOOP-5549) | ReplicationMonitor should schedule both replication and deletion work in one iteration | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5548](https://issues.apache.org/jira/browse/HADOOP-5548) | Observed negative running maps on the job tracker | Blocker | . | Owen O'Malley | Amareshwari Sriramadasu |
-| [HADOOP-5534](https://issues.apache.org/jira/browse/HADOOP-5534) | Deadlock triggered by FairScheduler scheduler's servlet due to changes from HADOOP-5214. | Blocker | . | Vinod Kumar Vavilapalli | rahul k singh |
-| [HADOOP-5522](https://issues.apache.org/jira/browse/HADOOP-5522) | Document job setup/cleaup tasks and task cleanup tasks in mapred tutorial | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-5516](https://issues.apache.org/jira/browse/HADOOP-5516) | TaskMemoryManagerThread crashes in a corner case | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [HADOOP-5505](https://issues.apache.org/jira/browse/HADOOP-5505) | TestMissingBlocksAlert fails on 0.20. | Major | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-5499](https://issues.apache.org/jira/browse/HADOOP-5499) | JobTracker metrics do not match job counters | Major | metrics | Chris Douglas | |
-| [HADOOP-5493](https://issues.apache.org/jira/browse/HADOOP-5493) | Shuffle copiers do not return Codecs back to the pool at the end of shuffling | Blocker | . | Devaraj Das | Jothi Padmanabhan |
-| [HADOOP-5490](https://issues.apache.org/jira/browse/HADOOP-5490) | TestParallelInitialization failed on NoSuchElementException | Blocker | . | Hairong Kuang | Jothi Padmanabhan |
-| [HADOOP-5484](https://issues.apache.org/jira/browse/HADOOP-5484) | TestRecoveryManager fails wtih FileAlreadyExistsException | Major | test | Hairong Kuang | Amar Kamat |
-| [HADOOP-5483](https://issues.apache.org/jira/browse/HADOOP-5483) | Directory/file cleanup thread throws IllegalStateException | Major | . | Hairong Kuang | |
-| [HADOOP-5479](https://issues.apache.org/jira/browse/HADOOP-5479) | NameNode should not send empty block replication request to DataNode | Critical | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5473](https://issues.apache.org/jira/browse/HADOOP-5473) | Race condition in command-line kill for a task | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-5471](https://issues.apache.org/jira/browse/HADOOP-5471) | SyncLogs thread in Child.java would update wrong file for a cleanup attempt, in some cases. | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-5465](https://issues.apache.org/jira/browse/HADOOP-5465) | Blocks remain under-replicated | Blocker | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5463](https://issues.apache.org/jira/browse/HADOOP-5463) | Balancer throws "Not a host:port pair" unless port is specified in fs.default.name | Minor | . | Stuart White | Stuart White |
-| [HADOOP-5459](https://issues.apache.org/jira/browse/HADOOP-5459) | CRC errors not detected reading intermediate output into memory with problematic length | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-5440](https://issues.apache.org/jira/browse/HADOOP-5440) | Successful taskid are not removed from TaskMemoryManager | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-5437](https://issues.apache.org/jira/browse/HADOOP-5437) | Unit test for jvm -reuse | Blocker | . | Amareshwari Sriramadasu | Owen O'Malley |
-| [HADOOP-5432](https://issues.apache.org/jira/browse/HADOOP-5432) | TestHdfsProxy fails on 0.20 | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-5417](https://issues.apache.org/jira/browse/HADOOP-5417) | IPC client drops interrupted exceptions | Blocker | ipc | Owen O'Malley | Owen O'Malley |
-| [HADOOP-5416](https://issues.apache.org/jira/browse/HADOOP-5416) | Wrong description of " hadoop fs -test " in FS Shell guide . | Trivial | documentation | Ravi Phulari | Ravi Phulari |
-| [HADOOP-5414](https://issues.apache.org/jira/browse/HADOOP-5414) | IO exception while executing hadoop fs -touchz fileName | Major | fs | Ravi Phulari | Hairong Kuang |
-| [HADOOP-5394](https://issues.apache.org/jira/browse/HADOOP-5394) | JobTracker might schedule 2 attempts of the same task with the same attempt id across restarts | Critical | . | Amar Kamat | Amar Kamat |
-| [HADOOP-5390](https://issues.apache.org/jira/browse/HADOOP-5390) | hdfsproxy includes duplicate jars in tarball, source in binary tarball | Major | build | Chris Douglas | zhiyong zhang |
-| [HADOOP-5384](https://issues.apache.org/jira/browse/HADOOP-5384) | DataNodeCluster should not create blocks with generationStamp == 1 | Blocker | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-5382](https://issues.apache.org/jira/browse/HADOOP-5382) | The new map/reduce api doesn't support combiners | Blocker | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-5376](https://issues.apache.org/jira/browse/HADOOP-5376) | JobInProgress.obtainTaskCleanupTask() throws an ArrayIndexOutOfBoundsException | Blocker | . | Vinod Kumar Vavilapalli | Amareshwari Sriramadasu |
-| [HADOOP-5338](https://issues.apache.org/jira/browse/HADOOP-5338) | Reduce tasks are stuck waiting for map outputs when none are in progress | Blocker | . | Ramya Sunil | Amar Kamat |
-| [HADOOP-5337](https://issues.apache.org/jira/browse/HADOOP-5337) | JobTracker greedily schedules tasks without running tasks to join | Major | . | Karam Singh | Amar Kamat |
-| [HADOOP-5328](https://issues.apache.org/jira/browse/HADOOP-5328) | Renaming of Job histroy file is incorrect if Jobtracker is restarted multimple times | Major | . | Karam Singh | Amar Kamat |
-| [HADOOP-5327](https://issues.apache.org/jira/browse/HADOOP-5327) | Job files for a job failing because of ACLs are not clean from the system directory | Blocker | . | Karam Singh | Amar Kamat |
-| [HADOOP-5326](https://issues.apache.org/jira/browse/HADOOP-5326) | bzip2 codec (CBZip2OutputStream) creates corrupted output file for some inputs | Major | io | Rodrigo Schmidt | Rodrigo Schmidt |
-| [HADOOP-5320](https://issues.apache.org/jira/browse/HADOOP-5320) | TestMapReduceLocal is missing a close() that is causing it to fail while running the test on NFS | Minor | test | Jothi Padmanabhan | Jothi Padmanabhan |
-| [HADOOP-5306](https://issues.apache.org/jira/browse/HADOOP-5306) | Job History file can have empty string as http port after JobTracker Restart in case of lost TT, which can result in NumberFormatException when JT is restarted 2nd time | Blocker | . | Ravi Gummadi | Amar Kamat |
-| [HADOOP-5305](https://issues.apache.org/jira/browse/HADOOP-5305) | Unit test org.apache.hadoop.fs.TestCopyFiles.testMapCount fails on trunk | Minor | test | Ramya Sunil | Tsz Wo Nicholas Sze |
-| [HADOOP-5298](https://issues.apache.org/jira/browse/HADOOP-5298) | Unit test fails out on trunk org.apache.hadoop.http.TestServletFilter.testServletFilter | Major | test | Lee Tucker | Tsz Wo Nicholas Sze |
-| [HADOOP-5292](https://issues.apache.org/jira/browse/HADOOP-5292) | KFS: calling getFileBlockLocations() on 0-length file causes a NPE | Major | . | Sriram Rao | Sriram Rao |
-| [HADOOP-5285](https://issues.apache.org/jira/browse/HADOOP-5285) | JobTracker hangs for long periods of time | Blocker | . | Vinod Kumar Vavilapalli | Devaraj Das |
-| [HADOOP-5282](https://issues.apache.org/jira/browse/HADOOP-5282) | Running tasks on lost trackers are incorrectly logging the attempt and task failures | Blocker | . | Amar Kamat | Amar Kamat |
-| [HADOOP-5281](https://issues.apache.org/jira/browse/HADOOP-5281) | GzipCodec fails second time it is used in a process | Blocker | . | Ben Maurer | Chris Douglas |
-| [HADOOP-5280](https://issues.apache.org/jira/browse/HADOOP-5280) | When expiring a lost launched task, JT doesn't remove the attempt from the taskidToTIPMap. | Blocker | . | Vinod Kumar Vavilapalli | Devaraj Das |
-| [HADOOP-5274](https://issues.apache.org/jira/browse/HADOOP-5274) | gridmix2 is not getting compiled to generate gridmix.jar | Critical | benchmarks | Suman Sehgal | Chris Douglas |
-| [HADOOP-5272](https://issues.apache.org/jira/browse/HADOOP-5272) | JobTracker does not log TIP start information after restart | Critical | . | Amar Kamat | Amar Kamat |
-| [HADOOP-5269](https://issues.apache.org/jira/browse/HADOOP-5269) | TaskTracker.runningTasks holding FAILED\_UNCLEAN and KILLED\_UNCLEAN taskStatuses forever in some cases. | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-5259](https://issues.apache.org/jira/browse/HADOOP-5259) | Job with output hdfs:/user/\<username\>/outputpath (no authority) fails with Wrong FS | Major | fs | Koji Noguchi | Doug Cutting |
-| [HADOOP-5255](https://issues.apache.org/jira/browse/HADOOP-5255) | Fix for HADOOP-5079 HashFunction inadvertently destroys some randomness | Minor | io | stack | Jonathan Ellis |
-| [HADOOP-5248](https://issues.apache.org/jira/browse/HADOOP-5248) | Job directories could remain undeleted in some scenarios after job completes. | Blocker | . | Hemanth Yamijala | Devaraj Das |
-| [HADOOP-5247](https://issues.apache.org/jira/browse/HADOOP-5247) | NPEs in JobTracker and JobClient when mapred.jobtracker.completeuserjobs.maximum is set to zero. | Blocker | . | Vinod Kumar Vavilapalli | Amar Kamat |
-| [HADOOP-5241](https://issues.apache.org/jira/browse/HADOOP-5241) | Reduce tasks get stuck because of over-estimated task size (regression from 0.18) | Blocker | . | Andy Pavlo | Sharad Agarwal |
-| [HADOOP-5233](https://issues.apache.org/jira/browse/HADOOP-5233) | Reducer not Succeded after 100% | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-5227](https://issues.apache.org/jira/browse/HADOOP-5227) | distcp -delete option deletes all files from the destination directory | Major | . | Suhas Gogate | Tsz Wo Nicholas Sze |
-| [HADOOP-5214](https://issues.apache.org/jira/browse/HADOOP-5214) | ConcurrentModificationException in FairScheduler.getTotalSlots | Blocker | . | Vinod Kumar Vavilapalli | rahul k singh |
-| [HADOOP-5211](https://issues.apache.org/jira/browse/HADOOP-5211) | TestSetupAndCleanupFailure fails with timeout | Major | . | Enis Soztutar | Enis Soztutar |
-| [HADOOP-5154](https://issues.apache.org/jira/browse/HADOOP-5154) | 4-way deadlock in FairShare scheduler | Blocker | . | Vinod Kumar Vavilapalli | Matei Zaharia |
-| [HADOOP-5146](https://issues.apache.org/jira/browse/HADOOP-5146) | LocalDirAllocator misses files on the local filesystem | Blocker | . | Arun C Murthy | Devaraj Das |
-| [HADOOP-5145](https://issues.apache.org/jira/browse/HADOOP-5145) | Balancer sometimes runs out of memory after days or weeks running | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5142](https://issues.apache.org/jira/browse/HADOOP-5142) | MapWritable#putAll does not store classes | Minor | io | Doğacan Güney | |
-| [HADOOP-5139](https://issues.apache.org/jira/browse/HADOOP-5139) | RPC call throws IllegalArgumentException complaining duplicate metrics registration | Major | ipc | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5111](https://issues.apache.org/jira/browse/HADOOP-5111) | Generic mapreduce classes cannot be used with Job::set\* methods | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-5085](https://issues.apache.org/jira/browse/HADOOP-5085) | Copying a file to local with Crc throws an exception | Major | fs | Hairong Kuang | Hairong Kuang |
-| [HADOOP-5079](https://issues.apache.org/jira/browse/HADOOP-5079) | HashFunction inadvertently destroys some randomness | Major | util | Jonathan Ellis | Jonathan Ellis |
-| [HADOOP-5075](https://issues.apache.org/jira/browse/HADOOP-5075) | Potential infinite loop in updateMinSlots | Blocker | . | Matei Zaharia | Matei Zaharia |
-| [HADOOP-5068](https://issues.apache.org/jira/browse/HADOOP-5068) | testClusterBlockingForLackOfMemory in TestCapacityScheduler fails randomly | Major | . | Sreekanth Ramakrishnan | Vinod Kumar Vavilapalli |
-| [HADOOP-5066](https://issues.apache.org/jira/browse/HADOOP-5066) | ant binary should not compile docs | Major | build | Amareshwari Sriramadasu | Giridharan Kesavan |
-| [HADOOP-5065](https://issues.apache.org/jira/browse/HADOOP-5065) | setOutputFormatClass in mapreduce.Job fails for SequenceFileOutputFormat | Major | . | Chris Douglas | Chris Douglas |
-| [HADOOP-5048](https://issues.apache.org/jira/browse/HADOOP-5048) | Sometimes job is still displayed in jobqueue\_details page for long time after job was killed. | Major | . | Karam Singh | Sreekanth Ramakrishnan |
-| [HADOOP-5026](https://issues.apache.org/jira/browse/HADOOP-5026) | Startup scripts should be svn-executable | Minor | . | Andy Konwinski | Andy Konwinski |
-| [HADOOP-4999](https://issues.apache.org/jira/browse/HADOOP-4999) | IndexOutOfBoundsException in FSEditLog | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [HADOOP-4993](https://issues.apache.org/jira/browse/HADOOP-4993) | chukwa agent startup should be more modular | Major | . | Ari Rabkin | Ari Rabkin |
-| [HADOOP-4988](https://issues.apache.org/jira/browse/HADOOP-4988) | An earlier fix, for HADOOP-4373, results in a problem with reclaiming capacity when one or more queues have a capacity equal to zero | Blocker | . | Vivek Ratan | Vivek Ratan |
-| [HADOOP-4979](https://issues.apache.org/jira/browse/HADOOP-4979) | Capacity Scheduler does not always return no task to a TT if a job's memry requirements are not met | Major | . | Vivek Ratan | Vivek Ratan |
-| [HADOOP-4977](https://issues.apache.org/jira/browse/HADOOP-4977) | Deadlock between reclaimCapacity and assignTasks | Blocker | . | Matei Zaharia | Vivek Ratan |
-| [HADOOP-4963](https://issues.apache.org/jira/browse/HADOOP-4963) | Logs saying org.apache.hadoop.util.DiskChecker$DiskErrorException in TaskTracker are not relevant | Minor | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-4956](https://issues.apache.org/jira/browse/HADOOP-4956) | NPE when jobdetails.jsp | Blocker | . | Devaraj Das | Devaraj Das |
-| [HADOOP-4949](https://issues.apache.org/jira/browse/HADOOP-4949) | Native compilation is broken | Blocker | . | Chris Douglas | Chris Douglas |
-| [HADOOP-4947](https://issues.apache.org/jira/browse/HADOOP-4947) | use regex to parse chukwa commands | Minor | . | Ari Rabkin | Ari Rabkin |
-| [HADOOP-4925](https://issues.apache.org/jira/browse/HADOOP-4925) | Chukwa HTTP connection policies are too hard to configure | Major | . | Ari Rabkin | Ari Rabkin |
-| [HADOOP-4914](https://issues.apache.org/jira/browse/HADOOP-4914) | Support chkconfig for chukwa start up scripts | Trivial | . | Eric Yang | Eric Yang |
-| [HADOOP-4896](https://issues.apache.org/jira/browse/HADOOP-4896) | hdfs fsck does not load hdfs configuration. | Blocker | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-4894](https://issues.apache.org/jira/browse/HADOOP-4894) | fix Chukwa's jettyCollector.sh | Minor | . | Ari Rabkin | Ari Rabkin |
-| [HADOOP-4892](https://issues.apache.org/jira/browse/HADOOP-4892) | File descriptor leak in Chukwa's ExecPlugin | Major | . | Ari Rabkin | Ari Rabkin |
-| [HADOOP-4889](https://issues.apache.org/jira/browse/HADOOP-4889) | Chukwa RPM needs to chown user/group in build stage instead of post install stage. | Trivial | . | Eric Yang | Eric Yang |
-| [HADOOP-4884](https://issues.apache.org/jira/browse/HADOOP-4884) | Change Date format pattern for Time Series graph | Trivial | . | Eric Yang | Eric Yang |
+| [HADOOP-4245](https://issues.apache.org/jira/browse/HADOOP-4245) | KFS: Update the kfs jar file | Major | fs | Sriram Rao | Sriram Rao |
+| [HADOOP-4262](https://issues.apache.org/jira/browse/HADOOP-4262) | message generated when the client exception has a null message is not useful | Minor | ipc | Steve Loughran | |
+| [HADOOP-4204](https://issues.apache.org/jira/browse/HADOOP-4204) | Fix warnings generated by FindBugs | Blocker | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-4207](https://issues.apache.org/jira/browse/HADOOP-4207) | update derby.jar to eliminate the one time wait of 2-3 minutes while running junit tests | Minor | . | Prasad Chakka | Prasad Chakka |
+| [HADOOP-4325](https://issues.apache.org/jira/browse/HADOOP-4325) | Hadoop SocketInputStream.read() should return -1 in case of EOF. | Minor | io | Raghu Angadi | Raghu Angadi |
+| [HADOOP-4408](https://issues.apache.org/jira/browse/HADOOP-4408) | FsAction operations shouldn't create new Objects | Minor | fs | Chris Douglas | Chris Douglas |
+| [HADOOP-4238](https://issues.apache.org/jira/browse/HADOOP-4238) | [mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A" | Major | . | Vinod Kumar Vavilapalli | Sreekanth Ramakrishnan |
+| [HADOOP-3842](https://issues.apache.org/jira/browse/HADOOP-3842) | There is a window where the JobTracker is in the RUNNING state (i.e ready to accept jobs) and never executes them. | Major | . | Amar Kamat | Hemanth Yamijala |
+| [HADOOP-4346](https://issues.apache.org/jira/browse/HADOOP-4346) | Hadoop triggers a "soft" fd leak. | Major | io | Raghu Angadi | Raghu Angadi |
+| [HADOOP-4388](https://issues.apache.org/jira/browse/HADOOP-4388) | Bug in Datanode transferBlocks code | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-4587](https://issues.apache.org/jira/browse/HADOOP-4587) | typo in javadoc for map.input.file | Trivial | documentation | Koji Noguchi | Koji Noguchi |
+| [HADOOP-4530](https://issues.apache.org/jira/browse/HADOOP-4530) | In fsck, HttpServletResponse sendError fails with IllegalStateException | Major | . | Koji Noguchi | Hairong Kuang |
+| [HADOOP-4377](https://issues.apache.org/jira/browse/HADOOP-4377) | Race condition creating S3 buffer directory for NativeS3FileSystem | Major | fs/s3 | David Phillips | David Phillips |
+| [HADOOP-4583](https://issues.apache.org/jira/browse/HADOOP-4583) | Code optimization/cleanup in HDFS | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-4621](https://issues.apache.org/jira/browse/HADOOP-4621) | javadoc: warning - Multiple sources of package comments found for some packages | Major | documentation | Tsz Wo Nicholas Sze | Kan Zhang |
+| [HADOOP-4571](https://issues.apache.org/jira/browse/HADOOP-4571) | chukwa conf files are not cleaned up | Minor | . | Tsz Wo Nicholas Sze | Eric Yang |
+| [HADOOP-4589](https://issues.apache.org/jira/browse/HADOOP-4589) | Fix the PiEstimator output messages and code comments | Minor | documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4650](https://issues.apache.org/jira/browse/HADOOP-4650) | local.cache.size is set to 10 GB, while DEFAULT\_CACHE\_SIZE is set to 1 MB | Trivial | filecache | Jeff Hammerbacher | Jeff Hammerbacher |
+| [HADOOP-4608](https://issues.apache.org/jira/browse/HADOOP-4608) | Examples -Driver does not check first argument. | Major | . | Edward J. Yoon | Edward J. Yoon |
+| [HADOOP-4645](https://issues.apache.org/jira/browse/HADOOP-4645) | hdfs proxy doesn't package itself right. | Major | . | Owen O'Malley | Kan Zhang |
+| [HADOOP-4606](https://issues.apache.org/jira/browse/HADOOP-4606) | There is a cygpath error if log directory does not exist | Minor | scripts | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4141](https://issues.apache.org/jira/browse/HADOOP-4141) | ScriptBasedMapping has infinite loop with invalid jobconf parameter | Minor | . | Aaron Kimball | Aaron Kimball |
+| [HADOOP-3293](https://issues.apache.org/jira/browse/HADOOP-3293) | When an input split spans cross block boundary, the split location should be the host having most of bytes on it. | Major | . | Runping Qi | Jothi Padmanabhan |
+| [HADOOP-4691](https://issues.apache.org/jira/browse/HADOOP-4691) | In the javadoc of IndexedSortable.compare(...), the link is wrong. | Minor | documentation, util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4598](https://issues.apache.org/jira/browse/HADOOP-4598) | '-setrep' command skips under-replicated blocks | Minor | . | Koji Noguchi | Hairong Kuang |
+| [HADOOP-4429](https://issues.apache.org/jira/browse/HADOOP-4429) | Misconfigured UNIX Groups Break Hadoop | Minor | . | Alex Loddengaard | Alex Loddengaard |
+| [HADOOP-4676](https://issues.apache.org/jira/browse/HADOOP-4676) | Go back to Job has a wrong URL on blacklisted trackers page | Minor | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-4704](https://issues.apache.org/jira/browse/HADOOP-4704) | javadoc: "the the" =\> "the" | Trivial | documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-4513](https://issues.apache.org/jira/browse/HADOOP-4513) | Capacity scheduler should initialize tasks asynchronously | Major | . | Hemanth Yamijala | Sreekanth Ramakrishnan |
+| [HADOOP-4677](https://issues.apache.org/jira/browse/HADOOP-4677) | FileSystem.getFileBlockLocations() (aka default implementation for Local FileSystem) incorrect. | Major | fs | Hong Tang | Hong Tang |
+| [HADOOP-4669](https://issues.apache.org/jira/browse/HADOOP-4669) | A file-open sometimes may not set the access time of a file | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-4732](https://issues.apache.org/jira/browse/HADOOP-4732) | connectionTimeout and readTimeout are passed in wrong order in ReduceTask.java | Minor | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-2771](https://issues.apache.org/jira/browse/HADOOP-2771) | changing the number of reduces dramatically changes the time of the map time | Major | . | Owen O'Malley | |
+| [HADOOP-4558](https://issues.apache.org/jira/browse/HADOOP-4558) | Scheduler fails to reclaim capacity if Jobs are submitted to queue one after the other | Major | . | Karam Singh | Amar Kamat |
+| [HADOOP-4770](https://issues.apache.org/jira/browse/HADOOP-4770) | gridmix2 run script doesn't work on trunk | Trivial | benchmarks | Chris Douglas | Chris Douglas |
+| [HADOOP-4738](https://issues.apache.org/jira/browse/HADOOP-4738) | saveVersion.sh could write a package-info.java that cannot be compiled when used with git | Trivial | build | Hemanth Yamijala | Chris Douglas |
+| [HADOOP-4623](https://issues.apache.org/jira/browse/HADOOP-4623) | Running tasks are not maintained by JobInProgress if speculation is off | Major | . | Amar Kamat | Amar Kamat |
+| [HADOOP-4786](https://issues.apache.org/jira/browse/HADOOP-4786) | TestTrackerBlacklistAcrossJobs compilation is broken | Blocker | . | Hemanth Yamijala | Hemanth Yamijala |
+| [HADOOP-4785](https://issues.apache.org/jira/browse/HADOOP-4785) | avoid two calls to System.currentTimeMillis() in heartbeat | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-4792](https://issues.apache.org/jira/browse/HADOOP-4792) | Chukwa build process generates files not tracked by svn | Major | build | Chris Douglas | Chris Douglas |
+| [HADOOP-4796](https://issues.apache.org/jira/browse/HADOOP-4796) | Test target for chukwa build.xml needs to comply to hadoop build.xml test suites | Major | build | Eric Yang | Eric Yang |
+| [HADOOP-4579](https://issues.apache.org/jira/browse/HADOOP-4579) | StorageDirectory is not removed from the storage directories list when writing to an edits fails | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [HADOOP-4811](https://issues.apache.org/jira/browse/HADOOP-4811) | Import style sheet images for Chukwa | Trivial | . | Eric Yang | Eric Yang |
+| [HADOOP-4805](https://issues.apache.org/jira/browse/HADOOP-4805) | Remove black list feature from Chukwa Agent to Chukwa Collector communication | Major | . | Eric Yang | Eric Yang |
+| [HADOOP-4737](https://issues.apache.org/jira/browse/HADOOP-4737) | Job end notification should give status as "KILLED" when job gets killed. | Major | . | Ruchir Shah | Amareshwari Sriramadasu |
+| [HADOOP-4825](https://issues.apache.org/jira/browse/HADOOP-4825) | Chukwa - change jps to ps for process status detection | Major | . | Eric Yang | Eric Yang |
+| [HADOOP-4844](https://issues.apache.org/jira/browse/HADOOP-4844) | Document deprecation of o.a.h.fs.permission.AccessControlException better | Minor | documentation, fs | Arun C Murthy | Arun C Murthy |
+| [HADOOP-4706](https://issues.apache.org/jira/browse/HADOOP-4706) | IFileOutputStream.close should call close of the underlying stream | Minor | . | Jothi Padmanabhan | Jothi Padmanabhan |
+| [HADOOP-4683](https://issues.apache.org/jira/browse/HADOOP-4683) | Move the call to getMapCompletionEvents in ReduceTask.ReduceCopier.fetchOutputs to a separate thread | Major | . | Devaraj Das | Jothi Padmanabhan |
+| [HADOOP-4855](https://issues.apache.org/jira/browse/HADOOP-4855) | Fix help message in MRAdmin | Minor | fs, security | Arun C Murthy | Arun C Murthy |
+| [HADOOP-4820](https://issues.apache.org/jira/browse/HADOOP-4820) | Remove unused method FSNamesystem.deleteInSafeMode | Minor | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-4698](https://issues.apache.org/jira/browse/HADOOP-4698) | TestMapRed fails with 64bit JDK | Major | test | Nigel Daley | Nigel Daley |
+| [HADOOP-4860](https://issues.apache.org/jira/browse/HADOOP-4860) | File Tailing Adaptor test cases causes random failure | Major | . | Eric Yang | Eric Yang |
+| [HADOOP-3921](https://issues.apache.org/jira/browse/HADOOP-3921) | Clover breaks nightly builds | Major | build | Tom White | Tom White |
+| [HADOOP-4845](https://issues.apache.org/jira/browse/HADOOP-4845) | Shuffle counter issues | Major | . | Chris Douglas | He Yongqiang |
| [HADOOP-4879](https://issues.apache.org/jira/browse/HADOOP-4879) | TestJobTrackerRestart fails on trunk | Blocker | test | Arun C Murthy | Owen O'Malley |
+| [HADOOP-4791](https://issues.apache.org/jira/browse/HADOOP-4791) | Improve rpm build process for Chukwa | Major | . | Eric Yang | Eric Yang |
+| [HADOOP-4771](https://issues.apache.org/jira/browse/HADOOP-4771) | FSImage saveFSImage() will have problem. | Major | . | Ruyue Ma | Ruyue Ma |
| [HADOOP-4878](https://issues.apache.org/jira/browse/HADOOP-4878) | After introduction of ivy ant test-patch always returns -1 score | Blocker | build | Sreekanth Ramakrishnan | Giridharan Kesavan |
-| [HADOOP-4876](https://issues.apache.org/jira/browse/HADOOP-4876) | Capacity reclaimation for queue would not work as intended | Blocker | . | Sreekanth Ramakrishnan | Sreekanth Ramakrishnan |
| [HADOOP-4874](https://issues.apache.org/jira/browse/HADOOP-4874) | Remove bindings to lzo | Blocker | io | Owen O'Malley | Owen O'Malley |
-| [HADOOP-4873](https://issues.apache.org/jira/browse/HADOOP-4873) | display minMaps/Reduces on advanced scheduler page | Major | . | Joydeep Sen Sarma | Joydeep Sen Sarma |
+| [HADOOP-4774](https://issues.apache.org/jira/browse/HADOOP-4774) | CapacityScheduler should work even if capacity-scheduler.xml is not in the classpath i.e with the code defaults | Major | . | Amar Kamat | Sreekanth Ramakrishnan |
+| [HADOOP-4876](https://issues.apache.org/jira/browse/HADOOP-4876) | Capacity reclaimation for queue would not work as intended | Blocker | . | Sreekanth Ramakrishnan | Sreekanth Ramakrishnan |
+| [HADOOP-4782](https://issues.apache.org/jira/browse/HADOOP-4782) | [HOD] HOD opens up directory permissions more than required | Blocker | contrib/hod | Hemanth Yamijala | Peeyush Bishnoi |
+| [HADOOP-4849](https://issues.apache.org/jira/browse/HADOOP-4849) | Document service level authorization - HADOOP-4348 | Major | documentation, scripts | Arun C Murthy | Arun C Murthy |
+| [HADOOP-4894](https://issues.apache.org/jira/browse/HADOOP-4894) | fix Chukwa's jettyCollector.sh | Minor | . | Ari Rabkin | Ari Rabkin |
+| [HADOOP-4892](https://issues.apache.org/jira/browse/HADOOP-4892) | File descriptor leak in Chukwa's ExecPlugin | Major | . | Ari Rabkin | Ari Rabkin |
+| [HADOOP-4889](https://issues.apache.org/jira/browse/HADOOP-4889) | Chukwa RPM needs to chown user/group in build stage instead of post install stage. | Trivial | . | Eric Yang | Eric Yang |
| [HADOOP-4869](https://issues.apache.org/jira/browse/HADOOP-4869) | Lost Trackers may not be able to join back | Blocker | . | Devaraj Das | Amareshwari Sriramadasu |
-| [HADOOP-4860](https://issues.apache.org/jira/browse/HADOOP-4860) | File Tailing Adaptor test cases causes random failure | Major | . | Eric Yang | Eric Yang |
-| [HADOOP-4855](https://issues.apache.org/jira/browse/HADOOP-4855) | Fix help message in MRAdmin | Minor | fs, security | Arun C Murthy | Arun C Murthy |
+| [HADOOP-4716](https://issues.apache.org/jira/browse/HADOOP-4716) | testRestartWithLostTracker frequently times out | Blocker | . | Johan Oskarsson | Amar Kamat |
| [HADOOP-4854](https://issues.apache.org/jira/browse/HADOOP-4854) | Capacity Scheduler should read the reclaim-capacity-interval config value from its own config file | Minor | . | Vivek Ratan | Sreekanth Ramakrishnan |
-| [HADOOP-4849](https://issues.apache.org/jira/browse/HADOOP-4849) | Document service level authorization - HADOOP-4348 | Major | documentation, scripts | Arun C Murthy | Arun C Murthy |
-| [HADOOP-4845](https://issues.apache.org/jira/browse/HADOOP-4845) | Shuffle counter issues | Major | . | Chris Douglas | He Yongqiang |
-| [HADOOP-4844](https://issues.apache.org/jira/browse/HADOOP-4844) | Document deprecation of o.a.h.fs.permission.AccessControlException better | Minor | documentation, fs | Arun C Murthy | Arun C Murthy |
+| [HADOOP-4896](https://issues.apache.org/jira/browse/HADOOP-4896) | hdfs fsck does not load hdfs configuration. | Blocker | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-4956](https://issues.apache.org/jira/browse/HADOOP-4956) | NPE when jobdetails.jsp | Blocker | . | Devaraj Das | Devaraj Das |
+| [HADOOP-4979](https://issues.apache.org/jira/browse/HADOOP-4979) | Capacity Scheduler does not always return no task to a TT if a job's memry requirements are not met | Major | . | Vivek Ratan | Vivek Ratan |
| [HADOOP-4830](https://issues.apache.org/jira/browse/HADOOP-4830) | Have end to end tests based on MiniMRCluster to verify that queue capacities are honoured. | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [HADOOP-4825](https://issues.apache.org/jira/browse/HADOOP-4825) | Chukwa - change jps to ps for process status detection | Major | . | Eric Yang | Eric Yang |
-| [HADOOP-4820](https://issues.apache.org/jira/browse/HADOOP-4820) | Remove unused method FSNamesystem.deleteInSafeMode | Minor | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-4818](https://issues.apache.org/jira/browse/HADOOP-4818) | Enable JobTracker Instrumentation API with user job configuration | Major | . | Eric Yang | Eric Yang |
-| [HADOOP-4811](https://issues.apache.org/jira/browse/HADOOP-4811) | Import style sheet images for Chukwa | Trivial | . | Eric Yang | Eric Yang |
-| [HADOOP-4805](https://issues.apache.org/jira/browse/HADOOP-4805) | Remove black list feature from Chukwa Agent to Chukwa Collector communication | Major | . | Eric Yang | Eric Yang |
-| [HADOOP-4796](https://issues.apache.org/jira/browse/HADOOP-4796) | Test target for chukwa build.xml needs to comply to hadoop build.xml test suites | Major | build | Eric Yang | Eric Yang |
-| [HADOOP-4792](https://issues.apache.org/jira/browse/HADOOP-4792) | Chukwa build process generates files not tracked by svn | Major | build | Chris Douglas | Chris Douglas |
-| [HADOOP-4791](https://issues.apache.org/jira/browse/HADOOP-4791) | Improve rpm build process for Chukwa | Major | . | Eric Yang | Eric Yang |
+| [HADOOP-4949](https://issues.apache.org/jira/browse/HADOOP-4949) | Native compilation is broken | Blocker | . | Chris Douglas | Chris Douglas |
| [HADOOP-4787](https://issues.apache.org/jira/browse/HADOOP-4787) | TestTrackerBlacklistAcrossJobs fails randomly | Blocker | test | Hemanth Yamijala | Amareshwari Sriramadasu |
-| [HADOOP-4786](https://issues.apache.org/jira/browse/HADOOP-4786) | TestTrackerBlacklistAcrossJobs compilation is broken | Blocker | . | Hemanth Yamijala | Hemanth Yamijala |
-| [HADOOP-4785](https://issues.apache.org/jira/browse/HADOOP-4785) | avoid two calls to System.currentTimeMillis() in heartbeat | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-4782](https://issues.apache.org/jira/browse/HADOOP-4782) | [HOD] HOD opens up directory permissions more than required | Blocker | contrib/hod | Hemanth Yamijala | Peeyush Bishnoi |
-| [HADOOP-4774](https://issues.apache.org/jira/browse/HADOOP-4774) | CapacityScheduler should work even if capacity-scheduler.xml is not in the classpath i.e with the code defaults | Major | . | Amar Kamat | Sreekanth Ramakrishnan |
-| [HADOOP-4771](https://issues.apache.org/jira/browse/HADOOP-4771) | FSImage saveFSImage() will have problem. | Major | . | Ruyue Ma | Ruyue Ma |
-| [HADOOP-4770](https://issues.apache.org/jira/browse/HADOOP-4770) | gridmix2 run script doesn't work on trunk | Trivial | benchmarks | Chris Douglas | Chris Douglas |
-| [HADOOP-4744](https://issues.apache.org/jira/browse/HADOOP-4744) | Wrong resolution of hostname and port | Blocker | . | Amareshwari Sriramadasu | Jothi Padmanabhan |
-| [HADOOP-4738](https://issues.apache.org/jira/browse/HADOOP-4738) | saveVersion.sh could write a package-info.java that cannot be compiled when used with git | Trivial | build | Hemanth Yamijala | Chris Douglas |
-| [HADOOP-4737](https://issues.apache.org/jira/browse/HADOOP-4737) | Job end notification should give status as "KILLED" when job gets killed. | Major | . | Ruchir Shah | Amareshwari Sriramadasu |
-| [HADOOP-4732](https://issues.apache.org/jira/browse/HADOOP-4732) | connectionTimeout and readTimeout are passed in wrong order in ReduceTask.java | Minor | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-4716](https://issues.apache.org/jira/browse/HADOOP-4716) | testRestartWithLostTracker frequently times out | Blocker | . | Johan Oskarsson | Amar Kamat |
-| [HADOOP-4706](https://issues.apache.org/jira/browse/HADOOP-4706) | IFileOutputStream.close should call close of the underlying stream | Minor | . | Jothi Padmanabhan | Jothi Padmanabhan |
-| [HADOOP-4704](https://issues.apache.org/jira/browse/HADOOP-4704) | javadoc: "the the" =\> "the" | Trivial | documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4698](https://issues.apache.org/jira/browse/HADOOP-4698) | TestMapRed fails with 64bit JDK | Major | test | Nigel Daley | Nigel Daley |
-| [HADOOP-4695](https://issues.apache.org/jira/browse/HADOOP-4695) | TestGlobalFilter.testServletFilter fails | Blocker | test | Tsz Wo Nicholas Sze | Kan Zhang |
-| [HADOOP-4692](https://issues.apache.org/jira/browse/HADOOP-4692) | Namenode in infinite loop for replicating/deleting corrupted block | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-4691](https://issues.apache.org/jira/browse/HADOOP-4691) | In the javadoc of IndexedSortable.compare(...), the link is wrong. | Minor | documentation, util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4683](https://issues.apache.org/jira/browse/HADOOP-4683) | Move the call to getMapCompletionEvents in ReduceTask.ReduceCopier.fetchOutputs to a separate thread | Major | . | Devaraj Das | Jothi Padmanabhan |
-| [HADOOP-4677](https://issues.apache.org/jira/browse/HADOOP-4677) | FileSystem.getFileBlockLocations() (aka default implementation for Local FileSystem) incorrect. | Major | fs | Hong Tang | Hong Tang |
-| [HADOOP-4676](https://issues.apache.org/jira/browse/HADOOP-4676) | Go back to Job has a wrong URL on blacklisted trackers page | Minor | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-4914](https://issues.apache.org/jira/browse/HADOOP-4914) | Support chkconfig for chukwa start up scripts | Trivial | . | Eric Yang | Eric Yang |
+| [HADOOP-4884](https://issues.apache.org/jira/browse/HADOOP-4884) | Change Date format pattern for Time Series graph | Trivial | . | Eric Yang | Eric Yang |
+| [HADOOP-4925](https://issues.apache.org/jira/browse/HADOOP-4925) | Chukwa HTTP connection policies are too hard to configure | Major | . | Ari Rabkin | Ari Rabkin |
+| [HADOOP-4947](https://issues.apache.org/jira/browse/HADOOP-4947) | use regex to parse chukwa commands | Minor | . | Ari Rabkin | Ari Rabkin |
+| [HADOOP-5026](https://issues.apache.org/jira/browse/HADOOP-5026) | Startup scripts should be svn-executable | Minor | . | Andy Konwinski | Andy Konwinski |
+| [HADOOP-4977](https://issues.apache.org/jira/browse/HADOOP-4977) | Deadlock between reclaimCapacity and assignTasks | Blocker | . | Matei Zaharia | Vivek Ratan |
+| [HADOOP-4988](https://issues.apache.org/jira/browse/HADOOP-4988) | An earlier fix, for HADOOP-4373, results in a problem with reclaiming capacity when one or more queues have a capacity equal to zero | Blocker | . | Vivek Ratan | Vivek Ratan |
+| [HADOOP-5065](https://issues.apache.org/jira/browse/HADOOP-5065) | setOutputFormatClass in mapreduce.Job fails for SequenceFileOutputFormat | Major | . | Chris Douglas | Chris Douglas |
+| [HADOOP-4818](https://issues.apache.org/jira/browse/HADOOP-4818) | Enable JobTracker Instrumentation API with user job configuration | Major | . | Eric Yang | Eric Yang |
+| [HADOOP-4993](https://issues.apache.org/jira/browse/HADOOP-4993) | chukwa agent startup should be more modular | Major | . | Ari Rabkin | Ari Rabkin |
+| [HADOOP-5048](https://issues.apache.org/jira/browse/HADOOP-5048) | Sometimes job is still displayed in jobqueue\_details page for long time after job was killed. | Major | . | Karam Singh | Sreekanth Ramakrishnan |
+| [HADOOP-5075](https://issues.apache.org/jira/browse/HADOOP-5075) | Potential infinite loop in updateMinSlots | Blocker | . | Matei Zaharia | Matei Zaharia |
| [HADOOP-4671](https://issues.apache.org/jira/browse/HADOOP-4671) | Make some "flag" booleans volatile because they are set/read in different threads | Minor | . | Owen O'Malley | Chris Douglas |
-| [HADOOP-4669](https://issues.apache.org/jira/browse/HADOOP-4669) | A file-open sometimes may not set the access time of a file | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-4650](https://issues.apache.org/jira/browse/HADOOP-4650) | local.cache.size is set to 10 GB, while DEFAULT\_CACHE\_SIZE is set to 1 MB | Trivial | filecache | Jeff Hammerbacher | Jeff Hammerbacher |
-| [HADOOP-4645](https://issues.apache.org/jira/browse/HADOOP-4645) | hdfs proxy doesn't package itself right. | Major | . | Owen O'Malley | Kan Zhang |
+| [HADOOP-4999](https://issues.apache.org/jira/browse/HADOOP-4999) | IndexOutOfBoundsException in FSEditLog | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [HADOOP-5139](https://issues.apache.org/jira/browse/HADOOP-5139) | RPC call throws IllegalArgumentException complaining duplicate metrics registration | Major | ipc | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5085](https://issues.apache.org/jira/browse/HADOOP-5085) | Copying a file to local with Crc throws an exception | Major | fs | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5079](https://issues.apache.org/jira/browse/HADOOP-5079) | HashFunction inadvertently destroys some randomness | Major | util | Jonathan Ellis | Jonathan Ellis |
+| [HADOOP-5211](https://issues.apache.org/jira/browse/HADOOP-5211) | TestSetupAndCleanupFailure fails with timeout | Major | . | Enis Soztutar | Enis Soztutar |
+| [HADOOP-4873](https://issues.apache.org/jira/browse/HADOOP-4873) | display minMaps/Reduces on advanced scheduler page | Major | . | Joydeep Sen Sarma | Joydeep Sen Sarma |
+| [HADOOP-4692](https://issues.apache.org/jira/browse/HADOOP-4692) | Namenode in infinite loop for replicating/deleting corrupted block | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5255](https://issues.apache.org/jira/browse/HADOOP-5255) | Fix for HADOOP-5079 HashFunction inadvertently destroys some randomness | Minor | io | stack | Jonathan Ellis |
+| [HADOOP-5269](https://issues.apache.org/jira/browse/HADOOP-5269) | TaskTracker.runningTasks holding FAILED\_UNCLEAN and KILLED\_UNCLEAN taskStatuses forever in some cases. | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-5214](https://issues.apache.org/jira/browse/HADOOP-5214) | ConcurrentModificationException in FairScheduler.getTotalSlots | Blocker | . | Vinod Kumar Vavilapalli | rahul k singh |
+| [HADOOP-5233](https://issues.apache.org/jira/browse/HADOOP-5233) | Reducer not Succeded after 100% | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-5247](https://issues.apache.org/jira/browse/HADOOP-5247) | NPEs in JobTracker and JobClient when mapred.jobtracker.completeuserjobs.maximum is set to zero. | Blocker | . | Vinod Kumar Vavilapalli | Amar Kamat |
+| [HADOOP-5282](https://issues.apache.org/jira/browse/HADOOP-5282) | Running tasks on lost trackers are incorrectly logging the attempt and task failures | Blocker | . | Amar Kamat | Amar Kamat |
+| [HADOOP-4963](https://issues.apache.org/jira/browse/HADOOP-4963) | Logs saying org.apache.hadoop.util.DiskChecker$DiskErrorException in TaskTracker are not relevant | Minor | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-5292](https://issues.apache.org/jira/browse/HADOOP-5292) | KFS: calling getFileBlockLocations() on 0-length file causes a NPE | Major | . | Sriram Rao | Sriram Rao |
+| [HADOOP-5285](https://issues.apache.org/jira/browse/HADOOP-5285) | JobTracker hangs for long periods of time | Blocker | . | Vinod Kumar Vavilapalli | Devaraj Das |
+| [HADOOP-5241](https://issues.apache.org/jira/browse/HADOOP-5241) | Reduce tasks get stuck because of over-estimated task size (regression from 0.18) | Blocker | . | Andy Pavlo | Sharad Agarwal |
+| [HADOOP-5142](https://issues.apache.org/jira/browse/HADOOP-5142) | MapWritable#putAll does not store classes | Minor | io | Doğacan Güney | |
+| [HADOOP-5280](https://issues.apache.org/jira/browse/HADOOP-5280) | When expiring a lost launched task, JT doesn't remove the attempt from the taskidToTIPMap. | Blocker | . | Vinod Kumar Vavilapalli | Devaraj Das |
+| [HADOOP-5272](https://issues.apache.org/jira/browse/HADOOP-5272) | JobTracker does not log TIP start information after restart | Critical | . | Amar Kamat | Amar Kamat |
+| [HADOOP-5154](https://issues.apache.org/jira/browse/HADOOP-5154) | 4-way deadlock in FairShare scheduler | Blocker | . | Vinod Kumar Vavilapalli | Matei Zaharia |
+| [HADOOP-5306](https://issues.apache.org/jira/browse/HADOOP-5306) | Job History file can have empty string as http port after JobTracker Restart in case of lost TT, which can result in NumberFormatException when JT is restarted 2nd time | Blocker | . | Ravi Gummadi | Amar Kamat |
+| [HADOOP-5248](https://issues.apache.org/jira/browse/HADOOP-5248) | Job directories could remain undeleted in some scenarios after job completes. | Blocker | . | Hemanth Yamijala | Devaraj Das |
+| [HADOOP-5111](https://issues.apache.org/jira/browse/HADOOP-5111) | Generic mapreduce classes cannot be used with Job::set\* methods | Major | . | Chris Douglas | Chris Douglas |
+| [HADOOP-5146](https://issues.apache.org/jira/browse/HADOOP-5146) | LocalDirAllocator misses files on the local filesystem | Blocker | . | Arun C Murthy | Devaraj Das |
+| [HADOOP-5326](https://issues.apache.org/jira/browse/HADOOP-5326) | bzip2 codec (CBZip2OutputStream) creates corrupted output file for some inputs | Major | io | Rodrigo Schmidt | Rodrigo Schmidt |
+| [HADOOP-4744](https://issues.apache.org/jira/browse/HADOOP-4744) | Wrong resolution of hostname and port | Blocker | . | Amareshwari Sriramadasu | Jothi Padmanabhan |
| [HADOOP-4638](https://issues.apache.org/jira/browse/HADOOP-4638) | Exception thrown in/from RecoveryManager.recover() should be caught and handled | Blocker | . | Amar Kamat | Amar Kamat |
-| [HADOOP-4623](https://issues.apache.org/jira/browse/HADOOP-4623) | Running tasks are not maintained by JobInProgress if speculation is off | Major | . | Amar Kamat | Amar Kamat |
-| [HADOOP-4621](https://issues.apache.org/jira/browse/HADOOP-4621) | javadoc: warning - Multiple sources of package comments found for some packages | Major | documentation | Tsz Wo Nicholas Sze | Kan Zhang |
-| [HADOOP-4608](https://issues.apache.org/jira/browse/HADOOP-4608) | Examples -Driver does not check first argument. | Major | . | Edward J. Yoon | Edward J. Yoon |
-| [HADOOP-4606](https://issues.apache.org/jira/browse/HADOOP-4606) | There is a cygpath error if log directory does not exist | Minor | scripts | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4598](https://issues.apache.org/jira/browse/HADOOP-4598) | '-setrep' command skips under-replicated blocks | Minor | . | Koji Noguchi | Hairong Kuang |
-| [HADOOP-4589](https://issues.apache.org/jira/browse/HADOOP-4589) | Fix the PiEstimator output messages and code comments | Minor | documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-4587](https://issues.apache.org/jira/browse/HADOOP-4587) | typo in javadoc for map.input.file | Trivial | documentation | Koji Noguchi | Koji Noguchi |
-| [HADOOP-4583](https://issues.apache.org/jira/browse/HADOOP-4583) | Code optimization/cleanup in HDFS | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-4579](https://issues.apache.org/jira/browse/HADOOP-4579) | StorageDirectory is not removed from the storage directories list when writing to an edits fails | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [HADOOP-4571](https://issues.apache.org/jira/browse/HADOOP-4571) | chukwa conf files are not cleaned up | Minor | . | Tsz Wo Nicholas Sze | Eric Yang |
-| [HADOOP-4558](https://issues.apache.org/jira/browse/HADOOP-4558) | Scheduler fails to reclaim capacity if Jobs are submitted to queue one after the other | Major | . | Karam Singh | Amar Kamat |
-| [HADOOP-4530](https://issues.apache.org/jira/browse/HADOOP-4530) | In fsck, HttpServletResponse sendError fails with IllegalStateException | Major | . | Koji Noguchi | Hairong Kuang |
-| [HADOOP-4513](https://issues.apache.org/jira/browse/HADOOP-4513) | Capacity scheduler should initialize tasks asynchronously | Major | . | Hemanth Yamijala | Sreekanth Ramakrishnan |
-| [HADOOP-4429](https://issues.apache.org/jira/browse/HADOOP-4429) | Misconfigured UNIX Groups Break Hadoop | Minor | . | Alex Loddengaard | Alex Loddengaard |
-| [HADOOP-4408](https://issues.apache.org/jira/browse/HADOOP-4408) | FsAction operations shouldn't create new Objects | Minor | fs | Chris Douglas | Chris Douglas |
-| [HADOOP-4388](https://issues.apache.org/jira/browse/HADOOP-4388) | Bug in Datanode transferBlocks code | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-4377](https://issues.apache.org/jira/browse/HADOOP-4377) | Race condition creating S3 buffer directory for NativeS3FileSystem | Major | fs/s3 | David Phillips | David Phillips |
+| [HADOOP-5274](https://issues.apache.org/jira/browse/HADOOP-5274) | gridmix2 is not getting compiled to generate gridmix.jar | Critical | benchmarks | Suman Sehgal | Chris Douglas |
+| [HADOOP-5066](https://issues.apache.org/jira/browse/HADOOP-5066) | ant binary should not compile docs | Major | build | Amareshwari Sriramadasu | Giridharan Kesavan |
+| [HADOOP-5384](https://issues.apache.org/jira/browse/HADOOP-5384) | DataNodeCluster should not create blocks with generationStamp == 1 | Blocker | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-5145](https://issues.apache.org/jira/browse/HADOOP-5145) | Balancer sometimes runs out of memory after days or weeks running | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5338](https://issues.apache.org/jira/browse/HADOOP-5338) | Reduce tasks are stuck waiting for map outputs when none are in progress | Blocker | . | Ramya Sunil | Amar Kamat |
+| [HADOOP-5376](https://issues.apache.org/jira/browse/HADOOP-5376) | JobInProgress.obtainTaskCleanupTask() throws an ArrayIndexOutOfBoundsException | Blocker | . | Vinod Kumar Vavilapalli | Amareshwari Sriramadasu |
+| [HADOOP-4695](https://issues.apache.org/jira/browse/HADOOP-4695) | TestGlobalFilter.testServletFilter fails | Blocker | test | Tsz Wo Nicholas Sze | Kan Zhang |
+| [HADOOP-5298](https://issues.apache.org/jira/browse/HADOOP-5298) | Unit test fails out on trunk org.apache.hadoop.http.TestServletFilter.testServletFilter | Major | test | Lee Tucker | Tsz Wo Nicholas Sze |
+| [HADOOP-5432](https://issues.apache.org/jira/browse/HADOOP-5432) | TestHdfsProxy fails on 0.20 | Major | . | Chris Douglas | Chris Douglas |
+| [HADOOP-5416](https://issues.apache.org/jira/browse/HADOOP-5416) | Wrong description of " hadoop fs -test " in FS Shell guide . | Trivial | documentation | Ravi Phulari | Ravi Phulari |
+| [HADOOP-5327](https://issues.apache.org/jira/browse/HADOOP-5327) | Job files for a job failing because of ACLs are not clean from the system directory | Blocker | . | Karam Singh | Amar Kamat |
+| [HADOOP-5440](https://issues.apache.org/jira/browse/HADOOP-5440) | Successful taskid are not removed from TaskMemoryManager | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-5465](https://issues.apache.org/jira/browse/HADOOP-5465) | Blocks remain under-replicated | Blocker | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5490](https://issues.apache.org/jira/browse/HADOOP-5490) | TestParallelInitialization failed on NoSuchElementException | Blocker | . | Hairong Kuang | Jothi Padmanabhan |
+| [HADOOP-5493](https://issues.apache.org/jira/browse/HADOOP-5493) | Shuffle copiers do not return Codecs back to the pool at the end of shuffling | Blocker | . | Devaraj Das | Jothi Padmanabhan |
+| [HADOOP-5505](https://issues.apache.org/jira/browse/HADOOP-5505) | TestMissingBlocksAlert fails on 0.20. | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-5414](https://issues.apache.org/jira/browse/HADOOP-5414) | IO exception while executing hadoop fs -touchz fileName | Major | fs | Ravi Phulari | Hairong Kuang |
+| [HADOOP-5483](https://issues.apache.org/jira/browse/HADOOP-5483) | Directory/file cleanup thread throws IllegalStateException | Major | . | Hairong Kuang | |
+| [HADOOP-5281](https://issues.apache.org/jira/browse/HADOOP-5281) | GzipCodec fails second time it is used in a process | Blocker | . | Ben Maurer | Chris Douglas |
+| [HADOOP-5463](https://issues.apache.org/jira/browse/HADOOP-5463) | Balancer throws "Not a host:port pair" unless port is specified in fs.default.name | Minor | . | Stuart White | Stuart White |
+| [HADOOP-5479](https://issues.apache.org/jira/browse/HADOOP-5479) | NameNode should not send empty block replication request to DataNode | Critical | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5259](https://issues.apache.org/jira/browse/HADOOP-5259) | Job with output hdfs:/user/\<username\>/outputpath (no authority) fails with Wrong FS | Major | fs | Koji Noguchi | Doug Cutting |
+| [HADOOP-5499](https://issues.apache.org/jira/browse/HADOOP-5499) | JobTracker metrics do not match job counters | Major | metrics | Chris Douglas | |
+| [HADOOP-5516](https://issues.apache.org/jira/browse/HADOOP-5516) | TaskMemoryManagerThread crashes in a corner case | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [HADOOP-5382](https://issues.apache.org/jira/browse/HADOOP-5382) | The new map/reduce api doesn't support combiners | Blocker | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-5471](https://issues.apache.org/jira/browse/HADOOP-5471) | SyncLogs thread in Child.java would update wrong file for a cleanup attempt, in some cases. | Major | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-5522](https://issues.apache.org/jira/browse/HADOOP-5522) | Document job setup/cleaup tasks and task cleanup tasks in mapred tutorial | Blocker | . | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-5534](https://issues.apache.org/jira/browse/HADOOP-5534) | Deadlock triggered by FairScheduler scheduler's servlet due to changes from HADOOP-5214. | Blocker | . | Vinod Kumar Vavilapalli | rahul k singh |
+| [HADOOP-5328](https://issues.apache.org/jira/browse/HADOOP-5328) | Renaming of Job histroy file is incorrect if Jobtracker is restarted multimple times | Major | . | Karam Singh | Amar Kamat |
+| [HADOOP-5417](https://issues.apache.org/jira/browse/HADOOP-5417) | IPC client drops interrupted exceptions | Blocker | ipc | Owen O'Malley | Owen O'Malley |
+| [HADOOP-5320](https://issues.apache.org/jira/browse/HADOOP-5320) | TestMapReduceLocal is missing a close() that is causing it to fail while running the test on NFS | Minor | test | Jothi Padmanabhan | Jothi Padmanabhan |
+| [HADOOP-5549](https://issues.apache.org/jira/browse/HADOOP-5549) | ReplicationMonitor should schedule both replication and deletion work in one iteration | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5554](https://issues.apache.org/jira/browse/HADOOP-5554) | DataNodeCluster should create blocks with the same generation stamp as the blocks created in CreateEditsLog | Major | test | Hairong Kuang | Hairong Kuang |
+| [HADOOP-5484](https://issues.apache.org/jira/browse/HADOOP-5484) | TestRecoveryManager fails wtih FileAlreadyExistsException | Major | test | Hairong Kuang | Amar Kamat |
+| [HADOOP-5557](https://issues.apache.org/jira/browse/HADOOP-5557) | Two minor problems in TestOverReplicatedBlocks | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-5564](https://issues.apache.org/jira/browse/HADOOP-5564) | hadoop command uses large JVM heap size | Blocker | build | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-5565](https://issues.apache.org/jira/browse/HADOOP-5565) | The job instrumentation API needs to have a method for finalizeJob, | Major | . | Jerome Boulon | Jerome Boulon |
+| [HADOOP-5390](https://issues.apache.org/jira/browse/HADOOP-5390) | hdfsproxy includes duplicate jars in tarball, source in binary tarball | Major | build | Chris Douglas | zhiyong zhang |
+| [HADOOP-5459](https://issues.apache.org/jira/browse/HADOOP-5459) | CRC erro
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[18/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.0/CHANGES.1.2.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.0/CHANGES.1.2.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.0/CHANGES.1.2.0.md
index ceb86d0..5420e8e 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.0/CHANGES.1.2.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.2.0/CHANGES.1.2.0.md
@@ -25,244 +25,238 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
| [HADOOP-8164](https://issues.apache.org/jira/browse/HADOOP-8164) | Handle paths using back slash as path separator for windows only | Major | fs | Suresh Srinivas | Daryn Sharp |
-| [HDFS-4350](https://issues.apache.org/jira/browse/HDFS-4350) | Make enabling of stale marking on read and write paths independent | Major | . | Andrew Wang | Andrew Wang |
+| [MAPREDUCE-4629](https://issues.apache.org/jira/browse/MAPREDUCE-4629) | Remove JobHistory.DEBUG\_MODE | Major | . | Karthik Kambatla | Karthik Kambatla |
| [HDFS-4122](https://issues.apache.org/jira/browse/HDFS-4122) | Cleanup HDFS logs and reduce the size of logged messages | Major | datanode, hdfs-client, namenode | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-4350](https://issues.apache.org/jira/browse/HDFS-4350) | Make enabling of stale marking on read and write paths independent | Major | . | Andrew Wang | Andrew Wang |
| [MAPREDUCE-4737](https://issues.apache.org/jira/browse/MAPREDUCE-4737) | Hadoop does not close output file / does not call Mapper.cleanup if exception in map | Major | . | Daniel Dai | Arun C Murthy |
-| [MAPREDUCE-4629](https://issues.apache.org/jira/browse/MAPREDUCE-4629) | Remove JobHistory.DEBUG\_MODE | Major | . | Karthik Kambatla | Karthik Kambatla |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9090](https://issues.apache.org/jira/browse/HADOOP-9090) | Support on-demand publish of metrics | Minor | metrics | Mostafa Elhemali | Mostafa Elhemali |
+| [MAPREDUCE-461](https://issues.apache.org/jira/browse/MAPREDUCE-461) | Enable ServicePlugins for the JobTracker | Minor | . | Fredrik Hedberg | Fredrik Hedberg |
+| [HDFS-3515](https://issues.apache.org/jira/browse/HDFS-3515) | Port HDFS-1457 to branch-1 | Major | namenode | Eli Collins | Eli Collins |
+| [HADOOP-8023](https://issues.apache.org/jira/browse/HADOOP-8023) | Add unset() method to Configuration | Critical | conf | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-4355](https://issues.apache.org/jira/browse/MAPREDUCE-4355) | Add RunningJob.getJobStatus() | Major | mrv1, mrv2 | Karthik Kambatla | Karthik Kambatla |
+| [MAPREDUCE-987](https://issues.apache.org/jira/browse/MAPREDUCE-987) | Exposing MiniDFS and MiniMR clusters as a single process command-line | Minor | build, test | Philip Zeyliger | Ahmed Radwan |
+| [MAPREDUCE-3678](https://issues.apache.org/jira/browse/MAPREDUCE-3678) | The Map tasks logs should have the value of input split it processed | Major | mrv1, mrv2 | Bejoy KS | Harsh J |
| [HADOOP-8988](https://issues.apache.org/jira/browse/HADOOP-8988) | Backport HADOOP-8343 to branch-1 | Major | conf | Jing Zhao | Jing Zhao |
| [HADOOP-8820](https://issues.apache.org/jira/browse/HADOOP-8820) | Backport HADOOP-8469 and HADOOP-8470: add "NodeGroup" layer in new NetworkTopology (also known as NetworkTopologyWithNodeGroup) | Major | net | Junping Du | Junping Du |
-| [HADOOP-8023](https://issues.apache.org/jira/browse/HADOOP-8023) | Add unset() method to Configuration | Critical | conf | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HDFS-4776](https://issues.apache.org/jira/browse/HDFS-4776) | Backport SecondaryNameNode web ui to branch-1 | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-4774](https://issues.apache.org/jira/browse/HDFS-4774) | Backport HDFS-4525 'Provide an API for knowing whether file is closed or not' to branch-1 | Major | hdfs-client, namenode | Ted Yu | Ted Yu |
-| [HDFS-4597](https://issues.apache.org/jira/browse/HDFS-4597) | Backport WebHDFS concat to branch-1 | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-3941](https://issues.apache.org/jira/browse/HDFS-3941) | Backport HDFS-3498 and HDFS3601: update replica placement policy for new added "NodeGroup" layer topology | Major | namenode | Junping Du | Junping Du |
| [HDFS-4219](https://issues.apache.org/jira/browse/HDFS-4219) | Port slive to branch-1 | Major | . | Arpit Gupta | Arpit Gupta |
+| [HADOOP-9090](https://issues.apache.org/jira/browse/HADOOP-9090) | Support on-demand publish of metrics | Minor | metrics | Mostafa Elhemali | Mostafa Elhemali |
| [HDFS-3942](https://issues.apache.org/jira/browse/HDFS-3942) | Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer | Major | balancer & mover | Junping Du | Junping Du |
-| [HDFS-3941](https://issues.apache.org/jira/browse/HDFS-3941) | Backport HDFS-3498 and HDFS3601: update replica placement policy for new added "NodeGroup" layer topology | Major | namenode | Junping Du | Junping Du |
-| [HDFS-3601](https://issues.apache.org/jira/browse/HDFS-3601) | Implementation of ReplicaPlacementPolicyNodeGroup to support 4-layer network topology | Major | namenode | Junping Du | Junping Du |
-| [HDFS-3515](https://issues.apache.org/jira/browse/HDFS-3515) | Port HDFS-1457 to branch-1 | Major | namenode | Eli Collins | Eli Collins |
-| [HDFS-3495](https://issues.apache.org/jira/browse/HDFS-3495) | Update Balancer to support new NetworkTopology with NodeGroup | Major | balancer & mover | Junping Du | Junping Du |
-| [MAPREDUCE-5129](https://issues.apache.org/jira/browse/MAPREDUCE-5129) | Add tag info to JH files | Minor | . | Billie Rinaldi | Billie Rinaldi |
+| [MAPREDUCE-4660](https://issues.apache.org/jira/browse/MAPREDUCE-4660) | Update task placement policy for NetworkTopology with 'NodeGroup' layer | Major | jobtracker, mrv1, scheduler | Junping Du | Junping Du |
+| [HDFS-4597](https://issues.apache.org/jira/browse/HDFS-4597) | Backport WebHDFS concat to branch-1 | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [MAPREDUCE-5081](https://issues.apache.org/jira/browse/MAPREDUCE-5081) | Backport DistCpV2 and the related JIRAs to branch-1 | Major | distcp | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [MAPREDUCE-4824](https://issues.apache.org/jira/browse/MAPREDUCE-4824) | Provide a mechanism for jobs to indicate they should not be recovered on restart | Major | mrv1 | Tom White | Tom White |
-| [MAPREDUCE-4660](https://issues.apache.org/jira/browse/MAPREDUCE-4660) | Update task placement policy for NetworkTopology with 'NodeGroup' layer | Major | jobtracker, mrv1, scheduler | Junping Du | Junping Du |
-| [MAPREDUCE-4355](https://issues.apache.org/jira/browse/MAPREDUCE-4355) | Add RunningJob.getJobStatus() | Major | mrv1, mrv2 | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-3678](https://issues.apache.org/jira/browse/MAPREDUCE-3678) | The Map tasks logs should have the value of input split it processed | Major | mrv1, mrv2 | Bejoy KS | Harsh J |
-| [MAPREDUCE-987](https://issues.apache.org/jira/browse/MAPREDUCE-987) | Exposing MiniDFS and MiniMR clusters as a single process command-line | Minor | build, test | Philip Zeyliger | Ahmed Radwan |
-| [MAPREDUCE-461](https://issues.apache.org/jira/browse/MAPREDUCE-461) | Enable ServicePlugins for the JobTracker | Minor | . | Fredrik Hedberg | Fredrik Hedberg |
+| [MAPREDUCE-5129](https://issues.apache.org/jira/browse/MAPREDUCE-5129) | Add tag info to JH files | Minor | . | Billie Rinaldi | Billie Rinaldi |
+| [HDFS-4776](https://issues.apache.org/jira/browse/HDFS-4776) | Backport SecondaryNameNode web ui to branch-1 | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-4774](https://issues.apache.org/jira/browse/HDFS-4774) | Backport HDFS-4525 'Provide an API for knowing whether file is closed or not' to branch-1 | Major | hdfs-client, namenode | Ted Yu | Ted Yu |
+| [HDFS-3601](https://issues.apache.org/jira/browse/HDFS-3601) | Implementation of ReplicaPlacementPolicyNodeGroup to support 4-layer network topology | Major | namenode | Junping Du | Junping Du |
+| [HDFS-3495](https://issues.apache.org/jira/browse/HDFS-3495) | Update Balancer to support new NetworkTopology with NodeGroup | Major | balancer & mover | Junping Du | Junping Du |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9434](https://issues.apache.org/jira/browse/HADOOP-9434) | Backport HADOOP-9267 to branch-1 | Minor | bin | Yu Li | Yu Li |
-| [HADOOP-9379](https://issues.apache.org/jira/browse/HADOOP-9379) | capture the ulimit info after printing the log to the console | Trivial | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-9253](https://issues.apache.org/jira/browse/HADOOP-9253) | Capture ulimit info in the logs at service start time | Major | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-9071](https://issues.apache.org/jira/browse/HADOOP-9071) | configure ivy log levels for resolve/retrieve | Major | build | Giridharan Kesavan | Giridharan Kesavan |
-| [HADOOP-8971](https://issues.apache.org/jira/browse/HADOOP-8971) | Backport: hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data (HADOOP-8926) | Major | util | Gopal V | Gopal V |
-| [HADOOP-8968](https://issues.apache.org/jira/browse/HADOOP-8968) | Add a flag to completely disable the worker version check | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8951](https://issues.apache.org/jira/browse/HADOOP-8951) | RunJar to fail with user-comprehensible error message if jar missing | Minor | util | Steve Loughran | Steve Loughran |
-| [HADOOP-8931](https://issues.apache.org/jira/browse/HADOOP-8931) | Add Java version to startup message | Trivial | . | Eli Collins | Eli Collins |
-| [HADOOP-8711](https://issues.apache.org/jira/browse/HADOOP-8711) | provide an option for IPC server users to avoid printing stack information for certain exceptions | Major | ipc | Brandon Li | Brandon Li |
-| [HADOOP-7688](https://issues.apache.org/jira/browse/HADOOP-7688) | When a servlet filter throws an exception in init(..), the Jetty server failed silently. | Major | . | Tsz Wo Nicholas Sze | Uma Maheswara Rao G |
+| [HDFS-385](https://issues.apache.org/jira/browse/HDFS-385) | Design a pluggable interface to place replicas of blocks in HDFS | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-7096](https://issues.apache.org/jira/browse/HADOOP-7096) | Allow setting of end-of-record delimiter for TextInputFormat | Major | . | Ahmed Radwan | Ahmed Radwan |
-| [HDFS-4651](https://issues.apache.org/jira/browse/HDFS-4651) | Offline Image Viewer backport to branch-1 | Major | tools | Chris Nauroth | Chris Nauroth |
-| [HDFS-4635](https://issues.apache.org/jira/browse/HDFS-4635) | Move BlockManager#computeCapacity to LightWeightGSet | Major | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-4551](https://issues.apache.org/jira/browse/HDFS-4551) | Change WebHDFS buffersize behavior to improve default performance | Major | webhdfs | Mark Wagner | Mark Wagner |
-| [HDFS-4320](https://issues.apache.org/jira/browse/HDFS-4320) | Add a separate configuration for namenode rpc address instead of only using fs.default.name | Major | datanode, namenode | Mostafa Elhemali | Mostafa Elhemali |
-| [HDFS-4062](https://issues.apache.org/jira/browse/HDFS-4062) | In branch-1, FSNameSystem#invalidateWorkForOneNode and FSNameSystem#computeReplicationWorkForBlock should print logs outside of the namesystem lock | Minor | . | Jing Zhao | Jing Zhao |
-| [HDFS-4057](https://issues.apache.org/jira/browse/HDFS-4057) | NameNode.namesystem should be private. Use getNamesystem() instead. | Minor | namenode | Brandon Li | Brandon Li |
-| [HDFS-3940](https://issues.apache.org/jira/browse/HDFS-3940) | Add Gset#clear method and clear the block map when namenode is shutdown | Minor | . | Eli Collins | Suresh Srinivas |
-| [HDFS-3838](https://issues.apache.org/jira/browse/HDFS-3838) | fix the typo in FSEditLog.java: isToterationEnabled should be isTolerationEnabled | Trivial | namenode | Brandon Li | Brandon Li |
-| [HDFS-3819](https://issues.apache.org/jira/browse/HDFS-3819) | Should check whether invalidate work percentage default value is not greater than 1.0f | Minor | . | Jing Zhao | Jing Zhao |
-| [HDFS-3817](https://issues.apache.org/jira/browse/HDFS-3817) | avoid printing stack information for SafeModeException | Major | namenode | Brandon Li | Brandon Li |
-| [HDFS-3697](https://issues.apache.org/jira/browse/HDFS-3697) | Enable fadvise readahead by default | Minor | datanode, performance | Todd Lipcon | Todd Lipcon |
-| [HDFS-3647](https://issues.apache.org/jira/browse/HDFS-3647) | Backport HDFS-2868 (Add number of active transfer threads to the DataNode status) to branch-1 | Major | datanode | Steve Hoffman | Harsh J |
-| [HDFS-3604](https://issues.apache.org/jira/browse/HDFS-3604) | Add dfs.webhdfs.enabled to hdfs-default.xml | Minor | . | Eli Collins | Eli Collins |
-| [HDFS-3596](https://issues.apache.org/jira/browse/HDFS-3596) | Improve FSEditLog pre-allocation in branch-1 | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3521](https://issues.apache.org/jira/browse/HDFS-3521) | Allow namenode to tolerate edit log corruption | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-3498](https://issues.apache.org/jira/browse/HDFS-3498) | Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass | Major | namenode | Junping Du | Junping Du |
-| [HDFS-3479](https://issues.apache.org/jira/browse/HDFS-3479) | backport HDFS-3335 (check for edit log corruption at the end of the log) to branch-1 | Major | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3163](https://issues.apache.org/jira/browse/HDFS-3163) | TestHDFSCLI.testAll fails if the user name is not all lowercase | Trivial | test | Brandon Li | Brandon Li |
-| [HDFS-2533](https://issues.apache.org/jira/browse/HDFS-2533) | Remove needless synchronization on FSDataSet.getBlockFile | Minor | datanode, performance | Todd Lipcon | Todd Lipcon |
| [HDFS-1957](https://issues.apache.org/jira/browse/HDFS-1957) | Documentation for HFTP | Minor | documentation | Ari Rabkin | Ari Rabkin |
-| [HDFS-385](https://issues.apache.org/jira/browse/HDFS-385) | Design a pluggable interface to place replicas of blocks in HDFS | Major | . | dhruba borthakur | dhruba borthakur |
-| [MAPREDUCE-4907](https://issues.apache.org/jira/browse/MAPREDUCE-4907) | TrackerDistributedCacheManager issues too many getFileStatus calls | Major | mrv1, tasktracker | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4845](https://issues.apache.org/jira/browse/MAPREDUCE-4845) | ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2 | Major | client | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4837](https://issues.apache.org/jira/browse/MAPREDUCE-4837) | Add webservices for jobtracker | Major | . | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-4703](https://issues.apache.org/jira/browse/MAPREDUCE-4703) | Add the ability to start the MiniMRClientCluster using the configurations used before it is being stopped. | Major | mrv1, mrv2, test | Ahmed Radwan | Ahmed Radwan |
+| [HDFS-2533](https://issues.apache.org/jira/browse/HDFS-2533) | Remove needless synchronization on FSDataSet.getBlockFile | Minor | datanode, performance | Todd Lipcon | Todd Lipcon |
+| [HDFS-3163](https://issues.apache.org/jira/browse/HDFS-3163) | TestHDFSCLI.testAll fails if the user name is not all lowercase | Trivial | test | Brandon Li | Brandon Li |
+| [HDFS-3479](https://issues.apache.org/jira/browse/HDFS-3479) | backport HDFS-3335 (check for edit log corruption at the end of the log) to branch-1 | Major | . | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-3521](https://issues.apache.org/jira/browse/HDFS-3521) | Allow namenode to tolerate edit log corruption | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-3604](https://issues.apache.org/jira/browse/HDFS-3604) | Add dfs.webhdfs.enabled to hdfs-default.xml | Minor | . | Eli Collins | Eli Collins |
+| [HDFS-3596](https://issues.apache.org/jira/browse/HDFS-3596) | Improve FSEditLog pre-allocation in branch-1 | Minor | . | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-3647](https://issues.apache.org/jira/browse/HDFS-3647) | Backport HDFS-2868 (Add number of active transfer threads to the DataNode status) to branch-1 | Major | datanode | Steve Hoffman | Harsh J |
+| [MAPREDUCE-4415](https://issues.apache.org/jira/browse/MAPREDUCE-4415) | Backport the Job.getInstance methods from MAPREDUCE-1505 to branch-1 | Major | mrv1 | Harsh J | Harsh J |
+| [HDFS-3697](https://issues.apache.org/jira/browse/HDFS-3697) | Enable fadvise readahead by default | Minor | datanode, performance | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8711](https://issues.apache.org/jira/browse/HADOOP-8711) | provide an option for IPC server users to avoid printing stack information for certain exceptions | Major | ipc | Brandon Li | Brandon Li |
| [MAPREDUCE-4565](https://issues.apache.org/jira/browse/MAPREDUCE-4565) | Backport MR-2855 to branch-1: ResourceBundle lookup during counter name resolution takes a lot of time | Major | . | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-4556](https://issues.apache.org/jira/browse/MAPREDUCE-4556) | FairScheduler: PoolSchedulable#updateDemand() has potential redundant computation | Minor | contrib/fair-share | Karthik Kambatla | Karthik Kambatla |
+| [HDFS-3817](https://issues.apache.org/jira/browse/HDFS-3817) | avoid printing stack information for SafeModeException | Major | namenode | Brandon Li | Brandon Li |
+| [HDFS-3819](https://issues.apache.org/jira/browse/HDFS-3819) | Should check whether invalidate work percentage default value is not greater than 1.0f | Minor | . | Jing Zhao | Jing Zhao |
+| [HDFS-3838](https://issues.apache.org/jira/browse/HDFS-3838) | fix the typo in FSEditLog.java: isToterationEnabled should be isTolerationEnabled | Trivial | namenode | Brandon Li | Brandon Li |
+| [MAPREDUCE-4408](https://issues.apache.org/jira/browse/MAPREDUCE-4408) | allow jobs to set a JAR that is in the distributed cached | Major | mrv1, mrv2 | Alejandro Abdelnur | Robert Kanter |
| [MAPREDUCE-4499](https://issues.apache.org/jira/browse/MAPREDUCE-4499) | Looking for speculative tasks is very expensive in 1.x | Major | mrv1, performance | Nathan Roberts | Koji Noguchi |
+| [HADOOP-7688](https://issues.apache.org/jira/browse/HADOOP-7688) | When a servlet filter throws an exception in init(..), the Jetty server failed silently. | Major | . | Tsz Wo Nicholas Sze | Uma Maheswara Rao G |
+| [MAPREDUCE-2770](https://issues.apache.org/jira/browse/MAPREDUCE-2770) | Improve hadoop.job.history.location doc in mapred-default.xml | Trivial | documentation | Eli Collins | Sandy Ryza |
| [MAPREDUCE-4464](https://issues.apache.org/jira/browse/MAPREDUCE-4464) | Reduce tasks failing with NullPointerException in ConcurrentHashMap.get() | Minor | task | Clint Heath | Clint Heath |
-| [MAPREDUCE-4415](https://issues.apache.org/jira/browse/MAPREDUCE-4415) | Backport the Job.getInstance methods from MAPREDUCE-1505 to branch-1 | Major | mrv1 | Harsh J | Harsh J |
-| [MAPREDUCE-4408](https://issues.apache.org/jira/browse/MAPREDUCE-4408) | allow jobs to set a JAR that is in the distributed cached | Major | mrv1, mrv2 | Alejandro Abdelnur | Robert Kanter |
+| [MAPREDUCE-4556](https://issues.apache.org/jira/browse/MAPREDUCE-4556) | FairScheduler: PoolSchedulable#updateDemand() has potential redundant computation | Minor | contrib/fair-share | Karthik Kambatla | Karthik Kambatla |
+| [HADOOP-8931](https://issues.apache.org/jira/browse/HADOOP-8931) | Add Java version to startup message | Trivial | . | Eli Collins | Eli Collins |
+| [HDFS-4057](https://issues.apache.org/jira/browse/HDFS-4057) | NameNode.namesystem should be private. Use getNamesystem() instead. | Minor | namenode | Brandon Li | Brandon Li |
+| [HADOOP-8951](https://issues.apache.org/jira/browse/HADOOP-8951) | RunJar to fail with user-comprehensible error message if jar missing | Minor | util | Steve Loughran | Steve Loughran |
+| [HDFS-4062](https://issues.apache.org/jira/browse/HDFS-4062) | In branch-1, FSNameSystem#invalidateWorkForOneNode and FSNameSystem#computeReplicationWorkForBlock should print logs outside of the namesystem lock | Minor | . | Jing Zhao | Jing Zhao |
+| [HADOOP-8971](https://issues.apache.org/jira/browse/HADOOP-8971) | Backport: hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data (HADOOP-8926) | Major | util | Gopal V | Gopal V |
+| [HADOOP-8968](https://issues.apache.org/jira/browse/HADOOP-8968) | Add a flag to completely disable the worker version check | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-4703](https://issues.apache.org/jira/browse/MAPREDUCE-4703) | Add the ability to start the MiniMRClientCluster using the configurations used before it is being stopped. | Major | mrv1, mrv2, test | Ahmed Radwan | Ahmed Radwan |
+| [MAPREDUCE-4845](https://issues.apache.org/jira/browse/MAPREDUCE-4845) | ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2 | Major | client | Sandy Ryza | Sandy Ryza |
+| [HDFS-4320](https://issues.apache.org/jira/browse/HDFS-4320) | Add a separate configuration for namenode rpc address instead of only using fs.default.name | Major | datanode, namenode | Mostafa Elhemali | Mostafa Elhemali |
+| [MAPREDUCE-4907](https://issues.apache.org/jira/browse/MAPREDUCE-4907) | TrackerDistributedCacheManager issues too many getFileStatus calls | Major | mrv1, tasktracker | Sandy Ryza | Sandy Ryza |
| [MAPREDUCE-2931](https://issues.apache.org/jira/browse/MAPREDUCE-2931) | CLONE - LocalJobRunner should support parallel mapper execution | Major | . | Forest Tan | Sandy Ryza |
-| [MAPREDUCE-2770](https://issues.apache.org/jira/browse/MAPREDUCE-2770) | Improve hadoop.job.history.location doc in mapred-default.xml | Trivial | documentation | Eli Collins | Sandy Ryza |
+| [MAPREDUCE-4837](https://issues.apache.org/jira/browse/MAPREDUCE-4837) | Add webservices for jobtracker | Major | . | Arun C Murthy | Arun C Murthy |
+| [HDFS-4551](https://issues.apache.org/jira/browse/HDFS-4551) | Change WebHDFS buffersize behavior to improve default performance | Major | webhdfs | Mark Wagner | Mark Wagner |
+| [HADOOP-9379](https://issues.apache.org/jira/browse/HADOOP-9379) | capture the ulimit info after printing the log to the console | Trivial | . | Arpit Gupta | Arpit Gupta |
+| [HADOOP-9434](https://issues.apache.org/jira/browse/HADOOP-9434) | Backport HADOOP-9267 to branch-1 | Minor | bin | Yu Li | Yu Li |
+| [HDFS-4635](https://issues.apache.org/jira/browse/HDFS-4635) | Move BlockManager#computeCapacity to LightWeightGSet | Major | namenode | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-9253](https://issues.apache.org/jira/browse/HADOOP-9253) | Capture ulimit info in the logs at service start time | Major | . | Arpit Gupta | Arpit Gupta |
+| [HDFS-4651](https://issues.apache.org/jira/browse/HDFS-4651) | Offline Image Viewer backport to branch-1 | Major | tools | Chris Nauroth | Chris Nauroth |
+| [HADOOP-9071](https://issues.apache.org/jira/browse/HADOOP-9071) | configure ivy log levels for resolve/retrieve | Major | build | Giridharan Kesavan | Giridharan Kesavan |
+| [HDFS-3940](https://issues.apache.org/jira/browse/HDFS-3940) | Add Gset#clear method and clear the block map when namenode is shutdown | Minor | . | Eli Collins | Suresh Srinivas |
+| [HDFS-3498](https://issues.apache.org/jira/browse/HDFS-3498) | Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass | Major | namenode | Junping Du | Junping Du |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9544](https://issues.apache.org/jira/browse/HADOOP-9544) | backport UTF8 encoding fixes to branch-1 | Major | io | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9543](https://issues.apache.org/jira/browse/HADOOP-9543) | TestFsShellReturnCode may fail in branch-1 | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-9537](https://issues.apache.org/jira/browse/HADOOP-9537) | Backport AIX patches to branch-1 | Major | security | Arpit Agarwal | Arpit Agarwal |
-| [HADOOP-9502](https://issues.apache.org/jira/browse/HADOOP-9502) | chmod does not return error exit codes for some exceptions | Minor | fs | Ramya Sunil | Tsz Wo Nicholas Sze |
-| [HADOOP-9492](https://issues.apache.org/jira/browse/HADOOP-9492) | Fix the typo in testConf.xml to make it consistent with FileUtil#copy() | Trivial | test | Jing Zhao | Jing Zhao |
-| [HADOOP-9473](https://issues.apache.org/jira/browse/HADOOP-9473) | typo in FileUtil copy() method | Trivial | fs | Glen Mazza | |
-| [HADOOP-9467](https://issues.apache.org/jira/browse/HADOOP-9467) | Metrics2 record filtering (.record.filter.include/exclude) does not filter by name | Major | metrics | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9458](https://issues.apache.org/jira/browse/HADOOP-9458) | In branch-1, RPC.getProxy(..) may call proxy.getProtocolVersion(..) without retry | Critical | ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-9451](https://issues.apache.org/jira/browse/HADOOP-9451) | Node with one topology layer should be handled as fault topology when NodeGroup layer is enabled | Major | net | Junping Du | Junping Du |
-| [HADOOP-9375](https://issues.apache.org/jira/browse/HADOOP-9375) | Port HADOOP-7290 to branch-1 to fix TestUserGroupInformation failure | Trivial | test | Xiaobo Peng | Suresh Srinivas |
-| [HADOOP-9369](https://issues.apache.org/jira/browse/HADOOP-9369) | DNS#reverseDns() can return hostname with . appended at the end | Major | net | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-9349](https://issues.apache.org/jira/browse/HADOOP-9349) | Confusing output when running hadoop version from one hadoop installation when HADOOP\_HOME points to another | Major | tools | Sandy Ryza | Sandy Ryza |
-| [HADOOP-9191](https://issues.apache.org/jira/browse/HADOOP-9191) | TestAccessControlList and TestJobHistoryConfig fail with JDK7 | Major | test | Arpit Agarwal | Arpit Agarwal |
-| [HADOOP-9179](https://issues.apache.org/jira/browse/HADOOP-9179) | TestFileSystem fails with open JDK7 | Major | . | Brandon Li | Brandon Li |
-| [HADOOP-9154](https://issues.apache.org/jira/browse/HADOOP-9154) | SortedMapWritable#putAll() doesn't add key/value classes to the map | Major | io | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-9124](https://issues.apache.org/jira/browse/HADOOP-9124) | SortedMapWritable violates contract of Map interface for equals() and hashCode() | Minor | io | Patrick Hunt | Surenkumar Nihalani |
-| [HADOOP-9099](https://issues.apache.org/jira/browse/HADOOP-9099) | NetUtils.normalizeHostName fails on domains where UnknownHost resolves to an IP address | Minor | test | Ivan Mitic | Ivan Mitic |
-| [HADOOP-9098](https://issues.apache.org/jira/browse/HADOOP-9098) | Add missing license headers | Blocker | build | Tom White | Arpit Agarwal |
-| [HADOOP-9095](https://issues.apache.org/jira/browse/HADOOP-9095) | TestNNThroughputBenchmark fails in branch-1 | Minor | net | Tsz Wo Nicholas Sze | Jing Zhao |
-| [HADOOP-9036](https://issues.apache.org/jira/browse/HADOOP-9036) | TestSinkQueue.testConcurrentConsumers fails intermittently (Backports HADOOP-7292) | Major | . | Ivan Mitic | Suresh Srinivas |
-| [HADOOP-8963](https://issues.apache.org/jira/browse/HADOOP-8963) | CopyFromLocal doesn't always create user directory | Trivial | . | Billie Rinaldi | Arpit Gupta |
-| [HADOOP-8917](https://issues.apache.org/jira/browse/HADOOP-8917) | add LOCALE.US to toLowerCase in SecurityUtil.replacePattern | Major | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-8900](https://issues.apache.org/jira/browse/HADOOP-8900) | BuiltInGzipDecompressor throws IOException - stored gzip size doesn't match decompressed size | Major | . | Slavik Krassovsky | Andy Isaacson |
-| [HADOOP-8861](https://issues.apache.org/jira/browse/HADOOP-8861) | FSDataOutputStream.sync should call flush() if the underlying wrapped stream is not Syncable | Major | fs | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-8832](https://issues.apache.org/jira/browse/HADOOP-8832) | backport serviceplugin to branch-1 | Major | . | Brandon Li | Brandon Li |
-| [HADOOP-8819](https://issues.apache.org/jira/browse/HADOOP-8819) | Should use && instead of & in a few places in FTPFileSystem,FTPInputStream,S3InputStream,ViewFileSystem,ViewFs | Major | fs | Brandon Li | Brandon Li |
-| [HADOOP-8791](https://issues.apache.org/jira/browse/HADOOP-8791) | rm "Only deletes non empty directory and files." | Major | documentation | Bertrand Dechoux | Jing Zhao |
-| [HADOOP-8786](https://issues.apache.org/jira/browse/HADOOP-8786) | HttpServer continues to start even if AuthenticationFilter fails to init | Major | . | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8781](https://issues.apache.org/jira/browse/HADOOP-8781) | hadoop-config.sh should add JAVA\_LIBRARY\_PATH to LD\_LIBRARY\_PATH | Major | scripts | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8767](https://issues.apache.org/jira/browse/HADOOP-8767) | secondary namenode on slave machines | Minor | bin | giovanni delussu | giovanni delussu |
-| [HADOOP-8613](https://issues.apache.org/jira/browse/HADOOP-8613) | AbstractDelegationTokenIdentifier#getUser() should set token auth type | Critical | . | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8612](https://issues.apache.org/jira/browse/HADOOP-8612) | Backport HADOOP-8599 to branch-1 (Non empty response when read beyond eof) | Major | fs | Matt Foley | Eli Collins |
-| [HADOOP-8611](https://issues.apache.org/jira/browse/HADOOP-8611) | Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails | Major | security | Kihwal Lee | Robert Parker |
-| [HADOOP-8606](https://issues.apache.org/jira/browse/HADOOP-8606) | FileSystem.get may return the wrong filesystem | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8587](https://issues.apache.org/jira/browse/HADOOP-8587) | HarFileSystem access of harMetaCache isn't threadsafe | Minor | fs | Eli Collins | Eli Collins |
-| [HADOOP-8586](https://issues.apache.org/jira/browse/HADOOP-8586) | Fixup a bunch of SPNEGO misspellings | Major | . | Eli Collins | Eli Collins |
-| [HADOOP-8580](https://issues.apache.org/jira/browse/HADOOP-8580) | ant compile-native fails with automake version 1.11.3 | Major | . | Eugene Koontz | |
-| [HADOOP-8512](https://issues.apache.org/jira/browse/HADOOP-8512) | AuthenticatedURL should reset the Token when the server returns other than OK on authentication | Minor | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8460](https://issues.apache.org/jira/browse/HADOOP-8460) | Document proper setting of HADOOP\_PID\_DIR and HADOOP\_SECURE\_DN\_PID\_DIR | Major | documentation | Robert Joseph Evans | Robert Joseph Evans |
-| [HADOOP-8423](https://issues.apache.org/jira/browse/HADOOP-8423) | MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data | Major | io | Jason B | Todd Lipcon |
-| [HADOOP-8386](https://issues.apache.org/jira/browse/HADOOP-8386) | hadoop script doesn't work if 'cd' prints to stdout (default behavior in Ubuntu) | Major | scripts | Christopher Berner | Christopher Berner |
+| [HADOOP-7101](https://issues.apache.org/jira/browse/HADOOP-7101) | UserGroupInformation.getCurrentUser() fails when called from non-Hadoop JAAS context | Blocker | security | Todd Lipcon | Todd Lipcon |
+| [HDFS-2827](https://issues.apache.org/jira/browse/HDFS-2827) | Cannot save namespace after renaming a directory above a file with an open lease | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
| [HADOOP-8355](https://issues.apache.org/jira/browse/HADOOP-8355) | SPNEGO filter throws/logs exception when authentication fails | Minor | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8249](https://issues.apache.org/jira/browse/HADOOP-8249) | invalid hadoop-auth cookies should trigger authentication if info is avail before returning HTTP 401 | Major | security | bc Wong | Alejandro Abdelnur |
+| [HADOOP-8460](https://issues.apache.org/jira/browse/HADOOP-8460) | Document proper setting of HADOOP\_PID\_DIR and HADOOP\_SECURE\_DN\_PID\_DIR | Major | documentation | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4195](https://issues.apache.org/jira/browse/MAPREDUCE-4195) | With invalid queueName request param, jobqueue\_details.jsp shows NPE | Critical | jobtracker | Gera Shegalov | |
+| [MAPREDUCE-3727](https://issues.apache.org/jira/browse/MAPREDUCE-3727) | jobtoken location property in jobconf refers to wrong jobtoken file | Critical | security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-8512](https://issues.apache.org/jira/browse/HADOOP-8512) | AuthenticatedURL should reset the Token when the server returns other than OK on authentication | Minor | security | Alejandro Abdelnur | Alejandro Abdelnur |
| [HADOOP-7868](https://issues.apache.org/jira/browse/HADOOP-7868) | Hadoop native fails to compile when default linker option is -Wl,--as-needed | Major | native | James Page | Trevor Robinson |
+| [MAPREDUCE-2289](https://issues.apache.org/jira/browse/MAPREDUCE-2289) | Permissions race can make getStagingDir fail on local filesystem | Major | job submission | Todd Lipcon | Ahmed Radwan |
+| [HADOOP-8249](https://issues.apache.org/jira/browse/HADOOP-8249) | invalid hadoop-auth cookies should trigger authentication if info is avail before returning HTTP 401 | Major | security | bc Wong | Alejandro Abdelnur |
+| [HDFS-3595](https://issues.apache.org/jira/browse/HDFS-3595) | TestEditLogLoading fails in branch-1 | Major | namenode | Colin P. McCabe | Colin P. McCabe |
+| [MAPREDUCE-4317](https://issues.apache.org/jira/browse/MAPREDUCE-4317) | Job view ACL checks are too permissive | Major | mrv1 | Harsh J | Karthik Kambatla |
+| [MAPREDUCE-4385](https://issues.apache.org/jira/browse/MAPREDUCE-4385) | FairScheduler.maxTasksToAssign() should check for fairscheduler.assignmultiple.maps \< TaskTracker.availableSlots | Major | . | Karthik Kambatla | Karthik Kambatla |
+| [MAPREDUCE-4359](https://issues.apache.org/jira/browse/MAPREDUCE-4359) | Potential deadlock in Counters | Major | . | Todd Lipcon | Tom White |
+| [MAPREDUCE-3993](https://issues.apache.org/jira/browse/MAPREDUCE-3993) | Graceful handling of codec errors during decompression | Major | mrv1, mrv2 | Todd Lipcon | Karthik Kambatla |
+| [HDFS-3628](https://issues.apache.org/jira/browse/HDFS-3628) | The dfsadmin -setBalancerBandwidth command on branch-1 does not check for superuser privileges | Blocker | datanode, namenode | Harsh J | Harsh J |
+| [HADOOP-8586](https://issues.apache.org/jira/browse/HADOOP-8586) | Fixup a bunch of SPNEGO misspellings | Major | . | Eli Collins | Eli Collins |
+| [HADOOP-8587](https://issues.apache.org/jira/browse/HADOOP-8587) | HarFileSystem access of harMetaCache isn't threadsafe | Minor | fs | Eli Collins | Eli Collins |
| [HADOOP-7836](https://issues.apache.org/jira/browse/HADOOP-7836) | TestSaslRPC#testDigestAuthMethodHostBasedToken fails with hostname localhost.localdomain | Minor | ipc, test | Eli Collins | Daryn Sharp |
-| [HADOOP-7827](https://issues.apache.org/jira/browse/HADOOP-7827) | jsp pages missing DOCTYPE | Trivial | . | Dave Vronay | Dave Vronay |
+| [HADOOP-8423](https://issues.apache.org/jira/browse/HADOOP-8423) | MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data | Major | io | Jason B | Todd Lipcon |
+| [HADOOP-8612](https://issues.apache.org/jira/browse/HADOOP-8612) | Backport HADOOP-8599 to branch-1 (Non empty response when read beyond eof) | Major | fs | Matt Foley | Eli Collins |
+| [HADOOP-8606](https://issues.apache.org/jira/browse/HADOOP-8606) | FileSystem.get may return the wrong filesystem | Major | fs | Daryn Sharp | Daryn Sharp |
+| [HADOOP-8613](https://issues.apache.org/jira/browse/HADOOP-8613) | AbstractDelegationTokenIdentifier#getUser() should set token auth type | Critical | . | Daryn Sharp | Daryn Sharp |
+| [HDFS-3679](https://issues.apache.org/jira/browse/HDFS-3679) | fuse\_dfs notrash option sets usetrash | Minor | fuse-dfs | Conrad Meyer | Conrad Meyer |
+| [MAPREDUCE-4036](https://issues.apache.org/jira/browse/MAPREDUCE-4036) | Streaming TestUlimit fails on CentOS 6 | Major | test | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3754](https://issues.apache.org/jira/browse/HDFS-3754) | BlockSender doesn't shutdown ReadaheadPool threads | Major | datanode | Eli Collins | Eli Collins |
+| [HADOOP-8611](https://issues.apache.org/jira/browse/HADOOP-8611) | Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails | Major | security | Kihwal Lee | Robert Parker |
+| [MAPREDUCE-4595](https://issues.apache.org/jira/browse/MAPREDUCE-4595) | TestLostTracker failing - possibly due to a race in JobHistory.JobHistoryFilesManager#run() | Critical | . | Karthik Kambatla | Karthik Kambatla |
+| [MAPREDUCE-1684](https://issues.apache.org/jira/browse/MAPREDUCE-1684) | ClusterStatus can be cached in CapacityTaskScheduler.assignTasks() | Major | capacity-sched | Amareshwari Sriramadasu | Koji Noguchi |
+| [MAPREDUCE-4572](https://issues.apache.org/jira/browse/MAPREDUCE-4572) | Can not access user logs - Jetty is not configured by default to serve aliases/symlinks | Major | tasktracker, webapps | Ahmed Radwan | Ahmed Radwan |
+| [HDFS-2757](https://issues.apache.org/jira/browse/HDFS-2757) | Cannot read a local block that's being written to when using the local read short circuit | Major | . | Jean-Daniel Cryans | Jean-Daniel Cryans |
+| [HADOOP-8781](https://issues.apache.org/jira/browse/HADOOP-8781) | hadoop-config.sh should add JAVA\_LIBRARY\_PATH to LD\_LIBRARY\_PATH | Major | scripts | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-4576](https://issues.apache.org/jira/browse/MAPREDUCE-4576) | Large dist cache can block tasktracker heartbeat | Major | . | Robert Joseph Evans | Robert Joseph Evans |
+| [HADOOP-8767](https://issues.apache.org/jira/browse/HADOOP-8767) | secondary namenode on slave machines | Minor | bin | giovanni delussu | giovanni delussu |
+| [HADOOP-8819](https://issues.apache.org/jira/browse/HADOOP-8819) | Should use && instead of & in a few places in FTPFileSystem,FTPInputStream,S3InputStream,ViewFileSystem,ViewFs | Major | fs | Brandon Li | Brandon Li |
+| [HADOOP-8786](https://issues.apache.org/jira/browse/HADOOP-8786) | HttpServer continues to start even if AuthenticationFilter fails to init | Major | . | Todd Lipcon | Todd Lipcon |
+| [HDFS-3961](https://issues.apache.org/jira/browse/HDFS-3961) | FSEditLog preallocate() needs to reset the position of PREALLOCATE\_BUFFER when more than 1MB size is needed | Major | . | Jing Zhao | Jing Zhao |
+| [HADOOP-8832](https://issues.apache.org/jira/browse/HADOOP-8832) | backport serviceplugin to branch-1 | Major | . | Brandon Li | Brandon Li |
+| [HDFS-3963](https://issues.apache.org/jira/browse/HDFS-3963) | backport namenode/datanode serviceplugin to branch-1 | Major | . | Brandon Li | Brandon Li |
+| [HDFS-3698](https://issues.apache.org/jira/browse/HDFS-3698) | TestHftpFileSystem is failing in branch-1 due to changed default secure port | Major | security | Aaron T. Myers | Aaron T. Myers |
| [HADOOP-7698](https://issues.apache.org/jira/browse/HADOOP-7698) | jsvc target fails on x86\_64 | Critical | build | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7101](https://issues.apache.org/jira/browse/HADOOP-7101) | UserGroupInformation.getCurrentUser() fails when called from non-Hadoop JAAS context | Blocker | security | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-4652](https://issues.apache.org/jira/browse/MAPREDUCE-4652) | ValueAggregatorJob sets the wrong job jar | Major | examples, mrv1 | Ahmed Radwan | Ahmed Radwan |
+| [MAPREDUCE-4662](https://issues.apache.org/jira/browse/MAPREDUCE-4662) | JobHistoryFilesManager thread pool never expands | Major | jobhistoryserver | Thomas Graves | Kihwal Lee |
+| [HADOOP-8791](https://issues.apache.org/jira/browse/HADOOP-8791) | rm "Only deletes non empty directory and files." | Major | documentation | Bertrand Dechoux | Jing Zhao |
+| [HADOOP-8386](https://issues.apache.org/jira/browse/HADOOP-8386) | hadoop script doesn't work if 'cd' prints to stdout (default behavior in Ubuntu) | Major | scripts | Christopher Berner | Christopher Berner |
+| [MAPREDUCE-4706](https://issues.apache.org/jira/browse/MAPREDUCE-4706) | FairScheduler#dump(): Computing of # running maps and reduces is commented out | Critical | contrib/fair-share | Karthik Kambatla | Karthik Kambatla |
+| [MAPREDUCE-4451](https://issues.apache.org/jira/browse/MAPREDUCE-4451) | fairscheduler fail to init job with kerberos authentication configured | Major | contrib/fair-share | Erik.fang | Erik.fang |
| [HADOOP-6496](https://issues.apache.org/jira/browse/HADOOP-6496) | HttpServer sends wrong content-type for CSS files (and others) | Minor | . | Lars Francke | Ivan Mitic |
-| [HDFS-4715](https://issues.apache.org/jira/browse/HDFS-4715) | Backport HDFS-3577 and other related WebHDFS issue to branch-1 | Major | webhdfs | Tsz Wo Nicholas Sze | Mark Wagner |
-| [HDFS-4558](https://issues.apache.org/jira/browse/HDFS-4558) | start balancer failed with NPE | Critical | balancer & mover | Wenwu Peng | Junping Du |
-| [HDFS-4544](https://issues.apache.org/jira/browse/HDFS-4544) | Error in deleting blocks should not do check disk, for all types of errors | Major | . | Amareshwari Sriramadasu | Arpit Agarwal |
-| [HDFS-4519](https://issues.apache.org/jira/browse/HDFS-4519) | Support override of jsvc binary and log file locations when launching secure datanode. | Major | datanode, scripts | Chris Nauroth | Chris Nauroth |
-| [HDFS-4518](https://issues.apache.org/jira/browse/HDFS-4518) | Finer grained metrics for HDFS capacity | Major | . | Arpit Agarwal | Arpit Agarwal |
-| [HDFS-4479](https://issues.apache.org/jira/browse/HDFS-4479) | logSync() with the FSNamesystem lock held in commitBlockSynchronization | Major | . | Jing Zhao | Jing Zhao |
-| [HDFS-4466](https://issues.apache.org/jira/browse/HDFS-4466) | Remove the deadlock from AbstractDelegationTokenSecretManager | Major | namenode, security | Brandon Li | Brandon Li |
-| [HDFS-4444](https://issues.apache.org/jira/browse/HDFS-4444) | Add space between total transaction time and number of transactions in FSEditLog#printStatistics | Trivial | . | Stephen Chu | Stephen Chu |
-| [HDFS-4413](https://issues.apache.org/jira/browse/HDFS-4413) | Secondary namenode won't start if HDFS isn't the default file system | Major | namenode | Mostafa Elhemali | Mostafa Elhemali |
-| [HDFS-4358](https://issues.apache.org/jira/browse/HDFS-4358) | TestCheckpoint failure with JDK7 | Major | test | Arpit Agarwal | Arpit Agarwal |
+| [HADOOP-7827](https://issues.apache.org/jira/browse/HADOOP-7827) | jsp pages missing DOCTYPE | Trivial | . | Dave Vronay | Dave Vronay |
+| [HDFS-3402](https://issues.apache.org/jira/browse/HDFS-3402) | Fix hdfs scripts for secure datanodes | Minor | scripts, security | Benoy Antony | Benoy Antony |
+| [HDFS-4072](https://issues.apache.org/jira/browse/HDFS-4072) | On file deletion remove corresponding blocks pending replication | Minor | namenode | Jing Zhao | Jing Zhao |
+| [HADOOP-8861](https://issues.apache.org/jira/browse/HADOOP-8861) | FSDataOutputStream.sync should call flush() if the underlying wrapped stream is not Syncable | Major | fs | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HDFS-3540](https://issues.apache.org/jira/browse/HDFS-3540) | Further improvement on recovery mode and edit log toleration in branch-1 | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-8900](https://issues.apache.org/jira/browse/HADOOP-8900) | BuiltInGzipDecompressor throws IOException - stored gzip size doesn't match decompressed size | Major | . | Slavik Krassovsky | Andy Isaacson |
+| [MAPREDUCE-1806](https://issues.apache.org/jira/browse/MAPREDUCE-1806) | CombineFileInputFormat does not work with paths not on default FS | Major | harchive | Paul Yang | Gera Shegalov |
+| [MAPREDUCE-4765](https://issues.apache.org/jira/browse/MAPREDUCE-4765) | Restarting the JobTracker programmatically can cause DelegationTokenRenewal to throw an exception | Minor | jobtracker, mrv1 | Robert Kanter | Robert Kanter |
+| [HDFS-4168](https://issues.apache.org/jira/browse/HDFS-4168) | TestDFSUpgradeFromImage fails in branch-1 | Major | namenode | Tsz Wo Nicholas Sze | Jing Zhao |
+| [HADOOP-8963](https://issues.apache.org/jira/browse/HADOOP-8963) | CopyFromLocal doesn't always create user directory | Trivial | . | Billie Rinaldi | Arpit Gupta |
+| [HDFS-4180](https://issues.apache.org/jira/browse/HDFS-4180) | TestFileCreation fails in branch-1 but not branch-1.1 | Minor | test | Tsz Wo Nicholas Sze | Jing Zhao |
+| [HADOOP-9036](https://issues.apache.org/jira/browse/HADOOP-9036) | TestSinkQueue.testConcurrentConsumers fails intermittently (Backports HADOOP-7292) | Major | . | Ivan Mitic | Suresh Srinivas |
+| [HDFS-4207](https://issues.apache.org/jira/browse/HDFS-4207) | All hadoop fs operations fail if the default fs is down even if a different file system is specified in the command | Minor | hdfs-client | Steve Loughran | Jing Zhao |
+| [HADOOP-9095](https://issues.apache.org/jira/browse/HADOOP-9095) | TestNNThroughputBenchmark fails in branch-1 | Minor | net | Tsz Wo Nicholas Sze | Jing Zhao |
+| [MAPREDUCE-4778](https://issues.apache.org/jira/browse/MAPREDUCE-4778) | Fair scheduler event log is only written if directory exists on HDFS | Major | jobtracker, scheduler | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9098](https://issues.apache.org/jira/browse/HADOOP-9098) | Add missing license headers | Blocker | build | Tom White | Arpit Agarwal |
+| [MAPREDUCE-4860](https://issues.apache.org/jira/browse/MAPREDUCE-4860) | DelegationTokenRenewal attempts to renew token even after a job is removed | Major | security | Karthik Kambatla | Karthik Kambatla |
+| [MAPREDUCE-4806](https://issues.apache.org/jira/browse/MAPREDUCE-4806) | Cleanup: Some (5) private methods in JobTracker.RecoveryManager are not used anymore after MAPREDUCE-3837 | Major | mrv1 | Karthik Kambatla | Karthik Kambatla |
+| [HDFS-4337](https://issues.apache.org/jira/browse/HDFS-4337) | Backport HDFS-4240 to branch-1: Make sure nodes are avoided to place replica if some replica are already under the same nodegroup. | Major | namenode | Junping Du | meng gong |
+| [MAPREDUCE-2217](https://issues.apache.org/jira/browse/MAPREDUCE-2217) | The expire launching task should cover the UNASSIGNED task | Major | jobtracker | Scott Chen | Karthik Kambatla |
+| [MAPREDUCE-4909](https://issues.apache.org/jira/browse/MAPREDUCE-4909) | TestKeyValueTextInputFormat fails with Open JDK 7 on Windows | Major | test | Arpit Agarwal | Arpit Agarwal |
| [HDFS-4355](https://issues.apache.org/jira/browse/HDFS-4355) | TestNameNodeMetrics.testCorruptBlock fails with open JDK7 | Major | test | Brandon Li | Brandon Li |
+| [HDFS-4358](https://issues.apache.org/jira/browse/HDFS-4358) | TestCheckpoint failure with JDK7 | Major | test | Arpit Agarwal | Arpit Agarwal |
+| [MAPREDUCE-4904](https://issues.apache.org/jira/browse/MAPREDUCE-4904) | TestMultipleLevelCaching failed in branch-1 | Major | test | meng gong | Junping Du |
+| [HADOOP-9179](https://issues.apache.org/jira/browse/HADOOP-9179) | TestFileSystem fails with open JDK7 | Major | . | Brandon Li | Brandon Li |
+| [MAPREDUCE-4916](https://issues.apache.org/jira/browse/MAPREDUCE-4916) | TestTrackerDistributedCacheManager is flaky due to other badly written tests in branch-1 | Major | . | Arun C Murthy | Xuan Gong |
+| [MAPREDUCE-4914](https://issues.apache.org/jira/browse/MAPREDUCE-4914) | TestMiniMRDFSSort fails with openJDK7 | Major | test | Brandon Li | Brandon Li |
+| [MAPREDUCE-4915](https://issues.apache.org/jira/browse/MAPREDUCE-4915) | TestShuffleExceptionCount fails with open JDK7 | Major | test | Brandon Li | Brandon Li |
| [HDFS-4351](https://issues.apache.org/jira/browse/HDFS-4351) | Fix BlockPlacementPolicyDefault#chooseTarget when avoiding stale nodes | Major | namenode | Andrew Wang | Andrew Wang |
-| [HDFS-4337](https://issues.apache.org/jira/browse/HDFS-4337) | Backport HDFS-4240 to branch-1: Make sure nodes are avoided to place replica if some replica are already under the same nodegroup. | Major | namenode | Junping Du | meng gong |
-| [HDFS-4240](https://issues.apache.org/jira/browse/HDFS-4240) | In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup | Major | namenode | Junping Du | Junping Du |
+| [MAPREDUCE-4278](https://issues.apache.org/jira/browse/MAPREDUCE-4278) | cannot run two local jobs in parallel from the same gateway. | Major | . | Araceli Henley | Sandy Ryza |
+| [HADOOP-9191](https://issues.apache.org/jira/browse/HADOOP-9191) | TestAccessControlList and TestJobHistoryConfig fail with JDK7 | Major | test | Arpit Agarwal | Arpit Agarwal |
+| [MAPREDUCE-4850](https://issues.apache.org/jira/browse/MAPREDUCE-4850) | Job recovery may fail if staging directory has been deleted | Major | mrv1 | Tom White | Tom White |
+| [MAPREDUCE-4930](https://issues.apache.org/jira/browse/MAPREDUCE-4930) | Backport MAPREDUCE-4678 and MAPREDUCE-4925 to branch-1 | Major | examples | Karthik Kambatla | Karthik Kambatla |
+| [MAPREDUCE-4924](https://issues.apache.org/jira/browse/MAPREDUCE-4924) | flakey test: org.apache.hadoop.mapred.TestClusterMRNotification.testMR | Trivial | mrv1 | Robert Kanter | Robert Kanter |
+| [MAPREDUCE-4315](https://issues.apache.org/jira/browse/MAPREDUCE-4315) | jobhistory.jsp throws 500 when a .txt file is found in /done | Major | jobhistoryserver | Alexander Alten-Lorenz | Sandy Ryza |
+| [MAPREDUCE-4923](https://issues.apache.org/jira/browse/MAPREDUCE-4923) | Add toString method to TaggedInputSplit | Minor | mrv1, mrv2, task | Sandy Ryza | Sandy Ryza |
+| [HADOOP-8580](https://issues.apache.org/jira/browse/HADOOP-8580) | ant compile-native fails with automake version 1.11.3 | Major | . | Eugene Koontz | |
+| [MAPREDUCE-4929](https://issues.apache.org/jira/browse/MAPREDUCE-4929) | mapreduce.task.timeout is ignored | Major | mrv1 | Sandy Ryza | Sandy Ryza |
+| [MAPREDUCE-4963](https://issues.apache.org/jira/browse/MAPREDUCE-4963) | StatisticsCollector improperly keeps track of "Last Day" and "Last Hour" statistics for new TaskTrackers | Major | mrv1 | Robert Kanter | Robert Kanter |
+| [MAPREDUCE-4962](https://issues.apache.org/jira/browse/MAPREDUCE-4962) | jobdetails.jsp uses display name instead of real name to get counters | Major | jobtracker, mrv1 | Sandy Ryza | Sandy Ryza |
+| [HDFS-4444](https://issues.apache.org/jira/browse/HDFS-4444) | Add space between total transaction time and number of transactions in FSEditLog#printStatistics | Trivial | . | Stephen Chu | Stephen Chu |
+| [MAPREDUCE-2264](https://issues.apache.org/jira/browse/MAPREDUCE-2264) | Job status exceeds 100% in some cases | Major | jobtracker | Adam Kramer | Devaraj K |
+| [MAPREDUCE-4969](https://issues.apache.org/jira/browse/MAPREDUCE-4969) | TestKeyValueTextInputFormat test fails with Open JDK 7 | Major | test | Arpit Agarwal | Arpit Agarwal |
+| [MAPREDUCE-4843](https://issues.apache.org/jira/browse/MAPREDUCE-4843) | When using DefaultTaskController, JobLocalizer not thread safe | Critical | tasktracker | yunjiong zhao | Karthik Kambatla |
+| [MAPREDUCE-4967](https://issues.apache.org/jira/browse/MAPREDUCE-4967) | TestJvmReuse fails on assertion | Major | tasktracker, test | Chris Nauroth | Karthik Kambatla |
+| [MAPREDUCE-4434](https://issues.apache.org/jira/browse/MAPREDUCE-4434) | Backport MR-2779 (JobSplitWriter.java can't handle large job.split file) to branch-1 | Major | mrv1 | Karthik Kambatla | Karthik Kambatla |
+| [MAPREDUCE-4970](https://issues.apache.org/jira/browse/MAPREDUCE-4970) | Child tasks (try to) create security audit log files | Major | . | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9124](https://issues.apache.org/jira/browse/HADOOP-9124) | SortedMapWritable violates contract of Map interface for equals() and hashCode() | Minor | io | Patrick Hunt | Surenkumar Nihalani |
+| [HDFS-4466](https://issues.apache.org/jira/browse/HDFS-4466) | Remove the deadlock from AbstractDelegationTokenSecretManager | Major | namenode, security | Brandon Li | Brandon Li |
+| [HADOOP-9154](https://issues.apache.org/jira/browse/HADOOP-9154) | SortedMapWritable#putAll() doesn't add key/value classes to the map | Major | io | Karthik Kambatla | Karthik Kambatla |
+| [MAPREDUCE-4643](https://issues.apache.org/jira/browse/MAPREDUCE-4643) | Make job-history cleanup-period configurable | Major | jobhistoryserver | Karthik Kambatla | Sandy Ryza |
| [HDFS-4222](https://issues.apache.org/jira/browse/HDFS-4222) | NN is unresponsive and loses heartbeats of DNs when Hadoop is configured to use LDAP and LDAP has issues | Minor | namenode | Xiaobo Peng | Xiaobo Peng |
-| [HDFS-4207](https://issues.apache.org/jira/browse/HDFS-4207) | All hadoop fs operations fail if the default fs is down even if a different file system is specified in the command | Minor | hdfs-client | Steve Loughran | Jing Zhao |
-| [HDFS-4180](https://issues.apache.org/jira/browse/HDFS-4180) | TestFileCreation fails in branch-1 but not branch-1.1 | Minor | test | Tsz Wo Nicholas Sze | Jing Zhao |
-| [HDFS-4168](https://issues.apache.org/jira/browse/HDFS-4168) | TestDFSUpgradeFromImage fails in branch-1 | Major | namenode | Tsz Wo Nicholas Sze | Jing Zhao |
-| [HDFS-4072](https://issues.apache.org/jira/browse/HDFS-4072) | On file deletion remove corresponding blocks pending replication | Minor | namenode | Jing Zhao | Jing Zhao |
-| [HDFS-3963](https://issues.apache.org/jira/browse/HDFS-3963) | backport namenode/datanode serviceplugin to branch-1 | Major | . | Brandon Li | Brandon Li |
-| [HDFS-3961](https://issues.apache.org/jira/browse/HDFS-3961) | FSEditLog preallocate() needs to reset the position of PREALLOCATE\_BUFFER when more than 1MB size is needed | Major | . | Jing Zhao | Jing Zhao |
-| [HDFS-3754](https://issues.apache.org/jira/browse/HDFS-3754) | BlockSender doesn't shutdown ReadaheadPool threads | Major | datanode | Eli Collins | Eli Collins |
-| [HDFS-3698](https://issues.apache.org/jira/browse/HDFS-3698) | TestHftpFileSystem is failing in branch-1 due to changed default secure port | Major | security | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3679](https://issues.apache.org/jira/browse/HDFS-3679) | fuse\_dfs notrash option sets usetrash | Minor | fuse-dfs | Conrad Meyer | Conrad Meyer |
-| [HDFS-3628](https://issues.apache.org/jira/browse/HDFS-3628) | The dfsadmin -setBalancerBandwidth command on branch-1 does not check for superuser privileges | Blocker | datanode, namenode | Harsh J | Harsh J |
-| [HDFS-3595](https://issues.apache.org/jira/browse/HDFS-3595) | TestEditLogLoading fails in branch-1 | Major | namenode | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3540](https://issues.apache.org/jira/browse/HDFS-3540) | Further improvement on recovery mode and edit log toleration in branch-1 | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-3499](https://issues.apache.org/jira/browse/HDFS-3499) | Make NetworkTopology support user specified topology class | Major | datanode | Junping Du | Junping Du |
-| [HDFS-3402](https://issues.apache.org/jira/browse/HDFS-3402) | Fix hdfs scripts for secure datanodes | Minor | scripts, security | Benoy Antony | Benoy Antony |
-| [HDFS-2827](https://issues.apache.org/jira/browse/HDFS-2827) | Cannot save namespace after renaming a directory above a file with an open lease | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HDFS-2757](https://issues.apache.org/jira/browse/HDFS-2757) | Cannot read a local block that's being written to when using the local read short circuit | Major | . | Jean-Daniel Cryans | Jean-Daniel Cryans |
-| [MAPREDUCE-5202](https://issues.apache.org/jira/browse/MAPREDUCE-5202) | Revert MAPREDUCE-4397 to avoid using incorrect config files | Major | . | Owen O'Malley | Owen O'Malley |
-| [MAPREDUCE-5198](https://issues.apache.org/jira/browse/MAPREDUCE-5198) | Race condition in cleanup during task tracker renint with LinuxTaskController | Major | tasktracker | Arpit Gupta | Arpit Gupta |
+| [HDFS-4479](https://issues.apache.org/jira/browse/HDFS-4479) | logSync() with the FSNamesystem lock held in commitBlockSynchronization | Major | . | Jing Zhao | Jing Zhao |
+| [HADOOP-8917](https://issues.apache.org/jira/browse/HADOOP-8917) | add LOCALE.US to toLowerCase in SecurityUtil.replacePattern | Major | . | Arpit Gupta | Arpit Gupta |
+| [MAPREDUCE-5008](https://issues.apache.org/jira/browse/MAPREDUCE-5008) | Merger progress miscounts with respect to EOF\_MARKER | Major | . | Sandy Ryza | Sandy Ryza |
+| [MAPREDUCE-5035](https://issues.apache.org/jira/browse/MAPREDUCE-5035) | Update MR1 memory configuration docs | Major | mrv1 | Tom White | Tom White |
+| [MAPREDUCE-4933](https://issues.apache.org/jira/browse/MAPREDUCE-4933) | MR1 final merge asks for length of file it just wrote before flushing it | Major | mrv1, task | Sandy Ryza | Sandy Ryza |
+| [HDFS-4518](https://issues.apache.org/jira/browse/HDFS-4518) | Finer grained metrics for HDFS capacity | Major | . | Arpit Agarwal | Arpit Agarwal |
+| [HADOOP-9349](https://issues.apache.org/jira/browse/HADOOP-9349) | Confusing output when running hadoop version from one hadoop installation when HADOOP\_HOME points to another | Major | tools | Sandy Ryza | Sandy Ryza |
+| [HDFS-4519](https://issues.apache.org/jira/browse/HDFS-4519) | Support override of jsvc binary and log file locations when launching secure datanode. | Major | datanode, scripts | Chris Nauroth | Chris Nauroth |
+| [HDFS-4544](https://issues.apache.org/jira/browse/HDFS-4544) | Error in deleting blocks should not do check disk, for all types of errors | Major | . | Amareshwari Sriramadasu | Arpit Agarwal |
+| [MAPREDUCE-5049](https://issues.apache.org/jira/browse/MAPREDUCE-5049) | CombineFileInputFormat counts all compressed files non-splitable | Major | . | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9369](https://issues.apache.org/jira/browse/HADOOP-9369) | DNS#reverseDns() can return hostname with . appended at the end | Major | net | Karthik Kambatla | Karthik Kambatla |
+| [HDFS-4558](https://issues.apache.org/jira/browse/HDFS-4558) | start balancer failed with NPE | Critical | balancer & mover | Wenwu Peng | Junping Du |
+| [HADOOP-9099](https://issues.apache.org/jira/browse/HADOOP-9099) | NetUtils.normalizeHostName fails on domains where UnknownHost resolves to an IP address | Minor | test | Ivan Mitic | Ivan Mitic |
+| [HADOOP-9451](https://issues.apache.org/jira/browse/HADOOP-9451) | Node with one topology layer should be handled as fault topology when NodeGroup layer is enabled | Major | net | Junping Du | Junping Du |
+| [MAPREDUCE-4463](https://issues.apache.org/jira/browse/MAPREDUCE-4463) | JobTracker recovery fails with HDFS permission issue | Blocker | mrv1 | Tom White | Tom White |
+| [MAPREDUCE-5131](https://issues.apache.org/jira/browse/MAPREDUCE-5131) | Provide better handling of job status related apis during JT restart | Major | . | Arun C Murthy | Arun C Murthy |
+| [HDFS-4413](https://issues.apache.org/jira/browse/HDFS-4413) | Secondary namenode won't start if HDFS isn't the default file system | Major | namenode | Mostafa Elhemali | Mostafa Elhemali |
+| [HADOOP-9467](https://issues.apache.org/jira/browse/HADOOP-9467) | Metrics2 record filtering (.record.filter.include/exclude) does not filter by name | Major | metrics | Chris Nauroth | Chris Nauroth |
+| [MAPREDUCE-5066](https://issues.apache.org/jira/browse/MAPREDUCE-5066) | JobTracker should set a timeout when calling into job.end.notification.url | Major | . | Ivan Mitic | Ivan Mitic |
+| [HADOOP-9473](https://issues.apache.org/jira/browse/HADOOP-9473) | typo in FileUtil copy() method | Trivial | fs | Glen Mazza | |
+| [HDFS-4715](https://issues.apache.org/jira/browse/HDFS-4715) | Backport HDFS-3577 and other related WebHDFS issue to branch-1 | Major | webhdfs | Tsz Wo Nicholas Sze | Mark Wagner |
+| [HADOOP-9492](https://issues.apache.org/jira/browse/HADOOP-9492) | Fix the typo in testConf.xml to make it consistent with FileUtil#copy() | Trivial | test | Jing Zhao | Jing Zhao |
| [MAPREDUCE-5169](https://issues.apache.org/jira/browse/MAPREDUCE-5169) | Job recovery fails if job tracker is restarted after the job is submitted but before its initialized | Major | . | Arpit Gupta | Arun C Murthy |
+| [HADOOP-9458](https://issues.apache.org/jira/browse/HADOOP-9458) | In branch-1, RPC.getProxy(..) may call proxy.getProtocolVersion(..) without retry | Critical | ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-9502](https://issues.apache.org/jira/browse/HADOOP-9502) | chmod does not return error exit codes for some exceptions | Minor | fs | Ramya Sunil | Tsz Wo Nicholas Sze |
| [MAPREDUCE-5166](https://issues.apache.org/jira/browse/MAPREDUCE-5166) | ConcurrentModificationException in LocalJobRunner | Blocker | . | Gunther Hagleitner | Sandy Ryza |
| [MAPREDUCE-5158](https://issues.apache.org/jira/browse/MAPREDUCE-5158) | Cleanup required when mapreduce.job.restart.recover is set to false | Major | jobtracker | Yesha Vora | Mayank Bansal |
+| [MAPREDUCE-5198](https://issues.apache.org/jira/browse/MAPREDUCE-5198) | Race condition in cleanup during task tracker renint with LinuxTaskController | Major | tasktracker | Arpit Gupta | Arpit Gupta |
| [MAPREDUCE-5154](https://issues.apache.org/jira/browse/MAPREDUCE-5154) | staging directory deletion fails because delegation tokens have been cancelled | Major | jobtracker | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5131](https://issues.apache.org/jira/browse/MAPREDUCE-5131) | Provide better handling of job status related apis during JT restart | Major | . | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-5066](https://issues.apache.org/jira/browse/MAPREDUCE-5066) | JobTracker should set a timeout when calling into job.end.notification.url | Major | . | Ivan Mitic | Ivan Mitic |
-| [MAPREDUCE-5049](https://issues.apache.org/jira/browse/MAPREDUCE-5049) | CombineFileInputFormat counts all compressed files non-splitable | Major | . | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-5035](https://issues.apache.org/jira/browse/MAPREDUCE-5035) | Update MR1 memory configuration docs | Major | mrv1 | Tom White | Tom White |
+| [MAPREDUCE-5202](https://issues.apache.org/jira/browse/MAPREDUCE-5202) | Revert MAPREDUCE-4397 to avoid using incorrect config files | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-9537](https://issues.apache.org/jira/browse/HADOOP-9537) | Backport AIX patches to branch-1 | Major | security | Arpit Agarwal | Arpit Agarwal |
+| [HADOOP-9543](https://issues.apache.org/jira/browse/HADOOP-9543) | TestFsShellReturnCode may fail in branch-1 | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-9544](https://issues.apache.org/jira/browse/HADOOP-9544) | backport UTF8 encoding fixes to branch-1 | Major | io | Chris Nauroth | Chris Nauroth |
+| [HADOOP-9375](https://issues.apache.org/jira/browse/HADOOP-9375) | Port HADOOP-7290 to branch-1 to fix TestUserGroupInformation failure | Trivial | test | Xiaobo Peng | Suresh Srinivas |
+| [HDFS-4240](https://issues.apache.org/jira/browse/HDFS-4240) | In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup | Major | namenode | Junping Du | Junping Du |
+| [HDFS-3499](https://issues.apache.org/jira/browse/HDFS-3499) | Make NetworkTopology support user specified topology class | Major | datanode | Junping Du | Junping Du |
| [MAPREDUCE-5028](https://issues.apache.org/jira/browse/MAPREDUCE-5028) | Maps fail when io.sort.mb is set to high value | Critical | . | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-5008](https://issues.apache.org/jira/browse/MAPREDUCE-5008) | Merger progress miscounts with respect to EOF\_MARKER | Major | . | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4970](https://issues.apache.org/jira/browse/MAPREDUCE-4970) | Child tasks (try to) create security audit log files | Major | . | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4969](https://issues.apache.org/jira/browse/MAPREDUCE-4969) | TestKeyValueTextInputFormat test fails with Open JDK 7 | Major | test | Arpit Agarwal | Arpit Agarwal |
-| [MAPREDUCE-4967](https://issues.apache.org/jira/browse/MAPREDUCE-4967) | TestJvmReuse fails on assertion | Major | tasktracker, test | Chris Nauroth | Karthik Kambatla |
-| [MAPREDUCE-4963](https://issues.apache.org/jira/browse/MAPREDUCE-4963) | StatisticsCollector improperly keeps track of "Last Day" and "Last Hour" statistics for new TaskTrackers | Major | mrv1 | Robert Kanter | Robert Kanter |
-| [MAPREDUCE-4962](https://issues.apache.org/jira/browse/MAPREDUCE-4962) | jobdetails.jsp uses display name instead of real name to get counters | Major | jobtracker, mrv1 | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4933](https://issues.apache.org/jira/browse/MAPREDUCE-4933) | MR1 final merge asks for length of file it just wrote before flushing it | Major | mrv1, task | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4930](https://issues.apache.org/jira/browse/MAPREDUCE-4930) | Backport MAPREDUCE-4678 and MAPREDUCE-4925 to branch-1 | Major | examples | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-4929](https://issues.apache.org/jira/browse/MAPREDUCE-4929) | mapreduce.task.timeout is ignored | Major | mrv1 | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4924](https://issues.apache.org/jira/browse/MAPREDUCE-4924) | flakey test: org.apache.hadoop.mapred.TestClusterMRNotification.testMR | Trivial | mrv1 | Robert Kanter | Robert Kanter |
-| [MAPREDUCE-4923](https://issues.apache.org/jira/browse/MAPREDUCE-4923) | Add toString method to TaggedInputSplit | Minor | mrv1, mrv2, task | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4916](https://issues.apache.org/jira/browse/MAPREDUCE-4916) | TestTrackerDistributedCacheManager is flaky due to other badly written tests in branch-1 | Major | . | Arun C Murthy | Xuan Gong |
-| [MAPREDUCE-4915](https://issues.apache.org/jira/browse/MAPREDUCE-4915) | TestShuffleExceptionCount fails with open JDK7 | Major | test | Brandon Li | Brandon Li |
-| [MAPREDUCE-4914](https://issues.apache.org/jira/browse/MAPREDUCE-4914) | TestMiniMRDFSSort fails with openJDK7 | Major | test | Brandon Li | Brandon Li |
-| [MAPREDUCE-4909](https://issues.apache.org/jira/browse/MAPREDUCE-4909) | TestKeyValueTextInputFormat fails with Open JDK 7 on Windows | Major | test | Arpit Agarwal | Arpit Agarwal |
-| [MAPREDUCE-4904](https://issues.apache.org/jira/browse/MAPREDUCE-4904) | TestMultipleLevelCaching failed in branch-1 | Major | test | meng gong | Junping Du |
-| [MAPREDUCE-4860](https://issues.apache.org/jira/browse/MAPREDUCE-4860) | DelegationTokenRenewal attempts to renew token even after a job is removed | Major | security | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-4850](https://issues.apache.org/jira/browse/MAPREDUCE-4850) | Job recovery may fail if staging directory has been deleted | Major | mrv1 | Tom White | Tom White |
-| [MAPREDUCE-4843](https://issues.apache.org/jira/browse/MAPREDUCE-4843) | When using DefaultTaskController, JobLocalizer not thread safe | Critical | tasktracker | zhaoyunjiong | Karthik Kambatla |
-| [MAPREDUCE-4806](https://issues.apache.org/jira/browse/MAPREDUCE-4806) | Cleanup: Some (5) private methods in JobTracker.RecoveryManager are not used anymore after MAPREDUCE-3837 | Major | mrv1 | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-4778](https://issues.apache.org/jira/browse/MAPREDUCE-4778) | Fair scheduler event log is only written if directory exists on HDFS | Major | jobtracker, scheduler | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4765](https://issues.apache.org/jira/browse/MAPREDUCE-4765) | Restarting the JobTracker programmatically can cause DelegationTokenRenewal to throw an exception | Minor | jobtracker, mrv1 | Robert Kanter | Robert Kanter |
-| [MAPREDUCE-4706](https://issues.apache.org/jira/browse/MAPREDUCE-4706) | FairScheduler#dump(): Computing of # running maps and reduces is commented out | Critical | contrib/fair-share | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-4662](https://issues.apache.org/jira/browse/MAPREDUCE-4662) | JobHistoryFilesManager thread pool never expands | Major | jobhistoryserver | Thomas Graves | Kihwal Lee |
-| [MAPREDUCE-4652](https://issues.apache.org/jira/browse/MAPREDUCE-4652) | ValueAggregatorJob sets the wrong job jar | Major | examples, mrv1 | Ahmed Radwan | Ahmed Radwan |
-| [MAPREDUCE-4643](https://issues.apache.org/jira/browse/MAPREDUCE-4643) | Make job-history cleanup-period configurable | Major | jobhistoryserver | Karthik Kambatla | Sandy Ryza |
-| [MAPREDUCE-4595](https://issues.apache.org/jira/browse/MAPREDUCE-4595) | TestLostTracker failing - possibly due to a race in JobHistory.JobHistoryFilesManager#run() | Critical | . | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-4576](https://issues.apache.org/jira/browse/MAPREDUCE-4576) | Large dist cache can block tasktracker heartbeat | Major | . | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4572](https://issues.apache.org/jira/browse/MAPREDUCE-4572) | Can not access user logs - Jetty is not configured by default to serve aliases/symlinks | Major | tasktracker, webapps | Ahmed Radwan | Ahmed Radwan |
-| [MAPREDUCE-4463](https://issues.apache.org/jira/browse/MAPREDUCE-4463) | JobTracker recovery fails with HDFS permission issue | Blocker | mrv1 | Tom White | Tom White |
-| [MAPREDUCE-4451](https://issues.apache.org/jira/browse/MAPREDUCE-4451) | fairscheduler fail to init job with kerberos authentication configured | Major | contrib/fair-share | Erik.fang | Erik.fang |
-| [MAPREDUCE-4434](https://issues.apache.org/jira/browse/MAPREDUCE-4434) | Backport MR-2779 (JobSplitWriter.java can't handle large job.split file) to branch-1 | Major | mrv1 | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-4385](https://issues.apache.org/jira/browse/MAPREDUCE-4385) | FairScheduler.maxTasksToAssign() should check for fairscheduler.assignmultiple.maps \< TaskTracker.availableSlots | Major | . | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-4359](https://issues.apache.org/jira/browse/MAPREDUCE-4359) | Potential deadlock in Counters | Major | . | Todd Lipcon | Tom White |
-| [MAPREDUCE-4317](https://issues.apache.org/jira/browse/MAPREDUCE-4317) | Job view ACL checks are too permissive | Major | mrv1 | Harsh J | Karthik Kambatla |
-| [MAPREDUCE-4315](https://issues.apache.org/jira/browse/MAPREDUCE-4315) | jobhistory.jsp throws 500 when a .txt file is found in /done | Major | jobhistoryserver | Alexander Alten-Lorenz | Sandy Ryza |
-| [MAPREDUCE-4278](https://issues.apache.org/jira/browse/MAPREDUCE-4278) | cannot run two local jobs in parallel from the same gateway. | Major | . | Araceli Henley | Sandy Ryza |
-| [MAPREDUCE-4195](https://issues.apache.org/jira/browse/MAPREDUCE-4195) | With invalid queueName request param, jobqueue\_details.jsp shows NPE | Critical | jobtracker | Gera Shegalov | |
-| [MAPREDUCE-4036](https://issues.apache.org/jira/browse/MAPREDUCE-4036) | Streaming TestUlimit fails on CentOS 6 | Major | test | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-3993](https://issues.apache.org/jira/browse/MAPREDUCE-3993) | Graceful handling of codec errors during decompression | Major | mrv1, mrv2 | Todd Lipcon | Karthik Kambatla |
-| [MAPREDUCE-3727](https://issues.apache.org/jira/browse/MAPREDUCE-3727) | jobtoken location property in jobconf refers to wrong jobtoken file | Critical | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-2289](https://issues.apache.org/jira/browse/MAPREDUCE-2289) | Permissions race can make getStagingDir fail on local filesystem | Major | job submission | Todd Lipcon | Ahmed Radwan |
-| [MAPREDUCE-2264](https://issues.apache.org/jira/browse/MAPREDUCE-2264) | Job status exceeds 100% in some cases | Major | jobtracker | Adam Kramer | Devaraj K |
-| [MAPREDUCE-2217](https://issues.apache.org/jira/browse/MAPREDUCE-2217) | The expire launching task should cover the UNASSIGNED task | Major | jobtracker | Scott Chen | Karthik Kambatla |
-| [MAPREDUCE-1806](https://issues.apache.org/jira/browse/MAPREDUCE-1806) | CombineFileInputFormat does not work with paths not on default FS | Major | harchive | Paul Yang | Gera Shegalov |
-| [MAPREDUCE-1684](https://issues.apache.org/jira/browse/MAPREDUCE-1684) | ClusterStatus can be cached in CapacityTaskScheduler.assignTasks() | Major | capacity-sched | Amareshwari Sriramadasu | Koji Noguchi |
### TESTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9175](https://issues.apache.org/jira/browse/HADOOP-9175) | TestWritableName fails with Open JDK 7 | Major | test | Arpit Agarwal | Arpit Agarwal |
| [HADOOP-9174](https://issues.apache.org/jira/browse/HADOOP-9174) | TestSecurityUtil fails on Open JDK 7 | Major | test | Arpit Agarwal | Arpit Agarwal |
+| [HADOOP-9175](https://issues.apache.org/jira/browse/HADOOP-9175) | TestWritableName fails with Open JDK 7 | Major | test | Arpit Agarwal | Arpit Agarwal |
| [HDFS-4256](https://issues.apache.org/jira/browse/HDFS-4256) | Backport concatenation of files into a single file to branch-1 | Major | namenode | Suresh Srinivas | Sanjay Radia |
@@ -270,17 +264,11 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8817](https://issues.apache.org/jira/browse/HADOOP-8817) | Backport Network Topology Extension for Virtualization (HADOOP-8468) to branch-1 | Major | . | Junping Du | Junping Du |
-| [HADOOP-8470](https://issues.apache.org/jira/browse/HADOOP-8470) | Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWithNodeGroup) | Major | . | Junping Du | Junping Du |
-| [HADOOP-8469](https://issues.apache.org/jira/browse/HADOOP-8469) | Make NetworkTopology class pluggable | Major | . | Junping Du | Junping Du |
| [HADOOP-7754](https://issues.apache.org/jira/browse/HADOOP-7754) | Expose file descriptors from Hadoop-wrapped local FileSystems | Major | native, performance | Todd Lipcon | Todd Lipcon |
-| [HDFS-4071](https://issues.apache.org/jira/browse/HDFS-4071) | Add number of stale DataNodes to metrics for Branch-1 | Minor | datanode, namenode | Jing Zhao | Jing Zhao |
| [HDFS-3912](https://issues.apache.org/jira/browse/HDFS-3912) | Detecting and avoiding stale datanodes for writing | Major | . | Jing Zhao | Jing Zhao |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-4071](https://issues.apache.org/jira/browse/HDFS-4071) | Add number of stale DataNodes to metrics for Branch-1 | Minor | datanode, namenode | Jing Zhao | Jing Zhao |
+| [HADOOP-8817](https://issues.apache.org/jira/browse/HADOOP-8817) | Backport Network Topology Extension for Virtualization (HADOOP-8468) to branch-1 | Major | . | Junping Du | Junping Du |
+| [HADOOP-8469](https://issues.apache.org/jira/browse/HADOOP-8469) | Make NetworkTopology class pluggable | Major | . | Junping Du | Junping Du |
+| [HADOOP-8470](https://issues.apache.org/jira/browse/HADOOP-8470) | Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWithNodeGroup) | Major | . | Junping Du | Junping Du |
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[51/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
HADOOP-14364. refresh changelog/release notes with newer Apache Yetus build
Signed-off-by: Andrew Wang <wa...@apache.org>
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/19041008
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/19041008
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/19041008
Branch: refs/heads/trunk
Commit: 190410085b86b002a7515ce3a000d87bafffc77d
Parents: 91cc070
Author: Allen Wittenauer <aw...@apache.org>
Authored: Thu May 4 18:22:34 2017 -0700
Committer: Allen Wittenauer <aw...@apache.org>
Committed: Thu Aug 31 19:06:49 2017 -0700
----------------------------------------------------------------------
hadoop-common-project/hadoop-common/pom.xml | 2 +-
.../markdown/release/0.1.0/CHANGES.0.1.0.md | 106 +-
.../markdown/release/0.1.1/CHANGES.0.1.1.md | 36 +-
.../markdown/release/0.10.0/CHANGES.0.10.0.md | 118 +-
.../markdown/release/0.10.1/CHANGES.0.10.1.md | 52 +-
.../markdown/release/0.11.0/CHANGES.0.11.0.md | 106 +-
.../markdown/release/0.11.1/CHANGES.0.11.1.md | 44 +-
.../markdown/release/0.11.2/CHANGES.0.11.2.md | 42 +-
.../markdown/release/0.12.0/CHANGES.0.12.0.md | 124 +-
.../markdown/release/0.12.1/CHANGES.0.12.1.md | 70 +-
.../markdown/release/0.12.2/CHANGES.0.12.2.md | 44 +-
.../markdown/release/0.12.3/CHANGES.0.12.3.md | 50 +-
.../markdown/release/0.13.0/CHANGES.0.13.0.md | 252 +-
.../markdown/release/0.13.1/CHANGES.0.13.1.md | 64 -
.../release/0.13.1/RELEASENOTES.0.13.1.md | 24 -
.../markdown/release/0.14.0/CHANGES.0.14.0.md | 288 +--
.../markdown/release/0.14.1/CHANGES.0.14.1.md | 44 +-
.../markdown/release/0.14.2/CHANGES.0.14.2.md | 52 +-
.../markdown/release/0.14.3/CHANGES.0.14.3.md | 44 +-
.../markdown/release/0.14.4/CHANGES.0.14.4.md | 36 +-
.../markdown/release/0.15.0/CHANGES.0.15.0.md | 266 +-
.../markdown/release/0.15.1/CHANGES.0.15.1.md | 32 +-
.../markdown/release/0.15.2/CHANGES.0.15.2.md | 52 +-
.../markdown/release/0.15.3/CHANGES.0.15.3.md | 44 +-
.../markdown/release/0.15.4/CHANGES.0.15.4.md | 42 +-
.../markdown/release/0.16.0/CHANGES.0.16.0.md | 320 ++-
.../markdown/release/0.16.1/CHANGES.0.16.1.md | 74 +-
.../markdown/release/0.16.2/CHANGES.0.16.2.md | 70 +-
.../markdown/release/0.16.3/CHANGES.0.16.3.md | 46 +-
.../markdown/release/0.16.4/CHANGES.0.16.4.md | 46 +-
.../markdown/release/0.17.0/CHANGES.0.17.0.md | 350 ++-
.../release/0.17.0/RELEASENOTES.0.17.0.md | 450 ++--
.../markdown/release/0.17.1/CHANGES.0.17.1.md | 48 +-
.../markdown/release/0.17.2/CHANGES.0.17.2.md | 60 +-
.../release/0.17.2/RELEASENOTES.0.17.2.md | 12 +-
.../markdown/release/0.17.3/CHANGES.0.17.3.md | 40 +-
.../markdown/release/0.18.0/CHANGES.0.18.0.md | 492 ++--
.../release/0.18.0/RELEASENOTES.0.18.0.md | 302 +--
.../markdown/release/0.18.1/CHANGES.0.18.1.md | 48 +-
.../release/0.18.1/RELEASENOTES.0.18.1.md | 8 +-
.../markdown/release/0.18.2/CHANGES.0.18.2.md | 58 +-
.../release/0.18.2/RELEASENOTES.0.18.2.md | 20 +-
.../markdown/release/0.18.3/CHANGES.0.18.3.md | 100 +-
.../release/0.18.3/RELEASENOTES.0.18.3.md | 50 +-
.../markdown/release/0.18.4/CHANGES.0.18.4.md | 48 +-
.../markdown/release/0.19.0/CHANGES.0.19.0.md | 636 +++--
.../release/0.19.0/RELEASENOTES.0.19.0.md | 306 +--
.../markdown/release/0.19.1/CHANGES.0.19.1.md | 96 +-
.../release/0.19.1/RELEASENOTES.0.19.1.md | 40 +-
.../markdown/release/0.19.2/CHANGES.0.19.2.md | 92 +-
.../markdown/release/0.2.0/CHANGES.0.2.0.md | 102 +-
.../markdown/release/0.2.1/CHANGES.0.2.1.md | 44 +-
.../markdown/release/0.20.0/CHANGES.0.20.0.md | 508 ++--
.../release/0.20.0/RELEASENOTES.0.20.0.md | 186 +-
.../markdown/release/0.20.1/CHANGES.0.20.1.md | 134 +-
.../release/0.20.1/RELEASENOTES.0.20.1.md | 112 +-
.../markdown/release/0.20.2/CHANGES.0.20.2.md | 90 +-
.../release/0.20.2/RELEASENOTES.0.20.2.md | 66 +-
.../release/0.20.203.0/CHANGES.0.20.203.0.md | 64 +-
.../0.20.203.0/RELEASENOTES.0.20.203.0.md | 44 +-
.../release/0.20.203.1/CHANGES.0.20.203.1.md | 42 +-
.../release/0.20.204.0/CHANGES.0.20.204.0.md | 100 +-
.../0.20.204.0/RELEASENOTES.0.20.204.0.md | 38 +-
.../release/0.20.204.1/CHANGES.0.20.204.1.md | 64 -
.../0.20.204.1/RELEASENOTES.0.20.204.1.md | 24 -
.../release/0.20.205.0/CHANGES.0.20.205.0.md | 210 +-
.../0.20.205.0/RELEASENOTES.0.20.205.0.md | 98 +-
.../markdown/release/0.20.3/CHANGES.0.20.3.md | 74 +-
.../release/0.20.3/RELEASENOTES.0.20.3.md | 12 +-
.../markdown/release/0.21.0/CHANGES.0.21.0.md | 2412 +++++++++---------
.../release/0.21.0/RELEASENOTES.0.21.0.md | 1324 +++++-----
.../markdown/release/0.21.1/CHANGES.0.21.1.md | 92 +-
.../release/0.21.1/RELEASENOTES.0.21.1.md | 38 +-
.../markdown/release/0.22.0/CHANGES.0.22.0.md | 1276 +++++----
.../release/0.22.0/RELEASENOTES.0.22.0.md | 394 +--
.../markdown/release/0.22.1/CHANGES.0.22.1.md | 78 +-
.../release/0.22.1/RELEASENOTES.0.22.1.md | 16 +-
.../markdown/release/0.23.0/CHANGES.0.23.0.md | 2082 ++++++++-------
.../release/0.23.0/RELEASENOTES.0.23.0.md | 726 +++---
.../markdown/release/0.23.1/CHANGES.0.23.1.md | 756 +++---
.../release/0.23.1/RELEASENOTES.0.23.1.md | 388 +--
.../markdown/release/0.23.10/CHANGES.0.23.10.md | 124 +-
.../release/0.23.10/RELEASENOTES.0.23.10.md | 2 +-
.../markdown/release/0.23.11/CHANGES.0.23.11.md | 88 +-
.../markdown/release/0.23.2/CHANGES.0.23.2.md | 180 +-
.../release/0.23.2/RELEASENOTES.0.23.2.md | 96 +-
.../markdown/release/0.23.3/CHANGES.0.23.3.md | 470 ++--
.../release/0.23.3/RELEASENOTES.0.23.3.md | 66 +-
.../markdown/release/0.23.4/CHANGES.0.23.4.md | 64 +-
.../markdown/release/0.23.5/CHANGES.0.23.5.md | 166 +-
.../markdown/release/0.23.6/CHANGES.0.23.6.md | 120 +-
.../markdown/release/0.23.7/CHANGES.0.23.7.md | 220 +-
.../release/0.23.7/RELEASENOTES.0.23.7.md | 12 +-
.../markdown/release/0.23.8/CHANGES.0.23.8.md | 60 +-
.../markdown/release/0.23.9/CHANGES.0.23.9.md | 42 +-
.../markdown/release/0.24.0/CHANGES.0.24.0.md | 52 +-
.../release/0.24.0/RELEASENOTES.0.24.0.md | 16 +-
.../markdown/release/0.3.0/CHANGES.0.3.0.md | 74 +-
.../markdown/release/0.3.1/CHANGES.0.3.1.md | 44 +-
.../markdown/release/0.3.2/CHANGES.0.3.2.md | 42 +-
.../markdown/release/0.4.0/CHANGES.0.4.0.md | 58 +-
.../markdown/release/0.5.0/CHANGES.0.5.0.md | 100 +-
.../markdown/release/0.6.0/CHANGES.0.6.0.md | 78 +-
.../markdown/release/0.6.1/CHANGES.0.6.1.md | 46 +-
.../markdown/release/0.6.2/CHANGES.0.6.2.md | 36 +-
.../markdown/release/0.7.0/CHANGES.0.7.0.md | 76 +-
.../markdown/release/0.7.1/CHANGES.0.7.1.md | 38 +-
.../markdown/release/0.7.2/CHANGES.0.7.2.md | 36 +-
.../markdown/release/0.8.0/CHANGES.0.8.0.md | 90 +-
.../markdown/release/0.9.0/CHANGES.0.9.0.md | 98 +-
.../markdown/release/0.9.1/CHANGES.0.9.1.md | 40 -
.../markdown/release/0.9.2/CHANGES.0.9.2.md | 42 +-
.../markdown/release/1.0.0/CHANGES.1.0.0.md | 94 +-
.../release/1.0.0/RELEASENOTES.1.0.0.md | 28 +-
.../markdown/release/1.0.1/CHANGES.1.0.1.md | 48 +-
.../release/1.0.1/RELEASENOTES.1.0.1.md | 16 +-
.../markdown/release/1.0.2/CHANGES.1.0.2.md | 48 +-
.../markdown/release/1.0.3/CHANGES.1.0.3.md | 68 +-
.../release/1.0.3/RELEASENOTES.1.0.3.md | 10 +-
.../markdown/release/1.0.4/CHANGES.1.0.4.md | 34 -
.../markdown/release/1.1.0/CHANGES.1.1.0.md | 222 +-
.../release/1.1.0/RELEASENOTES.1.1.0.md | 120 +-
.../markdown/release/1.1.1/CHANGES.1.1.1.md | 44 +-
.../markdown/release/1.1.2/CHANGES.1.1.2.md | 48 +-
.../release/1.1.2/RELEASENOTES.1.1.2.md | 22 +-
.../markdown/release/1.1.3/CHANGES.1.1.3.md | 44 +-
.../markdown/release/1.2.0/CHANGES.1.2.0.md | 380 ++-
.../release/1.2.0/RELEASENOTES.1.2.0.md | 112 +-
.../markdown/release/1.2.1/CHANGES.1.2.1.md | 54 +-
.../release/1.2.1/RELEASENOTES.1.2.1.md | 8 +-
.../markdown/release/1.2.2/CHANGES.1.2.2.md | 44 +-
.../markdown/release/1.3.0/CHANGES.1.3.0.md | 160 +-
.../release/1.3.0/RELEASENOTES.1.3.0.md | 30 +-
.../release/2.0.0-alpha/CHANGES.2.0.0-alpha.md | 574 +++--
.../2.0.0-alpha/RELEASENOTES.2.0.0-alpha.md | 72 +-
.../release/2.0.1-alpha/CHANGES.2.0.1-alpha.md | 36 -
.../2.0.1-alpha/RELEASENOTES.2.0.1-alpha.md | 2 +-
.../release/2.0.2-alpha/CHANGES.2.0.2-alpha.md | 1184 +++++----
.../2.0.2-alpha/RELEASENOTES.2.0.2-alpha.md | 150 +-
.../release/2.0.3-alpha/CHANGES.2.0.3-alpha.md | 924 ++++---
.../2.0.3-alpha/RELEASENOTES.2.0.3-alpha.md | 124 +-
.../release/2.0.4-alpha/CHANGES.2.0.4-alpha.md | 74 +-
.../release/2.0.5-alpha/CHANGES.2.0.5-alpha.md | 46 +-
.../release/2.0.6-alpha/CHANGES.2.0.6-alpha.md | 40 -
.../release/2.1.0-beta/CHANGES.2.1.0-beta.md | 1527 ++++++-----
.../2.1.0-beta/RELEASENOTES.2.1.0-beta.md | 432 ++--
.../release/2.1.1-beta/CHANGES.2.1.1-beta.md | 294 +--
.../2.1.1-beta/RELEASENOTES.2.1.1-beta.md | 10 +-
.../markdown/release/2.2.0/CHANGES.2.2.0.md | 142 +-
.../release/2.2.0/RELEASENOTES.2.2.0.md | 12 +-
.../markdown/release/2.2.1/CHANGES.2.2.1.md | 36 +-
.../markdown/release/2.3.0/CHANGES.2.3.0.md | 1082 ++++----
.../release/2.3.0/RELEASENOTES.2.3.0.md | 54 +-
.../markdown/release/2.4.0/CHANGES.2.4.0.md | 752 +++---
.../release/2.4.0/RELEASENOTES.2.4.0.md | 80 +-
.../markdown/release/2.4.1/CHANGES.2.4.1.md | 162 +-
.../markdown/release/2.5.0/CHANGES.2.5.0.md | 870 ++++---
.../release/2.5.0/RELEASENOTES.2.5.0.md | 54 +-
.../markdown/release/2.5.1/CHANGES.2.5.1.md | 46 +-
.../markdown/release/2.5.2/CHANGES.2.5.2.md | 46 +-
.../markdown/release/2.6.0/CHANGES.2.6.0.md | 1651 ++++++------
.../release/2.6.0/RELEASENOTES.2.6.0.md | 84 +-
.../markdown/release/2.6.1/CHANGES.2.6.1.md | 300 +--
.../release/2.6.1/RELEASENOTES.2.6.1.md | 14 +-
.../markdown/release/2.6.2/CHANGES.2.6.2.md | 40 +-
.../release/2.6.2/RELEASENOTES.2.6.2.md | 7 +
.../markdown/release/2.6.3/CHANGES.2.6.3.md | 74 +-
.../markdown/release/2.6.4/CHANGES.2.6.4.md | 82 +-
.../release/2.6.4/RELEASENOTES.2.6.4.md | 8 +
.../markdown/release/2.6.5/CHANGES.2.6.5.md | 132 +
.../release/2.6.5/RELEASENOTES.2.6.5.md | 44 +
.../markdown/release/2.6.6/CHANGES.2.6.6.md | 47 +
.../release/2.6.6/RELEASENOTES.2.6.6.md | 28 +
.../markdown/release/2.7.0/CHANGES.2.7.0.md | 1696 ++++++------
.../release/2.7.0/RELEASENOTES.2.7.0.md | 152 +-
.../markdown/release/2.7.1/CHANGES.2.7.1.md | 238 +-
.../release/2.7.1/RELEASENOTES.2.7.1.md | 11 +-
.../markdown/release/2.7.2/CHANGES.2.7.2.md | 282 +-
.../release/2.7.2/RELEASENOTES.2.7.2.md | 7 +-
.../markdown/release/2.7.3/CHANGES.2.7.3.md | 284 +++
.../release/2.7.3/RELEASENOTES.2.7.3.md | 74 +
.../markdown/release/2.7.4/CHANGES.2.7.4.md | 326 +++
.../release/2.7.4/RELEASENOTES.2.7.4.md | 130 +
.../markdown/release/2.7.5/CHANGES.2.7.5.md | 32 +
.../release/2.7.5/RELEASENOTES.2.7.5.md | 24 +
.../markdown/release/2.8.0/CHANGES.2.8.0.md | 95 +-
.../release/2.8.0/RELEASENOTES.2.8.0.md | 45 +-
.../markdown/release/2.8.1/CHANGES.2.8.1.md | 31 +
.../release/2.8.1/RELEASENOTES.2.8.1.md | 31 +
.../markdown/release/2.8.2/CHANGES.2.8.2.md | 356 +++
.../release/2.8.2/RELEASENOTES.2.8.2.md | 75 +
.../markdown/release/2.8.3/CHANGES.2.8.3.md | 69 +
.../release/2.8.3/RELEASENOTES.2.8.3.md | 36 +
.../markdown/release/2.9.0/CHANGES.2.9.0.md | 1453 +++++++++++
.../release/2.9.0/RELEASENOTES.2.9.0.md | 440 ++++
.../3.0.0-alpha1/CHANGES.3.0.0-alpha1.md | 230 +-
.../3.0.0-alpha1/RELEASENOTES.3.0.0-alpha1.md | 176 +-
.../3.0.0-alpha2/CHANGES.3.0.0-alpha2.md | 58 +-
.../3.0.0-alpha2/RELEASENOTES.3.0.0-alpha2.md | 113 +-
.../3.0.0-alpha3/CHANGES.3.0.0-alpha3.md | 35 +-
.../3.0.0-alpha3/RELEASENOTES.3.0.0-alpha3.md | 8 +-
.../3.0.0-alpha4/CHANGES.3.0.0-alpha4.md | 35 +-
.../3.0.0-alpha4/RELEASENOTES.3.0.0-alpha4.md | 20 +-
.../src/site/markdown/MapredAppMasterRest.md | 252 +-
.../src/site/markdown/HistoryServerRest.md | 78 +-
.../src/site/markdown/NodeManagerRest.md | 38 +-
.../src/site/markdown/ResourceManagerRest.md | 554 ++--
pom.xml | 7 +-
208 files changed, 20659 insertions(+), 19918 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/pom.xml
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/pom.xml b/hadoop-common-project/hadoop-common/pom.xml
index 0cd5479..e9222bb 100644
--- a/hadoop-common-project/hadoop-common/pom.xml
+++ b/hadoop-common-project/hadoop-common/pom.xml
@@ -1060,7 +1060,7 @@
<argument>--project</argument>
<argument>YARN</argument>
<argument>--projecttitle</argument>
- <argument>"Apache Hadoop"</argument>
+ <argument>Apache Hadoop</argument>
<argument>--usetoday</argument>
<argument>--version</argument>
<argument>${project.version}</argument>
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.1.0/CHANGES.0.1.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.1.0/CHANGES.0.1.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.1.0/CHANGES.0.1.0.md
index 38c4b90..7a3c083 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.1.0/CHANGES.0.1.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.1.0/CHANGES.0.1.0.md
@@ -20,98 +20,76 @@
## Release 0.1.0 - 2006-04-02
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-37](https://issues.apache.org/jira/browse/HADOOP-37) | A way to determine the size and overall activity of the cluster | Major | . | Owen O'Malley | |
| [HADOOP-80](https://issues.apache.org/jira/browse/HADOOP-80) | binary key | Major | io | Owen O'Malley | Owen O'Malley |
-| [HADOOP-46](https://issues.apache.org/jira/browse/HADOOP-46) | user-specified job names | Major | . | Doug Cutting | Owen O'Malley |
| [HADOOP-44](https://issues.apache.org/jira/browse/HADOOP-44) | RPC exceptions should include remote stack trace | Major | ipc | Doug Cutting | Doug Cutting |
-| [HADOOP-37](https://issues.apache.org/jira/browse/HADOOP-37) | A way to determine the size and overall activity of the cluster | Major | . | Owen O'Malley | |
+| [HADOOP-46](https://issues.apache.org/jira/browse/HADOOP-46) | user-specified job names | Major | . | Doug Cutting | Owen O'Malley |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-103](https://issues.apache.org/jira/browse/HADOOP-103) | introduce a common parent class for Mapper and Reducer | Minor | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-87](https://issues.apache.org/jira/browse/HADOOP-87) | SequenceFile performance degrades substantially compression is on and large values are encountered | Major | io | Sameer Paranjpye | Doug Cutting |
-| [HADOOP-79](https://issues.apache.org/jira/browse/HADOOP-79) | listFiles optimization | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-67](https://issues.apache.org/jira/browse/HADOOP-67) | Added statistic/reporting info to DFS | Trivial | . | Barry Kaplan | Doug Cutting |
-| [HADOOP-60](https://issues.apache.org/jira/browse/HADOOP-60) | Specification of alternate conf. directory | Minor | . | stack | |
-| [HADOOP-49](https://issues.apache.org/jira/browse/HADOOP-49) | JobClient cannot use a non-default server (unlike DFSShell) | Major | . | Michel Tourn | Michel Tourn |
-| [HADOOP-45](https://issues.apache.org/jira/browse/HADOOP-45) | JobTracker should log task errors | Major | . | Doug Cutting | Doug Cutting |
-| [HADOOP-41](https://issues.apache.org/jira/browse/HADOOP-41) | JAVA\_OPTS for the TaskRunner Child | Minor | conf | stack | |
+| [HADOOP-25](https://issues.apache.org/jira/browse/HADOOP-25) | a new map/reduce example and moving the examples from src/java to src/examples | Minor | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-20](https://issues.apache.org/jira/browse/HADOOP-20) | Mapper, Reducer need an occasion to cleanup after the last record is processed. | Major | . | Michel Tourn | |
+| [HADOOP-30](https://issues.apache.org/jira/browse/HADOOP-30) | DFS shell: support for ls -r and cat | Major | . | Michel Tourn | |
| [HADOOP-38](https://issues.apache.org/jira/browse/HADOOP-38) | default splitter should incorporate fs block size | Major | . | Doug Cutting | |
| [HADOOP-36](https://issues.apache.org/jira/browse/HADOOP-36) | Adding some uniformity/convenience to environment management | Major | conf | Bryan Pendleton | |
+| [HADOOP-49](https://issues.apache.org/jira/browse/HADOOP-49) | JobClient cannot use a non-default server (unlike DFSShell) | Major | . | Michel Tourn | Michel Tourn |
+| [HADOOP-41](https://issues.apache.org/jira/browse/HADOOP-41) | JAVA\_OPTS for the TaskRunner Child | Minor | conf | stack | |
+| [HADOOP-60](https://issues.apache.org/jira/browse/HADOOP-60) | Specification of alternate conf. directory | Minor | . | stack | |
+| [HADOOP-79](https://issues.apache.org/jira/browse/HADOOP-79) | listFiles optimization | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-87](https://issues.apache.org/jira/browse/HADOOP-87) | SequenceFile performance degrades substantially compression is on and large values are encountered | Major | io | Sameer Paranjpye | Doug Cutting |
+| [HADOOP-45](https://issues.apache.org/jira/browse/HADOOP-45) | JobTracker should log task errors | Major | . | Doug Cutting | Doug Cutting |
+| [HADOOP-67](https://issues.apache.org/jira/browse/HADOOP-67) | Added statistic/reporting info to DFS | Trivial | . | Barry Kaplan | Doug Cutting |
| [HADOOP-33](https://issues.apache.org/jira/browse/HADOOP-33) | DF enhancement: performance and win XP support | Minor | fs | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-30](https://issues.apache.org/jira/browse/HADOOP-30) | DFS shell: support for ls -r and cat | Major | . | Michel Tourn | |
-| [HADOOP-25](https://issues.apache.org/jira/browse/HADOOP-25) | a new map/reduce example and moving the examples from src/java to src/examples | Minor | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-20](https://issues.apache.org/jira/browse/HADOOP-20) | Mapper, Reducer need an occasion to cleanup after the last record is processed. | Major | . | Michel Tourn | |
+| [HADOOP-103](https://issues.apache.org/jira/browse/HADOOP-103) | introduce a common parent class for Mapper and Reducer | Minor | . | Owen O'Malley | Owen O'Malley |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-112](https://issues.apache.org/jira/browse/HADOOP-112) | copyFromLocal should exclude .crc files | Minor | . | Monu Ogbe | Doug Cutting |
-| [HADOOP-110](https://issues.apache.org/jira/browse/HADOOP-110) | new key and value instances are allocated before each map | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-107](https://issues.apache.org/jira/browse/HADOOP-107) | Namenode errors "Failed to complete filename.crc because dir.getFile()==null and null" | Major | . | Igor Bolotin | Doug Cutting |
-| [HADOOP-102](https://issues.apache.org/jira/browse/HADOOP-102) | Two identical consecutive loops in FSNamesystem.chooseTarget() | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-100](https://issues.apache.org/jira/browse/HADOOP-100) | Inconsistent locking of the JobTracker.taskTrackers field | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-98](https://issues.apache.org/jira/browse/HADOOP-98) | The JobTracker's count of the number of running maps and reduces is wrong | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-97](https://issues.apache.org/jira/browse/HADOOP-97) | DFSShell.cat returns NullPointerException if file does not exist | Major | . | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-93](https://issues.apache.org/jira/browse/HADOOP-93) | allow minimum split size configurable | Major | . | Hairong Kuang | Doug Cutting |
-| [HADOOP-86](https://issues.apache.org/jira/browse/HADOOP-86) | If corrupted map outputs, reducers get stuck fetching forever | Major | . | stack | Doug Cutting |
-| [HADOOP-84](https://issues.apache.org/jira/browse/HADOOP-84) | client should report file name in which IO exception occurs | Minor | . | Yoram Arnon | Konstantin Shvachko |
-| [HADOOP-83](https://issues.apache.org/jira/browse/HADOOP-83) | infinite retries accessing a missing block | Major | . | Yoram Arnon | Konstantin Shvachko |
-| [HADOOP-82](https://issues.apache.org/jira/browse/HADOOP-82) | JobTracker loses it: NoSuchElementException | Minor | . | stack | |
-| [HADOOP-81](https://issues.apache.org/jira/browse/HADOOP-81) | speculative execution is only controllable from the default config | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-78](https://issues.apache.org/jira/browse/HADOOP-78) | rpc commands not buffered | Major | ipc | Owen O'Malley | Owen O'Malley |
-| [HADOOP-77](https://issues.apache.org/jira/browse/HADOOP-77) | hang / crash when input folder does not exists. | Critical | . | Stefan Groschupf | |
-| [HADOOP-70](https://issues.apache.org/jira/browse/HADOOP-70) | the two file system tests TestDFS and TestFileSystem take too long | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-66](https://issues.apache.org/jira/browse/HADOOP-66) | dfs client writes all data for a chunk to /tmp | Major | . | Sameer Paranjpye | Doug Cutting |
-| [HADOOP-57](https://issues.apache.org/jira/browse/HADOOP-57) | hadoop dfs -ls / does not show root of file system | Minor | . | Yoram Arnon | |
-| [HADOOP-52](https://issues.apache.org/jira/browse/HADOOP-52) | mapred input and output dirs must be absolute | Major | . | Doug Cutting | Owen O'Malley |
+| [HADOOP-6](https://issues.apache.org/jira/browse/HADOOP-6) | missing build directory in classpath | Minor | . | Owen O'Malley | |
+| [HADOOP-7](https://issues.apache.org/jira/browse/HADOOP-7) | MapReduce has a series of problems concerning task-allocation to worker nodes | Major | . | Mike Cafarella | |
+| [HADOOP-10](https://issues.apache.org/jira/browse/HADOOP-10) | ndfs.replication is not documented within the nutch-default.xml configuration file. | Trivial | . | Rod Taylor | |
+| [HADOOP-5](https://issues.apache.org/jira/browse/HADOOP-5) | need commons-logging-api jar file | Minor | . | Owen O'Malley | |
+| [HADOOP-21](https://issues.apache.org/jira/browse/HADOOP-21) | the webapps need to be updated for the move from nutch | Minor | . | Owen O'Malley | |
+| [HADOOP-22](https://issues.apache.org/jira/browse/HADOOP-22) | remove unused imports | Trivial | . | Sami Siren | |
+| [HADOOP-28](https://issues.apache.org/jira/browse/HADOOP-28) | webapps broken | Major | . | Owen O'Malley | |
+| [HADOOP-12](https://issues.apache.org/jira/browse/HADOOP-12) | InputFormat used in job must be in JobTracker classpath (not loaded from job JAR) | Minor | . | Bryan Pendleton | |
+| [HADOOP-34](https://issues.apache.org/jira/browse/HADOOP-34) | Build Paths Relative to PWD in build.xml | Trivial | . | Jeremy Bensley | |
| [HADOOP-42](https://issues.apache.org/jira/browse/HADOOP-42) | PositionCache decrements its position for reads at the end of file | Major | fs | Konstantin Shvachko | |
| [HADOOP-40](https://issues.apache.org/jira/browse/HADOOP-40) | bufferSize argument is ignored in FileSystem.create(File, boolean, int) | Minor | fs | Konstantin Shvachko | |
-| [HADOOP-34](https://issues.apache.org/jira/browse/HADOOP-34) | Build Paths Relative to PWD in build.xml | Trivial | . | Jeremy Bensley | |
-| [HADOOP-28](https://issues.apache.org/jira/browse/HADOOP-28) | webapps broken | Major | . | Owen O'Malley | |
-| [HADOOP-22](https://issues.apache.org/jira/browse/HADOOP-22) | remove unused imports | Trivial | . | Sami Siren | |
-| [HADOOP-21](https://issues.apache.org/jira/browse/HADOOP-21) | the webapps need to be updated for the move from nutch | Minor | . | Owen O'Malley | |
-| [HADOOP-19](https://issues.apache.org/jira/browse/HADOOP-19) | Datanode corruption | Critical | . | Rod Taylor | Doug Cutting |
| [HADOOP-16](https://issues.apache.org/jira/browse/HADOOP-16) | RPC call times out while indexing map task is computing splits | Major | . | Chris Schneider | Mike Cafarella |
-| [HADOOP-12](https://issues.apache.org/jira/browse/HADOOP-12) | InputFormat used in job must be in JobTracker classpath (not loaded from job JAR) | Minor | . | Bryan Pendleton | |
-| [HADOOP-10](https://issues.apache.org/jira/browse/HADOOP-10) | ndfs.replication is not documented within the nutch-default.xml configuration file. | Trivial | . | Rod Taylor | |
-| [HADOOP-7](https://issues.apache.org/jira/browse/HADOOP-7) | MapReduce has a series of problems concerning task-allocation to worker nodes | Major | . | Mike Cafarella | |
-| [HADOOP-6](https://issues.apache.org/jira/browse/HADOOP-6) | missing build directory in classpath | Minor | . | Owen O'Malley | |
-| [HADOOP-5](https://issues.apache.org/jira/browse/HADOOP-5) | need commons-logging-api jar file | Minor | . | Owen O'Malley | |
+| [HADOOP-57](https://issues.apache.org/jira/browse/HADOOP-57) | hadoop dfs -ls / does not show root of file system | Minor | . | Yoram Arnon | |
+| [HADOOP-66](https://issues.apache.org/jira/browse/HADOOP-66) | dfs client writes all data for a chunk to /tmp | Major | . | Sameer Paranjpye | Doug Cutting |
+| [HADOOP-70](https://issues.apache.org/jira/browse/HADOOP-70) | the two file system tests TestDFS and TestFileSystem take too long | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-77](https://issues.apache.org/jira/browse/HADOOP-77) | hang / crash when input folder does not exists. | Critical | . | Stefan Groschupf | |
+| [HADOOP-78](https://issues.apache.org/jira/browse/HADOOP-78) | rpc commands not buffered | Major | ipc | Owen O'Malley | Owen O'Malley |
+| [HADOOP-81](https://issues.apache.org/jira/browse/HADOOP-81) | speculative execution is only controllable from the default config | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-82](https://issues.apache.org/jira/browse/HADOOP-82) | JobTracker loses it: NoSuchElementException | Minor | . | stack | |
+| [HADOOP-86](https://issues.apache.org/jira/browse/HADOOP-86) | If corrupted map outputs, reducers get stuck fetching forever | Major | . | stack | Doug Cutting |
+| [HADOOP-93](https://issues.apache.org/jira/browse/HADOOP-93) | allow minimum split size configurable | Major | . | Hairong Kuang | Doug Cutting |
+| [HADOOP-97](https://issues.apache.org/jira/browse/HADOOP-97) | DFSShell.cat returns NullPointerException if file does not exist | Major | . | Konstantin Shvachko | Konstantin Shvachko |
| [HADOOP-3](https://issues.apache.org/jira/browse/HADOOP-3) | Output directories are not cleaned up before the reduces run | Minor | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-83](https://issues.apache.org/jira/browse/HADOOP-83) | infinite retries accessing a missing block | Major | . | Yoram Arnon | Konstantin Shvachko |
+| [HADOOP-52](https://issues.apache.org/jira/browse/HADOOP-52) | mapred input and output dirs must be absolute | Major | . | Doug Cutting | Owen O'Malley |
+| [HADOOP-98](https://issues.apache.org/jira/browse/HADOOP-98) | The JobTracker's count of the number of running maps and reduces is wrong | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-19](https://issues.apache.org/jira/browse/HADOOP-19) | Datanode corruption | Critical | . | Rod Taylor | Doug Cutting |
+| [HADOOP-84](https://issues.apache.org/jira/browse/HADOOP-84) | client should report file name in which IO exception occurs | Minor | . | Yoram Arnon | Konstantin Shvachko |
| [HADOOP-2](https://issues.apache.org/jira/browse/HADOOP-2) | Reused Keys and Values fail with a Combiner | Major | . | Owen O'Malley | Owen O'Malley |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-110](https://issues.apache.org/jira/browse/HADOOP-110) | new key and value instances are allocated before each map | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-107](https://issues.apache.org/jira/browse/HADOOP-107) | Namenode errors "Failed to complete filename.crc because dir.getFile()==null and null" | Major | . | Igor Bolotin | Doug Cutting |
+| [HADOOP-100](https://issues.apache.org/jira/browse/HADOOP-100) | Inconsistent locking of the JobTracker.taskTrackers field | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-102](https://issues.apache.org/jira/browse/HADOOP-102) | Two identical consecutive loops in FSNamesystem.chooseTarget() | Major | . | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-112](https://issues.apache.org/jira/browse/HADOOP-112) | copyFromLocal should exclude .crc files | Minor | . | Monu Ogbe | Doug Cutting |
### OTHER:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.1.1/CHANGES.0.1.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.1.1/CHANGES.0.1.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.1.1/CHANGES.0.1.1.md
index a40faad..821606f 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.1.1/CHANGES.0.1.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.1.1/CHANGES.0.1.1.md
@@ -20,22 +20,6 @@
## Release 0.1.1 - 2006-04-07
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### IMPROVEMENTS:
@@ -49,25 +33,7 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-125](https://issues.apache.org/jira/browse/HADOOP-125) | LocalFileSystem.makeAbsolute bug on Windows | Minor | fs | p sutter | Doug Cutting |
| [HADOOP-117](https://issues.apache.org/jira/browse/HADOOP-117) | mapred temporary files not deleted | Blocker | . | raghavendra prabhu | Doug Cutting |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-125](https://issues.apache.org/jira/browse/HADOOP-125) | LocalFileSystem.makeAbsolute bug on Windows | Minor | fs | p sutter | Doug Cutting |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.10.0/CHANGES.0.10.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.10.0/CHANGES.0.10.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.10.0/CHANGES.0.10.0.md
index c0cda89..0b83f3d 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.10.0/CHANGES.0.10.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.10.0/CHANGES.0.10.0.md
@@ -20,110 +20,82 @@
## Release 0.10.0 - 2007-01-05
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-454](https://issues.apache.org/jira/browse/HADOOP-454) | hadoop du optionally behave like unix's du -s | Trivial | . | Marco Nicosia | Hairong Kuang |
+| [HADOOP-574](https://issues.apache.org/jira/browse/HADOOP-574) | want FileSystem implementation for Amazon S3 | Major | fs | Doug Cutting | Tom White |
| [HADOOP-811](https://issues.apache.org/jira/browse/HADOOP-811) | Patch to support multi-threaded MapRunnable | Major | . | Alejandro Abdelnur | Doug Cutting |
| [HADOOP-681](https://issues.apache.org/jira/browse/HADOOP-681) | Adminstrative hook to pull live nodes out of a HDFS cluster | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-574](https://issues.apache.org/jira/browse/HADOOP-574) | want FileSystem implementation for Amazon S3 | Major | fs | Doug Cutting | |
-| [HADOOP-454](https://issues.apache.org/jira/browse/HADOOP-454) | hadoop du optionally behave like unix's du -s | Trivial | . | Marco Nicosia | Hairong Kuang |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-853](https://issues.apache.org/jira/browse/HADOOP-853) | Move site directories to docs directories | Minor | documentation | Nigel Daley | Doug Cutting |
-| [HADOOP-850](https://issues.apache.org/jira/browse/HADOOP-850) | Add Writable implementations for variable-length integer types. | Minor | io | Andrzej Bialecki | Andrzej Bialecki |
-| [HADOOP-837](https://issues.apache.org/jira/browse/HADOOP-837) | RunJar should unpack jar files into hadoop.tmp.dir | Major | util | Hairong Kuang | Hairong Kuang |
-| [HADOOP-806](https://issues.apache.org/jira/browse/HADOOP-806) | NameNode WebUI : Include link to each of datanodes | Minor | . | Raghu Angadi | Raghu Angadi |
-| [HADOOP-804](https://issues.apache.org/jira/browse/HADOOP-804) | Cut down on the "mumbling" in the Task process' stdout/stderr | Major | . | Owen O'Malley | Sanjay Dahiya |
-| [HADOOP-796](https://issues.apache.org/jira/browse/HADOOP-796) | Node failing tasks and failed tasks should be more easily accessible through jobtracker history. | Minor | . | Sanjay Dahiya | Sanjay Dahiya |
-| [HADOOP-783](https://issues.apache.org/jira/browse/HADOOP-783) | Hadoop dfs -put and -get accept '-' to indicate stdin/stdout | Minor | . | Marco Nicosia | Wendy Chien |
| [HADOOP-763](https://issues.apache.org/jira/browse/HADOOP-763) | NameNode benchmark using mapred is insufficient | Minor | test | Nigel Daley | Nigel Daley |
-| [HADOOP-756](https://issues.apache.org/jira/browse/HADOOP-756) | new dfsadmin command to wait until safe mode is exited | Minor | . | Owen O'Malley | dhruba borthakur |
-| [HADOOP-720](https://issues.apache.org/jira/browse/HADOOP-720) | Write a white paper on Hadoop File System Architecture, Design and Features | Major | documentation | dhruba borthakur | dhruba borthakur |
-| [HADOOP-717](https://issues.apache.org/jira/browse/HADOOP-717) | When there are few reducers, sorting should be done by mappers | Major | . | arkady borkovsky | Owen O'Malley |
-| [HADOOP-676](https://issues.apache.org/jira/browse/HADOOP-676) | JobClient should print user friendly messages for standard errors | Major | . | Owen O'Malley | Sanjay Dahiya |
| [HADOOP-621](https://issues.apache.org/jira/browse/HADOOP-621) | When a dfs -cat command is killed by the user, the correspondig hadoop process does not get aborted | Minor | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-619](https://issues.apache.org/jira/browse/HADOOP-619) | Unify Map-Reduce and Streaming to take the same globbed input specification | Major | . | eric baldeschwieler | Sanjay Dahiya |
+| [HADOOP-676](https://issues.apache.org/jira/browse/HADOOP-676) | JobClient should print user friendly messages for standard errors | Major | . | Owen O'Malley | Sanjay Dahiya |
+| [HADOOP-756](https://issues.apache.org/jira/browse/HADOOP-756) | new dfsadmin command to wait until safe mode is exited | Minor | . | Owen O'Malley | dhruba borthakur |
+| [HADOOP-331](https://issues.apache.org/jira/browse/HADOOP-331) | map outputs should be written to a single output file with an index | Major | . | eric baldeschwieler | Devaraj Das |
+| [HADOOP-796](https://issues.apache.org/jira/browse/HADOOP-796) | Node failing tasks and failed tasks should be more easily accessible through jobtracker history. | Minor | . | Sanjay Dahiya | Sanjay Dahiya |
+| [HADOOP-806](https://issues.apache.org/jira/browse/HADOOP-806) | NameNode WebUI : Include link to each of datanodes | Minor | . | Raghu Angadi | Raghu Angadi |
| [HADOOP-618](https://issues.apache.org/jira/browse/HADOOP-618) | JobProfile and JobSubmissionProtocol should be public | Major | . | Runping Qi | Arun C Murthy |
| [HADOOP-571](https://issues.apache.org/jira/browse/HADOOP-571) | Path should use URI syntax | Major | fs | Doug Cutting | Doug Cutting |
-| [HADOOP-525](https://issues.apache.org/jira/browse/HADOOP-525) | Need raw comparators for hadoop record types | Major | record | Sameer Paranjpye | Milind Bhandarkar |
-| [HADOOP-470](https://issues.apache.org/jira/browse/HADOOP-470) | Some improvements in the DFS content browsing UI | Minor | . | Devaraj Das | Hairong Kuang |
+| [HADOOP-720](https://issues.apache.org/jira/browse/HADOOP-720) | Write a white paper on Hadoop File System Architecture, Design and Features | Major | documentation | dhruba borthakur | dhruba borthakur |
+| [HADOOP-717](https://issues.apache.org/jira/browse/HADOOP-717) | When there are few reducers, sorting should be done by mappers | Major | . | arkady borkovsky | Owen O'Malley |
| [HADOOP-451](https://issues.apache.org/jira/browse/HADOOP-451) | Add a Split interface | Major | . | Doug Cutting | Owen O'Malley |
+| [HADOOP-783](https://issues.apache.org/jira/browse/HADOOP-783) | Hadoop dfs -put and -get accept '-' to indicate stdin/stdout | Minor | . | Marco Nicosia | Wendy Chien |
+| [HADOOP-837](https://issues.apache.org/jira/browse/HADOOP-837) | RunJar should unpack jar files into hadoop.tmp.dir | Major | util | Hairong Kuang | Hairong Kuang |
+| [HADOOP-850](https://issues.apache.org/jira/browse/HADOOP-850) | Add Writable implementations for variable-length integer types. | Minor | io | Andrzej Bialecki | Andrzej Bialecki |
+| [HADOOP-525](https://issues.apache.org/jira/browse/HADOOP-525) | Need raw comparators for hadoop record types | Major | record | Sameer Paranjpye | Milind Bhandarkar |
+| [HADOOP-804](https://issues.apache.org/jira/browse/HADOOP-804) | Cut down on the "mumbling" in the Task process' stdout/stderr | Major | . | Owen O'Malley | Sanjay Dahiya |
+| [HADOOP-853](https://issues.apache.org/jira/browse/HADOOP-853) | Move site directories to docs directories | Minor | documentation | Nigel Daley | Doug Cutting |
| [HADOOP-371](https://issues.apache.org/jira/browse/HADOOP-371) | ant tar should package contrib jars | Major | build | Michel Tourn | Nigel Daley |
-| [HADOOP-331](https://issues.apache.org/jira/browse/HADOOP-331) | map outputs should be written to a single output file with an index | Major | . | eric baldeschwieler | Devaraj Das |
+| [HADOOP-470](https://issues.apache.org/jira/browse/HADOOP-470) | Some improvements in the DFS content browsing UI | Minor | . | Devaraj Das | Hairong Kuang |
+| [HADOOP-619](https://issues.apache.org/jira/browse/HADOOP-619) | Unify Map-Reduce and Streaming to take the same globbed input specification | Major | . | eric baldeschwieler | Sanjay Dahiya |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-849](https://issues.apache.org/jira/browse/HADOOP-849) | randomwriter fails with 'java.lang.OutOfMemoryError: Java heap space' in the 'reduce' task | Major | . | Arun C Murthy | Devaraj Das |
-| [HADOOP-846](https://issues.apache.org/jira/browse/HADOOP-846) | Progress report is not sent during the intermediate sorts in the map phase | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-844](https://issues.apache.org/jira/browse/HADOOP-844) | Metrics messages are sent on a fixed-delay schedule instead of a fixed-rate schedule | Minor | metrics | David Bowen | |
-| [HADOOP-841](https://issues.apache.org/jira/browse/HADOOP-841) | native hadoop libraries don't build properly with 64-bit OS and a 32-bit jvm | Major | build | Arun C Murthy | Arun C Murthy |
-| [HADOOP-840](https://issues.apache.org/jira/browse/HADOOP-840) | the task tracker is getting blocked by long deletes of local files | Major | . | Owen O'Malley | Mahadev konar |
-| [HADOOP-838](https://issues.apache.org/jira/browse/HADOOP-838) | TaskRunner.run() doesn't pass along the 'java.library.path' to the child (task) jvm | Major | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-836](https://issues.apache.org/jira/browse/HADOOP-836) | unit tests fail on windows (/C:/cygwin/... is invalid) | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-835](https://issues.apache.org/jira/browse/HADOOP-835) | conf not set for the default Codec when initializing a Reader for a record-compressed sequence file | Major | io | Hairong Kuang | Hairong Kuang |
-| [HADOOP-829](https://issues.apache.org/jira/browse/HADOOP-829) | Separate the datanode contents that is written to the fsimage vs the contents used in over-the-wire communication | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-825](https://issues.apache.org/jira/browse/HADOOP-825) | If the default file system is set using the new uri syntax, the namenode will not start | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-824](https://issues.apache.org/jira/browse/HADOOP-824) | DFSShell should become FSShell | Major | . | Doug Cutting | |
-| [HADOOP-823](https://issues.apache.org/jira/browse/HADOOP-823) | DataNode will not start up if any directories from dfs.data.dir are missing | Major | . | Bryan Pendleton | Sameer Paranjpye |
-| [HADOOP-818](https://issues.apache.org/jira/browse/HADOOP-818) | ant clean test-contrib doesn't work | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-814](https://issues.apache.org/jira/browse/HADOOP-814) | Increase dfs scalability by optimizing locking on namenode. | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-813](https://issues.apache.org/jira/browse/HADOOP-813) | map tasks lost during sort | Major | . | Owen O'Malley | Devaraj Das |
-| [HADOOP-802](https://issues.apache.org/jira/browse/HADOOP-802) | mapred.speculative.execution description in hadoop-defauls.xml is not complete | Trivial | conf | Nigel Daley | Nigel Daley |
-| [HADOOP-794](https://issues.apache.org/jira/browse/HADOOP-794) | JobTracker crashes with ArithmeticException | Major | . | Nigel Daley | Owen O'Malley |
-| [HADOOP-792](https://issues.apache.org/jira/browse/HADOOP-792) | Invalid dfs -mv can trash your entire dfs | Major | . | Chris Schneider | |
-| [HADOOP-786](https://issues.apache.org/jira/browse/HADOOP-786) | PhasedFileSystem should use debug level log for ignored exception. | Trivial | . | Sanjay Dahiya | Sanjay Dahiya |
-| [HADOOP-782](https://issues.apache.org/jira/browse/HADOOP-782) | TaskTracker.java:killOverflowingTasks & TaskTracker.java:markUnresponsiveTasks only put the tip in tasksToCleanup queue, they don't update the runningJobs | Major | . | Arun C Murthy | Arun C Murthy |
| [HADOOP-777](https://issues.apache.org/jira/browse/HADOOP-777) | the tasktracker hostname is not fully qualified | Minor | . | Mahadev konar | Mahadev konar |
-| [HADOOP-774](https://issues.apache.org/jira/browse/HADOOP-774) | Datanodes fails to heartbeat when a directory with a large number of blocks is deleted | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-770](https://issues.apache.org/jira/browse/HADOOP-770) | When JobTracker gets restarted, Job Tracker History doesn't show the jobs that were running. (incomplete jobs) | Minor | . | Koji Noguchi | Sanjay Dahiya |
-| [HADOOP-764](https://issues.apache.org/jira/browse/HADOOP-764) | The memory consumption of processReport() in the namenode can be reduced | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-752](https://issues.apache.org/jira/browse/HADOOP-752) | Possible locking issues in HDFS Namenode | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-745](https://issues.apache.org/jira/browse/HADOOP-745) | NameNode throws FileNotFoundException: Parent path does not exist on startup | Major | . | Nigel Daley | dhruba borthakur |
+| [HADOOP-629](https://issues.apache.org/jira/browse/HADOOP-629) | none of the rpc servers check the protcol name for validity | Major | ipc | Owen O'Malley | Owen O'Malley |
+| [HADOOP-774](https://issues.apache.org/jira/browse/HADOOP-774) | Datanodes fails to heartbeat when a directory with a large number of blocks is deleted | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-738](https://issues.apache.org/jira/browse/HADOOP-738) | dfs get or copyToLocal should not copy crc file | Major | . | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-770](https://issues.apache.org/jira/browse/HADOOP-770) | When JobTracker gets restarted, Job Tracker History doesn't show the jobs that were running. (incomplete jobs) | Minor | . | Koji Noguchi | Sanjay Dahiya |
+| [HADOOP-546](https://issues.apache.org/jira/browse/HADOOP-546) | Task tracker doesnt generate job.xml in jobcache for some tasks ( possibly for only rescheduled tasks) | Critical | . | Sanjay Dahiya | Arun C Murthy |
| [HADOOP-737](https://issues.apache.org/jira/browse/HADOOP-737) | TaskTracker's job cleanup loop should check for finished job before deleting local directories | Critical | . | Sanjay Dahiya | Arun C Murthy |
-| [HADOOP-700](https://issues.apache.org/jira/browse/HADOOP-700) | bin/hadoop includes in classpath all jar files in HADOOP\_HOME | Major | scripts | Nigel Daley | Doug Cutting |
+| [HADOOP-818](https://issues.apache.org/jira/browse/HADOOP-818) | ant clean test-contrib doesn't work | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-786](https://issues.apache.org/jira/browse/HADOOP-786) | PhasedFileSystem should use debug level log for ignored exception. | Trivial | . | Sanjay Dahiya | Sanjay Dahiya |
+| [HADOOP-764](https://issues.apache.org/jira/browse/HADOOP-764) | The memory consumption of processReport() in the namenode can be reduced | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-802](https://issues.apache.org/jira/browse/HADOOP-802) | mapred.speculative.execution description in hadoop-defauls.xml is not complete | Trivial | conf | Nigel Daley | Nigel Daley |
+| [HADOOP-782](https://issues.apache.org/jira/browse/HADOOP-782) | TaskTracker.java:killOverflowingTasks & TaskTracker.java:markUnresponsiveTasks only put the tip in tasksToCleanup queue, they don't update the runningJobs | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-792](https://issues.apache.org/jira/browse/HADOOP-792) | Invalid dfs -mv can trash your entire dfs | Major | . | Chris Schneider | |
| [HADOOP-673](https://issues.apache.org/jira/browse/HADOOP-673) | the task execution environment should have a current working directory that is task specific | Major | . | Owen O'Malley | Mahadev konar |
-| [HADOOP-629](https://issues.apache.org/jira/browse/HADOOP-629) | none of the rpc servers check the protcol name for validity | Major | ipc | Owen O'Malley | Owen O'Malley |
-| [HADOOP-628](https://issues.apache.org/jira/browse/HADOOP-628) | hadoop hdfs -cat replaces some characters with question marks. | Major | . | arkady borkovsky | Wendy Chien |
+| [HADOOP-794](https://issues.apache.org/jira/browse/HADOOP-794) | JobTracker crashes with ArithmeticException | Major | . | Nigel Daley | Owen O'Malley |
+| [HADOOP-824](https://issues.apache.org/jira/browse/HADOOP-824) | DFSShell should become FSShell | Major | . | Doug Cutting | |
+| [HADOOP-813](https://issues.apache.org/jira/browse/HADOOP-813) | map tasks lost during sort | Major | . | Owen O'Malley | Devaraj Das |
+| [HADOOP-825](https://issues.apache.org/jira/browse/HADOOP-825) | If the default file system is set using the new uri syntax, the namenode will not start | Major | . | Owen O'Malley | Owen O'Malley |
| [HADOOP-596](https://issues.apache.org/jira/browse/HADOOP-596) | TaskTracker taskstatus's phase doesnt get updated on phase transition causing wrong values displayed in WI | Major | . | Sanjay Dahiya | Sanjay Dahiya |
-| [HADOOP-546](https://issues.apache.org/jira/browse/HADOOP-546) | Task tracker doesnt generate job.xml in jobcache for some tasks ( possibly for only rescheduled tasks) | Critical | . | Sanjay Dahiya | Arun C Murthy |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-829](https://issues.apache.org/jira/browse/HADOOP-829) | Separate the datanode contents that is written to the fsimage vs the contents used in over-the-wire communication | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-823](https://issues.apache.org/jira/browse/HADOOP-823) | DataNode will not start up if any directories from dfs.data.dir are missing | Major | . | Bryan Pendleton | Sameer Paranjpye |
+| [HADOOP-814](https://issues.apache.org/jira/browse/HADOOP-814) | Increase dfs scalability by optimizing locking on namenode. | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-835](https://issues.apache.org/jira/browse/HADOOP-835) | conf not set for the default Codec when initializing a Reader for a record-compressed sequence file | Major | io | Hairong Kuang | Hairong Kuang |
+| [HADOOP-836](https://issues.apache.org/jira/browse/HADOOP-836) | unit tests fail on windows (/C:/cygwin/... is invalid) | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-841](https://issues.apache.org/jira/browse/HADOOP-841) | native hadoop libraries don't build properly with 64-bit OS and a 32-bit jvm | Major | build | Arun C Murthy | Arun C Murthy |
+| [HADOOP-838](https://issues.apache.org/jira/browse/HADOOP-838) | TaskRunner.run() doesn't pass along the 'java.library.path' to the child (task) jvm | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-844](https://issues.apache.org/jira/browse/HADOOP-844) | Metrics messages are sent on a fixed-delay schedule instead of a fixed-rate schedule | Minor | metrics | David Bowen | |
+| [HADOOP-849](https://issues.apache.org/jira/browse/HADOOP-849) | randomwriter fails with 'java.lang.OutOfMemoryError: Java heap space' in the 'reduce' task | Major | . | Arun C Murthy | Devaraj Das |
+| [HADOOP-745](https://issues.apache.org/jira/browse/HADOOP-745) | NameNode throws FileNotFoundException: Parent path does not exist on startup | Major | . | Nigel Daley | dhruba borthakur |
+| [HADOOP-628](https://issues.apache.org/jira/browse/HADOOP-628) | hadoop hdfs -cat replaces some characters with question marks. | Major | . | arkady borkovsky | Wendy Chien |
+| [HADOOP-846](https://issues.apache.org/jira/browse/HADOOP-846) | Progress report is not sent during the intermediate sorts in the map phase | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-840](https://issues.apache.org/jira/browse/HADOOP-840) | the task tracker is getting blocked by long deletes of local files | Major | . | Owen O'Malley | Mahadev konar |
+| [HADOOP-700](https://issues.apache.org/jira/browse/HADOOP-700) | bin/hadoop includes in classpath all jar files in HADOOP\_HOME | Major | scripts | Nigel Daley | Doug Cutting |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.10.1/CHANGES.0.10.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.10.1/CHANGES.0.10.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.10.1/CHANGES.0.10.1.md
index 0e97344..7ef60bb 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.10.1/CHANGES.0.10.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.10.1/CHANGES.0.10.1.md
@@ -20,16 +20,6 @@
## Release 0.10.1 - 2007-01-10
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
@@ -39,45 +29,21 @@
| [HADOOP-851](https://issues.apache.org/jira/browse/HADOOP-851) | Implement the LzoCodec with support for the lzo compression algorithms | Major | io | Arun C Murthy | Arun C Murthy |
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-880](https://issues.apache.org/jira/browse/HADOOP-880) | Recursive delete for an S3 directory does not actually delete files or subdirectories | Major | fs | Tom White | Tom White |
-| [HADOOP-879](https://issues.apache.org/jira/browse/HADOOP-879) | SequenceFileInputFormat can no longer read from data produced by MapFileOutputFormat | Major | . | Bryan Pendleton | Doug Cutting |
-| [HADOOP-873](https://issues.apache.org/jira/browse/HADOOP-873) | native libraries aren't loaded unless the user specifies the java.library.path in the child jvm options | Major | util | Owen O'Malley | Owen O'Malley |
-| [HADOOP-871](https://issues.apache.org/jira/browse/HADOOP-871) | java.library.path is wrongly initialized by bin/hadoop when only pre-built libs are present, but custom-built ones aren't | Major | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-868](https://issues.apache.org/jira/browse/HADOOP-868) | Fix the merge method on Maps to limit the number of open files | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-866](https://issues.apache.org/jira/browse/HADOOP-866) | dfs -get should remove existing crc file if -crc is not specified | Major | fs | Milind Bhandarkar | Milind Bhandarkar |
-| [HADOOP-865](https://issues.apache.org/jira/browse/HADOOP-865) | Files written to S3 but never closed can't be deleted | Major | fs | Bryan Pendleton | Tom White |
-| [HADOOP-864](https://issues.apache.org/jira/browse/HADOOP-864) | bin/hadoop jar throws file creation exception for temp files | Minor | . | Sanjay Dahiya | Sanjay Dahiya |
-| [HADOOP-863](https://issues.apache.org/jira/browse/HADOOP-863) | MapTask prints info log message when the progress-reporting thread starts | Major | . | Devaraj Das | Devaraj Das |
| [HADOOP-857](https://issues.apache.org/jira/browse/HADOOP-857) | IOException when running map reduce on S3 filesystem | Major | fs | Tom White | |
+| [HADOOP-863](https://issues.apache.org/jira/browse/HADOOP-863) | MapTask prints info log message when the progress-reporting thread starts | Major | . | Devaraj Das | Devaraj Das |
| [HADOOP-815](https://issues.apache.org/jira/browse/HADOOP-815) | Investigate and fix the extremely large memory-footprint of JobTracker | Major | . | Arun C Murthy | Arun C Murthy |
| [HADOOP-600](https://issues.apache.org/jira/browse/HADOOP-600) | Race condition in JobTracker updating the task tracker's status while declaring it lost | Major | . | Owen O'Malley | Arun C Murthy |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-864](https://issues.apache.org/jira/browse/HADOOP-864) | bin/hadoop jar throws file creation exception for temp files | Minor | . | Sanjay Dahiya | Sanjay Dahiya |
+| [HADOOP-866](https://issues.apache.org/jira/browse/HADOOP-866) | dfs -get should remove existing crc file if -crc is not specified | Major | fs | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-871](https://issues.apache.org/jira/browse/HADOOP-871) | java.library.path is wrongly initialized by bin/hadoop when only pre-built libs are present, but custom-built ones aren't | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-868](https://issues.apache.org/jira/browse/HADOOP-868) | Fix the merge method on Maps to limit the number of open files | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-865](https://issues.apache.org/jira/browse/HADOOP-865) | Files written to S3 but never closed can't be deleted | Major | fs | Bryan Pendleton | Tom White |
+| [HADOOP-873](https://issues.apache.org/jira/browse/HADOOP-873) | native libraries aren't loaded unless the user specifies the java.library.path in the child jvm options | Major | util | Owen O'Malley | Owen O'Malley |
+| [HADOOP-880](https://issues.apache.org/jira/browse/HADOOP-880) | Recursive delete for an S3 directory does not actually delete files or subdirectories | Major | fs | Tom White | Tom White |
+| [HADOOP-879](https://issues.apache.org/jira/browse/HADOOP-879) | SequenceFileInputFormat can no longer read from data produced by MapFileOutputFormat | Major | . | Bryan Pendleton | Doug Cutting |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.11.0/CHANGES.0.11.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.11.0/CHANGES.0.11.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.11.0/CHANGES.0.11.0.md
index fddbe01..aac6d9a 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.11.0/CHANGES.0.11.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.11.0/CHANGES.0.11.0.md
@@ -20,105 +20,77 @@
## Release 0.11.0 - 2007-02-02
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-967](https://issues.apache.org/jira/browse/HADOOP-967) | flip boolean to have rpc clients send a header | Major | ipc | Owen O'Malley | Owen O'Malley |
-| [HADOOP-961](https://issues.apache.org/jira/browse/HADOOP-961) | a cli tool to get the event logs from a job | Major | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-918](https://issues.apache.org/jira/browse/HADOOP-918) | Examples of Abacus using Python plugins | Major | . | Runping Qi | Runping Qi |
-| [HADOOP-908](https://issues.apache.org/jira/browse/HADOOP-908) | Hadoop Abacus, a package for performing simple counting/aggregation | Major | . | Runping Qi | Runping Qi |
-| [HADOOP-884](https://issues.apache.org/jira/browse/HADOOP-884) | Create scripts to run Hadoop on Amazon EC2 | Major | scripts | Tom White | Tom White |
| [HADOOP-852](https://issues.apache.org/jira/browse/HADOOP-852) | want ant task for record definitions | Major | record | Doug Cutting | Milind Bhandarkar |
+| [HADOOP-908](https://issues.apache.org/jira/browse/HADOOP-908) | Hadoop Abacus, a package for performing simple counting/aggregation | Major | . | Runping Qi | Runping Qi |
+| [HADOOP-918](https://issues.apache.org/jira/browse/HADOOP-918) | Examples of Abacus using Python plugins | Major | . | Runping Qi | Runping Qi |
| [HADOOP-732](https://issues.apache.org/jira/browse/HADOOP-732) | SequenceFile's header should allow to store metadata in the form of key/value pairs | Major | io | Runping Qi | Runping Qi |
+| [HADOOP-884](https://issues.apache.org/jira/browse/HADOOP-884) | Create scripts to run Hadoop on Amazon EC2 | Major | scripts | Tom White | Tom White |
+| [HADOOP-961](https://issues.apache.org/jira/browse/HADOOP-961) | a cli tool to get the event logs from a job | Major | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-967](https://issues.apache.org/jira/browse/HADOOP-967) | flip boolean to have rpc clients send a header | Major | ipc | Owen O'Malley | Owen O'Malley |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-963](https://issues.apache.org/jira/browse/HADOOP-963) | improve the stack trace returned by RPC client | Major | ipc | Owen O'Malley | Owen O'Malley |
-| [HADOOP-936](https://issues.apache.org/jira/browse/HADOOP-936) | More updates to metric names to conform to HADOOP-887 | Minor | . | Nigel Daley | |
-| [HADOOP-897](https://issues.apache.org/jira/browse/HADOOP-897) | Need a simpler way to specify arbitrary options to java compiler while building Hadoop | Minor | build | Milind Bhandarkar | Milind Bhandarkar |
-| [HADOOP-890](https://issues.apache.org/jira/browse/HADOOP-890) | Update tag and metric names to conform to HADOOP-887 | Minor | metrics | Nigel Daley | Nigel Daley |
-| [HADOOP-862](https://issues.apache.org/jira/browse/HADOOP-862) | Add handling of s3 to CopyFile tool | Minor | util | stack | |
| [HADOOP-842](https://issues.apache.org/jira/browse/HADOOP-842) | change the open method in ClientProtocol to take an additional argument: clientMachine | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-833](https://issues.apache.org/jira/browse/HADOOP-833) | need documentation of native build requirements | Major | documentation | Doug Cutting | Arun C Murthy |
-| [HADOOP-830](https://issues.apache.org/jira/browse/HADOOP-830) | Improve the performance of the Merge phase | Major | . | Devaraj Das | Devaraj Das |
-| [HADOOP-805](https://issues.apache.org/jira/browse/HADOOP-805) | JobClient should print the Task's stdout and stderr to the clients console | Major | . | Owen O'Malley | Sanjay Dahiya |
+| [HADOOP-890](https://issues.apache.org/jira/browse/HADOOP-890) | Update tag and metric names to conform to HADOOP-887 | Minor | metrics | Nigel Daley | Nigel Daley |
| [HADOOP-801](https://issues.apache.org/jira/browse/HADOOP-801) | job tracker should keep a log of task completion and failure | Major | . | Owen O'Malley | Sanjay Dahiya |
-| [HADOOP-788](https://issues.apache.org/jira/browse/HADOOP-788) | Streaming should use a subclass of TextInputFormat for reading text inputs. | Major | . | Owen O'Malley | Sanjay Dahiya |
+| [HADOOP-897](https://issues.apache.org/jira/browse/HADOOP-897) | Need a simpler way to specify arbitrary options to java compiler while building Hadoop | Minor | build | Milind Bhandarkar | Milind Bhandarkar |
+| [HADOOP-830](https://issues.apache.org/jira/browse/HADOOP-830) | Improve the performance of the Merge phase | Major | . | Devaraj Das | Devaraj Das |
+| [HADOOP-833](https://issues.apache.org/jira/browse/HADOOP-833) | need documentation of native build requirements | Major | documentation | Doug Cutting | Arun C Murthy |
| [HADOOP-726](https://issues.apache.org/jira/browse/HADOOP-726) | HDFS locking mechanisms should be simplified or removed | Minor | . | Sameer Paranjpye | Raghu Angadi |
-| [HADOOP-692](https://issues.apache.org/jira/browse/HADOOP-692) | Rack-aware Replica Placement | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-659](https://issues.apache.org/jira/browse/HADOOP-659) | Boost the priority of re-replicating blocks that are far from their replication target | Major | . | Konstantin Shvachko | Hairong Kuang |
+| [HADOOP-936](https://issues.apache.org/jira/browse/HADOOP-936) | More updates to metric names to conform to HADOOP-887 | Minor | . | Nigel Daley | |
| [HADOOP-602](https://issues.apache.org/jira/browse/HADOOP-602) | Remove Lucene dependency | Major | . | Andrzej Bialecki | Milind Bhandarkar |
+| [HADOOP-788](https://issues.apache.org/jira/browse/HADOOP-788) | Streaming should use a subclass of TextInputFormat for reading text inputs. | Major | . | Owen O'Malley | Sanjay Dahiya |
+| [HADOOP-963](https://issues.apache.org/jira/browse/HADOOP-963) | improve the stack trace returned by RPC client | Major | ipc | Owen O'Malley | Owen O'Malley |
+| [HADOOP-862](https://issues.apache.org/jira/browse/HADOOP-862) | Add handling of s3 to CopyFile tool | Minor | util | stack | |
+| [HADOOP-692](https://issues.apache.org/jira/browse/HADOOP-692) | Rack-aware Replica Placement | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-805](https://issues.apache.org/jira/browse/HADOOP-805) | JobClient should print the Task's stdout and stderr to the clients console | Major | . | Owen O'Malley | Sanjay Dahiya |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-969](https://issues.apache.org/jira/browse/HADOOP-969) | deadlock in job tracker RetireJobs | Critical | . | Owen O'Malley | Owen O'Malley |
-| [HADOOP-965](https://issues.apache.org/jira/browse/HADOOP-965) | Isolation Runner looking for job.jar in wrong directory | Major | . | Dennis Kubes | |
-| [HADOOP-964](https://issues.apache.org/jira/browse/HADOOP-964) | ClassNotFoundException in ReduceTaskRunner | Blocker | . | Dennis Kubes | |
-| [HADOOP-962](https://issues.apache.org/jira/browse/HADOOP-962) | Hadoop EC2 scripts are not executable | Major | scripts | Tom White | Tom White |
-| [HADOOP-959](https://issues.apache.org/jira/browse/HADOOP-959) | TestCheckpoint fails on Windows | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-937](https://issues.apache.org/jira/browse/HADOOP-937) | data node re-registration | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-935](https://issues.apache.org/jira/browse/HADOOP-935) | Abacus should not delete the output dir | Major | . | Runping Qi | Runping Qi |
-| [HADOOP-934](https://issues.apache.org/jira/browse/HADOOP-934) | TaskTracker sends duplicate status when updating task metrics throws exception | Major | . | Nigel Daley | Arun C Murthy |
-| [HADOOP-929](https://issues.apache.org/jira/browse/HADOOP-929) | PhasedFileSystem should implement get/set configuration | Major | . | Sanjay Dahiya | Sanjay Dahiya |
-| [HADOOP-922](https://issues.apache.org/jira/browse/HADOOP-922) | Optimize small reads and seeks | Major | . | dhruba borthakur | dhruba borthakur |
-| [HADOOP-920](https://issues.apache.org/jira/browse/HADOOP-920) | MapFileOutputFormat and SequenceFileOutputFormat use incorrect key/value classes in map/reduce tasks | Major | . | Andrzej Bialecki | Andrzej Bialecki |
-| [HADOOP-916](https://issues.apache.org/jira/browse/HADOOP-916) | HADOOP-908 patch causes javadoc warnings | Trivial | . | Nigel Daley | Nigel Daley |
-| [HADOOP-912](https://issues.apache.org/jira/browse/HADOOP-912) | TestMiniMRWithDFS fails sporadically | Major | . | Nigel Daley | Arun C Murthy |
-| [HADOOP-909](https://issues.apache.org/jira/browse/HADOOP-909) | dfs "du" shows that the size of a subdirectory is 0 | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-781](https://issues.apache.org/jira/browse/HADOOP-781) | Remove from trunk things deprecated in 0.10 branch. | Major | . | Doug Cutting | Doug Cutting |
+| [HADOOP-757](https://issues.apache.org/jira/browse/HADOOP-757) | "Bad File Descriptor" in closing DFS file | Major | . | Owen O'Malley | Raghu Angadi |
+| [HADOOP-855](https://issues.apache.org/jira/browse/HADOOP-855) | HDFS should repair corrupted files | Major | . | Wendy Chien | Wendy Chien |
+| [HADOOP-886](https://issues.apache.org/jira/browse/HADOOP-886) | thousands of TimerThreads created by metrics API | Major | metrics | Nigel Daley | Nigel Daley |
+| [HADOOP-899](https://issues.apache.org/jira/browse/HADOOP-899) | Removal of deprecated code (in v0.10.0) from trunk breaks libhdfs | Major | . | Sameer Paranjpye | Sameer Paranjpye |
+| [HADOOP-898](https://issues.apache.org/jira/browse/HADOOP-898) | namenode generates infinite stream of null pointers | Major | . | Owen O'Malley | Raghu Angadi |
| [HADOOP-905](https://issues.apache.org/jira/browse/HADOOP-905) | Code to qualify inputDirs doesn't affect path validation | Major | fs | Kenji Matsuoka | |
| [HADOOP-902](https://issues.apache.org/jira/browse/HADOOP-902) | NPE in DFSOutputStream.closeBackupStream() | Major | . | Raghu Angadi | Raghu Angadi |
+| [HADOOP-735](https://issues.apache.org/jira/browse/HADOOP-735) | The underlying data structure, ByteArrayOutputStream, for buffer type of Hadoop record is inappropriate | Major | record | Runping Qi | Milind Bhandarkar |
+| [HADOOP-916](https://issues.apache.org/jira/browse/HADOOP-916) | HADOOP-908 patch causes javadoc warnings | Trivial | . | Nigel Daley | Nigel Daley |
| [HADOOP-901](https://issues.apache.org/jira/browse/HADOOP-901) | Make S3FileSystem do recursive renames | Major | fs | Tom White | |
-| [HADOOP-899](https://issues.apache.org/jira/browse/HADOOP-899) | Removal of deprecated code (in v0.10.0) from trunk breaks libhdfs | Major | . | Sameer Paranjpye | Sameer Paranjpye |
-| [HADOOP-898](https://issues.apache.org/jira/browse/HADOOP-898) | namenode generates infinite stream of null pointers | Major | . | Owen O'Malley | Raghu Angadi |
-| [HADOOP-886](https://issues.apache.org/jira/browse/HADOOP-886) | thousands of TimerThreads created by metrics API | Major | metrics | Nigel Daley | Nigel Daley |
-| [HADOOP-881](https://issues.apache.org/jira/browse/HADOOP-881) | job history web/ui does not count task failures correctly | Major | . | Owen O'Malley | Sanjay Dahiya |
-| [HADOOP-856](https://issues.apache.org/jira/browse/HADOOP-856) | fsck reports a non-existant DFS path as healthy | Minor | . | Nigel Daley | Milind Bhandarkar |
-| [HADOOP-855](https://issues.apache.org/jira/browse/HADOOP-855) | HDFS should repair corrupted files | Major | . | Wendy Chien | Wendy Chien |
-| [HADOOP-781](https://issues.apache.org/jira/browse/HADOOP-781) | Remove from trunk things deprecated in 0.10 branch. | Major | . | Doug Cutting | Doug Cutting |
+| [HADOOP-912](https://issues.apache.org/jira/browse/HADOOP-912) | TestMiniMRWithDFS fails sporadically | Major | . | Nigel Daley | Arun C Murthy |
+| [HADOOP-920](https://issues.apache.org/jira/browse/HADOOP-920) | MapFileOutputFormat and SequenceFileOutputFormat use incorrect key/value classes in map/reduce tasks | Major | . | Andrzej Bialecki | Andrzej Bialecki |
| [HADOOP-758](https://issues.apache.org/jira/browse/HADOOP-758) | FileNotFound on DFS block file | Major | . | Owen O'Malley | Raghu Angadi |
-| [HADOOP-757](https://issues.apache.org/jira/browse/HADOOP-757) | "Bad File Descriptor" in closing DFS file | Major | . | Owen O'Malley | Raghu Angadi |
-| [HADOOP-735](https://issues.apache.org/jira/browse/HADOOP-735) | The underlying data structure, ByteArrayOutputStream, for buffer type of Hadoop record is inappropriate | Major | record | Runping Qi | Milind Bhandarkar |
+| [HADOOP-909](https://issues.apache.org/jira/browse/HADOOP-909) | dfs "du" shows that the size of a subdirectory is 0 | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-731](https://issues.apache.org/jira/browse/HADOOP-731) | Sometimes when a dfs file is accessed and one copy has a checksum error the I/O command fails, even if another copy is alright. | Major | . | Dick King | Wendy Chien |
+| [HADOOP-929](https://issues.apache.org/jira/browse/HADOOP-929) | PhasedFileSystem should implement get/set configuration | Major | . | Sanjay Dahiya | Sanjay Dahiya |
+| [HADOOP-935](https://issues.apache.org/jira/browse/HADOOP-935) | Abacus should not delete the output dir | Major | . | Runping Qi | Runping Qi |
+| [HADOOP-856](https://issues.apache.org/jira/browse/HADOOP-856) | fsck reports a non-existant DFS path as healthy | Minor | . | Nigel Daley | Milind Bhandarkar |
+| [HADOOP-227](https://issues.apache.org/jira/browse/HADOOP-227) | Namespace check pointing is not performed until the namenode restarts. | Major | . | Konstantin Shvachko | dhruba borthakur |
+| [HADOOP-937](https://issues.apache.org/jira/browse/HADOOP-937) | data node re-registration | Major | . | Hairong Kuang | Hairong Kuang |
+| [HADOOP-922](https://issues.apache.org/jira/browse/HADOOP-922) | Optimize small reads and seeks | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-959](https://issues.apache.org/jira/browse/HADOOP-959) | TestCheckpoint fails on Windows | Major | . | dhruba borthakur | dhruba borthakur |
+| [HADOOP-934](https://issues.apache.org/jira/browse/HADOOP-934) | TaskTracker sends duplicate status when updating task metrics throws exception | Major | . | Nigel Daley | Arun C Murthy |
+| [HADOOP-881](https://issues.apache.org/jira/browse/HADOOP-881) | job history web/ui does not count task failures correctly | Major | . | Owen O'Malley | Sanjay Dahiya |
+| [HADOOP-962](https://issues.apache.org/jira/browse/HADOOP-962) | Hadoop EC2 scripts are not executable | Major | scripts | Tom White | Tom White |
| [HADOOP-549](https://issues.apache.org/jira/browse/HADOOP-549) | NullPointerException in TaskReport's serialization code | Major | . | Michel Tourn | Owen O'Malley |
| [HADOOP-405](https://issues.apache.org/jira/browse/HADOOP-405) | Duplicate browseDirectory.jsp | Minor | . | Konstantin Shvachko | navychen |
+| [HADOOP-964](https://issues.apache.org/jira/browse/HADOOP-964) | ClassNotFoundException in ReduceTaskRunner | Blocker | . | Dennis Kubes | |
+| [HADOOP-969](https://issues.apache.org/jira/browse/HADOOP-969) | deadlock in job tracker RetireJobs | Critical | . | Owen O'Malley | Owen O'Malley |
+| [HADOOP-965](https://issues.apache.org/jira/browse/HADOOP-965) | Isolation Runner looking for job.jar in wrong directory | Major | . | Dennis Kubes | |
| [HADOOP-309](https://issues.apache.org/jira/browse/HADOOP-309) | NullPointerException in StatusHttpServer | Minor | . | Konstantin Shvachko | navychen |
-| [HADOOP-227](https://issues.apache.org/jira/browse/HADOOP-227) | Namespace check pointing is not performed until the namenode restarts. | Major | . | Konstantin Shvachko | dhruba borthakur |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.11.1/CHANGES.0.11.1.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.11.1/CHANGES.0.11.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.11.1/CHANGES.0.11.1.md
index 87afd44..d19d18f 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.11.1/CHANGES.0.11.1.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.11.1/CHANGES.0.11.1.md
@@ -20,55 +20,15 @@
## Release 0.11.1 - 2007-02-09
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-987](https://issues.apache.org/jira/browse/HADOOP-987) | pendingTransfer does not remove a block from neededReplications correctly after targets are chosen | Major | . | Hairong Kuang | Hairong Kuang |
-| [HADOOP-984](https://issues.apache.org/jira/browse/HADOOP-984) | Exception while retrieving a map output index file is not reported to JobTracker | Critical | . | Nigel Daley | Arun C Murthy |
| [HADOOP-976](https://issues.apache.org/jira/browse/HADOOP-976) | SequenceFile.Metadata class should be public | Major | . | Runping Qi | Runping Qi |
| [HADOOP-917](https://issues.apache.org/jira/browse/HADOOP-917) | NPE in org.apache.hadoop.io.SequenceFile$Sorter$MergeQueue | Major | io | Sami Siren | Owen O'Malley |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-984](https://issues.apache.org/jira/browse/HADOOP-984) | Exception while retrieving a map output index file is not reported to JobTracker | Critical | . | Nigel Daley | Arun C Murthy |
+| [HADOOP-987](https://issues.apache.org/jira/browse/HADOOP-987) | pendingTransfer does not remove a block from neededReplications correctly after targets are chosen | Major | . | Hairong Kuang | Hairong Kuang |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.11.2/CHANGES.0.11.2.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.11.2/CHANGES.0.11.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.11.2/CHANGES.0.11.2.md
index 0f3e7cd..a23ef0f 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.11.2/CHANGES.0.11.2.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.11.2/CHANGES.0.11.2.md
@@ -20,54 +20,14 @@
## Release 0.11.2 - 2007-02-16
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-1009](https://issues.apache.org/jira/browse/HADOOP-1009) | Infinite loop in chooseTarget | Major | . | dhruba borthakur | dhruba borthakur |
| [HADOOP-1014](https://issues.apache.org/jira/browse/HADOOP-1014) | map/reduce is corrupting data between map and reduce | Blocker | . | Owen O'Malley | Devaraj Das |
| [HADOOP-1013](https://issues.apache.org/jira/browse/HADOOP-1013) | ArithmeticException when number of racks is zero | Major | . | James P. White | Hairong Kuang |
-| [HADOOP-1009](https://issues.apache.org/jira/browse/HADOOP-1009) | Infinite loop in chooseTarget | Major | . | dhruba borthakur | dhruba borthakur |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[29/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.0/CHANGES.0.23.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.0/CHANGES.0.23.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.0/CHANGES.0.23.0.md
index cefa86d..9fa1489 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.0/CHANGES.0.23.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.0/CHANGES.0.23.0.md
@@ -24,1165 +24,1159 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7547](https://issues.apache.org/jira/browse/HADOOP-7547) | Fix the warning in writable classes.[ WritableComparable is a raw type. References to generic type WritableComparable\<T\> should be parameterized ] | Minor | io | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HADOOP-7507](https://issues.apache.org/jira/browse/HADOOP-7507) | jvm metrics all use the same namespace | Major | metrics | Jeff Bean | Alejandro Abdelnur |
-| [HADOOP-7374](https://issues.apache.org/jira/browse/HADOOP-7374) | Don't add tools.jar to the classpath when running Hadoop | Major | scripts | Eli Collins | Eli Collins |
-| [HADOOP-7331](https://issues.apache.org/jira/browse/HADOOP-7331) | Make hadoop-daemon.sh to return 1 if daemon processes did not get started | Trivial | scripts | Tanping Wang | Tanping Wang |
-| [HADOOP-7286](https://issues.apache.org/jira/browse/HADOOP-7286) | Refactor FsShell's du/dus/df | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7264](https://issues.apache.org/jira/browse/HADOOP-7264) | Bump avro version to at least 1.4.1 | Major | io | Luke Lu | Luke Lu |
-| [HADOOP-7227](https://issues.apache.org/jira/browse/HADOOP-7227) | Remove protocol version check at proxy creation in Hadoop RPC. | Major | ipc | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-7153](https://issues.apache.org/jira/browse/HADOOP-7153) | MapWritable violates contract of Map interface for equals() and hashCode() | Minor | io | Nicholas Telford | Nicholas Telford |
-| [HADOOP-7136](https://issues.apache.org/jira/browse/HADOOP-7136) | Remove failmon contrib | Major | . | Nigel Daley | Nigel Daley |
-| [HADOOP-6949](https://issues.apache.org/jira/browse/HADOOP-6949) | Reduces RPC packet size for primitive arrays, especially long[], which is used at block reporting | Major | io | Navis | Matt Foley |
-| [HADOOP-6921](https://issues.apache.org/jira/browse/HADOOP-6921) | metrics2: metrics plugins | Major | . | Luke Lu | Luke Lu |
-| [HADOOP-6920](https://issues.apache.org/jira/browse/HADOOP-6920) | Metrics2: metrics instrumentation | Major | . | Luke Lu | Luke Lu |
-| [HADOOP-6904](https://issues.apache.org/jira/browse/HADOOP-6904) | A baby step towards inter-version RPC communications | Major | ipc | Hairong Kuang | Hairong Kuang |
+| [HDFS-1526](https://issues.apache.org/jira/browse/HDFS-1526) | Dfs client name for a map/reduce task should have some randomness | Major | hdfs-client | Hairong Kuang | Hairong Kuang |
+| [HDFS-1560](https://issues.apache.org/jira/browse/HDFS-1560) | dfs.data.dir permissions should default to 700 | Minor | datanode | Todd Lipcon | Todd Lipcon |
+| [HDFS-1536](https://issues.apache.org/jira/browse/HDFS-1536) | Improve HDFS WebUI | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-6864](https://issues.apache.org/jira/browse/HADOOP-6864) | Provide a JNI-based implementation of ShellBasedUnixGroupsNetgroupMapping (implementation of GroupMappingServiceProvider) | Major | security | Erik Steffl | Boris Shkolnik |
+| [HADOOP-6904](https://issues.apache.org/jira/browse/HADOOP-6904) | A baby step towards inter-version RPC communications | Major | ipc | Hairong Kuang | Hairong Kuang |
| [HADOOP-6432](https://issues.apache.org/jira/browse/HADOOP-6432) | Statistics support in FileContext | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-6255](https://issues.apache.org/jira/browse/HADOOP-6255) | Create an rpm integration project | Major | . | Owen O'Malley | Eric Yang |
-| [HADOOP-2081](https://issues.apache.org/jira/browse/HADOOP-2081) | Configuration getInt, getLong, and getFloat replace invalid numbers with the default value | Major | conf | Owen O'Malley | Harsh J |
-| [HDFS-2210](https://issues.apache.org/jira/browse/HDFS-2210) | Remove hdfsproxy | Major | contrib/hdfsproxy | Eli Collins | Eli Collins |
-| [HDFS-2202](https://issues.apache.org/jira/browse/HDFS-2202) | Changes to balancer bandwidth should not require datanode restart. | Major | balancer & mover, datanode | Eric Payne | Eric Payne |
-| [HDFS-2107](https://issues.apache.org/jira/browse/HDFS-2107) | Move block management code to a package | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2087](https://issues.apache.org/jira/browse/HDFS-2087) | Add methods to DataTransferProtocol interface | Major | datanode, hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2066](https://issues.apache.org/jira/browse/HDFS-2066) | Create a package and individual class files for DataTransferProtocol | Major | datanode, hdfs-client, namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2058](https://issues.apache.org/jira/browse/HDFS-2058) | DataTransfer Protocol using protobufs | Major | . | Todd Lipcon | Todd Lipcon |
-| [HDFS-1966](https://issues.apache.org/jira/browse/HDFS-1966) | Encapsulate individual DataTransferProtocol op header | Major | datanode, hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1963](https://issues.apache.org/jira/browse/HDFS-1963) | HDFS rpm integration project | Major | build | Eric Yang | Eric Yang |
-| [HDFS-1945](https://issues.apache.org/jira/browse/HDFS-1945) | Removed deprecated fields in DataTransferProtocol | Major | datanode, hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1761](https://issues.apache.org/jira/browse/HDFS-1761) | Add a new DataTransferProtocol operation, Op.TRANSFER\_BLOCK, instead of using RPC | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1723](https://issues.apache.org/jira/browse/HDFS-1723) | quota errors messages should use the same scale | Minor | . | Allen Wittenauer | Jim Plush |
+| [HADOOP-7136](https://issues.apache.org/jira/browse/HADOOP-7136) | Remove failmon contrib | Major | . | Nigel Daley | Nigel Daley |
+| [HADOOP-7153](https://issues.apache.org/jira/browse/HADOOP-7153) | MapWritable violates contract of Map interface for equals() and hashCode() | Minor | io | Nicholas Telford | Nicholas Telford |
| [HDFS-1703](https://issues.apache.org/jira/browse/HDFS-1703) | HDFS federation: Improve start/stop scripts and add script to decommission datanodes | Minor | scripts | Tanping Wang | Tanping Wang |
| [HDFS-1675](https://issues.apache.org/jira/browse/HDFS-1675) | Transfer RBW between datanodes | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-6949](https://issues.apache.org/jira/browse/HADOOP-6949) | Reduces RPC packet size for primitive arrays, especially long[], which is used at block reporting | Major | io | Navis | Matt Foley |
+| [HDFS-1761](https://issues.apache.org/jira/browse/HDFS-1761) | Add a new DataTransferProtocol operation, Op.TRANSFER\_BLOCK, instead of using RPC | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HDFS-1606](https://issues.apache.org/jira/browse/HDFS-1606) | Provide a stronger data guarantee in the write pipeline | Major | datanode, hdfs-client, namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1560](https://issues.apache.org/jira/browse/HDFS-1560) | dfs.data.dir permissions should default to 700 | Minor | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-1536](https://issues.apache.org/jira/browse/HDFS-1536) | Improve HDFS WebUI | Major | . | Hairong Kuang | Hairong Kuang |
-| [HDFS-1526](https://issues.apache.org/jira/browse/HDFS-1526) | Dfs client name for a map/reduce task should have some randomness | Major | hdfs-client | Hairong Kuang | Hairong Kuang |
+| [HADOOP-7227](https://issues.apache.org/jira/browse/HADOOP-7227) | Remove protocol version check at proxy creation in Hadoop RPC. | Major | ipc | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HADOOP-6920](https://issues.apache.org/jira/browse/HADOOP-6920) | Metrics2: metrics instrumentation | Major | . | Luke Lu | Luke Lu |
+| [HADOOP-6921](https://issues.apache.org/jira/browse/HADOOP-6921) | metrics2: metrics plugins | Major | . | Luke Lu | Luke Lu |
| [HDFS-1117](https://issues.apache.org/jira/browse/HDFS-1117) | HDFS portion of HADOOP-6728 (ovehaul metrics framework) | Major | . | Luke Lu | Luke Lu |
-| [HDFS-1073](https://issues.apache.org/jira/browse/HDFS-1073) | Simpler model for Namenode's fs Image and edit Logs | Major | . | Sanjay Radia | Todd Lipcon |
-| [MAPREDUCE-3205](https://issues.apache.org/jira/browse/MAPREDUCE-3205) | MR2 memory limits should be pmem, not vmem | Blocker | mrv2, nodemanager | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-3041](https://issues.apache.org/jira/browse/MAPREDUCE-3041) | Enhance YARN Client-RM protocol to provide access to information such as cluster's Min/Max Resource capabilities similar to that of AM-RM protocol | Blocker | mrv2 | Hitesh Shah | Hitesh Shah |
-| [MAPREDUCE-2736](https://issues.apache.org/jira/browse/MAPREDUCE-2736) | Remove unused contrib components dependent on MR1 | Major | jobtracker, tasktracker | Eli Collins | Eli Collins |
-| [MAPREDUCE-2606](https://issues.apache.org/jira/browse/MAPREDUCE-2606) | Remove IsolationRunner | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-1945](https://issues.apache.org/jira/browse/HDFS-1945) | Removed deprecated fields in DataTransferProtocol | Major | datanode, hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-7286](https://issues.apache.org/jira/browse/HADOOP-7286) | Refactor FsShell's du/dus/df | Major | fs | Daryn Sharp | Daryn Sharp |
+| [HADOOP-6255](https://issues.apache.org/jira/browse/HADOOP-6255) | Create an rpm integration project | Major | . | Owen O'Malley | Eric Yang |
+| [HDFS-1963](https://issues.apache.org/jira/browse/HDFS-1963) | HDFS rpm integration project | Major | build | Eric Yang | Eric Yang |
| [MAPREDUCE-2455](https://issues.apache.org/jira/browse/MAPREDUCE-2455) | Remove deprecated JobTracker.State in favour of JobTrackerStatus | Major | build, client | Tom White | Tom White |
+| [HDFS-1966](https://issues.apache.org/jira/browse/HDFS-1966) | Encapsulate individual DataTransferProtocol op header | Major | datanode, hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-7331](https://issues.apache.org/jira/browse/HADOOP-7331) | Make hadoop-daemon.sh to return 1 if daemon processes did not get started | Trivial | scripts | Tanping Wang | Tanping Wang |
+| [HDFS-2058](https://issues.apache.org/jira/browse/HDFS-2058) | DataTransfer Protocol using protobufs | Major | . | Todd Lipcon | Todd Lipcon |
| [MAPREDUCE-2430](https://issues.apache.org/jira/browse/MAPREDUCE-2430) | Remove mrunit contrib | Major | . | Nigel Daley | Nigel Daley |
+| [HADOOP-7374](https://issues.apache.org/jira/browse/HADOOP-7374) | Don't add tools.jar to the classpath when running Hadoop | Major | scripts | Eli Collins | Eli Collins |
+| [HDFS-2066](https://issues.apache.org/jira/browse/HDFS-2066) | Create a package and individual class files for DataTransferProtocol | Major | datanode, hdfs-client, namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-2087](https://issues.apache.org/jira/browse/HDFS-2087) | Add methods to DataTransferProtocol interface | Major | datanode, hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-1723](https://issues.apache.org/jira/browse/HDFS-1723) | quota errors messages should use the same scale | Minor | . | Allen Wittenauer | Jim Plush |
+| [HDFS-2107](https://issues.apache.org/jira/browse/HDFS-2107) | Move block management code to a package | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-2606](https://issues.apache.org/jira/browse/MAPREDUCE-2606) | Remove IsolationRunner | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-2081](https://issues.apache.org/jira/browse/HADOOP-2081) | Configuration getInt, getLong, and getFloat replace invalid numbers with the default value | Major | conf | Owen O'Malley | Harsh J |
+| [HDFS-2210](https://issues.apache.org/jira/browse/HDFS-2210) | Remove hdfsproxy | Major | contrib/hdfsproxy | Eli Collins | Eli Collins |
+| [HDFS-1073](https://issues.apache.org/jira/browse/HDFS-1073) | Simpler model for Namenode's fs Image and edit Logs | Major | . | Sanjay Radia | Todd Lipcon |
+| [HDFS-2202](https://issues.apache.org/jira/browse/HDFS-2202) | Changes to balancer bandwidth should not require datanode restart. | Major | balancer & mover, datanode | Eric Payne | Eric Payne |
| [MAPREDUCE-1738](https://issues.apache.org/jira/browse/MAPREDUCE-1738) | MapReduce portion of HADOOP-6728 (ovehaul metrics framework) | Major | . | Luke Lu | Luke Lu |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-7264](https://issues.apache.org/jira/browse/HADOOP-7264) | Bump avro version to at least 1.4.1 | Major | io | Luke Lu | Luke Lu |
+| [HADOOP-7547](https://issues.apache.org/jira/browse/HADOOP-7547) | Fix the warning in writable classes.[ WritableComparable is a raw type. References to generic type WritableComparable\<T\> should be parameterized ] | Minor | io | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [HADOOP-7507](https://issues.apache.org/jira/browse/HADOOP-7507) | jvm metrics all use the same namespace | Major | metrics | Jeff Bean | Alejandro Abdelnur |
+| [MAPREDUCE-3041](https://issues.apache.org/jira/browse/MAPREDUCE-3041) | Enhance YARN Client-RM protocol to provide access to information such as cluster's Min/Max Resource capabilities similar to that of AM-RM protocol | Blocker | mrv2 | Hitesh Shah | Hitesh Shah |
+| [MAPREDUCE-3205](https://issues.apache.org/jira/browse/MAPREDUCE-3205) | MR2 memory limits should be pmem, not vmem | Blocker | mrv2, nodemanager | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-2736](https://issues.apache.org/jira/browse/MAPREDUCE-2736) | Remove unused contrib components dependent on MR1 | Major | jobtracker, tasktracker | Eli Collins | Eli Collins |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7705](https://issues.apache.org/jira/browse/HADOOP-7705) | Add a log4j back end that can push out JSON data, one per line | Minor | util | Steve Loughran | Steve Loughran |
-| [HADOOP-7594](https://issues.apache.org/jira/browse/HADOOP-7594) | Support HTTP REST in HttpServer | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-7493](https://issues.apache.org/jira/browse/HADOOP-7493) | [HDFS-362] Provide ShortWritable class in hadoop. | Major | io | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HADOOP-7443](https://issues.apache.org/jira/browse/HADOOP-7443) | Add CRC32C as another DataChecksum implementation | Major | io, util | Todd Lipcon | Todd Lipcon |
+| [HDFS-1448](https://issues.apache.org/jira/browse/HDFS-1448) | Create multi-format parser for edits logs file, support binary and XML formats initially | Major | tools | Erik Steffl | Erik Steffl |
+| [MAPREDUCE-2438](https://issues.apache.org/jira/browse/MAPREDUCE-2438) | MR-279: WebApp for Job History | Major | mrv2 | Mahadev konar | Krishna Ramachandran |
+| [HDFS-1751](https://issues.apache.org/jira/browse/HDFS-1751) | Intrinsic limits for HDFS files, directories | Major | datanode | Daryn Sharp | Daryn Sharp |
+| [HDFS-1052](https://issues.apache.org/jira/browse/HDFS-1052) | HDFS scalability with multiple namenodes | Major | namenode | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-2434](https://issues.apache.org/jira/browse/MAPREDUCE-2434) | MR-279: ResourceManager metrics | Major | mrv2 | Luke Lu | Luke Lu |
+| [HDFS-1873](https://issues.apache.org/jira/browse/HDFS-1873) | Federation Cluster Management Web Console | Major | . | Tanping Wang | Tanping Wang |
| [HADOOP-7257](https://issues.apache.org/jira/browse/HADOOP-7257) | A client side mount table to give per-application/per-job file system view | Major | . | Sanjay Radia | Sanjay Radia |
| [HADOOP-7214](https://issues.apache.org/jira/browse/HADOOP-7214) | Hadoop /usr/bin/groups equivalent | Major | . | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-7206](https://issues.apache.org/jira/browse/HADOOP-7206) | Integrate Snappy compression | Major | . | Eli Collins | Alejandro Abdelnur |
-| [HADOOP-7144](https://issues.apache.org/jira/browse/HADOOP-7144) | Expose JMX with something like JMXProxyServlet | Major | . | Luke Lu | Robert Joseph Evans |
-| [HADOOP-7119](https://issues.apache.org/jira/browse/HADOOP-7119) | add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-6889](https://issues.apache.org/jira/browse/HADOOP-6889) | Make RPC to have an option to timeout | Major | ipc | Hairong Kuang | John George |
-| [HADOOP-6385](https://issues.apache.org/jira/browse/HADOOP-6385) | dfs does not support -rmdir (was HDFS-639) | Minor | fs | Scott Phillips | Daryn Sharp |
-| [HDFS-2471](https://issues.apache.org/jira/browse/HDFS-2471) | Add Federation feature, configuration and tools documentation | Major | documentation | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-2083](https://issues.apache.org/jira/browse/HDFS-2083) | Adopt JMXJsonServlet into HDFS in order to query statistics | Major | . | Tanping Wang | Tanping Wang |
-| [HDFS-2055](https://issues.apache.org/jira/browse/HDFS-2055) | Add hflush support to libhdfs | Major | libhdfs | Travis Crawford | Travis Crawford |
-| [HDFS-1873](https://issues.apache.org/jira/browse/HDFS-1873) | Federation Cluster Management Web Console | Major | . | Tanping Wang | Tanping Wang |
| [HDFS-1814](https://issues.apache.org/jira/browse/HDFS-1814) | HDFS portion of HADOOP-7214 - Hadoop /usr/bin/groups equivalent | Major | hdfs-client, namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-1751](https://issues.apache.org/jira/browse/HDFS-1751) | Intrinsic limits for HDFS files, directories | Major | datanode | Daryn Sharp | Daryn Sharp |
-| [HDFS-1448](https://issues.apache.org/jira/browse/HDFS-1448) | Create multi-format parser for edits logs file, support binary and XML formats initially | Major | tools | Erik Steffl | Erik Steffl |
-| [HDFS-1330](https://issues.apache.org/jira/browse/HDFS-1330) | Make RPCs to DataNodes timeout | Major | datanode | Hairong Kuang | John George |
-| [HDFS-1052](https://issues.apache.org/jira/browse/HDFS-1052) | HDFS scalability with multiple namenodes | Major | namenode | Suresh Srinivas | Suresh Srinivas |
-| [MAPREDUCE-2719](https://issues.apache.org/jira/browse/MAPREDUCE-2719) | MR-279: Write a shell command application | Major | mrv2 | Sharad Agarwal | Hitesh Shah |
-| [MAPREDUCE-2692](https://issues.apache.org/jira/browse/MAPREDUCE-2692) | Ensure AM Restart and Recovery-on-restart is complete | Major | mrv2 | Amol Kekre | Sharad Agarwal |
-| [MAPREDUCE-2543](https://issues.apache.org/jira/browse/MAPREDUCE-2543) | [Gridmix] Add support for HighRam jobs | Major | contrib/gridmix | Amar Kamat | Amar Kamat |
+| [MAPREDUCE-2473](https://issues.apache.org/jira/browse/MAPREDUCE-2473) | MR portion of HADOOP-7214 - Hadoop /usr/bin/groups equivalent | Major | jobtracker | Aaron T. Myers | Aaron T. Myers |
+| [MAPREDUCE-461](https://issues.apache.org/jira/browse/MAPREDUCE-461) | Enable ServicePlugins for the JobTracker | Minor | . | Fredrik Hedberg | Fredrik Hedberg |
+| [MAPREDUCE-2407](https://issues.apache.org/jira/browse/MAPREDUCE-2407) | Make Gridmix emulate usage of Distributed Cache files | Major | contrib/gridmix | Ravi Gummadi | Ravi Gummadi |
| [MAPREDUCE-2533](https://issues.apache.org/jira/browse/MAPREDUCE-2533) | MR-279: Metrics for reserved resource in ResourceManager | Major | mrv2 | Luke Lu | Luke Lu |
-| [MAPREDUCE-2532](https://issues.apache.org/jira/browse/MAPREDUCE-2532) | MR-279: Metrics for NodeManager | Major | mrv2 | Luke Lu | Luke Lu |
| [MAPREDUCE-2527](https://issues.apache.org/jira/browse/MAPREDUCE-2527) | MR-279: Metrics for MRAppMaster | Major | mrv2 | Luke Lu | Luke Lu |
-| [MAPREDUCE-2521](https://issues.apache.org/jira/browse/MAPREDUCE-2521) | Mapreduce RPM integration project | Major | build | Eric Yang | Eric Yang |
-| [MAPREDUCE-2473](https://issues.apache.org/jira/browse/MAPREDUCE-2473) | MR portion of HADOOP-7214 - Hadoop /usr/bin/groups equivalent | Major | jobtracker | Aaron T. Myers | Aaron T. Myers |
-| [MAPREDUCE-2438](https://issues.apache.org/jira/browse/MAPREDUCE-2438) | MR-279: WebApp for Job History | Major | mrv2 | Mahadev konar | Krishna Ramachandran |
-| [MAPREDUCE-2434](https://issues.apache.org/jira/browse/MAPREDUCE-2434) | MR-279: ResourceManager metrics | Major | mrv2 | Luke Lu | Luke Lu |
+| [MAPREDUCE-2532](https://issues.apache.org/jira/browse/MAPREDUCE-2532) | MR-279: Metrics for NodeManager | Major | mrv2 | Luke Lu | Luke Lu |
| [MAPREDUCE-2408](https://issues.apache.org/jira/browse/MAPREDUCE-2408) | Make Gridmix emulate usage of data compression | Major | contrib/gridmix | Ravi Gummadi | Amar Kamat |
-| [MAPREDUCE-2407](https://issues.apache.org/jira/browse/MAPREDUCE-2407) | Make Gridmix emulate usage of Distributed Cache files | Major | contrib/gridmix | Ravi Gummadi | Ravi Gummadi |
+| [MAPREDUCE-2521](https://issues.apache.org/jira/browse/MAPREDUCE-2521) | Mapreduce RPM integration project | Major | build | Eric Yang | Eric Yang |
+| [MAPREDUCE-2543](https://issues.apache.org/jira/browse/MAPREDUCE-2543) | [Gridmix] Add support for HighRam jobs | Major | contrib/gridmix | Amar Kamat | Amar Kamat |
+| [HADOOP-7144](https://issues.apache.org/jira/browse/HADOOP-7144) | Expose JMX with something like JMXProxyServlet | Major | . | Luke Lu | Robert Joseph Evans |
+| [HDFS-2055](https://issues.apache.org/jira/browse/HDFS-2055) | Add hflush support to libhdfs | Major | libhdfs | Travis Crawford | Travis Crawford |
+| [HDFS-2083](https://issues.apache.org/jira/browse/HDFS-2083) | Adopt JMXJsonServlet into HDFS in order to query statistics | Major | . | Tanping Wang | Tanping Wang |
+| [HADOOP-7206](https://issues.apache.org/jira/browse/HADOOP-7206) | Integrate Snappy compression | Major | . | Eli Collins | Alejandro Abdelnur |
| [MAPREDUCE-2323](https://issues.apache.org/jira/browse/MAPREDUCE-2323) | Add metrics to the fair scheduler | Major | contrib/fair-share | Todd Lipcon | Todd Lipcon |
+| [HADOOP-7443](https://issues.apache.org/jira/browse/HADOOP-7443) | Add CRC32C as another DataChecksum implementation | Major | io, util | Todd Lipcon | Todd Lipcon |
+| [HADOOP-6385](https://issues.apache.org/jira/browse/HADOOP-6385) | dfs does not support -rmdir (was HDFS-639) | Minor | fs | Scott Phillips | Daryn Sharp |
| [MAPREDUCE-2037](https://issues.apache.org/jira/browse/MAPREDUCE-2037) | Capturing interim progress times, CPU usage, and memory usage, when tasks reach certain progress thresholds | Major | . | Dick King | Dick King |
+| [HADOOP-7493](https://issues.apache.org/jira/browse/HADOOP-7493) | [HDFS-362] Provide ShortWritable class in hadoop. | Major | io | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [HDFS-1330](https://issues.apache.org/jira/browse/HDFS-1330) | Make RPCs to DataNodes timeout | Major | datanode | Hairong Kuang | John George |
+| [HADOOP-7594](https://issues.apache.org/jira/browse/HADOOP-7594) | Support HTTP REST in HttpServer | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-7119](https://issues.apache.org/jira/browse/HADOOP-7119) | add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-2719](https://issues.apache.org/jira/browse/MAPREDUCE-2719) | MR-279: Write a shell command application | Major | mrv2 | Sharad Agarwal | Hitesh Shah |
+| [HADOOP-6889](https://issues.apache.org/jira/browse/HADOOP-6889) | Make RPC to have an option to timeout | Major | ipc | Hairong Kuang | John George |
+| [HADOOP-7705](https://issues.apache.org/jira/browse/HADOOP-7705) | Add a log4j back end that can push out JSON data, one per line | Minor | util | Steve Loughran | Steve Loughran |
+| [HDFS-2471](https://issues.apache.org/jira/browse/HDFS-2471) | Add Federation feature, configuration and tools documentation | Major | documentation | Suresh Srinivas | Suresh Srinivas |
| [MAPREDUCE-1938](https://issues.apache.org/jira/browse/MAPREDUCE-1938) | Ability for having user's classes take precedence over the system classes for tasks' classpath | Blocker | job submission, task, tasktracker | Devaraj Das | Krishna Ramachandran |
-| [MAPREDUCE-461](https://issues.apache.org/jira/browse/MAPREDUCE-461) | Enable ServicePlugins for the JobTracker | Minor | . | Fredrik Hedberg | Fredrik Hedberg |
+| [MAPREDUCE-2692](https://issues.apache.org/jira/browse/MAPREDUCE-2692) | Ensure AM Restart and Recovery-on-restart is complete | Major | mrv2 | Amol Kekre | Sharad Agarwal |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8619](https://issues.apache.org/jira/browse/HADOOP-8619) | WritableComparator must implement no-arg constructor | Major | io | Radim Kolar | Chris Douglas |
-| [HADOOP-7789](https://issues.apache.org/jira/browse/HADOOP-7789) | Minor edits to top-level site | Major | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-7785](https://issues.apache.org/jira/browse/HADOOP-7785) | Add equals, hashcode, toString to DataChecksum | Major | io, util | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7772](https://issues.apache.org/jira/browse/HADOOP-7772) | javadoc the topology classes | Trivial | . | Steve Loughran | Steve Loughran |
-| [HADOOP-7763](https://issues.apache.org/jira/browse/HADOOP-7763) | Add top-level navigation to APT docs | Major | documentation | Tom White | Tom White |
-| [HADOOP-7749](https://issues.apache.org/jira/browse/HADOOP-7749) | Add NetUtils call which provides more help in exception messages | Minor | util | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7743](https://issues.apache.org/jira/browse/HADOOP-7743) | Add Maven profile to create a full source tarball | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-7737](https://issues.apache.org/jira/browse/HADOOP-7737) | normalize hadoop-mapreduce & hadoop-dist dist/tar build with common/hdfs | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-7720](https://issues.apache.org/jira/browse/HADOOP-7720) | improve the hadoop-setup-conf.sh to read in the hbase user and setup the configs | Major | conf | Arpit Gupta | Arpit Gupta |
-| [HADOOP-7710](https://issues.apache.org/jira/browse/HADOOP-7710) | create a script to setup application in order to create root directories for application such hbase, hcat, hive etc | Major | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-7709](https://issues.apache.org/jira/browse/HADOOP-7709) | Running a set of methods in a Single Test Class | Major | . | Jonathan Eagles | Jonathan Eagles |
-| [HADOOP-7707](https://issues.apache.org/jira/browse/HADOOP-7707) | improve config generator to allow users to specify proxy user, turn append on or off, turn webhdfs on or off | Major | conf | Arpit Gupta | Arpit Gupta |
-| [HADOOP-7668](https://issues.apache.org/jira/browse/HADOOP-7668) | Add a NetUtils method that can tell if an InetAddress belongs to local host | Minor | util | Suresh Srinivas | Steve Loughran |
-| [HADOOP-7664](https://issues.apache.org/jira/browse/HADOOP-7664) | o.a.h.conf.Configuration complains of overriding final parameter even if the value with which its attempting to override is the same. | Minor | conf | Ravi Prakash | Ravi Prakash |
-| [HADOOP-7655](https://issues.apache.org/jira/browse/HADOOP-7655) | provide a small validation script that smoke tests the installed cluster | Major | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-7642](https://issues.apache.org/jira/browse/HADOOP-7642) | create hadoop-dist module where TAR stitching would happen | Major | build | Alejandro Abdelnur | Tom White |
-| [HADOOP-7627](https://issues.apache.org/jira/browse/HADOOP-7627) | Improve MetricsAsserts to give more understandable output on failure | Minor | metrics, test | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7624](https://issues.apache.org/jira/browse/HADOOP-7624) | Set things up for a top level hadoop-tools module | Major | build | Vinod Kumar Vavilapalli | Alejandro Abdelnur |
-| [HADOOP-7612](https://issues.apache.org/jira/browse/HADOOP-7612) | Change test-patch to run tests for all nested modules | Major | build | Tom White | Tom White |
-| [HADOOP-7595](https://issues.apache.org/jira/browse/HADOOP-7595) | Upgrade dependency to Avro 1.5.3 | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-7555](https://issues.apache.org/jira/browse/HADOOP-7555) | Add a eclipse-generated files to .gitignore | Trivial | build | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-7552](https://issues.apache.org/jira/browse/HADOOP-7552) | FileUtil#fullyDelete doesn't throw IOE but lists it in the throws clause | Minor | fs | Eli Collins | Eli Collins |
-| [HADOOP-7531](https://issues.apache.org/jira/browse/HADOOP-7531) | Add servlet util methods for handling paths in requests | Major | util | Eli Collins | Eli Collins |
-| [HADOOP-7509](https://issues.apache.org/jira/browse/HADOOP-7509) | Improve message when Authentication is required | Trivial | . | Ravi Prakash | Ravi Prakash |
-| [HADOOP-7491](https://issues.apache.org/jira/browse/HADOOP-7491) | hadoop command should respect HADOOP\_OPTS when given a class name | Major | scripts | Eli Collins | Eli Collins |
-| [HADOOP-7474](https://issues.apache.org/jira/browse/HADOOP-7474) | Refactor ClientCache out of WritableRpcEngine. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-7472](https://issues.apache.org/jira/browse/HADOOP-7472) | RPC client should deal with the IP address changes | Minor | ipc | Kihwal Lee | Kihwal Lee |
-| [HADOOP-7463](https://issues.apache.org/jira/browse/HADOOP-7463) | Adding a configuration parameter to SecurityInfo interface. | Minor | . | Mahadev konar | Mahadev konar |
-| [HADOOP-7460](https://issues.apache.org/jira/browse/HADOOP-7460) | Support for pluggable Trash policies | Major | fs | dhruba borthakur | Usman Masood |
-| [HADOOP-7457](https://issues.apache.org/jira/browse/HADOOP-7457) | Remove out-of-date Chinese language documentation | Blocker | documentation | Jakob Homan | Jakob Homan |
-| [HADOOP-7451](https://issues.apache.org/jira/browse/HADOOP-7451) | merge for MR-279: Generalize StringUtils#join | Major | . | Matt Foley | Matt Foley |
-| [HADOOP-7449](https://issues.apache.org/jira/browse/HADOOP-7449) | merge for MR-279: add Data(In,Out)putByteBuffer to work with ByteBuffer similar to Data(In,Out)putBuffer for byte[] | Major | . | Matt Foley | Matt Foley |
-| [HADOOP-7448](https://issues.apache.org/jira/browse/HADOOP-7448) | merge for MR-279: HttpServer /stacks servlet should use plain text content type | Major | . | Matt Foley | Matt Foley |
-| [HADOOP-7446](https://issues.apache.org/jira/browse/HADOOP-7446) | Implement CRC32C native code using SSE4.2 instructions | Major | native, performance | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7445](https://issues.apache.org/jira/browse/HADOOP-7445) | Implement bulk checksum verification using efficient native code | Major | native, util | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7444](https://issues.apache.org/jira/browse/HADOOP-7444) | Add Checksum API to verify and calculate checksums "in bulk" | Major | . | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7438](https://issues.apache.org/jira/browse/HADOOP-7438) | Using the hadoop-deamon.sh script to start nodes leads to a depricated warning | Major | . | Ravi Prakash | Ravi Prakash |
-| [HADOOP-7434](https://issues.apache.org/jira/browse/HADOOP-7434) | Display error when using "daemonlog -setlevel" with illegal level | Minor | . | 严金双 | 严金双 |
-| [HADOOP-7430](https://issues.apache.org/jira/browse/HADOOP-7430) | Improve error message when moving to trash fails due to quota issue | Minor | fs | Ravi Prakash | Ravi Prakash |
-| [HADOOP-7392](https://issues.apache.org/jira/browse/HADOOP-7392) | Implement capability of querying individual property of a mbean using JMXProxyServlet | Major | . | Tanping Wang | Tanping Wang |
-| [HADOOP-7384](https://issues.apache.org/jira/browse/HADOOP-7384) | Allow test-patch to be more flexible about patch format | Major | . | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7379](https://issues.apache.org/jira/browse/HADOOP-7379) | Add ability to include Protobufs in ObjectWritable | Major | io, ipc | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7375](https://issues.apache.org/jira/browse/HADOOP-7375) | Add resolvePath method to FileContext | Major | . | Sanjay Radia | Sanjay Radia |
-| [HADOOP-7361](https://issues.apache.org/jira/browse/HADOOP-7361) | Provide overwrite option (-overwrite/-f) in put and copyFromLocal command line options | Minor | fs | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HADOOP-7360](https://issues.apache.org/jira/browse/HADOOP-7360) | FsShell does not preserve relative paths with globs | Major | fs | Daryn Sharp | Kihwal Lee |
-| [HADOOP-7337](https://issues.apache.org/jira/browse/HADOOP-7337) | Annotate PureJavaCrc32 as a public API | Minor | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-7333](https://issues.apache.org/jira/browse/HADOOP-7333) | Performance improvement in PureJavaCrc32 | Minor | performance, util | Eric Caspole | Eric Caspole |
-| [HADOOP-7329](https://issues.apache.org/jira/browse/HADOOP-7329) | incomplete help message is displayed for df -h option | Minor | fs | XieXianshan | XieXianshan |
-| [HADOOP-7328](https://issues.apache.org/jira/browse/HADOOP-7328) | When a serializer class is missing, return null, not throw an NPE. | Major | io | Harsh J | Harsh J |
-| [HADOOP-7320](https://issues.apache.org/jira/browse/HADOOP-7320) | Refactor FsShell's copy & move commands | Major | . | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7316](https://issues.apache.org/jira/browse/HADOOP-7316) | Add public javadocs to FSDataInputStream and FSDataOutputStream | Major | documentation | Jonathan Hsieh | Eli Collins |
-| [HADOOP-7314](https://issues.apache.org/jira/browse/HADOOP-7314) | Add support for throwing UnknownHostException when a host doesn't resolve | Major | . | Jeffrey Naisbitt | Jeffrey Naisbitt |
-| [HADOOP-7306](https://issues.apache.org/jira/browse/HADOOP-7306) | Start metrics system even if config files are missing | Major | metrics | Luke Lu | Luke Lu |
-| [HADOOP-7305](https://issues.apache.org/jira/browse/HADOOP-7305) | Eclipse project files are incomplete | Minor | build | Niels Basjes | Niels Basjes |
-| [HADOOP-7301](https://issues.apache.org/jira/browse/HADOOP-7301) | FSDataInputStream should expose a getWrappedStream method | Major | . | Jonathan Hsieh | Jonathan Hsieh |
-| [HADOOP-7289](https://issues.apache.org/jira/browse/HADOOP-7289) | ivy: test conf should not extend common conf | Major | build | Tsz Wo Nicholas Sze | Eric Yang |
-| [HADOOP-7285](https://issues.apache.org/jira/browse/HADOOP-7285) | Refactor FsShell's test | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7275](https://issues.apache.org/jira/browse/HADOOP-7275) | Refactor FsShell's stat | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7271](https://issues.apache.org/jira/browse/HADOOP-7271) | Standardize error messages | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7267](https://issues.apache.org/jira/browse/HADOOP-7267) | Refactor FsShell's rm/rmr/expunge | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7265](https://issues.apache.org/jira/browse/HADOOP-7265) | Keep track of relative paths | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7251](https://issues.apache.org/jira/browse/HADOOP-7251) | Refactor FsShell's getmerge | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7250](https://issues.apache.org/jira/browse/HADOOP-7250) | Refactor FsShell's setrep | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7249](https://issues.apache.org/jira/browse/HADOOP-7249) | Refactor FsShell's chmod/chown/chgrp | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7241](https://issues.apache.org/jira/browse/HADOOP-7241) | fix typo of command 'hadoop fs -help tail' | Minor | fs, test | Wei Yongjun | Wei Yongjun |
-| [HADOOP-7238](https://issues.apache.org/jira/browse/HADOOP-7238) | Refactor FsShell's cat & text | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7237](https://issues.apache.org/jira/browse/HADOOP-7237) | Refactor FsShell's touchz | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7236](https://issues.apache.org/jira/browse/HADOOP-7236) | Refactor FsShell's mkdir | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7235](https://issues.apache.org/jira/browse/HADOOP-7235) | Refactor FsShell's tail | Major | . | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7233](https://issues.apache.org/jira/browse/HADOOP-7233) | Refactor FsShell's ls | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7209](https://issues.apache.org/jira/browse/HADOOP-7209) | Extensions to FsShell | Major | . | Olga Natkovich | Daryn Sharp |
-| [HADOOP-7205](https://issues.apache.org/jira/browse/HADOOP-7205) | automatically determine JAVA\_HOME on OS X | Trivial | . | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7202](https://issues.apache.org/jira/browse/HADOOP-7202) | Improve Command base class | Major | . | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7193](https://issues.apache.org/jira/browse/HADOOP-7193) | Help message is wrong for touchz command. | Minor | fs | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HADOOP-7180](https://issues.apache.org/jira/browse/HADOOP-7180) | Improve CommandFormat | Minor | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7177](https://issues.apache.org/jira/browse/HADOOP-7177) | CodecPool should report which compressor it is using | Trivial | native | Allen Wittenauer | Allen Wittenauer |
-| [HADOOP-7167](https://issues.apache.org/jira/browse/HADOOP-7167) | Allow using a file to exclude certain tests from build | Minor | . | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7159](https://issues.apache.org/jira/browse/HADOOP-7159) | RPC server should log the client hostname when read exception happened | Trivial | ipc | Scott Chen | Scott Chen |
-| [HADOOP-7133](https://issues.apache.org/jira/browse/HADOOP-7133) | CLONE to COMMON - HDFS-1445 Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file | Major | util | Matt Foley | Matt Foley |
-| [HADOOP-7131](https://issues.apache.org/jira/browse/HADOOP-7131) | set() and toString Methods of the org.apache.hadoop.io.Text class does not include the root exception, in the wrapping RuntimeException. | Minor | io | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HADOOP-7117](https://issues.apache.org/jira/browse/HADOOP-7117) | Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml | Major | conf | Patrick Angeles | Harsh J |
-| [HADOOP-7114](https://issues.apache.org/jira/browse/HADOOP-7114) | FsShell should dump all exceptions at DEBUG level | Minor | fs | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7112](https://issues.apache.org/jira/browse/HADOOP-7112) | Issue a warning when GenericOptionsParser libjars are not on local filesystem | Major | conf, filecache | Tom White | Tom White |
-| [HADOOP-7096](https://issues.apache.org/jira/browse/HADOOP-7096) | Allow setting of end-of-record delimiter for TextInputFormat | Major | . | Ahmed Radwan | Ahmed Radwan |
-| [HADOOP-7078](https://issues.apache.org/jira/browse/HADOOP-7078) | Add better javadocs for RawComparator interface | Trivial | . | Todd Lipcon | Harsh J |
-| [HADOOP-7061](https://issues.apache.org/jira/browse/HADOOP-7061) | unprecise javadoc for CompressionCodec | Minor | io | Jingguo Yao | Jingguo Yao |
-| [HADOOP-7060](https://issues.apache.org/jira/browse/HADOOP-7060) | A more elegant FileSystem#listCorruptFileBlocks API | Major | fs | Hairong Kuang | Patrick Kling |
-| [HADOOP-7059](https://issues.apache.org/jira/browse/HADOOP-7059) | Remove "unused" warning in native code | Major | native | Noah Watkins | Noah Watkins |
-| [HADOOP-7058](https://issues.apache.org/jira/browse/HADOOP-7058) | Expose number of bytes in FSOutputSummer buffer to implementatins | Trivial | . | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7049](https://issues.apache.org/jira/browse/HADOOP-7049) | TestReconfiguration should be junit v4 | Trivial | conf | Patrick Kling | Patrick Kling |
-| [HADOOP-7048](https://issues.apache.org/jira/browse/HADOOP-7048) | Wrong description of Block-Compressed SequenceFile Format in SequenceFile's javadoc | Minor | io | Jingguo Yao | Jingguo Yao |
| [HADOOP-7042](https://issues.apache.org/jira/browse/HADOOP-7042) | Update test-patch.sh to include failed test names and move test-patch.properties | Minor | test | Nigel Daley | Nigel Daley |
+| [HDFS-1510](https://issues.apache.org/jira/browse/HDFS-1510) | Add test-patch.properties required by test-patch.sh | Minor | . | Nigel Daley | Nigel Daley |
+| [HDFS-1513](https://issues.apache.org/jira/browse/HDFS-1513) | Fix a number of warnings | Minor | . | Eli Collins | Eli Collins |
+| [HDFS-1481](https://issues.apache.org/jira/browse/HDFS-1481) | NameNode should validate fsimage before rolling | Major | namenode | Hairong Kuang | Hairong Kuang |
| [HADOOP-7023](https://issues.apache.org/jira/browse/HADOOP-7023) | Add listCorruptFileBlocks to FileSystem | Major | . | Patrick Kling | Patrick Kling |
-| [HADOOP-7014](https://issues.apache.org/jira/browse/HADOOP-7014) | Generalize CLITest structure and interfaces to facilitate upstream adoption (e.g. for web testing) | Major | test | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-6994](https://issues.apache.org/jira/browse/HADOOP-6994) | Api to get delegation token in AbstractFileSystem | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-6929](https://issues.apache.org/jira/browse/HADOOP-6929) | RPC should have a way to pass Security information other than protocol annotations | Major | ipc, security | Sharad Agarwal | Sharad Agarwal |
-| [HADOOP-6887](https://issues.apache.org/jira/browse/HADOOP-6887) | Need a separate metrics per garbage collector | Major | metrics | Bharath Mundlapudi | Luke Lu |
+| [HDFS-1458](https://issues.apache.org/jira/browse/HDFS-1458) | Improve checkpoint performance by avoiding unnecessary image downloads | Major | namenode | Hairong Kuang | Hairong Kuang |
| [HADOOP-6764](https://issues.apache.org/jira/browse/HADOOP-6764) | Add number of reader threads and queue length as configuration parameters in RPC.getServer | Major | ipc | Dmytro Molkov | Dmytro Molkov |
+| [HADOOP-7049](https://issues.apache.org/jira/browse/HADOOP-7049) | TestReconfiguration should be junit v4 | Trivial | conf | Patrick Kling | Patrick Kling |
+| [HDFS-1518](https://issues.apache.org/jira/browse/HDFS-1518) | Wrong description in FSNamesystem's javadoc | Minor | namenode | Jingguo Yao | Jingguo Yao |
+| [MAPREDUCE-1752](https://issues.apache.org/jira/browse/MAPREDUCE-1752) | Implement getFileBlockLocations in HarFilesystem | Major | harchive | Dmytro Molkov | Dmytro Molkov |
+| [MAPREDUCE-2155](https://issues.apache.org/jira/browse/MAPREDUCE-2155) | RaidNode should optionally dispatch map reduce jobs to fix corrupt blocks (instead of fixing locally) | Major | contrib/raid | Patrick Kling | Patrick Kling |
+| [MAPREDUCE-1783](https://issues.apache.org/jira/browse/MAPREDUCE-1783) | Task Initialization should be delayed till when a job can be run | Major | contrib/fair-share | Ramkumar Vadali | Ramkumar Vadali |
+| [MAPREDUCE-2156](https://issues.apache.org/jira/browse/MAPREDUCE-2156) | Raid-aware FSCK | Major | contrib/raid | Patrick Kling | Patrick Kling |
+| [HDFS-1506](https://issues.apache.org/jira/browse/HDFS-1506) | Refactor fsimage loading code | Major | namenode | Hairong Kuang | Hairong Kuang |
+| [HADOOP-7060](https://issues.apache.org/jira/browse/HADOOP-7060) | A more elegant FileSystem#listCorruptFileBlocks API | Major | fs | Hairong Kuang | Patrick Kling |
+| [HADOOP-7058](https://issues.apache.org/jira/browse/HADOOP-7058) | Expose number of bytes in FSOutputSummer buffer to implementatins | Trivial | . | Todd Lipcon | Todd Lipcon |
+| [HADOOP-7061](https://issues.apache.org/jira/browse/HADOOP-7061) | unprecise javadoc for CompressionCodec | Minor | io | Jingguo Yao | Jingguo Yao |
+| [MAPREDUCE-1831](https://issues.apache.org/jira/browse/MAPREDUCE-1831) | BlockPlacement policy for RAID | Major | contrib/raid | Scott Chen | Scott Chen |
+| [HADOOP-7059](https://issues.apache.org/jira/browse/HADOOP-7059) | Remove "unused" warning in native code | Major | native | Noah Watkins | Noah Watkins |
+| [HDFS-1476](https://issues.apache.org/jira/browse/HDFS-1476) | listCorruptFileBlocks should be functional while the name node is still in safe mode | Major | namenode | Patrick Kling | Patrick Kling |
+| [HDFS-1534](https://issues.apache.org/jira/browse/HDFS-1534) | Fix some incorrect logs in FSDirectory | Minor | namenode | Eli Collins | Eli Collins |
+| [HADOOP-7078](https://issues.apache.org/jira/browse/HADOOP-7078) | Add better javadocs for RawComparator interface | Trivial | . | Todd Lipcon | Harsh J |
+| [HDFS-1509](https://issues.apache.org/jira/browse/HDFS-1509) | Resync discarded directories in fs.name.dir during saveNamespace command | Major | namenode | dhruba borthakur | dhruba borthakur |
+| [MAPREDUCE-1906](https://issues.apache.org/jira/browse/MAPREDUCE-1906) | Lower default minimum heartbeat interval for tasktracker \> Jobtracker | Major | jobtracker, performance, tasktracker | Scott Carey | Todd Lipcon |
| [HADOOP-6578](https://issues.apache.org/jira/browse/HADOOP-6578) | Configuration should trim whitespace around a lot of value types | Minor | conf | Todd Lipcon | Michele Catasta |
+| [HDFS-1539](https://issues.apache.org/jira/browse/HDFS-1539) | prevent data loss when a cluster suffers a power loss | Major | datanode, hdfs-client, namenode | dhruba borthakur | dhruba borthakur |
+| [MAPREDUCE-2207](https://issues.apache.org/jira/browse/MAPREDUCE-2207) | Task-cleanup task should not be scheduled on the node that the task just failed | Major | jobtracker | Scott Chen | Liyin Liang |
+| [MAPREDUCE-2248](https://issues.apache.org/jira/browse/MAPREDUCE-2248) | DistributedRaidFileSystem should unraid only the corrupt block | Major | . | Ramkumar Vadali | Ramkumar Vadali |
+| [HDFS-1547](https://issues.apache.org/jira/browse/HDFS-1547) | Improve decommission mechanism | Major | namenode | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-1588](https://issues.apache.org/jira/browse/HDFS-1588) | Add dfs.hosts.exclude to DFSConfigKeys and use constant in stead of hardcoded string | Major | . | Erik Steffl | Erik Steffl |
+| [MAPREDUCE-2250](https://issues.apache.org/jira/browse/MAPREDUCE-2250) | Fix logging in raid code. | Trivial | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
+| [HDFS-1335](https://issues.apache.org/jira/browse/HDFS-1335) | HDFS side of HADOOP-6904: first step towards inter-version communications between dfs client and NameNode | Major | hdfs-client, namenode | Hairong Kuang | Hairong Kuang |
+| [MAPREDUCE-2263](https://issues.apache.org/jira/browse/MAPREDUCE-2263) | MapReduce side of HADOOP-6904 | Major | . | Hairong Kuang | Hairong Kuang |
| [HADOOP-6436](https://issues.apache.org/jira/browse/HADOOP-6436) | Remove auto-generated native build files | Major | . | Eli Collins | Roman Shaposhnik |
-| [HADOOP-6376](https://issues.apache.org/jira/browse/HADOOP-6376) | slaves file to have a header specifying the format of conf/slaves file | Minor | conf | Karthik K | Karthik K |
-| [HADOOP-1886](https://issues.apache.org/jira/browse/HADOOP-1886) | Undocumented parameters in FilesSystem | Trivial | fs | Konstantin Shvachko | Frank Conrad |
-| [HDFS-2521](https://issues.apache.org/jira/browse/HDFS-2521) | Remove custom checksum headers from data transfer protocol | Major | datanode, hdfs-client | Todd Lipcon | Todd Lipcon |
-| [HDFS-2512](https://issues.apache.org/jira/browse/HDFS-2512) | Add textual error message to data transfer protocol responses | Major | datanode, hdfs-client | Todd Lipcon | Todd Lipcon |
-| [HDFS-2507](https://issues.apache.org/jira/browse/HDFS-2507) | HA: Allow saveNamespace operations to be canceled | Major | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2500](https://issues.apache.org/jira/browse/HDFS-2500) | Avoid file system operations in BPOfferService thread while processing deletes | Major | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2485](https://issues.apache.org/jira/browse/HDFS-2485) | Improve code layout and constants in UnderReplicatedBlocks | Trivial | datanode | Steve Loughran | Steve Loughran |
-| [HDFS-2465](https://issues.apache.org/jira/browse/HDFS-2465) | Add HDFS support for fadvise readahead and drop-behind | Major | datanode, performance | Todd Lipcon | Todd Lipcon |
-| [HDFS-2401](https://issues.apache.org/jira/browse/HDFS-2401) | Running a set of methods in a Single Test Class | Major | build | Jonathan Eagles | Jonathan Eagles |
-| [HDFS-2371](https://issues.apache.org/jira/browse/HDFS-2371) | Refactor BlockSender.java for better readability | Major | datanode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-2355](https://issues.apache.org/jira/browse/HDFS-2355) | Federation: enable using the same configuration file across all the nodes in the cluster. | Major | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-2294](https://issues.apache.org/jira/browse/HDFS-2294) | Download of commons-daemon TAR should not be under target | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HDFS-2286](https://issues.apache.org/jira/browse/HDFS-2286) | DataXceiverServer logs AsynchronousCloseException at shutdown | Trivial | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2273](https://issues.apache.org/jira/browse/HDFS-2273) | Refactor BlockManager.recentInvalidateSets to a new class | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2260](https://issues.apache.org/jira/browse/HDFS-2260) | Refactor BlockReader into an interface and implementation | Major | hdfs-client | Todd Lipcon | Todd Lipcon |
-| [HDFS-2241](https://issues.apache.org/jira/browse/HDFS-2241) | Remove implementing FSConstants interface just to access the constants defined in the interface | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-2238](https://issues.apache.org/jira/browse/HDFS-2238) | NamenodeFsck.toString() uses StringBuilder with + operator | Minor | namenode | Tsz Wo Nicholas Sze | Uma Maheswara Rao G |
-| [HDFS-2230](https://issues.apache.org/jira/browse/HDFS-2230) | hdfs it not resolving the latest common test jars published post common mavenization | Major | build | Giridharan Kesavan | Giridharan Kesavan |
-| [HDFS-2227](https://issues.apache.org/jira/browse/HDFS-2227) | HDFS-2018 Part 2 : getRemoteEditLogManifest should pull it's information from FileJournalManager | Major | . | Ivan Kelly | Ivan Kelly |
-| [HDFS-2226](https://issues.apache.org/jira/browse/HDFS-2226) | Clean up counting of operations in FSEditLogLoader | Trivial | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2225](https://issues.apache.org/jira/browse/HDFS-2225) | HDFS-2018 Part 1 : Refactor file management so its not in classes which should be generic | Major | . | Ivan Kelly | Ivan Kelly |
-| [HDFS-2212](https://issues.apache.org/jira/browse/HDFS-2212) | Refactor double-buffering code out of EditLogOutputStreams | Major | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2209](https://issues.apache.org/jira/browse/HDFS-2209) | Make MiniDFS easier to embed in other apps | Minor | test | Steve Loughran | Steve Loughran |
-| [HDFS-2205](https://issues.apache.org/jira/browse/HDFS-2205) | Log message for failed connection to datanode is not followed by a success message. | Major | hdfs-client | Ravi Prakash | Ravi Prakash |
-| [HDFS-2198](https://issues.apache.org/jira/browse/HDFS-2198) | Remove hardcoded configuration keys | Minor | datanode, hdfs-client, namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-2197](https://issues.apache.org/jira/browse/HDFS-2197) | Refactor RPC call implementations out of NameNode class | Major | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2187](https://issues.apache.org/jira/browse/HDFS-2187) | HDFS-1580: Make EditLogInputStream act like an iterator over FSEditLogOps | Major | . | Ivan Kelly | Ivan Kelly |
-| [HDFS-2180](https://issues.apache.org/jira/browse/HDFS-2180) | Refactor NameNode HTTP server into new class | Major | . | Todd Lipcon | Todd Lipcon |
-| [HDFS-2161](https://issues.apache.org/jira/browse/HDFS-2161) | Move utilities to DFSUtil | Minor | balancer & mover, datanode, hdfs-client, namenode, security | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-2157](https://issues.apache.org/jira/browse/HDFS-2157) | Improve header comment in o.a.h.hdfs.server.namenode.NameNode | Major | documentation, namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-2144](https://issues.apache.org/jira/browse/HDFS-2144) | If SNN shuts down during initialization it does not log the cause | Major | namenode | Ravi Prakash | Ravi Prakash |
-| [HDFS-2143](https://issues.apache.org/jira/browse/HDFS-2143) | Federation: we should link to the live nodes and dead nodes to cluster web console | Major | . | Ravi Prakash | Ravi Prakash |
-| [HDFS-2118](https://issues.apache.org/jira/browse/HDFS-2118) | Couple dfs data dir improvements | Minor | datanode | Eli Collins | Eli Collins |
-| [HDFS-2116](https://issues.apache.org/jira/browse/HDFS-2116) | Cleanup TestStreamFile and TestByteRangeInputStream | Minor | test | Eli Collins | Plamen Jeliazkov |
-| [HDFS-2110](https://issues.apache.org/jira/browse/HDFS-2110) | Some StreamFile and ByteRangeInputStream cleanup | Minor | namenode | Eli Collins | Eli Collins |
-| [HDFS-2073](https://issues.apache.org/jira/browse/HDFS-2073) | Namenode is missing @Override annotations | Minor | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-2056](https://issues.apache.org/jira/browse/HDFS-2056) | Update fetchdt usage | Minor | documentation, tools | Tanping Wang | Tanping Wang |
-| [HDFS-2054](https://issues.apache.org/jira/browse/HDFS-2054) | BlockSender.sendChunk() prints ERROR for connection closures encountered during transferToFully() | Minor | datanode | Kihwal Lee | Kihwal Lee |
-| [HDFS-2046](https://issues.apache.org/jira/browse/HDFS-2046) | Force entropy to come from non-true random for tests | Major | build, test | Todd Lipcon | Todd Lipcon |
-| [HDFS-2040](https://issues.apache.org/jira/browse/HDFS-2040) | Only build libhdfs if a flag is passed | Minor | . | Eli Collins | Eli Collins |
-| [HDFS-2029](https://issues.apache.org/jira/browse/HDFS-2029) | Improve TestWriteRead | Trivial | test | Tsz Wo Nicholas Sze | John George |
-| [HDFS-2024](https://issues.apache.org/jira/browse/HDFS-2024) | Eclipse format HDFS Junit test hdfs/TestWriteRead.java | Trivial | test | CW Chung | CW Chung |
-| [HDFS-2003](https://issues.apache.org/jira/browse/HDFS-2003) | Separate FSEditLog reading logic from editLog memory state building logic | Major | . | Ivan Kelly | Ivan Kelly |
-| [HDFS-1996](https://issues.apache.org/jira/browse/HDFS-1996) | ivy: hdfs test jar should be independent to common test jar | Major | build | Tsz Wo Nicholas Sze | Eric Yang |
-| [HDFS-1995](https://issues.apache.org/jira/browse/HDFS-1995) | Minor modification to both dfsclusterhealth and dfshealth pages for Web UI | Minor | . | Tanping Wang | Tanping Wang |
-| [HDFS-1959](https://issues.apache.org/jira/browse/HDFS-1959) | Better error message for missing namenode directory | Minor | . | Eli Collins | Eli Collins |
-| [HDFS-1958](https://issues.apache.org/jira/browse/HDFS-1958) | Format confirmation prompt should be more lenient of its input | Major | namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-1939](https://issues.apache.org/jira/browse/HDFS-1939) | ivy: test conf should not extend common conf | Major | build | Tsz Wo Nicholas Sze | Eric Yang |
-| [HDFS-1937](https://issues.apache.org/jira/browse/HDFS-1937) | Umbrella JIRA for improving DataTransferProtocol | Major | datanode, hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1906](https://issues.apache.org/jira/browse/HDFS-1906) | Remove logging exception stack trace when one of the datanode targets to read from is not reachable | Minor | hdfs-client | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-1899](https://issues.apache.org/jira/browse/HDFS-1899) | GenericTestUtils.formatNamenode is misplaced | Major | . | Todd Lipcon | Ted Yu |
-| [HDFS-1890](https://issues.apache.org/jira/browse/HDFS-1890) | A few improvements on the LeaseRenewer.pendingCreates map | Minor | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1870](https://issues.apache.org/jira/browse/HDFS-1870) | Refactor DFSClient.LeaseChecker | Minor | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1865](https://issues.apache.org/jira/browse/HDFS-1865) | Share LeaseChecker thread among DFSClients | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1861](https://issues.apache.org/jira/browse/HDFS-1861) | Rename dfs.datanode.max.xcievers and bump its default value | Major | datanode | Eli Collins | Eli Collins |
-| [HDFS-1846](https://issues.apache.org/jira/browse/HDFS-1846) | Don't fill preallocated portion of edits log with 0x00 | Major | namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-1843](https://issues.apache.org/jira/browse/HDFS-1843) | Discover file not found early for file append | Minor | . | Bharath Mundlapudi | Bharath Mundlapudi |
-| [HDFS-1840](https://issues.apache.org/jira/browse/HDFS-1840) | Terminate LeaseChecker when all writing files are closed. | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1833](https://issues.apache.org/jira/browse/HDFS-1833) | Refactor BlockReceiver | Minor | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1831](https://issues.apache.org/jira/browse/HDFS-1831) | HDFS equivalent of HADOOP-7223 changes to handle FileContext createFlag combinations | Major | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-1817](https://issues.apache.org/jira/browse/HDFS-1817) | Split TestFiDataTransferProtocol.java into two files | Trivial | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1789](https://issues.apache.org/jira/browse/HDFS-1789) | Refactor frequently used codes from DFSOutputStream, BlockReceiver and DataXceiver | Minor | datanode, hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1785](https://issues.apache.org/jira/browse/HDFS-1785) | Cleanup BlockReceiver and DataXceiver | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1774](https://issues.apache.org/jira/browse/HDFS-1774) | Small optimization to FSDataset | Minor | datanode | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HDFS-1773](https://issues.apache.org/jira/browse/HDFS-1773) | Remove a datanode from cluster if include list is not empty and this datanode is removed from both include and exclude lists | Minor | namenode | Tanping Wang | Tanping Wang |
-| [HDFS-1763](https://issues.apache.org/jira/browse/HDFS-1763) | Replace hard-coded option strings with variables from DFSConfigKeys | Minor | . | Eli Collins | Eli Collins |
-| [HDFS-1757](https://issues.apache.org/jira/browse/HDFS-1757) | Don't compile fuse-dfs by default | Major | fuse-dfs | Eli Collins | Eli Collins |
-| [HDFS-1741](https://issues.apache.org/jira/browse/HDFS-1741) | Provide a minimal pom file to allow integration of HDFS into Sonar analysis | Major | build | Konstantin Boudnik | Konstantin Boudnik |
-| [HDFS-1739](https://issues.apache.org/jira/browse/HDFS-1739) | When DataNode throws DiskOutOfSpaceException, it will be helpfull to the user if we log the available volume size and configured block size. | Minor | datanode | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HDFS-1731](https://issues.apache.org/jira/browse/HDFS-1731) | Allow using a file to exclude certain tests from build | Minor | . | Todd Lipcon | Todd Lipcon |
-| [HDFS-1636](https://issues.apache.org/jira/browse/HDFS-1636) | If dfs.name.dir points to an empty dir, namenode format shouldn't require confirmation | Minor | namenode | Todd Lipcon | Harsh J |
-| [HDFS-1630](https://issues.apache.org/jira/browse/HDFS-1630) | Checksum fsedits | Major | namenode | Hairong Kuang | Hairong Kuang |
+| [MAPREDUCE-2260](https://issues.apache.org/jira/browse/MAPREDUCE-2260) | Remove auto-generated native build files | Major | build | Roman Shaposhnik | Roman Shaposhnik |
+| [HDFS-1582](https://issues.apache.org/jira/browse/HDFS-1582) | Remove auto-generated native build files | Major | libhdfs | Roman Shaposhnik | Roman Shaposhnik |
+| [MAPREDUCE-2026](https://issues.apache.org/jira/browse/MAPREDUCE-2026) | JobTracker.getJobCounters() should not hold JobTracker lock while calling JobInProgress.getCounters() | Major | . | Scott Chen | Joydeep Sen Sarma |
+| [MAPREDUCE-1706](https://issues.apache.org/jira/browse/MAPREDUCE-1706) | Log RAID recoveries on HDFS | Major | contrib/raid | Rodrigo Schmidt | Scott Chen |
+| [HDFS-1601](https://issues.apache.org/jira/browse/HDFS-1601) | Pipeline ACKs are sent as lots of tiny TCP packets | Major | datanode | Todd Lipcon | Todd Lipcon |
+| [HADOOP-7096](https://issues.apache.org/jira/browse/HADOOP-7096) | Allow setting of end-of-record delimiter for TextInputFormat | Major | . | Ahmed Radwan | Ahmed Radwan |
+| [HDFS-560](https://issues.apache.org/jira/browse/HDFS-560) | Proposed enhancements/tuning to hadoop-hdfs/build.xml | Minor | build | Steve Loughran | Steve Loughran |
+| [HADOOP-7048](https://issues.apache.org/jira/browse/HADOOP-7048) | Wrong description of Block-Compressed SequenceFile Format in SequenceFile's javadoc | Minor | io | Jingguo Yao | Jingguo Yao |
| [HDFS-1628](https://issues.apache.org/jira/browse/HDFS-1628) | AccessControlException should display the full path | Minor | namenode | Ramya Sunil | John George |
+| [HADOOP-6376](https://issues.apache.org/jira/browse/HADOOP-6376) | slaves file to have a header specifying the format of conf/slaves file | Minor | conf | Karthik K | Karthik K |
+| [MAPREDUCE-2254](https://issues.apache.org/jira/browse/MAPREDUCE-2254) | Allow setting of end-of-record delimiter for TextInputFormat | Major | . | Ahmed Radwan | Ahmed Radwan |
+| [MAPREDUCE-2203](https://issues.apache.org/jira/browse/MAPREDUCE-2203) | Wong javadoc for TaskRunner's appendJobJarClasspaths method | Trivial | . | Jingguo Yao | Jingguo Yao |
+| [MAPREDUCE-1159](https://issues.apache.org/jira/browse/MAPREDUCE-1159) | Limit Job name on jobtracker.jsp to be 80 char long | Trivial | . | Zheng Shao | Harsh J |
+| [HADOOP-7112](https://issues.apache.org/jira/browse/HADOOP-7112) | Issue a warning when GenericOptionsParser libjars are not on local filesystem | Major | conf, filecache | Tom White | Tom White |
+| [MAPREDUCE-2206](https://issues.apache.org/jira/browse/MAPREDUCE-2206) | The task-cleanup tasks should be optional | Major | jobtracker | Scott Chen | Scott Chen |
| [HDFS-1626](https://issues.apache.org/jira/browse/HDFS-1626) | Make BLOCK\_INVALIDATE\_LIMIT configurable | Minor | namenode | Arun C Murthy | Tsz Wo Nicholas Sze |
-| [HDFS-1620](https://issues.apache.org/jira/browse/HDFS-1620) | Rename HdfsConstants -\> HdfsServerConstants, FSConstants -\> HdfsConstants | Minor | . | Tsz Wo Nicholas Sze | Harsh J |
-| [HDFS-1601](https://issues.apache.org/jira/browse/HDFS-1601) | Pipeline ACKs are sent as lots of tiny TCP packets | Major | datanode | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-2225](https://issues.apache.org/jira/browse/MAPREDUCE-2225) | MultipleOutputs should not require the use of 'Writable' | Blocker | job submission | Harsh J | Harsh J |
+| [HADOOP-7114](https://issues.apache.org/jira/browse/HADOOP-7114) | FsShell should dump all exceptions at DEBUG level | Minor | fs | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-2302](https://issues.apache.org/jira/browse/MAPREDUCE-2302) | Add static factory methods in GaloisField | Major | contrib/raid | Scott Chen | Scott Chen |
+| [MAPREDUCE-2351](https://issues.apache.org/jira/browse/MAPREDUCE-2351) | mapred.job.tracker.history.completed.location should support an arbitrary filesystem URI | Major | . | Tom White | Tom White |
+| [MAPREDUCE-2239](https://issues.apache.org/jira/browse/MAPREDUCE-2239) | BlockPlacementPolicyRaid should call getBlockLocations only when necessary | Major | contrib/raid | Scott Chen | Scott Chen |
+| [HADOOP-7131](https://issues.apache.org/jira/browse/HADOOP-7131) | set() and toString Methods of the org.apache.hadoop.io.Text class does not include the root exception, in the wrapping RuntimeException. | Minor | io | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [HADOOP-7159](https://issues.apache.org/jira/browse/HADOOP-7159) | RPC server should log the client hostname when read exception happened | Trivial | ipc | Scott Chen | Scott Chen |
+| [HADOOP-7133](https://issues.apache.org/jira/browse/HADOOP-7133) | CLONE to COMMON - HDFS-1445 Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file | Major | util | Matt Foley | Matt Foley |
+| [HADOOP-7177](https://issues.apache.org/jira/browse/HADOOP-7177) | CodecPool should report which compressor it is using | Trivial | native | Allen Wittenauer | Allen Wittenauer |
+| [HADOOP-7167](https://issues.apache.org/jira/browse/HADOOP-7167) | Allow using a file to exclude certain tests from build | Minor | . | Todd Lipcon | Todd Lipcon |
+| [HDFS-1731](https://issues.apache.org/jira/browse/HDFS-1731) | Allow using a file to exclude certain tests from build | Minor | . | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-2367](https://issues.apache.org/jira/browse/MAPREDUCE-2367) | Allow using a file to exclude certain tests from build | Minor | . | Todd Lipcon | Todd Lipcon |
+| [HDFS-1757](https://issues.apache.org/jira/browse/HDFS-1757) | Don't compile fuse-dfs by default | Major | fuse-dfs | Eli Collins | Eli Collins |
| [HDFS-1596](https://issues.apache.org/jira/browse/HDFS-1596) | Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml | Major | documentation, namenode | Patrick Angeles | Harsh J |
-| [HDFS-1588](https://issues.apache.org/jira/browse/HDFS-1588) | Add dfs.hosts.exclude to DFSConfigKeys and use constant in stead of hardcoded string | Major | . | Erik Steffl | Erik Steffl |
+| [HADOOP-7117](https://issues.apache.org/jira/browse/HADOOP-7117) | Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml | Major | conf | Patrick Angeles | Harsh J |
+| [HADOOP-7180](https://issues.apache.org/jira/browse/HADOOP-7180) | Improve CommandFormat | Minor | fs | Daryn Sharp | Daryn Sharp |
+| [HDFS-1763](https://issues.apache.org/jira/browse/HDFS-1763) | Replace hard-coded option strings with variables from DFSConfigKeys | Minor | . | Eli Collins | Eli Collins |
| [HDFS-1583](https://issues.apache.org/jira/browse/HDFS-1583) | Improve backup-node sync performance by wrapping RPC parameters | Major | namenode | Liyin Liang | Liyin Liang |
-| [HDFS-1582](https://issues.apache.org/jira/browse/HDFS-1582) | Remove auto-generated native build files | Major | libhdfs | Roman Shaposhnik | Roman Shaposhnik |
-| [HDFS-1573](https://issues.apache.org/jira/browse/HDFS-1573) | LeaseChecker thread name trace not that useful | Trivial | hdfs-client | Todd Lipcon | Todd Lipcon |
-| [HDFS-1568](https://issues.apache.org/jira/browse/HDFS-1568) | Improve DataXceiver error logging | Minor | datanode | Todd Lipcon | Joey Echeverria |
-| [HDFS-1547](https://issues.apache.org/jira/browse/HDFS-1547) | Improve decommission mechanism | Major | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-1539](https://issues.apache.org/jira/browse/HDFS-1539) | prevent data loss when a cluster suffers a power loss | Major | datanode, hdfs-client, namenode | dhruba borthakur | dhruba borthakur |
-| [HDFS-1534](https://issues.apache.org/jira/browse/HDFS-1534) | Fix some incorrect logs in FSDirectory | Minor | namenode | Eli Collins | Eli Collins |
-| [HDFS-1518](https://issues.apache.org/jira/browse/HDFS-1518) | Wrong description in FSNamesystem's javadoc | Minor | namenode | Jingguo Yao | Jingguo Yao |
-| [HDFS-1513](https://issues.apache.org/jira/browse/HDFS-1513) | Fix a number of warnings | Minor | . | Eli Collins | Eli Collins |
-| [HDFS-1510](https://issues.apache.org/jira/browse/HDFS-1510) | Add test-patch.properties required by test-patch.sh | Minor | . | Nigel Daley | Nigel Daley |
-| [HDFS-1509](https://issues.apache.org/jira/browse/HDFS-1509) | Resync discarded directories in fs.name.dir during saveNamespace command | Major | namenode | dhruba borthakur | dhruba borthakur |
-| [HDFS-1506](https://issues.apache.org/jira/browse/HDFS-1506) | Refactor fsimage loading code | Major | namenode | Hairong Kuang | Hairong Kuang |
-| [HDFS-1486](https://issues.apache.org/jira/browse/HDFS-1486) | Generalize CLITest structure and interfaces to facilitate upstream adoption (e.g. for web testing) | Major | test | Konstantin Boudnik | Konstantin Boudnik |
-| [HDFS-1481](https://issues.apache.org/jira/browse/HDFS-1481) | NameNode should validate fsimage before rolling | Major | namenode | Hairong Kuang | Hairong Kuang |
-| [HDFS-1476](https://issues.apache.org/jira/browse/HDFS-1476) | listCorruptFileBlocks should be functional while the name node is still in safe mode | Major | namenode | Patrick Kling | Patrick Kling |
-| [HDFS-1458](https://issues.apache.org/jira/browse/HDFS-1458) | Improve checkpoint performance by avoiding unnecessary image downloads | Major | namenode | Hairong Kuang | Hairong Kuang |
-| [HDFS-1442](https://issues.apache.org/jira/browse/HDFS-1442) | Api to get delegation token in Hdfs | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HDFS-1378](https://issues.apache.org/jira/browse/HDFS-1378) | Edit log replay should track and report file offsets in case of errors | Major | namenode | Todd Lipcon | Colin Patrick McCabe |
-| [HDFS-1335](https://issues.apache.org/jira/browse/HDFS-1335) | HDFS side of HADOOP-6904: first step towards inter-version communications between dfs client and NameNode | Major | hdfs-client, namenode | Hairong Kuang | Hairong Kuang |
-| [HDFS-1332](https://issues.apache.org/jira/browse/HDFS-1332) | When unable to place replicas, BlockPlacementPolicy should log reasons nodes were excluded | Minor | namenode | Todd Lipcon | Ted Yu |
+| [HADOOP-7193](https://issues.apache.org/jira/browse/HADOOP-7193) | Help message is wrong for touchz command. | Minor | fs | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [MAPREDUCE-2403](https://issues.apache.org/jira/browse/MAPREDUCE-2403) | MR-279: Improve job history event handling in AM to log to HDFS | Major | mrv2 | Mahadev konar | Krishna Ramachandran |
+| [HDFS-1785](https://issues.apache.org/jira/browse/HDFS-1785) | Cleanup BlockReceiver and DataXceiver | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HDFS-1120](https://issues.apache.org/jira/browse/HDFS-1120) | Make DataNode's block-to-device placement policy pluggable | Major | datanode | Jeff Hammerbacher | Harsh J |
-| [HDFS-560](https://issues.apache.org/jira/browse/HDFS-560) | Proposed enhancements/tuning to hadoop-hdfs/build.xml | Minor | build | Steve Loughran | Steve Loughran |
-| [HDFS-420](https://issues.apache.org/jira/browse/HDFS-420) | Fuse-dfs should cache fs handles | Major | fuse-dfs | Dima Brodsky | Brian Bockelman |
-| [MAPREDUCE-3322](https://issues.apache.org/jira/browse/MAPREDUCE-3322) | Create a better index.html for maven docs | Major | documentation, mrv2 | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-3275](https://issues.apache.org/jira/browse/MAPREDUCE-3275) | Add docs for WebAppProxy | Critical | documentation, mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-3239](https://issues.apache.org/jira/browse/MAPREDUCE-3239) | Use new createSocketAddr API in MRv2 to give better error messages on misconfig | Minor | mrv2 | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-3237](https://issues.apache.org/jira/browse/MAPREDUCE-3237) | Move LocalJobRunner to hadoop-mapreduce-client-core module | Major | client | Tom White | Tom White |
-| [MAPREDUCE-3190](https://issues.apache.org/jira/browse/MAPREDUCE-3190) | bin/yarn should barf early if HADOOP\_COMMON\_HOME or HADOOP\_HDFS\_HOME are not set | Major | mrv2 | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-3189](https://issues.apache.org/jira/browse/MAPREDUCE-3189) | Add link decoration back to MR2's CSS | Major | mrv2 | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-3187](https://issues.apache.org/jira/browse/MAPREDUCE-3187) | Add names for various unnamed threads in MR2 | Minor | mrv2 | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-3171](https://issues.apache.org/jira/browse/MAPREDUCE-3171) | normalize nodemanager native code compilation with common/hdfs native | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-3162](https://issues.apache.org/jira/browse/MAPREDUCE-3162) | Separate application-init and container-init event types in NM's ApplicationImpl FSM | Minor | mrv2, nodemanager | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-3161](https://issues.apache.org/jira/browse/MAPREDUCE-3161) | Improve javadoc and fix some typos in MR2 code | Minor | mrv2 | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-3154](https://issues.apache.org/jira/browse/MAPREDUCE-3154) | Validate the Jobs Output Specification as the first statement in JobSubmitter.submitJobInternal(Job, Cluster) method | Major | client, mrv2 | Abhijit Suresh Shingate | Abhijit Suresh Shingate |
-| [MAPREDUCE-3133](https://issues.apache.org/jira/browse/MAPREDUCE-3133) | Running a set of methods in a Single Test Class | Major | build | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-3113](https://issues.apache.org/jira/browse/MAPREDUCE-3113) | the scripts yarn-daemon.sh and yarn are not working properly | Minor | mrv2 | XieXianshan | XieXianshan |
-| [MAPREDUCE-3090](https://issues.apache.org/jira/browse/MAPREDUCE-3090) | Change MR AM to use ApplicationAttemptId rather than \<applicationId, startCount\> everywhere | Major | applicationmaster, mrv2 | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-3014](https://issues.apache.org/jira/browse/MAPREDUCE-3014) | Rename and invert logic of '-cbuild' profile to 'native' and off by default | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-3001](https://issues.apache.org/jira/browse/MAPREDUCE-3001) | Map Reduce JobHistory and AppMaster UI should have ability to display task specific counters. | Blocker | jobhistoryserver, mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-2990](https://issues.apache.org/jira/browse/MAPREDUCE-2990) | Health Report on Resource Manager UI is null if the NM's are all healthy. | Blocker | mrv2 | Mahadev konar | Subroto Sanyal |
-| [MAPREDUCE-2966](https://issues.apache.org/jira/browse/MAPREDUCE-2966) | Add ShutDown hooks for MRV2 processes | Major | applicationmaster, jobhistoryserver, nodemanager, resourcemanager | Abhijit Suresh Shingate | Abhijit Suresh Shingate |
-| [MAPREDUCE-2961](https://issues.apache.org/jira/browse/MAPREDUCE-2961) | Increase the default threadpool size for container launching in the application master. | Blocker | mrv2 | Mahadev konar | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-2930](https://issues.apache.org/jira/browse/MAPREDUCE-2930) | Generate state graph from the State Machine Definition | Major | mrv2 | Sharad Agarwal | Binglin Chang |
-| [MAPREDUCE-2894](https://issues.apache.org/jira/browse/MAPREDUCE-2894) | Improvements to YARN apis | Blocker | mrv2 | Arun C Murthy | |
-| [MAPREDUCE-2893](https://issues.apache.org/jira/browse/MAPREDUCE-2893) | Removing duplicate service provider in hadoop-mapreduce-client-jobclient | Trivial | client | Liang-Chi Hsieh | Liang-Chi Hsieh |
-| [MAPREDUCE-2890](https://issues.apache.org/jira/browse/MAPREDUCE-2890) | Documentation for MRv2 | Blocker | documentation, mrv2 | Arun C Murthy | |
-| [MAPREDUCE-2880](https://issues.apache.org/jira/browse/MAPREDUCE-2880) | Fix classpath construction for MRv2 | Blocker | mrv2 | Luke Lu | Arun C Murthy |
-| [MAPREDUCE-2864](https://issues.apache.org/jira/browse/MAPREDUCE-2864) | Renaming of configuration property names in yarn | Major | jobhistoryserver, mrv2, nodemanager, resourcemanager | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-2848](https://issues.apache.org/jira/browse/MAPREDUCE-2848) | Upgrade avro to 1.5.2 | Major | . | Luke Lu | Luke Lu |
-| [MAPREDUCE-2805](https://issues.apache.org/jira/browse/MAPREDUCE-2805) | Update RAID for HDFS-2241 | Minor | contrib/raid | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [MAPREDUCE-2802](https://issues.apache.org/jira/browse/MAPREDUCE-2802) | [MR-279] Jobhistory filenames should have jobID to help in better parsing | Critical | mrv2 | Ramya Sunil | Jonathan Eagles |
-| [MAPREDUCE-2726](https://issues.apache.org/jira/browse/MAPREDUCE-2726) | MR-279: Add the jobFile to the web UI | Blocker | mrv2 | Jeffrey Naisbitt | Jeffrey Naisbitt |
-| [MAPREDUCE-2707](https://issues.apache.org/jira/browse/MAPREDUCE-2707) | ProtoOverHadoopRpcEngine without using TunnelProtocol over WritableRpc | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [MAPREDUCE-2701](https://issues.apache.org/jira/browse/MAPREDUCE-2701) | MR-279: app/Job.java needs UGI for the user that launched it | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-2691](https://issues.apache.org/jira/browse/MAPREDUCE-2691) | Finish up the cleanup of distributed cache file resources and related tests. | Major | mrv2 | Amol Kekre | Siddharth Seth |
-| [MAPREDUCE-2682](https://issues.apache.org/jira/browse/MAPREDUCE-2682) | Add a -classpath option to bin/mapred | Trivial | . | Arun C Murthy | Vinod Kumar Vavilapalli |
-| [MAPREDUCE-2680](https://issues.apache.org/jira/browse/MAPREDUCE-2680) | Enhance job-client cli to show queue information for running jobs | Minor | . | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-2679](https://issues.apache.org/jira/browse/MAPREDUCE-2679) | MR-279: Merge MR-279 related minor patches into trunk | Trivial | . | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-2676](https://issues.apache.org/jira/browse/MAPREDUCE-2676) | MR-279: JobHistory Job page needs reformatted | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-2675](https://issues.apache.org/jira/browse/MAPREDUCE-2675) | MR-279: JobHistory Server main page needs to be reformatted | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-2672](https://issues.apache.org/jira/browse/MAPREDUCE-2672) | MR-279: JobHistory Server needs Analysis this job | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-2664](https://issues.apache.org/jira/browse/MAPREDUCE-2664) | MR 279: Implement JobCounters for MRv2 + Fix for Map Data Locality | Major | mrv2 | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-2629](https://issues.apache.org/jira/browse/MAPREDUCE-2629) | Class loading quirk prevents inner class method compilation | Minor | task | Eric Caspole | Eric Caspole |
-| [MAPREDUCE-2624](https://issues.apache.org/jira/browse/MAPREDUCE-2624) | Update RAID for HDFS-2107 | Major | contrib/raid | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [MAPREDUCE-2623](https://issues.apache.org/jira/browse/MAPREDUCE-2623) | Update ClusterMapReduceTestCase to use MiniDFSCluster.Builder | Minor | test | Jim Plush | Harsh J |
-| [MAPREDUCE-2611](https://issues.apache.org/jira/browse/MAPREDUCE-2611) | MR 279: Metrics, finishTimes, etc in JobHistory | Major | mrv2 | Siddharth Seth | |
-| [MAPREDUCE-2602](https://issues.apache.org/jira/browse/MAPREDUCE-2602) | Allow setting of end-of-record delimiter for TextInputFormat (for the old API) | Major | . | Ahmed Radwan | Ahmed Radwan |
-| [MAPREDUCE-2596](https://issues.apache.org/jira/browse/MAPREDUCE-2596) | Gridmix should notify job failures | Major | benchmarks, contrib/gridmix | Arun C Murthy | Amar Kamat |
-| [MAPREDUCE-2580](https://issues.apache.org/jira/browse/MAPREDUCE-2580) | MR 279: RM UI should redirect finished jobs to History UI | Minor | mrv2 | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-2551](https://issues.apache.org/jira/browse/MAPREDUCE-2551) | MR 279: Implement JobSummaryLog | Major | mrv2 | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-2501](https://issues.apache.org/jira/browse/MAPREDUCE-2501) | MR-279: Attach sources in builds | Major | mrv2 | Luke Lu | Luke Lu |
-| [MAPREDUCE-2495](https://issues.apache.org/jira/browse/MAPREDUCE-2495) | The distributed cache cleanup thread has no monitoring to check to see if it has died for some reason | Minor | distributed-cache | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-2494](https://issues.apache.org/jira/browse/MAPREDUCE-2494) | Make the distributed cache delete entires using LRU priority | Major | distributed-cache | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-2492](https://issues.apache.org/jira/browse/MAPREDUCE-2492) | [MAPREDUCE] The new MapReduce API should make available task's progress to the task | Major | task | Amar Kamat | Amar Kamat |
-| [MAPREDUCE-2490](https://issues.apache.org/jira/browse/MAPREDUCE-2490) | Log blacklist debug count | Trivial | jobtracker | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-2478](https://issues.apache.org/jira/browse/MAPREDUCE-2478) | MR 279: Improve history server | Major | mrv2 | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-2474](https://issues.apache.org/jira/browse/MAPREDUCE-2474) | Add docs to the new API Partitioner on how to access Job Configuration data | Minor | documentation | Harsh J | Harsh J |
-| [MAPREDUCE-2469](https://issues.apache.org/jira/browse/MAPREDUCE-2469) | Task counters should also report the total heap usage of the task | Major | task | Amar Kamat | Amar Kamat |
-| [MAPREDUCE-2462](https://issues.apache.org/jira/browse/MAPREDUCE-2462) | MR 279: Write job conf along with JobHistory, other minor improvements | Minor | mrv2 | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-2459](https://issues.apache.org/jira/browse/MAPREDUCE-2459) | Cache HAR filesystem metadata | Major | harchive | Mac Yang | Mac Yang |
-| [MAPREDUCE-2456](https://issues.apache.org/jira/browse/MAPREDUCE-2456) | Show the reducer taskid and map/reduce tasktrackers for "Failed fetch notification #\_ for task attempt..." log messages | Trivial | jobtracker | Jeffrey Naisbitt | Jeffrey Naisbitt |
-| [MAPREDUCE-2449](https://issues.apache.org/jira/browse/MAPREDUCE-2449) | Allow for command line arguments when performing "Run on Hadoop" action. | Minor | contrib/eclipse-plugin | Jeff Zemerick | Jeff Zemerick |
-| [MAPREDUCE-2432](https://issues.apache.org/jira/browse/MAPREDUCE-2432) | MR-279: Install sanitized poms for downstream sanity | Major | mrv2 | Luke Lu | Luke Lu |
-| [MAPREDUCE-2424](https://issues.apache.org/jira/browse/MAPREDUCE-2424) | MR-279: counters/UI/etc. for uber-AppMaster (in-cluster LocalJobRunner for MRv2) | Major | mrv2 | Greg Roelofs | Greg Roelofs |
+| [HDFS-1789](https://issues.apache.org/jira/browse/HDFS-1789) | Refactor frequently used codes from DFSOutputStream, BlockReceiver and DataXceiver | Minor | datanode, hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [MAPREDUCE-2414](https://issues.apache.org/jira/browse/MAPREDUCE-2414) | MR-279: Use generic interfaces for protocols | Major | mrv2 | Arun C Murthy | Siddharth Seth |
+| [HADOOP-7202](https://issues.apache.org/jira/browse/HADOOP-7202) | Improve Command base class | Major | . | Daryn Sharp | Daryn Sharp |
| [MAPREDUCE-2405](https://issues.apache.org/jira/browse/MAPREDUCE-2405) | MR-279: Implement uber-AppMaster (in-cluster LocalJobRunner for MRv2) | Major | mrv2 | Mahadev konar | Greg Roelofs |
-| [MAPREDUCE-2403](https://issues.apache.org/jira/browse/MAPREDUCE-2403) | MR-279: Improve job history event handling in AM to log to HDFS | Major | mrv2 | Mahadev konar | Krishna Ramachandran |
-| [MAPREDUCE-2399](https://issues.apache.org/jira/browse/MAPREDUCE-2399) | The embedded web framework for MAPREDUCE-279 | Major | . | Arun C Murthy | Luke Lu |
-| [MAPREDUCE-2381](https://issues.apache.org/jira/browse/MAPREDUCE-2381) | JobTracker instrumentation not consistent about error handling | Major | . | Philip Zeyliger | Philip Zeyliger |
-| [MAPREDUCE-2367](https://issues.apache.org/jira/browse/MAPREDUCE-2367) | Allow using a file to exclude certain tests from build | Minor | . | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-2351](https://issues.apache.org/jira/browse/MAPREDUCE-2351) | mapred.job.tracker.history.completed.location should support an arbitrary filesystem URI | Major | . | Tom White | Tom White |
-| [MAPREDUCE-2326](https://issues.apache.org/jira/browse/MAPREDUCE-2326) | Port gridmix changes from hadoop-0.20.100 to trunk | Major | . | Arun C Murthy | |
-| [MAPREDUCE-2302](https://issues.apache.org/jira/browse/MAPREDUCE-2302) | Add static factory methods in GaloisField | Major | contrib/raid | Scott Chen | Scott Chen |
-| [MAPREDUCE-2263](https://issues.apache.org/jira/browse/MAPREDUCE-2263) | MapReduce side of HADOOP-6904 | Major | . | Hairong Kuang | Hairong Kuang |
-| [MAPREDUCE-2260](https://issues.apache.org/jira/browse/MAPREDUCE-2260) | Remove auto-generated native build files | Major | build | Roman Shaposhnik | Roman Shaposhnik |
-| [MAPREDUCE-2254](https://issues.apache.org/jira/browse/MAPREDUCE-2254) | Allow setting of end-of-record delimiter for TextInputFormat | Major | . | Ahmed Radwan | Ahmed Radwan |
-| [MAPREDUCE-2250](https://issues.apache.org/jira/browse/MAPREDUCE-2250) | Fix logging in raid code. | Trivial | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
-| [MAPREDUCE-2249](https://issues.apache.org/jira/browse/MAPREDUCE-2249) | Better to check the reflexive property of the object while overriding equals method of it | Major | . | Bhallamudi Venkata Siva Kamesh | Devaraj K |
-| [MAPREDUCE-2248](https://issues.apache.org/jira/browse/MAPREDUCE-2248) | DistributedRaidFileSystem should unraid only the corrupt block | Major | . | Ramkumar Vadali | Ramkumar Vadali |
-| [MAPREDUCE-2243](https://issues.apache.org/jira/browse/MAPREDUCE-2243) | Close all the file streams propely in a finally block to avoid their leakage. | Minor | jobtracker, tasktracker | Bhallamudi Venkata Siva Kamesh | Devaraj K |
-| [MAPREDUCE-2239](https://issues.apache.org/jira/browse/MAPREDUCE-2239) | BlockPlacementPolicyRaid should call getBlockLocations only when necessary | Major | contrib/raid | Scott Chen | Scott Chen |
-| [MAPREDUCE-2225](https://issues.apache.org/jira/browse/MAPREDUCE-2225) | MultipleOutputs should not require the use of 'Writable' | Blocker | job submission | Harsh J | Harsh J |
-| [MAPREDUCE-2207](https://issues.apache.org/jira/browse/MAPREDUCE-2207) | Task-cleanup task should not be scheduled on the node that the task just failed | Major | jobtracker | Scott Chen | Liyin Liang |
-| [MAPREDUCE-2206](https://issues.apache.org/jira/browse/MAPREDUCE-2206) | The task-cleanup tasks should be optional | Major | jobtracker | Scott Chen | Scott Chen |
-| [MAPREDUCE-2203](https://issues.apache.org/jira/browse/MAPREDUCE-2203) | Wong javadoc for TaskRunner's appendJobJarClasspaths method | Trivial | . | Jingguo Yao | Jingguo Yao |
+| [HDFS-1817](https://issues.apache.org/jira/browse/HDFS-1817) | Split TestFiDataTransferProtocol.java into two files | Trivial | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-1630](https://issues.apache.org/jira/browse/HDFS-1630) | Checksum fsedits | Major | namenode | Hairong Kuang | Hairong Kuang |
+| [HADOOP-6994](https://issues.apache.org/jira/browse/HADOOP-6994) | Api to get delegation token in AbstractFileSystem | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HDFS-1442](https://issues.apache.org/jira/browse/HDFS-1442) | Api to get delegation token in Hdfs | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [MAPREDUCE-2432](https://issues.apache.org/jira/browse/MAPREDUCE-2432) | MR-279: Instal
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[11/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.3-alpha/RELEASENOTES.2.0.3-alpha.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.3-alpha/RELEASENOTES.2.0.3-alpha.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.3-alpha/RELEASENOTES.2.0.3-alpha.md
index f924b91..e22f889 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.3-alpha/RELEASENOTES.2.0.3-alpha.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.3-alpha/RELEASENOTES.2.0.3-alpha.md
@@ -23,44 +23,42 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-9147](https://issues.apache.org/jira/browse/HADOOP-9147) | *Trivial* | **Add missing fields to FIleStatus.toString**
+* [HDFS-3703](https://issues.apache.org/jira/browse/HDFS-3703) | *Major* | **Decrease the datanode failure detection time**
-Update FileStatus.toString to include missing fields
+This jira adds a new DataNode state called "stale" at the NameNode. DataNodes are marked as stale if it does not send heartbeat message to NameNode within the timeout configured using the configuration parameter "dfs.namenode.stale.datanode.interval" in seconds (default value is 30 seconds). NameNode picks a stale datanode as the last target to read from when returning block locations for reads.
+
+This feature is by default turned \* off \*. To turn on the feature, set the HDFS configuration "dfs.namenode.check.stale.datanode" to true.
---
-* [HADOOP-9119](https://issues.apache.org/jira/browse/HADOOP-9119) | *Minor* | **Add test to FileSystemContractBaseTest to verify integrity of overwritten files**
+* [MAPREDUCE-4123](https://issues.apache.org/jira/browse/MAPREDUCE-4123) | *Critical* | **./mapred groups gives NoClassDefFoundError**
-Patches adds more tests to verify overwritten and more complex operations -write-delete-overwrite. By using differently sized datasets and different data inside, these tests verify that the overwrite really did take place. While HDFS meets all these requirements directly, eventually consistent object stores may not -hence these tests.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-9118](https://issues.apache.org/jira/browse/HADOOP-9118) | *Trivial* | **FileSystemContractBaseTest test data for read/write isn't rigorous enough**
+* [MAPREDUCE-3678](https://issues.apache.org/jira/browse/MAPREDUCE-3678) | *Major* | **The Map tasks logs should have the value of input split it processed**
-Resolved as part of HADOOP-9119 -it's test data generator creates more bits in every test byte
+A map-task's syslogs now carries basic info on the InputSplit it processed.
---
-* [HADOOP-9106](https://issues.apache.org/jira/browse/HADOOP-9106) | *Major* | **Allow configuration of IPC connect timeout**
-
-This jira introduces a new configuration parameter "ipc.client.connect.timeout". This configuration defines the Hadoop RPC connection timeout in milliseconds for a client to connect to a server. For details see the description associated with this configuration in core-default.xml.
+* [HDFS-4059](https://issues.apache.org/jira/browse/HDFS-4059) | *Minor* | **Add number of stale DataNodes to metrics**
+This jira adds a new metric with name "StaleDataNodes" under metrics context "dfs" of type Gauge. This tracks the number of DataNodes marked as stale. A DataNode is marked stale when the heartbeat message from the DataNode is not received within the configured time ""dfs.namenode.stale.datanode.interval".
----
-* [HADOOP-9070](https://issues.apache.org/jira/browse/HADOOP-9070) | *Blocker* | **Kerberos SASL server cannot find kerberos key**
-
-**WARNING: No release note provided for this incompatible change.**
+Please see hdfs-default.xml documentation corresponding to ""dfs.namenode.stale.datanode.interval" for more details on how to configure this feature. When this feature is not configured, this metrics would return zero.
---
-* [HADOOP-8999](https://issues.apache.org/jira/browse/HADOOP-8999) | *Major* | **SASL negotiation is flawed**
+* [HADOOP-8922](https://issues.apache.org/jira/browse/HADOOP-8922) | *Trivial* | **Provide alternate JSONP output for JMXJsonServlet to allow javascript in browser dashboard**
-The RPC SASL negotiation now always ends with final response. If the SASL mechanism does not have a final response (GSSAPI, PLAIN), then an empty success response is sent to the client. The client will now always expect a final response to definitively know if negotiation is complete/successful.
+Add a JSONP alternative outpout for /jmx HTTP interface to provide a Javascript polling ability in browsers.
---
@@ -72,109 +70,100 @@ Speed up Crc32 by improving the cache hit-ratio of hadoop.util.PureJavaCrc32
---
-* [HADOOP-8922](https://issues.apache.org/jira/browse/HADOOP-8922) | *Trivial* | **Provide alternate JSONP output for JMXJsonServlet to allow javascript in browser dashboard**
+* [MAPREDUCE-4637](https://issues.apache.org/jira/browse/MAPREDUCE-4637) | *Major* | **Killing an unassigned task attempt causes the job to fail**
-Add a JSONP alternative outpout for /jmx HTTP interface to provide a Javascript polling ability in browsers.
+Handle TaskAttempt diagnostic updates while in the NEW and UNASSIGNED states.
---
-* [HADOOP-8712](https://issues.apache.org/jira/browse/HADOOP-8712) | *Minor* | **Change default hadoop.security.group.mapping**
+* [HDFS-4122](https://issues.apache.org/jira/browse/HDFS-4122) | *Major* | **Cleanup HDFS logs and reduce the size of logged messages**
-The default group mapping policy has been changed to JniBasedUnixGroupsNetgroupMappingWithFallback. This should maintain the same semantics as the prior default for most users.
+The change from this jira changes the content of some of the log messages. No log message are removed. Only the content of the log messages is changed to reduce the size. If you have a tool that depends on the exact content of the log, please look at the patch and make appropriate updates to the tool.
---
-* [HDFS-4451](https://issues.apache.org/jira/browse/HDFS-4451) | *Major* | **hdfs balancer command returns exit code 1 on success instead of 0**
+* [HDFS-1331](https://issues.apache.org/jira/browse/HDFS-1331) | *Minor* | **dfs -test should work like /bin/test**
-This is an incompatible change from release 2.0.2-alpha and prior releases. Balancer tool exited with exit code 1 on success. It is changed to exit with exit code 0 on success. Non 0 exit code indicates failure.
+"test" will not print a warning for non-existent paths when testing for existence
---
-* [HDFS-4403](https://issues.apache.org/jira/browse/HDFS-4403) | *Minor* | **DFSClient can infer checksum type when not provided by reading first byte**
+* [HDFS-4080](https://issues.apache.org/jira/browse/HDFS-4080) | *Major* | **Add a separate logger for block state change logs to enable turning off those logs**
-The HDFS implementation of getFileChecksum() can now operate correctly against earlier-version datanodes which do not include the checksum type information in their checksum response. The checksum type is automatically inferred by issuing a read of the first byte of each block.
+Add a separate logger "BlockStateChange" for block state change logs.
---
-* [HDFS-4369](https://issues.apache.org/jira/browse/HDFS-4369) | *Blocker* | **GetBlockKeysResponseProto does not handle null response**
+* [HADOOP-8999](https://issues.apache.org/jira/browse/HADOOP-8999) | *Major* | **SASL negotiation is flawed**
-Protobuf message GetBlockKeysResponseProto member keys is made optional from required so that null values can be passed over the wire. This is an incompatible wire protocol change and does not affect the API backward compatibility.
+The RPC SASL negotiation now always ends with final response. If the SASL mechanism does not have a final response (GSSAPI, PLAIN), then an empty success response is sent to the client. The client will now always expect a final response to definitively know if negotiation is complete/successful.
---
-* [HDFS-4367](https://issues.apache.org/jira/browse/HDFS-4367) | *Blocker* | **GetDataEncryptionKeyResponseProto does not handle null response**
+* [MAPREDUCE-4049](https://issues.apache.org/jira/browse/MAPREDUCE-4049) | *Major* | **plugin for generic shuffle service**
-Member dataEncryptionKey of the protobuf message GetDataEncryptionKeyResponseProto is made optional instead of required. This is incompatible change is not likely to affect the existing users (that are using HDFS FileSystem and other public APIs).
+Allow ReduceTask loading a third party plugin for shuffle (and merge) instead of the default shuffle.
---
-* [HDFS-4364](https://issues.apache.org/jira/browse/HDFS-4364) | *Blocker* | **GetLinkTargetResponseProto does not handle null path**
+* [MAPREDUCE-2454](https://issues.apache.org/jira/browse/MAPREDUCE-2454) | *Minor* | **Allow external sorter plugin for MR**
-Protobuf message GetLinkTargetResponseProto member targetPath is made optional from required so that null values can be passed over the wire. This is an incompatible wire protocol change and does not affect the API backward compatibility.
+MAPREDUCE-4807 Allow external implementations of the sort phase in a Map task
---
-* [HDFS-4362](https://issues.apache.org/jira/browse/HDFS-4362) | *Critical* | **GetDelegationTokenResponseProto does not handle null token**
+* [HADOOP-9147](https://issues.apache.org/jira/browse/HADOOP-9147) | *Trivial* | **Add missing fields to FIleStatus.toString**
-**WARNING: No release note provided for this incompatible change.**
+Update FileStatus.toString to include missing fields
---
-* [HDFS-4350](https://issues.apache.org/jira/browse/HDFS-4350) | *Major* | **Make enabling of stale marking on read and write paths independent**
-
-This patch makes an incompatible configuration change, as described below:
-In releases 1.1.0 and other point releases 1.1.x, the configuration parameter "dfs.namenode.check.stale.datanode" could be used to turn on checking for the stale nodes. This configuration is no longer supported in release 1.2.0 onwards and is renamed as "dfs.namenode.avoid.read.stale.datanode".
+* [HDFS-4362](https://issues.apache.org/jira/browse/HDFS-4362) | *Critical* | **GetDelegationTokenResponseProto does not handle null token**
-How feature works and configuring this feature:
-As described in HDFS-3703 release notes, datanode stale period can be configured using parameter "dfs.namenode.stale.datanode.interval" in seconds (default value is 30 seconds). NameNode can be configured to use this staleness information for reads using configuration "dfs.namenode.avoid.read.stale.datanode". When this parameter is set to true, namenode picks a stale datanode as the last target to read from when returning block locations for reads. Using staleness information for writes is as described in the releases notes of HDFS-3912.
+**WARNING: No release note provided for this change.**
---
-* [HDFS-4122](https://issues.apache.org/jira/browse/HDFS-4122) | *Major* | **Cleanup HDFS logs and reduce the size of logged messages**
+* [HADOOP-9119](https://issues.apache.org/jira/browse/HADOOP-9119) | *Minor* | **Add test to FileSystemContractBaseTest to verify integrity of overwritten files**
-The change from this jira changes the content of some of the log messages. No log message are removed. Only the content of the log messages is changed to reduce the size. If you have a tool that depends on the exact content of the log, please look at the patch and make appropriate updates to the tool.
+Patches adds more tests to verify overwritten and more complex operations -write-delete-overwrite. By using differently sized datasets and different data inside, these tests verify that the overwrite really did take place. While HDFS meets all these requirements directly, eventually consistent object stores may not -hence these tests.
---
-* [HDFS-4080](https://issues.apache.org/jira/browse/HDFS-4080) | *Major* | **Add a separate logger for block state change logs to enable turning off those logs**
+* [HADOOP-9118](https://issues.apache.org/jira/browse/HADOOP-9118) | *Trivial* | **FileSystemContractBaseTest test data for read/write isn't rigorous enough**
-Add a separate logger "BlockStateChange" for block state change logs.
+Resolved as part of HADOOP-9119 -it's test data generator creates more bits in every test byte
---
-* [HDFS-4059](https://issues.apache.org/jira/browse/HDFS-4059) | *Minor* | **Add number of stale DataNodes to metrics**
-
-This jira adds a new metric with name "StaleDataNodes" under metrics context "dfs" of type Gauge. This tracks the number of DataNodes marked as stale. A DataNode is marked stale when the heartbeat message from the DataNode is not received within the configured time ""dfs.namenode.stale.datanode.interval".
-
+* [HDFS-4367](https://issues.apache.org/jira/browse/HDFS-4367) | *Blocker* | **GetDataEncryptionKeyResponseProto does not handle null response**
-Please see hdfs-default.xml documentation corresponding to ""dfs.namenode.stale.datanode.interval" for more details on how to configure this feature. When this feature is not configured, this metrics would return zero.
+Member dataEncryptionKey of the protobuf message GetDataEncryptionKeyResponseProto is made optional instead of required. This is incompatible change is not likely to affect the existing users (that are using HDFS FileSystem and other public APIs).
---
-* [HDFS-3703](https://issues.apache.org/jira/browse/HDFS-3703) | *Major* | **Decrease the datanode failure detection time**
-
-This jira adds a new DataNode state called "stale" at the NameNode. DataNodes are marked as stale if it does not send heartbeat message to NameNode within the timeout configured using the configuration parameter "dfs.namenode.stale.datanode.interval" in seconds (default value is 30 seconds). NameNode picks a stale datanode as the last target to read from when returning block locations for reads.
+* [HDFS-4364](https://issues.apache.org/jira/browse/HDFS-4364) | *Blocker* | **GetLinkTargetResponseProto does not handle null path**
-This feature is by default turned \* off \*. To turn on the feature, set the HDFS configuration "dfs.namenode.check.stale.datanode" to true.
+Protobuf message GetLinkTargetResponseProto member targetPath is made optional from required so that null values can be passed over the wire. This is an incompatible wire protocol change and does not affect the API backward compatibility.
---
-* [HDFS-1331](https://issues.apache.org/jira/browse/HDFS-1331) | *Minor* | **dfs -test should work like /bin/test**
+* [HDFS-4369](https://issues.apache.org/jira/browse/HDFS-4369) | *Blocker* | **GetBlockKeysResponseProto does not handle null response**
-"test" will not print a warning for non-existent paths when testing for existence
+Protobuf message GetBlockKeysResponseProto member keys is made optional from required so that null values can be passed over the wire. This is an incompatible wire protocol change and does not affect the API backward compatibility.
---
@@ -186,37 +175,48 @@ Protobuf message GetDelegationTokenRequestProto field renewer is made requried f
---
-* [MAPREDUCE-4637](https://issues.apache.org/jira/browse/MAPREDUCE-4637) | *Major* | **Killing an unassigned task attempt causes the job to fail**
+* [HADOOP-8712](https://issues.apache.org/jira/browse/HADOOP-8712) | *Minor* | **Change default hadoop.security.group.mapping**
-Handle TaskAttempt diagnostic updates while in the NEW and UNASSIGNED states.
+The default group mapping policy has been changed to JniBasedUnixGroupsNetgroupMappingWithFallback. This should maintain the same semantics as the prior default for most users.
---
-* [MAPREDUCE-4123](https://issues.apache.org/jira/browse/MAPREDUCE-4123) | *Critical* | **./mapred groups gives NoClassDefFoundError**
+* [HADOOP-9106](https://issues.apache.org/jira/browse/HADOOP-9106) | *Major* | **Allow configuration of IPC connect timeout**
-**WARNING: No release note provided for this incompatible change.**
+This jira introduces a new configuration parameter "ipc.client.connect.timeout". This configuration defines the Hadoop RPC connection timeout in milliseconds for a client to connect to a server. For details see the description associated with this configuration in core-default.xml.
---
-* [MAPREDUCE-4049](https://issues.apache.org/jira/browse/MAPREDUCE-4049) | *Major* | **plugin for generic shuffle service**
+* [HDFS-4403](https://issues.apache.org/jira/browse/HDFS-4403) | *Minor* | **DFSClient can infer checksum type when not provided by reading first byte**
-Allow ReduceTask loading a third party plugin for shuffle (and merge) instead of the default shuffle.
+The HDFS implementation of getFileChecksum() can now operate correctly against earlier-version datanodes which do not include the checksum type information in their checksum response. The checksum type is automatically inferred by issuing a read of the first byte of each block.
---
-* [MAPREDUCE-3678](https://issues.apache.org/jira/browse/MAPREDUCE-3678) | *Major* | **The Map tasks logs should have the value of input split it processed**
+* [HDFS-4451](https://issues.apache.org/jira/browse/HDFS-4451) | *Major* | **hdfs balancer command returns exit code 1 on success instead of 0**
-A map-task's syslogs now carries basic info on the InputSplit it processed.
+This is an incompatible change from release 2.0.2-alpha and prior releases. Balancer tool exited with exit code 1 on success. It is changed to exit with exit code 0 on success. Non 0 exit code indicates failure.
---
-* [MAPREDUCE-2454](https://issues.apache.org/jira/browse/MAPREDUCE-2454) | *Minor* | **Allow external sorter plugin for MR**
+* [HDFS-4350](https://issues.apache.org/jira/browse/HDFS-4350) | *Major* | **Make enabling of stale marking on read and write paths independent**
-MAPREDUCE-4807 Allow external implementations of the sort phase in a Map task
+This patch makes an incompatible configuration change, as described below:
+In releases 1.1.0 and other point releases 1.1.x, the configuration parameter "dfs.namenode.check.stale.datanode" could be used to turn on checking for the stale nodes. This configuration is no longer supported in release 1.2.0 onwards and is renamed as "dfs.namenode.avoid.read.stale.datanode".
+
+How feature works and configuring this feature:
+As described in HDFS-3703 release notes, datanode stale period can be configured using parameter "dfs.namenode.stale.datanode.interval" in seconds (default value is 30 seconds). NameNode can be configured to use this staleness information for reads using configuration "dfs.namenode.avoid.read.stale.datanode". When this parameter is set to true, namenode picks a stale datanode as the last target to read from when returning block locations for reads. Using staleness information for writes is as described in the releases notes of HDFS-3912.
+
+
+---
+
+* [HADOOP-9070](https://issues.apache.org/jira/browse/HADOOP-9070) | *Blocker* | **Kerberos SASL server cannot find kerberos key**
+
+**WARNING: No release note provided for this change.**
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.4-alpha/CHANGES.2.0.4-alpha.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.4-alpha/CHANGES.2.0.4-alpha.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.4-alpha/CHANGES.2.0.4-alpha.md
index 0f1db1e..b4e6a82 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.4-alpha/CHANGES.2.0.4-alpha.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.4-alpha/CHANGES.2.0.4-alpha.md
@@ -20,85 +20,57 @@
## Release 2.0.4-alpha - 2013-04-25
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9379](https://issues.apache.org/jira/browse/HADOOP-9379) | capture the ulimit info after printing the log to the console | Trivial | . | Arpit Gupta | Arpit Gupta |
| [HADOOP-9374](https://issues.apache.org/jira/browse/HADOOP-9374) | Add tokens from -tokenCacheFile into UGI | Major | security | Daryn Sharp | Daryn Sharp |
| [YARN-443](https://issues.apache.org/jira/browse/YARN-443) | allow OS scheduling priority of NM to be different than the containers it launches | Major | nodemanager | Thomas Graves | Thomas Graves |
+| [HADOOP-9379](https://issues.apache.org/jira/browse/HADOOP-9379) | capture the ulimit info after printing the log to the console | Trivial | . | Arpit Gupta | Arpit Gupta |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9471](https://issues.apache.org/jira/browse/HADOOP-9471) | hadoop-client wrongfully excludes jetty-util JAR, breaking webhdfs | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-9467](https://issues.apache.org/jira/browse/HADOOP-9467) | Metrics2 record filtering (.record.filter.include/exclude) does not filter by name | Major | metrics | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9444](https://issues.apache.org/jira/browse/HADOOP-9444) | $var shell substitution in properties are not expanded in hadoop-policy.xml | Blocker | conf | Konstantin Boudnik | Roman Shaposhnik |
+| [MAPREDUCE-3685](https://issues.apache.org/jira/browse/MAPREDUCE-3685) | There are some bugs in implementation of MergeManager | Critical | mrv2 | anty.rao | anty |
+| [YARN-429](https://issues.apache.org/jira/browse/YARN-429) | capacity-scheduler config missing from yarn-test artifact | Blocker | resourcemanager | Siddharth Seth | Siddharth Seth |
+| [MAPREDUCE-5023](https://issues.apache.org/jira/browse/MAPREDUCE-5023) | History Server Web Services missing Job Counters | Critical | jobhistoryserver, webapps | Kendall Thrapp | Ravi Prakash |
+| [HDFS-4571](https://issues.apache.org/jira/browse/HDFS-4571) | WebHDFS should not set the service hostname on the server side | Major | webhdfs | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3344](https://issues.apache.org/jira/browse/HDFS-3344) | Unreliable corrupt blocks counting in TestProcessCorruptBlocks | Major | namenode | Tsz Wo Nicholas Sze | Kihwal Lee |
| [HADOOP-9406](https://issues.apache.org/jira/browse/HADOOP-9406) | hadoop-client leaks dependency on JDK tools jar | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-9405](https://issues.apache.org/jira/browse/HADOOP-9405) | TestGridmixSummary#testExecutionSummarizer is broken | Minor | test, tools | Andrew Wang | Andrew Wang |
-| [HADOOP-9399](https://issues.apache.org/jira/browse/HADOOP-9399) | protoc maven plugin doesn't work on mvn 3.0.2 | Minor | build | Todd Lipcon | Konstantin Boudnik |
| [HADOOP-9301](https://issues.apache.org/jira/browse/HADOOP-9301) | hadoop client servlet/jsp/jetty/tomcat JARs creating conflicts in Oozie & HttpFS | Blocker | build | Roman Shaposhnik | Alejandro Abdelnur |
| [HADOOP-9299](https://issues.apache.org/jira/browse/HADOOP-9299) | kerberos name resolution is kicking in even when kerberos is not configured | Blocker | security | Roman Shaposhnik | Daryn Sharp |
-| [HDFS-4649](https://issues.apache.org/jira/browse/HDFS-4649) | Webhdfs cannot list large directories | Blocker | namenode, security, webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-4646](https://issues.apache.org/jira/browse/HDFS-4646) | createNNProxyWithClientProtocol ignores configured timeout value | Minor | namenode | Jagane Sundar | Jagane Sundar |
-| [HDFS-4581](https://issues.apache.org/jira/browse/HDFS-4581) | DataNode#checkDiskError should not be called on network errors | Major | datanode | Rohit Kochar | Rohit Kochar |
-| [HDFS-4576](https://issues.apache.org/jira/browse/HDFS-4576) | Webhdfs authentication issues | Major | webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-4571](https://issues.apache.org/jira/browse/HDFS-4571) | WebHDFS should not set the service hostname on the server side | Major | webhdfs | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HDFS-3344](https://issues.apache.org/jira/browse/HDFS-3344) | Unreliable corrupt blocks counting in TestProcessCorruptBlocks | Major | namenode | Tsz Wo Nicholas Sze | Kihwal Lee |
-| [MAPREDUCE-5117](https://issues.apache.org/jira/browse/MAPREDUCE-5117) | With security enabled HS delegation token renewer fails | Blocker | security | Roman Shaposhnik | Siddharth Seth |
-| [MAPREDUCE-5094](https://issues.apache.org/jira/browse/MAPREDUCE-5094) | Disable mem monitoring by default in MiniMRYarnCluster | Major | . | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-5088](https://issues.apache.org/jira/browse/MAPREDUCE-5088) | MR Client gets an renewer token exception while Oozie is submitting a job | Blocker | . | Roman Shaposhnik | Daryn Sharp |
-| [MAPREDUCE-5083](https://issues.apache.org/jira/browse/MAPREDUCE-5083) | MiniMRCluster should use a random component when creating an actual cluster | Major | mrv2 | Siddharth Seth | Siddharth Seth |
| [MAPREDUCE-5053](https://issues.apache.org/jira/browse/MAPREDUCE-5053) | java.lang.InternalError from decompression codec cause reducer to fail | Major | . | Robert Parker | Robert Parker |
-| [MAPREDUCE-5023](https://issues.apache.org/jira/browse/MAPREDUCE-5023) | History Server Web Services missing Job Counters | Critical | jobhistoryserver, webapps | Kendall Thrapp | Ravi Prakash |
+| [HADOOP-9399](https://issues.apache.org/jira/browse/HADOOP-9399) | protoc maven plugin doesn't work on mvn 3.0.2 | Minor | build | Todd Lipcon | Konstantin Boudnik |
+| [YARN-470](https://issues.apache.org/jira/browse/YARN-470) | Support a way to disable resource monitoring on the NodeManager | Major | nodemanager | Hitesh Shah | Siddharth Seth |
| [MAPREDUCE-5006](https://issues.apache.org/jira/browse/MAPREDUCE-5006) | streaming tests failing | Major | contrib/streaming | Alejandro Abdelnur | Sandy Ryza |
+| [HDFS-4581](https://issues.apache.org/jira/browse/HDFS-4581) | DataNode#checkDiskError should not be called on network errors | Major | datanode | Rohit Kochar | Rohit Kochar |
| [MAPREDUCE-4549](https://issues.apache.org/jira/browse/MAPREDUCE-4549) | Distributed cache conflicts breaks backwards compatability | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-3685](https://issues.apache.org/jira/browse/MAPREDUCE-3685) | There are some bugs in implementation of MergeManager | Critical | mrv2 | anty.rao | anty |
-| [YARN-470](https://issues.apache.org/jira/browse/YARN-470) | Support a way to disable resource monitoring on the NodeManager | Major | nodemanager | Hitesh Shah | Siddharth Seth |
+| [HADOOP-9444](https://issues.apache.org/jira/browse/HADOOP-9444) | $var shell substitution in properties are not expanded in hadoop-policy.xml | Blocker | conf | Konstantin Boudnik | Roman Shaposhnik |
+| [HADOOP-9405](https://issues.apache.org/jira/browse/HADOOP-9405) | TestGridmixSummary#testExecutionSummarizer is broken | Minor | test, tools | Andrew Wang | Andrew Wang |
| [YARN-449](https://issues.apache.org/jira/browse/YARN-449) | HBase test failures when running against Hadoop 2 | Blocker | . | Siddharth Seth | |
-| [YARN-429](https://issues.apache.org/jira/browse/YARN-429) | capacity-scheduler config missing from yarn-test artifact | Blocker | resourcemanager | Siddharth Seth | Siddharth Seth |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-4649](https://issues.apache.org/jira/browse/HDFS-4649) | Webhdfs cannot list large directories | Blocker | namenode, security, webhdfs | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-5117](https://issues.apache.org/jira/browse/MAPREDUCE-5117) | With security enabled HS delegation token renewer fails | Blocker | security | Roman Shaposhnik | Siddharth Seth |
+| [MAPREDUCE-5088](https://issues.apache.org/jira/browse/MAPREDUCE-5088) | MR Client gets an renewer token exception while Oozie is submitting a job | Blocker | . | Roman Shaposhnik | Daryn Sharp |
+| [MAPREDUCE-5083](https://issues.apache.org/jira/browse/MAPREDUCE-5083) | MiniMRCluster should use a random component when creating an actual cluster | Major | mrv2 | Siddharth Seth | Siddharth Seth |
+| [HDFS-4646](https://issues.apache.org/jira/browse/HDFS-4646) | createNNProxyWithClientProtocol ignores configured timeout value | Minor | namenode | Jagane Sundar | Jagane Sundar |
+| [HADOOP-9467](https://issues.apache.org/jira/browse/HADOOP-9467) | Metrics2 record filtering (.record.filter.include/exclude) does not filter by name | Major | metrics | Chris Nauroth | Chris Nauroth |
+| [HADOOP-9471](https://issues.apache.org/jira/browse/HADOOP-9471) | hadoop-client wrongfully excludes jetty-util JAR, breaking webhdfs | Major | build | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-5094](https://issues.apache.org/jira/browse/MAPREDUCE-5094) | Disable mem monitoring by default in MiniMRYarnCluster | Major | . | Siddharth Seth | Siddharth Seth |
+| [HDFS-4576](https://issues.apache.org/jira/browse/HDFS-4576) | Webhdfs authentication issues | Major | webhdfs | Daryn Sharp | Daryn Sharp |
### SUB-TASKS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HDFS-4577](https://issues.apache.org/jira/browse/HDFS-4577) | Webhdfs operations should declare if authentication is required | Major | webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-4567](https://issues.apache.org/jira/browse/HDFS-4567) | Webhdfs does not need a token for token operations | Major | webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-4566](https://issues.apache.org/jira/browse/HDFS-4566) | Webdhfs token cancelation should use authentication | Major | webhdfs | Daryn Sharp | Daryn Sharp |
| [HDFS-4560](https://issues.apache.org/jira/browse/HDFS-4560) | Webhdfs cannot use tokens obtained by another user | Major | webhdfs | Daryn Sharp | Daryn Sharp |
+| [HDFS-4566](https://issues.apache.org/jira/browse/HDFS-4566) | Webdhfs token cancelation should use authentication | Major | webhdfs | Daryn Sharp | Daryn Sharp |
+| [HDFS-4567](https://issues.apache.org/jira/browse/HDFS-4567) | Webhdfs does not need a token for token operations | Major | webhdfs | Daryn Sharp | Daryn Sharp |
+| [HDFS-4577](https://issues.apache.org/jira/browse/HDFS-4577) | Webhdfs operations should declare if authentication is required | Major | webhdfs | Daryn Sharp | Daryn Sharp |
| [HDFS-4548](https://issues.apache.org/jira/browse/HDFS-4548) | Webhdfs doesn't renegotiate SPNEGO token | Blocker | . | Daryn Sharp | Daryn Sharp |
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.5-alpha/CHANGES.2.0.5-alpha.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.5-alpha/CHANGES.2.0.5-alpha.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.5-alpha/CHANGES.2.0.5-alpha.md
index 2aab255..0ca6e8a 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.5-alpha/CHANGES.2.0.5-alpha.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.5-alpha/CHANGES.2.0.5-alpha.md
@@ -20,56 +20,16 @@
## Release 2.0.5-alpha - 2013-06-06
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9614](https://issues.apache.org/jira/browse/HADOOP-9614) | smart-test-patch.sh hangs for new version of patch (2.7.1) | Major | . | Ravi Prakash | Ravi Prakash |
-| [HADOOP-9407](https://issues.apache.org/jira/browse/HADOOP-9407) | commons-daemon 1.0.3 dependency has bad group id causing build issues | Major | build | Sangjin Lee | Sangjin Lee |
-| [HADOOP-8419](https://issues.apache.org/jira/browse/HADOOP-8419) | GzipCodec NPE upon reset with IBM JDK | Major | io | Luke Lu | Yu Li |
| [HDFS-4482](https://issues.apache.org/jira/browse/HDFS-4482) | ReplicationMonitor thread can exit with NPE due to the race between delete and replication of same file. | Blocker | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [HADOOP-8419](https://issues.apache.org/jira/browse/HADOOP-8419) | GzipCodec NPE upon reset with IBM JDK | Major | io | Luke Lu | Yu Li |
| [MAPREDUCE-5240](https://issues.apache.org/jira/browse/MAPREDUCE-5240) | inside of FileOutputCommitter the initialized Credentials cache appears to be empty | Blocker | mrv2 | Roman Shaposhnik | Vinod Kumar Vavilapalli |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-9407](https://issues.apache.org/jira/browse/HADOOP-9407) | commons-daemon 1.0.3 dependency has bad group id causing build issues | Major | build | Sangjin Lee | Sangjin Lee |
+| [HADOOP-9614](https://issues.apache.org/jira/browse/HADOOP-9614) | smart-test-patch.sh hangs for new version of patch (2.7.1) | Major | . | Ravi Prakash | Ravi Prakash |
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.6-alpha/CHANGES.2.0.6-alpha.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.6-alpha/CHANGES.2.0.6-alpha.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.6-alpha/CHANGES.2.0.6-alpha.md
index 2383d4a..c27d9a4 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.6-alpha/CHANGES.2.0.6-alpha.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.6-alpha/CHANGES.2.0.6-alpha.md
@@ -20,28 +20,6 @@
## Release 2.0.6-alpha - 2013-08-22
-### INCOMPATIBLE CHANGES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### IMPROVEMENTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
### BUG FIXES:
@@ -51,21 +29,3 @@
| [YARN-854](https://issues.apache.org/jira/browse/YARN-854) | App submission fails on secure deploy | Blocker | . | Ramya Sunil | Omkar Vinit Joshi |
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[12/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.3-alpha/CHANGES.2.0.3-alpha.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.3-alpha/CHANGES.2.0.3-alpha.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.3-alpha/CHANGES.2.0.3-alpha.md
index 6ec5fbb..8508485 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.3-alpha/CHANGES.2.0.3-alpha.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.3-alpha/CHANGES.2.0.3-alpha.md
@@ -24,571 +24,565 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9070](https://issues.apache.org/jira/browse/HADOOP-9070) | Kerberos SASL server cannot find kerberos key | Blocker | ipc | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4123](https://issues.apache.org/jira/browse/MAPREDUCE-4123) | ./mapred groups gives NoClassDefFoundError | Critical | mrv2 | Nishan Shetty | Devaraj K |
+| [HDFS-4122](https://issues.apache.org/jira/browse/HDFS-4122) | Cleanup HDFS logs and reduce the size of logged messages | Major | datanode, hdfs-client, namenode | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-1331](https://issues.apache.org/jira/browse/HDFS-1331) | dfs -test should work like /bin/test | Minor | tools | Allen Wittenauer | Andy Isaacson |
+| [HDFS-4080](https://issues.apache.org/jira/browse/HDFS-4080) | Add a separate logger for block state change logs to enable turning off those logs | Major | namenode | Kihwal Lee | Kihwal Lee |
| [HADOOP-8999](https://issues.apache.org/jira/browse/HADOOP-8999) | SASL negotiation is flawed | Major | ipc | Daryn Sharp | Daryn Sharp |
-| [HDFS-4451](https://issues.apache.org/jira/browse/HDFS-4451) | hdfs balancer command returns exit code 1 on success instead of 0 | Major | balancer & mover | Joshua Blatt | |
-| [HDFS-4369](https://issues.apache.org/jira/browse/HDFS-4369) | GetBlockKeysResponseProto does not handle null response | Blocker | namenode | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-4362](https://issues.apache.org/jira/browse/HDFS-4362) | GetDelegationTokenResponseProto does not handle null token | Critical | . | Suresh Srinivas | Suresh Srinivas |
| [HDFS-4367](https://issues.apache.org/jira/browse/HDFS-4367) | GetDataEncryptionKeyResponseProto does not handle null response | Blocker | namenode | Suresh Srinivas | Suresh Srinivas |
| [HDFS-4364](https://issues.apache.org/jira/browse/HDFS-4364) | GetLinkTargetResponseProto does not handle null path | Blocker | . | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-4362](https://issues.apache.org/jira/browse/HDFS-4362) | GetDelegationTokenResponseProto does not handle null token | Critical | . | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-4350](https://issues.apache.org/jira/browse/HDFS-4350) | Make enabling of stale marking on read and write paths independent | Major | . | Andrew Wang | Andrew Wang |
-| [HDFS-4122](https://issues.apache.org/jira/browse/HDFS-4122) | Cleanup HDFS logs and reduce the size of logged messages | Major | datanode, hdfs-client, namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-4080](https://issues.apache.org/jira/browse/HDFS-4080) | Add a separate logger for block state change logs to enable turning off those logs | Major | namenode | Kihwal Lee | Kihwal Lee |
-| [HDFS-1331](https://issues.apache.org/jira/browse/HDFS-1331) | dfs -test should work like /bin/test | Minor | tools | Allen Wittenauer | Andy Isaacson |
+| [HDFS-4369](https://issues.apache.org/jira/browse/HDFS-4369) | GetBlockKeysResponseProto does not handle null response | Blocker | namenode | Suresh Srinivas | Suresh Srinivas |
| [MAPREDUCE-4928](https://issues.apache.org/jira/browse/MAPREDUCE-4928) | Use token request messages defined in hadoop common | Major | applicationmaster, security | Suresh Srinivas | Suresh Srinivas |
-| [MAPREDUCE-4123](https://issues.apache.org/jira/browse/MAPREDUCE-4123) | ./mapred groups gives NoClassDefFoundError | Critical | mrv2 | Nishan Shetty | Devaraj K |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-4451](https://issues.apache.org/jira/browse/HDFS-4451) | hdfs balancer command returns exit code 1 on success instead of 0 | Major | balancer & mover | Joshua Blatt | |
+| [HDFS-4350](https://issues.apache.org/jira/browse/HDFS-4350) | Make enabling of stale marking on read and write paths independent | Major | . | Andrew Wang | Andrew Wang |
+| [HADOOP-9070](https://issues.apache.org/jira/browse/HADOOP-9070) | Kerberos SASL server cannot find kerberos key | Blocker | ipc | Daryn Sharp | Daryn Sharp |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9090](https://issues.apache.org/jira/browse/HADOOP-9090) | Support on-demand publish of metrics | Minor | metrics | Mostafa Elhemali | Mostafa Elhemali |
-| [HADOOP-9054](https://issues.apache.org/jira/browse/HADOOP-9054) | Add AuthenticationHandler that uses Kerberos but allows for an alternate form of authentication for browsers | Major | security | Robert Kanter | Robert Kanter |
| [HADOOP-8597](https://issues.apache.org/jira/browse/HADOOP-8597) | FsShell's Text command should be able to read avro data files | Major | fs | Harsh J | Ivan Vladimirov Ivanov |
-| [HDFS-4456](https://issues.apache.org/jira/browse/HDFS-4456) | Add concat to HttpFS and WebHDFS REST API docs | Major | webhdfs | Tsz Wo Nicholas Sze | Plamen Jeliazkov |
+| [MAPREDUCE-3678](https://issues.apache.org/jira/browse/MAPREDUCE-3678) | The Map tasks logs should have the value of input split it processed | Major | mrv1, mrv2 | Bejoy KS | Harsh J |
+| [YARN-146](https://issues.apache.org/jira/browse/YARN-146) | Add unit tests for computing fair share in the fair scheduler | Major | resourcemanager | Sandy Ryza | Sandy Ryza |
+| [YARN-145](https://issues.apache.org/jira/browse/YARN-145) | Add a Web UI to the fair share scheduler | Major | resourcemanager | Sandy Ryza | Sandy Ryza |
+| [YARN-187](https://issues.apache.org/jira/browse/YARN-187) | Add hierarchical queues to the fair scheduler | Major | scheduler | Sandy Ryza | Sandy Ryza |
| [HDFS-4213](https://issues.apache.org/jira/browse/HDFS-4213) | When the client calls hsync, allows the client to update the file length in the NameNode | Major | hdfs-client, namenode | Jing Zhao | Jing Zhao |
-| [HDFS-3598](https://issues.apache.org/jira/browse/HDFS-3598) | WebHDFS: support file concat | Major | webhdfs | Tsz Wo Nicholas Sze | Plamen Jeliazkov |
+| [HADOOP-9090](https://issues.apache.org/jira/browse/HADOOP-9090) | Support on-demand publish of metrics | Minor | metrics | Mostafa Elhemali | Mostafa Elhemali |
+| [HDFS-3049](https://issues.apache.org/jira/browse/HDFS-3049) | During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt | Minor | namenode | Colin P. McCabe | Colin P. McCabe |
| [HDFS-3077](https://issues.apache.org/jira/browse/HDFS-3077) | Quorum-based protocol for reading and writing edit logs | Major | ha, namenode | Todd Lipcon | Todd Lipcon |
-| [HDFS-3049](https://issues.apache.org/jira/browse/HDFS-3049) | During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt | Minor | namenode | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-1245](https://issues.apache.org/jira/browse/HDFS-1245) | Plugable block id generation | Major | namenode | Dmytro Molkov | Konstantin Shvachko |
-| [MAPREDUCE-4808](https://issues.apache.org/jira/browse/MAPREDUCE-4808) | Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations | Major | . | Arun C Murthy | Mariappan Asokan |
-| [MAPREDUCE-4520](https://issues.apache.org/jira/browse/MAPREDUCE-4520) | Add experimental support for MR AM to schedule CPUs along-with memory | Major | . | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-3678](https://issues.apache.org/jira/browse/MAPREDUCE-3678) | The Map tasks logs should have the value of input split it processed | Major | mrv1, mrv2 | Bejoy KS | Harsh J |
+| [HADOOP-9054](https://issues.apache.org/jira/browse/HADOOP-9054) | Add AuthenticationHandler that uses Kerberos but allows for an alternate form of authentication for browsers | Major | security | Robert Kanter | Robert Kanter |
| [MAPREDUCE-2454](https://issues.apache.org/jira/browse/MAPREDUCE-2454) | Allow external sorter plugin for MR | Minor | . | Mariappan Asokan | Mariappan Asokan |
| [YARN-286](https://issues.apache.org/jira/browse/YARN-286) | Add a YARN ApplicationClassLoader | Major | applications | Tom White | Tom White |
-| [YARN-187](https://issues.apache.org/jira/browse/YARN-187) | Add hierarchical queues to the fair scheduler | Major | scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-146](https://issues.apache.org/jira/browse/YARN-146) | Add unit tests for computing fair share in the fair scheduler | Major | resourcemanager | Sandy Ryza | Sandy Ryza |
-| [YARN-145](https://issues.apache.org/jira/browse/YARN-145) | Add a Web UI to the fair share scheduler | Major | resourcemanager | Sandy Ryza | Sandy Ryza |
| [YARN-2](https://issues.apache.org/jira/browse/YARN-2) | Enhance CS to schedule accounting for both memory and cpu cores | Major | capacityscheduler, scheduler | Arun C Murthy | Arun C Murthy |
+| [MAPREDUCE-4520](https://issues.apache.org/jira/browse/MAPREDUCE-4520) | Add experimental support for MR AM to schedule CPUs along-with memory | Major | . | Arun C Murthy | Arun C Murthy |
+| [HDFS-1245](https://issues.apache.org/jira/browse/HDFS-1245) | Plugable block id generation | Major | namenode | Dmytro Molkov | Konstantin Shvachko |
+| [MAPREDUCE-4808](https://issues.apache.org/jira/browse/MAPREDUCE-4808) | Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations | Major | . | Arun C Murthy | Mariappan Asokan |
+| [HDFS-3598](https://issues.apache.org/jira/browse/HDFS-3598) | WebHDFS: support file concat | Major | webhdfs | Tsz Wo Nicholas Sze | Plamen Jeliazkov |
+| [HDFS-4456](https://issues.apache.org/jira/browse/HDFS-4456) | Add concat to HttpFS and WebHDFS REST API docs | Major | webhdfs | Tsz Wo Nicholas Sze | Plamen Jeliazkov |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9276](https://issues.apache.org/jira/browse/HADOOP-9276) | Allow BoundedByteArrayOutputStream to be resettable | Minor | . | Arun C Murthy | Arun C Murthy |
-| [HADOOP-9247](https://issues.apache.org/jira/browse/HADOOP-9247) | parametrize Clover "generateXxx" properties to make them re-definable via -D in mvn calls | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
-| [HADOOP-9216](https://issues.apache.org/jira/browse/HADOOP-9216) | CompressionCodecFactory#getCodecClasses should trim the result of parsing by Configuration. | Major | io | Tsuyoshi Ozawa | Tsuyoshi Ozawa |
-| [HADOOP-9192](https://issues.apache.org/jira/browse/HADOOP-9192) | Move token related request/response messages to common | Major | security | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-9162](https://issues.apache.org/jira/browse/HADOOP-9162) | Add utility to check native library availability | Minor | native | Binglin Chang | Binglin Chang |
-| [HADOOP-9153](https://issues.apache.org/jira/browse/HADOOP-9153) | Support createNonRecursive in ViewFileSystem | Major | viewfs | Sandy Ryza | Sandy Ryza |
-| [HADOOP-9147](https://issues.apache.org/jira/browse/HADOOP-9147) | Add missing fields to FIleStatus.toString | Trivial | . | Jonathan Allen | Jonathan Allen |
-| [HADOOP-9127](https://issues.apache.org/jira/browse/HADOOP-9127) | Update documentation for ZooKeeper Failover Controller | Major | documentation | Daisuke Kobayashi | Daisuke Kobayashi |
-| [HADOOP-9118](https://issues.apache.org/jira/browse/HADOOP-9118) | FileSystemContractBaseTest test data for read/write isn't rigorous enough | Trivial | test | Steve Loughran | |
-| [HADOOP-9106](https://issues.apache.org/jira/browse/HADOOP-9106) | Allow configuration of IPC connect timeout | Major | ipc | Todd Lipcon | Robert Parker |
-| [HADOOP-9093](https://issues.apache.org/jira/browse/HADOOP-9093) | Move all the Exception in PathExceptions to o.a.h.fs package | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-9004](https://issues.apache.org/jira/browse/HADOOP-9004) | Allow security unit tests to use external KDC | Major | security, test | Stephen Chu | Stephen Chu |
-| [HADOOP-8998](https://issues.apache.org/jira/browse/HADOOP-8998) | set Cache-Control no-cache header on all dynamic content | Minor | . | Andy Isaacson | Alejandro Abdelnur |
-| [HADOOP-8992](https://issues.apache.org/jira/browse/HADOOP-8992) | Enhance unit-test coverage of class HarFileSystem | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
-| [HADOOP-8985](https://issues.apache.org/jira/browse/HADOOP-8985) | Add namespace declarations in .proto files for languages other than java | Minor | ha, ipc | Binglin Chang | Binglin Chang |
-| [HADOOP-8951](https://issues.apache.org/jira/browse/HADOOP-8951) | RunJar to fail with user-comprehensible error message if jar missing | Minor | util | Steve Loughran | Steve Loughran |
-| [HADOOP-8932](https://issues.apache.org/jira/browse/HADOOP-8932) | JNI-based user-group mapping modules can be too chatty on lookup failures | Major | security | Kihwal Lee | Kihwal Lee |
-| [HADOOP-8931](https://issues.apache.org/jira/browse/HADOOP-8931) | Add Java version to startup message | Trivial | . | Eli Collins | Eli Collins |
-| [HADOOP-8930](https://issues.apache.org/jira/browse/HADOOP-8930) | Cumulative code coverage calculation | Major | test | Andrey Klochkov | Andrey Klochkov |
-| [HADOOP-8929](https://issues.apache.org/jira/browse/HADOOP-8929) | Add toString, other improvements for SampleQuantiles | Major | metrics | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8926](https://issues.apache.org/jira/browse/HADOOP-8926) | hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data | Major | util | Gopal V | Gopal V |
-| [HADOOP-8925](https://issues.apache.org/jira/browse/HADOOP-8925) | Remove the packaging | Minor | build | Eli Collins | Eli Collins |
-| [HADOOP-8922](https://issues.apache.org/jira/browse/HADOOP-8922) | Provide alternate JSONP output for JMXJsonServlet to allow javascript in browser dashboard | Trivial | metrics | Damien Hardy | Damien Hardy |
-| [HADOOP-8909](https://issues.apache.org/jira/browse/HADOOP-8909) | Hadoop Common Maven protoc calls must not depend on external sh script | Major | build | Chris Nauroth | Chris Nauroth |
-| [HADOOP-8894](https://issues.apache.org/jira/browse/HADOOP-8894) | GenericTestUtils.waitFor should dump thread stacks on timeout | Major | . | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8889](https://issues.apache.org/jira/browse/HADOOP-8889) | Upgrade to Surefire 2.12.3 | Major | build, test | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8866](https://issues.apache.org/jira/browse/HADOOP-8866) | SampleQuantiles#query is O(N^2) instead of O(N) | Minor | . | Andrew Wang | Andrew Wang |
-| [HADOOP-8851](https://issues.apache.org/jira/browse/HADOOP-8851) | Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests | Minor | test | Ivan A. Veselovsky | Ivan A. Veselovsky |
-| [HADOOP-8849](https://issues.apache.org/jira/browse/HADOOP-8849) | FileUtil#fullyDelete should grant the target directories +rwx permissions before trying to delete them | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
-| [HADOOP-8812](https://issues.apache.org/jira/browse/HADOOP-8812) | ExitUtil#terminate should print Exception#toString | Minor | . | Eli Collins | Eli Collins |
-| [HADOOP-8806](https://issues.apache.org/jira/browse/HADOOP-8806) | libhadoop.so: dlopen should be better at locating libsnappy.so, etc. | Minor | build | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8804](https://issues.apache.org/jira/browse/HADOOP-8804) | Improve Web UIs when the wildcard address is used | Minor | . | Eli Collins | Senthil V Kumar |
+| [HADOOP-7886](https://issues.apache.org/jira/browse/HADOOP-7886) | Add toString to FileStatus | Minor | . | Jakob Homan | SreeHari |
+| [HADOOP-8736](https://issues.apache.org/jira/browse/HADOOP-8736) | Add Builder for building an RPC server | Major | ipc | Brandon Li | Brandon Li |
+| [YARN-57](https://issues.apache.org/jira/browse/YARN-57) | Plugable process tree | Major | nodemanager | Radim Kolar | Radim Kolar |
+| [HDFS-2656](https://issues.apache.org/jira/browse/HDFS-2656) | Implement a pure c client based on webhdfs | Major | webhdfs | Zhanwei Wang | Jing Zhao |
| [HADOOP-8789](https://issues.apache.org/jira/browse/HADOOP-8789) | Tests setLevel(Level.OFF) should be Level.ERROR | Minor | test | Andy Isaacson | Andy Isaacson |
+| [HDFS-3925](https://issues.apache.org/jira/browse/HDFS-3925) | Prettify PipelineAck#toString() for printing to a log | Minor | . | Andrew Wang | Andrew Wang |
| [HADOOP-8755](https://issues.apache.org/jira/browse/HADOOP-8755) | Print thread dump when tests fail due to timeout | Major | test | Andrey Klochkov | Andrey Klochkov |
-| [HADOOP-8736](https://issues.apache.org/jira/browse/HADOOP-8736) | Add Builder for building an RPC server | Major | ipc | Brandon Li | Brandon Li |
-| [HADOOP-8712](https://issues.apache.org/jira/browse/HADOOP-8712) | Change default hadoop.security.group.mapping | Minor | security | Robert Parker | Robert Parker |
-| [HADOOP-8561](https://issues.apache.org/jira/browse/HADOOP-8561) | Introduce HADOOP\_PROXY\_USER for secure impersonation in child hadoop client processes | Major | security | Luke Lu | Yu Gao |
-| [HADOOP-7886](https://issues.apache.org/jira/browse/HADOOP-7886) | Add toString to FileStatus | Minor | . | Jakob Homan | SreeHari |
+| [HDFS-3703](https://issues.apache.org/jira/browse/HDFS-3703) | Decrease the datanode failure detection time | Major | datanode, namenode | Nicolas Liochon | Jing Zhao |
| [HADOOP-7688](https://issues.apache.org/jira/browse/HADOOP-7688) | When a servlet filter throws an exception in init(..), the Jetty server failed silently. | Major | . | Tsz Wo Nicholas Sze | Uma Maheswara Rao G |
-| [HDFS-4393](https://issues.apache.org/jira/browse/HDFS-4393) | Empty request and responses in protocol translators can be static final members | Minor | . | Brandon Li | Brandon Li |
-| [HDFS-4392](https://issues.apache.org/jira/browse/HDFS-4392) | Use NetUtils#getFreeSocketPort in MiniDFSCluster | Trivial | test | Andrew Purtell | Andrew Purtell |
-| [HDFS-4381](https://issues.apache.org/jira/browse/HDFS-4381) | Document fsimage format details in FSImageFormat class javadoc | Major | namenode | Jing Zhao | Jing Zhao |
-| [HDFS-4375](https://issues.apache.org/jira/browse/HDFS-4375) | Use token request messages defined in hadoop common | Major | namenode, security | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-4259](https://issues.apache.org/jira/browse/HDFS-4259) | Improve pipeline DN replacement failure message | Minor | hdfs-client | Harsh J | Harsh J |
-| [HDFS-4231](https://issues.apache.org/jira/browse/HDFS-4231) | Introduce HAState for BackupNode | Major | ha, namenode | Konstantin Shvachko | Konstantin Shvachko |
-| [HDFS-4214](https://issues.apache.org/jira/browse/HDFS-4214) | OfflineEditsViewer should print out the offset at which it encountered an error | Trivial | tools | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-4155](https://issues.apache.org/jira/browse/HDFS-4155) | libhdfs implementation of hsync API | Major | libhdfs | Liang Xie | Liang Xie |
-| [HDFS-4153](https://issues.apache.org/jira/browse/HDFS-4153) | Add START\_MSG/SHUTDOWN\_MSG for JournalNode | Major | journal-node | Liang Xie | Liang Xie |
-| [HDFS-4143](https://issues.apache.org/jira/browse/HDFS-4143) | Change INodeFile.blocks to private | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-4121](https://issues.apache.org/jira/browse/HDFS-4121) | Add namespace declarations in hdfs .proto files for languages other than java | Minor | . | Binglin Chang | Binglin Chang |
-| [HDFS-4110](https://issues.apache.org/jira/browse/HDFS-4110) | Refine JNStorage log | Trivial | journal-node | Liang Xie | Liang Xie |
-| [HDFS-4088](https://issues.apache.org/jira/browse/HDFS-4088) | Remove "throws QuotaExceededException" from an INodeDirectoryWithQuota constructor | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-4074](https://issues.apache.org/jira/browse/HDFS-4074) | Remove empty constructors for INode | Trivial | namenode | Brandon Li | Brandon Li |
-| [HDFS-4073](https://issues.apache.org/jira/browse/HDFS-4073) | Two minor improvements to FSDirectory | Minor | namenode | Tsz Wo Nicholas Sze | Jing Zhao |
-| [HDFS-4068](https://issues.apache.org/jira/browse/HDFS-4068) | DatanodeID and DatanodeInfo member should be private | Minor | datanode | Eli Collins | Eli Collins |
-| [HDFS-4058](https://issues.apache.org/jira/browse/HDFS-4058) | DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order | Major | datanode | Eli Collins | Eli Collins |
-| [HDFS-4048](https://issues.apache.org/jira/browse/HDFS-4048) | Use ERROR instead of INFO for volume failure logs | Major | . | Stephen Chu | Stephen Chu |
-| [HDFS-4041](https://issues.apache.org/jira/browse/HDFS-4041) | Hadoop HDFS Maven protoc calls must not depend on external sh script | Major | build | Chris Nauroth | Chris Nauroth |
-| [HDFS-4037](https://issues.apache.org/jira/browse/HDFS-4037) | Rename the getReplication() method in BlockCollection to getBlockReplication() | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-4014](https://issues.apache.org/jira/browse/HDFS-4014) | Fix warnings found by findbugs2 | Major | . | Eli Collins | Eli Collins |
-| [HDFS-4008](https://issues.apache.org/jira/browse/HDFS-4008) | TestBalancerWithEncryptedTransfer needs a timeout | Minor | test | Eli Collins | Eli Collins |
-| [HDFS-4000](https://issues.apache.org/jira/browse/HDFS-4000) | TestParallelLocalRead fails with "input ByteBuffers must be direct buffers" | Major | . | Eli Collins | Colin Patrick McCabe |
-| [HDFS-3957](https://issues.apache.org/jira/browse/HDFS-3957) | Change MutableQuantiles to use a shared thread for rolling over metrics | Minor | . | Andrew Wang | Andrew Wang |
+| [HADOOP-8806](https://issues.apache.org/jira/browse/HADOOP-8806) | libhadoop.so: dlopen should be better at locating libsnappy.so, etc. | Minor | build | Colin P. McCabe | Colin P. McCabe |
+| [HADOOP-8812](https://issues.apache.org/jira/browse/HADOOP-8812) | ExitUtil#terminate should print Exception#toString | Minor | . | Eli Collins | Eli Collins |
| [HDFS-3939](https://issues.apache.org/jira/browse/HDFS-3939) | NN RPC address cleanup | Minor | namenode | Eli Collins | Eli Collins |
-| [HDFS-3925](https://issues.apache.org/jira/browse/HDFS-3925) | Prettify PipelineAck#toString() for printing to a log | Minor | . | Andrew Wang | Andrew Wang |
-| [HDFS-3910](https://issues.apache.org/jira/browse/HDFS-3910) | DFSTestUtil#waitReplication should timeout | Minor | test | Eli Collins | Eli Collins |
+| [HDFS-3957](https://issues.apache.org/jira/browse/HDFS-3957) | Change MutableQuantiles to use a shared thread for rolling over metrics | Minor | . | Andrew Wang | Andrew Wang |
| [HDFS-3896](https://issues.apache.org/jira/browse/HDFS-3896) | Add descriptions for dfs.namenode.rpc-address and dfs.namenode.servicerpc-address to hdfs-default.xml | Minor | . | Jeff Lord | Jeff Lord |
+| [HADOOP-8866](https://issues.apache.org/jira/browse/HADOOP-8866) | SampleQuantiles#query is O(N^2) instead of O(N) | Minor | . | Andrew Wang | Andrew Wang |
+| [HADOOP-8851](https://issues.apache.org/jira/browse/HADOOP-8851) | Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests | Minor | test | Ivan A. Veselovsky | Ivan A. Veselovsky |
+| [HDFS-4000](https://issues.apache.org/jira/browse/HDFS-4000) | TestParallelLocalRead fails with "input ByteBuffers must be direct buffers" | Major | . | Eli Collins | Colin P. McCabe |
+| [HDFS-3910](https://issues.apache.org/jira/browse/HDFS-3910) | DFSTestUtil#waitReplication should timeout | Minor | test | Eli Collins | Eli Collins |
+| [YARN-23](https://issues.apache.org/jira/browse/YARN-23) | FairScheduler: FSQueueSchedulable#updateDemand() - potential redundant aggregation | Major | scheduler | Karthik Kambatla | Karthik Kambatla |
| [HDFS-3813](https://issues.apache.org/jira/browse/HDFS-3813) | Log error message if security and WebHDFS are enabled but principal/keytab are not configured | Major | security, webhdfs | Stephen Chu | Stephen Chu |
-| [HDFS-3703](https://issues.apache.org/jira/browse/HDFS-3703) | Decrease the datanode failure detection time | Major | datanode, namenode | Nicolas Liochon | Jing Zhao |
-| [HDFS-3682](https://issues.apache.org/jira/browse/HDFS-3682) | MiniDFSCluster#init should provide more info when it fails | Minor | test | Eli Collins | Todd Lipcon |
-| [HDFS-3680](https://issues.apache.org/jira/browse/HDFS-3680) | Allow customized audit logging in HDFS FSNamesystem | Minor | namenode | Marcelo Vanzin | Marcelo Vanzin |
| [HDFS-3483](https://issues.apache.org/jira/browse/HDFS-3483) | Better error message when hdfs fsck is run against a ViewFS config | Major | . | Stephen Chu | Stephen Fritz |
+| [HADOOP-8889](https://issues.apache.org/jira/browse/HADOOP-8889) | Upgrade to Surefire 2.12.3 | Major | build, test | Todd Lipcon | Todd Lipcon |
+| [HDFS-3682](https://issues.apache.org/jira/browse/HDFS-3682) | MiniDFSCluster#init should provide more info when it fails | Minor | test | Eli Collins | Todd Lipcon |
+| [HDFS-4008](https://issues.apache.org/jira/browse/HDFS-4008) | TestBalancerWithEncryptedTransfer needs a timeout | Minor | test | Eli Collins | Eli Collins |
+| [HADOOP-8804](https://issues.apache.org/jira/browse/HADOOP-8804) | Improve Web UIs when the wildcard address is used | Minor | . | Eli Collins | Senthil V Kumar |
+| [HADOOP-8894](https://issues.apache.org/jira/browse/HADOOP-8894) | GenericTestUtils.waitFor should dump thread stacks on timeout | Major | . | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-4616](https://issues.apache.org/jira/browse/MAPREDUCE-4616) | Improvement to MultipleOutputs javadocs | Minor | documentation | Tony Burton | Tony Burton |
+| [HADOOP-8909](https://issues.apache.org/jira/browse/HADOOP-8909) | Hadoop Common Maven protoc calls must not depend on external sh script | Major | build | Chris Nauroth | Chris Nauroth |
+| [HDFS-4041](https://issues.apache.org/jira/browse/HDFS-4041) | Hadoop HDFS Maven protoc calls must not depend on external sh script | Major | build | Chris Nauroth | Chris Nauroth |
+| [HDFS-4037](https://issues.apache.org/jira/browse/HDFS-4037) | Rename the getReplication() method in BlockCollection to getBlockReplication() | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HDFS-2946](https://issues.apache.org/jira/browse/HDFS-2946) | HA: Put a cap on the number of completed edits files retained by the NN | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-2656](https://issues.apache.org/jira/browse/HDFS-2656) | Implement a pure c client based on webhdfs | Major | webhdfs | Zhanwei Wang | Jing Zhao |
-| [MAPREDUCE-4977](https://issues.apache.org/jira/browse/MAPREDUCE-4977) | Documentation for pluggable shuffle and pluggable sort | Major | documentation | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-4971](https://issues.apache.org/jira/browse/MAPREDUCE-4971) | Minor extensibility enhancements | Minor | . | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-4949](https://issues.apache.org/jira/browse/MAPREDUCE-4949) | Enable multiple pi jobs to run in parallel | Minor | examples | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4907](https://issues.apache.org/jira/browse/MAPREDUCE-4907) | TrackerDistributedCacheManager issues too many getFileStatus calls | Major | mrv1, tasktracker | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4899](https://issues.apache.org/jira/browse/MAPREDUCE-4899) | Provide a plugin to the Yarn Web App Proxy to generate tracking links for M/R appllications given the ID | Major | . | Derek Dagit | Derek Dagit |
-| [MAPREDUCE-4845](https://issues.apache.org/jira/browse/MAPREDUCE-4845) | ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2 | Major | client | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4838](https://issues.apache.org/jira/browse/MAPREDUCE-4838) | Add extra info to JH files | Major | . | Arun C Murthy | Zhijie Shen |
-| [MAPREDUCE-4822](https://issues.apache.org/jira/browse/MAPREDUCE-4822) | Unnecessary conversions in History Events | Trivial | jobhistoryserver | Robert Joseph Evans | Chu Tong |
-| [MAPREDUCE-4811](https://issues.apache.org/jira/browse/MAPREDUCE-4811) | JobHistoryServer should show when it was started in WebUI About page | Minor | jobhistoryserver, mrv2 | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-4810](https://issues.apache.org/jira/browse/MAPREDUCE-4810) | Add admin command options for ApplicationMaster | Minor | applicationmaster | Jason Lowe | Jerry Chen |
-| [MAPREDUCE-4802](https://issues.apache.org/jira/browse/MAPREDUCE-4802) | Takes a long time to load the task list on the AM for large jobs | Major | mr-am, mrv2, webapps | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-4777](https://issues.apache.org/jira/browse/MAPREDUCE-4777) | In TestIFile, testIFileReaderWithCodec relies on testIFileWriterWithCodec | Minor | . | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4764](https://issues.apache.org/jira/browse/MAPREDUCE-4764) | repair test org.apache.hadoop.mapreduce.security.TestBinaryTokenFile | Major | . | Ivan A. Veselovsky | |
-| [MAPREDUCE-4763](https://issues.apache.org/jira/browse/MAPREDUCE-4763) | repair test org.apache.hadoop.mapreduce.security.TestUmbilicalProtocolWithJobToken | Minor | . | Ivan A. Veselovsky | |
-| [MAPREDUCE-4752](https://issues.apache.org/jira/browse/MAPREDUCE-4752) | Reduce MR AM memory usage through String Interning | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [HDFS-4058](https://issues.apache.org/jira/browse/HDFS-4058) | DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order | Major | datanode | Eli Collins | Eli Collins |
+| [HADOOP-8929](https://issues.apache.org/jira/browse/HADOOP-8929) | Add toString, other improvements for SampleQuantiles | Major | metrics | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8932](https://issues.apache.org/jira/browse/HADOOP-8932) | JNI-based user-group mapping modules can be too chatty on lookup failures | Major | security | Kihwal Lee | Kihwal Lee |
+| [HADOOP-8922](https://issues.apache.org/jira/browse/HADOOP-8922) | Provide alternate JSONP output for JMXJsonServlet to allow javascript in browser dashboard | Trivial | metrics | Damien Hardy | Damien Hardy |
+| [HADOOP-8926](https://issues.apache.org/jira/browse/HADOOP-8926) | hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data | Major | util | Gopal V | Gopal V |
+| [HADOOP-8931](https://issues.apache.org/jira/browse/HADOOP-8931) | Add Java version to startup message | Trivial | . | Eli Collins | Eli Collins |
+| [HADOOP-8930](https://issues.apache.org/jira/browse/HADOOP-8930) | Cumulative code coverage calculation | Major | test | Andrey Klochkov | Andrey Klochkov |
+| [HDFS-4068](https://issues.apache.org/jira/browse/HDFS-4068) | DatanodeID and DatanodeInfo member should be private | Minor | datanode | Eli Collins | Eli Collins |
+| [HDFS-4073](https://issues.apache.org/jira/browse/HDFS-4073) | Two minor improvements to FSDirectory | Minor | namenode | Tsz Wo Nicholas Sze | Jing Zhao |
+| [HDFS-4074](https://issues.apache.org/jira/browse/HDFS-4074) | Remove empty constructors for INode | Trivial | namenode | Brandon Li | Brandon Li |
+| [HADOOP-8925](https://issues.apache.org/jira/browse/HADOOP-8925) | Remove the packaging | Minor | build | Eli Collins | Eli Collins |
| [MAPREDUCE-4736](https://issues.apache.org/jira/browse/MAPREDUCE-4736) | Remove obsolete option [-rootDir] from TestDFSIO | Trivial | test | Brandon Li | Brandon Li |
-| [MAPREDUCE-4723](https://issues.apache.org/jira/browse/MAPREDUCE-4723) | Fix warnings found by findbugs 2 | Major | . | Sandy Ryza | Sandy Ryza |
-| [MAPREDUCE-4703](https://issues.apache.org/jira/browse/MAPREDUCE-4703) | Add the ability to start the MiniMRClientCluster using the configurations used before it is being stopped. | Major | mrv1, mrv2, test | Ahmed Radwan | Ahmed Radwan |
+| [HDFS-4088](https://issues.apache.org/jira/browse/HDFS-4088) | Remove "throws QuotaExceededException" from an INodeDirectoryWithQuota constructor | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HADOOP-8951](https://issues.apache.org/jira/browse/HADOOP-8951) | RunJar to fail with user-comprehensible error message if jar missing | Minor | util | Steve Loughran | Steve Loughran |
+| [MAPREDUCE-4229](https://issues.apache.org/jira/browse/MAPREDUCE-4229) | Counter names' memory usage can be decreased by interning | Major | jobtracker | Todd Lipcon | Miomir Boljanovic |
+| [HDFS-4121](https://issues.apache.org/jira/browse/HDFS-4121) | Add namespace declarations in hdfs .proto files for languages other than java | Minor | . | Binglin Chang | Binglin Chang |
+| [HADOOP-8985](https://issues.apache.org/jira/browse/HADOOP-8985) | Add namespace declarations in .proto files for languages other than java | Minor | ha, ipc | Binglin Chang | Binglin Chang |
+| [MAPREDUCE-4752](https://issues.apache.org/jira/browse/MAPREDUCE-4752) | Reduce MR AM memory usage through String Interning | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [YARN-165](https://issues.apache.org/jira/browse/YARN-165) | RM should point tracking URL to RM web page for app when AM fails | Blocker | resourcemanager | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4763](https://issues.apache.org/jira/browse/MAPREDUCE-4763) | repair test org.apache.hadoop.mapreduce.security.TestUmbilicalProtocolWithJobToken | Minor | . | Ivan A. Veselovsky | |
+| [HDFS-4143](https://issues.apache.org/jira/browse/HDFS-4143) | Change INodeFile.blocks to private | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-4155](https://issues.apache.org/jira/browse/HDFS-4155) | libhdfs implementation of hsync API | Major | libhdfs | Liang Xie | Liang Xie |
+| [HDFS-4153](https://issues.apache.org/jira/browse/HDFS-4153) | Add START\_MSG/SHUTDOWN\_MSG for JournalNode | Major | journal-node | Liang Xie | Liang Xie |
+| [MAPREDUCE-4777](https://issues.apache.org/jira/browse/MAPREDUCE-4777) | In TestIFile, testIFileReaderWithCodec relies on testIFileWriterWithCodec | Minor | . | Sandy Ryza | Sandy Ryza |
+| [YARN-169](https://issues.apache.org/jira/browse/YARN-169) | Update log4j.appender.EventCounter to use org.apache.hadoop.log.metrics.EventCounter | Minor | nodemanager | Anthony Rojas | Anthony Rojas |
+| [HDFS-4048](https://issues.apache.org/jira/browse/HDFS-4048) | Use ERROR instead of INFO for volume failure logs | Major | . | Stephen Chu | Stephen Chu |
+| [YARN-183](https://issues.apache.org/jira/browse/YARN-183) | Clean up fair scheduler code | Minor | scheduler | Sandy Ryza | Sandy Ryza |
| [MAPREDUCE-4666](https://issues.apache.org/jira/browse/MAPREDUCE-4666) | JVM metrics for history server | Minor | jobhistoryserver | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4616](https://issues.apache.org/jira/browse/MAPREDUCE-4616) | Improvement to MultipleOutputs javadocs | Minor | documentation | Tony Burton | Tony Burton |
| [MAPREDUCE-4517](https://issues.apache.org/jira/browse/MAPREDUCE-4517) | Too many INFO messages written out during AM to RM heartbeat | Minor | applicationmaster | James Kinley | Jason Lowe |
-| [MAPREDUCE-4458](https://issues.apache.org/jira/browse/MAPREDUCE-4458) | Warn if java.library.path is used for AM or Task | Major | mrv2 | Robert Joseph Evans | Robert Parker |
-| [MAPREDUCE-4229](https://issues.apache.org/jira/browse/MAPREDUCE-4229) | Counter names' memory usage can be decreased by interning | Major | jobtracker | Todd Lipcon | Miomir Boljanovic |
-| [YARN-331](https://issues.apache.org/jira/browse/YARN-331) | Fill in missing fair scheduler documentation | Major | scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-328](https://issues.apache.org/jira/browse/YARN-328) | Use token request messages defined in hadoop common | Major | resourcemanager | Suresh Srinivas | Suresh Srinivas |
-| [YARN-315](https://issues.apache.org/jira/browse/YARN-315) | Use security token protobuf definition from hadoop common | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [YARN-285](https://issues.apache.org/jira/browse/YARN-285) | RM should be able to provide a tracking link for apps that have already been purged | Major | . | Derek Dagit | Derek Dagit |
-| [YARN-277](https://issues.apache.org/jira/browse/YARN-277) | Use AMRMClient in DistributedShell to exemplify the approach | Major | . | Bikas Saha | Bikas Saha |
-| [YARN-254](https://issues.apache.org/jira/browse/YARN-254) | Update fair scheduler web UI for hierarchical queues | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-222](https://issues.apache.org/jira/browse/YARN-222) | Fair scheduler should create queue for each user by default | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza |
+| [HADOOP-8998](https://issues.apache.org/jira/browse/HADOOP-8998) | set Cache-Control no-cache header on all dynamic content | Minor | . | Andy Isaacson | Alejandro Abdelnur |
| [YARN-216](https://issues.apache.org/jira/browse/YARN-216) | Remove jquery theming support | Major | . | Todd Lipcon | Robert Joseph Evans |
+| [MAPREDUCE-4723](https://issues.apache.org/jira/browse/MAPREDUCE-4723) | Fix warnings found by findbugs 2 | Major | . | Sandy Ryza | Sandy Ryza |
+| [MAPREDUCE-4802](https://issues.apache.org/jira/browse/MAPREDUCE-4802) | Takes a long time to load the task list on the AM for large jobs | Major | mr-am, mrv2, webapps | Ravi Prakash | Ravi Prakash |
| [YARN-184](https://issues.apache.org/jira/browse/YARN-184) | Remove unnecessary locking in fair scheduler, and address findbugs excludes. | Major | . | Sandy Ryza | Sandy Ryza |
-| [YARN-183](https://issues.apache.org/jira/browse/YARN-183) | Clean up fair scheduler code | Minor | scheduler | Sandy Ryza | Sandy Ryza |
-| [YARN-169](https://issues.apache.org/jira/browse/YARN-169) | Update log4j.appender.EventCounter to use org.apache.hadoop.log.metrics.EventCounter | Minor | nodemanager | Anthony Rojas | Anthony Rojas |
-| [YARN-165](https://issues.apache.org/jira/browse/YARN-165) | RM should point tracking URL to RM web page for app when AM fails | Blocker | resourcemanager | Jason Lowe | Jason Lowe |
| [YARN-129](https://issues.apache.org/jira/browse/YARN-129) | Simplify classpath construction for mini YARN tests | Major | client | Tom White | Tom White |
-| [YARN-57](https://issues.apache.org/jira/browse/YARN-57) | Plugable process tree | Major | nodemanager | Radim Kolar | Radim Kolar |
-| [YARN-23](https://issues.apache.org/jira/browse/YARN-23) | FairScheduler: FSQueueSchedulable#updateDemand() - potential redundant aggregation | Major | scheduler | Karthik Kambatla | Karthik Kambatla |
+| [MAPREDUCE-4811](https://issues.apache.org/jira/browse/MAPREDUCE-4811) | JobHistoryServer should show when it was started in WebUI About page | Minor | jobhistoryserver, mrv2 | Ravi Prakash | Ravi Prakash |
+| [MAPREDUCE-4764](https://issues.apache.org/jira/browse/MAPREDUCE-4764) | repair test org.apache.hadoop.mapreduce.security.TestBinaryTokenFile | Major | . | Ivan A. Veselovsky | |
+| [HADOOP-8992](https://issues.apache.org/jira/browse/HADOOP-8992) | Enhance unit-test coverage of class HarFileSystem | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
+| [HADOOP-9093](https://issues.apache.org/jira/browse/HADOOP-9093) | Move all the Exception in PathExceptions to o.a.h.fs package | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-4214](https://issues.apache.org/jira/browse/HDFS-4214) | OfflineEditsViewer should print out the offset at which it encountered an error | Trivial | tools | Colin P. McCabe | Colin P. McCabe |
+| [YARN-222](https://issues.apache.org/jira/browse/YARN-222) | Fair scheduler should create queue for each user by default | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza |
+| [HDFS-4231](https://issues.apache.org/jira/browse/HDFS-4231) | Introduce HAState for BackupNode | Major | ha, namenode | Konstantin Shvachko | Konstantin Shvachko |
+| [HDFS-4110](https://issues.apache.org/jira/browse/HDFS-4110) | Refine JNStorage log | Trivial | journal-node | Liang Xie | Liang Xie |
+| [HDFS-3680](https://issues.apache.org/jira/browse/HDFS-3680) | Allow customized audit logging in HDFS FSNamesystem | Minor | namenode | Marcelo Vanzin | Marcelo Vanzin |
+| [HADOOP-9127](https://issues.apache.org/jira/browse/HADOOP-9127) | Update documentation for ZooKeeper Failover Controller | Major | documentation | Daisuke Kobayashi | Daisuke Kobayashi |
+| [HADOOP-8561](https://issues.apache.org/jira/browse/HADOOP-8561) | Introduce HADOOP\_PROXY\_USER for secure impersonation in child hadoop client processes | Major | security | Luke Lu | Yu Gao |
+| [HADOOP-9004](https://issues.apache.org/jira/browse/HADOOP-9004) | Allow security unit tests to use external KDC | Major | security, test | Stephen Chu | Stephen Chu |
+| [MAPREDUCE-4703](https://issues.apache.org/jira/browse/MAPREDUCE-4703) | Add the ability to start the MiniMRClientCluster using the configurations used before it is being stopped. | Major | mrv1, mrv2, test | Ahmed Radwan | Ahmed Radwan |
+| [HADOOP-9147](https://issues.apache.org/jira/browse/HADOOP-9147) | Add missing fields to FIleStatus.toString | Trivial | . | Jonathan Allen | Jonathan Allen |
+| [MAPREDUCE-4845](https://issues.apache.org/jira/browse/MAPREDUCE-4845) | ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2 | Major | client | Sandy Ryza | Sandy Ryza |
+| [YARN-254](https://issues.apache.org/jira/browse/YARN-254) | Update fair scheduler web UI for hierarchical queues | Major | resourcemanager, scheduler | Sandy Ryza | Sandy Ryza |
+| [HADOOP-9153](https://issues.apache.org/jira/browse/HADOOP-9153) | Support createNonRecursive in ViewFileSystem | Major | viewfs | Sandy Ryza | Sandy Ryza |
+| [YARN-285](https://issues.apache.org/jira/browse/YARN-285) | RM should be able to provide a tracking link for apps that have already been purged | Major | . | Derek Dagit | Derek Dagit |
+| [HADOOP-9162](https://issues.apache.org/jira/browse/HADOOP-9162) | Add utility to check native library availability | Minor | native | Binglin Chang | Binglin Chang |
+| [YARN-315](https://issues.apache.org/jira/browse/YARN-315) | Use security token protobuf definition from hadoop common | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-4899](https://issues.apache.org/jira/browse/MAPREDUCE-4899) | Provide a plugin to the Yarn Web App Proxy to generate tracking links for M/R appllications given the ID | Major | . | Derek Dagit | Derek Dagit |
+| [MAPREDUCE-4810](https://issues.apache.org/jira/browse/MAPREDUCE-4810) | Add admin command options for ApplicationMaster | Minor | applicationmaster | Jason Lowe | Jerry Chen |
+| [HADOOP-9118](https://issues.apache.org/jira/browse/HADOOP-9118) | FileSystemContractBaseTest test data for read/write isn't rigorous enough | Trivial | test | Steve Loughran | |
+| [MAPREDUCE-4907](https://issues.apache.org/jira/browse/MAPREDUCE-4907) | TrackerDistributedCacheManager issues too many getFileStatus calls | Major | mrv1, tasktracker | Sandy Ryza | Sandy Ryza |
+| [HDFS-4381](https://issues.apache.org/jira/browse/HDFS-4381) | Document fsimage format details in FSImageFormat class javadoc | Major | namenode | Jing Zhao | Jing Zhao |
+| [HADOOP-9192](https://issues.apache.org/jira/browse/HADOOP-9192) | Move token related request/response messages to common | Major | security | Suresh Srinivas | Suresh Srinivas |
+| [YARN-328](https://issues.apache.org/jira/browse/YARN-328) | Use token request messages defined in hadoop common | Major | resourcemanager | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-4375](https://issues.apache.org/jira/browse/HDFS-4375) | Use token request messages defined in hadoop common | Major | namenode, security | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-4392](https://issues.apache.org/jira/browse/HDFS-4392) | Use NetUtils#getFreeSocketPort in MiniDFSCluster | Trivial | test | Andrew Purtell | Andrew Purtell |
+| [HADOOP-8712](https://issues.apache.org/jira/browse/HADOOP-8712) | Change default hadoop.security.group.mapping | Minor | security | Robert Parker | Robert Parker |
+| [HADOOP-9106](https://issues.apache.org/jira/browse/HADOOP-9106) | Allow configuration of IPC connect timeout | Major | ipc | Todd Lipcon | Robert Parker |
+| [HADOOP-9216](https://issues.apache.org/jira/browse/HADOOP-9216) | CompressionCodecFactory#getCodecClasses should trim the result of parsing by Configuration. | Major | io | Tsuyoshi Ozawa | Tsuyoshi Ozawa |
+| [HDFS-4393](https://issues.apache.org/jira/browse/HDFS-4393) | Empty request and responses in protocol translators can be static final members | Minor | . | Brandon Li | Brandon Li |
+| [HADOOP-8849](https://issues.apache.org/jira/browse/HADOOP-8849) | FileUtil#fullyDelete should grant the target directories +rwx permissions before trying to delete them | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
+| [YARN-331](https://issues.apache.org/jira/browse/YARN-331) | Fill in missing fair scheduler documentation | Major | scheduler | Sandy Ryza | Sandy Ryza |
+| [MAPREDUCE-4458](https://issues.apache.org/jira/browse/MAPREDUCE-4458) | Warn if java.library.path is used for AM or Task | Major | mrv2 | Robert Joseph Evans | Robert Parker |
+| [MAPREDUCE-4949](https://issues.apache.org/jira/browse/MAPREDUCE-4949) | Enable multiple pi jobs to run in parallel | Minor | examples | Sandy Ryza | Sandy Ryza |
+| [YARN-277](https://issues.apache.org/jira/browse/YARN-277) | Use AMRMClient in DistributedShell to exemplify the approach | Major | . | Bikas Saha | Bikas Saha |
+| [HADOOP-9247](https://issues.apache.org/jira/browse/HADOOP-9247) | parametrize Clover "generateXxx" properties to make them re-definable via -D in mvn calls | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
+| [HDFS-4259](https://issues.apache.org/jira/browse/HDFS-4259) | Improve pipeline DN replacement failure message | Minor | hdfs-client | Harsh J | Harsh J |
+| [MAPREDUCE-4838](https://issues.apache.org/jira/browse/MAPREDUCE-4838) | Add extra info to JH files | Major | . | Arun C Murthy | Zhijie Shen |
+| [MAPREDUCE-4971](https://issues.apache.org/jira/browse/MAPREDUCE-4971) | Minor extensibility enhancements | Minor | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-9276](https://issues.apache.org/jira/browse/HADOOP-9276) | Allow BoundedByteArrayOutputStream to be resettable | Minor | . | Arun C Murthy | Arun C Murthy |
+| [MAPREDUCE-4977](https://issues.apache.org/jira/browse/MAPREDUCE-4977) | Documentation for pluggable shuffle and pluggable sort | Major | documentation | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-4822](https://issues.apache.org/jira/browse/MAPREDUCE-4822) | Unnecessary conversions in History Events | Trivial | jobhistoryserver | Robert Joseph Evans | Chu Tong |
+| [HDFS-4014](https://issues.apache.org/jira/browse/HDFS-4014) | Fix warnings found by findbugs2 | Major | . | Eli Collins | Eli Collins |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-9289](https://issues.apache.org/jira/browse/HADOOP-9289) | FsShell rm -f fails for non-matching globs | Blocker | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9278](https://issues.apache.org/jira/browse/HADOOP-9278) | HarFileSystem may leak file handle | Major | fs | Chris Nauroth | Chris Nauroth |
-| [HADOOP-9260](https://issues.apache.org/jira/browse/HADOOP-9260) | Hadoop version may be not correct when starting name node or data node | Critical | . | Jerry Chen | Chris Nauroth |
-| [HADOOP-9255](https://issues.apache.org/jira/browse/HADOOP-9255) | relnotes.py missing last jira | Critical | scripts | Thomas Graves | Thomas Graves |
-| [HADOOP-9252](https://issues.apache.org/jira/browse/HADOOP-9252) | StringUtils.humanReadableInt(..) has a race condition | Minor | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-9231](https://issues.apache.org/jira/browse/HADOOP-9231) | Parametrize staging URL for the uniformity of distributionManagement | Major | build | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-9221](https://issues.apache.org/jira/browse/HADOOP-9221) | Convert remaining xdocs to APT | Major | . | Andy Isaacson | Andy Isaacson |
-| [HADOOP-9215](https://issues.apache.org/jira/browse/HADOOP-9215) | when using cmake-2.6, libhadoop.so doesn't get created (only libhadoop.so.1.0.0) | Blocker | . | Thomas Graves | Colin Patrick McCabe |
-| [HADOOP-9212](https://issues.apache.org/jira/browse/HADOOP-9212) | Potential deadlock in FileSystem.Cache/IPC/UGI | Major | fs | Tom White | Tom White |
-| [HADOOP-9203](https://issues.apache.org/jira/browse/HADOOP-9203) | RPCCallBenchmark should find a random available port | Trivial | ipc, test | Andrew Purtell | Andrew Purtell |
-| [HADOOP-9193](https://issues.apache.org/jira/browse/HADOOP-9193) | hadoop script can inadvertently expand wildcard arguments when delegating to hdfs script | Minor | scripts | Jason Lowe | Andy Isaacson |
-| [HADOOP-9190](https://issues.apache.org/jira/browse/HADOOP-9190) | packaging docs is broken | Major | documentation | Thomas Graves | Andy Isaacson |
-| [HADOOP-9183](https://issues.apache.org/jira/browse/HADOOP-9183) | Potential deadlock in ActiveStandbyElector | Major | ha | Tom White | Tom White |
-| [HADOOP-9181](https://issues.apache.org/jira/browse/HADOOP-9181) | Set daemon flag for HttpServer's QueuedThreadPool | Major | . | Liang Xie | Liang Xie |
-| [HADOOP-9178](https://issues.apache.org/jira/browse/HADOOP-9178) | src/main/conf is missing hadoop-policy.xml | Minor | . | Sandy Ryza | Sandy Ryza |
-| [HADOOP-9173](https://issues.apache.org/jira/browse/HADOOP-9173) | Add security token protobuf definition to common and use it in hdfs | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-9155](https://issues.apache.org/jira/browse/HADOOP-9155) | FsPermission should have different default value, 777 for directory and 666 for file | Minor | . | Binglin Chang | Binglin Chang |
-| [HADOOP-9152](https://issues.apache.org/jira/browse/HADOOP-9152) | HDFS can report negative DFS Used on clusters with very small amounts of data | Minor | fs | Brock Noland | Brock Noland |
-| [HADOOP-9135](https://issues.apache.org/jira/browse/HADOOP-9135) | JniBasedUnixGroupsMappingWithFallback should log at debug rather than info during fallback | Trivial | security | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-9124](https://issues.apache.org/jira/browse/HADOOP-9124) | SortedMapWritable violates contract of Map interface for equals() and hashCode() | Minor | io | Patrick Hunt | Surenkumar Nihalani |
-| [HADOOP-9113](https://issues.apache.org/jira/browse/HADOOP-9113) | o.a.h.fs.TestDelegationTokenRenewer is failing intermittently | Major | security, test | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-9105](https://issues.apache.org/jira/browse/HADOOP-9105) | FsShell -moveFromLocal erroneously fails | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-9103](https://issues.apache.org/jira/browse/HADOOP-9103) | UTF8 class does not properly decode Unicode characters outside the basic multilingual plane | Major | io | yixiaohua | Todd Lipcon |
-| [HADOOP-9097](https://issues.apache.org/jira/browse/HADOOP-9097) | Maven RAT plugin is not checking all source files | Critical | build | Tom White | Thomas Graves |
-| [HADOOP-9072](https://issues.apache.org/jira/browse/HADOOP-9072) | Hadoop-Common-0.23-Build Fails to build in Jenkins | Major | . | Robert Parker | Robert Parker |
-| [HADOOP-9064](https://issues.apache.org/jira/browse/HADOOP-9064) | Augment DelegationTokenRenewer API to cancel the tokens on calls to removeRenewAction | Major | security | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-9049](https://issues.apache.org/jira/browse/HADOOP-9049) | DelegationTokenRenewer needs to be Singleton and FileSystems should register/deregister to/from. | Major | security | Karthik Kambatla | Karthik Kambatla |
-| [HADOOP-9041](https://issues.apache.org/jira/browse/HADOOP-9041) | FileSystem initialization can go into infinite loop | Critical | fs | Radim Kolar | Radim Kolar |
-| [HADOOP-9025](https://issues.apache.org/jira/browse/HADOOP-9025) | org.apache.hadoop.tools.TestCopyListing failing | Major | . | Robert Joseph Evans | Jonathan Eagles |
-| [HADOOP-9022](https://issues.apache.org/jira/browse/HADOOP-9022) | Hadoop distcp tool fails to copy file if -m 0 specified | Major | . | Haiyang Jiang | Jonathan Eagles |
-| [HADOOP-8994](https://issues.apache.org/jira/browse/HADOOP-8994) | TestDFSShell creates file named "noFileHere", making further tests hard to understand | Minor | test | Andy Isaacson | Andy Isaacson |
-| [HADOOP-8986](https://issues.apache.org/jira/browse/HADOOP-8986) | Server$Call object is never released after it is sent | Critical | ipc | Robert Joseph Evans | Robert Joseph Evans |
-| [HADOOP-8981](https://issues.apache.org/jira/browse/HADOOP-8981) | TestMetricsSystemImpl fails on Windows | Major | metrics | Chris Nauroth | Xuan Gong |
-| [HADOOP-8962](https://issues.apache.org/jira/browse/HADOOP-8962) | RawLocalFileSystem.listStatus fails when a child filename contains a colon | Critical | fs | Jason Lowe | Jason Lowe |
-| [HADOOP-8948](https://issues.apache.org/jira/browse/HADOOP-8948) | TestFileUtil.testGetDU fails on Windows due to incorrect assumption of line separator | Major | test | Chris Nauroth | Chris Nauroth |
+| [HDFS-3510](https://issues.apache.org/jira/browse/HDFS-3510) | Improve FSEditLog pre-allocation | Major | . | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-3625](https://issues.apache.org/jira/browse/HDFS-3625) | Fix TestBackupNode by properly initializing edit log | Blocker | ha | Eli Collins | Junping Du |
+| [HDFS-3678](https://issues.apache.org/jira/browse/HDFS-3678) | Edit log files are never being purged from 2NN | Critical | namenode | Todd Lipcon | Aaron T. Myers |
+| [HADOOP-8684](https://issues.apache.org/jira/browse/HADOOP-8684) | Deadlock between WritableComparator and WritableComparable | Minor | io | Hiroshi Ikeda | Jing Zhao |
+| [MAPREDUCE-4607](https://issues.apache.org/jira/browse/MAPREDUCE-4607) | Race condition in ReduceTask completion can result in Task being incorrectly failed | Major | . | Bikas Saha | Bikas Saha |
+| [YARN-78](https://issues.apache.org/jira/browse/YARN-78) | Change UnmanagedAMLauncher to use YarnClientImpl | Major | applications | Bikas Saha | Bikas Saha |
+| [HDFS-3919](https://issues.apache.org/jira/browse/HDFS-3919) | MiniDFSCluster:waitClusterUp can hang forever | Minor | test | Andy Isaacson | Andy Isaacson |
+| [YARN-93](https://issues.apache.org/jira/browse/YARN-93) | Diagnostics missing from applications that have finished but failed | Major | resourcemanager | Jason Lowe | Jason Lowe |
+| [HADOOP-8795](https://issues.apache.org/jira/browse/HADOOP-8795) | BASH tab completion doesn't look in PATH, assumes path to executable is specified | Minor | scripts | Sean Mackrory | Sean Mackrory |
+| [HDFS-3924](https://issues.apache.org/jira/browse/HDFS-3924) | Multi-byte id in HdfsVolumeId | Major | hdfs-client | Andrew Wang | Andrew Wang |
+| [HADOOP-8780](https://issues.apache.org/jira/browse/HADOOP-8780) | Update DeprecatedProperties apt file | Major | . | Ahmed Radwan | Ahmed Radwan |
+| [HDFS-3938](https://issues.apache.org/jira/browse/HDFS-3938) | remove current limitations from HttpFS docs | Major | documentation | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-8819](https://issues.apache.org/jira/browse/HADOOP-8819) | Should use && instead of & in a few places in FTPFileSystem,FTPInputStream,S3InputStream,ViewFileSystem,ViewFs | Major | fs | Brandon Li | Brandon Li |
+| [HADOOP-8786](https://issues.apache.org/jira/browse/HADOOP-8786) | HttpServer continues to start even if AuthenticationFilter fails to init | Major | . | Todd Lipcon | Todd Lipcon |
+| [YARN-28](https://issues.apache.org/jira/browse/YARN-28) | TestCompositeService fails on jdk7 | Major | . | Thomas Graves | Thomas Graves |
+| [HDFS-3936](https://issues.apache.org/jira/browse/HDFS-3936) | MiniDFSCluster shutdown races with BlocksMap usage | Major | . | Eli Collins | Eli Collins |
+| [HDFS-3951](https://issues.apache.org/jira/browse/HDFS-3951) | datanode web ui does not work over HTTPS when datanode is started in secure mode | Major | datanode, security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3949](https://issues.apache.org/jira/browse/HDFS-3949) | NameNodeRpcServer#join should join on both client and server RPC servers | Minor | namenode | Eli Collins | Eli Collins |
+| [HDFS-3932](https://issues.apache.org/jira/browse/HDFS-3932) | NameNode Web UI broken if the rpc-address is set to the wildcard | Major | . | Eli Collins | Eli Collins |
+| [HDFS-3964](https://issues.apache.org/jira/browse/HDFS-3964) | Make NN log of fs.defaultFS debug rather than info | Minor | namenode | Eli Collins | Eli Collins |
+| [YARN-82](https://issues.apache.org/jira/browse/YARN-82) | YARN local-dirs defaults to /tmp/nm-local-dir | Minor | nodemanager | Andy Isaacson | Hemanth Yamijala |
+| [MAPREDUCE-4674](https://issues.apache.org/jira/browse/MAPREDUCE-4674) | Hadoop examples secondarysort has a typo "secondarysrot" in the usage | Minor | . | Robert Justice | Robert Justice |
+| [HADOOP-8833](https://issues.apache.org/jira/browse/HADOOP-8833) | fs -text should make sure to call inputstream.seek(0) before using input stream | Major | fs | Harsh J | Harsh J |
+| [YARN-53](https://issues.apache.org/jira/browse/YARN-53) | Add protocol to YARN to support GetGroups | Major | resourcemanager | Alejandro Abdelnur | Bo Wang |
+| [HADOOP-8791](https://issues.apache.org/jira/browse/HADOOP-8791) | rm "Only deletes non empty directory and files." | Major | documentation | Bertrand Dechoux | Jing Zhao |
+| [HADOOP-8822](https://issues.apache.org/jira/browse/HADOOP-8822) | relnotes.py was deleted post mavenization | Major | . | Robert Joseph Evans | Robert Joseph Evans |
+| [HADOOP-8843](https://issues.apache.org/jira/browse/HADOOP-8843) | Old trash directories are never deleted on upgrade from 1.x | Critical | . | Robert Joseph Evans | Jason Lowe |
+| [HDFS-3931](https://issues.apache.org/jira/browse/HDFS-3931) | TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken | Minor | test | Eli Collins | Andy Isaacson |
+| [HADOOP-8855](https://issues.apache.org/jira/browse/HADOOP-8855) | SSL-based image transfer does not work when Kerberos is disabled | Minor | security | Todd Lipcon | Todd Lipcon |
+| [HDFS-3831](https://issues.apache.org/jira/browse/HDFS-3831) | Failure to renew tokens due to test-sources left in classpath | Critical | security | Jason Lowe | Jason Lowe |
+| [HDFS-3373](https://issues.apache.org/jira/browse/HDFS-3373) | FileContext HDFS implementation can leak socket caches | Major | hdfs-client | Todd Lipcon | John George |
+| [HDFS-3992](https://issues.apache.org/jira/browse/HDFS-3992) | Method org.apache.hadoop.hdfs.TestHftpFileSystem.tearDown() sometimes throws NPEs | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky |
+| [YARN-116](https://issues.apache.org/jira/browse/YARN-116) | RM is missing ability to add include/exclude files without a restart | Major | resourcemanager | xieguiming | xieguiming |
+| [MAPREDUCE-4681](https://issues.apache.org/jira/browse/MAPREDUCE-4681) | HDFS-3910 broke MR tests | Major | . | Arun C Murthy | Arun C Murthy |
+| [HADOOP-8616](https://issues.apache.org/jira/browse/HADOOP-8616) | ViewFS configuration requires a trailing slash | Major | viewfs | Eli Collins | Sandy Ryza |
+| [HDFS-3753](https://issues.apache.org/jira/browse/HDFS-3753) | Tests don't run with native libraries | Major | build, test | Eli Collins | Colin P. McCabe |
+| [HADOOP-8756](https://issues.apache.org/jira/browse/HADOOP-8756) | Fix SEGV when libsnappy is in java.library.path but not LD\_LIBRARY\_PATH | Minor | native | Colin P. McCabe | Colin P. McCabe |
+| [YARN-131](https://issues.apache.org/jira/browse/YARN-131) | Incorrect ACL properties in capacity scheduler documentation | Major | capacityscheduler | Ahmed Radwan | Ahmed Radwan |
+| [YARN-102](https://issues.apache.org/jira/browse/YARN-102) | Move the apache licence header to the top of the file in MemStore.java | Trivial | resourcemanager | Devaraj K | Devaraj K |
+| [HDFS-3996](https://issues.apache.org/jira/browse/HDFS-3996) | Add debug log removed in HDFS-3873 back | Minor | . | Eli Collins | Eli Collins |
+| [HDFS-3916](https://issues.apache.org/jira/browse/HDFS-3916) | libwebhdfs (C client) code cleanups | Major | webhdfs | Colin P. McCabe | Colin P. McCabe |
+| [HADOOP-8881](https://issues.apache.org/jira/browse/HADOOP-8881) | FileBasedKeyStoresFactory initialization logging should be debug not info | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3999](https://issues.apache.org/jira/browse/HDFS-3999) | HttpFS OPEN operation expects len parameter, it should be length | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3829](https://issues.apache.org/jira/browse/HDFS-3829) | TestHftpURLTimeouts fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
+| [HDFS-4006](https://issues.apache.org/jira/browse/HDFS-4006) | TestCheckpoint#testSecondaryHasVeryOutOfDateImage occasionally fails due to unexpected exit | Major | namenode | Eli Collins | Todd Lipcon |
+| [MAPREDUCE-4712](https://issues.apache.org/jira/browse/MAPREDUCE-4712) | mr-jobhistory-daemon.sh doesn't accept --config | Major | jobhistoryserver | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [MAPREDUCE-4554](https://issues.apache.org/jira/browse/MAPREDUCE-4554) | Job Credentials are not transmitted if security is turned off | Major | job submission, security | Benoy Antony | Benoy Antony |
+| [YARN-127](https://issues.apache.org/jira/browse/YARN-127) | Move RMAdmin tool to the client package | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [YARN-40](https://issues.apache.org/jira/browse/YARN-40) | Provide support for missing yarn commands | Major | client | Devaraj K | Devaraj K |
+| [HDFS-4018](https://issues.apache.org/jira/browse/HDFS-4018) | TestDataNodeMultipleRegistrations#testMiniDFSClusterWithMultipleNN is missing some cluster cleanup | Minor | . | Eli Collins | Eli Collins |
+| [YARN-33](https://issues.apache.org/jira/browse/YARN-33) | LocalDirsHandler should validate the configured local and log dirs | Major | nodemanager | Mayank Bansal | Mayank Bansal |
+| [MAPREDUCE-4705](https://issues.apache.org/jira/browse/MAPREDUCE-4705) | Historyserver links expire before the history data does | Critical | jobhistoryserver, mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4654](https://issues.apache.org/jira/browse/MAPREDUCE-4654) | TestDistCp is @ignored | Critical | test | Colin P. McCabe | Sandy Ryza |
+| [YARN-94](https://issues.apache.org/jira/browse/YARN-94) | DistributedShell jar should point to Client as the main class by default | Major | applications/distributed-shell | Vinod Kumar Vavilapalli | Hitesh Shah |
+| [YARN-30](https://issues.apache.org/jira/browse/YARN-30) | TestNMWebServicesApps, TestRMWebServicesApps and TestRMWebServicesNodes fail on jdk7 | Major | . | Thomas Graves | Thomas Graves |
+| [YARN-150](https://issues.apache.org/jira/browse/YARN-150) | AppRejectedTransition does not unregister app from master service and scheduler | Major | . | Bikas Saha | Bikas Saha |
+| [HDFS-3824](https://issues.apache.org/jira/browse/HDFS-3824) | TestHftpDelegationToken fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
+| [HDFS-4020](https://issues.apache.org/jira/browse/HDFS-4020) | TestRBWBlockInvalidation may time out | Major | . | Eli Collins | Eli Collins |
+| [HDFS-3224](https://issues.apache.org/jira/browse/HDFS-3224) | Bug in check for DN re-registration with different storage ID | Minor | . | Eli Collins | Jason Lowe |
+| [HDFS-4021](https://issues.apache.org/jira/browse/HDFS-4021) | Misleading error message when resources are low on the NameNode | Minor | namenode | Colin P. McCabe | Christopher Conner |
| [HADOOP-8913](https://issues.apache.org/jira/browse/HADOOP-8913) | hadoop-metrics2.properties should give units in comment for sampling period | Minor | metrics | Sandy Ryza | Sandy Ryza |
-| [HADOOP-8912](https://issues.apache.org/jira/browse/HADOOP-8912) | adding .gitattributes file to prevent CRLF and LF mismatches for source and text files | Major | build | Raja Aluri | Raja Aluri |
+| [HADOOP-8878](https://issues.apache.org/jira/browse/HADOOP-8878) | uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on | Major | . | Arpit Gupta | Arpit Gupta |
| [HADOOP-8911](https://issues.apache.org/jira/browse/HADOOP-8911) | CRLF characters in source and text files | Major | build | Raja Aluri | Raja Aluri |
+| [HADOOP-8912](https://issues.apache.org/jira/browse/HADOOP-8912) | adding .gitattributes file to prevent CRLF and LF mismatches for source and text files | Major | build | Raja Aluri | Raja Aluri |
+| [HDFS-4044](https://issues.apache.org/jira/browse/HDFS-4044) | Duplicate ChecksumType definition in HDFS .proto files | Major | datanode | Binglin Chang | Binglin Chang |
| [HADOOP-8906](https://issues.apache.org/jira/browse/HADOOP-8906) | paths with multiple globs are unreliable | Critical | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8901](https://issues.apache.org/jira/browse/HADOOP-8901) | GZip and Snappy support may not work without unversioned libraries | Minor | native | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8900](https://issues.apache.org/jira/browse/HADOOP-8900) | BuiltInGzipDecompressor throws IOException - stored gzip size doesn't match decompressed size | Major | . | Slavik Krassovsky | Andy Isaacson |
+| [HDFS-4036](https://issues.apache.org/jira/browse/HDFS-4036) | FSDirectory.unprotectedAddFile(..) should not throw UnresolvedLinkException | Major | namenode | Tsz Wo Nicholas Sze | Jing Zhao |
+| [HDFS-4049](https://issues.apache.org/jira/browse/HDFS-4049) | hflush performance regression due to nagling delays | Critical | datanode, performance | Todd Lipcon | Todd Lipcon |
+| [HDFS-3985](https://issues.apache.org/jira/browse/HDFS-3985) | Add timeouts to TestMulitipleNNDataBlockScanner | Major | test | Eli Collins | |
| [HADOOP-8883](https://issues.apache.org/jira/browse/HADOOP-8883) | Anonymous fallback in KerberosAuthenticator is broken | Major | . | Robert Kanter | Robert Kanter |
-| [HADOOP-8881](https://issues.apache.org/jira/browse/HADOOP-8881) | FileBasedKeyStoresFactory initialization logging should be debug not info | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8878](https://issues.apache.org/jira/browse/HADOOP-8878) | uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on | Major | . | Arpit Gupta | Arpit Gupta |
-| [HADOOP-8855](https://issues.apache.org/jira/browse/HADOOP-8855) | SSL-based image transfer does not work when Kerberos is disabled | Minor | security | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8843](https://issues.apache.org/jira/browse/HADOOP-8843) | Old trash directories are never deleted on upgrade from 1.x | Critical | . | Robert Joseph Evans | Jason Lowe |
-| [HADOOP-8833](https://issues.apache.org/jira/browse/HADOOP-8833) | fs -text should make sure to call inputstream.seek(0) before using input stream | Major | fs | Harsh J | Harsh J |
-| [HADOOP-8822](https://issues.apache.org/jira/browse/HADOOP-8822) | relnotes.py was deleted post mavenization | Major | . | Robert Joseph Evans | Robert Joseph Evans |
-| [HADOOP-8819](https://issues.apache.org/jira/browse/HADOOP-8819) | Should use && instead of & in a few places in FTPFileSystem,FTPInputStream,S3InputStream,ViewFileSystem,ViewFs | Major | fs | Brandon Li | Brandon Li |
-| [HADOOP-8816](https://issues.apache.org/jira/browse/HADOOP-8816) | HTTP Error 413 full HEAD if using kerberos authentication | Major | net | Moritz Moeller | Moritz Moeller |
+| [MAPREDUCE-4521](https://issues.apache.org/jira/browse/MAPREDUCE-4521) | mapreduce.user.classpath.first incompatibility with 0.20/1.x | Major | mrv2 | Jason Lowe | Ravi Prakash |
+| [HDFS-4061](https://issues.apache.org/jira/browse/HDFS-4061) | TestBalancer and TestUnderReplicatedBlocks need timeouts | Major | . | Eli Collins | Eli Collins |
+| [YARN-161](https://issues.apache.org/jira/browse/YARN-161) | Yarn Common has multiple compiler warnings for unchecked operations | Major | api | Chris Nauroth | Chris Nauroth |
+| [HDFS-3997](https://issues.apache.org/jira/browse/HDFS-3997) | OfflineImageViewer incorrectly passes value of imageVersion when visiting IS\_COMPRESSED element | Trivial | namenode | Mithun Radhakrishnan | Mithun Radhakrishnan |
+| [YARN-43](https://issues.apache.org/jira/browse/YARN-43) | TestResourceTrackerService fail intermittently on jdk7 | Major | . | Thomas Graves | Thomas Graves |
+| [HDFS-4055](https://issues.apache.org/jira/browse/HDFS-4055) | TestAuditLogs is flaky | Major | . | Binglin Chang | Binglin Chang |
+| [MAPREDUCE-4721](https://issues.apache.org/jira/browse/MAPREDUCE-4721) | Task startup time in JHS is same as job startup time. | Major | jobhistoryserver | Ravi Prakash | Ravi Prakash |
+| [YARN-32](https://issues.apache.org/jira/browse/YARN-32) | TestApplicationTokens fails intermintently on jdk7 | Major | . | Thomas Graves | Vinod Kumar Vavilapalli |
+| [HDFS-4072](https://issues.apache.org/jira/browse/HDFS-4072) | On file deletion remove corresponding blocks pending replication | Minor | namenode | Jing Zhao | Jing Zhao |
+| [YARN-163](https://issues.apache.org/jira/browse/YARN-163) | Retrieving container log via NM webapp can hang with multibyte characters in log | Major | nodemanager | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4479](https://issues.apache.org/jira/browse/MAPREDUCE-4479) | Fix parameter order in assertEquals() in TestCombineInputFileFormat.java | Major | test | Mariappan Asokan | Mariappan Asokan |
+| [MAPREDUCE-4733](https://issues.apache.org/jira/browse/MAPREDUCE-4733) | Reducer can fail to make progress during shuffle if too many reducers complete consecutively | Major | applicationmaster, mrv2 | Jason Lowe | Jason Lowe |
+| [YARN-136](https://issues.apache.org/jira/browse/YARN-136) | Make ClientTokenSecretManager part of RMContext | Major | resourcemanager | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [HADOOP-8948](https://issues.apache.org/jira/browse/HADOOP-8948) | TestFileUtil.testGetDU fails on Windows due to incorrect assumption of line separator | Major | test | Chris Nauroth | Chris Nauroth |
+| [YARN-140](https://issues.apache.org/jira/browse/YARN-140) | Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler. | Major | capacityscheduler | Ahmed Radwan | Ahmed Radwan |
+| [HDFS-4022](https://issues.apache.org/jira/browse/HDFS-4022) | Replication not happening for appended block | Blocker | . | suja s | Vinayakumar B |
+| [HDFS-4099](https://issues.apache.org/jira/browse/HDFS-4099) | Clean up replication code and add more javadoc | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-4740](https://issues.apache.org/jira/browse/MAPREDUCE-4740) | only .jars can be added to the Distributed Cache classpath | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [HADOOP-8900](https://issues.apache.org/jira/browse/HADOOP-8900) | BuiltInGzipDecompressor throws IOException - stored gzip size doesn't match decompressed size | Major | . | Slavik Krassovsky | Andy Isaacson |
+| [HDFS-4090](https://issues.apache.org/jira/browse/HDFS-4090) | getFileChecksum() result incompatible when called against zero-byte files. | Critical | hdfs-client | Kihwal Lee | Kihwal Lee |
+| [HADOOP-8962](https://issues.apache.org/jira/browse/HADOOP-8962) | RawLocalFileSystem.listStatus fails when a child filename contains a colon | Critical | fs | Jason Lowe | Jason Lowe |
| [HADOOP-8811](https://issues.apache.org/jira/browse/HADOOP-8811) | Compile hadoop native library in FreeBSD | Critical | native | Radim Kolar | Radim Kolar |
-| [HADOOP-8795](https://issues.apache.org/jira/browse/HADOOP-8795) | BASH tab completion doesn't look in PATH, assumes path to executable is specified | Minor | scripts | Sean Mackrory | Sean Mackrory |
-| [HADOOP-8791](https://issues.apache.org/jira/browse/HADOOP-8791) | rm "Only deletes non empty directory and files." | Major | documentation | Bertrand Dechoux | Jing Zhao |
-| [HADOOP-8786](https://issues.apache.org/jira/browse/HADOOP-8786) | HttpServer continues to start even if AuthenticationFilter fails to init | Major | . | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8780](https://issues.apache.org/jira/browse/HADOOP-8780) | Update DeprecatedProperties apt file | Major | . | Ahmed Radwan | Ahmed Radwan |
-| [HADOOP-8756](https://issues.apache.org/jira/browse/HADOOP-8756) | Fix SEGV when libsnappy is in java.library.path but not LD\_LIBRARY\_PATH | Minor | native | Colin Patrick McCabe | Colin Patrick McCabe |
+| [HADOOP-8901](https://issues.apache.org/jira/browse/HADOOP-8901) | GZip and Snappy support may not work without unversioned libraries | Minor | native | Colin P. McCabe | Colin P. McCabe |
+| [MAPREDUCE-4637](https://issues.apache.org/jira/browse/MAPREDUCE-4637) | Killing an unassigned task attempt causes the job to fail | Major | mrv2 | Tom White | Mayank Bansal |
+| [YARN-179](https://issues.apache.org/jira/browse/YARN-179) | Bunch of test failures on trunk | Blocker | capacityscheduler | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
+| [YARN-181](https://issues.apache.org/jira/browse/YARN-181) | capacity-scheduler.xml move breaks Eclipse import | Critical | resourcemanager | Siddharth Seth | Siddharth Seth |
+| [YARN-177](https://issues.apache.org/jira/browse/YARN-177) | CapacityScheduler - adding a queue while the RM is running has wacky results | Critical | capacityscheduler | Thomas Graves | Arun C Murthy |
+| [YARN-178](https://issues.apache.org/jira/browse/YARN-178) | Fix custom ProcessTree instance creation | Critical | . | Radim Kolar | Radim Kolar |
+| [YARN-180](https://issues.apache.org/jira/browse/YARN-180) | Capacity scheduler - containers that get reserved create container token to early | Critical | capacityscheduler | Thomas Graves | Arun C Murthy |
+| [YARN-139](https://issues.apache.org/jira/browse/YARN-139) | Interrupted Exception within AsyncDispatcher leads to user confusion | Major | api | Nathan Roberts | Vinod Kumar Vavilapalli |
+| [MAPREDUCE-4741](https://issues.apache.org/jira/browse/MAPREDUCE-4741) | WARN and ERROR messages logged during normal AM shutdown | Minor | applicationmaster, mrv2 | Jason Lowe | Vinod Kumar Vavilapalli |
+| [MAPREDUCE-4730](https://issues.apache.org/jira/browse/MAPREDUCE-4730) | AM crashes due to OOM while serving up map task completion events | Blocker | applicationmaster, mrv2 | Jason Lowe | Jason Lowe |
+| [HDFS-4107](https://issues.apache.org/jira/browse/HDFS-4107) | Add utility methods to cast INode to INodeFile and INodeFileUnderConstruction | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-3948](https://issues.apache.org/jira/browse/HDFS-3948) | TestWebHDFS#testNamenodeRestart occasionally fails | Minor | test | Eli Collins | Jing Zhao |
+| [HDFS-4112](https://issues.apache.org/jira/browse/HDFS-4112) | A few improvements on INodeDirectory | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-3616](https://issues.apache.org/jira/browse/HDFS-3616) | TestWebHdfsWithMultipleNameNodes fails with ConcurrentModificationException in DN shutdown | Major | datanode | Uma Maheswara Rao G | Jing Zhao |
| [HADOOP-8713](https://issues.apache.org/jira/browse/HADOOP-8713) | TestRPCCompatibility fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
-| [HADOOP-8684](https://issues.apache.org/jira/browse/HADOOP-8684) | Deadlock between WritableComparator and WritableComparable | Minor | io | Hiroshi Ikeda | Jing Zhao |
-| [HADOOP-8616](https://issues.apache.org/jira/browse/HADOOP-8616) | ViewFS configuration requires a trailing slash | Major | viewfs | Eli Collins | Sandy Ryza |
+| [MAPREDUCE-4748](https://issues.apache.org/jira/browse/MAPREDUCE-4748) | Invalid event: T\_ATTEMPT\_SUCCEEDED at SUCCEEDED | Blocker | mrv2 | Robert Joseph Evans | Jason Lowe |
+| [HDFS-4106](https://issues.apache.org/jira/browse/HDFS-4106) | BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be declared as volatile | Minor | namenode, test | Jing Zhao | Jing Zhao |
+| [MAPREDUCE-1806](https://issues.apache.org/jira/browse/MAPREDUCE-1806) | CombineFileInputFormat does not work with paths not on default FS | Major | harchive | Paul Yang | Gera Shegalov |
+| [HDFS-4127](https://issues.apache.org/jira/browse/HDFS-4127) | Log message is not correct in case of short of replica | Minor | namenode | Junping Du | Junping Du |
+| [HADOOP-8994](https://issues.apache.org/jira/browse/HADOOP-8994) | TestDFSShell creates file named "noFileHere", making further tests hard to understand | Minor | test | Andy Isaacson | Andy Isaacson |
+| [HADOOP-8986](https://issues.apache.org/jira/browse/HADOOP-8986) | Server$Call object is never released after it is sent | Critical | ipc | Robert Joseph Evans | Robert Joseph Evans |
+| [YARN-159](https://issues.apache.org/jira/browse/YARN-159) | RM web ui applications page should be sorted to display last app first | Major | resourcemanager | Thomas Graves | Thomas Graves |
+| [YARN-166](https://issues.apache.org/jira/browse/YARN-166) | capacity scheduler doesn't allow capacity \< 1.0 | Major | capacityscheduler | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4724](https://issues.apache.org/jira/browse/MAPREDUCE-4724) | job history web ui applications page should be sorted to display last app first | Major | jobhistoryserver | Thomas Graves | Thomas Graves |
+| [YARN-189](https://issues.apache.org/jira/browse/YARN-189) | deadlock in RM - AMResponse object | Blocker | resourcemanager | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4746](https://issues.apache.org/jira/browse/MAPREDUCE-4746) | The MR Application Master does not have a config to set environment variables | Major | applicationmaster | Robert Parker | Robert Parker |
+| [MAPREDUCE-4729](https://issues.apache.org/jira/browse/MAPREDUCE-4729) | job history UI not showing all job attempts | Major | jobhistoryserver | Thomas Graves | Vinod Kumar Vavilapalli |
+| [HDFS-3804](https://issues.apache.org/jira/browse/HDFS-3804) | TestHftpFileSystem fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
+| [HDFS-4132](https://issues.apache.org/jira/browse/HDFS-4132) | when libwebhdfs is not enabled, nativeMiniDfsClient frees uninitialized memory | Major | libhdfs | Colin P. McCabe | Colin P. McCabe |
+| [MAPREDUCE-4771](https://issues.apache.org/jira/browse/MAPREDUCE-4771) | KeyFieldBasedPartitioner not partitioning properly when configured | Major | mrv2 | Jason Lowe | Jason Lowe |
+| [HDFS-4046](https://issues.apache.org/jira/browse/HDFS-4046) | ChecksumTypeProto use NULL as enum value which is illegal in C/C++ | Minor | datanode, namenode | Binglin Chang | Binglin Chang |
+| [HDFS-4075](https://issues.apache.org/jira/browse/HDFS-4075) | Reduce recommissioning overhead | Critical | namenode | Kihwal Lee | Kihwal Lee |
+| [HDFS-3979](https://issues.apache.org/jira/browse/HDFS-3979) | Fix hsync semantics | Major | datanode | Lars Hofhansl | Lars Hofhansl |
+| [YARN-201](https://issues.apache.org/jira/browse/YARN-201) | CapacityScheduler can take a very long time to schedule containers if requests are off cluster | Critical | capacityscheduler | Jason Lowe | Jason Lowe |
| [HADOOP-8589](https://issues.apache.org/jira/browse/HADOOP-8589) | ViewFs tests fail when tests and home dirs are nested | Major | fs, test | Andrey Klochkov | Sanjay Radia |
-| [HADOOP-8418](https://issues.apache.org/jira/browse/HADOOP-8418) | Fix UGI for IBM JDK running on Windows | Major | security | Luke Lu | Yu Gao |
-| [HADOOP-7294](https://issues.apache.org/jira/browse/HADOOP-7294) | FileUtil uses wrong stat command for FreeBSD | Major | fs | Vitalii Tymchyshyn | |
+| [MAPREDUCE-4772](https://issues.apache.org/jira/browse/MAPREDUCE-4772) | Fetch failures can take way too long for a map to be restarted | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [HDFS-3990](https://issues.apache.org/jira/browse/HDFS-3990) | NN's health report has severe performance problems | Critical | namenode | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4782](https://issues.apache.org/jira/browse/MAPREDUCE-4782) | NLineInputFormat skips first line of last InputSplit | Blocker | client | Mark Fuhs | Mark Fuhs |
+| [HDFS-4162](https://issues.apache.org/jira/browse/HDFS-4162) | Some malformed and unquoted HTML strings are returned from datanode web ui | Minor | datanode | Derek Dagit | Derek Dagit |
| [HADOOP-7115](https://issues.apache.org/jira/browse/HADOOP-7115) | Add a cache for getpwuid\_r and getpwgid\_r calls | Major | . | Arun C Murthy | Alejandro Abdelnur |
-| [HADOOP-6762](https://issues.apache.org/jira/browse/HADOOP-6762) | exception while doing RPC I/O closes channel | Critical | . | sam rash | sam rash |
+| [MAPREDUCE-4774](https://issues.apache.org/jira/browse/MAPREDUCE-4774) | JobImpl does not handle asynchronous task events in FAILED state | Major | applicationmaster, mrv2 | Ivan A. Veselovsky | Jason Lowe |
+| [YARN-206](https://issues.apache.org/jira/browse/YARN-206) | TestApplicationCleanup.testContainerCleanup occasionally fails | Major | resourcemanager | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4751](https://issues.apache.org/jira/browse/MAPREDUCE-4751) | AM stuck in KILL\_WAIT for days | Major | . | Ravi Prakash | Vinod Kumar Vavilapalli |
+| [MAPREDUCE-4787](https://issues.apache.org/jira/browse/MAPREDUCE-4787) | TestJobMonitorAndPrint is broken | Major | test | Ravi Prakash | Robert Parker |
+| [HDFS-4172](https://issues.apache.org/jira/browse/HDFS-4172) | namenode does not URI-encode parameters when building URI for datanode request | Minor | namenode | Derek Dagit | Derek Dagit |
+| [MAPREDUCE-4425](https://issues.apache.org/jira/browse/MAPREDUCE-4425) | Speculation + Fetch failures can lead to a hung job | Critical | mrv2 | Siddharth Seth | Jason Lowe |
+| [MAPREDUCE-4786](https://issues.apache.org/jira/browse/MAPREDUCE-4786) | Job End Notification retry interval is 5 milliseconds by default | Major | mrv2 | Ravi Prakash | Ravi Prakash |
+| [HDFS-4164](https://issues.apache.org/jira/browse/HDFS-4164) | fuse\_dfs: add -lrt to the compiler command line on Linux | Minor | fuse-dfs | Colin P. McCabe | Colin P. McCabe |
+| [HADOOP-9022](https://issues.apache.org/jira/browse/HADOOP-9022) | Hadoop distcp tool fails to copy file if -m 0 specified | Major | . | Haiyang Jiang | Jonathan Eagles |
+| [HDFS-1322](https://issues.apache.org/jira/browse/HDFS-1322) | Document umask in DistributedFileSystem#mkdirs javadocs | Major | . | Ravi Gummadi | Colin P. McCabe |
+| [HDFS-3921](https://issues.apache.org/jira/browse/HDFS-3921) | NN will prematurely consider blocks missing when entering active state while still in safe mode | Major | . | Stephen Chu | Aaron T. Myers |
+| [HADOOP-9025](https://issues.apache.org/jira/browse/HADOOP-9025) | org.apache.hadoop.tools.TestCopyListing failing | Major | . | Robert Joseph Evans | Jonathan Eagles |
+| [HDFS-4181](https://issues.apache.org/jira/browse/HDFS-4181) | LeaseManager tries to double remove and prints extra messages | Critical | namenode | Kihwal Lee | Kihwal Lee |
+| [YARN-212](https://issues.apache.org/jira/browse/YARN-212) | NM state machine ignores an APPLICATION\_CONTAINER\_FINISHED event when it shouldn't | Blocker | nodemanager | Nathan Roberts | Nathan Roberts |
+| [HDFS-4139](https://issues.apache.org/jira/browse/HDFS-4139) | fuse-dfs RO mode still allows file truncation | Major | fuse-dfs | Andy Isaacson | Colin P. McCabe |
+| [HDFS-4182](https://issues.apache.org/jira/browse/HDFS-4182) | SecondaryNameNode leaks NameCache entries | Critical | namenode | Todd Lipcon | Robert Joseph Evans |
+| [MAPREDUCE-4797](https://issues.apache.org/jira/browse/MAPREDUCE-4797) | LocalContainerAllocator can loop forever trying to contact the RM | Major | applicationmaster | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4720](https://issues.apache.org/jira/browse/MAPREDUCE-4720) | Browser thinks History Server main page JS is taking too long | Major | . | Robert Joseph Evans | Ravi Prakash |
+| [HDFS-4104](https://issues.apache.org/jira/browse/HDFS-4104) | dfs -test -d prints inappropriate error on nonexistent directory | Minor | . | Andy Isaacson | Andy Isaacson |
| [HADOOP-6607](https://issues.apache.org/jira/browse/HADOOP-6607) | Add different variants of non caching HTTP headers | Minor | io | Steve Loughran | Alejandro Abdelnur |
-| [HDFS-4468](https://issues.apache.org/jira/browse/HDFS-4468) | Fix TestHDFSCLI and TestQuota for HADOOP-9252 | Minor | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-4462](https://issues.apache.org/jira/browse/HDFS-4462) | 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS | Major | namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-4458](https://issues.apache.org/jira/browse/HDFS-4458) | start balancer failed with "Failed to create file [/system/balancer.id]" if configure IP on fs.defaultFS | Major | balancer & mover | Wenwu Peng | Binglin Chang |
-| [HDFS-4452](https://issues.apache.org/jira/browse/HDFS-4452) | getAdditionalBlock() can create multiple blocks if the client times out and retries. | Critical | namenode | Konstantin Shvachko | Konstantin Shvachko |
-| [HDFS-4444](https://issues.apache.org/jira/browse/HDFS-4444) | Add space between total transaction time and number of transactions in FSEditLog#printStatistics | Trivial | . | Stephen Chu | Stephen Chu |
-| [HDFS-4443](https://issues.apache.org/jira/browse/HDFS-4443) | Remove trailing '`' character from HDFS nodelist jsp | Trivial | namenode | Christian Rohling | Christian Rohling |
-| [HDFS-4428](https://issues.apache.org/jira/browse/HDFS-4428) | FsDatasetImpl should disclose what the error is when a rename fails | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-4426](https://issues.apache.org/jira/browse/HDFS-4426) | Secondary namenode shuts down immediately after startup | Blocker | namenode | Jason Lowe | Arpit Agarwal |
-| [HDFS-4415](https://issues.apache.org/jira/browse/HDFS-4415) | HostnameFilter should handle hostname resolution failures and continue processing | Major | . | Robert Kanter | Robert Kanter |
-| [HDFS-4404](https://issues.apache.org/jira/browse/HDFS-4404) | Create file failure when the machine of first attempted NameNode is down | Critical | ha, hdfs-client | liaowenrui | Todd Lipcon |
-| [HDFS-4403](https://issues.apache.org/jira/browse/HDFS-4403) | DFSClient can infer checksum type when not provided by reading first byte | Minor | hdfs-client | Todd Lipcon | Todd Lipcon |
-| [HDFS-4385](https://issues.apache.org/jira/browse/HDFS-4385) | Maven RAT plugin is not checking all source files | Critical | build | Thomas Graves | Thomas Graves |
-| [HDFS-4384](https://issues.apache.org/jira/browse/HDFS-4384) | test\_libhdfs\_threaded gets SEGV if JNIEnv cannot be initialized | Minor | libhdfs | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-4377](https://issues.apache.org/jira/browse/HDFS-4377) | Some trivial DN comment cleanup | Trivial | . | Eli Collins | Eli Collins |
-| [HDFS-4363](https://issues.apache.org/jira/browse/HDFS-4363) | Combine PBHelper and HdfsProtoUtil and remove redundant methods | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-4359](https://issues.apache.org/jira/browse/HDFS-4359) | remove an unnecessary synchronized keyword in BPOfferService.java | Major | d
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[24/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.3/CHANGES.0.23.3.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.3/CHANGES.0.23.3.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.3/CHANGES.0.23.3.md
index 9b50eaf..4c8912e 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.3/CHANGES.0.23.3.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.3/CHANGES.0.23.3.md
@@ -24,17 +24,11 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8551](https://issues.apache.org/jira/browse/HADOOP-8551) | fs -mkdir creates parent directories without the -p option | Major | fs | Robert Joseph Evans | John George |
-| [HDFS-3318](https://issues.apache.org/jira/browse/HDFS-3318) | Hftp hangs on transfers \>2GB | Blocker | hdfs-client | Daryn Sharp | Daryn Sharp |
-| [MAPREDUCE-4311](https://issues.apache.org/jira/browse/MAPREDUCE-4311) | Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings | Major | capacity-sched, mrv2 | Thomas Graves | Karthik Kambatla |
| [MAPREDUCE-4072](https://issues.apache.org/jira/browse/MAPREDUCE-4072) | User set java.library.path seems to overwrite default creating problems native lib loading | Major | mrv2 | Anupam Seth | Anupam Seth |
| [MAPREDUCE-3812](https://issues.apache.org/jira/browse/MAPREDUCE-3812) | Lower default allocation sizes, fix allocation configurations and document them | Major | mrv2, performance | Vinod Kumar Vavilapalli | Harsh J |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-3318](https://issues.apache.org/jira/browse/HDFS-3318) | Hftp hangs on transfers \>2GB | Blocker | hdfs-client | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4311](https://issues.apache.org/jira/browse/MAPREDUCE-4311) | Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings | Major | capacity-sched, mrv2 | Thomas Graves | Karthik Kambatla |
+| [HADOOP-8551](https://issues.apache.org/jira/browse/HADOOP-8551) | fs -mkdir creates parent directories without the -p option | Major | fs | Robert Joseph Evans | John George |
### NEW FEATURES:
@@ -49,268 +43,268 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8700](https://issues.apache.org/jira/browse/HADOOP-8700) | Move the checksum type constants to an enum | Minor | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-8635](https://issues.apache.org/jira/browse/HADOOP-8635) | Cannot cancel paths registered deleteOnExit | Critical | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8535](https://issues.apache.org/jira/browse/HADOOP-8535) | Cut hadoop build times in half (upgrade maven-compiler-plugin to 2.5.1) | Major | build | Jonathan Eagles | Jonathan Eagles |
-| [HADOOP-8525](https://issues.apache.org/jira/browse/HADOOP-8525) | Provide Improved Traceability for Configuration | Trivial | . | Robert Joseph Evans | Robert Joseph Evans |
-| [HADOOP-8373](https://issues.apache.org/jira/browse/HADOOP-8373) | Port RPC.getServerAddress to 0.23 | Major | ipc | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8335](https://issues.apache.org/jira/browse/HADOOP-8335) | Improve Configuration's address handling | Major | util | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8286](https://issues.apache.org/jira/browse/HADOOP-8286) | Simplify getting a socket address from conf | Major | conf | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8242](https://issues.apache.org/jira/browse/HADOOP-8242) | AbstractDelegationTokenIdentifier: add getter methods for owner and realuser | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8240](https://issues.apache.org/jira/browse/HADOOP-8240) | Allow users to specify a checksum type on create() | Major | fs | Kihwal Lee | Kihwal Lee |
-| [HADOOP-8239](https://issues.apache.org/jira/browse/HADOOP-8239) | Extend MD5MD5CRC32FileChecksum to show the actual checksum type being used | Major | fs | Kihwal Lee | Kihwal Lee |
-| [HADOOP-8227](https://issues.apache.org/jira/browse/HADOOP-8227) | Allow RPC to limit ephemeral port range. | Blocker | . | Robert Joseph Evans | Robert Joseph Evans |
+| [HDFS-208](https://issues.apache.org/jira/browse/HDFS-208) | name node should warn if only one dir is listed in dfs.name.dir | Minor | namenode | Allen Wittenauer | Uma Maheswara Rao G |
+| [MAPREDUCE-3935](https://issues.apache.org/jira/browse/MAPREDUCE-3935) | Annotate Counters.Counter and Counters.Group as @Public | Major | client | Tom White | Tom White |
| [HADOOP-8141](https://issues.apache.org/jira/browse/HADOOP-8141) | Add method to init krb5 cipher suites | Trivial | security | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8242](https://issues.apache.org/jira/browse/HADOOP-8242) | AbstractDelegationTokenIdentifier: add getter methods for owner and realuser | Minor | . | Colin P. McCabe | Colin P. McCabe |
+| [MAPREDUCE-4059](https://issues.apache.org/jira/browse/MAPREDUCE-4059) | The history server should have a separate pluggable storage/query interface | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4017](https://issues.apache.org/jira/browse/MAPREDUCE-4017) | Add jobname to jobsummary log | Trivial | jobhistoryserver, jobtracker | Koji Noguchi | Thomas Graves |
| [HADOOP-7510](https://issues.apache.org/jira/browse/HADOOP-7510) | Tokens should use original hostname provided instead of ip | Major | security | Daryn Sharp | Daryn Sharp |
+| [HADOOP-8286](https://issues.apache.org/jira/browse/HADOOP-8286) | Simplify getting a socket address from conf | Major | conf | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4151](https://issues.apache.org/jira/browse/MAPREDUCE-4151) | RM scheduler web page should filter apps to those that are relevant to scheduling | Major | mrv2, webapps | Jason Lowe | Jason Lowe |
| [HDFS-2652](https://issues.apache.org/jira/browse/HDFS-2652) | Port token service changes from 205 | Major | . | Daryn Sharp | Daryn Sharp |
-| [HDFS-2421](https://issues.apache.org/jira/browse/HDFS-2421) | Improve the concurrency of SerialNumberMap in NameNode | Major | namenode | Hairong Kuang | Jing Zhao |
-| [HDFS-208](https://issues.apache.org/jira/browse/HDFS-208) | name node should warn if only one dir is listed in dfs.name.dir | Minor | namenode | Allen Wittenauer | Uma Maheswara Rao G |
-| [MAPREDUCE-4614](https://issues.apache.org/jira/browse/MAPREDUCE-4614) | Simplify debugging a job's tokens | Major | client, task | Daryn Sharp | Daryn Sharp |
-| [MAPREDUCE-4375](https://issues.apache.org/jira/browse/MAPREDUCE-4375) | Show Configuration Tracability in MR UI | Major | applicationmaster | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4301](https://issues.apache.org/jira/browse/MAPREDUCE-4301) | Dedupe some strings in MRAM for memory savings | Major | applicationmaster | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4283](https://issues.apache.org/jira/browse/MAPREDUCE-4283) | Display tail of aggregated logs by default | Major | jobhistoryserver, mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4210](https://issues.apache.org/jira/browse/MAPREDUCE-4210) | Expose listener address for WebApp | Major | webapps | Daryn Sharp | Daryn Sharp |
-| [MAPREDUCE-4205](https://issues.apache.org/jira/browse/MAPREDUCE-4205) | retrofit all JVM shutdown hooks to use ShutdownHookManager | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur |
| [MAPREDUCE-4190](https://issues.apache.org/jira/browse/MAPREDUCE-4190) | Improve web UI for task attempts userlog link | Major | mrv2, webapps | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4151](https://issues.apache.org/jira/browse/MAPREDUCE-4151) | RM scheduler web page should filter apps to those that are relevant to scheduling | Major | mrv2, webapps | Jason Lowe | Jason Lowe |
| [MAPREDUCE-4079](https://issues.apache.org/jira/browse/MAPREDUCE-4079) | Allow MR AppMaster to limit ephemeral port range. | Blocker | mr-am, mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4059](https://issues.apache.org/jira/browse/MAPREDUCE-4059) | The history server should have a separate pluggable storage/query interface | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4017](https://issues.apache.org/jira/browse/MAPREDUCE-4017) | Add jobname to jobsummary log | Trivial | jobhistoryserver, jobtracker | Koji Noguchi | Thomas Graves |
-| [MAPREDUCE-3935](https://issues.apache.org/jira/browse/MAPREDUCE-3935) | Annotate Counters.Counter and Counters.Group as @Public | Major | client | Tom White | Tom White |
-| [MAPREDUCE-3907](https://issues.apache.org/jira/browse/MAPREDUCE-3907) | Document entries mapred-default.xml for the jobhistory server. | Minor | documentation | Eugene Koontz | Eugene Koontz |
-| [MAPREDUCE-3906](https://issues.apache.org/jira/browse/MAPREDUCE-3906) | Fix inconsistency in documentation regarding mapreduce.jobhistory.principal | Trivial | documentation | Eugene Koontz | Eugene Koontz |
-| [MAPREDUCE-3871](https://issues.apache.org/jira/browse/MAPREDUCE-3871) | Allow symlinking in LocalJobRunner DistributedCache | Major | distributed-cache | Tom White | Tom White |
+| [HADOOP-8227](https://issues.apache.org/jira/browse/HADOOP-8227) | Allow RPC to limit ephemeral port range. | Blocker | . | Robert Joseph Evans | Robert Joseph Evans |
+| [HADOOP-8335](https://issues.apache.org/jira/browse/HADOOP-8335) | Improve Configuration's address handling | Major | util | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4210](https://issues.apache.org/jira/browse/MAPREDUCE-4210) | Expose listener address for WebApp | Major | webapps | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4205](https://issues.apache.org/jira/browse/MAPREDUCE-4205) | retrofit all JVM shutdown hooks to use ShutdownHookManager | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur |
| [MAPREDUCE-3850](https://issues.apache.org/jira/browse/MAPREDUCE-3850) | Avoid redundant calls for tokens in TokenCache | Major | security | Daryn Sharp | Daryn Sharp |
-| [MAPREDUCE-3842](https://issues.apache.org/jira/browse/MAPREDUCE-3842) | stop webpages from automatic refreshing | Critical | mrv2, webapps | Alejandro Abdelnur | Thomas Graves |
+| [HADOOP-8373](https://issues.apache.org/jira/browse/HADOOP-8373) | Port RPC.getServerAddress to 0.23 | Major | ipc | Daryn Sharp | Daryn Sharp |
| [MAPREDUCE-3659](https://issues.apache.org/jira/browse/MAPREDUCE-3659) | Host-based token support | Major | security | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4301](https://issues.apache.org/jira/browse/MAPREDUCE-4301) | Dedupe some strings in MRAM for memory savings | Major | applicationmaster | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-3842](https://issues.apache.org/jira/browse/MAPREDUCE-3842) | stop webpages from automatic refreshing | Critical | mrv2, webapps | Alejandro Abdelnur | Thomas Graves |
+| [MAPREDUCE-3871](https://issues.apache.org/jira/browse/MAPREDUCE-3871) | Allow symlinking in LocalJobRunner DistributedCache | Major | distributed-cache | Tom White | Tom White |
+| [HADOOP-8535](https://issues.apache.org/jira/browse/HADOOP-8535) | Cut hadoop build times in half (upgrade maven-compiler-plugin to 2.5.1) | Major | build | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-3907](https://issues.apache.org/jira/browse/MAPREDUCE-3907) | Document entries mapred-default.xml for the jobhistory server. | Minor | documentation | Eugene Koontz | Eugene Koontz |
+| [MAPREDUCE-3906](https://issues.apache.org/jira/browse/MAPREDUCE-3906) | Fix inconsistency in documentation regarding mapreduce.jobhistory.principal | Trivial | documentation | Eugene Koontz | Eugene Koontz |
+| [HADOOP-8525](https://issues.apache.org/jira/browse/HADOOP-8525) | Provide Improved Traceability for Configuration | Trivial | . | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4283](https://issues.apache.org/jira/browse/MAPREDUCE-4283) | Display tail of aggregated logs by default | Major | jobhistoryserver, mrv2 | Jason Lowe | Jason Lowe |
+| [HADOOP-8635](https://issues.apache.org/jira/browse/HADOOP-8635) | Cannot cancel paths registered deleteOnExit | Critical | fs | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4375](https://issues.apache.org/jira/browse/MAPREDUCE-4375) | Show Configuration Tracability in MR UI | Major | applicationmaster | Robert Joseph Evans | Robert Joseph Evans |
+| [HADOOP-8700](https://issues.apache.org/jira/browse/HADOOP-8700) | Move the checksum type constants to an enum | Minor | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-2421](https://issues.apache.org/jira/browse/HDFS-2421) | Improve the concurrency of SerialNumberMap in NameNode | Major | namenode | Hairong Kuang | Jing Zhao |
+| [HADOOP-8240](https://issues.apache.org/jira/browse/HADOOP-8240) | Allow users to specify a checksum type on create() | Major | fs | Kihwal Lee | Kihwal Lee |
+| [HADOOP-8239](https://issues.apache.org/jira/browse/HADOOP-8239) | Extend MD5MD5CRC32FileChecksum to show the actual checksum type being used | Major | fs | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-4614](https://issues.apache.org/jira/browse/MAPREDUCE-4614) | Simplify debugging a job's tokens | Major | client, task | Daryn Sharp | Daryn Sharp |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8727](https://issues.apache.org/jira/browse/HADOOP-8727) | Gracefully deprecate dfs.umaskmode in 2.x onwards | Major | conf | Harsh J | Harsh J |
-| [HADOOP-8726](https://issues.apache.org/jira/browse/HADOOP-8726) | The Secrets in Credentials are not available to MR tasks | Major | security | Benoy Antony | Daryn Sharp |
-| [HADOOP-8725](https://issues.apache.org/jira/browse/HADOOP-8725) | MR is broken when security is off | Blocker | security | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8709](https://issues.apache.org/jira/browse/HADOOP-8709) | globStatus changed behavior from 0.20/1.x | Critical | fs | Jason Lowe | Jason Lowe |
-| [HADOOP-8703](https://issues.apache.org/jira/browse/HADOOP-8703) | distcpV2: turn CRC checking off for 0 byte size | Major | . | Dave Thompson | Dave Thompson |
-| [HADOOP-8697](https://issues.apache.org/jira/browse/HADOOP-8697) | TestWritableName fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
-| [HADOOP-8695](https://issues.apache.org/jira/browse/HADOOP-8695) | TestPathData fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
-| [HADOOP-8693](https://issues.apache.org/jira/browse/HADOOP-8693) | TestSecurityUtil fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
-| [HADOOP-8692](https://issues.apache.org/jira/browse/HADOOP-8692) | TestLocalDirAllocator fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
-| [HADOOP-8637](https://issues.apache.org/jira/browse/HADOOP-8637) | FilterFileSystem#setWriteChecksum is broken | Critical | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8634](https://issues.apache.org/jira/browse/HADOOP-8634) | Ensure FileSystem#close doesn't squawk for deleteOnExit paths | Critical | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8633](https://issues.apache.org/jira/browse/HADOOP-8633) | Interrupted FsShell copies may leave tmp files | Critical | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8627](https://issues.apache.org/jira/browse/HADOOP-8627) | FS deleteOnExit may delete the wrong path | Critical | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8614](https://issues.apache.org/jira/browse/HADOOP-8614) | IOUtils#skipFully hangs forever on EOF | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8613](https://issues.apache.org/jira/browse/HADOOP-8613) | AbstractDelegationTokenIdentifier#getUser() should set token auth type | Critical | . | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8611](https://issues.apache.org/jira/browse/HADOOP-8611) | Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails | Major | security | Kihwal Lee | Robert Parker |
-| [HADOOP-8606](https://issues.apache.org/jira/browse/HADOOP-8606) | FileSystem.get may return the wrong filesystem | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8599](https://issues.apache.org/jira/browse/HADOOP-8599) | Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file | Major | fs | Andrey Klochkov | Andrey Klochkov |
-| [HADOOP-8587](https://issues.apache.org/jira/browse/HADOOP-8587) | HarFileSystem access of harMetaCache isn't threadsafe | Minor | fs | Eli Collins | Eli Collins |
-| [HADOOP-8573](https://issues.apache.org/jira/browse/HADOOP-8573) | Configuration tries to read from an inputstream resource multiple times. | Major | conf | Robert Joseph Evans | Robert Joseph Evans |
-| [HADOOP-8550](https://issues.apache.org/jira/browse/HADOOP-8550) | hadoop fs -touchz automatically created parent directories | Major | fs | Robert Joseph Evans | John George |
-| [HADOOP-8543](https://issues.apache.org/jira/browse/HADOOP-8543) | Invalid pom.xml files on 0.23 branch | Major | build | Radim Kolar | Radim Kolar |
-| [HADOOP-8501](https://issues.apache.org/jira/browse/HADOOP-8501) | Gridmix fails to compile on OpenJDK7u4 | Major | benchmarks | Radim Kolar | Radim Kolar |
-| [HADOOP-8495](https://issues.apache.org/jira/browse/HADOOP-8495) | Update Netty to avoid leaking file descriptors during shuffle | Critical | build | Jason Lowe | Jason Lowe |
-| [HADOOP-8450](https://issues.apache.org/jira/browse/HADOOP-8450) | Remove src/test/system | Trivial | test | Colin Patrick McCabe | Eli Collins |
-| [HADOOP-8393](https://issues.apache.org/jira/browse/HADOOP-8393) | hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster | Major | scripts | Patrick Hunt | Patrick Hunt |
-| [HADOOP-8390](https://issues.apache.org/jira/browse/HADOOP-8390) | TestFileSystemCanonicalization fails with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
-| [HADOOP-8370](https://issues.apache.org/jira/browse/HADOOP-8370) | Native build failure: javah: class file for org.apache.hadoop.classification.InterfaceAudience not found | Major | native | Trevor Robinson | Trevor Robinson |
-| [HADOOP-8342](https://issues.apache.org/jira/browse/HADOOP-8342) | HDFS command fails with exception following merge of HADOOP-8325 | Major | fs | Randy Clayton | Alejandro Abdelnur |
-| [HADOOP-8341](https://issues.apache.org/jira/browse/HADOOP-8341) | Fix or filter findbugs issues in hadoop-tools | Major | . | Robert Joseph Evans | Robert Joseph Evans |
+| [HADOOP-7621](https://issues.apache.org/jira/browse/HADOOP-7621) | alfredo config should be in a file not readable by users | Critical | security | Alejandro Abdelnur | Aaron T. Myers |
+| [HDFS-2285](https://issues.apache.org/jira/browse/HDFS-2285) | BackupNode should reject requests trying to modify namespace | Major | namenode | Konstantin Shvachko | Konstantin Shvachko |
+| [HADOOP-8104](https://issues.apache.org/jira/browse/HADOOP-8104) | Inconsistent Jackson versions | Major | . | Colin P. McCabe | Alejandro Abdelnur |
+| [MAPREDUCE-3728](https://issues.apache.org/jira/browse/MAPREDUCE-3728) | ShuffleHandler can't access results when configured in a secure mode | Critical | mrv2, nodemanager | Roman Shaposhnik | Ding Yuan |
+| [HDFS-3037](https://issues.apache.org/jira/browse/HDFS-3037) | TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy | Minor | test | Aaron T. Myers | Aaron T. Myers |
+| [MAPREDUCE-3348](https://issues.apache.org/jira/browse/MAPREDUCE-3348) | mapred job -status fails to give info even if the job is present in History | Major | mrv2 | Devaraj K | Devaraj K |
+| [HADOOP-8167](https://issues.apache.org/jira/browse/HADOOP-8167) | Configuration deprecation logic breaks backwards compatibility | Blocker | conf | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3067](https://issues.apache.org/jira/browse/HDFS-3067) | NPE in DFSInputStream.readBuffer if read is repeated on corrupted block | Major | hdfs-client | Henry Robinson | Henry Robinson |
+| [MAPREDUCE-4010](https://issues.apache.org/jira/browse/MAPREDUCE-4010) | TestWritableJobConf fails on trunk | Critical | mrv2 | Jason Lowe | Alejandro Abdelnur |
+| [HADOOP-8197](https://issues.apache.org/jira/browse/HADOOP-8197) | Configuration logs WARNs on every use of a deprecated key | Critical | conf | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-3992](https://issues.apache.org/jira/browse/MAPREDUCE-3992) | Reduce fetcher doesn't verify HTTP status code of response | Major | mrv1 | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-4082](https://issues.apache.org/jira/browse/MAPREDUCE-4082) | hadoop-mapreduce-client-app's mrapp-generated-classpath file should not be in the module JAR | Critical | build | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-4091](https://issues.apache.org/jira/browse/MAPREDUCE-4091) | tools testcases failing because of MAPREDUCE-4082 | Critical | build, test | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-4092](https://issues.apache.org/jira/browse/MAPREDUCE-4092) | commitJob Exception does not fail job (regression in 0.23 vs 0.20) | Blocker | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-4089](https://issues.apache.org/jira/browse/MAPREDUCE-4089) | Hung Tasks never time out. | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4024](https://issues.apache.org/jira/browse/MAPREDUCE-4024) | RM webservices can't query on finalStatus | Major | mrv2 | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4060](https://issues.apache.org/jira/browse/MAPREDUCE-4060) | Multiple SLF4J binding warning | Major | build | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4012](https://issues.apache.org/jira/browse/MAPREDUCE-4012) | Hadoop Job setup error leaves no useful info to users (when LinuxTaskController is used) | Minor | . | Koji Noguchi | Thomas Graves |
+| [MAPREDUCE-4062](https://issues.apache.org/jira/browse/MAPREDUCE-4062) | AM Launcher thread can hang forever | Major | mrv2 | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-3988](https://issues.apache.org/jira/browse/MAPREDUCE-3988) | mapreduce.job.local.dir doesn't point to a single directory on a node. | Major | mrv2 | Vinod Kumar Vavilapalli | Eric Payne |
+| [HDFS-3166](https://issues.apache.org/jira/browse/HDFS-3166) | Hftp connections do not have a timeout | Critical | hdfs-client | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-3999](https://issues.apache.org/jira/browse/MAPREDUCE-3999) | Tracking link gives an error if the AppMaster hasn't started yet | Major | mrv2, webapps | Ravi Prakash | Ravi Prakash |
+| [HDFS-3176](https://issues.apache.org/jira/browse/HDFS-3176) | JsonUtil should not parse the MD5MD5CRC32FileChecksum bytes on its own. | Major | hdfs-client | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-4020](https://issues.apache.org/jira/browse/MAPREDUCE-4020) | Web services returns incorrect JSON for deep queue tree | Major | mrv2, webapps | Jason Lowe | Anupam Seth |
+| [MAPREDUCE-3672](https://issues.apache.org/jira/browse/MAPREDUCE-3672) | Killed maps shouldn't be counted towards JobCounter.NUM\_FAILED\_MAPS | Major | mr-am, mrv2 | Vinod Kumar Vavilapalli | Anupam Seth |
+| [MAPREDUCE-3682](https://issues.apache.org/jira/browse/MAPREDUCE-3682) | Tracker URL says AM tasks run on localhost | Major | mrv2 | David Capwell | Ravi Prakash |
+| [MAPREDUCE-3082](https://issues.apache.org/jira/browse/MAPREDUCE-3082) | archive command take wrong path for input file with current directory | Major | harchive | Rajit Saha | John George |
+| [MAPREDUCE-3650](https://issues.apache.org/jira/browse/MAPREDUCE-3650) | testGetTokensForHftpFS() fails | Blocker | mrv2 | Thomas Graves | Ravi Prakash |
+| [HADOOP-8088](https://issues.apache.org/jira/browse/HADOOP-8088) | User-group mapping cache incorrectly does negative caching on transient failures | Major | security | Kihwal Lee | Kihwal Lee |
+| [HADOOP-8179](https://issues.apache.org/jira/browse/HADOOP-8179) | risk of NPE in CopyCommands processArguments() | Minor | fs | Steve Loughran | Daryn Sharp |
+| [MAPREDUCE-4097](https://issues.apache.org/jira/browse/MAPREDUCE-4097) | tools testcases fail because missing mrapp-generated-classpath file in classpath | Major | build | Alejandro Abdelnur | Roman Shaposhnik |
+| [HADOOP-8180](https://issues.apache.org/jira/browse/HADOOP-8180) | Remove hsqldb since its not needed from pom.xml | Major | . | Ravi Prakash | Ravi Prakash |
+| [HADOOP-6963](https://issues.apache.org/jira/browse/HADOOP-6963) | Fix FileUtil.getDU. It should not include the size of the directory or follow symbolic links | Critical | fs | Owen O'Malley | Ravi Prakash |
+| [MAPREDUCE-3621](https://issues.apache.org/jira/browse/MAPREDUCE-3621) | TestDBJob and TestDataDrivenDBInputFormat ant tests fail | Major | mrv2 | Thomas Graves | Ravi Prakash |
+| [MAPREDUCE-4073](https://issues.apache.org/jira/browse/MAPREDUCE-4073) | CS assigns multiple off-switch containers when using multi-level-queues | Critical | mrv2, scheduler | Siddharth Seth | Siddharth Seth |
+| [HDFS-3136](https://issues.apache.org/jira/browse/HDFS-3136) | Multiple SLF4J binding warning | Major | build | Jason Lowe | Jason Lowe |
+| [HADOOP-8014](https://issues.apache.org/jira/browse/HADOOP-8014) | ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary | Major | fs | Daryn Sharp | John George |
+| [MAPREDUCE-4117](https://issues.apache.org/jira/browse/MAPREDUCE-4117) | mapred job -status throws NullPointerException | Critical | client, mrv2 | Devaraj K | Devaraj K |
+| [MAPREDUCE-4040](https://issues.apache.org/jira/browse/MAPREDUCE-4040) | History links should use hostname rather than IP address. | Minor | jobhistoryserver, mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh |
+| [MAPREDUCE-4099](https://issues.apache.org/jira/browse/MAPREDUCE-4099) | ApplicationMaster may fail to remove staging directory | Critical | mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-3932](https://issues.apache.org/jira/browse/MAPREDUCE-3932) | MR tasks failing and crashing the AM when available-resources/headRoom becomes zero | Critical | mr-am, mrv2 | Vinod Kumar Vavilapalli | Robert Joseph Evans |
+| [MAPREDUCE-4140](https://issues.apache.org/jira/browse/MAPREDUCE-4140) | mapreduce classes incorrectly importing "clover.org.apache.\*" classes | Major | client, mrv2 | Patrick Hunt | Patrick Hunt |
+| [HADOOP-8144](https://issues.apache.org/jira/browse/HADOOP-8144) | pseudoSortByDistance in NetworkTopology doesn't work properly if no local node and first node is local rack node | Minor | io | Junping Du | Junping Du |
+| [MAPREDUCE-4050](https://issues.apache.org/jira/browse/MAPREDUCE-4050) | Invalid node link | Major | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh |
+| [MAPREDUCE-4128](https://issues.apache.org/jira/browse/MAPREDUCE-4128) | AM Recovery expects all attempts of a completed task to also be completed. | Major | mrv2 | Bikas Saha | Bikas Saha |
+| [HADOOP-8005](https://issues.apache.org/jira/browse/HADOOP-8005) | Multiple SLF4J binding message in .out file for all daemons | Major | scripts | Joe Crobak | Jason Lowe |
+| [MAPREDUCE-4144](https://issues.apache.org/jira/browse/MAPREDUCE-4144) | ResourceManager NPE while handling NODE\_UPDATE | Critical | mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4156](https://issues.apache.org/jira/browse/MAPREDUCE-4156) | ant build fails compiling JobInProgress | Major | build | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4160](https://issues.apache.org/jira/browse/MAPREDUCE-4160) | some mrv1 ant tests fail with timeout - due to 4156 | Major | test | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4139](https://issues.apache.org/jira/browse/MAPREDUCE-4139) | Potential ResourceManager deadlock when SchedulerEventDispatcher is stopped | Major | mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4074](https://issues.apache.org/jira/browse/MAPREDUCE-4074) | Client continuously retries to RM When RM goes down before launching Application Master | Major | . | Devaraj K | xieguiming |
+| [HADOOP-8288](https://issues.apache.org/jira/browse/HADOOP-8288) | Remove references of mapred.child.ulimit etc. since they are not being used any more | Major | . | Ravi Prakash | Ravi Prakash |
+| [MAPREDUCE-4159](https://issues.apache.org/jira/browse/MAPREDUCE-4159) | Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero | Major | mrv2 | Nishan Shetty | Devaraj K |
+| [MAPREDUCE-4165](https://issues.apache.org/jira/browse/MAPREDUCE-4165) | Committing is misspelled as commiting in task logs | Trivial | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-4129](https://issues.apache.org/jira/browse/MAPREDUCE-4129) | Lots of unneeded counters log messages | Major | mrv2 | Ahmed Radwan | Ahmed Radwan |
+| [MAPREDUCE-3947](https://issues.apache.org/jira/browse/MAPREDUCE-3947) | yarn.app.mapreduce.am.resource.mb not documented | Minor | . | Todd Lipcon | Devaraj K |
+| [HDFS-3308](https://issues.apache.org/jira/browse/HDFS-3308) | hftp/webhdfs can't get tokens if authority has no port | Critical | webhdfs | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4133](https://issues.apache.org/jira/browse/MAPREDUCE-4133) | MR over viewfs is broken | Major | . | John George | John George |
+| [HDFS-3312](https://issues.apache.org/jira/browse/HDFS-3312) | Hftp selects wrong token service | Blocker | hdfs-client | Daryn Sharp | Daryn Sharp |
+| [HDFS-3321](https://issues.apache.org/jira/browse/HDFS-3321) | Error message for insufficient data nodes to come out of safemode is wrong. | Major | . | Ravi Prakash | Ravi Prakash |
+| [MAPREDUCE-4194](https://issues.apache.org/jira/browse/MAPREDUCE-4194) | ConcurrentModificationError in DirectoryCollection | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-4169](https://issues.apache.org/jira/browse/MAPREDUCE-4169) | Container Logs appear in unsorted order | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-4189](https://issues.apache.org/jira/browse/MAPREDUCE-4189) | TestContainerManagerSecurity is failing | Critical | mrv2 | Devaraj K | Devaraj K |
+| [HADOOP-8305](https://issues.apache.org/jira/browse/HADOOP-8305) | distcp over viewfs is broken | Major | viewfs | John George | John George |
+| [HDFS-3334](https://issues.apache.org/jira/browse/HDFS-3334) | ByteRangeInputStream leaks streams | Major | hdfs-client | Daryn Sharp | Daryn Sharp |
+| [HDFS-3331](https://issues.apache.org/jira/browse/HDFS-3331) | setBalancerBandwidth do not checkSuperuserPrivilege | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-4209](https://issues.apache.org/jira/browse/MAPREDUCE-4209) | junit dependency in hadoop-mapreduce-client is missing scope test | Major | build | Radim Kolar | |
+| [MAPREDUCE-4206](https://issues.apache.org/jira/browse/MAPREDUCE-4206) | Sorting by Last Health-Update on the RM nodes page sorts does not work correctly | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
| [HADOOP-8334](https://issues.apache.org/jira/browse/HADOOP-8334) | HttpServer sometimes returns incorrect port | Major | . | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8330](https://issues.apache.org/jira/browse/HADOOP-8330) | TestSequenceFile.testCreateUsesFsArg() is broken | Minor | test | John George | John George |
-| [HADOOP-8328](https://issues.apache.org/jira/browse/HADOOP-8328) | Duplicate FileSystem Statistics object for 'file' scheme | Major | fs | Tom White | Tom White |
-| [HADOOP-8327](https://issues.apache.org/jira/browse/HADOOP-8327) | distcpv2 and distcpv1 jars should not coexist | Major | . | Dave Thompson | Dave Thompson |
| [HADOOP-8325](https://issues.apache.org/jira/browse/HADOOP-8325) | Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook | Critical | fs | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-8330](https://issues.apache.org/jira/browse/HADOOP-8330) | TestSequenceFile.testCreateUsesFsArg() is broken | Minor | test | John George | John George |
+| [MAPREDUCE-4211](https://issues.apache.org/jira/browse/MAPREDUCE-4211) | Error conditions (missing appid, appid not found) are masked in the RM app page | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
| [HADOOP-8317](https://issues.apache.org/jira/browse/HADOOP-8317) | Update maven-assembly-plugin to 2.3 - fix build on FreeBSD | Major | build | Radim Kolar | |
-| [HADOOP-8305](https://issues.apache.org/jira/browse/HADOOP-8305) | distcp over viewfs is broken | Major | viewfs | John George | John George |
-| [HADOOP-8288](https://issues.apache.org/jira/browse/HADOOP-8288) | Remove references of mapred.child.ulimit etc. since they are not being used any more | Major | . | Ravi Prakash | Ravi Prakash |
-| [HADOOP-8225](https://issues.apache.org/jira/browse/HADOOP-8225) | DistCp fails when invoked by Oozie | Blocker | security | Mithun Radhakrishnan | Daryn Sharp |
-| [HADOOP-8197](https://issues.apache.org/jira/browse/HADOOP-8197) | Configuration logs WARNs on every use of a deprecated key | Critical | conf | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8180](https://issues.apache.org/jira/browse/HADOOP-8180) | Remove hsqldb since its not needed from pom.xml | Major | . | Ravi Prakash | Ravi Prakash |
-| [HADOOP-8179](https://issues.apache.org/jira/browse/HADOOP-8179) | risk of NPE in CopyCommands processArguments() | Minor | fs | Steve Loughran | Daryn Sharp |
| [HADOOP-8172](https://issues.apache.org/jira/browse/HADOOP-8172) | Configuration no longer sets all keys in a deprecated key list. | Critical | conf | Robert Joseph Evans | Anupam Seth |
-| [HADOOP-8167](https://issues.apache.org/jira/browse/HADOOP-8167) | Configuration deprecation logic breaks backwards compatibility | Blocker | conf | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8144](https://issues.apache.org/jira/browse/HADOOP-8144) | pseudoSortByDistance in NetworkTopology doesn't work properly if no local node and first node is local rack node | Minor | io | Junping Du | Junping Du |
+| [HADOOP-8342](https://issues.apache.org/jira/browse/HADOOP-8342) | HDFS command fails with exception following merge of HADOOP-8325 | Major | fs | Randy Clayton | Alejandro Abdelnur |
+| [HDFS-3359](https://issues.apache.org/jira/browse/HDFS-3359) | DFSClient.close should close cached sockets | Critical | hdfs-client | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-4048](https://issues.apache.org/jira/browse/MAPREDUCE-4048) | NullPointerException exception while accessing the Application Master UI | Major | mrv2 | Devaraj K | Devaraj K |
+| [HADOOP-8327](https://issues.apache.org/jira/browse/HADOOP-8327) | distcpv2 and distcpv1 jars should not coexist | Major | . | Dave Thompson | Dave Thompson |
+| [HADOOP-8328](https://issues.apache.org/jira/browse/HADOOP-8328) | Duplicate FileSystem Statistics object for 'file' scheme | Major | fs | Tom White | Tom White |
+| [MAPREDUCE-4220](https://issues.apache.org/jira/browse/MAPREDUCE-4220) | RM apps page starttime/endtime sorts are incorrect | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-4226](https://issues.apache.org/jira/browse/MAPREDUCE-4226) | ConcurrentModificationException in FileSystemCounterGroup | Major | mrv2 | Tom White | Tom White |
+| [HADOOP-8341](https://issues.apache.org/jira/browse/HADOOP-8341) | Fix or filter findbugs issues in hadoop-tools | Major | . | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4215](https://issues.apache.org/jira/browse/MAPREDUCE-4215) | RM app page shows 500 error on appid parse error | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-4237](https://issues.apache.org/jira/browse/MAPREDUCE-4237) | TestNodeStatusUpdater can fail if localhost has a domain associated with it | Major | . | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4233](https://issues.apache.org/jira/browse/MAPREDUCE-4233) | NPE can happen in RMNMNodeInfo. | Critical | . | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4238](https://issues.apache.org/jira/browse/MAPREDUCE-4238) | mavenize data\_join | Critical | mrv2 | Thomas Graves | Thomas Graves |
+| [HADOOP-8393](https://issues.apache.org/jira/browse/HADOOP-8393) | hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster | Major | scripts | Patrick Hunt | Patrick Hunt |
+| [MAPREDUCE-4250](https://issues.apache.org/jira/browse/MAPREDUCE-4250) | hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster | Major | nodemanager | Patrick Hunt | Patrick Hunt |
+| [MAPREDUCE-4102](https://issues.apache.org/jira/browse/MAPREDUCE-4102) | job counters not available in Jobhistory webui for killed jobs | Major | webapps | Thomas Graves | Bhallamudi Venkata Siva Kamesh |
+| [MAPREDUCE-4264](https://issues.apache.org/jira/browse/MAPREDUCE-4264) | Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true | Blocker | mrv2 | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-3543](https://issues.apache.org/jira/browse/MAPREDUCE-3543) | Mavenize Gridmix. | Critical | mrv2 | Mahadev konar | Thomas Graves |
+| [MAPREDUCE-4197](https://issues.apache.org/jira/browse/MAPREDUCE-4197) | Include the hsqldb jar in the hadoop-mapreduce tar file | Major | . | Ravi Prakash | Ravi Prakash |
+| [MAPREDUCE-4269](https://issues.apache.org/jira/browse/MAPREDUCE-4269) | documentation: Gridmix has javadoc warnings in StressJobFactory | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-3870](https://issues.apache.org/jira/browse/MAPREDUCE-3870) | Invalid App Metrics | Major | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh |
+| [MAPREDUCE-4152](https://issues.apache.org/jira/browse/MAPREDUCE-4152) | map task left hanging after AM dies trying to connect to RM | Major | mrv2 | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4297](https://issues.apache.org/jira/browse/MAPREDUCE-4297) | Usersmap file in gridmix should not fail on empty lines | Major | contrib/gridmix | Ravi Prakash | Ravi Prakash |
+| [HDFS-3486](https://issues.apache.org/jira/browse/HDFS-3486) | offlineimageviewer can't read fsimage files that contain persistent delegation tokens | Minor | security, tools | Colin P. McCabe | Colin P. McCabe |
+| [MAPREDUCE-4302](https://issues.apache.org/jira/browse/MAPREDUCE-4302) | NM goes down if error encountered during log aggregation | Critical | nodemanager | Daryn Sharp | Daryn Sharp |
+| [HDFS-3442](https://issues.apache.org/jira/browse/HDFS-3442) | Incorrect count for Missing Replicas in FSCK report | Minor | . | suja s | Andrew Wang |
+| [MAPREDUCE-4307](https://issues.apache.org/jira/browse/MAPREDUCE-4307) | TeraInputFormat calls FileSystem.getDefaultBlockSize() without a Path - Failure when using ViewFileSystem | Major | mrv2 | Ahmed Radwan | Ahmed Radwan |
+| [HADOOP-8450](https://issues.apache.org/jira/browse/HADOOP-8450) | Remove src/test/system | Trivial | test | Colin P. McCabe | Eli Collins |
+| [MAPREDUCE-3350](https://issues.apache.org/jira/browse/MAPREDUCE-3350) | Per-app RM page should have the list of application-attempts like on the app JHS page | Critical | mrv2, webapps | Vinod Kumar Vavilapalli | Jonathan Eagles |
+| [MAPREDUCE-3927](https://issues.apache.org/jira/browse/MAPREDUCE-3927) | Shuffle hang when set map.failures.percent | Critical | mrv2 | MengWang | Bhallamudi Venkata Siva Kamesh |
+| [HADOOP-8501](https://issues.apache.org/jira/browse/HADOOP-8501) | Gridmix fails to compile on OpenJDK7u4 | Major | benchmarks | Radim Kolar | Radim Kolar |
+| [HADOOP-8495](https://issues.apache.org/jira/browse/HADOOP-8495) | Update Netty to avoid leaking file descriptors during shuffle | Critical | build | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4341](https://issues.apache.org/jira/browse/MAPREDUCE-4341) | add types to capacity scheduler properties documentation | Major | capacity-sched, mrv2 | Thomas Graves | Karthik Kambatla |
+| [MAPREDUCE-4267](https://issues.apache.org/jira/browse/MAPREDUCE-4267) | mavenize pipes | Critical | mrv2 | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4270](https://issues.apache.org/jira/browse/MAPREDUCE-4270) | data\_join test classes are in the wrong packge | Major | mrv2 | Brock Noland | Thomas Graves |
+| [MAPREDUCE-3889](https://issues.apache.org/jira/browse/MAPREDUCE-3889) | job client tries to use /tasklog interface, but that doesn't exist anymore | Critical | mrv2 | Thomas Graves | Devaraj K |
+| [MAPREDUCE-4320](https://issues.apache.org/jira/browse/MAPREDUCE-4320) | gridmix mainClass wrong in pom.xml | Major | contrib/gridmix | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4295](https://issues.apache.org/jira/browse/MAPREDUCE-4295) | RM crashes due to DNS issue | Critical | mrv2, resourcemanager | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4031](https://issues.apache.org/jira/browse/MAPREDUCE-4031) | Node Manager hangs on shut down | Critical | mrv2, nodemanager | Devaraj K | Devaraj K |
+| [MAPREDUCE-4361](https://issues.apache.org/jira/browse/MAPREDUCE-4361) | Fix detailed metrics for protobuf-based RPC on 0.23 | Major | mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4290](https://issues.apache.org/jira/browse/MAPREDUCE-4290) | JobStatus.getState() API is giving ambiguous values | Major | mrv2 | Nishan Shetty | Devaraj K |
+| [MAPREDUCE-2289](https://issues.apache.org/jira/browse/MAPREDUCE-2289) | Permissions race can make getStagingDir fail on local filesystem | Major | job submission | Todd Lipcon | Ahmed Radwan |
| [HADOOP-8129](https://issues.apache.org/jira/browse/HADOOP-8129) | ViewFileSystemTestSetup setupForViewFileSystem is erring when the user's home directory is somewhere other than /home (eg. /User) etc. | Major | fs, test | Ravi Prakash | Ahmed Radwan |
+| [MAPREDUCE-4228](https://issues.apache.org/jira/browse/MAPREDUCE-4228) | mapreduce.job.reduce.slowstart.completedmaps is not working properly to delay the scheduling of the reduce tasks | Major | applicationmaster, mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4372](https://issues.apache.org/jira/browse/MAPREDUCE-4372) | Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager | Major | mrv2, resourcemanager | Devaraj K | Devaraj K |
+| [MAPREDUCE-4376](https://issues.apache.org/jira/browse/MAPREDUCE-4376) | TestClusterMRNotification times out | Major | mrv2, test | Jason Lowe | Kihwal Lee |
| [HADOOP-8110](https://issues.apache.org/jira/browse/HADOOP-8110) | TestViewFsTrash occasionally fails | Major | fs | Tsz Wo Nicholas Sze | Jason Lowe |
-| [HADOOP-8104](https://issues.apache.org/jira/browse/HADOOP-8104) | Inconsistent Jackson versions | Major | . | Colin Patrick McCabe | Alejandro Abdelnur |
-| [HADOOP-8088](https://issues.apache.org/jira/browse/HADOOP-8088) | User-group mapping cache incorrectly does negative caching on transient failures | Major | security | Kihwal Lee | Kihwal Lee |
-| [HADOOP-8060](https://issues.apache.org/jira/browse/HADOOP-8060) | Add a capability to discover and set checksum types per file. | Major | fs, util | Kihwal Lee | Kihwal Lee |
-| [HADOOP-8014](https://issues.apache.org/jira/browse/HADOOP-8014) | ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary | Major | fs | Daryn Sharp | John George |
-| [HADOOP-8005](https://issues.apache.org/jira/browse/HADOOP-8005) | Multiple SLF4J binding message in .out file for all daemons | Major | scripts | Joe Crobak | Jason Lowe |
-| [HADOOP-7967](https://issues.apache.org/jira/browse/HADOOP-7967) | Need generalized multi-token filesystem support | Critical | fs, security | Daryn Sharp | Daryn Sharp |
-| [HADOOP-7621](https://issues.apache.org/jira/browse/HADOOP-7621) | alfredo config should be in a file not readable by users | Critical | security | Alejandro Abdelnur | Aaron T. Myers |
-| [HADOOP-6963](https://issues.apache.org/jira/browse/HADOOP-6963) | Fix FileUtil.getDU. It should not include the size of the directory or follow symbolic links | Critical | fs | Owen O'Malley | Ravi Prakash |
-| [HDFS-3890](https://issues.apache.org/jira/browse/HDFS-3890) | filecontext mkdirs doesn't apply umask as expected | Critical | . | Thomas Graves | Thomas Graves |
-| [HDFS-3873](https://issues.apache.org/jira/browse/HDFS-3873) | Hftp assumes security is disabled if token fetch fails | Major | hdfs-client | Daryn Sharp | Daryn Sharp |
-| [HDFS-3861](https://issues.apache.org/jira/browse/HDFS-3861) | Deadlock in DFSClient | Blocker | hdfs-client | Kihwal Lee | Kihwal Lee |
-| [HDFS-3852](https://issues.apache.org/jira/browse/HDFS-3852) | TestHftpDelegationToken is broken after HADOOP-8225 | Major | hdfs-client, security | Aaron T. Myers | Daryn Sharp |
-| [HDFS-3841](https://issues.apache.org/jira/browse/HDFS-3841) | Port HDFS-3835 to branch-0.23 | Major | . | Robert Joseph Evans | Robert Joseph Evans |
-| [HDFS-3794](https://issues.apache.org/jira/browse/HDFS-3794) | WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header. | Major | webhdfs | Ravi Prakash | Ravi Prakash |
-| [HDFS-3788](https://issues.apache.org/jira/browse/HDFS-3788) | distcp can't copy large files using webhdfs due to missing Content-Length header | Critical | webhdfs | Eli Collins | Tsz Wo Nicholas Sze |
-| [HDFS-3718](https://issues.apache.org/jira/browse/HDFS-3718) | Datanode won't shutdown because of runaway DataBlockScanner thread | Critical | datanode | Kihwal Lee | Kihwal Lee |
-| [HDFS-3696](https://issues.apache.org/jira/browse/HDFS-3696) | Create files with WebHdfsFileSystem goes OOM when file size is big | Critical | webhdfs | Kihwal Lee | Tsz Wo Nicholas Sze |
-| [HDFS-3688](https://issues.apache.org/jira/browse/HDFS-3688) | Namenode loses datanode hostname if datanode re-registers | Major | datanode | Jason Lowe | Jason Lowe |
-| [HDFS-3646](https://issues.apache.org/jira/browse/HDFS-3646) | LeaseRenewer can hold reference to inactive DFSClient instances forever | Critical | hdfs-client | Kihwal Lee | Kihwal Lee |
-| [HDFS-3622](https://issues.apache.org/jira/browse/HDFS-3622) | Backport HDFS-3541 to branch-0.23 | Major | . | Robert Joseph Evans | Robert Joseph Evans |
-| [HDFS-3603](https://issues.apache.org/jira/browse/HDFS-3603) | Decouple TestHDFSTrash from TestTrash | Major | test | Jason Lowe | Jason Lowe |
-| [HDFS-3597](https://issues.apache.org/jira/browse/HDFS-3597) | SNN can fail to start on upgrade | Minor | namenode | Andy Isaacson | Andy Isaacson |
-| [HDFS-3591](https://issues.apache.org/jira/browse/HDFS-3591) | Backport HDFS-3357 to branch-0.23 | Major | . | Robert Joseph Evans | Robert Joseph Evans |
| [HDFS-3581](https://issues.apache.org/jira/browse/HDFS-3581) | FSPermissionChecker#checkPermission sticky bit check missing range check | Major | namenode | Eli Collins | Eli Collins |
-| [HDFS-3577](https://issues.apache.org/jira/browse/HDFS-3577) | WebHdfsFileSystem can not read files larger than 24KB | Blocker | webhdfs | Alejandro Abdelnur | Tsz Wo Nicholas Sze |
-| [HDFS-3486](https://issues.apache.org/jira/browse/HDFS-3486) | offlineimageviewer can't read fsimage files that contain persistent delegation tokens | Minor | security, tools | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3442](https://issues.apache.org/jira/browse/HDFS-3442) | Incorrect count for Missing Replicas in FSCK report | Minor | . | suja s | Andrew Wang |
-| [HDFS-3359](https://issues.apache.org/jira/browse/HDFS-3359) | DFSClient.close should close cached sockets | Critical | hdfs-client | Todd Lipcon | Todd Lipcon |
-| [HDFS-3334](https://issues.apache.org/jira/browse/HDFS-3334) | ByteRangeInputStream leaks streams | Major | hdfs-client | Daryn Sharp | Daryn Sharp |
-| [HDFS-3331](https://issues.apache.org/jira/browse/HDFS-3331) | setBalancerBandwidth do not checkSuperuserPrivilege | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-3321](https://issues.apache.org/jira/browse/HDFS-3321) | Error message for insufficient data nodes to come out of safemode is wrong. | Major | . | Ravi Prakash | Ravi Prakash |
-| [HDFS-3312](https://issues.apache.org/jira/browse/HDFS-3312) | Hftp selects wrong token service | Blocker | hdfs-client | Daryn Sharp | Daryn Sharp |
-| [HDFS-3308](https://issues.apache.org/jira/browse/HDFS-3308) | hftp/webhdfs can't get tokens if authority has no port | Critical | webhdfs | Daryn Sharp | Daryn Sharp |
-| [HDFS-3177](https://issues.apache.org/jira/browse/HDFS-3177) | Allow DFSClient to find out and use the CRC type being used for a file. | Major | datanode, hdfs-client | Kihwal Lee | Kihwal Lee |
-| [HDFS-3176](https://issues.apache.org/jira/browse/HDFS-3176) | JsonUtil should not parse the MD5MD5CRC32FileChecksum bytes on its own. | Major | hdfs-client | Kihwal Lee | Kihwal Lee |
-| [HDFS-3166](https://issues.apache.org/jira/browse/HDFS-3166) | Hftp connections do not have a timeout | Critical | hdfs-client | Daryn Sharp | Daryn Sharp |
-| [HDFS-3136](https://issues.apache.org/jira/browse/HDFS-3136) | Multiple SLF4J binding warning | Major | build | Jason Lowe | Jason Lowe |
-| [HDFS-3067](https://issues.apache.org/jira/browse/HDFS-3067) | NPE in DFSInputStream.readBuffer if read is repeated on corrupted block | Major | hdfs-client | Henry Robinson | Henry Robinson |
-| [HDFS-3037](https://issues.apache.org/jira/browse/HDFS-3037) | TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy | Minor | test | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-2285](https://issues.apache.org/jira/browse/HDFS-2285) | BackupNode should reject requests trying to modify namespace | Major | namenode | Konstantin Shvachko | Konstantin Shvachko |
-| [MAPREDUCE-4641](https://issues.apache.org/jira/browse/MAPREDUCE-4641) | Exception in commitJob marks job as successful in job history | Major | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4633](https://issues.apache.org/jira/browse/MAPREDUCE-4633) | history server doesn't set permissions on all subdirs | Critical | jobhistoryserver | Thomas Graves | oss.wakayama |
-| [MAPREDUCE-4612](https://issues.apache.org/jira/browse/MAPREDUCE-4612) | job summary file permissions not set when its created | Critical | . | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4611](https://issues.apache.org/jira/browse/MAPREDUCE-4611) | MR AM dies badly when Node is decomissioned | Critical | . | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4604](https://issues.apache.org/jira/browse/MAPREDUCE-4604) | In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker. | Critical | mrv2 | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-4600](https://issues.apache.org/jira/browse/MAPREDUCE-4600) | TestTokenCache.java from MRV1 no longer compiles | Critical | . | Robert Joseph Evans | Daryn Sharp |
-| [MAPREDUCE-4570](https://issues.apache.org/jira/browse/MAPREDUCE-4570) | ProcfsBasedProcessTree#constructProcessInfo() prints a warning if procfsDir/\<pid\>/stat is not found. | Minor | mrv2 | Ahmed Radwan | Ahmed Radwan |
-| [MAPREDUCE-4569](https://issues.apache.org/jira/browse/MAPREDUCE-4569) | TestHsWebServicesJobsQuery fails on jdk7 | Major | . | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4562](https://issues.apache.org/jira/browse/MAPREDUCE-4562) | Support for "FileSystemCounter" legacy counter group name for compatibility reasons is creating incorrect counter name | Major | . | Jarek Jarcec Cecho | Jarek Jarcec Cecho |
-| [MAPREDUCE-4504](https://issues.apache.org/jira/browse/MAPREDUCE-4504) | SortValidator writes to wrong directory | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4496](https://issues.apache.org/jira/browse/MAPREDUCE-4496) | AM logs link is missing user name | Major | applicationmaster, mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4493](https://issues.apache.org/jira/browse/MAPREDUCE-4493) | Distibuted Cache Compatability Issues | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4492](https://issues.apache.org/jira/browse/MAPREDUCE-4492) | Configuring total queue capacity between 100.5 and 99.5 at perticular level is sucessfull | Minor | mrv2 | Nishan Shetty | Mayank Bansal |
-| [MAPREDUCE-4467](https://issues.apache.org/jira/browse/MAPREDUCE-4467) | IndexCache failures due to missing synchronization | Critical | nodemanager | Andrey Klochkov | Kihwal Lee |
-| [MAPREDUCE-4457](https://issues.apache.org/jira/browse/MAPREDUCE-4457) | mr job invalid transition TA\_TOO\_MANY\_FETCH\_FAILURE at FAILED | Critical | mrv2 | Thomas Graves | Robert Joseph Evans |
-| [MAPREDUCE-4456](https://issues.apache.org/jira/browse/MAPREDUCE-4456) | LocalDistributedCacheManager can get an ArrayIndexOutOfBounds when creating symlinks | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4449](https://issues.apache.org/jira/browse/MAPREDUCE-4449) | Incorrect MR\_HISTORY\_STORAGE property name in JHAdminConfig | Major | mrv2 | Ahmed Radwan | Ahmed Radwan |
-| [MAPREDUCE-4448](https://issues.apache.org/jira/browse/MAPREDUCE-4448) | Nodemanager crashes upon application cleanup if aggregation failed to start | Critical | mrv2, nodemanager | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4444](https://issues.apache.org/jira/browse/MAPREDUCE-4444) | nodemanager fails to start when one of the local-dirs is bad | Blocker | nodemanager | Nathan Roberts | Jason Lowe |
-| [MAPREDUCE-4437](https://issues.apache.org/jira/browse/MAPREDUCE-4437) | Race in MR ApplicationMaster can cause reducers to never be scheduled | Critical | applicationmaster, mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4423](https://issues.apache.org/jira/browse/MAPREDUCE-4423) | Potential infinite fetching of map output | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4419](https://issues.apache.org/jira/browse/MAPREDUCE-4419) | ./mapred queue -info \<queuename\> -showJobs displays all the jobs irrespective of \<queuename\> | Major | mrv2 | Nishan Shetty | Devaraj K |
-| [MAPREDUCE-4402](https://issues.apache.org/jira/browse/MAPREDUCE-4402) | TestFileInputFormat fails intermittently | Major | test | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4395](https://issues.apache.org/jira/browse/MAPREDUCE-4395) | Possible NPE at ClientDistributedCacheManager#determineTimestamps | Critical | distributed-cache, job submission, mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh |
| [MAPREDUCE-4392](https://issues.apache.org/jira/browse/MAPREDUCE-4392) | Counters.makeCompactString() changed behavior from 0.20 | Major | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4387](https://issues.apache.org/jira/browse/MAPREDUCE-4387) | RM gets fatal error and exits during TestRM | Major | resourcemanager | Kihwal Lee | Kihwal Lee |
| [MAPREDUCE-4384](https://issues.apache.org/jira/browse/MAPREDUCE-4384) | Race conditions in IndexCache | Major | nodemanager | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-4387](https://issues.apache.org/jira/browse/MAPREDUCE-4387) | RM gets fatal error and exits during TestRM | Major | resourcemanager | Kihwal Lee | Kihwal Lee |
| [MAPREDUCE-4379](https://issues.apache.org/jira/browse/MAPREDUCE-4379) | Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts | Blocker | mrv2, nodemanager | Devaraj K | Devaraj K |
-| [MAPREDUCE-4376](https://issues.apache.org/jira/browse/MAPREDUCE-4376) | TestClusterMRNotification times out | Major | mrv2, test | Jason Lowe | Kihwal Lee |
-| [MAPREDUCE-4372](https://issues.apache.org/jira/browse/MAPREDUCE-4372) | Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager | Major | mrv2, resourcemanager | Devaraj K | Devaraj K |
-| [MAPREDUCE-4361](https://issues.apache.org/jira/browse/MAPREDUCE-4361) | Fix detailed metrics for protobuf-based RPC on 0.23 | Major | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4341](https://issues.apache.org/jira/browse/MAPREDUCE-4341) | add types to capacity scheduler properties documentation | Major | capacity-sched, mrv2 | Thomas Graves | Karthik Kambatla |
-| [MAPREDUCE-4320](https://issues.apache.org/jira/browse/MAPREDUCE-4320) | gridmix mainClass wrong in pom.xml | Major | contrib/gridmix | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4307](https://issues.apache.org/jira/browse/MAPREDUCE-4307) | TeraInputFormat calls FileSystem.getDefaultBlockSize() without a Path - Failure when using ViewFileSystem | Major | mrv2 | Ahmed Radwan | Ahmed Radwan |
-| [MAPREDUCE-4302](https://issues.apache.org/jira/browse/MAPREDUCE-4302) | NM goes down if error encountered during log aggregation | Critical | nodemanager | Daryn Sharp | Daryn Sharp |
+| [HDFS-3591](https://issues.apache.org/jira/browse/HDFS-3591) | Backport HDFS-3357 to branch-0.23 | Major | . | Robert Joseph Evans | Robert Joseph Evans |
+| [HDFS-3603](https://issues.apache.org/jira/browse/HDFS-3603) | Decouple TestHDFSTrash from TestTrash | Major | test | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4402](https://issues.apache.org/jira/browse/MAPREDUCE-4402) | TestFileInputFormat fails intermittently | Major | test | Jason Lowe | Jason Lowe |
| [MAPREDUCE-4300](https://issues.apache.org/jira/browse/MAPREDUCE-4300) | OOM in AM can turn it into a zombie. | Major | applicationmaster | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4299](https://issues.apache.org/jira/browse/MAPREDUCE-4299) | Terasort hangs with MR2 FifoScheduler | Major | mrv2 | Tom White | Tom White |
-| [MAPREDUCE-4297](https://issues.apache.org/jira/browse/MAPREDUCE-4297) | Usersmap file in gridmix should not fail on empty lines | Major | contrib/gridmix | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-4295](https://issues.apache.org/jira/browse/MAPREDUCE-4295) | RM crashes due to DNS issue | Critical | mrv2, resourcemanager | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4290](https://issues.apache.org/jira/browse/MAPREDUCE-4290) | JobStatus.getState() API is giving ambiguous values | Major | mrv2 | Nishan Shetty | Devaraj K |
-| [MAPREDUCE-4270](https://issues.apache.org/jira/browse/MAPREDUCE-4270) | data\_join test classes are in the wrong packge | Major | mrv2 | Brock Noland | Thomas Graves |
-| [MAPREDUCE-4269](https://issues.apache.org/jira/browse/MAPREDUCE-4269) | documentation: Gridmix has javadoc warnings in StressJobFactory | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-4267](https://issues.apache.org/jira/browse/MAPREDUCE-4267) | mavenize pipes | Critical | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4264](https://issues.apache.org/jira/browse/MAPREDUCE-4264) | Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true | Blocker | mrv2 | Thomas Graves | Thomas Graves |
| [MAPREDUCE-4252](https://issues.apache.org/jira/browse/MAPREDUCE-4252) | MR2 job never completes with 1 pending task | Major | mrv2 | Tom White | Tom White |
-| [MAPREDUCE-4250](https://issues.apache.org/jira/browse/MAPREDUCE-4250) | hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster | Major | nodemanager | Patrick Hunt | Patrick Hunt |
-| [MAPREDUCE-4238](https://issues.apache.org/jira/browse/MAPREDUCE-4238) | mavenize data\_join | Critical | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4237](https://issues.apache.org/jira/browse/MAPREDUCE-4237) | TestNodeStatusUpdater can fail if localhost has a domain associated with it | Major | . | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4233](https://issues.apache.org/jira/browse/MAPREDUCE-4233) | NPE can happen in RMNMNodeInfo. | Critical | . | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4228](https://issues.apache.org/jira/browse/MAPREDUCE-4228) | mapreduce.job.reduce.slowstart.completedmaps is not working properly to delay the scheduling of the reduce tasks | Major | applicationmaster, mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4226](https://issues.apache.org/jira/browse/MAPREDUCE-4226) | ConcurrentModificationException in FileSystemCounterGroup | Major | mrv2 | Tom White | Tom White |
-| [MAPREDUCE-4220](https://issues.apache.org/jira/browse/MAPREDUCE-4220) | RM apps page starttime/endtime sorts are incorrect | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-4215](https://issues.apache.org/jira/browse/MAPREDUCE-4215) | RM app page shows 500 error on appid parse error | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-4211](https://issues.apache.org/jira/browse/MAPREDUCE-4211) | Error conditions (missing appid, appid not found) are masked in the RM app page | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-4209](https://issues.apache.org/jira/browse/MAPREDUCE-4209) | junit dependency in hadoop-mapreduce-client is missing scope test | Major | build | Radim Kolar | |
-| [MAPREDUCE-4206](https://issues.apache.org/jira/browse/MAPREDUCE-4206) | Sorting by Last Health-Update on the RM nodes page sorts does not work correctly | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-4197](https://issues.apache.org/jira/browse/MAPREDUCE-4197) | Include the hsqldb jar in the hadoop-mapreduce tar file | Major | . | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-4194](https://issues.apache.org/jira/browse/MAPREDUCE-4194) | ConcurrentModificationError in DirectoryCollection | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-4189](https://issues.apache.org/jira/browse/MAPREDUCE-4189) | TestContainerManagerSecurity is failing | Critical | mrv2 | Devaraj K | Devaraj K |
-| [MAPREDUCE-4169](https://issues.apache.org/jira/browse/MAPREDUCE-4169) | Container Logs appear in unsorted order | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-4165](https://issues.apache.org/jira/browse/MAPREDUCE-4165) | Committing is misspelled as commiting in task logs | Trivial | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-4160](https://issues.apache.org/jira/browse/MAPREDUCE-4160) | some mrv1 ant tests fail with timeout - due to 4156 | Major | test | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4159](https://issues.apache.org/jira/browse/MAPREDUCE-4159) | Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero | Major | mrv2 | Nishan Shetty | Devaraj K |
-| [MAPREDUCE-4156](https://issues.apache.org/jira/browse/MAPREDUCE-4156) | ant build fails compiling JobInProgress | Major | build | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4152](https://issues.apache.org/jira/browse/MAPREDUCE-4152) | map task left hanging after AM dies trying to connect to RM | Major | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4144](https://issues.apache.org/jira/browse/MAPREDUCE-4144) | ResourceManager NPE while handling NODE\_UPDATE | Critical | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4140](https://issues.apache.org/jira/browse/MAPREDUCE-4140) | mapreduce classes incorrectly importing "clover.org.apache.\*" classes | Major | client, mrv2 | Patrick Hunt | Patrick Hunt |
-| [MAPREDUCE-4139](https://issues.apache.org/jira/browse/MAPREDUCE-4139) | Potential ResourceManager deadlock when SchedulerEventDispatcher is stopped | Major | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4133](https://issues.apache.org/jira/browse/MAPREDUCE-4133) | MR over viewfs is broken | Major | . | John George | John George |
-| [MAPREDUCE-4129](https://issues.apache.org/jira/browse/MAPREDUCE-4129) | Lots of unneeded counters log messages | Major | mrv2 | Ahmed Radwan | Ahmed Radwan |
-| [MAPREDUCE-4128](https://issues.apache.org/jira/browse/MAPREDUCE-4128) | AM Recovery expects all attempts of a completed task to also be completed. | Major | mrv2 | Bikas Saha | Bikas Saha |
-| [MAPREDUCE-4117](https://issues.apache.org/jira/browse/MAPREDUCE-4117) | mapred job -status throws NullPointerException | Critical | client, mrv2 | Devaraj K | Devaraj K |
-| [MAPREDUCE-4102](https://issues.apache.org/jira/browse/MAPREDUCE-4102) | job counters not available in Jobhistory webui for killed jobs | Major | webapps | Thomas Graves | Bhallamudi Venkata Siva Kamesh |
-| [MAPREDUCE-4099](https://issues.apache.org/jira/browse/MAPREDUCE-4099) | ApplicationMaster may fail to remove staging directory | Critical | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4097](https://issues.apache.org/jira/browse/MAPREDUCE-4097) | tools testcases fail because missing mrapp-generated-classpath file in classpath | Major | build | Alejandro Abdelnur | Roman Shaposhnik |
-| [MAPREDUCE-4092](https://issues.apache.org/jira/browse/MAPREDUCE-4092) | commitJob Exception does not fail job (regression in 0.23 vs 0.20) | Blocker | mrv2 | Jonathan Eagles | Jonathan Eagles |
-| [MAPREDUCE-4091](https://issues.apache.org/jira/browse/MAPREDUCE-4091) | tools testcases failing because of MAPREDUCE-4082 | Critical | build, test | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-4089](https://issues.apache.org/jira/browse/MAPREDUCE-4089) | Hung Tasks never time out. | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4082](https://issues.apache.org/jira/browse/MAPREDUCE-4082) | hadoop-mapreduce-client-app's mrapp-generated-classpath file should not be in the module JAR | Critical | build | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-4074](https://issues.apache.org/jira/browse/MAPREDUCE-4074) | Client continuously retries to RM When RM goes down before launching Application Master | Major | . | Devaraj K | xieguiming |
-| [MAPREDUCE-4073](https://issues.apache.org/jira/browse/MAPREDUCE-4073) | CS assigns multiple off-switch containers when using multi-level-queues | Critical | mrv2, scheduler | Siddharth Seth | Siddharth Seth |
-| [MAPREDUCE-4068](https://issues.apache.org/jira/browse/MAPREDUCE-4068) | Jars in lib subdirectory of the submittable JAR are not added to the classpath | Blocker | mrv2 | Ahmed Radwan | Robert Kanter |
-| [MAPREDUCE-4062](https://issues.apache.org/jira/browse/MAPREDUCE-4062) | AM Launcher thread can hang forever | Major | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4060](https://issues.apache.org/jira/browse/MAPREDUCE-4060) | Multiple SLF4J binding warning | Major | build | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4053](https://issues.apache.org/jira/browse/MAPREDUCE-4053) | Counters group names deprecation is wrong, iterating over group names deprecated names don't show up | Major | mrv2 | Alejandro Abdelnur | Robert Joseph Evans |
-| [MAPREDUCE-4050](https://issues.apache.org/jira/browse/MAPREDUCE-4050) | Invalid node link | Major | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh |
-| [MAPREDUCE-4048](https://issues.apache.org/jira/browse/MAPREDUCE-4048) | NullPointerException exception while accessing the Application Master UI | Major | mrv2 | Devaraj K | Devaraj K |
-| [MAPREDUCE-4040](https://issues.apache.org/jira/browse/MAPREDUCE-4040) | History links should use hostname rather than IP address. | Minor | jobhistoryserver, mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh |
-| [MAPREDUCE-4031](https://issues.apache.org/jira/browse/MAPREDUCE-4031) | Node Manager hangs on shut down | Critical | mrv2, nodemanager | Devaraj K | Devaraj K |
-| [MAPREDUCE-4024](https://issues.apache.org/jira/browse/MAPREDUCE-4024) | RM webservices can't query on finalStatus | Major | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4020](https://issues.apache.org/jira/browse/MAPREDUCE-4020) | Web services returns incorrect JSON for deep queue tree | Major | mrv2, webapps | Jason Lowe | Anupam Seth |
-| [MAPREDUCE-4012](https://issues.apache.org/jira/browse/MAPREDUCE-4012) | Hadoop Job setup error leaves no useful info to users (when LinuxTaskController is used) | Minor | . | Koji Noguchi | Thomas Graves |
-| [MAPREDUCE-4010](https://issues.apache.org/jira/browse/MAPREDUCE-4010) | TestWritableJobConf fails on trunk | Critical | mrv2 | Jason Lowe | Alejandro Abdelnur |
-| [MAPREDUCE-3999](https://issues.apache.org/jira/browse/MAPREDUCE-3999) | Tracking link gives an error if the AppMaster hasn't started yet | Major | mrv2, webapps | Ravi Prakash | Ravi Prakash |
-| [MAPREDUCE-3992](https://issues.apache.org/jira/browse/MAPREDUCE-3992) | Reduce fetcher doesn't verify HTTP status code of response | Major | mrv1 | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-3988](https://issues.apache.org/jira/browse/MAPREDUCE-3988) | mapreduce.job.local.dir doesn't point to a single directory on a node. | Major | mrv2 | Vinod Kumar Vavilapalli | Eric Payne |
-| [MAPREDUCE-3947](https://issues.apache.org/jira/browse/MAPREDUCE-3947) | yarn.app.mapreduce.am.resource.mb not documented | Minor | . | Todd Lipcon | Devaraj K |
-| [MAPREDUCE-3932](https://issues.apache.org/jira/browse/MAPREDUCE-3932) | MR tasks failing and crashing the AM when available-resources/headRoom becomes zero | Critical | mr-am, mrv2 | Vinod Kumar Vavilapalli | Robert Joseph Evans |
-| [MAPREDUCE-3927](https://issues.apache.org/jira/browse/MAPREDUCE-3927) | Shuffle hang when set map.failures.percent | Critical | mrv2 | MengWang | Bhallamudi Venkata Siva Kamesh |
+| [HADOOP-8573](https://issues.apache.org/jira/browse/HADOOP-8573) | Configuration tries to read from an inputstream resource multiple times. | Major | conf | Robert Joseph Evans | Robert Joseph Evans |
+| [HADOOP-8587](https://issues.apache.org/jira/browse/HADOOP-8587) | HarFileSystem access of harMetaCache isn't threadsafe | Minor | fs | Eli Collins | Eli Collins |
+| [MAPREDUCE-4419](https://issues.apache.org/jira/browse/MAPREDUCE-4419) | ./mapred queue -info \<queuename\> -showJobs displays all the jobs irrespective of \<queuename\> | Major | mrv2 | Nishan Shetty | Devaraj K |
+| [MAPREDUCE-4299](https://issues.apache.org/jira/browse/MAPREDUCE-4299) | Terasort hangs with MR2 FifoScheduler | Major | mrv2 | Tom White | Tom White |
+| [HADOOP-8543](https://issues.apache.org/jira/browse/HADOOP-8543) | Invalid pom.xml files on 0.23 branch | Major | build | Radim Kolar | Radim Kolar |
+| [MAPREDUCE-4395](https://issues.apache.org/jira/browse/MAPREDUCE-4395) | Possible NPE at ClientDistributedCacheManager#determineTimestamps | Critical | distributed-cache, job submission, mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh |
+| [HDFS-3622](https://issues.apache.org/jira/browse/HDFS-3622) | Backport HDFS-3541 to branch-0.23 | Major | . | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4437](https://issues.apache.org/jira/browse/MAPREDUCE-4437) | Race in MR ApplicationMaster can cause reducers to never be scheduled | Critical | applicationmaster, mrv2 | Jason Lowe | Jason Lowe |
+| [HADOOP-8599](https://issues.apache.org/jira/browse/HADOOP-8599) | Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file | Major | fs | Andrey Klochkov | Andrey Klochkov |
+| [MAPREDUCE-4449](https://issues.apache.org/jira/browse/MAPREDUCE-4449) | Incorrect MR\_HISTORY\_STORAGE property name in JHAdminConfig | Major | mrv2 | Ahmed Radwan | Ahmed Radwan |
+| [MAPREDUCE-4448](https://issues.apache.org/jira/browse/MAPREDUCE-4448) | Nodemanager crashes upon application cleanup if aggregation failed to start | Critical | mrv2, nodemanager | Jason Lowe | Jason Lowe |
+| [HDFS-3646](https://issues.apache.org/jira/browse/HDFS-3646) | LeaseRenewer can hold reference to inactive DFSClient instances forever | Critical | hdfs-client | Kihwal Lee | Kihwal Lee |
+| [HDFS-3577](https://issues.apache.org/jira/browse/HDFS-3577) | WebHdfsFileSystem can not read files larger than 24KB | Blocker | webhdfs | Alejandro Abdelnur | Tsz Wo Nicholas Sze |
+| [HDFS-3597](https://issues.apache.org/jira/browse/HDFS-3597) | SNN can fail to start on upgrade | Minor | namenode | Andy Isaacson | Andy Isaacson |
+| [HDFS-3688](https://issues.apache.org/jira/browse/HDFS-3688) | Namenode loses datanode hostname if datanode re-registers | Major | datanode | Jason Lowe | Jason Lowe |
| [MAPREDUCE-3893](https://issues.apache.org/jira/browse/MAPREDUCE-3893) | allow capacity scheduler configs maximum-applications and maximum-am-resource-percent configurable on a per queue basis | Critical | mrv2 | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-3889](https://issues.apache.org/jira/browse/MAPREDUCE-3889) | job client tries to use /tasklog interface, but that doesn't exist anymore | Critical | mrv2 | Thomas Graves | Devaraj K |
-| [MAPREDUCE-3870](https://issues.apache.org/jira/browse/MAPREDUCE-3870) | Invalid App Metrics | Major | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh |
+| [HADOOP-8606](https://issues.apache.org/jira/browse/HADOOP-8606) | FileSystem.get may return the wrong filesystem | Major | fs | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4467](https://issues.apache.org/jira/browse/MAPREDUCE-4467) | IndexCache failures due to missing synchronization | Critical | nodemanager | Andrey Klochkov | Kihwal Lee |
+| [MAPREDUCE-4423](https://issues.apache.org/jira/browse/MAPREDUCE-4423) | Potential infinite fetching of map output | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [HDFS-3696](https://issues.apache.org/jira/browse/HDFS-3696) | Create files with WebHdfsFileSystem goes OOM when file size is big | Critical | webhdfs | Kihwal Lee | Tsz Wo Nicholas Sze |
+| [HADOOP-8613](https://issues.apache.org/jira/browse/HADOOP-8613) | AbstractDelegationTokenIdentifier#getUser() should set token auth type | Critical | . | Daryn Sharp | Daryn Sharp |
+| [HADOOP-8627](https://issues.apache.org/jira/browse/HADOOP-8627) | FS deleteOnExit may delete the wrong path | Critical | fs | Daryn Sharp | Daryn Sharp |
+| [HADOOP-8634](https://issues.apache.org/jira/browse/HADOOP-8634) | Ensure FileSystem#close doesn't squawk for deleteOnExit paths | Critical | fs | Daryn Sharp | Daryn Sharp |
+| [HADOOP-8550](https://issues.apache.org/jira/browse/HADOOP-8550) | hadoop fs -touchz automatically created parent directories | Major | fs | Robert Joseph Evans | John George |
+| [MAPREDUCE-4456](https://issues.apache.org/jira/browse/MAPREDUCE-4456) | LocalDistributedCacheManager can get an ArrayIndexOutOfBounds when creating symlinks | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4496](https://issues.apache.org/jira/browse/MAPREDUCE-4496) | AM logs link is missing user name | Major | applicationmaster, mrv2 | Jason Lowe | Jason Lowe |
+| [HADOOP-8637](https://issues.apache.org/jira/browse/HADOOP-8637) | FilterFileSystem#setWriteChecksum is broken | Critical | fs | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4493](https://issues.apache.org/jira/browse/MAPREDUCE-4493) | Distibuted Cache Compatability Issues | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4492](https://issues.apache.org/jira/browse/MAPREDUCE-4492) | Configuring total queue capacity between 100.5 and 99.5 at perticular level is sucessfull | Minor | mrv2 | Nishan Shetty | Mayank Bansal |
+| [HADOOP-8370](https://issues.apache.org/jira/browse/HADOOP-8370) | Native build failure: javah: class file for org.apache.hadoop.classification.InterfaceAudience not found | Major | native | Trevor Robinson | Trevor Robinson |
+| [MAPREDUCE-4457](https://issues.apache.org/jira/browse/MAPREDUCE-4457) | mr job invalid transition TA\_TOO\_MANY\_FETCH\_FAILURE at FAILED | Critical | mrv2 | Thomas Graves | Robert Joseph Evans |
+| [MAPREDUCE-4444](https://issues.apache.org/jira/browse/MAPREDUCE-4444) | nodemanager fails to start when one of the local-dirs is bad | Blocker | nodemanager | Nathan Roberts | Jason Lowe |
+| [HADOOP-8633](https://issues.apache.org/jira/browse/HADOOP-8633) | Interrupted FsShell copies may leave tmp files | Critical | fs | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4504](https://issues.apache.org/jira/browse/MAPREDUCE-4504) | SortValidator writes to wrong directory | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
| [MAPREDUCE-3782](https://issues.apache.org/jira/browse/MAPREDUCE-3782) | teragen terasort jobs fail when using webhdfs:// | Critical | mrv2 | Arpit Gupta | Jason Lowe |
-| [MAPREDUCE-3728](https://issues.apache.org/jira/browse/MAPREDUCE-3728) | ShuffleHandler can't access results when configured in a secure mode | Critical | mrv2, nodemanager | Roman Shaposhnik | Ding Yuan |
-| [MAPREDUCE-3682](https://issues.apache.org/jira/browse/MAPREDUCE-3682) | Tracker URL says AM tasks run on localhost | Major | mrv2 | David Capwell | Ravi Prakash |
-| [MAPREDUCE-3672](https://issues.apache.org/jira/browse/MAPREDUCE-3672) | Killed maps shouldn't be counted towards JobCounter.NUM\_FAILED\_MAPS | Major | mr-am, mrv2 | Vinod Kumar Vavilapalli | Anupam Seth |
-| [MAPREDUCE-3650](https://issues.apache.org/jira/browse/MAPREDUCE-3650) | testGetTokensForHftpFS() fails | Blocker | mrv2 | Thomas Graves | Ravi Prakash |
-| [MAPREDUCE-3621](https://issues.apache.org/jira/browse/MAPREDUCE-3621) | TestDBJob and TestDataDrivenDBInputFormat ant tests fail | Major | mrv2 | Thomas Graves | Ravi Prakash |
-| [MAPREDUCE-3543](https://issues.apache.org/jira/browse/MAPREDUCE-3543) | Mavenize Gridmix. | Critical | mrv2 | Mahadev konar | Thomas Graves |
+| [YARN-14](https://issues.apache.org/jira/browse/YARN-14) | Symlinks to peer distributed cache files no longer work | Major | nodemanager | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4053](https://issues.apache.org/jira/browse/MAPREDUCE-4053) | Counters group names deprecation is wrong, iterating over group names deprecated names don't show up | Major | mrv2 | Alejandro Abdelnur | Robert Joseph Evans |
+| [HDFS-3718](https://issues.apache.org/jira/browse/HDFS-3718) | Datanode won't shutdown because of runaway DataBlockScanner thread | Critical | datanode | Kihwal Lee | Kihwal Lee |
+| [HDFS-3794](https://issues.apache.org/jira/browse/HDFS-3794) | WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header. | Major | webhdfs | Ravi Prakash | Ravi Prakash |
+| [HADOOP-8703](https://issues.apache.org/jira/browse/HADOOP-8703) | distcpV2: turn CRC checking off for 0 byte size | Major | . | Dave Thompson | Dave Thompson |
+| [MAPREDUCE-4562](https://issues.apache.org/jira/browse/MAPREDUCE-4562) | Support for "FileSystemCounter" legacy counter group name for compatibility reasons is creating incorrect counter name | Major | . | Jarek Jarcec Cecho | Jarek Jarcec Cecho |
+| [HADOOP-8390](https://issues.apache.org/jira/browse/HADOOP-8390) | TestFileSystemCanonicalization fails with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
+| [HDFS-3788](https://issues.apache.org/jira/browse/HDFS-3788) | distcp can't copy large files using webhdfs due to missing Content-Length header | Critical | webhdfs | Eli Collins | Tsz Wo Nicholas Sze |
+| [HADOOP-8692](https://issues.apache.org/jira/browse/HADOOP-8692) | TestLocalDirAllocator fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
+| [HADOOP-8693](https://issues.apache.org/jira/browse/HADOOP-8693) | TestSecurityUtil fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
+| [HADOOP-8697](https://issues.apache.org/jira/browse/HADOOP-8697) | TestWritableName fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
+| [YARN-25](https://issues.apache.org/jira/browse/YARN-25) | remove old aggregated logs | Major | . | Thomas Graves | Robert Joseph Evans |
+| [HADOOP-8695](https://issues.apache.org/jira/browse/HADOOP-8695) | TestPathData fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
+| [HADOOP-7967](https://issues.apache.org/jira/browse/HADOOP-7967) | Need generalized multi-token filesystem support | Critical | fs, security | Daryn Sharp | Daryn Sharp |
+| [YARN-27](https://issues.apache.org/jira/browse/YARN-27) | Failed refreshQueues due to misconfiguration prevents further refreshing of queues | Major | . | Ramya Sunil | Arun C Murthy |
+| [YARN-58](https://issues.apache.org/jira/browse/YARN-58) | NM leaks filesystems | Critical | nodemanager | Daryn Sharp | Jason Lowe |
+| [HADOOP-8611](https://issues.apache.org/jira/browse/HADOOP-8611) | Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails | Major | security | Kihwal Lee | Robert Parker |
| [MAPREDUCE-3506](https://issues.apache.org/jira/browse/MAPREDUCE-3506) | Calling getPriority on JobInfo after parsing a history log with JobHistoryParser throws a NullPointerException | Minor | client, mrv2 | Ratandeep Ratti | Jason Lowe |
-| [MAPREDUCE-3350](https://issues.apache.org/jira/browse/MAPREDUCE-3350) | Per-app RM page should have the list of application-attempts like on the app JHS page | Critical | mrv2, webapps | Vinod Kumar Vavilapalli | Jonathan Eagles |
-| [MAPREDUCE-3348](https://issues.apache.org/jira/browse/MAPREDUCE-3348) | mapred job -status fails to give info even if the job is present in History | Major | mrv2 | Devaraj K | Devaraj K |
-| [MAPREDUCE-3082](https://issues.apache.org/jira/browse/MAPREDUCE-3082) | archive command take wrong path for input file with current directory | Major | harchive | Rajit Saha | John George |
+| [MAPREDUCE-4570](https://issues.apache.org/jira/browse/MAPREDUCE-4570) | ProcfsBasedProcessTree#constructProcessInfo() prints a warning if procfsDir/\<pid\>/stat is not found. | Minor | mrv2 | Ahmed Radwan | Ahmed Radwan |
+| [MAPREDUCE-4068](https://issues.apache.org/jira/browse/MAPREDUCE-4068) | Jars in lib subdirectory of the submittable JAR are not added to the classpath | Blocker | mrv2 | Ahmed Radwan | Robert Kanter |
+| [HDFS-3841](https://issues.apache.org/jira/browse/HDFS-3841) | Port HDFS-3835 to branch-0.23 | Major | . | Robert Joseph Evans | Robert Joseph Evans |
+| [HADOOP-8225](https://issues.apache.org/jira/browse/HADOOP-8225) | DistCp fails when invoked by Oozie | Blocker | security | Mithun Radhakrishnan | Daryn Sharp |
| [MAPREDUCE-2374](https://issues.apache.org/jira/browse/MAPREDUCE-2374) | "Text File Busy" errors launching MR tasks | Major | . | Todd Lipcon | Andy Isaacson |
-| [MAPREDUCE-2289](https://issues.apache.org/jira/browse/MAPREDUCE-2289) | Permissions race can make getStagingDir fail on local filesystem | Major | job submission | Todd Lipcon | Ahmed Radwan |
-| [YARN-87](https://issues.apache.org/jira/browse/YARN-87) | NM ResourceLocalizationService does not set permissions of local cache directories | Critical | nodemanager | Jason Lowe | Jason Lowe |
-| [YARN-68](https://issues.apache.org/jira/browse/YARN-68) | NodeManager will refuse to shutdown indefinitely due to container log aggregation | Major | nodemanager | patrick white | Daryn Sharp |
-| [YARN-66](https://issues.apache.org/jira/browse/YARN-66) | aggregated logs permissions not set properly | Critical | nodemanager | Thomas Graves | Thomas Graves |
-| [YARN-63](https://issues.apache.org/jira/browse/YARN-63) | RMNodeImpl is missing valid transitions from the UNHEALTHY state | Major | resourcemanager | Jason Lowe | Jason Lowe |
-| [YARN-58](https://issues.apache.org/jira/browse/YARN-58) | NM leaks filesystems | Critical | nodemanager | Daryn Sharp | Jason Lowe |
+| [HADOOP-8709](https://issues.apache.org/jira/browse/HADOOP-8709) | globStatus changed behavior from 0.20/1.x | Critical | fs | Jason Lowe | Jason Lowe |
+| [HADOOP-8725](https://issues.apache.org/jira/browse/HADOOP-8725) | MR is broken when security is off | Blocker | security | Daryn Sharp | Daryn Sharp |
+| [HDFS-3177](https://issues.apache.org/jira/browse/HDFS-3177) | Allow DFSClient to find out and use the CRC type being used for a file. | Major | datanode, hdfs-client | Kihwal Lee | Kihwal Lee |
+| [HADOOP-8060](https://issues.apache.org/jira/browse/HADOOP-8060) | Add a capability to discover and set checksum types per file. | Major | fs, util | Kihwal Lee | Kihwal Lee |
| [YARN-31](https://issues.apache.org/jira/browse/YARN-31) | TestDelegationTokenRenewer fails on jdk7 | Major | . | Thomas Graves | Thomas Graves |
-| [YARN-27](https://issues.apache.org/jira/browse/YARN-27) | Failed refreshQueues due to misconfiguration prevents further refreshing of queues | Major | . | Ramya Sunil | Arun C Murthy |
-| [YARN-25](https://issues.apache.org/jira/browse/YARN-25) | remove old aggregated logs | Major | . | Thomas Graves | Robert Joseph Evans |
-| [YARN-14](https://issues.apache.org/jira/browse/YARN-14) | Symlinks to peer distributed cache files no longer work | Major | nodemanager | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4600](https://issues.apache.org/jira/browse/MAPREDUCE-4600) | TestTokenCache.java from MRV1 no longer compiles | Critical | . | Robert Joseph Evans | Daryn Sharp |
+| [HADOOP-8614](https://issues.apache.org/jira/browse/HADOOP-8614) | IOUtils#skipFully hangs forever on EOF | Minor | . | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-3861](https://issues.apache.org/jira/browse/HDFS-3861) | Deadlock in DFSClient | Blocker | hdfs-client | Kihwal Lee | Kihwal Lee |
+| [HADOOP-8726](https://issues.apache.org/jira/browse/HADOOP-8726) | The Secrets in Credentials are not available to MR tasks | Major | security | Benoy Antony | Daryn Sharp |
+| [MAPREDUCE-4569](https://issues.apache.org/jira/browse/MAPREDUCE-4569) | TestHsWebServicesJobsQuery fails on jdk7 | Major | . | Thomas Graves | Thomas Graves |
+| [YARN-63](https://issues.apache.org/jira/browse/YARN-63) | RMNodeImpl is missing valid transitions from the UNHEALTHY state | Major | resourcemanager | Jason Lowe | Jason Lowe |
+| [HADOOP-8727](https://issues.apache.org/jira/browse/HADOOP-8727) | Gracefully deprecate dfs.umaskmode in 2.x onwards | Major | conf | Harsh J | Harsh J |
+| [YARN-66](https://issues.apache.org/jira/browse/YARN-66) | aggregated logs permissions not set properly | Critical | nodemanager | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4612](https://issues.apache.org/jira/browse/MAPREDUCE-4612) | job summary file permissions not set when its created | Critical | . | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4611](https://issues.apache.org/jira/browse/MAPREDUCE-4611) | MR AM dies badly when Node is decomissioned | Critical | . | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4604](https://issues.apache.org/jira/browse/MAPREDUCE-4604) | In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker. | Critical | mrv2 | Ravi Prakash | Ravi Prakash |
+| [HDFS-3873](https://issues.apache.org/jira/browse/HDFS-3873) | Hftp assumes security is disabled if token fetch fails | Major | hdfs-client | Daryn Sharp | Daryn Sharp |
+| [HDFS-3852](https://issues.apache.org/jira/browse/HDFS-3852) | TestHftpDelegationToken is broken after HADOOP-8225 | Major | hdfs-client, security | Aaron T. Myers | Daryn Sharp |
+| [YARN-68](https://issues.apache.org/jira/browse/YARN-68) | NodeManager will refuse to shutdown indefinitely due to container log aggregation | Major | nodemanager | patrick white | Daryn Sharp |
+| [YARN-87](https://issues.apache.org/jira/browse/YARN-87) | NM ResourceLocalizationService does not set permissions of local cache directories | Critical | nodemanager | Jason Lowe | Jason Lowe |
+| [HDFS-3890](https://issues.apache.org/jira/browse/HDFS-3890) | filecontext mkdirs doesn't apply umask as expected | Critical | . | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4633](https://issues.apache.org/jira/browse/MAPREDUCE-4633) | history server doesn't set permissions on all subdirs | Critical | jobhistoryserver | Thomas Graves | oss.wakayama |
+| [MAPREDUCE-4641](https://issues.apache.org/jira/browse/MAPREDUCE-4641) | Exception in commitJob marks job as successful in job history | Major | mrv2 | Jason Lowe | Jason Lowe |
### TESTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-2505](https://issues.apache.org/jira/browse/HDFS-2505) | Add a test to verify getFileChecksum works with ViewFS | Minor | test | Ravi Prakash | Ravi Prakash |
+| [MAPREDUCE-3983](https://issues.apache.org/jira/browse/MAPREDUCE-3983) | TestTTResourceReporting can fail, and should just be deleted | Major | mrv1 | Robert Joseph Evans | Ravi Prakash |
| [HADOOP-8283](https://issues.apache.org/jira/browse/HADOOP-8283) | Allow tests to
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[14/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.2-alpha/CHANGES.2.0.2-alpha.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.2-alpha/CHANGES.2.0.2-alpha.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.2-alpha/CHANGES.2.0.2-alpha.md
index 1d032c7..54f1663 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.2-alpha/CHANGES.2.0.2-alpha.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.2-alpha/CHANGES.2.0.2-alpha.md
@@ -24,697 +24,691 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8794](https://issues.apache.org/jira/browse/HADOOP-8794) | Modifiy bin/hadoop to point to HADOOP\_YARN\_HOME | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
-| [HADOOP-8710](https://issues.apache.org/jira/browse/HADOOP-8710) | Remove ability for users to easily run the trash emptier | Major | fs | Eli Collins | Eli Collins |
-| [HADOOP-8689](https://issues.apache.org/jira/browse/HADOOP-8689) | Make trash a server side configuration option | Major | fs | Eli Collins | Eli Collins |
-| [HADOOP-8551](https://issues.apache.org/jira/browse/HADOOP-8551) | fs -mkdir creates parent directories without the -p option | Major | fs | Robert Joseph Evans | John George |
-| [HADOOP-8458](https://issues.apache.org/jira/browse/HADOOP-8458) | Add management hook to AuthenticationHandler to enable delegation token operations support | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8388](https://issues.apache.org/jira/browse/HADOOP-8388) | Remove unused BlockLocation serialization | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8368](https://issues.apache.org/jira/browse/HADOOP-8368) | Use CMake rather than autotools to build native code | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3675](https://issues.apache.org/jira/browse/HDFS-3675) | libhdfs: follow documented return codes | Minor | libhdfs | Colin Patrick McCabe | Colin Patrick McCabe |
+| [MAPREDUCE-4072](https://issues.apache.org/jira/browse/MAPREDUCE-4072) | User set java.library.path seems to overwrite default creating problems native lib loading | Major | mrv2 | Anupam Seth | Anupam Seth |
+| [MAPREDUCE-3812](https://issues.apache.org/jira/browse/MAPREDUCE-3812) | Lower default allocation sizes, fix allocation configurations and document them | Major | mrv2, performance | Vinod Kumar Vavilapalli | Harsh J |
+| [HDFS-3318](https://issues.apache.org/jira/browse/HDFS-3318) | Hftp hangs on transfers \>2GB | Blocker | hdfs-client | Daryn Sharp | Daryn Sharp |
+| [HADOOP-8388](https://issues.apache.org/jira/browse/HADOOP-8388) | Remove unused BlockLocation serialization | Minor | . | Colin P. McCabe | Colin P. McCabe |
+| [HADOOP-8368](https://issues.apache.org/jira/browse/HADOOP-8368) | Use CMake rather than autotools to build native code | Minor | . | Colin P. McCabe | Colin P. McCabe |
| [HDFS-3522](https://issues.apache.org/jira/browse/HDFS-3522) | If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations | Major | namenode | Brandon Li | Brandon Li |
+| [HADOOP-8458](https://issues.apache.org/jira/browse/HADOOP-8458) | Add management hook to AuthenticationHandler to enable delegation token operations support | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-4311](https://issues.apache.org/jira/browse/MAPREDUCE-4311) | Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings | Major | capacity-sched, mrv2 | Thomas Graves | Karthik Kambatla |
| [HDFS-3446](https://issues.apache.org/jira/browse/HDFS-3446) | HostsFileReader silently ignores bad includes/excludes | Major | namenode | Matthew Jacobs | Matthew Jacobs |
-| [HDFS-3318](https://issues.apache.org/jira/browse/HDFS-3318) | Hftp hangs on transfers \>2GB | Blocker | hdfs-client | Daryn Sharp | Daryn Sharp |
-| [HDFS-2727](https://issues.apache.org/jira/browse/HDFS-2727) | libhdfs should get the default block size from the server | Minor | libhdfs | Sho Shimauchi | Colin Patrick McCabe |
-| [HDFS-2686](https://issues.apache.org/jira/browse/HDFS-2686) | Remove DistributedUpgrade related code | Major | datanode, namenode | Todd Lipcon | Suresh Srinivas |
+| [HDFS-3675](https://issues.apache.org/jira/browse/HDFS-3675) | libhdfs: follow documented return codes | Minor | libhdfs | Colin P. McCabe | Colin P. McCabe |
| [HDFS-2617](https://issues.apache.org/jira/browse/HDFS-2617) | Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution | Major | security | Jakob Homan | Jakob Homan |
+| [HADOOP-8551](https://issues.apache.org/jira/browse/HADOOP-8551) | fs -mkdir creates parent directories without the -p option | Major | fs | Robert Joseph Evans | John George |
+| [HADOOP-8689](https://issues.apache.org/jira/browse/HADOOP-8689) | Make trash a server side configuration option | Major | fs | Eli Collins | Eli Collins |
+| [HADOOP-8710](https://issues.apache.org/jira/browse/HADOOP-8710) | Remove ability for users to easily run the trash emptier | Major | fs | Eli Collins | Eli Collins |
+| [HDFS-2727](https://issues.apache.org/jira/browse/HDFS-2727) | libhdfs should get the default block size from the server | Minor | libhdfs | Sho Shimauchi | Colin P. McCabe |
+| [HDFS-2686](https://issues.apache.org/jira/browse/HDFS-2686) | Remove DistributedUpgrade related code | Major | datanode, namenode | Todd Lipcon | Suresh Srinivas |
| [MAPREDUCE-4629](https://issues.apache.org/jira/browse/MAPREDUCE-4629) | Remove JobHistory.DEBUG\_MODE | Major | . | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-4311](https://issues.apache.org/jira/browse/MAPREDUCE-4311) | Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings | Major | capacity-sched, mrv2 | Thomas Graves | Karthik Kambatla |
-| [MAPREDUCE-4072](https://issues.apache.org/jira/browse/MAPREDUCE-4072) | User set java.library.path seems to overwrite default creating problems native lib loading | Major | mrv2 | Anupam Seth | Anupam Seth |
-| [MAPREDUCE-3812](https://issues.apache.org/jira/browse/MAPREDUCE-3812) | Lower default allocation sizes, fix allocation configurations and document them | Major | mrv2, performance | Vinod Kumar Vavilapalli | Harsh J |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-8794](https://issues.apache.org/jira/browse/HADOOP-8794) | Modifiy bin/hadoop to point to HADOOP\_YARN\_HOME | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8644](https://issues.apache.org/jira/browse/HADOOP-8644) | AuthenticatedURL should be able to use SSLFactory | Critical | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8581](https://issues.apache.org/jira/browse/HADOOP-8581) | add support for HTTPS to the web UIs | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8465](https://issues.apache.org/jira/browse/HADOOP-8465) | hadoop-auth should support ephemeral authentication | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8135](https://issues.apache.org/jira/browse/HADOOP-8135) | Add ByteBufferReadable interface to FSDataInputStream | Major | fs | Henry Robinson | Henry Robinson |
-| [HDFS-3637](https://issues.apache.org/jira/browse/HDFS-3637) | Add support for encrypting the DataTransferProtocol | Major | datanode, hdfs-client, security | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3535](https://issues.apache.org/jira/browse/HDFS-3535) | Audit logging should log denied accesses | Major | namenode | Andy Isaacson | Andy Isaacson |
-| [HDFS-3150](https://issues.apache.org/jira/browse/HDFS-3150) | Add option for clients to contact DNs via hostname | Major | datanode, hdfs-client | Eli Collins | Eli Collins |
-| [HDFS-3113](https://issues.apache.org/jira/browse/HDFS-3113) | httpfs does not support delegation tokens | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HDFS-3042](https://issues.apache.org/jira/browse/HDFS-3042) | Automatic failover support for NN HA | Major | auto-failover, ha | Todd Lipcon | Todd Lipcon |
| [HDFS-2978](https://issues.apache.org/jira/browse/HDFS-2978) | The NameNode should expose name dir statuses via JMX | Major | namenode | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-2793](https://issues.apache.org/jira/browse/HDFS-2793) | Add an admin command to trigger an edit log roll | Major | namenode | Aaron T. Myers | Todd Lipcon |
+| [HADOOP-8135](https://issues.apache.org/jira/browse/HADOOP-8135) | Add ByteBufferReadable interface to FSDataInputStream | Major | fs | Henry Robinson | Henry Robinson |
+| [MAPREDUCE-3773](https://issues.apache.org/jira/browse/MAPREDUCE-3773) | Add queue metrics with buckets for job run times | Major | jobtracker | Owen O'Malley | Owen O'Malley |
| [HDFS-744](https://issues.apache.org/jira/browse/HDFS-744) | Support hsync in HDFS | Major | datanode, hdfs-client | Hairong Kuang | Lars Hofhansl |
-| [MAPREDUCE-4417](https://issues.apache.org/jira/browse/MAPREDUCE-4417) | add support for encrypted shuffle | Major | mrv2, security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3042](https://issues.apache.org/jira/browse/HDFS-3042) | Automatic failover support for NN HA | Major | auto-failover, ha | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8465](https://issues.apache.org/jira/browse/HADOOP-8465) | hadoop-auth should support ephemeral authentication | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3535](https://issues.apache.org/jira/browse/HDFS-3535) | Audit logging should log denied accesses | Major | namenode | Andy Isaacson | Andy Isaacson |
| [MAPREDUCE-4355](https://issues.apache.org/jira/browse/MAPREDUCE-4355) | Add RunningJob.getJobStatus() | Major | mrv1, mrv2 | Karthik Kambatla | Karthik Kambatla |
-| [MAPREDUCE-3773](https://issues.apache.org/jira/browse/MAPREDUCE-3773) | Add queue metrics with buckets for job run times | Major | jobtracker | Owen O'Malley | Owen O'Malley |
| [MAPREDUCE-3451](https://issues.apache.org/jira/browse/MAPREDUCE-3451) | Port Fair Scheduler to MR2 | Major | mrv2, scheduler | NO NAME | NO NAME |
| [MAPREDUCE-987](https://issues.apache.org/jira/browse/MAPREDUCE-987) | Exposing MiniDFS and MiniMR clusters as a single process command-line | Minor | build, test | Philip Zeyliger | Ahmed Radwan |
+| [MAPREDUCE-4417](https://issues.apache.org/jira/browse/MAPREDUCE-4417) | add support for encrypted shuffle | Major | mrv2, security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3113](https://issues.apache.org/jira/browse/HDFS-3113) | httpfs does not support delegation tokens | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-8644](https://issues.apache.org/jira/browse/HADOOP-8644) | AuthenticatedURL should be able to use SSLFactory | Critical | security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3637](https://issues.apache.org/jira/browse/HDFS-3637) | Add support for encrypting the DataTransferProtocol | Major | datanode, hdfs-client, security | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-8581](https://issues.apache.org/jira/browse/HADOOP-8581) | add support for HTTPS to the web UIs | Major | security | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3150](https://issues.apache.org/jira/browse/HDFS-3150) | Add option for clients to contact DNs via hostname | Major | datanode, hdfs-client | Eli Collins | Eli Collins |
+| [HDFS-2793](https://issues.apache.org/jira/browse/HDFS-2793) | Add an admin command to trigger an edit log roll | Major | namenode | Aaron T. Myers | Todd Lipcon |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8754](https://issues.apache.org/jira/browse/HADOOP-8754) | Deprecate all the RPC.getServer() variants | Minor | ipc | Brandon Li | Brandon Li |
-| [HADOOP-8748](https://issues.apache.org/jira/browse/HADOOP-8748) | Move dfsclient retry to a util class | Minor | io | Arun C Murthy | Arun C Murthy |
-| [HADOOP-8700](https://issues.apache.org/jira/browse/HADOOP-8700) | Move the checksum type constants to an enum | Minor | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HADOOP-8687](https://issues.apache.org/jira/browse/HADOOP-8687) | Upgrade log4j to 1.2.17 | Minor | . | Eli Collins | Eli Collins |
-| [HADOOP-8635](https://issues.apache.org/jira/browse/HADOOP-8635) | Cannot cancel paths registered deleteOnExit | Critical | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8624](https://issues.apache.org/jira/browse/HADOOP-8624) | ProtobufRpcEngine should log all RPCs if TRACE logging is enabled | Minor | ipc | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8623](https://issues.apache.org/jira/browse/HADOOP-8623) | hadoop jar command should respect HADOOP\_OPTS | Minor | scripts | Steven Willis | Steven Willis |
-| [HADOOP-8620](https://issues.apache.org/jira/browse/HADOOP-8620) | Add -Drequire.fuse and -Drequire.snappy | Minor | build | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8609](https://issues.apache.org/jira/browse/HADOOP-8609) | IPC server logs a useless message when shutting down socket | Major | . | Todd Lipcon | Jon Zuanich |
-| [HADOOP-8541](https://issues.apache.org/jira/browse/HADOOP-8541) | Better high-percentile latency metrics | Major | metrics | Andrew Wang | Andrew Wang |
-| [HADOOP-8535](https://issues.apache.org/jira/browse/HADOOP-8535) | Cut hadoop build times in half (upgrade maven-compiler-plugin to 2.5.1) | Major | build | Jonathan Eagles | Jonathan Eagles |
-| [HADOOP-8533](https://issues.apache.org/jira/browse/HADOOP-8533) | Remove Parallel Call in IPC | Major | ipc | Suresh Srinivas | Brandon Li |
-| [HADOOP-8531](https://issues.apache.org/jira/browse/HADOOP-8531) | SequenceFile Writer can throw out a better error if a serializer or deserializer isn't available | Trivial | io | Harsh J | madhukara phatak |
-| [HADOOP-8525](https://issues.apache.org/jira/browse/HADOOP-8525) | Provide Improved Traceability for Configuration | Trivial | . | Robert Joseph Evans | Robert Joseph Evans |
-| [HADOOP-8524](https://issues.apache.org/jira/browse/HADOOP-8524) | Allow users to get source of a Configuration parameter | Trivial | conf | Harsh J | Harsh J |
-| [HADOOP-8463](https://issues.apache.org/jira/browse/HADOOP-8463) | hadoop.security.auth\_to\_local needs a key definition and doc | Major | security | Eli Collins | madhukara phatak |
-| [HADOOP-8398](https://issues.apache.org/jira/browse/HADOOP-8398) | Cleanup BlockLocation | Minor | . | Eli Collins | Eli Collins |
-| [HADOOP-8373](https://issues.apache.org/jira/browse/HADOOP-8373) | Port RPC.getServerAddress to 0.23 | Major | ipc | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8367](https://issues.apache.org/jira/browse/HADOOP-8367) | Improve documentation of declaringClassProtocolName in rpc headers | Major | . | Sanjay Radia | Sanjay Radia |
-| [HADOOP-8362](https://issues.apache.org/jira/browse/HADOOP-8362) | Improve exception message when Configuration.set() is called with a null key or value | Trivial | conf | Todd Lipcon | madhukara phatak |
-| [HADOOP-8361](https://issues.apache.org/jira/browse/HADOOP-8361) | Avoid out-of-memory problems when deserializing strings | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8358](https://issues.apache.org/jira/browse/HADOOP-8358) | Config-related WARN for dfs.web.ugi can be avoided. | Trivial | conf | Harsh J | Harsh J |
-| [HADOOP-8340](https://issues.apache.org/jira/browse/HADOOP-8340) | SNAPSHOT build versions should compare as less than their eventual final release | Minor | util | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8335](https://issues.apache.org/jira/browse/HADOOP-8335) | Improve Configuration's address handling | Major | util | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8323](https://issues.apache.org/jira/browse/HADOOP-8323) | Revert HADOOP-7940 and improve javadocs and test for Text.clear() | Critical | io | Harsh J | Harsh J |
-| [HADOOP-8286](https://issues.apache.org/jira/browse/HADOOP-8286) | Simplify getting a socket address from conf | Major | conf | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8278](https://issues.apache.org/jira/browse/HADOOP-8278) | Make sure components declare correct set of dependencies | Major | build | Tom White | Tom White |
+| [HDFS-2834](https://issues.apache.org/jira/browse/HDFS-2834) | ByteBuffer-based read API for DFSInputStream | Major | hdfs-client, performance | Henry Robinson | Henry Robinson |
+| [HADOOP-8242](https://issues.apache.org/jira/browse/HADOOP-8242) | AbstractDelegationTokenIdentifier: add getter methods for owner and realuser | Minor | . | Colin P. McCabe | Colin P. McCabe |
| [HADOOP-8244](https://issues.apache.org/jira/browse/HADOOP-8244) | Improve comments on ByteBufferReadable.read | Major | . | Henry Robinson | Henry Robinson |
-| [HADOOP-8242](https://issues.apache.org/jira/browse/HADOOP-8242) | AbstractDelegationTokenIdentifier: add getter methods for owner and realuser | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8240](https://issues.apache.org/jira/browse/HADOOP-8240) | Allow users to specify a checksum type on create() | Major | fs | Kihwal Lee | Kihwal Lee |
-| [HADOOP-8239](https://issues.apache.org/jira/browse/HADOOP-8239) | Extend MD5MD5CRC32FileChecksum to show the actual checksum type being used | Major | fs | Kihwal Lee | Kihwal Lee |
+| [HDFS-3110](https://issues.apache.org/jira/browse/HDFS-3110) | libhdfs implementation of direct read API | Major | libhdfs, performance | Henry Robinson | Henry Robinson |
+| [MAPREDUCE-4059](https://issues.apache.org/jira/browse/MAPREDUCE-4059) | The history server should have a separate pluggable storage/query interface | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4017](https://issues.apache.org/jira/browse/MAPREDUCE-4017) | Add jobname to jobsummary log | Trivial | jobhistoryserver, jobtracker | Koji Noguchi | Thomas Graves |
+| [HADOOP-7510](https://issues.apache.org/jira/browse/HADOOP-7510) | Tokens should use original hostname provided instead of ip | Major | security | Daryn Sharp | Daryn Sharp |
+| [HADOOP-8286](https://issues.apache.org/jira/browse/HADOOP-8286) | Simplify getting a socket address from conf | Major | conf | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4151](https://issues.apache.org/jira/browse/MAPREDUCE-4151) | RM scheduler web page should filter apps to those that are relevant to scheduling | Major | mrv2, webapps | Jason Lowe | Jason Lowe |
+| [HDFS-2652](https://issues.apache.org/jira/browse/HDFS-2652) | Port token service changes from 205 | Major | . | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4190](https://issues.apache.org/jira/browse/MAPREDUCE-4190) | Improve web UI for task attempts userlog link | Major | mrv2, webapps | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4079](https://issues.apache.org/jira/browse/MAPREDUCE-4079) | Allow MR AppMaster to limit ephemeral port range. | Blocker | mr-am, mrv2 | Robert Joseph Evans | Robert Joseph Evans |
| [HADOOP-8227](https://issues.apache.org/jira/browse/HADOOP-8227) | Allow RPC to limit ephemeral port range. | Blocker | . | Robert Joseph Evans | Robert Joseph Evans |
+| [HADOOP-8335](https://issues.apache.org/jira/browse/HADOOP-8335) | Improve Configuration's address handling | Major | util | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4210](https://issues.apache.org/jira/browse/MAPREDUCE-4210) | Expose listener address for WebApp | Major | webapps | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4205](https://issues.apache.org/jira/browse/MAPREDUCE-4205) | retrofit all JVM shutdown hooks to use ShutdownHookManager | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-3850](https://issues.apache.org/jira/browse/MAPREDUCE-3850) | Avoid redundant calls for tokens in TokenCache | Major | security | Daryn Sharp | Daryn Sharp |
+| [HADOOP-8373](https://issues.apache.org/jira/browse/HADOOP-8373) | Port RPC.getServerAddress to 0.23 | Major | ipc | Daryn Sharp | Daryn Sharp |
+| [HDFS-3390](https://issues.apache.org/jira/browse/HDFS-3390) | DFSAdmin should print full stack traces of errors when DEBUG logging is enabled | Minor | hdfs-client | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-3341](https://issues.apache.org/jira/browse/HDFS-3341) | Change minimum RPC versions to 2.0.0-SNAPSHOT instead of 2.0.0 | Minor | . | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8340](https://issues.apache.org/jira/browse/HADOOP-8340) | SNAPSHOT build versions should compare as less than their eventual final release | Minor | util | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-3659](https://issues.apache.org/jira/browse/MAPREDUCE-3659) | Host-based token support | Major | security | Daryn Sharp | Daryn Sharp |
+| [HDFS-3230](https://issues.apache.org/jira/browse/HDFS-3230) | Cleanup DatanodeID creation in the tests | Minor | test | Eli Collins | Eli Collins |
+| [HDFS-3401](https://issues.apache.org/jira/browse/HDFS-3401) | Cleanup DatanodeDescriptor creation in the tests | Major | datanode, test | Eli Collins | Eli Collins |
+| [HDFS-3400](https://issues.apache.org/jira/browse/HDFS-3400) | DNs should be able start with jsvc even if security is disabled | Major | datanode, scripts | Aaron T. Myers | Aaron T. Myers |
| [HADOOP-8224](https://issues.apache.org/jira/browse/HADOOP-8224) | Don't hardcode hdfs.audit.logger in the scripts | Major | conf | Eli Collins | Tomohiko Kinebuchi |
-| [HADOOP-8075](https://issues.apache.org/jira/browse/HADOOP-8075) | Lower native-hadoop library log from info to debug | Major | native | Eli Collins | Hızır Sefa İrken |
-| [HADOOP-7510](https://issues.apache.org/jira/browse/HADOOP-7510) | Tokens should use original hostname provided instead of ip | Major | security | Daryn Sharp | Daryn Sharp |
-| [HADOOP-6802](https://issues.apache.org/jira/browse/HADOOP-6802) | Remove FS\_CLIENT\_BUFFER\_DIR\_KEY = "fs.client.buffer.dir" from CommonConfigurationKeys.java (not used, deprecated) | Major | conf, fs | Erik Steffl | Sho Shimauchi |
-| [HADOOP-3450](https://issues.apache.org/jira/browse/HADOOP-3450) | Add tests to Local Directory Allocator for asserting their URI-returning capability | Minor | fs | Ari Rabkin | Sho Shimauchi |
-| [HDFS-3907](https://issues.apache.org/jira/browse/HDFS-3907) | Allow multiple users for local block readers | Major | datanode | Eli Collins | Eli Collins |
-| [HDFS-3887](https://issues.apache.org/jira/browse/HDFS-3887) | Remove redundant chooseTarget methods in BlockPlacementPolicy.java | Trivial | namenode | Jing Zhao | Jing Zhao |
-| [HDFS-3871](https://issues.apache.org/jira/browse/HDFS-3871) | Change NameNodeProxies to use HADOOP-8748 | Minor | hdfs-client | Arun C Murthy | Arun C Murthy |
-| [HDFS-3866](https://issues.apache.org/jira/browse/HDFS-3866) | HttpFS POM should have property where to download tomcat from | Minor | build | Ryan Hennig | Plamen Jeliazkov |
-| [HDFS-3844](https://issues.apache.org/jira/browse/HDFS-3844) | Add @Override where necessary and remove unnecessary {@inheritdoc} and imports | Trivial | . | Jing Zhao | Jing Zhao |
-| [HDFS-3819](https://issues.apache.org/jira/browse/HDFS-3819) | Should check whether invalidate work percentage default value is not greater than 1.0f | Minor | . | Jing Zhao | Jing Zhao |
-| [HDFS-3802](https://issues.apache.org/jira/browse/HDFS-3802) | StartupOption.name in HdfsServerConstants should be final | Trivial | . | Jing Zhao | Jing Zhao |
-| [HDFS-3796](https://issues.apache.org/jira/browse/HDFS-3796) | Speed up edit log tests by avoiding fsync() | Minor | test | Todd Lipcon | Todd Lipcon |
-| [HDFS-3765](https://issues.apache.org/jira/browse/HDFS-3765) | Namenode INITIALIZESHAREDEDITS should be able to initialize all shared storages | Major | ha | Vinayakumar B | Vinayakumar B |
-| [HDFS-3723](https://issues.apache.org/jira/browse/HDFS-3723) | All commands should support meaningful --help | Major | scripts, tools | E. Sammer | Jing Zhao |
-| [HDFS-3711](https://issues.apache.org/jira/browse/HDFS-3711) | Manually convert remaining tests to JUnit4 | Major | . | Andrew Wang | Andrew Wang |
-| [HDFS-3697](https://issues.apache.org/jira/browse/HDFS-3697) | Enable fadvise readahead by default | Minor | datanode, performance | Todd Lipcon | Todd Lipcon |
-| [HDFS-3672](https://issues.apache.org/jira/browse/HDFS-3672) | Expose disk-location information for blocks to enable better scheduling | Major | . | Andrew Wang | Andrew Wang |
-| [HDFS-3666](https://issues.apache.org/jira/browse/HDFS-3666) | Plumb more exception messages to terminate | Minor | . | Eli Collins | Eli Collins |
-| [HDFS-3663](https://issues.apache.org/jira/browse/HDFS-3663) | MiniDFSCluster should capture the code path that led to the first ExitException | Major | test | Eli Collins | Eli Collins |
-| [HDFS-3659](https://issues.apache.org/jira/browse/HDFS-3659) | Add missing @Override to methods across the hadoop-hdfs project | Minor | documentation | Brandon Li | Brandon Li |
-| [HDFS-3650](https://issues.apache.org/jira/browse/HDFS-3650) | Use MutableQuantiles to provide latency histograms for various operations | Major | . | Andrew Wang | Andrew Wang |
-| [HDFS-3641](https://issues.apache.org/jira/browse/HDFS-3641) | Move server Util time methods to common and use now instead of System#currentTimeMillis | Minor | . | Eli Collins | Eli Collins |
-| [HDFS-3613](https://issues.apache.org/jira/browse/HDFS-3613) | GSet prints some INFO level values, which aren't really very useful to all | Trivial | namenode | Harsh J | Andrew Wang |
-| [HDFS-3612](https://issues.apache.org/jira/browse/HDFS-3612) | Single namenode image directory config warning can be improved | Trivial | namenode | Harsh J | Andy Isaacson |
-| [HDFS-3610](https://issues.apache.org/jira/browse/HDFS-3610) | fuse\_dfs: Provide a way to use the default (configured) NN URI | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3607](https://issues.apache.org/jira/browse/HDFS-3607) | log a message when fuse\_dfs is not built | Minor | fuse-dfs | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3604](https://issues.apache.org/jira/browse/HDFS-3604) | Add dfs.webhdfs.enabled to hdfs-default.xml | Minor | . | Eli Collins | Eli Collins |
-| [HDFS-3583](https://issues.apache.org/jira/browse/HDFS-3583) | Convert remaining tests to Junit4 | Major | test | Eli Collins | Andrew Wang |
-| [HDFS-3582](https://issues.apache.org/jira/browse/HDFS-3582) | Hook daemon process exit for testing | Minor | test | Eli Collins | Eli Collins |
-| [HDFS-3568](https://issues.apache.org/jira/browse/HDFS-3568) | fuse\_dfs: add support for security | Major | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3537](https://issues.apache.org/jira/browse/HDFS-3537) | Move libhdfs and fuse-dfs source to native subdirectories | Minor | fuse-dfs, libhdfs | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3520](https://issues.apache.org/jira/browse/HDFS-3520) | Add transfer rate logging to TransferFsImage | Minor | namenode | Eli Collins | Eli Collins |
-| [HDFS-3516](https://issues.apache.org/jira/browse/HDFS-3516) | Check content-type in WebHdfsFileSystem | Major | hdfs-client, webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-3134](https://issues.apache.org/jira/browse/HDFS-3134) | Harden edit log loader against malformed or malicious input | Major | namenode | Colin P. McCabe | Colin P. McCabe |
+| [HADOOP-8361](https://issues.apache.org/jira/browse/HADOOP-8361) | Avoid out-of-memory problems when deserializing strings | Minor | . | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-3404](https://issues.apache.org/jira/browse/HDFS-3404) | Make putImage in GetImageServlet infer remote address to fetch from request | Major | . | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-3335](https://issues.apache.org/jira/browse/HDFS-3335) | check for edit log corruption at the end of the log | Major | . | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-3416](https://issues.apache.org/jira/browse/HDFS-3416) | Cleanup DatanodeID and DatanodeRegistration constructors used by testing | Minor | datanode | Eli Collins | Eli Collins |
+| [HDFS-3417](https://issues.apache.org/jira/browse/HDFS-3417) | Rename BalancerDatanode#getName to getDisplayName to be consistent with Datanode | Minor | datanode | Eli Collins | Eli Collins |
+| [HDFS-3419](https://issues.apache.org/jira/browse/HDFS-3419) | Cleanup LocatedBlock | Minor | . | Eli Collins | Eli Collins |
+| [HADOOP-8398](https://issues.apache.org/jira/browse/HADOOP-8398) | Cleanup BlockLocation | Minor | . | Eli Collins | Eli Collins |
+| [HDFS-3438](https://issues.apache.org/jira/browse/HDFS-3438) | BootstrapStandby should not require a rollEdits on active node | Major | ha | Todd Lipcon | Todd Lipcon |
+| [HDFS-2885](https://issues.apache.org/jira/browse/HDFS-2885) | Remove "federation" from the nameservice config options | Major | namenode | Eli Collins | Tsz Wo Nicholas Sze |
+| [HDFS-3394](https://issues.apache.org/jira/browse/HDFS-3394) | Do not use generic in INodeFile.getLastBlock() | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-4274](https://issues.apache.org/jira/browse/MAPREDUCE-4274) | MapOutputBuffer should use native byte order for kvmeta | Minor | performance, task | Todd Lipcon | Todd Lipcon |
+| [HDFS-3454](https://issues.apache.org/jira/browse/HDFS-3454) | Balancer unconditionally logs InterruptedException at INFO level on shutdown if security is enabled | Minor | balancer & mover | Eli Collins | Eli Collins |
+| [HADOOP-8367](https://issues.apache.org/jira/browse/HADOOP-8367) | Improve documentation of declaringClassProtocolName in rpc headers | Major | . | Sanjay Radia | Sanjay Radia |
+| [HDFS-1013](https://issues.apache.org/jira/browse/HDFS-1013) | Miscellaneous improvements to HTML markup for web UIs | Minor | . | Todd Lipcon | Eugene Koontz |
+| [HADOOP-8323](https://issues.apache.org/jira/browse/HADOOP-8323) | Revert HADOOP-7940 and improve javadocs and test for Text.clear() | Critical | io | Harsh J | Harsh J |
+| [HDFS-2391](https://issues.apache.org/jira/browse/HDFS-2391) | Newly set BalancerBandwidth value is not displayed anywhere | Major | balancer & mover | Rajit Saha | Harsh J |
+| [HADOOP-8358](https://issues.apache.org/jira/browse/HADOOP-8358) | Config-related WARN for dfs.web.ugi can be avoided. | Trivial | conf | Harsh J | Harsh J |
+| [MAPREDUCE-4146](https://issues.apache.org/jira/browse/MAPREDUCE-4146) | Support limits on task status string length and number of block locations in branch-2 | Major | . | Tom White | Ahmed Radwan |
+| [MAPREDUCE-4301](https://issues.apache.org/jira/browse/MAPREDUCE-4301) | Dedupe some strings in MRAM for memory savings | Major | applicationmaster | Robert Joseph Evans | Robert Joseph Evans |
+| [HDFS-3040](https://issues.apache.org/jira/browse/HDFS-3040) | TestMulitipleNNDataBlockScanner is misspelled | Trivial | test | Aaron T. Myers | madhukara phatak |
+| [MAPREDUCE-3842](https://issues.apache.org/jira/browse/MAPREDUCE-3842) | stop webpages from automatic refreshing | Critical | mrv2, webapps | Alejandro Abdelnur | Thomas Graves |
| [HDFS-3514](https://issues.apache.org/jira/browse/HDFS-3514) | Add missing TestParallelLocalRead | Major | test | Henry Robinson | Henry Robinson |
-| [HDFS-3513](https://issues.apache.org/jira/browse/HDFS-3513) | HttpFS should cache filesystems | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-3871](https://issues.apache.org/jira/browse/MAPREDUCE-3871) | Allow symlinking in LocalJobRunner DistributedCache | Major | distributed-cache | Tom White | Tom White |
+| [MAPREDUCE-3921](https://issues.apache.org/jira/browse/MAPREDUCE-3921) | MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy | Major | mr-am, mrv2 | Vinod Kumar Vavilapalli | Bikas Saha |
+| [HDFS-3520](https://issues.apache.org/jira/browse/HDFS-3520) | Add transfer rate logging to TransferFsImage | Minor | namenode | Eli Collins | Eli Collins |
| [HDFS-3504](https://issues.apache.org/jira/browse/HDFS-3504) | Configurable retry in DFSClient | Major | hdfs-client | Siddharth Seth | Tsz Wo Nicholas Sze |
+| [HDFS-3372](https://issues.apache.org/jira/browse/HDFS-3372) | offlineEditsViewer should be able to read a binary edits file with recovery mode | Minor | tools | Colin P. McCabe | Colin P. McCabe |
+| [HADOOP-8524](https://issues.apache.org/jira/browse/HADOOP-8524) | Allow users to get source of a Configuration parameter | Trivial | conf | Harsh J | Harsh J |
+| [HDFS-3516](https://issues.apache.org/jira/browse/HDFS-3516) | Check content-type in WebHdfsFileSystem | Major | hdfs-client, webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
| [HDFS-3481](https://issues.apache.org/jira/browse/HDFS-3481) | Refactor HttpFS handling of JAX-RS query string parameters | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3002](https://issues.apache.org/jira/browse/HDFS-3002) | TestNameNodeMetrics need not wait for metrics update with new metrics framework | Trivial | test | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-8535](https://issues.apache.org/jira/browse/HADOOP-8535) | Cut hadoop build times in half (upgrade maven-compiler-plugin to 2.5.1) | Major | build | Jonathan Eagles | Jonathan Eagles |
| [HDFS-3475](https://issues.apache.org/jira/browse/HDFS-3475) | Make the replication and invalidation rates configurable | Trivial | . | Harsh J | Harsh J |
-| [HDFS-3454](https://issues.apache.org/jira/browse/HDFS-3454) | Balancer unconditionally logs InterruptedException at INFO level on shutdown if security is enabled | Minor | balancer & mover | Eli Collins | Eli Collins |
-| [HDFS-3438](https://issues.apache.org/jira/browse/HDFS-3438) | BootstrapStandby should not require a rollEdits on active node | Major | ha | Todd Lipcon | Todd Lipcon |
-| [HDFS-3419](https://issues.apache.org/jira/browse/HDFS-3419) | Cleanup LocatedBlock | Minor | . | Eli Collins | Eli Collins |
-| [HDFS-3417](https://issues.apache.org/jira/browse/HDFS-3417) | Rename BalancerDatanode#getName to getDisplayName to be consistent with Datanode | Minor | datanode | Eli Collins | Eli Collins |
-| [HDFS-3416](https://issues.apache.org/jira/browse/HDFS-3416) | Cleanup DatanodeID and DatanodeRegistration constructors used by testing | Minor | datanode | Eli Collins | Eli Collins |
-| [HDFS-3404](https://issues.apache.org/jira/browse/HDFS-3404) | Make putImage in GetImageServlet infer remote address to fetch from request | Major | . | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3401](https://issues.apache.org/jira/browse/HDFS-3401) | Cleanup DatanodeDescriptor creation in the tests | Major | datanode, test | Eli Collins | Eli Collins |
-| [HDFS-3400](https://issues.apache.org/jira/browse/HDFS-3400) | DNs should be able start with jsvc even if security is disabled | Major | datanode, scripts | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3394](https://issues.apache.org/jira/browse/HDFS-3394) | Do not use generic in INodeFile.getLastBlock() | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-3390](https://issues.apache.org/jira/browse/HDFS-3390) | DFSAdmin should print full stack traces of errors when DEBUG logging is enabled | Minor | hdfs-client | Aaron T. Myers | Aaron T. Myers |
-| [HDFS-3372](https://issues.apache.org/jira/browse/HDFS-3372) | offlineEditsViewer should be able to read a binary edits file with recovery mode | Minor | tools | Colin Patrick McCabe | Colin Patrick McCabe |
+| [HADOOP-6802](https://issues.apache.org/jira/browse/HADOOP-6802) | Remove FS\_CLIENT\_BUFFER\_DIR\_KEY = "fs.client.buffer.dir" from CommonConfigurationKeys.java (not used, deprecated) | Major | conf, fs | Erik Steffl | Sho Shimauchi |
+| [HADOOP-3450](https://issues.apache.org/jira/browse/HADOOP-3450) | Add tests to Local Directory Allocator for asserting their URI-returning capability | Minor | fs | Ari Rabkin | Sho Shimauchi |
+| [HADOOP-8533](https://issues.apache.org/jira/browse/HADOOP-8533) | Remove Parallel Call in IPC | Major | ipc | Suresh Srinivas | Brandon Li |
+| [HADOOP-8463](https://issues.apache.org/jira/browse/HADOOP-8463) | hadoop.security.auth\_to\_local needs a key definition and doc | Major | security | Eli Collins | madhukara phatak |
| [HDFS-3343](https://issues.apache.org/jira/browse/HDFS-3343) | Improve metrics for DN read latency | Major | datanode | Todd Lipcon | Andrew Wang |
-| [HDFS-3341](https://issues.apache.org/jira/browse/HDFS-3341) | Change minimum RPC versions to 2.0.0-SNAPSHOT instead of 2.0.0 | Minor | . | Todd Lipcon | Todd Lipcon |
-| [HDFS-3335](https://issues.apache.org/jira/browse/HDFS-3335) | check for edit log corruption at the end of the log | Major | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3276](https://issues.apache.org/jira/browse/HDFS-3276) | initializeSharedEdits should have a -nonInteractive flag | Minor | ha, namenode | Vinithra Varadharajan | Todd Lipcon |
-| [HDFS-3230](https://issues.apache.org/jira/browse/HDFS-3230) | Cleanup DatanodeID creation in the tests | Minor | test | Eli Collins | Eli Collins |
-| [HDFS-3227](https://issues.apache.org/jira/browse/HDFS-3227) | Mavenise libhdfs tests | Major | libhdfs | Henry Robinson | |
| [HDFS-3170](https://issues.apache.org/jira/browse/HDFS-3170) | Add more useful metrics for write latency | Major | datanode | Todd Lipcon | Matthew Jacobs |
-| [HDFS-3134](https://issues.apache.org/jira/browse/HDFS-3134) | Harden edit log loader against malformed or malicious input | Major | namenode | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HDFS-3110](https://issues.apache.org/jira/browse/HDFS-3110) | libhdfs implementation of direct read API | Major | libhdfs, performance | Henry Robinson | Henry Robinson |
-| [HDFS-3040](https://issues.apache.org/jira/browse/HDFS-3040) | TestMulitipleNNDataBlockScanner is misspelled | Trivial | test | Aaron T. Myers | madhukara phatak |
-| [HDFS-3002](https://issues.apache.org/jira/browse/HDFS-3002) | TestNameNodeMetrics need not wait for metrics update with new metrics framework | Trivial | test | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-3604](https://issues.apache.org/jira/browse/HDFS-3604) | Add dfs.webhdfs.enabled to hdfs-default.xml | Minor | . | Eli Collins | Eli Collins |
| [HDFS-2988](https://issues.apache.org/jira/browse/HDFS-2988) | Improve error message when storage directory lock fails | Minor | namenode | Todd Lipcon | Miomir Boljanovic |
-| [HDFS-2885](https://issues.apache.org/jira/browse/HDFS-2885) | Remove "federation" from the nameservice config options | Major | namenode | Eli Collins | Tsz Wo Nicholas Sze |
-| [HDFS-2834](https://issues.apache.org/jira/browse/HDFS-2834) | ByteBuffer-based read API for DFSInputStream | Major | hdfs-client, performance | Henry Robinson | Henry Robinson |
-| [HDFS-2652](https://issues.apache.org/jira/browse/HDFS-2652) | Port token service changes from 205 | Major | . | Daryn Sharp | Daryn Sharp |
-| [HDFS-2421](https://issues.apache.org/jira/browse/HDFS-2421) | Improve the concurrency of SerialNumberMap in NameNode | Major | namenode | Hairong Kuang | Jing Zhao |
-| [HDFS-2391](https://issues.apache.org/jira/browse/HDFS-2391) | Newly set BalancerBandwidth value is not displayed anywhere | Major | balancer & mover | Rajit Saha | Harsh J |
-| [HDFS-1013](https://issues.apache.org/jira/browse/HDFS-1013) | Miscellaneous improvements to HTML markup for web UIs | Minor | . | Todd Lipcon | Eugene Koontz |
-| [HDFS-799](https://issues.apache.org/jira/browse/HDFS-799) | libhdfs must call DetachCurrentThread when a thread is destroyed | Major | . | Christian Kunz | Colin Patrick McCabe |
-| [MAPREDUCE-4638](https://issues.apache.org/jira/browse/MAPREDUCE-4638) | MR AppMaster shouldn't rely on YARN\_APPLICATION\_CLASSPATH providing MR jars | Major | . | Arun C Murthy | Arun C Murthy |
-| [MAPREDUCE-4614](https://issues.apache.org/jira/browse/MAPREDUCE-4614) | Simplify debugging a job's tokens | Major | client, task | Daryn Sharp | Daryn Sharp |
-| [MAPREDUCE-4511](https://issues.apache.org/jira/browse/MAPREDUCE-4511) | Add IFile readahead | Major | mrv1, mrv2, performance | Ahmed Radwan | Ahmed Radwan |
-| [MAPREDUCE-4422](https://issues.apache.org/jira/browse/MAPREDUCE-4422) | YARN\_APPLICATION\_CLASSPATH needs a documented default value in YarnConfiguration | Major | nodemanager | Arun C Murthy | Ahmed Radwan |
-| [MAPREDUCE-4408](https://issues.apache.org/jira/browse/MAPREDUCE-4408) | allow jobs to set a JAR that is in the distributed cached | Major | mrv1, mrv2 | Alejandro Abdelnur | Robert Kanter |
-| [MAPREDUCE-4375](https://issues.apache.org/jira/browse/MAPREDUCE-4375) | Show Configuration Tracability in MR UI | Major | applicationmaster | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4301](https://issues.apache.org/jira/browse/MAPREDUCE-4301) | Dedupe some strings in MRAM for memory savings | Major | applicationmaster | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4283](https://issues.apache.org/jira/browse/MAPREDUCE-4283) | Display tail of aggregated logs by default | Major | jobhistoryserver, mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4274](https://issues.apache.org/jira/browse/MAPREDUCE-4274) | MapOutputBuffer should use native byte order for kvmeta | Minor | performance, task | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-4210](https://issues.apache.org/jira/browse/MAPREDUCE-4210) | Expose listener address for WebApp | Major | webapps | Daryn Sharp | Daryn Sharp |
-| [MAPREDUCE-4205](https://issues.apache.org/jira/browse/MAPREDUCE-4205) | retrofit all JVM shutdown hooks to use ShutdownHookManager | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur |
-| [MAPREDUCE-4190](https://issues.apache.org/jira/browse/MAPREDUCE-4190) | Improve web UI for task attempts userlog link | Major | mrv2, webapps | Thomas Graves | Thomas Graves |
-| [MAPREDUCE-4157](https://issues.apache.org/jira/browse/MAPREDUCE-4157) | ResourceManager should not kill apps that are well behaved | Major | mrv2 | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4151](https://issues.apache.org/jira/browse/MAPREDUCE-4151) | RM scheduler web page should filter apps to those that are relevant to scheduling | Major | mrv2, webapps | Jason Lowe | Jason Lowe |
-| [MAPREDUCE-4146](https://issues.apache.org/jira/browse/MAPREDUCE-4146) | Support limits on task status string length and number of block locations in branch-2 | Major | . | Tom White | Ahmed Radwan |
-| [MAPREDUCE-4079](https://issues.apache.org/jira/browse/MAPREDUCE-4079) | Allow MR AppMaster to limit ephemeral port range. | Blocker | mr-am, mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4059](https://issues.apache.org/jira/browse/MAPREDUCE-4059) | The history server should have a separate pluggable storage/query interface | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
-| [MAPREDUCE-4017](https://issues.apache.org/jira/browse/MAPREDUCE-4017) | Add jobname to jobsummary log | Trivial | jobhistoryserver, jobtracker | Koji Noguchi | Thomas Graves |
-| [MAPREDUCE-3921](https://issues.apache.org/jira/browse/MAPREDUCE-3921) | MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy | Major | mr-am, mrv2 | Vinod Kumar Vavilapalli | Bikas Saha |
| [MAPREDUCE-3907](https://issues.apache.org/jira/browse/MAPREDUCE-3907) | Document entries mapred-default.xml for the jobhistory server. | Minor | documentation | Eugene Koontz | Eugene Koontz |
| [MAPREDUCE-3906](https://issues.apache.org/jira/browse/MAPREDUCE-3906) | Fix inconsistency in documentation regarding mapreduce.jobhistory.principal | Trivial | documentation | Eugene Koontz | Eugene Koontz |
-| [MAPREDUCE-3871](https://issues.apache.org/jira/browse/MAPREDUCE-3871) | Allow symlinking in LocalJobRunner DistributedCache | Major | distributed-cache | Tom White | Tom White |
-| [MAPREDUCE-3850](https://issues.apache.org/jira/browse/MAPREDUCE-3850) | Avoid redundant calls for tokens in TokenCache | Major | security | Daryn Sharp | Daryn Sharp |
-| [MAPREDUCE-3842](https://issues.apache.org/jira/browse/MAPREDUCE-3842) | stop webpages from automatic refreshing | Critical | mrv2, webapps | Alejandro Abdelnur | Thomas Graves |
-| [MAPREDUCE-3659](https://issues.apache.org/jira/browse/MAPREDUCE-3659) | Host-based token support | Major | security | Daryn Sharp | Daryn Sharp |
-| [MAPREDUCE-3289](https://issues.apache.org/jira/browse/MAPREDUCE-3289) | Make use of fadvise in the NM's shuffle handler | Major | mrv2, nodemanager, performance | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-2786](https://issues.apache.org/jira/browse/MAPREDUCE-2786) | TestDFSIO should also test compression reading/writing from command-line. | Minor | benchmarks | Plamen Jeliazkov | Plamen Jeliazkov |
+| [HADOOP-8525](https://issues.apache.org/jira/browse/HADOOP-8525) | Provide Improved Traceability for Configuration | Trivial | . | Robert Joseph Evans | Robert Joseph Evans |
+| [HDFS-3613](https://issues.apache.org/jira/browse/HDFS-3613) | GSet prints some INFO level values, which aren't really very useful to all | Trivial | namenode | Harsh J | Andrew Wang |
+| [HDFS-3582](https://issues.apache.org/jira/browse/HDFS-3582) | Hook daemon process exit for testing | Minor | test | Eli Collins | Eli Collins |
+| [HADOOP-8541](https://issues.apache.org/jira/browse/HADOOP-8541) | Better high-percentile latency metrics | Major | metrics | Andrew Wang | Andrew Wang |
+| [HDFS-3641](https://issues.apache.org/jira/browse/HDFS-3641) | Move server Util time methods to common and use now instead of System#currentTimeMillis | Minor | . | Eli Collins | Eli Collins |
+| [HDFS-3612](https://issues.apache.org/jira/browse/HDFS-3612) | Single namenode image directory config warning can be improved | Trivial | namenode | Harsh J | Andy Isaacson |
+| [HDFS-3568](https://issues.apache.org/jira/browse/HDFS-3568) | fuse\_dfs: add support for security | Major | . | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-799](https://issues.apache.org/jira/browse/HDFS-799) | libhdfs must call DetachCurrentThread when a thread is destroyed | Major | . | Christian Kunz | Colin P. McCabe |
+| [HDFS-3610](https://issues.apache.org/jira/browse/HDFS-3610) | fuse\_dfs: Provide a way to use the default (configured) NN URI | Minor | . | Colin P. McCabe | Colin P. McCabe |
+| [HADOOP-8362](https://issues.apache.org/jira/browse/HADOOP-8362) | Improve exception message when Configuration.set() is called with a null key or value | Trivial | conf | Todd Lipcon | madhukara phatak |
+| [HDFS-3663](https://issues.apache.org/jira/browse/HDFS-3663) | MiniDFSCluster should capture the code path that led to the first ExitException | Major | test | Eli Collins | Eli Collins |
| [YARN-420](https://issues.apache.org/jira/browse/YARN-420) | Enable the RM to work with AM's that are not managed by it | Major | applications/unmanaged-AM-launcher | Bikas Saha | Bikas Saha |
+| [HDFS-3659](https://issues.apache.org/jira/browse/HDFS-3659) | Add missing @Override to methods across the hadoop-hdfs project | Minor | documentation | Brandon Li | Brandon Li |
+| [HADOOP-8531](https://issues.apache.org/jira/browse/HADOOP-8531) | SequenceFile Writer can throw out a better error if a serializer or deserializer isn't available | Trivial | io | Harsh J | madhukara phatak |
+| [HDFS-3537](https://issues.apache.org/jira/browse/HDFS-3537) | Move libhdfs and fuse-dfs source to native subdirectories | Minor | fuse-dfs, libhdfs | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-3666](https://issues.apache.org/jira/browse/HDFS-3666) | Plumb more exception messages to terminate | Minor | . | Eli Collins | Eli Collins |
+| [MAPREDUCE-4283](https://issues.apache.org/jira/browse/MAPREDUCE-4283) | Display tail of aggregated logs by default | Major | jobhistoryserver, mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4422](https://issues.apache.org/jira/browse/MAPREDUCE-4422) | YARN\_APPLICATION\_CLASSPATH needs a documented default value in YarnConfiguration | Major | nodemanager | Arun C Murthy | Ahmed Radwan |
+| [MAPREDUCE-4157](https://issues.apache.org/jira/browse/MAPREDUCE-4157) | ResourceManager should not kill apps that are well behaved | Major | mrv2 | Jason Lowe | Jason Lowe |
+| [HDFS-3583](https://issues.apache.org/jira/browse/HDFS-3583) | Convert remaining tests to Junit4 | Major | test | Eli Collins | Andrew Wang |
+| [HADOOP-8609](https://issues.apache.org/jira/browse/HADOOP-8609) | IPC server logs a useless message when shutting down socket | Major | . | Todd Lipcon | Jon Zuanich |
+| [HDFS-3711](https://issues.apache.org/jira/browse/HDFS-3711) | Manually convert remaining tests to JUnit4 | Major | . | Andrew Wang | Andrew Wang |
| [YARN-419](https://issues.apache.org/jira/browse/YARN-419) | Add client side for Unmanaged-AMs | Major | applications/unmanaged-AM-launcher | Bikas Saha | Bikas Saha |
-| [YARN-137](https://issues.apache.org/jira/browse/YARN-137) | Change the default scheduler to the CapacityScheduler | Major | scheduler | Siddharth Seth | Siddharth Seth |
-| [YARN-80](https://issues.apache.org/jira/browse/YARN-80) | Support delay scheduling for node locality in MR2's capacity scheduler | Major | capacityscheduler | Todd Lipcon | Arun C Murthy |
+| [HADOOP-8623](https://issues.apache.org/jira/browse/HADOOP-8623) | hadoop jar command should respect HADOOP\_OPTS | Minor | scripts | Steven Willis | Steven Willis |
+| [HDFS-3650](https://issues.apache.org/jira/browse/HDFS-3650) | Use MutableQuantiles to provide latency histograms for various operations | Major | . | Andrew Wang | Andrew Wang |
+| [HADOOP-8635](https://issues.apache.org/jira/browse/HADOOP-8635) | Cannot cancel paths registered deleteOnExit | Critical | fs | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4375](https://issues.apache.org/jira/browse/MAPREDUCE-4375) | Show Configuration Tracability in MR UI | Major | applicationmaster | Robert Joseph Evans | Robert Joseph Evans |
+| [HADOOP-8620](https://issues.apache.org/jira/browse/HADOOP-8620) | Add -Drequire.fuse and -Drequire.snappy | Minor | build | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-3513](https://issues.apache.org/jira/browse/HDFS-3513) | HttpFS should cache filesystems | Major | . | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3697](https://issues.apache.org/jira/browse/HDFS-3697) | Enable fadvise readahead by default | Minor | datanode, performance | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-3289](https://issues.apache.org/jira/browse/MAPREDUCE-3289) | Make use of fadvise in the NM's shuffle handler | Major | mrv2, nodemanager, performance | Todd Lipcon | Todd Lipcon |
+| [HDFS-3276](https://issues.apache.org/jira/browse/HDFS-3276) | initializeSharedEdits should have a -nonInteractive flag | Minor | ha, namenode | Vinithra Varadharajan | Todd Lipcon |
+| [HADOOP-8687](https://issues.apache.org/jira/browse/HADOOP-8687) | Upgrade log4j to 1.2.17 | Minor | . | Eli Collins | Eli Collins |
+| [HDFS-3765](https://issues.apache.org/jira/browse/HDFS-3765) | Namenode INITIALIZESHAREDEDITS should be able to initialize all shared storages | Major | ha | Vinayakumar B | Vinayakumar B |
+| [HDFS-3723](https://issues.apache.org/jira/browse/HDFS-3723) | All commands should support meaningful --help | Major | scripts, tools | E. Sammer | Jing Zhao |
+| [HDFS-3802](https://issues.apache.org/jira/browse/HDFS-3802) | StartupOption.name in HdfsServerConstants should be final | Trivial | . | Jing Zhao | Jing Zhao |
+| [HDFS-3796](https://issues.apache.org/jira/browse/HDFS-3796) | Speed up edit log tests by avoiding fsync() | Minor | test | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8278](https://issues.apache.org/jira/browse/HADOOP-8278) | Make sure components declare correct set of dependencies | Major | build | Tom White | Tom White |
+| [MAPREDUCE-4511](https://issues.apache.org/jira/browse/MAPREDUCE-4511) | Add IFile readahead | Major | mrv1, mrv2, performance | Ahmed Radwan | Ahmed Radwan |
+| [HADOOP-8700](https://issues.apache.org/jira/browse/HADOOP-8700) | Move the checksum type constants to an enum | Minor | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-2421](https://issues.apache.org/jira/browse/HDFS-2421) | Improve the concurrency of SerialNumberMap in NameNode | Major | namenode | Hairong Kuang | Jing Zhao |
+| [HDFS-3672](https://issues.apache.org/jira/browse/HDFS-3672) | Expose disk-location information for blocks to enable better scheduling | Major | . | Andrew Wang | Andrew Wang |
+| [HADOOP-8240](https://issues.apache.org/jira/browse/HADOOP-8240) | Allow users to specify a checksum type on create() | Major | fs | Kihwal Lee | Kihwal Lee |
+| [HADOOP-8239](https://issues.apache.org/jira/browse/HADOOP-8239) | Extend MD5MD5CRC32FileChecksum to show the actual checksum type being used | Major | fs | Kihwal Lee | Kihwal Lee |
+| [HDFS-3819](https://issues.apache.org/jira/browse/HDFS-3819) | Should check whether invalidate work percentage default value is not greater than 1.0f | Minor | . | Jing Zhao | Jing Zhao |
+| [HADOOP-8075](https://issues.apache.org/jira/browse/HADOOP-8075) | Lower native-hadoop library log from info to debug | Major | native | Eli Collins | Hızır Sefa İrken |
+| [MAPREDUCE-4408](https://issues.apache.org/jira/browse/MAPREDUCE-4408) | allow jobs to set a JAR that is in the distributed cached | Major | mrv1, mrv2 | Alejandro Abdelnur | Robert Kanter |
+| [HDFS-3844](https://issues.apache.org/jira/browse/HDFS-3844) | Add @Override where necessary and remove unnecessary {@inheritdoc} and imports | Trivial | . | Jing Zhao | Jing Zhao |
+| [HADOOP-8748](https://issues.apache.org/jira/browse/HADOOP-8748) | Move dfsclient retry to a util class | Minor | io | Arun C Murthy | Arun C Murthy |
+| [MAPREDUCE-4614](https://issues.apache.org/jira/browse/MAPREDUCE-4614) | Simplify debugging a job's tokens | Major | client, task | Daryn Sharp | Daryn Sharp |
+| [HDFS-3871](https://issues.apache.org/jira/browse/HDFS-3871) | Change NameNodeProxies to use HADOOP-8748 | Minor | hdfs-client | Arun C Murthy | Arun C Murthy |
+| [MAPREDUCE-2786](https://issues.apache.org/jira/browse/MAPREDUCE-2786) | TestDFSIO should also test compression reading/writing from command-line. | Minor | benchmarks | Plamen Jeliazkov | Plamen Jeliazkov |
| [YARN-10](https://issues.apache.org/jira/browse/YARN-10) | dist-shell shouldn't have a (test) dependency on hadoop-mapreduce-client-core | Major | . | Arun C Murthy | Hitesh Shah |
-| [YARN-9](https://issues.apache.org/jira/browse/YARN-9) | Rename YARN\_HOME to HADOOP\_YARN\_HOME | Major | . | Arun C Murthy | Vinod Kumar Vavilapalli |
-
+| [HDFS-3866](https://issues.apache.org/jira/browse/HDFS-3866) | HttpFS POM should have property where to download tomcat from | Minor | build | Ryan Hennig | Plamen Jeliazkov |
+| [HDFS-3887](https://issues.apache.org/jira/browse/HDFS-3887) | Remove redundant chooseTarget methods in BlockPlacementPolicy.java | Trivial | namenode | Jing Zhao | Jing Zhao |
+| [HADOOP-8624](https://issues.apache.org/jira/browse/HADOOP-8624) | ProtobufRpcEngine should log all RPCs if TRACE logging is enabled | Minor | ipc | Todd Lipcon | Todd Lipcon |
+| [HADOOP-8754](https://issues.apache.org/jira/browse/HADOOP-8754) | Deprecate all the RPC.getServer() variants | Minor | ipc | Brandon Li | Brandon Li |
+| [MAPREDUCE-4638](https://issues.apache.org/jira/browse/MAPREDUCE-4638) | MR AppMaster shouldn't rely on YARN\_APPLICATION\_CLASSPATH providing MR jars | Major | . | Arun C Murthy | Arun C Murthy |
+| [YARN-80](https://issues.apache.org/jira/browse/YARN-80) | Support delay scheduling for node locality in MR2's capacity scheduler | Major | capacityscheduler | Todd Lipcon | Arun C Murthy |
+| [YARN-9](https://issues.apache.org/jira/browse/YARN-9) | Rename YARN\_HOME to HADOOP\_YARN\_HOME | Major | . | Arun C Murthy | Vinod Kumar Vavilapalli |
+| [YARN-137](https://issues.apache.org/jira/browse/YARN-137) | Change the default scheduler to the CapacityScheduler | Major | scheduler | Siddharth Seth | Siddharth Seth |
+| [HDFS-3607](https://issues.apache.org/jira/browse/HDFS-3607) | log a message when fuse\_dfs is not built | Minor | fuse-dfs | Colin P. McCabe | Colin P. McCabe |
+| [HDFS-3227](https://issues.apache.org/jira/browse/HDFS-3227) | Mavenise libhdfs tests | Major | libhdfs | Henry Robinson | |
+| [HDFS-3907](https://issues.apache.org/jira/browse/HDFS-3907) | Allow multiple users for local block readers | Major | datanode | Eli Collins | Eli Collins |
+
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-8801](https://issues.apache.org/jira/browse/HADOOP-8801) | ExitUtil#terminate should capture the exception stack trace | Major | . | Eli Collins | Eli Collins |
-| [HADOOP-8781](https://issues.apache.org/jira/browse/HADOOP-8781) | hadoop-config.sh should add JAVA\_LIBRARY\_PATH to LD\_LIBRARY\_PATH | Major | scripts | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8775](https://issues.apache.org/jira/browse/HADOOP-8775) | MR2 distcp permits non-positive value to -bandwidth option which causes job never to complete | Major | . | Sandy Ryza | Sandy Ryza |
-| [HADOOP-8770](https://issues.apache.org/jira/browse/HADOOP-8770) | NN should not RPC to self to find trash defaults (causes deadlock) | Blocker | trash | Todd Lipcon | Eli Collins |
-| [HADOOP-8766](https://issues.apache.org/jira/browse/HADOOP-8766) | FileContextMainOperationsBaseTest should randomize the root dir | Major | test | Eli Collins | Colin Patrick McCabe |
-| [HADOOP-8764](https://issues.apache.org/jira/browse/HADOOP-8764) | CMake: HADOOP-8737 broke ARM build | Major | build | Trevor Robinson | Trevor Robinson |
-| [HADOOP-8749](https://issues.apache.org/jira/browse/HADOOP-8749) | HADOOP-8031 changed the way in which relative xincludes are handled in Configuration. | Major | conf | Ahmed Radwan | Ahmed Radwan |
-| [HADOOP-8747](https://issues.apache.org/jira/browse/HADOOP-8747) | Syntax error on cmake version 2.6 patch 2 in JNIFlags.cmake | Major | native | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8737](https://issues.apache.org/jira/browse/HADOOP-8737) | cmake: always use JAVA\_HOME to find libjvm.so, jni.h, jni\_md.h | Minor | native | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8727](https://issues.apache.org/jira/browse/HADOOP-8727) | Gracefully deprecate dfs.umaskmode in 2.x onwards | Major | conf | Harsh J | Harsh J |
-| [HADOOP-8726](https://issues.apache.org/jira/browse/HADOOP-8726) | The Secrets in Credentials are not available to MR tasks | Major | security | Benoy Antony | Daryn Sharp |
-| [HADOOP-8725](https://issues.apache.org/jira/browse/HADOOP-8725) | MR is broken when security is off | Blocker | security | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8722](https://issues.apache.org/jira/browse/HADOOP-8722) | Update BUILDING.txt with latest snappy info | Minor | documentation | Eli Collins | Colin Patrick McCabe |
-| [HADOOP-8721](https://issues.apache.org/jira/browse/HADOOP-8721) | ZKFC should not retry 45 times when attempting a graceful fence during a failover | Critical | auto-failover, ha | suja s | Vinayakumar B |
-| [HADOOP-8720](https://issues.apache.org/jira/browse/HADOOP-8720) | TestLocalFileSystem should use test root subdirectory | Trivial | test | Vlad Rozov | Vlad Rozov |
-| [HADOOP-8709](https://issues.apache.org/jira/browse/HADOOP-8709) | globStatus changed behavior from 0.20/1.x | Critical | fs | Jason Lowe | Jason Lowe |
-| [HADOOP-8703](https://issues.apache.org/jira/browse/HADOOP-8703) | distcpV2: turn CRC checking off for 0 byte size | Major | . | Dave Thompson | Dave Thompson |
-| [HADOOP-8699](https://issues.apache.org/jira/browse/HADOOP-8699) | some common testcases create core-site.xml in test-classes making other testcases to fail | Critical | test | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8697](https://issues.apache.org/jira/browse/HADOOP-8697) | TestWritableName fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
-| [HADOOP-8695](https://issues.apache.org/jira/browse/HADOOP-8695) | TestPathData fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
-| [HADOOP-8693](https://issues.apache.org/jira/browse/HADOOP-8693) | TestSecurityUtil fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
-| [HADOOP-8692](https://issues.apache.org/jira/browse/HADOOP-8692) | TestLocalDirAllocator fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
-| [HADOOP-8686](https://issues.apache.org/jira/browse/HADOOP-8686) | Fix warnings in native code | Minor | native | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8660](https://issues.apache.org/jira/browse/HADOOP-8660) | TestPseudoAuthenticator failing with NPE | Major | . | Eli Collins | Alejandro Abdelnur |
-| [HADOOP-8659](https://issues.apache.org/jira/browse/HADOOP-8659) | Native libraries must build with soft-float ABI for Oracle JVM on ARM | Major | native | Trevor Robinson | Colin Patrick McCabe |
-| [HADOOP-8655](https://issues.apache.org/jira/browse/HADOOP-8655) | In TextInputFormat, while specifying textinputformat.record.delimiter the character/character sequences in data file similar to starting character/starting character sequence in delimiter were found missing in certain cases in the Map Output | Major | util | Arun A K | |
-| [HADOOP-8654](https://issues.apache.org/jira/browse/HADOOP-8654) | TextInputFormat delimiter bug:- Input Text portion ends with & Delimiter starts with same char/char sequence | Major | util | Gelesh | |
-| [HADOOP-8648](https://issues.apache.org/jira/browse/HADOOP-8648) | libhadoop: native CRC32 validation crashes when io.bytes.per.checksum=1 | Major | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8637](https://issues.apache.org/jira/browse/HADOOP-8637) | FilterFileSystem#setWriteChecksum is broken | Critical | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8634](https://issues.apache.org/jira/browse/HADOOP-8634) | Ensure FileSystem#close doesn't squawk for deleteOnExit paths | Critical | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8633](https://issues.apache.org/jira/browse/HADOOP-8633) | Interrupted FsShell copies may leave tmp files | Critical | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8632](https://issues.apache.org/jira/browse/HADOOP-8632) | Configuration leaking class-loaders | Major | conf | Costin Leau | Costin Leau |
-| [HADOOP-8627](https://issues.apache.org/jira/browse/HADOOP-8627) | FS deleteOnExit may delete the wrong path | Critical | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8626](https://issues.apache.org/jira/browse/HADOOP-8626) | Typo in default setting for hadoop.security.group.mapping.ldap.search.filter.user | Major | security | Jonathan Natkins | Jonathan Natkins |
-| [HADOOP-8614](https://issues.apache.org/jira/browse/HADOOP-8614) | IOUtils#skipFully hangs forever on EOF | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8613](https://issues.apache.org/jira/browse/HADOOP-8613) | AbstractDelegationTokenIdentifier#getUser() should set token auth type | Critical | . | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8611](https://issues.apache.org/jira/browse/HADOOP-8611) | Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails | Major | security | Kihwal Lee | Robert Parker |
-| [HADOOP-8606](https://issues.apache.org/jira/browse/HADOOP-8606) | FileSystem.get may return the wrong filesystem | Major | fs | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8599](https://issues.apache.org/jira/browse/HADOOP-8599) | Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file | Major | fs | Andrey Klochkov | Andrey Klochkov |
-| [HADOOP-8587](https://issues.apache.org/jira/browse/HADOOP-8587) | HarFileSystem access of harMetaCache isn't threadsafe | Minor | fs | Eli Collins | Eli Collins |
-| [HADOOP-8586](https://issues.apache.org/jira/browse/HADOOP-8586) | Fixup a bunch of SPNEGO misspellings | Major | . | Eli Collins | Eli Collins |
-| [HADOOP-8585](https://issues.apache.org/jira/browse/HADOOP-8585) | Fix initialization circularity between UserGroupInformation and HadoopConfiguration | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8573](https://issues.apache.org/jira/browse/HADOOP-8573) | Configuration tries to read from an inputstream resource multiple times. | Major | conf | Robert Joseph Evans | Robert Joseph Evans |
-| [HADOOP-8566](https://issues.apache.org/jira/browse/HADOOP-8566) | AvroReflectSerializer.accept(Class) throws a NPE if the class has no package (primitive types and arrays) | Major | io | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8563](https://issues.apache.org/jira/browse/HADOOP-8563) | don't package hadoop-pipes examples/bin | Minor | build | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8550](https://issues.apache.org/jira/browse/HADOOP-8550) | hadoop fs -touchz automatically created parent directories | Major | fs | Robert Joseph Evans | John George |
-| [HADOOP-8547](https://issues.apache.org/jira/browse/HADOOP-8547) | Package hadoop-pipes examples/bin directory (again) | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8543](https://issues.apache.org/jira/browse/HADOOP-8543) | Invalid pom.xml files on 0.23 branch | Major | build | Radim Kolar | Radim Kolar |
-| [HADOOP-8538](https://issues.apache.org/jira/browse/HADOOP-8538) | CMake builds fail on ARM | Major | native | Trevor Robinson | Trevor Robinson |
-| [HADOOP-8537](https://issues.apache.org/jira/browse/HADOOP-8537) | Two TFile tests failing recently | Major | io | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8512](https://issues.apache.org/jira/browse/HADOOP-8512) | AuthenticatedURL should reset the Token when the server returns other than OK on authentication | Minor | security | Alejandro Abdelnur | Alejandro Abdelnur |
-| [HADOOP-8509](https://issues.apache.org/jira/browse/HADOOP-8509) | JarFinder duplicate entry: META-INF/MANIFEST.MF exception | Minor | util | Matteo Bertozzi | Alejandro Abdelnur |
-| [HADOOP-8507](https://issues.apache.org/jira/browse/HADOOP-8507) | Avoid OOM while deserializing DelegationTokenIdentifer | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8501](https://issues.apache.org/jira/browse/HADOOP-8501) | Gridmix fails to compile on OpenJDK7u4 | Major | benchmarks | Radim Kolar | Radim Kolar |
-| [HADOOP-8499](https://issues.apache.org/jira/browse/HADOOP-8499) | Lower min.user.id to 500 for the tests | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8495](https://issues.apache.org/jira/browse/HADOOP-8495) | Update Netty to avoid leaking file descriptors during shuffle | Critical | build | Jason Lowe | Jason Lowe |
-| [HADOOP-8488](https://issues.apache.org/jira/browse/HADOOP-8488) | test-patch.sh gives +1 even if the native build fails. | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8485](https://issues.apache.org/jira/browse/HADOOP-8485) | Don't hardcode "Apache Hadoop 0.23" in the docs | Minor | documentation | Eli Collins | Eli Collins |
-| [HADOOP-8481](https://issues.apache.org/jira/browse/HADOOP-8481) | update BUILDING.txt to talk about cmake rather than autotools | Trivial | documentation | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8480](https://issues.apache.org/jira/browse/HADOOP-8480) | The native build should honor -DskipTests | Trivial | . | Colin Patrick McCabe | Colin Patrick McCabe |
-| [HADOOP-8466](https://issues.apache.org/jira/browse/HADOOP-8466) | hadoop-client POM incorrectly excludes avro | Major | build | Bruno Mahé | Bruno Mahé |
-| [HADOOP-8460](https://issues.apache.org/jira/browse/HADOOP-8460) | Document proper setting of HADOOP\_PID\_DIR and HADOOP\_SECURE\_DN\_PID\_DIR | Major | documentation | Robert Joseph Evans | Robert Joseph Evans |
-| [HADOOP-8452](https://issues.apache.org/jira/browse/HADOOP-8452) | DN logs backtrace when running under jsvc and /jmx is loaded | Minor | . | Andy Isaacson | Andy Isaacson |
-| [HADOOP-8450](https://issues.apache.org/jira/browse/HADOOP-8450) | Remove src/test/system | Trivial | test | Colin Patrick McCabe | Eli Collins |
-| [HADOOP-8449](https://issues.apache.org/jira/browse/HADOOP-8449) | hadoop fs -text fails with compressed sequence files with the codec file extension | Minor | . | Joey Echeverria | Harsh J |
-| [HADOOP-8444](https://issues.apache.org/jira/browse/HADOOP-8444) | Fix the tests FSMainOperationsBaseTest.java and F ileContextMainOperationsBaseTest.java to avoid potential test failure | Major | fs, test | Mariappan Asokan | madhukara phatak |
-| [HADOOP-8438](https://issues.apache.org/jira/browse/HADOOP-8438) | hadoop-validate-setup.sh refers to examples jar file which doesn't exist | Major | . | Devaraj K | Devaraj K |
-| [HADOOP-8433](https://issues.apache.org/jira/browse/HADOOP-8433) | Don't set HADOOP\_LOG\_DIR in hadoop-env.sh | Major | scripts | Brahma Reddy Battula | Brahma Reddy Battula |
-| [HADOOP-8431](https://issues.apache.org/jira/browse/HADOOP-8431) | Running distcp wo args throws IllegalArgumentException | Major | . | Eli Collins | Sandy Ryza |
-| [HADOOP-8423](https://issues.apache.org/jira/browse/HADOOP-8423) | MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data | Major | io | Jason B | Todd Lipcon |
-| [HADOOP-8422](https://issues.apache.org/jira/browse/HADOOP-8422) | Deprecate FileSystem#getDefault\* and getServerDefault methods that don't take a Path argument | Minor | fs | Eli Collins | Eli Collins |
-| [HADOOP-8408](https://issues.apache.org/jira/browse/HADOOP-8408) | MR doesn't work with a non-default ViewFS mount table and security enabled | Major | viewfs | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-8406](https://issues.apache.org/jira/browse/HADOOP-8406) | CompressionCodecFactory.CODEC\_PROVIDERS iteration is thread-unsafe | Major | io | Todd Lipcon | Todd Lipcon |
-| [HADOOP-8400](https://issues.apache.org/jira/browse/HADOOP-8400) | All commands warn "Kerberos krb5 configuration not found" when security is not enabled | Major | security | Eli Collins | Alejandro Abdelnur |
-| [HADOOP-8393](https://issues.apache.org/jira/browse/HADOOP-8393) | hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster | Major | scripts | Patrick Hunt | Patrick Hunt |
-| [HADOOP-8390](https://issues.apache.org/jira/browse/HADOOP-8390) | TestFileSystemCanonicalization fails with JDK7 | Major | test | Trevor Robinson | Trevor Robinson |
-| [HADOOP-8372](https://issues.apache.org/jira/browse/HADOOP-8372) | normalizeHostName() in NetUtils is not working properly in resolving a hostname start with numeric character | Major | io, util | Junping Du | Junping Du |
-| [HADOOP-8370](https://issues.apache.org/jira/browse/HADOOP-8370) | Native build failure: javah: class file for org.apache.hadoop.classification.InterfaceAudience not found | Major | native | Trevor Robinson | Trevor Robinson |
-| [HADOOP-8342](https://issues.apache.org/jira/browse/HADOOP-8342) | HDFS command fails with exception following merge of HADOOP-8325 | Major | fs | Randy Clayton | Alejandro Abdelnur |
-| [HADOOP-8341](https://issues.apache.org/jira/browse/HADOOP-8341) | Fix or filter findbugs issues in hadoop-tools | Major | . | Robert Joseph Evans | Robert Joseph Evans |
+| [HADOOP-7703](https://issues.apache.org/jira/browse/HADOOP-7703) | WebAppContext should also be stopped and cleared | Major | . | Devaraj K | Devaraj K |
+| [HDFS-2285](https://issues.apache.org/jira/browse/HDFS-2285) | BackupNode should reject requests trying to modify namespace | Major | namenode | Konstantin Shvachko | Konstantin Shvachko |
+| [HDFS-2759](https://issues.apache.org/jira/browse/HDFS-2759) | Pre-allocate HDFS edit log files after writing version number | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers |
+| [HADOOP-8104](https://issues.apache.org/jira/browse/HADOOP-8104) | Inconsistent Jackson versions | Major | . | Colin P. McCabe | Alejandro Abdelnur |
+| [MAPREDUCE-3728](https://issues.apache.org/jira/browse/MAPREDUCE-3728) | ShuffleHandler can't access results when configured in a secure mode | Critical | mrv2, nodemanager | Roman Shaposhnik | Ding Yuan |
+| [HDFS-3037](https://issues.apache.org/jira/browse/HDFS-3037) | TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy | Minor | test | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-2966](https://issues.apache.org/jira/browse/HDFS-2966) | TestNameNodeMetrics tests can fail under load | Minor | test | Steve Loughran | Steve Loughran |
+| [MAPREDUCE-3348](https://issues.apache.org/jira/browse/MAPREDUCE-3348) | mapred job -status fails to give info even if the job is present in History | Major | mrv2 | Devaraj K | Devaraj K |
+| [HADOOP-8167](https://issues.apache.org/jira/browse/HADOOP-8167) | Configuration deprecation logic breaks backwards compatibility | Blocker | conf | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HDFS-3067](https://issues.apache.org/jira/browse/HDFS-3067) | NPE in DFSInputStream.readBuffer if read is repeated on corrupted block | Major | hdfs-client | Henry Robinson | Henry Robinson |
+| [MAPREDUCE-4010](https://issues.apache.org/jira/browse/MAPREDUCE-4010) | TestWritableJobConf fails on trunk | Critical | mrv2 | Jason Lowe | Alejandro Abdelnur |
+| [HADOOP-8197](https://issues.apache.org/jira/browse/HADOOP-8197) | Configuration logs WARNs on every use of a deprecated key | Critical | conf | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-3992](https://issues.apache.org/jira/browse/MAPREDUCE-3992) | Reduce fetcher doesn't verify HTTP status code of response | Major | mrv1 | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-4082](https://issues.apache.org/jira/browse/MAPREDUCE-4082) | hadoop-mapreduce-client-app's mrapp-generated-classpath file should not be in the module JAR | Critical | build | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-4091](https://issues.apache.org/jira/browse/MAPREDUCE-4091) | tools testcases failing because of MAPREDUCE-4082 | Critical | build, test | Alejandro Abdelnur | Alejandro Abdelnur |
+| [MAPREDUCE-4092](https://issues.apache.org/jira/browse/MAPREDUCE-4092) | commitJob Exception does not fail job (regression in 0.23 vs 0.20) | Blocker | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-4089](https://issues.apache.org/jira/browse/MAPREDUCE-4089) | Hung Tasks never time out. | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4024](https://issues.apache.org/jira/browse/MAPREDUCE-4024) | RM webservices can't query on finalStatus | Major | mrv2 | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4060](https://issues.apache.org/jira/browse/MAPREDUCE-4060) | Multiple SLF4J binding warning | Major | build | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4012](https://issues.apache.org/jira/browse/MAPREDUCE-4012) | Hadoop Job setup error leaves no useful info to users (when LinuxTaskController is used) | Minor | . | Koji Noguchi | Thomas Graves |
+| [MAPREDUCE-4062](https://issues.apache.org/jira/browse/MAPREDUCE-4062) | AM Launcher thread can hang forever | Major | mrv2 | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-3988](https://issues.apache.org/jira/browse/MAPREDUCE-3988) | mapreduce.job.local.dir doesn't point to a single directory on a node. | Major | mrv2 | Vinod Kumar Vavilapalli | Eric Payne |
+| [HDFS-3166](https://issues.apache.org/jira/browse/HDFS-3166) | Hftp connections do not have a timeout | Critical | hdfs-client | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-3999](https://issues.apache.org/jira/browse/MAPREDUCE-3999) | Tracking link gives an error if the AppMaster hasn't started yet | Major | mrv2, webapps | Ravi Prakash | Ravi Prakash |
+| [HDFS-3176](https://issues.apache.org/jira/browse/HDFS-3176) | JsonUtil should not parse the MD5MD5CRC32FileChecksum bytes on its own. | Major | hdfs-client | Kihwal Lee | Kihwal Lee |
+| [MAPREDUCE-4020](https://issues.apache.org/jira/browse/MAPREDUCE-4020) | Web services returns incorrect JSON for deep queue tree | Major | mrv2, webapps | Jason Lowe | Anupam Seth |
+| [MAPREDUCE-3672](https://issues.apache.org/jira/browse/MAPREDUCE-3672) | Killed maps shouldn't be counted towards JobCounter.NUM\_FAILED\_MAPS | Major | mr-am, mrv2 | Vinod Kumar Vavilapalli | Anupam Seth |
+| [MAPREDUCE-3682](https://issues.apache.org/jira/browse/MAPREDUCE-3682) | Tracker URL says AM tasks run on localhost | Major | mrv2 | David Capwell | Ravi Prakash |
+| [MAPREDUCE-3082](https://issues.apache.org/jira/browse/MAPREDUCE-3082) | archive command take wrong path for input file with current directory | Major | harchive | Rajit Saha | John George |
+| [MAPREDUCE-3650](https://issues.apache.org/jira/browse/MAPREDUCE-3650) | testGetTokensForHftpFS() fails | Blocker | mrv2 | Thomas Graves | Ravi Prakash |
+| [HADOOP-8088](https://issues.apache.org/jira/browse/HADOOP-8088) | User-group mapping cache incorrectly does negative caching on transient failures | Major | security | Kihwal Lee | Kihwal Lee |
+| [HADOOP-8179](https://issues.apache.org/jira/browse/HADOOP-8179) | risk of NPE in CopyCommands processArguments() | Minor | fs | Steve Loughran | Daryn Sharp |
+| [MAPREDUCE-4097](https://issues.apache.org/jira/browse/MAPREDUCE-4097) | tools testcases fail because missing mrapp-generated-classpath file in classpath | Major | build | Alejandro Abdelnur | Roman Shaposhnik |
+| [HADOOP-8180](https://issues.apache.org/jira/browse/HADOOP-8180) | Remove hsqldb since its not needed from pom.xml | Major | . | Ravi Prakash | Ravi Prakash |
+| [HADOOP-6963](https://issues.apache.org/jira/browse/HADOOP-6963) | Fix FileUtil.getDU. It should not include the size of the directory or follow symbolic links | Critical | fs | Owen O'Malley | Ravi Prakash |
+| [MAPREDUCE-3621](https://issues.apache.org/jira/browse/MAPREDUCE-3621) | TestDBJob and TestDataDrivenDBInputFormat ant tests fail | Major | mrv2 | Thomas Graves | Ravi Prakash |
+| [MAPREDUCE-4073](https://issues.apache.org/jira/browse/MAPREDUCE-4073) | CS assigns multiple off-switch containers when using multi-level-queues | Critical | mrv2, scheduler | Siddharth Seth | Siddharth Seth |
+| [HDFS-3136](https://issues.apache.org/jira/browse/HDFS-3136) | Multiple SLF4J binding warning | Major | build | Jason Lowe | Jason Lowe |
+| [HADOOP-8014](https://issues.apache.org/jira/browse/HADOOP-8014) | ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary | Major | fs | Daryn Sharp | John George |
+| [MAPREDUCE-4117](https://issues.apache.org/jira/browse/MAPREDUCE-4117) | mapred job -status throws NullPointerException | Critical | client, mrv2 | Devaraj K | Devaraj K |
+| [HDFS-3235](https://issues.apache.org/jira/browse/HDFS-3235) | MiniDFSClusterManager doesn't correctly support -format option | Minor | . | Henry Robinson | Henry Robinson |
+| [HDFS-3243](https://issues.apache.org/jira/browse/HDFS-3243) | TestParallelRead timing out on jenkins | Major | hdfs-client, test | Todd Lipcon | Henry Robinson |
+| [MAPREDUCE-4040](https://issues.apache.org/jira/browse/MAPREDUCE-4040) | History links should use hostname rather than IP address. | Minor | jobhistoryserver, mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh |
+| [MAPREDUCE-4099](https://issues.apache.org/jira/browse/MAPREDUCE-4099) | ApplicationMaster may fail to remove staging directory | Critical | mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-3932](https://issues.apache.org/jira/browse/MAPREDUCE-3932) | MR tasks failing and crashing the AM when available-resources/headRoom becomes zero | Critical | mr-am, mrv2 | Vinod Kumar Vavilapalli | Robert Joseph Evans |
+| [MAPREDUCE-4140](https://issues.apache.org/jira/browse/MAPREDUCE-4140) | mapreduce classes incorrectly importing "clover.org.apache.\*" classes | Major | client, mrv2 | Patrick Hunt | Patrick Hunt |
+| [HADOOP-8144](https://issues.apache.org/jira/browse/HADOOP-8144) | pseudoSortByDistance in NetworkTopology doesn't work properly if no local node and first node is local rack node | Minor | io | Junping Du | Junping Du |
+| [MAPREDUCE-4050](https://issues.apache.org/jira/browse/MAPREDUCE-4050) | Invalid node link | Major | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh |
+| [MAPREDUCE-4128](https://issues.apache.org/jira/browse/MAPREDUCE-4128) | AM Recovery expects all attempts of a completed task to also be completed. | Major | mrv2 | Bikas Saha | Bikas Saha |
+| [HADOOP-8005](https://issues.apache.org/jira/browse/HADOOP-8005) | Multiple SLF4J binding message in .out file for all daemons | Major | scripts | Joe Crobak | Jason Lowe |
+| [MAPREDUCE-4144](https://issues.apache.org/jira/browse/MAPREDUCE-4144) | ResourceManager NPE while handling NODE\_UPDATE | Critical | mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4156](https://issues.apache.org/jira/browse/MAPREDUCE-4156) | ant build fails compiling JobInProgress | Major | build | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4160](https://issues.apache.org/jira/browse/MAPREDUCE-4160) | some mrv1 ant tests fail with timeout - due to 4156 | Major | test | Thomas Graves | Thomas Graves |
+| [MAPREDUCE-4139](https://issues.apache.org/jira/browse/MAPREDUCE-4139) | Potential ResourceManager deadlock when SchedulerEventDispatcher is stopped | Major | mrv2 | Jason Lowe | Jason Lowe |
+| [MAPREDUCE-4074](https://issues.apache.org/jira/browse/MAPREDUCE-4074) | Client continuously retries to RM When RM goes down before launching Application Master | Major | . | Devaraj K | xieguiming |
+| [HADOOP-8288](https://issues.apache.org/jira/browse/HADOOP-8288) | Remove references of mapred.child.ulimit etc. since they are not being used any more | Major | . | Ravi Prakash | Ravi Prakash |
+| [MAPREDUCE-4159](https://issues.apache.org/jira/browse/MAPREDUCE-4159) | Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero | Major | mrv2 | Nishan Shetty | Devaraj K |
+| [MAPREDUCE-4165](https://issues.apache.org/jira/browse/MAPREDUCE-4165) | Committing is misspelled as commiting in task logs | Trivial | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-4129](https://issues.apache.org/jira/browse/MAPREDUCE-4129) | Lots of unneeded counters log messages | Major | mrv2 | Ahmed Radwan | Ahmed Radwan |
+| [MAPREDUCE-3947](https://issues.apache.org/jira/browse/MAPREDUCE-3947) | yarn.app.mapreduce.am.resource.mb not documented | Minor | . | Todd Lipcon | Devaraj K |
+| [HDFS-3308](https://issues.apache.org/jira/browse/HDFS-3308) | hftp/webhdfs can't get tokens if authority has no port | Critical | webhdfs | Daryn Sharp | Daryn Sharp |
+| [MAPREDUCE-4133](https://issues.apache.org/jira/browse/MAPREDUCE-4133) | MR over viewfs is broken | Major | . | John George | John George |
+| [HDFS-3312](https://issues.apache.org/jira/browse/HDFS-3312) | Hftp selects wrong token service | Blocker | hdfs-client | Daryn Sharp | Daryn Sharp |
+| [HDFS-3321](https://issues.apache.org/jira/browse/HDFS-3321) | Error message for insufficient data nodes to come out of safemode is wrong. | Major | . | Ravi Prakash | Ravi Prakash |
+| [MAPREDUCE-4194](https://issues.apache.org/jira/browse/MAPREDUCE-4194) | ConcurrentModificationError in DirectoryCollection | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-4169](https://issues.apache.org/jira/browse/MAPREDUCE-4169) | Container Logs appear in unsorted order | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-4189](https://issues.apache.org/jira/browse/MAPREDUCE-4189) | TestContainerManagerSecurity is failing | Critical | mrv2 | Devaraj K | Devaraj K |
+| [HADOOP-8305](https://issues.apache.org/jira/browse/HADOOP-8305) | distcp over viewfs is broken | Major | viewfs | John George | John George |
+| [HDFS-3334](https://issues.apache.org/jira/browse/HDFS-3334) | ByteRangeInputStream leaks streams | Major | hdfs-client | Daryn Sharp | Daryn Sharp |
+| [HDFS-3331](https://issues.apache.org/jira/browse/HDFS-3331) | setBalancerBandwidth do not checkSuperuserPrivilege | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-4209](https://issues.apache.org/jira/browse/MAPREDUCE-4209) | junit dependency in hadoop-mapreduce-client is missing scope test | Major | build | Radim Kolar | |
+| [MAPREDUCE-4206](https://issues.apache.org/jira/browse/MAPREDUCE-4206) | Sorting by Last Health-Update on the RM nodes page sorts does not work correctly | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
| [HADOOP-8334](https://issues.apache.org/jira/browse/HADOOP-8334) | HttpServer sometimes returns incorrect port | Major | . | Daryn Sharp | Daryn Sharp |
-| [HADOOP-8330](https://issues.apache.org/jira/browse/HADOOP-8330) | TestSequenceFile.testCreateUsesFsArg() is broken | Minor | test | John George | John George |
-| [HADOOP-8329](https://issues.apache.org/jira/browse/HADOOP-8329) | Build fails with Java 7 | Major | build | Kumar Ravi | Eli Collins |
-| [HADOOP-8328](https://issues.apache.org/jira/browse/HADOOP-8328) | Duplicate FileSystem Statistics object for 'file' scheme | Major | fs | Tom White | Tom White |
-| [HADOOP-8327](https://issues.apache.org/jira/browse/HADOOP-8327) | distcpv2 and distcpv1 jars should not coexist | Major | . | Dave Thompson | Dave Thompson |
| [HADOOP-8325](https://issues.apache.org/jira/browse/HADOOP-8325) | Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook | Critical | fs | Alejandro Abdelnur | Alejandro Abdelnur |
+| [HADOOP-8330](https://issues.apache.org/jira/browse/HADOOP-8330) | TestSequenceFile.testCreateUsesFsArg() is broken | Minor | test | John George | John George |
+| [HDFS-3275](https://issues.apache.org/jira/browse/HDFS-3275) | Format command overwrites contents of non-empty shared edits dir if name dirs are empty without any prompting | Major | ha, namenode | Vinithra Varadharajan | amith |
+| [MAPREDUCE-4211](https://issues.apache.org/jira/browse/MAPREDUCE-4211) | Error conditions (missing appid, appid not found) are masked in the RM app page | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
| [HADOOP-8317](https://issues.apache.org/jira/browse/HADOOP-8317) | Update maven-assembly-plugin to 2.3 - fix build on FreeBSD | Major | build | Radim Kolar | |
+| [HADOOP-8172](https://issues.apache.org/jira/browse/HADOOP-8172) | Configuration no longer sets all keys in a deprecated key list. | Critical | conf | Robert Joseph Evans | Anupam Seth |
+| [HADOOP-8342](https://issues.apache.org/jira/browse/HADOOP-8342) | HDFS command fails with exception following merge of HADOOP-8325 | Major | fs | Randy Clayton | Alejandro Abdelnur |
+| [HDFS-3359](https://issues.apache.org/jira/browse/HDFS-3359) | DFSClient.close should close cached sockets | Critical | hdfs-client | Todd Lipcon | Todd Lipcon |
+| [MAPREDUCE-4048](https://issues.apache.org/jira/browse/MAPREDUCE-4048) | NullPointerException exception while accessing the Application Master UI | Major | mrv2 | Devaraj K | Devaraj K |
+| [HADOOP-8327](https://issues.apache.org/jira/browse/HADOOP-8327) | distcpv2 and distcpv1 jars should not coexist | Major | . | Dave Thompson | Dave Thompson |
+| [HADOOP-8328](https://issues.apache.org/jira/browse/HADOOP-8328) | Duplicate FileSystem Statistics object for 'file' scheme | Major | fs | Tom White | Tom White |
+| [MAPREDUCE-4220](https://issues.apache.org/jira/browse/MAPREDUCE-4220) | RM apps page starttime/endtime sorts are incorrect | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-4226](https://issues.apache.org/jira/browse/MAPREDUCE-4226) | ConcurrentModificationException in FileSystemCounterGroup | Major | mrv2 | Tom White | Tom White |
+| [HADOOP-8341](https://issues.apache.org/jira/browse/HADOOP-8341) | Fix or filter findbugs issues in hadoop-tools | Major | . | Robert Joseph Evans | Robert Joseph Evans |
+| [MAPREDUCE-4215](https://issues.apache.org/jira/browse/MAPREDUCE-4215) | RM app page shows 500 error on appid parse error | Major | mrv2 | Jonathan Eagles | Jonathan Eagles |
+| [MAPREDUCE-4237](https://issues.apache.org/jira/browse/MAPREDUCE-4237) | TestNodeStatusUpdater can fail if localhost has a domain associated with it | Major | . | Robert Joseph Evans
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[31/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.0/CHANGES.0.22.0.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.0/CHANGES.0.22.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.0/CHANGES.0.22.0.md
index 40de51c..aa5e8cf 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.0/CHANGES.0.22.0.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.22.0/CHANGES.0.22.0.md
@@ -24,745 +24,739 @@
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7229](https://issues.apache.org/jira/browse/HADOOP-7229) | Absolute path to kinit in auto-renewal thread | Major | security | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-7137](https://issues.apache.org/jira/browse/HADOOP-7137) | Remove hod contrib | Major | . | Nigel Daley | Nigel Daley |
-| [HADOOP-7013](https://issues.apache.org/jira/browse/HADOOP-7013) | Add boolean field isCorrupt to BlockLocation | Major | . | Patrick Kling | Patrick Kling |
-| [HADOOP-6949](https://issues.apache.org/jira/browse/HADOOP-6949) | Reduces RPC packet size for primitive arrays, especially long[], which is used at block reporting | Major | io | Navis | Matt Foley |
-| [HADOOP-6905](https://issues.apache.org/jira/browse/HADOOP-6905) | Better logging messages when a delegation token is invalid | Major | security | Kan Zhang | Kan Zhang |
-| [HADOOP-6835](https://issues.apache.org/jira/browse/HADOOP-6835) | Support concatenated gzip files | Major | io | Tom White | Greg Roelofs |
-| [HADOOP-6787](https://issues.apache.org/jira/browse/HADOOP-6787) | Factor out glob pattern code from FileContext and Filesystem | Major | fs | Luke Lu | Luke Lu |
| [HADOOP-6730](https://issues.apache.org/jira/browse/HADOOP-6730) | Bug in FileContext#copy and provide base class for FileContext tests | Major | fs, test | Eli Collins | Ravi Phulari |
-| [HDFS-1825](https://issues.apache.org/jira/browse/HDFS-1825) | Remove thriftfs contrib | Major | . | Nigel Daley | Nigel Daley |
-| [HDFS-1560](https://issues.apache.org/jira/browse/HDFS-1560) | dfs.data.dir permissions should default to 700 | Minor | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-1435](https://issues.apache.org/jira/browse/HDFS-1435) | Provide an option to store fsimage compressed | Major | namenode | Hairong Kuang | Hairong Kuang |
-| [HDFS-1315](https://issues.apache.org/jira/browse/HDFS-1315) | Add fsck event to audit log and remove other audit log events corresponding to FSCK listStatus and open calls | Major | namenode, tools | Suresh Srinivas | Suresh Srinivas |
| [HDFS-1109](https://issues.apache.org/jira/browse/HDFS-1109) | HFTP and URL Encoding | Major | contrib/hdfsproxy, datanode | Dmytro Molkov | Dmytro Molkov |
-| [HDFS-1080](https://issues.apache.org/jira/browse/HDFS-1080) | SecondaryNameNode image transfer should use the defined http address rather than local ip address | Major | namenode | Jakob Homan | Jakob Homan |
| [HDFS-1061](https://issues.apache.org/jira/browse/HDFS-1061) | Memory footprint optimization for INodeFile object. | Minor | namenode | Bharath Mundlapudi | Bharath Mundlapudi |
-| [HDFS-903](https://issues.apache.org/jira/browse/HDFS-903) | NN should verify images and edit logs on startup | Critical | namenode | Eli Collins | Hairong Kuang |
+| [MAPREDUCE-1683](https://issues.apache.org/jira/browse/MAPREDUCE-1683) | Remove JNI calls from ClusterStatus cstr | Major | jobtracker | Chris Douglas | Luke Lu |
+| [HADOOP-6787](https://issues.apache.org/jira/browse/HADOOP-6787) | Factor out glob pattern code from FileContext and Filesystem | Major | fs | Luke Lu | Luke Lu |
+| [HDFS-1080](https://issues.apache.org/jira/browse/HDFS-1080) | SecondaryNameNode image transfer should use the defined http address rather than local ip address | Major | namenode | Jakob Homan | Jakob Homan |
+| [HADOOP-6835](https://issues.apache.org/jira/browse/HADOOP-6835) | Support concatenated gzip files | Major | io | Tom White | Greg Roelofs |
+| [MAPREDUCE-1733](https://issues.apache.org/jira/browse/MAPREDUCE-1733) | Authentication between pipes processes and java counterparts. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HDFS-1315](https://issues.apache.org/jira/browse/HDFS-1315) | Add fsck event to audit log and remove other audit log events corresponding to FSCK listStatus and open calls | Major | namenode, tools | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-1866](https://issues.apache.org/jira/browse/MAPREDUCE-1866) | Remove deprecated class org.apache.hadoop.streaming.UTF8ByteArrayUtils | Minor | contrib/streaming | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
| [HDFS-330](https://issues.apache.org/jira/browse/HDFS-330) | Datanode Web UIs should provide robots.txt | Trivial | datanode | Allen Wittenauer | Allen Wittenauer |
| [HDFS-202](https://issues.apache.org/jira/browse/HDFS-202) | Add a bulk FIleSystem.getFileBlockLocations | Major | hdfs-client, namenode | Arun C Murthy | Hairong Kuang |
-| [MAPREDUCE-1905](https://issues.apache.org/jira/browse/MAPREDUCE-1905) | Context.setStatus() and progress() api are ignored | Blocker | task | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [MAPREDUCE-1866](https://issues.apache.org/jira/browse/MAPREDUCE-1866) | Remove deprecated class org.apache.hadoop.streaming.UTF8ByteArrayUtils | Minor | contrib/streaming | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [MAPREDUCE-1733](https://issues.apache.org/jira/browse/MAPREDUCE-1733) | Authentication between pipes processes and java counterparts. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [MAPREDUCE-1683](https://issues.apache.org/jira/browse/MAPREDUCE-1683) | Remove JNI calls from ClusterStatus cstr | Major | jobtracker | Chris Douglas | Luke Lu |
+| [HADOOP-6905](https://issues.apache.org/jira/browse/HADOOP-6905) | Better logging messages when a delegation token is invalid | Major | security | Kan Zhang | Kan Zhang |
| [MAPREDUCE-1664](https://issues.apache.org/jira/browse/MAPREDUCE-1664) | Job Acls affect Queue Acls | Major | security | Ravi Gummadi | Ravi Gummadi |
-
-
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-1435](https://issues.apache.org/jira/browse/HDFS-1435) | Provide an option to store fsimage compressed | Major | namenode | Hairong Kuang | Hairong Kuang |
+| [HDFS-903](https://issues.apache.org/jira/browse/HDFS-903) | NN should verify images and edit logs on startup | Critical | namenode | Eli Collins | Hairong Kuang |
+| [MAPREDUCE-1905](https://issues.apache.org/jira/browse/MAPREDUCE-1905) | Context.setStatus() and progress() api are ignored | Blocker | task | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-7013](https://issues.apache.org/jira/browse/HADOOP-7013) | Add boolean field isCorrupt to BlockLocation | Major | . | Patrick Kling | Patrick Kling |
+| [HDFS-1560](https://issues.apache.org/jira/browse/HDFS-1560) | dfs.data.dir permissions should default to 700 | Minor | datanode | Todd Lipcon | Todd Lipcon |
+| [HADOOP-6949](https://issues.apache.org/jira/browse/HADOOP-6949) | Reduces RPC packet size for primitive arrays, especially long[], which is used at block reporting | Major | io | Navis | Matt Foley |
+| [HADOOP-7229](https://issues.apache.org/jira/browse/HADOOP-7229) | Absolute path to kinit in auto-renewal thread | Major | security | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-1825](https://issues.apache.org/jira/browse/HDFS-1825) | Remove thriftfs contrib | Major | . | Nigel Daley | Nigel Daley |
+| [HADOOP-7137](https://issues.apache.org/jira/browse/HADOOP-7137) | Remove hod contrib | Major | . | Nigel Daley | Nigel Daley |
### NEW FEATURES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-6996](https://issues.apache.org/jira/browse/HADOOP-6996) | Allow CodecFactory to return a codec object given a codec' class name | Major | io | Hairong Kuang | Hairong Kuang |
-| [HADOOP-6978](https://issues.apache.org/jira/browse/HADOOP-6978) | Add JNI support for secure IO operations | Blocker | io, native, security | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6892](https://issues.apache.org/jira/browse/HADOOP-6892) | Common component of HDFS-1150 (Verify datanodes' identities to clients in secure clusters) | Major | security | Jakob Homan | Jakob Homan |
-| [HADOOP-6889](https://issues.apache.org/jira/browse/HADOOP-6889) | Make RPC to have an option to timeout | Major | ipc | Hairong Kuang | John George |
-| [HADOOP-6870](https://issues.apache.org/jira/browse/HADOOP-6870) | Add FileSystem#listLocatedStatus to list a directory's content together with each file's block locations | Major | fs | Hairong Kuang | Hairong Kuang |
-| [HADOOP-6832](https://issues.apache.org/jira/browse/HADOOP-6832) | Provide a web server plugin that uses a static user for the web UI | Major | security | Owen O'Malley | Owen O'Malley |
+| [MAPREDUCE-1680](https://issues.apache.org/jira/browse/MAPREDUCE-1680) | Add a metrics to track the number of heartbeats processed | Major | jobtracker | Hong Tang | Dick King |
+| [HDFS-1003](https://issues.apache.org/jira/browse/HDFS-1003) | authorization checks for inter-server protocol (based on HADOOP-6600) | Major | . | Boris Shkolnik | Boris Shkolnik |
| [HADOOP-6600](https://issues.apache.org/jira/browse/HADOOP-6600) | mechanism for authorization check for inter-server protocols | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [HADOOP-6586](https://issues.apache.org/jira/browse/HADOOP-6586) | Log authentication and authorization failures and successes | Major | security | Boris Shkolnik | Boris Shkolnik |
-| [HADOOP-6472](https://issues.apache.org/jira/browse/HADOOP-6472) | add tokenCache option to GenericOptionsParser for passing file with secret keys to a map reduce job | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [HADOOP-4487](https://issues.apache.org/jira/browse/HADOOP-4487) | Security features for Hadoop | Major | security | Kan Zhang | Kan Zhang |
-| [HDFS-1330](https://issues.apache.org/jira/browse/HDFS-1330) | Make RPCs to DataNodes timeout | Major | datanode | Hairong Kuang | John George |
-| [HDFS-1318](https://issues.apache.org/jira/browse/HDFS-1318) | HDFS Namenode and Datanode WebUI information needs to be accessible programmatically for scripts | Major | . | Suresh Srinivas | Tanping Wang |
-| [HDFS-1150](https://issues.apache.org/jira/browse/HDFS-1150) | Verify datanodes' identities to clients in secure clusters | Major | datanode | Jakob Homan | Jakob Homan |
-| [HDFS-1111](https://issues.apache.org/jira/browse/HDFS-1111) | getCorruptFiles() should give some hint that the list is not complete | Major | . | Rodrigo Schmidt | Sriram Rao |
-| [HDFS-1096](https://issues.apache.org/jira/browse/HDFS-1096) | allow dfsadmin/mradmin refresh of superuser proxy group mappings | Major | security | Boris Shkolnik | Boris Shkolnik |
| [HDFS-1079](https://issues.apache.org/jira/browse/HDFS-1079) | HDFS implementation should throw exceptions defined in AbstractFileSystem | Major | namenode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-1005](https://issues.apache.org/jira/browse/HDFS-1005) | Fsck security | Major | . | Jitendra Nath Pandey | Boris Shkolnik |
-| [HDFS-1004](https://issues.apache.org/jira/browse/HDFS-1004) | Update NN to support Kerberized SSL from HADOOP-6584 | Major | namenode | Jakob Homan | Jakob Homan |
-| [HDFS-1003](https://issues.apache.org/jira/browse/HDFS-1003) | authorization checks for inter-server protocol (based on HADOOP-6600) | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [MAPREDUCE-1804](https://issues.apache.org/jira/browse/MAPREDUCE-1804) | Stress-test tool for HDFS introduced in HDFS-708 | Major | benchmarks, test | Konstantin Shvachko | Konstantin Shvachko |
+| [HDFS-708](https://issues.apache.org/jira/browse/HDFS-708) | A stress-test tool for HDFS. | Major | test, tools | Konstantin Shvachko | Joshua Harlow |
| [HDFS-992](https://issues.apache.org/jira/browse/HDFS-992) | Re-factor block access token implementation to conform to the generic Token interface in Common | Major | security | Kan Zhang | Kan Zhang |
-| [HDFS-811](https://issues.apache.org/jira/browse/HDFS-811) | Add metrics, failure reporting and additional tests for HDFS-457 | Minor | test | Ravi Phulari | Eli Collins |
+| [HDFS-1096](https://issues.apache.org/jira/browse/HDFS-1096) | allow dfsadmin/mradmin refresh of superuser proxy group mappings | Major | security | Boris Shkolnik | Boris Shkolnik |
+| [HADOOP-6586](https://issues.apache.org/jira/browse/HADOOP-6586) | Log authentication and authorization failures and successes | Major | security | Boris Shkolnik | Boris Shkolnik |
+| [MAPREDUCE-1516](https://issues.apache.org/jira/browse/MAPREDUCE-1516) | JobTracker should issue a delegation token only for kerberos authenticated client | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
| [HDFS-752](https://issues.apache.org/jira/browse/HDFS-752) | Add interface classification stable & scope to HDFS | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-708](https://issues.apache.org/jira/browse/HDFS-708) | A stress-test tool for HDFS. | Major | test, tools | Konstantin Shvachko | Joshua Harlow |
-| [HDFS-528](https://issues.apache.org/jira/browse/HDFS-528) | Add ability for safemode to wait for a minimum number of live datanodes | Major | scripts | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-1804](https://issues.apache.org/jira/browse/MAPREDUCE-1804) | Stress-test tool for HDFS introduced in HDFS-708 | Major | benchmarks, test | Konstantin Shvachko | Konstantin Shvachko |
-| [MAPREDUCE-1680](https://issues.apache.org/jira/browse/MAPREDUCE-1680) | Add a metrics to track the number of heartbeats processed | Major | jobtracker | Hong Tang | Dick King |
+| [HDFS-1004](https://issues.apache.org/jira/browse/HDFS-1004) | Update NN to support Kerberized SSL from HADOOP-6584 | Major | namenode | Jakob Homan | Jakob Homan |
+| [HDFS-1005](https://issues.apache.org/jira/browse/HDFS-1005) | Fsck security | Major | . | Jitendra Nath Pandey | Boris Shkolnik |
| [MAPREDUCE-1594](https://issues.apache.org/jira/browse/MAPREDUCE-1594) | Support for Sleep Jobs in gridmix | Major | contrib/gridmix | rahul k singh | rahul k singh |
-| [MAPREDUCE-1517](https://issues.apache.org/jira/browse/MAPREDUCE-1517) | streaming should support running on background | Major | contrib/streaming | Bochun Bai | Bochun Bai |
-| [MAPREDUCE-1516](https://issues.apache.org/jira/browse/MAPREDUCE-1516) | JobTracker should issue a delegation token only for kerberos authenticated client | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HADOOP-6870](https://issues.apache.org/jira/browse/HADOOP-6870) | Add FileSystem#listLocatedStatus to list a directory's content together with each file's block locations | Major | fs | Hairong Kuang | Hairong Kuang |
+| [HADOOP-6892](https://issues.apache.org/jira/browse/HADOOP-6892) | Common component of HDFS-1150 (Verify datanodes' identities to clients in secure clusters) | Major | security | Jakob Homan | Jakob Homan |
+| [HDFS-1150](https://issues.apache.org/jira/browse/HDFS-1150) | Verify datanodes' identities to clients in secure clusters | Major | datanode | Jakob Homan | Jakob Homan |
+| [HDFS-1318](https://issues.apache.org/jira/browse/HDFS-1318) | HDFS Namenode and Datanode WebUI information needs to be accessible programmatically for scripts | Major | . | Suresh Srinivas | Tanping Wang |
| [MAPREDUCE-220](https://issues.apache.org/jira/browse/MAPREDUCE-220) | Collecting cpu and memory usage for MapReduce tasks | Major | task, tasktracker | Hong Tang | Scott Chen |
+| [HDFS-1111](https://issues.apache.org/jira/browse/HDFS-1111) | getCorruptFiles() should give some hint that the list is not complete | Major | . | Rodrigo Schmidt | Sriram Rao |
+| [MAPREDUCE-1517](https://issues.apache.org/jira/browse/MAPREDUCE-1517) | streaming should support running on background | Major | contrib/streaming | Bochun Bai | Bochun Bai |
+| [HADOOP-6472](https://issues.apache.org/jira/browse/HADOOP-6472) | add tokenCache option to GenericOptionsParser for passing file with secret keys to a map reduce job | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [HADOOP-6996](https://issues.apache.org/jira/browse/HADOOP-6996) | Allow CodecFactory to return a codec object given a codec' class name | Major | io | Hairong Kuang | Hairong Kuang |
+| [HADOOP-4487](https://issues.apache.org/jira/browse/HADOOP-4487) | Security features for Hadoop | Major | security | Kan Zhang | Kan Zhang |
+| [HDFS-811](https://issues.apache.org/jira/browse/HDFS-811) | Add metrics, failure reporting and additional tests for HDFS-457 | Minor | test | Ravi Phulari | Eli Collins |
+| [HDFS-528](https://issues.apache.org/jira/browse/HDFS-528) | Add ability for safemode to wait for a minimum number of live datanodes | Major | scripts | Todd Lipcon | Todd Lipcon |
+| [HADOOP-6978](https://issues.apache.org/jira/browse/HADOOP-6978) | Add JNI support for secure IO operations | Blocker | io, native, security | Todd Lipcon | Todd Lipcon |
+| [HADOOP-6832](https://issues.apache.org/jira/browse/HADOOP-6832) | Provide a web server plugin that uses a static user for the web UI | Major | security | Owen O'Malley | Owen O'Malley |
+| [HDFS-1330](https://issues.apache.org/jira/browse/HDFS-1330) | Make RPCs to DataNodes timeout | Major | datanode | Hairong Kuang | John George |
+| [HADOOP-6889](https://issues.apache.org/jira/browse/HADOOP-6889) | Make RPC to have an option to timeout | Major | ipc | Hairong Kuang | John George |
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7861](https://issues.apache.org/jira/browse/HADOOP-7861) | changes2html.pl should generate links to HADOOP, HDFS, and MAPREDUCE jiras | Major | documentation | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-7786](https://issues.apache.org/jira/browse/HADOOP-7786) | Remove HDFS-specific configuration keys defined in FsConfig | Major | . | Eli Collins | Eli Collins |
-| [HADOOP-7457](https://issues.apache.org/jira/browse/HADOOP-7457) | Remove out-of-date Chinese language documentation | Blocker | documentation | Jakob Homan | Jakob Homan |
-| [HADOOP-7358](https://issues.apache.org/jira/browse/HADOOP-7358) | Improve log levels when exceptions caught in RPC handler | Minor | ipc | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7355](https://issues.apache.org/jira/browse/HADOOP-7355) | Add audience and stability annotations to HttpServer class | Major | . | stack | stack |
-| [HADOOP-7346](https://issues.apache.org/jira/browse/HADOOP-7346) | Send back nicer error to clients using outdated IPC version | Major | ipc | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7335](https://issues.apache.org/jira/browse/HADOOP-7335) | Force entropy to come from non-true random for tests | Minor | build, test | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7325](https://issues.apache.org/jira/browse/HADOOP-7325) | hadoop command - do not accept class names starting with a hyphen | Minor | scripts | Brock Noland | Brock Noland |
-| [HADOOP-7244](https://issues.apache.org/jira/browse/HADOOP-7244) | Documentation change for updated configuration keys | Blocker | documentation | Tom White | Tom White |
-| [HADOOP-7241](https://issues.apache.org/jira/browse/HADOOP-7241) | fix typo of command 'hadoop fs -help tail' | Minor | fs, test | Wei Yongjun | Wei Yongjun |
-| [HADOOP-7193](https://issues.apache.org/jira/browse/HADOOP-7193) | Help message is wrong for touchz command. | Minor | fs | Uma Maheswara Rao G | Uma Maheswara Rao G |
-| [HADOOP-7192](https://issues.apache.org/jira/browse/HADOOP-7192) | fs -stat docs aren't updated to reflect the format features | Trivial | documentation | Harsh J | Harsh J |
-| [HADOOP-7189](https://issues.apache.org/jira/browse/HADOOP-7189) | Add ability to enable 'debug' property in JAAS configuration | Minor | security | Todd Lipcon | Ted Yu |
-| [HADOOP-7177](https://issues.apache.org/jira/browse/HADOOP-7177) | CodecPool should report which compressor it is using | Trivial | native | Allen Wittenauer | Allen Wittenauer |
-| [HADOOP-7154](https://issues.apache.org/jira/browse/HADOOP-7154) | Should set MALLOC\_ARENA\_MAX in hadoop-config.sh | Minor | scripts | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7134](https://issues.apache.org/jira/browse/HADOOP-7134) | configure files that are generated as part of the released tarball need to have executable bit set | Major | build | Roman Shaposhnik | Roman Shaposhnik |
-| [HADOOP-7117](https://issues.apache.org/jira/browse/HADOOP-7117) | Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml | Major | conf | Patrick Angeles | Harsh J |
-| [HADOOP-7110](https://issues.apache.org/jira/browse/HADOOP-7110) | Implement chmod with JNI | Major | io, native | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7106](https://issues.apache.org/jira/browse/HADOOP-7106) | Re-organize hadoop subversion layout | Blocker | build | Nigel Daley | Todd Lipcon |
-| [HADOOP-7054](https://issues.apache.org/jira/browse/HADOOP-7054) | Change NN LoadGenerator to use the new FileContext api | Major | . | Sanjay Radia | Sanjay Radia |
-| [HADOOP-7032](https://issues.apache.org/jira/browse/HADOOP-7032) | Assert type constraints in the FileStatus constructor | Major | fs | Eli Collins | Eli Collins |
-| [HADOOP-7010](https://issues.apache.org/jira/browse/HADOOP-7010) | Typo in FileSystem.java | Minor | fs | Jingguo Yao | Jingguo Yao |
-| [HADOOP-7009](https://issues.apache.org/jira/browse/HADOOP-7009) | MD5Hash provides a public factory method that creates an instance of MessageDigest | Major | io | Hairong Kuang | Hairong Kuang |
-| [HADOOP-7008](https://issues.apache.org/jira/browse/HADOOP-7008) | Enable test-patch.sh to have a configured number of acceptable findbugs and javadoc warnings | Major | test | Nigel Daley | Giridharan Kesavan |
-| [HADOOP-7007](https://issues.apache.org/jira/browse/HADOOP-7007) | update the hudson-test-patch target to work with the latest test-patch script. | Major | build | Giridharan Kesavan | Giridharan Kesavan |
-| [HADOOP-7005](https://issues.apache.org/jira/browse/HADOOP-7005) | Update test-patch.sh to remove callback to Hudson master | Major | test | Nigel Daley | Nigel Daley |
-| [HADOOP-6987](https://issues.apache.org/jira/browse/HADOOP-6987) | Use JUnit Rule to optionally fail test cases that run more than 10 seconds | Major | test | Jakob Homan | Jakob Homan |
-| [HADOOP-6985](https://issues.apache.org/jira/browse/HADOOP-6985) | Suggest that HADOOP\_OPTS be preserved in hadoop-env.sh.template | Minor | . | Ramkumar Vadali | Ramkumar Vadali |
-| [HADOOP-6977](https://issues.apache.org/jira/browse/HADOOP-6977) | Herriot daemon clients should vend statistics | Major | test | Konstantin Boudnik | Konstantin Boudnik |
-| [HADOOP-6950](https://issues.apache.org/jira/browse/HADOOP-6950) | Suggest that HADOOP\_CLASSPATH should be preserved in hadoop-env.sh.template | Trivial | scripts | Philip Zeyliger | Philip Zeyliger |
-| [HADOOP-6943](https://issues.apache.org/jira/browse/HADOOP-6943) | The GroupMappingServiceProvider interface should be public | Major | security | Aaron T. Myers | Aaron T. Myers |
-| [HADOOP-6911](https://issues.apache.org/jira/browse/HADOOP-6911) | doc update for DelegationTokenFetcher (part of HDFS-1036) | Minor | . | Boris Shkolnik | |
-| [HADOOP-6903](https://issues.apache.org/jira/browse/HADOOP-6903) | Make AbstractFileSystem's methods public to allow filter-Fs like implementions in a differnt package than fs | Major | . | Sanjay Radia | Sanjay Radia |
-| [HADOOP-6890](https://issues.apache.org/jira/browse/HADOOP-6890) | Improve listFiles API introduced by HADOOP-6870 | Major | fs | Hairong Kuang | Hairong Kuang |
-| [HADOOP-6884](https://issues.apache.org/jira/browse/HADOOP-6884) | Add LOG.isDebugEnabled() guard for each LOG.debug("...") | Major | . | Erik Steffl | Erik Steffl |
-| [HADOOP-6879](https://issues.apache.org/jira/browse/HADOOP-6879) | Provide SSH based (Jsch) remote execution API for system tests | Major | build, test | Iyappan Srinivasan | Konstantin Boudnik |
-| [HADOOP-6877](https://issues.apache.org/jira/browse/HADOOP-6877) | Common part of HDFS-1178 | Major | ipc | Kan Zhang | Kan Zhang |
-| [HADOOP-6862](https://issues.apache.org/jira/browse/HADOOP-6862) | Add api to add user/group to AccessControlList | Major | security | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [HADOOP-6861](https://issues.apache.org/jira/browse/HADOOP-6861) | Method in Credentials to read and write a token storage file. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-6859](https://issues.apache.org/jira/browse/HADOOP-6859) | Introduce additional statistics to FileSystem | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HADOOP-6856](https://issues.apache.org/jira/browse/HADOOP-6856) | SequenceFile and MapFile need cleanup to remove redundant constructors | Major | io | Owen O'Malley | Owen O'Malley |
-| [HADOOP-6845](https://issues.apache.org/jira/browse/HADOOP-6845) | TokenStorage renamed to Credentials. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-6825](https://issues.apache.org/jira/browse/HADOOP-6825) | FileStatus needs unit tests | Major | . | Rodrigo Schmidt | Rodrigo Schmidt |
-| [HADOOP-6818](https://issues.apache.org/jira/browse/HADOOP-6818) | Provide a JNI-based implementation of GroupMappingServiceProvider | Major | security | Devaraj Das | Devaraj Das |
-| [HADOOP-6814](https://issues.apache.org/jira/browse/HADOOP-6814) | Method in UGI to get the authentication method of the real user. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-6811](https://issues.apache.org/jira/browse/HADOOP-6811) | Remove EC2 bash scripts | Blocker | . | Tom White | Tom White |
-| [HADOOP-6805](https://issues.apache.org/jira/browse/HADOOP-6805) | add buildDTServiceName method to SecurityUtil (as part of MAPREDUCE-1718) | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [HADOOP-6791](https://issues.apache.org/jira/browse/HADOOP-6791) | Refresh for proxy superuser config (common part for HDFS-1096) | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [MAPREDUCE-478](https://issues.apache.org/jira/browse/MAPREDUCE-478) | separate jvm param for mapper and reducer | Minor | . | Koji Noguchi | Arun C Murthy |
+| [HADOOP-6599](https://issues.apache.org/jira/browse/HADOOP-6599) | Split RPC metrics into summary and detailed metrics | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-1546](https://issues.apache.org/jira/browse/MAPREDUCE-1546) | Jobtracker JSP pages should automatically redirect to the corresponding history page if not in memory | Minor | . | Scott Chen | Scott Chen |
+| [HADOOP-6623](https://issues.apache.org/jira/browse/HADOOP-6623) | Add StringUtils.split for non-escaped single-character separator | Minor | util | Todd Lipcon | Todd Lipcon |
+| [HDFS-1028](https://issues.apache.org/jira/browse/HDFS-1028) | INode.getPathNames could split more efficiently | Minor | namenode | Todd Lipcon | Dmytro Molkov |
+| [HDFS-853](https://issues.apache.org/jira/browse/HDFS-853) | The HDFS webUI should show a metric that summarizes whether the cluster is balanced regarding disk space usage | Major | namenode | dhruba borthakur | Dmytro Molkov |
+| [MAPREDUCE-1761](https://issues.apache.org/jira/browse/MAPREDUCE-1761) | FairScheduler should allow separate configuration of node and rack locality wait time | Major | . | Scott Chen | Scott Chen |
| [HADOOP-6761](https://issues.apache.org/jira/browse/HADOOP-6761) | Improve Trash Emptier | Major | . | Dmytro Molkov | Dmytro Molkov |
-| [HADOOP-6745](https://issues.apache.org/jira/browse/HADOOP-6745) | adding some java doc to Server.RpcMetrics, UGI | Minor | ipc | Boris Shkolnik | Boris Shkolnik |
| [HADOOP-6714](https://issues.apache.org/jira/browse/HADOOP-6714) | FsShell 'hadoop fs -text' does not support compression codecs | Major | . | Patrick Angeles | Patrick Angeles |
-| [HADOOP-6693](https://issues.apache.org/jira/browse/HADOOP-6693) | Add metrics to track kerberos login activity | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-1798](https://issues.apache.org/jira/browse/MAPREDUCE-1798) | normalize property names for JT kerberos principal names in configuration (from HADOOP 6633) | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [MAPREDUCE-1354](https://issues.apache.org/jira/browse/MAPREDUCE-1354) | Incremental enhancements to the JobTracker for better scalability | Critical | jobtracker | Devaraj Das | Dick King |
+| [MAPREDUCE-1785](https://issues.apache.org/jira/browse/MAPREDUCE-1785) | Add streaming config option for not emitting the key | Minor | contrib/streaming | Eli Collins | Eli Collins |
+| [HADOOP-6791](https://issues.apache.org/jira/browse/HADOOP-6791) | Refresh for proxy superuser config (common part for HDFS-1096) | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [HDFS-1184](https://issues.apache.org/jira/browse/HDFS-1184) | Replace tabs in code with spaces | Minor | . | Jeff Ames | Jeff Ames |
+| [MAPREDUCE-1832](https://issues.apache.org/jira/browse/MAPREDUCE-1832) | Support for file sizes less than 1MB in DFSIO benchmark. | Major | benchmarks | Konstantin Shvachko | Konstantin Shvachko |
+| [HDFS-1185](https://issues.apache.org/jira/browse/HDFS-1185) | Remove duplicate now() functions in DataNode, FSNamesystem | Minor | datanode, namenode | Jeff Ames | Jeff Ames |
+| [HDFS-1183](https://issues.apache.org/jira/browse/HDFS-1183) | Remove some duplicate code in NamenodeJspHelper.java | Minor | namenode | Jeff Ames | Jeff Ames |
| [HADOOP-6674](https://issues.apache.org/jira/browse/HADOOP-6674) | Performance Improvement in Secure RPC | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HADOOP-6632](https://issues.apache.org/jira/browse/HADOOP-6632) | Support for using different Kerberos keys for different instances of Hadoop services | Major | . | Kan Zhang | Kan Zhang |
-| [HADOOP-6623](https://issues.apache.org/jira/browse/HADOOP-6623) | Add StringUtils.split for non-escaped single-character separator | Minor | util | Todd Lipcon | Todd Lipcon |
-| [HADOOP-6605](https://issues.apache.org/jira/browse/HADOOP-6605) | Add JAVA\_HOME detection to hadoop-config | Minor | . | Chad Metcalf | Eli Collins |
-| [HADOOP-6599](https://issues.apache.org/jira/browse/HADOOP-6599) | Split RPC metrics into summary and detailed metrics | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-1545](https://issues.apache.org/jira/browse/MAPREDUCE-1545) | Add 'first-task-launched' to job-summary | Major | jobtracker | Arun C Murthy | Luke Lu |
+| [MAPREDUCE-1762](https://issues.apache.org/jira/browse/MAPREDUCE-1762) | Add a setValue() method in Counter | Major | . | Scott Chen | Scott Chen |
+| [HDFS-1190](https://issues.apache.org/jira/browse/HDFS-1190) | Remove unused getNamenode() method from DataNode. | Minor | datanode | Jeff Ames | Jeff Ames |
+| [HDFS-1110](https://issues.apache.org/jira/browse/HDFS-1110) | Namenode heap optimization - reuse objects for commonly used file names | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-6814](https://issues.apache.org/jira/browse/HADOOP-6814) | Method in UGI to get the authentication method of the real user. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [MAPREDUCE-1829](https://issues.apache.org/jira/browse/MAPREDUCE-1829) | JobInProgress.findSpeculativeTask should use min() to find the candidate instead of sort() | Major | jobtracker | Scott Chen | Scott Chen |
+| [HDFS-1114](https://issues.apache.org/jira/browse/HDFS-1114) | Reducing NameNode memory usage by an alternate hash table | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-599](https://issues.apache.org/jira/browse/HDFS-599) | Improve Namenode robustness by prioritizing datanode heartbeats over client requests | Major | namenode | dhruba borthakur | Dmytro Molkov |
+| [HDFS-947](https://issues.apache.org/jira/browse/HDFS-947) | The namenode should redirect a hftp request to read a file to the datanode that has the maximum number of local replicas | Major | . | dhruba borthakur | Dmytro Molkov |
+| [MAPREDUCE-1492](https://issues.apache.org/jira/browse/MAPREDUCE-1492) | Delete or recreate obsolete har files used on hdfs raid | Major | contrib/raid | Rodrigo Schmidt | Rodrigo Schmidt |
+| [MAPREDUCE-1851](https://issues.apache.org/jira/browse/MAPREDUCE-1851) | Document configuration parameters in streaming | Major | contrib/streaming, documentation | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [MAPREDUCE-1868](https://issues.apache.org/jira/browse/MAPREDUCE-1868) | Add read timeout on userlog pull | Major | client | Krishna Ramachandran | Krishna Ramachandran |
+| [MAPREDUCE-1778](https://issues.apache.org/jira/browse/MAPREDUCE-1778) | CompletedJobStatusStore initialization should fail if {mapred.job.tracker.persist.jobstatus.dir} is unwritable | Major | jobtracker | Amar Kamat | Krishna Ramachandran |
+| [MAPREDUCE-1850](https://issues.apache.org/jira/browse/MAPREDUCE-1850) | Include job submit host information (name and ip) in jobconf and jobdetails display | Major | . | Krishna Ramachandran | Krishna Ramachandran |
+| [MAPREDUCE-1893](https://issues.apache.org/jira/browse/MAPREDUCE-1893) | Multiple reducers for Slive | Major | benchmarks, test | Konstantin Shvachko | Konstantin Shvachko |
| [HADOOP-6584](https://issues.apache.org/jira/browse/HADOOP-6584) | Provide Kerberized SSL encryption for webservices | Major | . | Jakob Homan | Jakob Homan |
-| [HADOOP-6578](https://issues.apache.org/jira/browse/HADOOP-6578) | Configuration should trim whitespace around a lot of value types | Minor | conf | Todd Lipcon | Michele Catasta |
-| [HADOOP-6562](https://issues.apache.org/jira/browse/HADOOP-6562) | FileContextSymlinkBaseTest should use FileContextTestHelper | Minor | test | Eli Collins | Eli Collins |
-| [HADOOP-6436](https://issues.apache.org/jira/browse/HADOOP-6436) | Remove auto-generated native build files | Major | . | Eli Collins | Roman Shaposhnik |
-| [HADOOP-6298](https://issues.apache.org/jira/browse/HADOOP-6298) | BytesWritable#getBytes is a bad name that leads to programming mistakes | Major | . | Nathan Marz | Owen O'Malley |
-| [HADOOP-6056](https://issues.apache.org/jira/browse/HADOOP-6056) | Use java.net.preferIPv4Stack to force IPv4 | Major | scripts | Steve Loughran | Michele Catasta |
-| [HADOOP-4675](https://issues.apache.org/jira/browse/HADOOP-4675) | Current Ganglia metrics implementation is incompatible with Ganglia 3.1 | Major | metrics | Brian Bockelman | Brian Bockelman |
-| [HDFS-2286](https://issues.apache.org/jira/browse/HDFS-2286) | DataXceiverServer logs AsynchronousCloseException at shutdown | Trivial | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-2054](https://issues.apache.org/jira/browse/HDFS-2054) | BlockSender.sendChunk() prints ERROR for connection closures encountered during transferToFully() | Minor | datanode | Kihwal Lee | Kihwal Lee |
-| [HDFS-2039](https://issues.apache.org/jira/browse/HDFS-2039) | TestNameNodeMetrics uses a bad test root path | Major | . | Todd Lipcon | Todd Lipcon |
-| [HDFS-1980](https://issues.apache.org/jira/browse/HDFS-1980) | Move build/webapps deeper in directory heirarchy to aid eclipse users | Major | build | Todd Lipcon | Todd Lipcon |
-| [HDFS-1957](https://issues.apache.org/jira/browse/HDFS-1957) | Documentation for HFTP | Minor | documentation | Ari Rabkin | Ari Rabkin |
-| [HDFS-1954](https://issues.apache.org/jira/browse/HDFS-1954) | Improve corrupt files warning message on NameNode web UI | Major | namenode | philo vivero | Patrick Hunt |
-| [HDFS-1947](https://issues.apache.org/jira/browse/HDFS-1947) | DFSClient should use mapreduce.task.attempt.id | Trivial | hdfs-client | Eli Collins | Eli Collins |
-| [HDFS-1935](https://issues.apache.org/jira/browse/HDFS-1935) | Build should not redownload ivy on every invocation | Minor | build | Todd Lipcon | Joep Rottinghuis |
-| [HDFS-1866](https://issues.apache.org/jira/browse/HDFS-1866) | Document dfs.datanode.max.transfer.threads in hdfs-default.xml | Minor | datanode, documentation | Eli Collins | Harsh J |
-| [HDFS-1861](https://issues.apache.org/jira/browse/HDFS-1861) | Rename dfs.datanode.max.xcievers and bump its default value | Major | datanode | Eli Collins | Eli Collins |
-| [HDFS-1736](https://issues.apache.org/jira/browse/HDFS-1736) | Break dependency between DatanodeJspHelper and FsShell | Minor | datanode | Daryn Sharp | Daryn Sharp |
-| [HDFS-1619](https://issues.apache.org/jira/browse/HDFS-1619) | Remove AC\_TYPE\* from the libhdfs | Major | libhdfs | Roman Shaposhnik | Roman Shaposhnik |
-| [HDFS-1618](https://issues.apache.org/jira/browse/HDFS-1618) | configure files that are generated as part of the released tarball need to have executable bit set | Major | build | Roman Shaposhnik | Roman Shaposhnik |
-| [HDFS-1596](https://issues.apache.org/jira/browse/HDFS-1596) | Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml | Major | documentation, namenode | Patrick Angeles | Harsh J |
-| [HDFS-1582](https://issues.apache.org/jira/browse/HDFS-1582) | Remove auto-generated native build files | Major | libhdfs | Roman Shaposhnik | Roman Shaposhnik |
-| [HDFS-1513](https://issues.apache.org/jira/browse/HDFS-1513) | Fix a number of warnings | Minor | . | Eli Collins | Eli Collins |
-| [HDFS-1491](https://issues.apache.org/jira/browse/HDFS-1491) | Update Hdfs to match the change of methods from protected to public in AbstractFileSystem (Hadoop-6903) | Major | . | Sanjay Radia | Sanjay Radia |
-| [HDFS-1485](https://issues.apache.org/jira/browse/HDFS-1485) | Typo in BlockPlacementPolicy.java | Minor | . | Jingguo Yao | Jingguo Yao |
-| [HDFS-1472](https://issues.apache.org/jira/browse/HDFS-1472) | Refactor DFSck to allow programmatic access to output | Major | tools | Ramkumar Vadali | Ramkumar Vadali |
-| [HDFS-1457](https://issues.apache.org/jira/browse/HDFS-1457) | Limit transmission rate when transfering image between primary and secondary NNs | Major | namenode | Hairong Kuang | Hairong Kuang |
-| [HDFS-1456](https://issues.apache.org/jira/browse/HDFS-1456) | Provide builder for constructing instances of MiniDFSCluster | Major | test | Jakob Homan | Jakob Homan |
-| [HDFS-1454](https://issues.apache.org/jira/browse/HDFS-1454) | Update the documentation to reflect true client caching strategy | Major | documentation, hdfs-client | Jeff Hammerbacher | Harsh J |
-| [HDFS-1434](https://issues.apache.org/jira/browse/HDFS-1434) | Refactor Datanode#startDataNode method | Major | datanode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-1426](https://issues.apache.org/jira/browse/HDFS-1426) | Remove unused method BlockInfo#listCount | Major | namenode | Hairong Kuang | Hairong Kuang |
-| [HDFS-1417](https://issues.apache.org/jira/browse/HDFS-1417) | Add @Override annotation to SimulatedFSDataset methods that implement FSDatasetInterface | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-1408](https://issues.apache.org/jira/browse/HDFS-1408) | Herriot NN and DN clients should vend statistics | Major | test | Al Thompson | Konstantin Boudnik |
-| [HDFS-1407](https://issues.apache.org/jira/browse/HDFS-1407) | Use Block in DataTransferProtocol | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-1395](https://issues.apache.org/jira/browse/HDFS-1395) | Add @Override annotation to FSDataset methods that implement FSDatasetInterface | Major | datanode | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-1387](https://issues.apache.org/jira/browse/HDFS-1387) | Update HDFS permissions guide for security | Major | documentation, security | Todd Lipcon | Todd Lipcon |
-| [HDFS-1383](https://issues.apache.org/jira/browse/HDFS-1383) | Better error messages on hftp | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1369](https://issues.apache.org/jira/browse/HDFS-1369) | Invalid javadoc reference in FSDatasetMBean.java | Trivial | datanode | Eli Collins | Eli Collins |
-| [HDFS-1368](https://issues.apache.org/jira/browse/HDFS-1368) | Add a block counter to DatanodeDescriptor | Major | namenode | Hairong Kuang | Hairong Kuang |
-| [HDFS-1356](https://issues.apache.org/jira/browse/HDFS-1356) | Provide information as to whether or not security is enabled on web interface for NameNode (part of HADOOP-6822) | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [HDFS-1353](https://issues.apache.org/jira/browse/HDFS-1353) | Remove most of getBlockLocation optimization | Major | namenode | Jakob Homan | Jakob Homan |
-| [HDFS-1320](https://issues.apache.org/jira/browse/HDFS-1320) | Add LOG.isDebugEnabled() guard for each LOG.debug("...") | Major | . | Erik Steffl | Erik Steffl |
+| [MAPREDUCE-1838](https://issues.apache.org/jira/browse/MAPREDUCE-1838) | DistRaid map tasks have large variance in running times | Minor | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
+| [HDFS-882](https://issues.apache.org/jira/browse/HDFS-882) | Datanode could log what hostname and ports its listening on on startup | Minor | datanode | Steve Loughran | Steve Loughran |
+| [MAPREDUCE-1248](https://issues.apache.org/jira/browse/MAPREDUCE-1248) | Redundant memory copying in StreamKeyValUtil | Minor | contrib/streaming | Ruibang He | Ruibang He |
+| [HDFS-1140](https://issues.apache.org/jira/browse/HDFS-1140) | Speedup INode.getPathComponents | Minor | namenode | Dmytro Molkov | Dmytro Molkov |
+| [HADOOP-6845](https://issues.apache.org/jira/browse/HADOOP-6845) | TokenStorage renamed to Credentials. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HDFS-1272](https://issues.apache.org/jira/browse/HDFS-1272) | HDFS changes corresponding to rename of TokenStorage to Credentials | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HDFS-1033](https://issues.apache.org/jira/browse/HDFS-1033) | In secure clusters, NN and SNN should verify that the remote principal during image and edits transfer | Major | namenode, security | Jakob Homan | Jakob Homan |
+| [HDFS-1023](https://issues.apache.org/jira/browse/HDFS-1023) | Allow http server to start as regular principal if https principal not defined. | Major | namenode | Jakob Homan | Jakob Homan |
+| [HADOOP-6825](https://issues.apache.org/jira/browse/HADOOP-6825) | FileStatus needs unit tests | Major | . | Rodrigo Schmidt | Rodrigo Schmidt |
+| [MAPREDUCE-1840](https://issues.apache.org/jira/browse/MAPREDUCE-1840) | [Gridmix] Exploit/Add security features in GridMix | Major | contrib/gridmix | Amar Kamat | Amar Kamat |
+| [MAPREDUCE-1376](https://issues.apache.org/jira/browse/MAPREDUCE-1376) | Support for varied user submission in Gridmix | Major | contrib/gridmix | Chris Douglas | Chris Douglas |
+| [MAPREDUCE-1711](https://issues.apache.org/jira/browse/MAPREDUCE-1711) | Gridmix should provide an option to submit jobs to the same queues as specified in the trace. | Major | contrib/gridmix | Hong Tang | rahul k singh |
+| [MAPREDUCE-1526](https://issues.apache.org/jira/browse/MAPREDUCE-1526) | Cache the job related information while submitting the job , this would avoid many RPC calls to JobTracker. | Major | contrib/gridmix | rahul k singh | rahul k singh |
+| [MAPREDUCE-1848](https://issues.apache.org/jira/browse/MAPREDUCE-1848) | Put number of speculative, data local, rack local tasks in JobTracker metrics | Major | jobtracker | Scott Chen | Scott Chen |
+| [HADOOP-6859](https://issues.apache.org/jira/browse/HADOOP-6859) | Introduce additional statistics to FileSystem | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-1298](https://issues.apache.org/jira/browse/HDFS-1298) | Add support in HDFS to update statistics that tracks number of file system operations in FileSystem | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [MAPREDUCE-1935](https://issues.apache.org/jira/browse/MAPREDUCE-1935) | HFTP needs to be updated to use delegation tokens (from HDFS-1007) | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [HADOOP-6632](https://issues.apache.org/jira/browse/HADOOP-6632) | Support for using different Kerberos keys for different instances of Hadoop services | Major | . | Kan Zhang | Kan Zhang |
+| [HDFS-1201](https://issues.apache.org/jira/browse/HDFS-1201) | Support for using different Kerberos keys for Namenode and datanode. | Major | . | Jitendra Nath Pandey | Kan Zhang |
+| [MAPREDUCE-1945](https://issues.apache.org/jira/browse/MAPREDUCE-1945) | Support for using different Kerberos keys for Jobtracker and TaskTrackers | Major | . | Kan Zhang | Kan Zhang |
+| [HDFS-1081](https://issues.apache.org/jira/browse/HDFS-1081) | Performance regression in DistributedFileSystem::getFileBlockLocations in secure systems | Major | security | Jakob Homan | Jakob Homan |
| [HDFS-1307](https://issues.apache.org/jira/browse/HDFS-1307) | Add start time, end time and total time taken for FSCK to FSCK report | Major | namenode, tools | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-1304](https://issues.apache.org/jira/browse/HDFS-1304) | There is no unit test for HftpFileSystem.open(..) | Major | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-1936](https://issues.apache.org/jira/browse/MAPREDUCE-1936) | [gridmix3] Make Gridmix3 more customizable. | Major | contrib/gridmix | Hong Tang | Hong Tang |
+| [HADOOP-6861](https://issues.apache.org/jira/browse/HADOOP-6861) | Method in Credentials to read and write a token storage file. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
| [HDFS-1302](https://issues.apache.org/jira/browse/HDFS-1302) | Use writeTokenStorageToStream method in Credentials to store credentials to a file. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
-| [HDFS-1298](https://issues.apache.org/jira/browse/HDFS-1298) | Add support in HDFS to update statistics that tracks number of file system operations in FileSystem | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-6805](https://issues.apache.org/jira/browse/HADOOP-6805) | add buildDTServiceName method to SecurityUtil (as part of MAPREDUCE-1718) | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [HADOOP-6877](https://issues.apache.org/jira/browse/HADOOP-6877) | Common part of HDFS-1178 | Major | ipc | Kan Zhang | Kan Zhang |
+| [HDFS-1178](https://issues.apache.org/jira/browse/HDFS-1178) | The NameNode servlets should not use RPC to connect to the NameNode | Major | namenode | Owen O'Malley | Owen O'Malley |
+| [HADOOP-6745](https://issues.apache.org/jira/browse/HADOOP-6745) | adding some java doc to Server.RpcMetrics, UGI | Minor | ipc | Boris Shkolnik | Boris Shkolnik |
+| [HADOOP-6890](https://issues.apache.org/jira/browse/HADOOP-6890) | Improve listFiles API introduced by HADOOP-6870 | Major | fs | Hairong Kuang | Hairong Kuang |
| [HDFS-1297](https://issues.apache.org/jira/browse/HDFS-1297) | Fix some comments | Trivial | documentation | Jeff Ames | Jeff Ames |
-| [HDFS-1272](https://issues.apache.org/jira/browse/HDFS-1272) | HDFS changes corresponding to rename of TokenStorage to Credentials | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey |
+| [HADOOP-6862](https://issues.apache.org/jira/browse/HADOOP-6862) | Add api to add user/group to AccessControlList | Major | security | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
+| [HADOOP-6911](https://issues.apache.org/jira/browse/HADOOP-6911) | doc update for DelegationTokenFetcher (part of HDFS-1036) | Minor | . | Boris Shkolnik | |
+| [MAPREDUCE-1253](https://issues.apache.org/jira/browse/MAPREDUCE-1253) | Making Mumak work with Capacity-Scheduler | Major | contrib/mumak | Anirban Dasgupta | Anirban Dasgupta |
+| [HADOOP-6693](https://issues.apache.org/jira/browse/HADOOP-6693) | Add metrics to track kerberos login activity | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-1356](https://issues.apache.org/jira/browse/HDFS-1356) | Provide information as to whether or not security is enabled on web interface for NameNode (part of HADOOP-6822) | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [HADOOP-6884](https://issues.apache.org/jira/browse/HADOOP-6884) | Add LOG.isDebugEnabled() guard for each LOG.debug("...") | Major | . | Erik Steffl | Erik Steffl |
+| [HDFS-1320](https://issues.apache.org/jira/browse/HDFS-1320) | Add LOG.isDebugEnabled() guard for each LOG.debug("...") | Major | . | Erik Steffl | Erik Steffl |
+| [HDFS-1353](https://issues.apache.org/jira/browse/HDFS-1353) | Remove most of getBlockLocation optimization | Major | namenode | Jakob Homan | Jakob Homan |
| [HDFS-1205](https://issues.apache.org/jira/browse/HDFS-1205) | FSDatasetAsyncDiskService should name its threads | Major | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-1203](https://issues.apache.org/jira/browse/HDFS-1203) | DataNode should sleep before reentering service loop after an exception | Major | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-1201](https://issues.apache.org/jira/browse/HDFS-1201) | Support for using different Kerberos keys for Namenode and datanode. | Major | . | Jitendra Nath Pandey | Kan Zhang |
-| [HDFS-1190](https://issues.apache.org/jira/browse/HDFS-1190) | Remove unused getNamenode() method from DataNode. | Minor | datanode | Jeff Ames | Jeff Ames |
-| [HDFS-1187](https://issues.apache.org/jira/browse/HDFS-1187) | Modify fetchdt to allow renewing and canceling token | Major | security | Owen O'Malley | Owen O'Malley |
-| [HDFS-1185](https://issues.apache.org/jira/browse/HDFS-1185) | Remove duplicate now() functions in DataNode, FSNamesystem | Minor | datanode, namenode | Jeff Ames | Jeff Ames |
-| [HDFS-1184](https://issues.apache.org/jira/browse/HDFS-1184) | Replace tabs in code with spaces | Minor | . | Jeff Ames | Jeff Ames |
-| [HDFS-1183](https://issues.apache.org/jira/browse/HDFS-1183) | Remove some duplicate code in NamenodeJspHelper.java | Minor | namenode | Jeff Ames | Jeff Ames |
-| [HDFS-1178](https://issues.apache.org/jira/browse/HDFS-1178) | The NameNode servlets should not use RPC to connect to the NameNode | Major | namenode | Owen O'Malley | Owen O'Malley |
-| [HDFS-1160](https://issues.apache.org/jira/browse/HDFS-1160) | Improve some FSDataset warnings and comments | Major | datanode | Eli Collins | Eli Collins |
-| [HDFS-1140](https://issues.apache.org/jira/browse/HDFS-1140) | Speedup INode.getPathComponents | Minor | namenode | Dmytro Molkov | Dmytro Molkov |
-| [HDFS-1114](https://issues.apache.org/jira/browse/HDFS-1114) | Reducing NameNode memory usage by an alternate hash table | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-| [HDFS-1110](https://issues.apache.org/jira/browse/HDFS-1110) | Namenode heap optimization - reuse objects for commonly used file names | Major | . | Suresh Srinivas | Suresh Srinivas |
-| [HDFS-1093](https://issues.apache.org/jira/browse/HDFS-1093) | Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write lock | Major | namenode | dhruba borthakur | dhruba borthakur |
-| [HDFS-1081](https://issues.apache.org/jira/browse/HDFS-1081) | Performance regression in DistributedFileSystem::getFileBlockLocations in secure systems | Major | security | Jakob Homan | Jakob Homan |
-| [HDFS-1055](https://issues.apache.org/jira/browse/HDFS-1055) | Improve thread naming for DataXceivers | Major | datanode | Todd Lipcon | Todd Lipcon |
-| [HDFS-1035](https://issues.apache.org/jira/browse/HDFS-1035) | Generate Eclipse's .classpath file from Ivy config | Major | build | Tom White | Nigel Daley |
-| [HDFS-1033](https://issues.apache.org/jira/browse/HDFS-1033) | In secure clusters, NN and SNN should verify that the remote principal during image and edits transfer | Major | namenode, security | Jakob Homan | Jakob Homan |
-| [HDFS-1028](https://issues.apache.org/jira/browse/HDFS-1028) | INode.getPathNames could split more efficiently | Minor | namenode | Todd Lipcon | Dmytro Molkov |
-| [HDFS-1023](https://issues.apache.org/jira/browse/HDFS-1023) | Allow http server to start as regular principal if https principal not defined. | Major | namenode | Jakob Homan | Jakob Homan |
-| [HDFS-947](https://issues.apache.org/jira/browse/HDFS-947) | The namenode should redirect a hftp request to read a file to the datanode that has the maximum number of local replicas | Major | . | dhruba borthakur | Dmytro Molkov |
-| [HDFS-941](https://issues.apache.org/jira/browse/HDFS-941) | Datanode xceiver protocol should allow reuse of a connection | Major | datanode, hdfs-client, performance | Todd Lipcon | bc Wong |
-| [HDFS-895](https://issues.apache.org/jira/browse/HDFS-895) | Allow hflush/sync to occur in parallel with new writes to the file | Major | hdfs-client | dhruba borthakur | Todd Lipcon |
-| [HDFS-884](https://issues.apache.org/jira/browse/HDFS-884) | DataNode makeInstance should report the directory list when failing to start up | Minor | datanode | Steve Loughran | Steve Loughran |
-| [HDFS-882](https://issues.apache.org/jira/browse/HDFS-882) | Datanode could log what hostname and ports its listening on on startup | Minor | datanode | Steve Loughran | Steve Loughran |
+| [MAPREDUCE-2046](https://issues.apache.org/jira/browse/MAPREDUCE-2046) | A CombineFileInputSplit cannot be less than a dfs block | Major | . | Namit Jain | dhruba borthakur |
+| [HDFS-1369](https://issues.apache.org/jira/browse/HDFS-1369) | Invalid javadoc reference in FSDatasetMBean.java | Trivial | datanode | Eli Collins | Eli Collins |
| [HDFS-881](https://issues.apache.org/jira/browse/HDFS-881) | Refactor DataNode Packet header into DataTransferProtocol | Major | . | Todd Lipcon | Todd Lipcon |
-| [HDFS-853](https://issues.apache.org/jira/browse/HDFS-853) | The HDFS webUI should show a metric that summarizes whether the cluster is balanced regarding disk space usage | Major | namenode | dhruba borthakur | Dmytro Molkov |
-| [HDFS-718](https://issues.apache.org/jira/browse/HDFS-718) | configuration parameter to prevent accidental formatting of HDFS filesystem | Minor | namenode | Andrew Ryan | Andrew Ryan |
-| [HDFS-599](https://issues.apache.org/jira/browse/HDFS-599) | Improve Namenode robustness by prioritizing datanode heartbeats over client requests | Major | namenode | dhruba borthakur | Dmytro Molkov |
-| [HDFS-556](https://issues.apache.org/jira/browse/HDFS-556) | Provide info on failed volumes in the web ui | Major | namenode | Jakob Homan | Eli Collins |
-| [HDFS-455](https://issues.apache.org/jira/browse/HDFS-455) | Make NN and DN handle in a intuitive way comma-separated configuration strings | Minor | datanode, namenode | Michele Catasta | Michele Catasta |
-| [MAPREDUCE-2505](https://issues.apache.org/jira/browse/MAPREDUCE-2505) | Explain how to use ACLs in the fair scheduler | Minor | contrib/fair-share, documentation | Matei Zaharia | Matei Zaharia |
-| [MAPREDUCE-2502](https://issues.apache.org/jira/browse/MAPREDUCE-2502) | JobSubmitter should use mapreduce.job.maps | Trivial | job submission | Eli Collins | Eli Collins |
-| [MAPREDUCE-2410](https://issues.apache.org/jira/browse/MAPREDUCE-2410) | document multiple keys per reducer oddity in hadoop streaming FAQ | Minor | contrib/streaming, documentation | Dieter Plaetinck | Harsh J |
-| [MAPREDUCE-2372](https://issues.apache.org/jira/browse/MAPREDUCE-2372) | TaskLogAppender mechanism shouldn't be set in log4j.properties | Major | task | Todd Lipcon | Todd Lipcon |
-| [MAPREDUCE-2337](https://issues.apache.org/jira/browse/MAPREDUCE-2337) | Remove dependence of public MapReduce API on classes in server package | Major | . | Tom White | Tom White |
-| [MAPREDUCE-2314](https://issues.apache.org/jira/browse/MAPREDUCE-2314) | configure files that are generated as part of the released tarball need to have executable bit set | Major | build | Roman Shaposhnik | Roman Shaposhnik |
-| [MAPREDUCE-2260](https://issues.apache.org/jira/browse/MAPREDUCE-2260) | Remove auto-generated native build files | Major | build | Roman Shaposhnik | Roman Shaposhnik |
-| [MAPREDUCE-2184](https://issues.apache.org/jira/browse/MAPREDUCE-2184) | Port DistRaid.java to new mapreduce API | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
-| [MAPREDUCE-2167](https://issues.apache.org/jira/browse/MAPREDUCE-2167) | Faster directory traversal for raid node | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
-| [MAPREDUCE-2150](https://issues.apache.org/jira/browse/MAPREDUCE-2150) | RaidNode should periodically fix corrupt blocks | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
-| [MAPREDUCE-2147](https://issues.apache.org/jira/browse/MAPREDUCE-2147) | JobInProgress has some redundant lines in its ctor | Trivial | jobtracker | Harsh J | Harsh J |
-| [MAPREDUCE-2145](https://issues.apache.org/jira/browse/MAPREDUCE-2145) | upgrade clover on the builds servers to v 3.0.2 | Major | . | Giridharan Kesavan | Giridharan Kesavan |
-| [MAPREDUCE-2141](https://issues.apache.org/jira/browse/MAPREDUCE-2141) | Add an "extra data" field to Task for use by Mesos | Minor | . | Matei Zaharia | Matei Zaharia |
+| [MAPREDUCE-1918](https://issues.apache.org/jira/browse/MAPREDUCE-1918) | Add documentation to Rumen | Major | tools/rumen | Amar Kamat | Amar Kamat |
+| [HDFS-1395](https://issues.apache.org/jira/browse/HDFS-1395) | Add @Override annotation to FSDataset methods that implement FSDatasetInterface | Major | datanode | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-6950](https://issues.apache.org/jira/browse/HADOOP-6950) | Suggest that HADOOP\_CLASSPATH should be preserved in hadoop-env.sh.template | Trivial | scripts | Philip Zeyliger | Philip Zeyliger |
+| [HDFS-1383](https://issues.apache.org/jira/browse/HDFS-1383) | Better error messages on hftp | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [HDFS-1093](https://issues.apache.org/jira/browse/HDFS-1093) | Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write lock | Major | namenode | dhruba borthakur | dhruba borthakur |
+| [HDFS-1407](https://issues.apache.org/jira/browse/HDFS-1407) | Use Block in DataTransferProtocol | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-1304](https://issues.apache.org/jira/browse/HDFS-1304) | There is no unit test for HftpFileSystem.open(..) | Major | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
+| [MAPREDUCE-1548](https://issues.apache.org/jira/browse/MAPREDUCE-1548) | Hadoop archives should be able to preserve times and other properties from original files | Major | harchive | Rodrigo Schmidt | Rodrigo Schmidt |
+| [HDFS-1417](https://issues.apache.org/jira/browse/HDFS-1417) | Add @Override annotation to SimulatedFSDataset methods that implement FSDatasetInterface | Major | . | Suresh Srinivas | Suresh Srinivas |
+| [HDFS-1368](https://issues.apache.org/jira/browse/HDFS-1368) | Add a block counter to DatanodeDescriptor | Major | namenode | Hairong Kuang | Hairong Kuang |
+| [HDFS-1426](https://issues.apache.org/jira/browse/HDFS-1426) | Remove unused method BlockInfo#listCount | Major | namenode | Hairong Kuang | Hairong Kuang |
+| [HADOOP-6856](https://issues.apache.org/jira/browse/HADOOP-6856) | SequenceFile and MapFile need cleanup to remove redundant constructors | Major | io | Owen O'Malley | Owen O'Malley |
+| [MAPREDUCE-1816](https://issues.apache.org/jira/browse/MAPREDUCE-1816) | HAR files used for RAID parity need to have configurable partfile size | Minor | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
+| [HADOOP-6879](https://issues.apache.org/jira/browse/HADOOP-6879) | Provide SSH based (Jsch) remote execution API for system tests | Major | build, test | Iyappan Srinivasan | Konstantin Boudnik |
+| [HDFS-1434](https://issues.apache.org/jira/browse/HDFS-1434) | Refactor Datanode#startDataNode method | Major | datanode | Suresh Srinivas | Suresh Srinivas |
+| [HADOOP-6987](https://issues.apache.org/jira/browse/HADOOP-6987) | Use JUnit Rule to optionally fail test cases that run more than 10 seconds | Major | test | Jakob Homan | Jakob Homan |
+| [MAPREDUCE-1819](https://issues.apache.org/jira/browse/MAPREDUCE-1819) | RaidNode should be smarter in submitting Raid jobs | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
+| [HDFS-1456](https://issues.apache.org/jira/browse/HDFS-1456) | Provide builder for constructing instances of MiniDFSCluster | Major | test | Jakob Homan | Jakob Homan |
| [MAPREDUCE-2140](https://issues.apache.org/jira/browse/MAPREDUCE-2140) | Re-generate fair scheduler design doc PDF | Trivial | . | Matei Zaharia | Matei Zaharia |
+| [MAPREDUCE-2145](https://issues.apache.org/jira/browse/MAPREDUCE-2145) | upgrade clover on the builds servers to v 3.0.2 | Major | . | Giridharan Kesavan | Giridharan Kesavan |
| [MAPREDUCE-2132](https://issues.apache.org/jira/browse/MAPREDUCE-2132) | Need a command line option in RaidShell to fix blocks using raid | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
+| [MAPREDUCE-2147](https://issues.apache.org/jira/browse/MAPREDUCE-2147) | JobInProgress has some redundant lines in its ctor | Trivial | jobtracker | Harsh J | Harsh J |
| [MAPREDUCE-2126](https://issues.apache.org/jira/browse/MAPREDUCE-2126) | JobQueueJobInProgressListener's javadoc is inconsistent with source code | Minor | jobtracker | Jingguo Yao | Jingguo Yao |
-| [MAPREDUCE-2103](https://issues.apache.org/jira/browse/MAPREDUCE-2103) | task-controller shouldn't require o-r permissions | Trivial | task-controller | Todd Lipcon | Todd Lipcon |
+| [HDFS-1472](https://issues.apache.org/jira/browse/HDFS-1472) | Refactor DFSck to allow programmatic access to output | Major | tools | Ramkumar Vadali | Ramkumar Vadali |
+| [HADOOP-7005](https://issues.apache.org/jira/browse/HADOOP-7005) | Update test-patch.sh to remove callback to Hudson master | Major | test | Nigel Daley | Nigel Daley |
+| [HADOOP-7007](https://issues.apache.org/jira/browse/HADOOP-7007) | update the hudson-test-patch target to work with the latest test-patch script. | Major | build | Giridharan Kesavan | Giridharan Kesavan |
+| [HADOOP-6985](https://issues.apache.org/jira/browse/HADOOP-6985) | Suggest that HADOOP\_OPTS be preserved in hadoop-env.sh.template | Minor | . | Ramkumar Vadali | Ramkumar Vadali |
+| [HADOOP-7010](https://issues.apache.org/jira/browse/HADOOP-7010) | Typo in FileSystem.java | Minor | fs | Jingguo Yao | Jingguo Yao |
+| [HADOOP-7009](https://issues.apache.org/jira/browse/HADOOP-7009) | MD5Hash provides a public factory method that creates an instance of MessageDigest | Major | io | Hairong Kuang | Hairong Kuang |
+| [MAPREDUCE-2150](https://issues.apache.org/jira/browse/MAPREDUCE-2150) | RaidNode should periodically fix corrupt blocks | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
+| [MAPREDUCE-1818](https://issues.apache.org/jira/browse/MAPREDUCE-1818) | RaidNode should specify a pool name incase the cluster is using FairScheduler | Minor | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
+| [HDFS-1485](https://issues.apache.org/jira/browse/HDFS-1485) | Typo in BlockPlacementPolicy.java | Minor | . | Jingguo Yao | Jingguo Yao |
+| [HADOOP-7008](https://issues.apache.org/jira/browse/HADOOP-7008) | Enable test-patch.sh to have a configured number of acceptable findbugs and javadoc warnings | Major | test | Nigel Daley | Giridharan Kesavan |
+| [MAPREDUCE-1892](https://issues.apache.org/jira/browse/MAPREDUCE-1892) | RaidNode can allow layered policies more efficiently | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
+| [HADOOP-6818](https://issues.apache.org/jira/browse/HADOOP-6818) | Provide a JNI-based implementation of GroupMappingServiceProvider | Major | security | Devaraj Das | Devaraj Das |
+| [HADOOP-6943](https://issues.apache.org/jira/browse/HADOOP-6943) | The GroupMappingServiceProvider interface should be public | Major | security | Aaron T. Myers | Aaron T. Myers |
+| [HDFS-1457](https://issues.apache.org/jira/browse/HDFS-1457) | Limit transmission rate when transfering image between primary and secondary NNs | Major | namenode | Hairong Kuang | Hairong Kuang |
+| [HDFS-1035](https://issues.apache.org/jira/browse/HDFS-1035) | Generate Eclipse's .classpath file from Ivy config | Major | build | Tom White | Nigel Daley |
+| [MAPREDUCE-1592](https://issues.apache.org/jira/browse/MAPREDUCE-1592) | Generate Eclipse's .classpath file from Ivy config | Major | build | Tom White | Tom White |
+| [HADOOP-4675](https://issues.apache.org/jira/browse/HADOOP-4675) | Current Ganglia metrics implementation is incompatible with Ganglia 3.1 | Major | metrics | Brian Bockelman | Brian Bockelman |
+| [HADOOP-6977](https://issues.apache.org/jira/browse/HADOOP-6977) | Herriot daemon clients should vend statistics | Major | test | Konstantin Boudnik | Konstantin Boudnik |
+| [MAPREDUCE-2141](https://issues.apache.org/jira/browse/MAPREDUCE-2141) | Add an "extra data" field to Task for use by Mesos | Minor | . | Matei Zaharia | Matei Zaharia |
+| [HDFS-1408](https://issues.apache.org/jira/browse/HDFS-1408) | Herriot NN and DN clients should vend statistics | Major | test | Al Thompson | Konstantin Boudnik |
| [MAPREDUCE-2093](https://issues.apache.org/jira/browse/MAPREDUCE-2093) | Herriot JT and TT clients should vend statistics | Major | test | Konstantin Boudnik | Konstantin Boudnik |
-| [MAPREDUCE-2046](https://issues.apache.org/jira/browse/MAPREDUCE-2046) | A CombineFileInputSplit cannot be less than a dfs block | Major | . | Namit Jain | dhruba borthakur |
-| [MAPREDUCE-2026](https://issues.apache.org/jira/browse/MAPREDUCE-2026) | JobTracker.getJobCounters() should not hold JobTracker lock while calling JobInProgress.getCounters() | Major | . | Scott Chen | Joydeep Sen Sarma |
-| [MAPREDUCE-1945](https://issues.apache.org/jira/browse/MAPREDUCE-1945) | Support for using different Kerberos keys for Jobtracker and TaskTrackers | Major | . | Kan Zhang | Kan Zhang |
-| [MAPREDUCE-1936](https://issues.apache.org/jira/browse/MAPREDUCE-1936) | [gridmix3] Make Gridmix3 more customizable. | Major | contrib/gridmix | Hong Tang | Hong Tang |
-| [MAPREDUCE-1935](https://issues.apache.org/jira/browse/MAPREDUCE-1935) | HFTP needs to be updated to use delegation tokens (from HDFS-1007) | Major | . | Boris Shkolnik | Boris Shkolnik |
+| [MAPREDUCE-2167](https://issues.apache.org/jira/browse/MAPREDUCE-2167) | Faster directory traversal for raid node | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
+| [HADOOP-6903](https://issues.apache.org/jira/browse/HADOOP-6903) | Make AbstractFileSystem's methods public to allow filter-Fs like implementions in a differnt package than fs | Major | . | Sanjay Radia | Sanjay Radia |
+| [HDFS-1160](https://issues.apache.org/jira/browse/HDFS-1160) | Improve some FSDataset warnings and comments | Major | datanode | Eli Collins | Eli Collins |
+| [HDFS-556](https://issues.apache.org/jira/browse/HDFS-556) | Provide info on failed volumes in the web ui | Major | namenode | Jakob Homan | Eli Collins |
+| [HADOOP-7032](https://issues.apache.org/jira/browse/HADOOP-7032) | Assert type constraints in the FileStatus constructor | Major | fs | Eli Collins | Eli Collins |
+| [HADOOP-6562](https://issues.apache.org/jira/browse/HADOOP-6562) | FileContextSymlinkBaseTest should use FileContextTestHelper | Minor | test | Eli Collins | Eli Collins |
+| [HDFS-1491](https://issues.apache.org/jira/browse/HDFS-1491) | Update Hdfs to match the change of methods from protected to public in AbstractFileSystem (Hadoop-6903) | Major | . | Sanjay Radia | Sanjay Radia |
+| [HDFS-1187](https://issues.apache.org/jira/browse/HDFS-1187) | Modify fetchdt to allow renewing and canceling token | Major | security | Owen O'Malley | Owen O'Malley |
+| [HDFS-1203](https://issues.apache.org/jira/browse/HDFS-1203) | DataNode should sleep before reentering service loop after an exception | Major | datanode | Todd Lipcon | Todd Lipcon |
+| [HDFS-1387](https://issues.apache.org/jira/browse/HDFS-1387) | Update HDFS permissions guide for security | Major | documentation, security | Todd Lipcon | Todd Lipcon |
+| [HDFS-455](https://issues.apache.org/jira/browse/HDFS-455) | Make NN and DN handle in a intuitive way comma-separated configuration strings | Minor | datanode, namenode | Michele Catasta | Michele Catasta |
+| [HDFS-1055](https://issues.apache.org/jira/browse/HDFS-1055) | Improve thread naming for DataXceivers | Major | datanode | Todd Lipcon | Todd Lipcon |
+| [HDFS-718](https://issues.apache.org/jira/browse/HDFS-718) | configuration parameter to prevent accidental formatting of HDFS filesystem | Minor | namenode | Andrew Ryan | Andrew Ryan |
| [MAPREDUCE-1931](https://issues.apache.org/jira/browse/MAPREDUCE-1931) | Gridmix forrest documentation | Major | contrib/gridmix | rahul k singh | Ranjit Mathew |
-| [MAPREDUCE-1918](https://issues.apache.org/jira/browse/MAPREDUCE-1918) | Add documentation to Rumen | Major | tools/rumen | Amar Kamat | Amar Kamat |
-| [MAPREDUCE-1893](https://issues.apache.org/jira/browse/MAPREDUCE-1893) | Multiple reducers for Slive | Major | benchmarks, test | Konstantin Shvachko | Konstantin Shvachko |
-| [MAPREDUCE-1892](https://issues.apache.org/jira/browse/MAPREDUCE-1892) | RaidNode can allow layered policies more efficiently | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
-| [MAPREDUCE-1878](https://issues.apache.org/jira/browse/MAPREDUCE-1878) | Add MRUnit documentation | Major | contrib/mrunit | Aaron Kimball | Aaron Kimball |
-| [MAPREDUCE-1868](https://issues.apache.org/jira/browse/MAPREDUCE-1868) | Add read timeout on userlog pull | Major | client | Krishna Ramachandran | Krishna Ramachandran |
-| [MAPREDUCE-1851](https://issues.apache.org/jira/browse/MAPREDUCE-1851) | Document configuration parameters in streaming | Major | contrib/streaming, documentation | Amareshwari Sriramadasu | Amareshwari Sriramadasu |
-| [MAPREDUCE-1850](https://issues.apache.org/jira/browse/MAPREDUCE-1850) | Include job submit host information (name and ip) in jobconf and jobdetails display | Major | . | Krishna Ramachandran | Krishna Ramachandran |
-| [MAPREDUCE-1848](https://issues.apache.org/jira/browse/MAPREDUCE-1848) | Put number of speculative, data local, rack local tasks in JobTracker metrics | Major | jobtracker | Scott Chen | Scott Chen |
-| [MAPREDUCE-1840](https://issues.apache.org/jira/browse/MAPREDUCE-1840) | [Gridmix] Exploit/Add security features in GridMix | Major | contrib/gridmix | Amar Kamat | Amar Kamat |
-| [MAPREDUCE-1838](https://issues.apache.org/jira/browse/MAPREDUCE-1838) | DistRaid map tasks have large variance in running times | Minor | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
-| [MAPREDUCE-1832](https://issues.apache.org/jira/browse/MAPREDUCE-1832) | Support for file sizes less than 1MB in DFSIO benchmark. | Major | benchmarks | Konstantin Shvachko | Konstantin Shvachko |
-| [MAPREDUCE-1829](https://issues.apache.org/jira/browse/MAPREDUCE-1829) | JobInProgress.findSpeculativeTask should use min() to find the candidate instead of sort() | Major | jobtracker | Scott Chen | Scott Chen |
-| [MAPREDUCE-1819](https://issues.apache.org/jira/browse/MAPREDUCE-1819) | RaidNode should be smarter in submitting Raid jobs | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
-| [MAPREDUCE-1818](https://issues.apache.org/jira/browse/MAPREDUCE-1818) | RaidNode should specify a pool name incase the cluster is using FairScheduler | Minor | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
-| [MAPREDUCE-1816](https://issues.apache.org/jira/browse/MAPREDUCE-1816) | HAR files used for RAID parity need to have configurable partfile size | Minor | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
-| [MAPREDUCE-1798](https://issues.apache.org/jira/browse/MAPREDUCE-1798) | normalize property names for JT kerberos principal names in configuration (from HADOOP 6633) | Major | . | Boris Shkolnik | Boris Shkolnik |
-| [MAPREDUCE-1785](https://issues.apache.org/jira/browse/MAPREDUCE-1785) | Add streaming config option for not emitting the key | Minor | contrib/streaming | Eli Collins | Eli Collins |
+| [MAPREDUCE-2184](https://issues.apache.org/jira/browse/MAPREDUCE-2184) | Port DistRaid.java to new mapreduce API | Major | contrib/raid | Ramkumar Vadali | Ramkumar Vadali |
+| [HDFS-1513](https://issues.apache.org/jira/browse/HDFS-1513) | Fix a number of warnings | Minor | . | Eli Collins | Eli Collins |
| [MAPREDUCE-1783](https://issues.apache.org/jira/browse/MAPREDUCE-1783) | Task Initialization should be delayed till when a job can be run | Major | contrib/fair-share | Ramkumar Vadali | Ramkumar Vadali |
-| [MAPREDUCE-1778](https://issues.apache.org/jira/browse/MAPREDUCE-1778) | CompletedJobStatusStore initialization should fail if {mapred.job.tracker.persist.jobstatus.dir} is unwritable | Major | jobtracker | Amar Kamat | Krishna Ramachandran |
-| [MAPREDUCE-1762](https://issues.apache.org/jira/browse/MAPREDUCE-1762) | Add a setValue() method in Counter | Major | . | Scott Chen | Scott Chen |
-| [MAPREDUCE-1761](https://issues.apache.org/jira/browse/MAPREDUCE-1761) | FairScheduler should allow separate configuration of node and rack locality wait time | Major | . | Scott Chen | Scott Chen |
-| [MAPREDUCE-1711](https://issues.apache.org/jira/browse/MAPREDUCE-1711) | Gridmix should provide an option to submit jobs to the same queues as specified in the trace. | Major | contrib/gridmix | Hong Tang | rahul k singh |
-| [MAPREDUCE-1626](https://issues.apache.org/jira/browse/MAPREDUCE-1626) | Publish Javadoc for all contrib packages with user-facing APIs | Major | documentation | Tom White | Jolly Chen |
-| [MAPREDUCE-1592](https://issues.apache.org/jira/browse/MAPREDUCE-1592) | Generate Eclipse's .classpath file from Ivy config | Major | build | Tom White | Tom White |
-| [MAPREDUCE-1548](https://issues.apache.org/jira/browse/MAPREDUCE-1548) | Hadoop archives should be able to preserve times and other properties from original files | Major | harchive | Rodrigo Schmidt | Rodrigo Schmidt |
-| [MAPREDUCE-1546](https://issues.apache.org/jira/browse/MAPREDUCE-1546) | Jobtracker JSP pages should automatically redirect to the corresponding history page if not in memory | Minor | . | Scott Chen | Scott Chen |
-| [MAPREDUCE-1545](https://issues.apache.org/jira/browse/MAPREDUCE-1545) | Add 'first-task-launched' to job-summary | Major | jobtracker | Arun C Murthy | Luke Lu |
-| [MAPREDUCE-1526](https://issues.apache.org/jira/browse/MAPREDUCE-1526) | Cache the job related information while submitting the job , this would avoid many RPC calls to JobTracker. | Major | contrib/gridmix | rahul k singh | rahul k singh |
-| [MAPREDUCE-1492](https://issues.apache.org/jira/browse/MAPREDUCE-1492) | Delete or recreate obsolete har files used on hdfs raid | Major | contrib/raid | Rodrigo Schmidt | Rodrigo Schmidt |
+| [HDFS-895](https://issues.apache.org/jira/browse/HDFS-895) | Allow hflush/sync to occur in parallel with new writes to the file | Major | hdfs-client | dhruba borthakur | Todd Lipcon |
+| [MAPREDUCE-1878](https://issues.apache.org/jira/browse/MAPREDUCE-1878) | Add MRUnit documentation | Major | contrib/mrunit | Aaron Kimball | Aaron Kimball |
+| [HADOOP-7054](https://issues.apache.org/jira/browse/HADOOP-7054) | Change NN LoadGenerator to use the new FileContext api | Major | . | Sanjay Radia | Sanjay Radia |
+| [HADOOP-6298](https://issues.apache.org/jira/browse/HADOOP-6298) | BytesWritable#getBytes is a bad name that leads to programming mistakes | Major | . | Nathan Marz | Owen O'Malley |
+| [HADOOP-6578](https://issues.apache.org/jira/browse/HADOOP-6578) | Configuration should trim whitespace around a lot of value types | Minor | conf | Todd Lipcon | Michele Catasta |
+| [HADOOP-6811](https://issues.apache.org/jira/browse/HADOOP-6811) | Remove EC2 bash scripts | Blocker | . | Tom White | Tom White |
+| [HDFS-884](https://issues.apache.org/jira/browse/HDFS-884) | DataNode makeInstance should report the directory list when failing to start up | Minor | datanode | Steve Loughran | Steve Loughran |
+| [HADOOP-6056](https://issues.apache.org/jira/browse/HADOOP-6056) | Use java.net.preferIPv4Stack to force IPv4 | Major | scripts | Steve Loughran | Michele Catasta |
| [MAPREDUCE-1382](https://issues.apache.org/jira/browse/MAPREDUCE-1382) | MRAsyncDiscService should tolerate missing local.dir | Major | . | Scott Chen | Zheng Shao |
-| [MAPREDUCE-1376](https://issues.apache.org/jira/browse/MAPREDUCE-1376) | Support for varied user submission in Gridmix | Major | contrib/gridmix | Chris Douglas | Chris Douglas |
-| [MAPREDUCE-1354](https://issues.apache.org/jira/browse/MAPREDUCE-1354) | Incremental enhancements to the JobTracker for better scalability | Critical | jobtracker | Devaraj Das | Dick King |
-| [MAPREDUCE-1253](https://issues.apache.org/jira/browse/MAPREDUCE-1253) | Making Mumak work with Capacity-Scheduler | Major | contrib/mumak | Anirban Dasgupta | Anirban Dasgupta |
-| [MAPREDUCE-1248](https://issues.apache.org/jira/browse/MAPREDUCE-1248) | Redundant memory copying in StreamKeyValUtil | Minor | contrib/streaming | Ruibang He | Ruibang He |
+| [HADOOP-7110](https://issues.apache.org/jira/browse/HADOOP-7110) | Implement chmod with JNI | Major | io, native | Todd Lipcon | Todd Lipcon |
+| [HADOOP-6436](https://issues.apache.org/jira/browse/HADOOP-6436) | Remove auto-generated native build files | Major | . | Eli Collins | Roman Shaposhnik |
+| [MAPREDUCE-2260](https://issues.apache.org/jira/browse/MAPREDUCE-2260) | Remove auto-generated native build files | Major | build | Roman Shaposhnik | Roman Shaposhnik |
+| [HDFS-1582](https://issues.apache.org/jira/browse/HDFS-1582) | Remove auto-generated native build files | Major | libhdfs | Roman Shaposhnik | Roman Shaposhnik |
+| [MAPREDUCE-2026](https://issues.apache.org/jira/browse/MAPREDUCE-2026) | JobTracker.getJobCounters() should not hold JobTracker lock while calling JobInProgress.getCounters() | Major | . | Scott Chen | Joydeep Sen Sarma |
+| [HADOOP-7134](https://issues.apache.org/jira/browse/HADOOP-7134) | configure files that are generated as part of the released tarball need to have executable bit set | Major | build | Roman Shaposhnik | Roman Shaposhnik |
+| [HDFS-1618](https://issues.apache.org/jira/browse/HDFS-1618) | configure files that are generated as part of the released tarball need to have executable bit set | Major | build | Roman Shaposhnik | Roman Shaposhnik |
+| [MAPREDUCE-2314](https://issues.apache.org/jira/browse/MAPREDUCE-2314) | configure files that are generated as part of the released tarball need to have executable bit set | Major | build | Roman Shaposhnik | Roman Shaposhnik |
| [MAPREDUCE-1159](https://issues.apache.org/jira/browse/MAPREDUCE-1159) | Limit Job name on jobtracker.jsp to be 80 char long | Trivial | . | Zheng Shao | Harsh J |
-| [MAPREDUCE-478](https://issues.apache.org/jira/browse/MAPREDUCE-478) | separate jvm param for mapper and reducer | Minor | . | Koji Noguchi | Arun C Murthy |
+| [HADOOP-7154](https://issues.apache.org/jira/browse/HADOOP-7154) | Should set MALLOC\_ARENA\_MAX in hadoop-config.sh | Minor | scripts | Todd Lipcon | Todd Lipcon |
+| [HDFS-1736](https://issues.apache.org/jira/browse/HDFS-1736) | Break dependency between DatanodeJspHelper and FsShell | Minor | datanode | Daryn Sharp | Daryn Sharp |
+| [HADOOP-7177](https://issues.apache.org/jira/browse/HADOOP-7177) | CodecPool should report which compressor it is using | Trivial | native | Allen Wittenauer | Allen Wittenauer |
+| [HDFS-1596](https://issues.apache.org/jira/browse/HDFS-1596) | Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml | Major | documentation, namenode | Patrick Angeles | Harsh J |
+| [HADOOP-7117](https://issues.apache.org/jira/browse/HADOOP-7117) | Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml | Major | conf | Patrick Angeles | Harsh J |
+| [HADOOP-7193](https://issues.apache.org/jira/browse/HADOOP-7193) | Help message is wrong for touchz command. | Minor | fs | Uma Maheswara Rao G | Uma Maheswara Rao G |
+| [MAPREDUCE-2337](https://issues.apache.org/jira/browse/MAPREDUCE-2337) | Remove dependence of public MapReduce API on classes in server package | Major | . | Tom White | Tom White |
+| [HADOOP-7241](https://issues.apache.org/jira/browse/HADOOP-7241) | fix typo of command 'hadoop fs -help tail' | Minor | fs, test | Wei Yongjun | Wei Yongjun |
+| [HDFS-1861](https://issues.apache.org/jira/browse/HDFS-1861) | Rename dfs.datanode.max.xcievers and bump its default value | Major | datanode | Eli Collins | Eli Collins |
+| [HADOOP-7244](https://issues.apache.org/jira/browse/HADOOP-7244) | Documentation change for updated configuration keys | Blocker | documentation | Tom White | Tom White |
+| [HDFS-1866](https://issues.apache.org/jira/browse/HDFS-1866) | Document dfs.datanode.max.transfer.threads in hdfs-default.xml | Minor | datanode, documentation | Eli Collins | Harsh J |
+| [HADOOP-7189](https://issues.apache.org/jira/browse/HADOOP-7189) | Add ability to enable 'debug' property in JAAS configuration | Minor | security | Todd Lipcon | Ted Yu |
+| [MAPREDUCE-2410](https://issues.apache.org/jira/browse/MAPREDUCE-2410) | document multiple keys per reducer oddity in hadoop streaming FAQ | Minor | contrib/streaming, documentation | Dieter Plaetinck | Harsh J |
+| [MAPREDUCE-1626](https://issues.apache.org/jira/browse/MAPREDUCE-1626) | Publish Javadoc for all contrib packages with user-facing APIs | Major | documentation | Tom White | Jolly Chen |
+| [MAPREDUCE-2103](https://issues.apache.org/jira/browse/MAPREDUCE-2103) | task-controller shouldn't require o-r permissions | Trivial | task-controller | Todd Lipcon | Todd Lipcon |
+| [HADOOP-7192](https://issues.apache.org/jira/browse/HADOOP-7192) | fs -stat docs aren't updated to reflect the format features | Trivial | documentation | Harsh J | Harsh J |
+| [HDFS-1947](https://issues.apache.org/jira/browse/HDFS-1947) | DFSClient should use mapreduce.task.attempt.id | Trivial | hdfs-client | Eli Collins | Eli Collins |
+| [MAPREDUCE-2502](https://issues.apache.org/jira/browse/MAPREDUCE-2502) | JobSubmitter should use mapreduce.job.maps | Trivial | job submission | Eli Collins | Eli Collins |
+| [MAPREDUCE-2505](https://issues.apache.org/jira/browse/MAPREDUCE-2505) | Explain how to use ACLs in the fair scheduler | Minor | contrib/fair-share, documentation | Matei Zaharia | Matei Zaharia |
+| [HDFS-1957](https://issues.apache.org/jira/browse/HDFS-1957) | Documentation for HFTP | Minor | documentation | Ari Rabkin | Ari Rabkin |
+| [MAPREDUCE-2372](https://issues.apache.org/jira/browse/MAPREDUCE-2372) | TaskLogAppender mechanism shouldn't be set in log4j.properties | Major | task | Todd Lipcon | Todd Lipcon |
+| [HADOOP-7355](https://issues.apache.org/jira/browse/HADOOP-7355) | Add audience and stability annotations to HttpServer class | Major | . | stack | stack |
+| [HADOOP-7335](https://issues.apache.org/jira/browse/HADOOP-7335) | Force entropy to come from non-true random for tests | Minor | build, test | Todd Lipcon | Todd Lipcon |
+| [HDFS-1454](https://issues.apache.org/jira/browse/HDFS-1454) | Update the documentation to reflect true client caching strategy | Major | documentation, hdfs-client | Jeff Hammerbacher | Harsh J |
+| [HADOOP-7346](https://issues.apache.org/jira/browse/HADOOP-7346) | Send back nicer error to clients using outdated IPC version | Major | ipc | Todd Lipcon | Todd Lipcon |
+| [HDFS-1980](https://issues.apache.org/jira/browse/HDFS-1980) | Move build/webapps deeper in directory heirarchy to aid eclipse users | Major | build | Todd Lipcon | Todd Lipcon |
+| [HADOOP-7325](https://issues.apache.org/jira/browse/HADOOP-7325) | hadoop command - do not accept class names starting with a hyphen | Minor | scripts | Brock Noland | Brock Noland |
+| [HDFS-2039](https://issues.apache.org/jira/browse/HDFS-2039) | TestNameNodeMetrics uses a bad test root path | Major | . | Todd Lipcon | Todd Lipcon |
+| [HDFS-1619](https://issues.apache.org/jira/browse/HDFS-1619) | Remove AC\_TYPE\* from the libhdfs | Major | libhdfs | Roman Shaposhnik | Roman Shaposhnik |
+| [HDFS-1954](https://issues.apache.org/jira/browse/HDFS-1954) | Improve corrupt files warning message on NameNode web UI | Major | namenode | philo vivero | Patrick Hunt |
+| [HADOOP-6605](https://issues.apache.org/jira/browse/HADOOP-6605) | Add JAVA\_HOME detection to hadoop-config | Minor | . | Chad Metcalf | Eli Collins |
+| [HADOOP-7106](https://issues.apache.org/jira/browse/HADOOP-7106) | Re-organize hadoop subversion layout | Blocker | build | Nigel Daley | Todd Lipcon |
+| [HDFS-941](https://issues.apache.org/jira/browse/HDFS-941) | Datanode xceiver protocol should allow reuse of a connection | Major | datanode, hdfs-client, performance | Todd Lipcon | bc Wong |
+| [HDFS-2054](https://issues.apache.org/jira/browse/HDFS-2054) | BlockSender.sendChunk() prints ERROR for connection closures encountered during transferToFully() | Minor | datanode | Kihwal Lee | Kihwal Lee |
+| [HDFS-2286](https://issues.apache.org/jira/browse/HDFS-2286) | DataXceiverServer logs AsynchronousCloseException at shutdown | Trivial | datanode | Todd Lipcon | Todd Lipcon |
+| [HADOOP-7457](https://issues.apache.org/jira/browse/HADOOP-7457) | Remove out-of-date Chinese language documentation | Blocker | documentation | Jakob Homan | Jakob Homan |
+| [HDFS-1935](https://issues.apache.org/jira/browse/HDFS-1935) | Build should not redownload ivy on every invocation | Minor | build | Todd Lipcon | Joep Rottinghuis |
+| [HADOOP-7786](https://issues.apache.org/jira/browse/HADOOP-7786) | Remove HDFS-specific configuration keys defined in FsConfig | Major | . | Eli Collins | Eli Collins |
+| [HADOOP-7358](https://issues.apache.org/jira/browse/HADOOP-7358) | Improve log levels when exceptions caught in RPC handler | Minor | ipc | Todd Lipcon | Todd Lipcon |
+| [HADOOP-7861](https://issues.apache.org/jira/browse/HADOOP-7861) | changes2html.pl should generate links to HADOOP, HDFS, and MAPREDUCE jiras | Major | documentation | Konstantin Shvachko | Konstantin Shvachko |
### BUG FIXES:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
|:---- |:---- | :--- |:---- |:---- |:---- |
-| [HADOOP-7697](https://issues.apache.org/jira/browse/HADOOP-7697) | Remove dependency on different version of slf4j in avro | Major | build | Konstantin Shvachko | Konstantin Shvachko |
-| [HADOOP-7663](https://issues.apache.org/jira/browse/HADOOP-7663) | TestHDFSTrash failing on 22 | Major | test | Mayank Bansal | Mayank Bansal |
-| [HADOOP-7646](https://issues.apache.org/jira/browse/HADOOP-7646) | Make hadoop-common use same version of avro as HBase | Major | io, ipc | Joep Rottinghuis | Joep Rottinghuis |
-| [HADOOP-7577](https://issues.apache.org/jira/browse/HADOOP-7577) | TT does not start due to backwards compatibility wrt. EventCounter | Minor | metrics | Joep Rottinghuis | Joep Rottinghuis |
-| [HADOOP-7568](https://issues.apache.org/jira/browse/HADOOP-7568) | SequenceFile should not print into stdout | Major | io | Konstantin Shvachko | Plamen Jeliazkov |
-| [HADOOP-7514](https://issues.apache.org/jira/browse/HADOOP-7514) | Build fails with ClassCastException when running both mvn-install and mvn-deploy targets | Minor | build | Joep Rottinghuis | Joep Rottinghuis |
-| [HADOOP-7513](https://issues.apache.org/jira/browse/HADOOP-7513) | mvn-deploy target fails | Major | build | Joep Rottinghuis | Joep Rottinghuis |
-| [HADOOP-7450](https://issues.apache.org/jira/browse/HADOOP-7450) | Bump jetty to 6.1.26 | Blocker | build | Jitendra Nath Pandey | Konstantin Boudnik |
-| [HADOOP-7390](https://issues.apache.org/jira/browse/HADOOP-7390) | VersionInfo not generated properly in git after unsplit | Minor | build | Thomas Graves | Todd Lipcon |
-| [HADOOP-7351](https://issues.apache.org/jira/browse/HADOOP-7351) | Regression: HttpServer#getWebAppsPath used to be protected so subclasses could supply alternate webapps path but it was made private by HADOOP-6461 | Major | . | stack | stack |
-| [HADOOP-7349](https://issues.apache.org/jira/browse/HADOOP-7349) | HADOOP-7121 accidentally disabled some tests | Major | ipc, test | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7318](https://issues.apache.org/jira/browse/HADOOP-7318) | MD5Hash factory should reset the digester it returns | Critical | io | Todd Lipcon | Todd Lipcon |
-| [HADOOP-7312](https://issues.apache.org/jira/browse/HADOOP-73
<TRUNCATED>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[15/51] [partial] hadoop git commit: HADOOP-14364. refresh
changelog/release notes with newer Apache Yetus build
Posted by aw...@apache.org.
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.0-alpha/RELEASENOTES.2.0.0-alpha.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.0-alpha/RELEASENOTES.2.0.0-alpha.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.0-alpha/RELEASENOTES.2.0.0-alpha.md
index 06edd6d..674a8eb 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.0-alpha/RELEASENOTES.2.0.0-alpha.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.0-alpha/RELEASENOTES.2.0.0-alpha.md
@@ -23,100 +23,100 @@ These release notes cover new developer and user-facing incompatibilities, impor
---
-* [HADOOP-8314](https://issues.apache.org/jira/browse/HADOOP-8314) | *Major* | **HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated**
+* [HDFS-395](https://issues.apache.org/jira/browse/HDFS-395) | *Major* | **DFS Scalability: Incremental block reports**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-8270](https://issues.apache.org/jira/browse/HADOOP-8270) | *Minor* | **hadoop-daemon.sh stop action should return 0 for an already stopped service**
+* [HADOOP-7524](https://issues.apache.org/jira/browse/HADOOP-7524) | *Major* | **Change RPC to allow multiple protocols including multiple versions of the same protocol**
-The daemon stop action no longer returns failure when stopping an already stopped service.
+**WARNING: No release note provided for this change.**
---
-* [HADOOP-8184](https://issues.apache.org/jira/browse/HADOOP-8184) | *Major* | **ProtoBuf RPC engine does not need it own reply packet - it can use the IPC layer reply packet.**
+* [HADOOP-7704](https://issues.apache.org/jira/browse/HADOOP-7704) | *Minor* | **JsonFactory can be created only once and used for every next request to create JsonGenerator inside JMXJsonServlet**
-This change will affect the output of errors for some Hadoop CLI commands. Specifically, the name of the exception class will no longer appear, and instead only the text of the exception message will appear.
+Reduce number of object created by JMXJsonServlet. (Devaraj K via Eric Yang)
---
-* [HADOOP-8154](https://issues.apache.org/jira/browse/HADOOP-8154) | *Major* | **DNS#getIPs shouldn't silently return the local host IP for bogus interface names**
+* [MAPREDUCE-3818](https://issues.apache.org/jira/browse/MAPREDUCE-3818) | *Blocker* | **Trunk MRV1 compilation is broken.**
-**WARNING: No release note provided for this incompatible change.**
+Fixed broken compilation in TestSubmitJob after the patch for HDFS-2895.
---
-* [HADOOP-8149](https://issues.apache.org/jira/browse/HADOOP-8149) | *Major* | **cap space usage of default log4j rolling policy**
+* [HDFS-2731](https://issues.apache.org/jira/browse/HDFS-2731) | *Major* | **HA: Autopopulate standby name dirs if they're empty**
-Hadoop log files are now rolled by size instead of date (daily) by default. Tools that depend on the log file name format will need to be updated. Users who would like to maintain the previous settings of hadoop.root.logger and hadoop.security.logger can use their current log4j.properties files and update the HADOOP\_ROOT\_LOGGER and HADOOP\_SECURITY\_LOGGER environment variables to use DRFA and DRFAS respectively.
+The HA NameNode may now be started with the "-bootstrapStandby" flag. This causes it to copy the namespace information and most recent checkpoint from its HA pair, and save it to local storage, allowing an HA setup to be bootstrapped without use of rsync or external tools.
---
-* [HADOOP-7704](https://issues.apache.org/jira/browse/HADOOP-7704) | *Minor* | **JsonFactory can be created only once and used for every next request to create JsonGenerator inside JMXJsonServlet**
+* [HDFS-2303](https://issues.apache.org/jira/browse/HDFS-2303) | *Major* | **Unbundle jsvc**
-Reduce number of object created by JMXJsonServlet. (Devaraj K via Eric Yang)
+To run secure Datanodes users must install jsvc for their platform and set JSVC\_HOME to point to the location of jsvc in their environment.
---
-* [HADOOP-7524](https://issues.apache.org/jira/browse/HADOOP-7524) | *Major* | **Change RPC to allow multiple protocols including multiple versions of the same protocol**
+* [HDFS-3044](https://issues.apache.org/jira/browse/HDFS-3044) | *Major* | **fsck move should be non-destructive by default**
-**WARNING: No release note provided for this incompatible change.**
+The fsck "move" option is no longer destructive. It copies the accessible blocks of corrupt files to lost and found as before, but no longer deletes the corrupt files after copying the blocks. The original, destructive behavior can be enabled by specifying both the "move" and "delete" options.
---
-* [HDFS-3286](https://issues.apache.org/jira/browse/HDFS-3286) | *Major* | **When the threshold value for balancer is 0(zero) ,unexpected output is displayed**
+* [HADOOP-8154](https://issues.apache.org/jira/browse/HADOOP-8154) | *Major* | **DNS#getIPs shouldn't silently return the local host IP for bogus interface names**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [HDFS-3164](https://issues.apache.org/jira/browse/HDFS-3164) | *Major* | **Move DatanodeInfo#hostName to DatanodeID**
+* [HADOOP-8184](https://issues.apache.org/jira/browse/HADOOP-8184) | *Major* | **ProtoBuf RPC engine does not need it own reply packet - it can use the IPC layer reply packet.**
-This change modifies DatanodeID, which is part of the client to server protocol, therefore clients must be upgraded with servers.
+This change will affect the output of errors for some Hadoop CLI commands. Specifically, the name of the exception class will no longer appear, and instead only the text of the exception message will appear.
---
-* [HDFS-3144](https://issues.apache.org/jira/browse/HDFS-3144) | *Major* | **Refactor DatanodeID#getName by use**
+* [HADOOP-8149](https://issues.apache.org/jira/browse/HADOOP-8149) | *Major* | **cap space usage of default log4j rolling policy**
-This change modifies DatanodeID, which is part of the client to server protocol, therefore clients must be upgraded with servers.
+Hadoop log files are now rolled by size instead of date (daily) by default. Tools that depend on the log file name format will need to be updated. Users who would like to maintain the previous settings of hadoop.root.logger and hadoop.security.logger can use their current log4j.properties files and update the HADOOP\_ROOT\_LOGGER and HADOOP\_SECURITY\_LOGGER environment variables to use DRFA and DRFAS respectively.
---
-* [HDFS-3138](https://issues.apache.org/jira/browse/HDFS-3138) | *Major* | **Move DatanodeInfo#ipcPort to DatanodeID**
+* [HDFS-3137](https://issues.apache.org/jira/browse/HDFS-3137) | *Major* | **Bump LAST\_UPGRADABLE\_LAYOUT\_VERSION to -16**
-This change modifies DatanodeID, which is part of the client to server protocol, therefore clients must be upgraded with servers.
+Upgrade from Hadoop versions earlier than 0.18 is not supported as of 2.0. To upgrade from an earlier release, first upgrade to 0.18, and then upgrade again from there.
---
-* [HDFS-3137](https://issues.apache.org/jira/browse/HDFS-3137) | *Major* | **Bump LAST\_UPGRADABLE\_LAYOUT\_VERSION to -16**
+* [HDFS-3138](https://issues.apache.org/jira/browse/HDFS-3138) | *Major* | **Move DatanodeInfo#ipcPort to DatanodeID**
-Upgrade from Hadoop versions earlier than 0.18 is not supported as of 2.0. To upgrade from an earlier release, first upgrade to 0.18, and then upgrade again from there.
+This change modifies DatanodeID, which is part of the client to server protocol, therefore clients must be upgraded with servers.
---
-* [HDFS-3094](https://issues.apache.org/jira/browse/HDFS-3094) | *Major* | **add -nonInteractive and -force option to namenode -format command**
+* [HDFS-3164](https://issues.apache.org/jira/browse/HDFS-3164) | *Major* | **Move DatanodeInfo#hostName to DatanodeID**
-The 'namenode -format' command now supports the flags '-nonInteractive' and '-force' to improve usefulness without user input.
+This change modifies DatanodeID, which is part of the client to server protocol, therefore clients must be upgraded with servers.
---
-* [HDFS-3044](https://issues.apache.org/jira/browse/HDFS-3044) | *Major* | **fsck move should be non-destructive by default**
+* [HDFS-3144](https://issues.apache.org/jira/browse/HDFS-3144) | *Major* | **Refactor DatanodeID#getName by use**
-The fsck "move" option is no longer destructive. It copies the accessible blocks of corrupt files to lost and found as before, but no longer deletes the corrupt files after copying the blocks. The original, destructive behavior can be enabled by specifying both the "move" and "delete" options.
+This change modifies DatanodeID, which is part of the client to server protocol, therefore clients must be upgraded with servers.
---
@@ -128,30 +128,30 @@ This is a new feature. It is documented in hdfs\_user\_guide.xml.
---
-* [HDFS-2731](https://issues.apache.org/jira/browse/HDFS-2731) | *Major* | **HA: Autopopulate standby name dirs if they're empty**
+* [HADOOP-8270](https://issues.apache.org/jira/browse/HADOOP-8270) | *Minor* | **hadoop-daemon.sh stop action should return 0 for an already stopped service**
-The HA NameNode may now be started with the "-bootstrapStandby" flag. This causes it to copy the namespace information and most recent checkpoint from its HA pair, and save it to local storage, allowing an HA setup to be bootstrapped without use of rsync or external tools.
+The daemon stop action no longer returns failure when stopping an already stopped service.
---
-* [HDFS-2303](https://issues.apache.org/jira/browse/HDFS-2303) | *Major* | **Unbundle jsvc**
+* [HDFS-3094](https://issues.apache.org/jira/browse/HDFS-3094) | *Major* | **add -nonInteractive and -force option to namenode -format command**
-To run secure Datanodes users must install jsvc for their platform and set JSVC\_HOME to point to the location of jsvc in their environment.
+The 'namenode -format' command now supports the flags '-nonInteractive' and '-force' to improve usefulness without user input.
---
-* [HDFS-395](https://issues.apache.org/jira/browse/HDFS-395) | *Major* | **DFS Scalability: Incremental block reports**
+* [HADOOP-8314](https://issues.apache.org/jira/browse/HADOOP-8314) | *Major* | **HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---
-* [MAPREDUCE-3818](https://issues.apache.org/jira/browse/MAPREDUCE-3818) | *Blocker* | **Trunk MRV1 compilation is broken.**
+* [HDFS-3286](https://issues.apache.org/jira/browse/HDFS-3286) | *Major* | **When the threshold value for balancer is 0(zero) ,unexpected output is displayed**
-Fixed broken compilation in TestSubmitJob after the patch for HDFS-2895.
+**WARNING: No release note provided for this change.**
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.1-alpha/CHANGES.2.0.1-alpha.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.1-alpha/CHANGES.2.0.1-alpha.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.1-alpha/CHANGES.2.0.1-alpha.md
index 4f2d9ff..23597ed 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.1-alpha/CHANGES.2.0.1-alpha.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.1-alpha/CHANGES.2.0.1-alpha.md
@@ -27,18 +27,6 @@
| [HADOOP-8552](https://issues.apache.org/jira/browse/HADOOP-8552) | Conflict: Same security.log.file for multiple users. | Major | conf, security | Karthik Kambatla | Karthik Kambatla |
-### IMPORTANT ISSUES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### NEW FEATURES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
### IMPROVEMENTS:
| JIRA | Summary | Priority | Component | Reporter | Contributor |
@@ -46,27 +34,3 @@
| [HDFS-3667](https://issues.apache.org/jira/browse/HDFS-3667) | Add retry support to WebHdfsFileSystem | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze |
-### BUG FIXES:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### TESTS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### SUB-TASKS:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
-### OTHER:
-
-| JIRA | Summary | Priority | Component | Reporter | Contributor |
-|:---- |:---- | :--- |:---- |:---- |:---- |
-
-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.1-alpha/RELEASENOTES.2.0.1-alpha.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.1-alpha/RELEASENOTES.2.0.1-alpha.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.1-alpha/RELEASENOTES.2.0.1-alpha.md
index fc34b58..a0d1d98 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.1-alpha/RELEASENOTES.2.0.1-alpha.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/2.0.1-alpha/RELEASENOTES.2.0.1-alpha.md
@@ -25,7 +25,7 @@ These release notes cover new developer and user-facing incompatibilities, impor
* [HADOOP-8552](https://issues.apache.org/jira/browse/HADOOP-8552) | *Major* | **Conflict: Same security.log.file for multiple users.**
-**WARNING: No release note provided for this incompatible change.**
+**WARNING: No release note provided for this change.**
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org