You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by wa...@apache.org on 2017/06/01 23:02:44 UTC
svn commit: r1797304 [3/3] - in
/hadoop/common/site/main/publish/docs/r3.0.0-alpha3/hadoop-project-dist/hadoop-common/release/3.0.0-alpha3:
CHANGES.3.0.0-alpha3.html RELEASENOTES.3.0.0-alpha3.html
Modified: hadoop/common/site/main/publish/docs/r3.0.0-alpha3/hadoop-project-dist/hadoop-common/release/3.0.0-alpha3/RELEASENOTES.3.0.0-alpha3.html
URL: http://svn.apache.org/viewvc/hadoop/common/site/main/publish/docs/r3.0.0-alpha3/hadoop-project-dist/hadoop-common/release/3.0.0-alpha3/RELEASENOTES.3.0.0-alpha3.html?rev=1797304&r1=1797303&r2=1797304&view=diff
==============================================================================
--- hadoop/common/site/main/publish/docs/r3.0.0-alpha3/hadoop-project-dist/hadoop-common/release/3.0.0-alpha3/RELEASENOTES.3.0.0-alpha3.html (original)
+++ hadoop/common/site/main/publish/docs/r3.0.0-alpha3/hadoop-project-dist/hadoop-common/release/3.0.0-alpha3/RELEASENOTES.3.0.0-alpha3.html Thu Jun 1 23:02:44 2017
@@ -1,6 +1,6 @@
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<!--
- | Generated by Apache Maven Doxia at 2017-05-25
+ | Generated by Apache Maven Doxia at 2017-05-23
| Rendered using Apache Maven Stylus Skin 1.5
-->
<html xmlns="http://www.w3.org/1999/xhtml">
@@ -12,7 +12,7 @@
@import url("../../css/site.css");
</style>
<link rel="stylesheet" href="../../css/print.css" type="text/css" media="print" />
- <meta name="Date-Revision-yyyymmdd" content="20170525" />
+ <meta name="Date-Revision-yyyymmdd" content="20170523" />
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
</head>
<body class="composite">
@@ -46,7 +46,7 @@
|
<a href="http://hadoop.apache.org/" class="externalLink">Apache Hadoop</a>
- | Last Published: 2017-05-25
+ | Last Published: 2017-05-23
| Version: 3.0.0-alpha3
</div>
<div class="clear">
@@ -428,551 +428,6 @@
--><h1>“Apache Hadoop” 3.0.0-alpha3 Release Notes</h1>
<p>These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements.</p>
<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-13956">HADOOP-13956</a> | <i>Critical</i> | <b>Read ADLS credentials from Credential Provider</b></li>
-</ul>
-<p>The hadoop-azure-datalake file system now supports configuration of the Azure Data Lake Store account credentials using the standard Hadoop Credential Provider API. For details, please refer to the documentation on hadoop-azure-datalake and the Credential Provider API.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6404">MAPREDUCE-6404</a> | <i>Major</i> | <b>Allow AM to specify a port range for starting its webapp</b></li>
-</ul>
-<p>Add a new configuration - “yarn.app.mapreduce.am.webapp.port-range” to specify port-range for webapp launched by AM.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-10860">HDFS-10860</a> | <i>Blocker</i> | <b>Switch HttpFS from Tomcat to Jetty</b></li>
-</ul>
-<!-- markdown -->
-<p>The following environment variables are deprecated. Set the corresponding configuration properties instead.</p>
-
-<table border="0" class="bodyTable">
- <thead>
-
-<tr class="a">
-
-<th>Environment Variable </th>
-
-<th>Configuration Property </th>
-
-<th>Configuration File</th>
- </tr>
- </thead>
- <tbody>
-
-<tr class="b">
-
-<td>HTTPFS_TEMP </td>
-
-<td>hadoop.http.temp.dir </td>
-
-<td>httpfs-site.xml</td>
- </tr>
-
-<tr class="a">
-
-<td>HTTPFS_HTTP_PORT </td>
-
-<td>hadoop.httpfs.http.port </td>
-
-<td>httpfs-site.xml</td>
- </tr>
-
-<tr class="b">
-
-<td>HTTPFS_MAX_HTTP_HEADER_SIZE </td>
-
-<td>hadoop.http.max.request.header.size and hadoop.http.max.response.header.size </td>
-
-<td>httpfs-site.xml</td>
- </tr>
-
-<tr class="a">
-
-<td>HTTPFS_MAX_THREADS </td>
-
-<td>hadoop.http.max.threads </td>
-
-<td>httpfs-site.xml</td>
- </tr>
-
-<tr class="b">
-
-<td>HTTPFS_SSL_ENABLED </td>
-
-<td>hadoop.httpfs.ssl.enabled </td>
-
-<td>httpfs-site.xml</td>
- </tr>
-
-<tr class="a">
-
-<td>HTTPFS_SSL_KEYSTORE_FILE </td>
-
-<td>ssl.server.keystore.location </td>
-
-<td>ssl-server.xml</td>
- </tr>
-
-<tr class="b">
-
-<td>HTTPFS_SSL_KEYSTORE_PASS </td>
-
-<td>ssl.server.keystore.password </td>
-
-<td>ssl-server.xml</td>
- </tr>
- </tbody>
-</table>
-<p>These default HTTP Services have been added.</p>
-
-<table border="0" class="bodyTable">
- <thead>
-
-<tr class="a">
-
-<th>Name </th>
-
-<th>Description</th>
- </tr>
- </thead>
- <tbody>
-
-<tr class="b">
-
-<td>/conf </td>
-
-<td>Display configuration properties</td>
- </tr>
-
-<tr class="a">
-
-<td>/jmx </td>
-
-<td>Java JMX management interface</td>
- </tr>
-
-<tr class="b">
-
-<td>/logLevel </td>
-
-<td>Get or set log level per class</td>
- </tr>
-
-<tr class="a">
-
-<td>/logs </td>
-
-<td>Display log files</td>
- </tr>
-
-<tr class="b">
-
-<td>/stacks </td>
-
-<td>Display JVM stacks</td>
- </tr>
-
-<tr class="a">
-
-<td>/static/index.html </td>
-
-<td>The static home page</td>
- </tr>
- </tbody>
-</table>
-<p>Script httpfs.sh has been deprecated, use <tt>hdfs httpfs</tt> instead. The new scripts are based on the Hadoop shell scripting framework. <tt>hadoop daemonlog</tt> is supported. SSL configurations are read from ssl-server.xml.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11210">HDFS-11210</a> | <i>Major</i> | <b>Enhance key rolling to guarantee new KeyVersion is returned from generateEncryptedKeys after a key is rolled</b></li>
-</ul>
-<!-- markdown -->
-<p>An <tt>invalidateCache</tt> command has been added to the KMS. The <tt>rollNewVersion</tt> semantics of the KMS has been improved so that after a key’s version is rolled, <tt>generateEncryptedKey</tt> of that key guarantees to return the <tt>EncryptedKeyVersion</tt> based on the new key version.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-13075">HADOOP-13075</a> | <i>Major</i> | <b>Add support for SSE-KMS and SSE-C in s3a filesystem</b></li>
-</ul>
-<p>The new encryption options SSE-KMS and especially SSE-C must be considered experimental at present. If you are using SSE-C, problems may arise if the bucket mixes encrypted and unencrypted files. For SSE-KMS, there may be extra throttling of IO, especially with the fadvise=random option. You may wish to request an increase in your KMS IOPs limits.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11026">HDFS-11026</a> | <i>Major</i> | <b>Convert BlockTokenIdentifier to use Protobuf</b></li>
-</ul>
-<p>Changed the serialized format of BlockTokenIdentifier to protocol buffers. Includes logic to decode both the old Writable format and the new PB format to support existing clients. Client implementations in other languages will require similar functionality.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-13929">HADOOP-13929</a> | <i>Major</i> | <b>ADLS connector should not check in contract-test-options.xml</b></li>
-</ul>
-<p>To run live unit tests, create src/test/resources/auth-keys.xml with the same properties as in the deprecated contract-test-options.xml.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11100">HDFS-11100</a> | <i>Critical</i> | <b>Recursively deleting file protected by sticky bit should fail</b></li>
-</ul>
-<p>Changed the behavior of removing directories with sticky bits, so that it is closer to what most Unix/Linux users would expect.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-6177">YARN-6177</a> | <i>Major</i> | <b>Yarn client should exit with an informative error message if an incompatible Jersey library is used at client</b></li>
-</ul>
-<p>Let yarn client exit with an informative error message if an incompatible Jersey library is used from client side.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-13805">HADOOP-13805</a> | <i>Major</i> | <b>UGI.getCurrentUser() fails if user does not have a keytab associated</b></li>
-</ul>
-<p>Due to a remaining issue after HADOOP-13558, an UGI may still try to renew the TGT even though the UGI is created from an existing Subject. The renewal would fail because of non-existing keytab. </p>
-<p>Fixing the issue means different behavior which is incompatible, however, configuration property “hadoop.treat.subject.external” is introduced to enable the fix (disabled by default). The behavior is the same as before when the fix is not enabled.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11405">HDFS-11405</a> | <i>Blocker</i> | <b>Rename “erasurecode” CLI subcommand to “ec”</b></li>
-</ul>
-<p>The “hdfs erasurecode” CLI command has been renamed to “hdfs ec” for ease-of-use.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11426">HDFS-11426</a> | <i>Major</i> | <b>Refactor EC CLI to be similar to storage policies CLI</b></li>
-</ul>
-<p>The <tt>hdfs ec</tt> CLI command has been substantially reworked to make the calling patterns more similar to the <tt>hdfs storagepolicies</tt> command. See <tt>hdfs ec -help</tt> and the HDFS erasure coding documentation for more information.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-13817">HADOOP-13817</a> | <i>Minor</i> | <b>Add a finite shell command timeout to ShellBasedUnixGroupsMapping</b></li>
-</ul>
-<p>A new introduced configuration key “hadoop.security.groups.shell.command.timeout” allows applying a finite wait timeout over the ‘id’ commands launched by the ShellBasedUnixGroupsMapping plugin. Values specified can be in any valid time duration units: <a class="externalLink" href="https://hadoop.apache.org/docs/current/api/org/apache/hadoop/conf/Configuration.html#getTimeDuration-java.lang.String-long-java.util.concurrent.TimeUnit-">https://hadoop.apache.org/docs/current/api/org/apache/hadoop/conf/Configuration.html#getTimeDuration-java.lang.String-long-java.util.concurrent.TimeUnit-</a></p>
-<p>Value defaults to 0, indicating infinite wait (preserving existing behaviour).</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11427">HDFS-11427</a> | <i>Major</i> | <b>Rename “rs-default” to “rs”</b></li>
-</ul>
-<p>The “rs-default” codec has been renamed to simply “rs” for simplicity. Previous configuration keys like “io.erasurecode.codec.rs-default” have also been renamed to match.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11382">HDFS-11382</a> | <i>Major</i> | <b>Persist Erasure Coding Policy ID in a new optional field in INodeFile in FSImage</b></li>
-</ul>
-<p>The FSImage on-disk format for INodeFile is changed to additionally include a field for Erasure Coded files. This optional field ‘erasureCodingPolicyID’ which is unit32 type is available for all Erasure Coded files and represents the Erasure Coding Policy ID. Previously, the ‘replication’ field in INodeFile disk format was overloaded to represent the same Erasure Coding Policy ID.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11428">HDFS-11428</a> | <i>Major</i> | <b>Change setErasureCodingPolicy to take a required string EC policy name</b></li>
-</ul>
-<p>{{HdfsAdmin#setErasureCodingPolicy}} now takes a String {{ecPolicyName}} rather than an ErasureCodingPolicy object. The corresponding RPC’s wire format has also been modified.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-14138">HADOOP-14138</a> | <i>Critical</i> | <b>Remove S3A ref from META-INF service discovery, rely on existing core-default entry</b></li>
-</ul>
-<p>The classpath implementing the s3a filesystem is now defined in core-default.xml. Attempting to instantiate an S3A filesystem instance using a Configuration instance which has not included the default resorts will fail. Applications should not be doing this anyway, as it will lose other critical configuration options needed by the filesystem.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-6801">HADOOP-6801</a> | <i>Minor</i> | <b>io.sort.mb and io.sort.factor were renamed and moved to mapreduce but are still in CommonConfigurationKeysPublic.java and used in SequenceFile.java</b></li>
-</ul>
-<p>Two new configuration keys, seq.io.sort.mb and seq.io.sort.factor have been introduced for the SequenceFile’s Sorter feature to replace older, deprecated property keys of io.sort.mb and io.sort.factor.</p>
-<p>This only affects direct users of the org.apache.hadoop.io.SequenceFile.Sorter Java class. For controlling MR2’s internal sorting instead, use the existing config keys of mapreduce.task.io.sort.mb and mapreduce.task.io.sort.factor.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8112">HDFS-8112</a> | <i>Blocker</i> | <b>Relax permission checking for EC related operations</b></li>
-</ul>
-<p>The HdfsAdmin erasure coding APIs (set, unset, get) are now usable by non-superusers based on appropriate file and directory permissions.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11498">HDFS-11498</a> | <i>Major</i> | <b>Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0</b></li>
-</ul>
-<p>This JIRA sets the Netty 4 dependency to 4.0.23. This is an incompatible change for the 3.0 release line, as 3.0.0-alpha1 and 3.0.0-alpha2 depended on Netty 4.1.0.Beta5.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11152">HDFS-11152</a> | <i>Blocker</i> | <b>Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors</b></li>
-</ul>
-<p>The NameNode metadata for storing erasure coding policies has changed.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11314">HDFS-11314</a> | <i>Blocker</i> | <b>Enforce set of enabled EC policies on the NameNode</b></li>
-</ul>
-<p>HDFS will now restrict the set of erasure coding policies that can be set by users. The set of allowed policies can be configured via “dfs.namenode.ec.policies.enabled” on the NameNode. Please see the documentation for more details.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11499">HDFS-11499</a> | <i>Major</i> | <b>Decommissioning stuck because of failing recovery</b></li>
-</ul>
-<p>Allow a block to complete if the number of replicas on live nodes, decommissioning nodes and nodes in maintenance mode satisfies minimum replication factor. The fix prevents block recovery failure if replica of last block is being decommissioned. Vice versa, the decommissioning will be stuck, waiting for the last block to be completed. In addition, file close() operation will not fail due to last block being decommissioned.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11505">HDFS-11505</a> | <i>Major</i> | <b>Do not enable any erasure coding policies by default</b></li>
-</ul>
-<p>By default, none of the built-in erasure coding policies are enabled. Users have to explicitly enable the erasure coding policy via the hdfs configuration ‘dfs.namenode.ec.policies.enabled’ before setting the policy on any directories.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-14213">HADOOP-14213</a> | <i>Major</i> | <b>Move Configuration runtime check for hadoop-site.xml to initialization</b></li>
-</ul>
-<p>Move the check for hadoop-site.xml to static initialization of the Configuration class.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-10101">HADOOP-10101</a> | <i>Major</i> | <b>Update guava dependency to the latest version</b></li>
-</ul>
-<p>Guava is updated to version 21.0. </p>
-<p>In the background of merging this patch into trunk, there is a work, shaded Hadoop client artifacts and minicluster, on HADOOP-11804. hadoop-client has its own Guava which is shaded, so we can update dependency with minimum effect compare to previous HADOOP-11804. </p>
-<p>See also HADOOP-14238 as related problem.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-14038">HADOOP-14038</a> | <i>Minor</i> | <b>Rename ADLS credential properties</b></li>
-</ul>
-<!-- markdown -->
-
-<ul>
-
-<li>Properties {{dfs.adls.<i>}} are renamed {{fs.adl.</i>}}</li>
-
-<li>Property {{adl.dfs.enable.client.latency.tracker}} is renamed {{adl.enable.client.latency.tracker}}</li>
-
-<li>Old properties are still supported</li>
-</ul>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-14267">HADOOP-14267</a> | <i>Major</i> | <b>Make DistCpOptions class immutable</b></li>
-</ul>
-<p>DistCpOptions has been changed to be constructed with a Builder pattern. This potentially affects applications that invoke DistCp with the Java API.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11596">HDFS-11596</a> | <i>Critical</i> | <b>hadoop-hdfs-client jar is in the wrong directory in release tarball</b></li>
-</ul>
-<p>The scope of hadoop-hdfs’s dependency on hadoop-hdfs-client has changed from “compile” to “provided”. This may affect users who directly consume hadoop-hdfs, which is a private API. These users need to add a new dependency on hadoop-hdfs-client, or better yet, switch from hadoop-hdfs to hadoop-hdfs-client.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-14202">HADOOP-14202</a> | <i>Major</i> | <b>fix jsvc/secure user var inconsistencies</b></li>
-</ul>
-<!-- markdown -->
-<p>The secure user variables have been changed to be consistent with the rest of the environment variable changes:</p>
-
-<table border="0" class="bodyTable">
- <thead>
-
-<tr class="a">
-
-<th align="left">Old </th>
-
-<th align="left">New </th>
- </tr>
- </thead>
- <tbody>
-
-<tr class="b">
-
-<td align="left">HADOOP_SECURE_DN_USER </td>
-
-<td align="left">HDFS_DATANODE_SECURE_USER </td>
- </tr>
-
-<tr class="a">
-
-<td align="left">HADOO\P_PRIVILEGED_NFS_USER </td>
-
-<td align="left">HDFS_NFS3_SECURE_USER </td>
- </tr>
- </tbody>
-</table>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-14174">HADOOP-14174</a> | <i>Major</i> | <b>Set default ADLS access token provider type to ClientCredential</b></li>
-</ul>
-<p>Switch the default ADLS access token provider type from Custom to ClientCredential.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-6298">YARN-6298</a> | <i>Blocker</i> | <b>Metric preemptCall is not used in new preemption</b></li>
-</ul>
-<p>Metric preemptCall in FSOpDurations is no longer supported.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-14285">HADOOP-14285</a> | <i>Major</i> | <b>Update minimum version of Maven from 3.0 to 3.3</b></li>
-</ul>
-<p>Minimum version of Apache Maven has been updated from 3.0 to 3.3.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-14225">HADOOP-14225</a> | <i>Minor</i> | <b>Remove xmlenc dependency</b></li>
-</ul>
-<p>xmlenc dependency has been removed. If you rely on the transitive dependency, you need to set the dependency explicitly in your code after this change.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-13665">HADOOP-13665</a> | <i>Blocker</i> | <b>Erasure Coding codec should support fallback coder</b></li>
-</ul>
-<p>Use configuration properties io.erasurecode.codec.{rs-legacy,rs,xor}.rawcoders to control erasure coding codec. These properties support codec fallback in case the previous codec is not loaded.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-14248">HADOOP-14248</a> | <i>Major</i> | <b>Retire SharedInstanceProfileCredentialsProvider in trunk.</b></li>
-</ul>
-<p>SharedInstanceProfileCredentialsProvider is removed after this change. Users should use InstanceProfileCredentialsProvider provided by AWS SDK instead, which itself enforces a singleton instance to reduce calls to AWS EC2 Instance Metadata Service.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11565">HDFS-11565</a> | <i>Blocker</i> | <b>Use compact identifiers for built-in ECPolicies in HdfsFileStatus</b></li>
-</ul>
-<p>Some of the existing fields in ErasureCodingPolicyProto have changed from required to optional. For system EC policies, these fields are populated from hardcoded values.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-11794">HADOOP-11794</a> | <i>Major</i> | <b>Enable distcp to copy blocks in parallel</b></li>
-</ul>
-<p>If a positive value is passed to command line switch -blocksperchunk, files with more blocks than this value will be split into chunks of <tt>\<blocksperchunk\></tt> blocks to be transferred in parallel, and reassembled on the destination. By default, <tt>\<blocksperchunk\></tt> is 0 and the files will be transmitted in their entirety without splitting. This switch is only applicable when both the source file system supports getBlockLocations and target supports concat.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3427">YARN-3427</a> | <i>Blocker</i> | <b>Remove deprecated methods from ResourceCalculatorProcessTree</b></li>
-</ul>
-<p>The deprecated ProcessTree methods getCumulativeVmem and getCumulativeRssmem have been removed.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11402">HDFS-11402</a> | <i>Major</i> | <b>HDFS Snapshots should capture point-in-time copies of OPEN files</b></li>
-</ul>
-<p><b>WARNING: No release note provided for this change.</b></p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-6708">HDFS-6708</a> | <i>Major</i> | <b>StorageType should be encoded in the block token</b></li>
-</ul>
-<p>StorageTypes are now encoded in the BlockTokenIdentifier to ensure that the intended StorageType for writes is not tampered with on it’s way through the Client to the Datanode.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-10105">HADOOP-10105</a> | <i>Blocker</i> | <b>remove httpclient dependency</b></li>
-</ul>
-<p>Apache Httpclient has been removed as a dependency. This library is End of Life: people using it should move to its {{httpcore}} successor. If you cannot do that, you must add an explicit dependency on {{httpclient}} in your classpath.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-13200">HADOOP-13200</a> | <i>Blocker</i> | <b>Implement customizable and configurable erasure coders</b></li>
-</ul>
-<p>CodecRegistry uses ServiceLoader to dynamically load all implementations of RawErasureCoderFactory. In Hadoop 3.0, there are several built-in implementations, and user can also provide self-defined implementations with the corresponding resource files. For each codec, user can configure the order of the implementations with the configuration keys: <tt>io.erasurecode.codec.rs.rawcoders</tt> for the default RS codec, <tt>io.erasurecode.codec.rs-legacy.rawcoders</tt> for the legacy RS codec, <tt>io.erasurecode.codec.xor.rawcoders</tt> for the XOR codec. User can also configure self-defined codec with the configuration key like: <tt>io.erasurecode.codec.self-defined.rawcoders</tt>. For each codec, Hadoop will use the implementation according to the order configured. If the former implementation fails, it will fall back to call the latter one. The order is defined by a list of coder names separated by commas. The names for the built-in implementations are: <tt>rs\_native</tt> and <tt>
rs\_java</tt> for the default RS codec, of which the former is a native implementation which leverages Intel ISA-L library, which is the default implementation and the latter is the implementation in pure Java, <tt>rs-legacy\_java</tt> for the legacy RS codec, which is the default implementation in pure Java, <tt>xor\_native</tt> and <tt>xor\_java</tt> for the XOR codec, of which the former is the Intel ISA-L implementation which is the default one and the latter in pure Java.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-2962">YARN-2962</a> | <i>Critical</i> | <b>ZKRMStateStore: Limit the number of znodes under a znode</b></li>
-</ul>
-<p><b>WARNING: No release note provided for this change.</b></p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-14386">HADOOP-14386</a> | <i>Blocker</i> | <b>Rewind trunk from Guava 21.0 back to Guava 11.0.2</b></li>
-</ul>
-<p>YARN application tags can no longer contain non-printable ASCII characters.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11515">HDFS-11515</a> | <i>Major</i> | <b>-du throws ConcurrentModificationException</b></li>
-</ul>
-<p>In case a directory with subdirectories were removed from a directory that has a snapshot containing the removed subdirectory, hdfs dfs -du on any ancestor of the removed directories ran into a ConcurrentModificationException, and failed.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-14401">HADOOP-14401</a> | <i>Major</i> | <b>maven-project-info-reports-plugin can be removed</b></li>
-</ul>
-<p>hadoop-auth and hadoop-hdfs-httpfs modules no longer generate dependencies.html via maven-project-info-reports-plugin.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-14375">HADOOP-14375</a> | <i>Minor</i> | <b>Remove tomcat support from hadoop-functions.sh</b></li>
-</ul>
-<p>This change removes the support in the shell scripts for Tomcat that was added in 3.0.0-alpha1.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-14419">HADOOP-14419</a> | <i>Minor</i> | <b>Remove findbugs report from docs profile</b></li>
-</ul>
-<p>Findbugs report is no longer part of the documentation.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-14407">HADOOP-14407</a> | <i>Major</i> | <b>DistCp - Introduce a configurable copy buffer size</b></li>
-</ul>
-<p>The copy buffer size can be configured via the new parameter <copybuffersize>. By default the <copybuffersize> is set to 8KB.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11661">HDFS-11661</a> | <i>Blocker</i> | <b>GetContentSummary uses excessive amounts of memory</b></li>
-</ul>
-<p>Reverted HDFS-10797 to fix a scalability regression brought by the commit.</p>
-<hr />
-
-<ul>
-
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11787">HDFS-11787</a> | <i>Major</i> | <b>After HDFS-11515, -du still throws ConcurrentModificationException</b></li>
-</ul>
-<p>Reverted HDFS-11515.</p>
</div>
</div>
<div class="clear">
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org