You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by tu...@apache.org on 2014/08/29 00:12:43 UTC
[2/2] git commit: Fix up CHANGES.txt for HDFS-6134,
HADOOP-10150 and related JIRAs following merge to branch-2
Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs following merge to branch-2
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-mapreduce-project/CHANGES.txt
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d9a7404c
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/d9a7404c
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/d9a7404c
Branch: refs/heads/trunk
Commit: d9a7404c389ea1adffe9c13f7178b54678577b56
Parents: 88c5e21
Author: Alejandro Abdelnur <tu...@cloudera.com>
Authored: Tue Aug 26 12:00:37 2014 -0700
Committer: Alejandro Abdelnur <tu...@apache.org>
Committed: Thu Aug 28 15:10:59 2014 -0700
----------------------------------------------------------------------
hadoop-common-project/hadoop-common/CHANGES.txt | 101 +++++-----
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt | 185 +++++++++----------
hadoop-mapreduce-project/CHANGES.txt | 23 +--
3 files changed, 155 insertions(+), 154 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/hadoop/blob/d9a7404c/hadoop-common-project/hadoop-common/CHANGES.txt
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/CHANGES.txt b/hadoop-common-project/hadoop-common/CHANGES.txt
index 2d794cf..9fb0cd3 100644
--- a/hadoop-common-project/hadoop-common/CHANGES.txt
+++ b/hadoop-common-project/hadoop-common/CHANGES.txt
@@ -328,56 +328,6 @@ Trunk (Unreleased)
HADOOP-8589. ViewFs tests fail when tests and home dirs are nested (sanjay Radia)
- BREAKDOWN OF HDFS-6134 AND HADOOP-10150 SUBTASKS AND RELATED JIRAS
-
- HADOOP-10734. Implement high-performance secure random number sources.
- (Yi Liu via Colin Patrick McCabe)
-
- HADOOP-10603. Crypto input and output streams implementing Hadoop stream
- interfaces. (Yi Liu and Charles Lamb)
-
- HADOOP-10628. Javadoc and few code style improvement for Crypto
- input and output streams. (Yi Liu via clamb)
-
- HADOOP-10632. Minor improvements to Crypto input and output streams.
- (Yi Liu)
-
- HADOOP-10635. Add a method to CryptoCodec to generate SRNs for IV. (Yi Liu)
-
- HADOOP-10653. Add a new constructor for CryptoInputStream that
- receives current position of wrapped stream. (Yi Liu)
-
- HADOOP-10662. NullPointerException in CryptoInputStream while wrapped
- stream is not ByteBufferReadable. Add tests using normal stream. (Yi Liu)
-
- HADOOP-10713. Refactor CryptoCodec#generateSecureRandom to take a byte[].
- (wang via yliu)
-
- HADOOP-10693. Implementation of AES-CTR CryptoCodec using JNI to OpenSSL.
- (Yi Liu via cmccabe)
-
- HADOOP-10803. Update OpensslCipher#getInstance to accept CipherSuite#name
- format. (Yi Liu)
-
- HADOOP-10735. Fall back AesCtrCryptoCodec implementation from OpenSSL to
- JCE if non native support. (Yi Liu)
-
- HADOOP-10870. Failed to load OpenSSL cipher error logs on systems with old
- openssl versions (cmccabe)
-
- HADOOP-10853. Refactor get instance of CryptoCodec and support create via
- algorithm/mode/padding. (Yi Liu)
-
- HADOOP-10919. Copy command should preserve raw.* namespace
- extended attributes. (clamb)
-
- HDFS-6873. Constants in CommandWithDestination should be static. (clamb)
-
- HADOOP-10871. incorrect prototype in OpensslSecureRandom.c (cmccabe)
-
- HADOOP-10886. CryptoCodec#getCodecclasses throws NPE when configurations not
- loaded. (umamahesh)
-
Release 2.6.0 - UNRELEASED
INCOMPATIBLE CHANGES
@@ -704,6 +654,57 @@ Release 2.6.0 - UNRELEASED
HADOOP-8815. RandomDatum needs to override hashCode().
(Brandon Li via suresh)
+ BREAKDOWN OF HDFS-6134 AND HADOOP-10150 SUBTASKS AND RELATED JIRAS
+
+ HADOOP-10734. Implement high-performance secure random number sources.
+ (Yi Liu via Colin Patrick McCabe)
+
+ HADOOP-10603. Crypto input and output streams implementing Hadoop stream
+ interfaces. (Yi Liu and Charles Lamb)
+
+ HADOOP-10628. Javadoc and few code style improvement for Crypto
+ input and output streams. (Yi Liu via clamb)
+
+ HADOOP-10632. Minor improvements to Crypto input and output streams.
+ (Yi Liu)
+
+ HADOOP-10635. Add a method to CryptoCodec to generate SRNs for IV. (Yi Liu)
+
+ HADOOP-10653. Add a new constructor for CryptoInputStream that
+ receives current position of wrapped stream. (Yi Liu)
+
+ HADOOP-10662. NullPointerException in CryptoInputStream while wrapped
+ stream is not ByteBufferReadable. Add tests using normal stream. (Yi Liu)
+
+ HADOOP-10713. Refactor CryptoCodec#generateSecureRandom to take a byte[].
+ (wang via yliu)
+
+ HADOOP-10693. Implementation of AES-CTR CryptoCodec using JNI to OpenSSL.
+ (Yi Liu via cmccabe)
+
+ HADOOP-10803. Update OpensslCipher#getInstance to accept CipherSuite#name
+ format. (Yi Liu)
+
+ HADOOP-10735. Fall back AesCtrCryptoCodec implementation from OpenSSL to
+ JCE if non native support. (Yi Liu)
+
+ HADOOP-10870. Failed to load OpenSSL cipher error logs on systems with old
+ openssl versions (cmccabe)
+
+ HADOOP-10853. Refactor get instance of CryptoCodec and support create via
+ algorithm/mode/padding. (Yi Liu)
+
+ HADOOP-10919. Copy command should preserve raw.* namespace
+ extended attributes. (clamb)
+
+ HDFS-6873. Constants in CommandWithDestination should be static. (clamb)
+
+ HADOOP-10871. incorrect prototype in OpensslSecureRandom.c (cmccabe)
+
+ HADOOP-10886. CryptoCodec#getCodecclasses throws NPE when configurations not
+ loaded. (umamahesh)
+ --
+
Release 2.5.1 - UNRELEASED
INCOMPATIBLE CHANGES
http://git-wip-us.apache.org/repos/asf/hadoop/blob/d9a7404c/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
----------------------------------------------------------------------
diff --git a/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
index 1bb6025..2c56407 100644
--- a/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
+++ b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
@@ -255,99 +255,6 @@ Trunk (Unreleased)
HDFS-6657. Remove link to 'Legacy UI' in trunk's Namenode UI.
(Vinayakumar B via wheat 9)
- BREAKDOWN OF HDFS-6134 AND HADOOP-10150 SUBTASKS AND RELATED JIRAS
-
- HDFS-6387. HDFS CLI admin tool for creating & deleting an
- encryption zone. (clamb)
-
- HDFS-6386. HDFS Encryption Zones (clamb)
-
- HDFS-6388. HDFS integration with KeyProvider. (clamb)
-
- HDFS-6473. Protocol and API for Encryption Zones (clamb)
-
- HDFS-6392. Wire crypto streams for encrypted files in
- DFSClient. (clamb and yliu)
-
- HDFS-6476. Print out the KeyProvider after finding KP successfully on
- startup. (Juan Yu via wang)
-
- HDFS-6391. Get the Key/IV from the NameNode for encrypted files in
- DFSClient. (Charles Lamb and wang)
-
- HDFS-6389. Rename restrictions for encryption zones. (clamb)
-
- HDFS-6605. Client server negotiation of cipher suite. (wang)
-
- HDFS-6625. Remove the Delete Encryption Zone function (clamb)
-
- HDFS-6516. List of Encryption Zones should be based on inodes (clamb)
-
- HDFS-6629. Not able to create symlinks after HDFS-6516 (umamaheswararao)
-
- HDFS-6635. Refactor encryption zone functionality into new
- EncryptionZoneManager class. (wang)
-
- HDFS-6474. Namenode needs to get the actual keys and iv from the
- KeyProvider. (wang)
-
- HDFS-6619. Clean up encryption-related tests. (wang)
-
- HDFS-6405. Test Crypto streams in HDFS. (yliu via wang)
-
- HDFS-6490. Fix the keyid format for generated keys in
- FSNamesystem.createEncryptionZone (clamb)
-
- HDFS-6716. Update usage of KeyProviderCryptoExtension APIs on NameNode.
- (wang)
-
- HDFS-6718. Remove EncryptionZoneManager lock. (wang)
-
- HDFS-6720. Remove KeyProvider in EncryptionZoneManager. (wang)
-
- HDFS-6738. Remove unnecessary getEncryptionZoneForPath call in
- EZManager#createEncryptionZone. (clamb)
-
- HDFS-6724. Decrypt EDEK before creating
- CryptoInputStream/CryptoOutputStream. (wang)
-
- HDFS-6509. Create a special /.reserved/raw directory for raw access to
- encrypted data. (clamb via wang)
-
- HDFS-6771. Require specification of an encryption key when creating
- an encryption zone. (wang)
-
- HDFS-6730. Create a .RAW extended attribute namespace. (clamb)
-
- HDFS-6692. Add more HDFS encryption tests. (wang)
-
- HDFS-6780. Batch the encryption zones listing API. (wang)
-
- HDFS-6394. HDFS encryption documentation. (wang)
-
- HDFS-6834. Improve the configuration guidance in DFSClient when there
- are no Codec classes found in configs. (umamahesh)
-
- HDFS-6546. Add non-superuser capability to get the encryption zone
- for a specific path. (clamb)
-
- HDFS-6733. Creating encryption zone results in NPE when
- KeyProvider is null. (clamb)
-
- HDFS-6785. Should not be able to create encryption zone using path
- to a non-directory file. (clamb)
-
- HDFS-6807. Fix TestReservedRawPaths. (clamb)
-
- HDFS-6814. Mistakenly dfs.namenode.list.encryption.zones.num.responses configured
- as boolean. (umamahesh)
-
- HDFS-6817. Fix findbugs and other warnings. (yliu)
-
- HDFS-6839. Fix TestCLI to expect new output. (clamb)
-
- HDFS-6905. fs-encryption merge triggered release audit failures. (clamb via tucu)
-
HDFS-6694. TestPipelinesFailover.testPipelineRecoveryStress tests fail
intermittently with various symptoms - debugging patch. (Yongjun Zhang via
Arpit Agarwal)
@@ -661,6 +568,98 @@ Release 2.6.0 - UNRELEASED
HDFS-6902. FileWriter should be closed in finally block in
BlockReceiver#receiveBlock() (Tsuyoshi OZAWA via Colin Patrick McCabe)
+ BREAKDOWN OF HDFS-6134 AND HADOOP-10150 SUBTASKS AND RELATED JIRAS
+
+ HDFS-6387. HDFS CLI admin tool for creating & deleting an
+ encryption zone. (clamb)
+
+ HDFS-6386. HDFS Encryption Zones (clamb)
+
+ HDFS-6388. HDFS integration with KeyProvider. (clamb)
+
+ HDFS-6473. Protocol and API for Encryption Zones (clamb)
+
+ HDFS-6392. Wire crypto streams for encrypted files in
+ DFSClient. (clamb and yliu)
+
+ HDFS-6476. Print out the KeyProvider after finding KP successfully on
+ startup. (Juan Yu via wang)
+
+ HDFS-6391. Get the Key/IV from the NameNode for encrypted files in
+ DFSClient. (Charles Lamb and wang)
+
+ HDFS-6389. Rename restrictions for encryption zones. (clamb)
+
+ HDFS-6605. Client server negotiation of cipher suite. (wang)
+
+ HDFS-6625. Remove the Delete Encryption Zone function (clamb)
+
+ HDFS-6516. List of Encryption Zones should be based on inodes (clamb)
+
+ HDFS-6629. Not able to create symlinks after HDFS-6516 (umamaheswararao)
+
+ HDFS-6635. Refactor encryption zone functionality into new
+ EncryptionZoneManager class. (wang)
+
+ HDFS-6474. Namenode needs to get the actual keys and iv from the
+ KeyProvider. (wang)
+
+ HDFS-6619. Clean up encryption-related tests. (wang)
+
+ HDFS-6405. Test Crypto streams in HDFS. (yliu via wang)
+
+ HDFS-6490. Fix the keyid format for generated keys in
+ FSNamesystem.createEncryptionZone (clamb)
+
+ HDFS-6716. Update usage of KeyProviderCryptoExtension APIs on NameNode.
+ (wang)
+
+ HDFS-6718. Remove EncryptionZoneManager lock. (wang)
+
+ HDFS-6720. Remove KeyProvider in EncryptionZoneManager. (wang)
+
+ HDFS-6738. Remove unnecessary getEncryptionZoneForPath call in
+ EZManager#createEncryptionZone. (clamb)
+
+ HDFS-6724. Decrypt EDEK before creating
+ CryptoInputStream/CryptoOutputStream. (wang)
+
+ HDFS-6509. Create a special /.reserved/raw directory for raw access to
+ encrypted data. (clamb via wang)
+
+ HDFS-6771. Require specification of an encryption key when creating
+ an encryption zone. (wang)
+
+ HDFS-6730. Create a .RAW extended attribute namespace. (clamb)
+
+ HDFS-6692. Add more HDFS encryption tests. (wang)
+
+ HDFS-6780. Batch the encryption zones listing API. (wang)
+
+ HDFS-6394. HDFS encryption documentation. (wang)
+
+ HDFS-6834. Improve the configuration guidance in DFSClient when there
+ are no Codec classes found in configs. (umamahesh)
+
+ HDFS-6546. Add non-superuser capability to get the encryption zone
+ for a specific path. (clamb)
+
+ HDFS-6733. Creating encryption zone results in NPE when
+ KeyProvider is null. (clamb)
+
+ HDFS-6785. Should not be able to create encryption zone using path
+ to a non-directory file. (clamb)
+
+ HDFS-6807. Fix TestReservedRawPaths. (clamb)
+
+ HDFS-6814. Mistakenly dfs.namenode.list.encryption.zones.num.responses configured
+ as boolean. (umamahesh)
+
+ HDFS-6817. Fix findbugs and other warnings. (yliu)
+
+ HDFS-6839. Fix TestCLI to expect new output. (clamb)
+ --
+
Release 2.5.1 - UNRELEASED
INCOMPATIBLE CHANGES
http://git-wip-us.apache.org/repos/asf/hadoop/blob/d9a7404c/hadoop-mapreduce-project/CHANGES.txt
----------------------------------------------------------------------
diff --git a/hadoop-mapreduce-project/CHANGES.txt b/hadoop-mapreduce-project/CHANGES.txt
index de0767d..c0038f6 100644
--- a/hadoop-mapreduce-project/CHANGES.txt
+++ b/hadoop-mapreduce-project/CHANGES.txt
@@ -154,16 +154,6 @@ Trunk (Unreleased)
MAPREDUCE-5867. Fix NPE in KillAMPreemptionPolicy related to
ProportionalCapacityPreemptionPolicy (Sunil G via devaraj)
- BREAKDOWN OF HDFS-6134 AND HADOOP-10150 SUBTASKS AND RELATED JIRAS
-
- MAPREDUCE-5890. Support for encrypting Intermediate
- data and spills in local filesystem. (asuresh via tucu)
-
- MAPREDUCE-6007. Add support to distcp to preserve raw.* namespace
- extended attributes. (clamb)
-
- MAPREDUCE-6041. Fix TestOptionsParser. (clamb)
-
Release 2.6.0 - UNRELEASED
INCOMPATIBLE CHANGES
@@ -261,6 +251,17 @@ Release 2.6.0 - UNRELEASED
MAPREDUCE-5885. build/test/test.mapred.spill causes release audit warnings
(Chen He via jlowe)
+ BREAKDOWN OF HDFS-6134 AND HADOOP-10150 SUBTASKS AND RELATED JIRAS
+
+ MAPREDUCE-5890. Support for encrypting Intermediate
+ data and spills in local filesystem. (asuresh via tucu)
+
+ MAPREDUCE-6007. Add support to distcp to preserve raw.* namespace
+ extended attributes. (clamb)
+
+ MAPREDUCE-6041. Fix TestOptionsParser. (clamb)
+ --
+
Release 2.5.1 - UNRELEASED
INCOMPATIBLE CHANGES
@@ -273,7 +274,7 @@ Release 2.5.1 - UNRELEASED
BUG FIXES
- MAPREDUCE-6033. Updated access check for displaying job information
+ MAPREDUCE-6033. Updated access check for displaying job information
(Yu Gao via Eric Yang)
Release 2.5.0 - 2014-08-11