You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-commits@hadoop.apache.org by sz...@apache.org on 2011/10/27 01:49:46 UTC
svn commit: r1189541 -
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
Author: szetszwo
Date: Wed Oct 26 23:49:45 2011
New Revision: 1189541
URL: http://svn.apache.org/viewvc?rev=1189541&view=rev
Log:
Move webhdfs entries from trunk to 0.23 in CHANGES.txt.
Modified:
hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
Modified: hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt?rev=1189541&r1=1189540&r2=1189541&view=diff
==============================================================================
--- hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt (original)
+++ hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt Wed Oct 26 23:49:45 2011
@@ -5,23 +5,6 @@ Trunk (unreleased changes)
HDFS-395. DFS Scalability: Incremental block reports. (Tomasz Nykiel
via hairong)
- HDFS-2284. Add a new FileSystem, webhdfs://, for supporting write Http
- access to HDFS. (szetszwo)
-
- HDFS-2317. Support read access to HDFS in webhdfs. (szetszwo)
-
- HDFS-2338. Add configuration option to enable/disable webhdfs.
- (jitendra via szetszwo)
-
- HDFS-2318. Provide authentication to webhdfs using SPNEGO and delegation
- tokens. (szetszwo)
-
- HDFS-2340. Support getFileBlockLocations and getDelegationToken in webhdfs.
- (szetszwo)
-
- HDFS-2348. Support getContentSummary and getFileChecksum in webhdfs.
- (szetszwo)
-
IMPROVEMENTS
HADOOP-7524 Change RPC to allow multiple protocols including multuple
@@ -45,12 +28,6 @@ Trunk (unreleased changes)
HDFS-2351 Change Namenode and Datanode to register each of their protocols
seperately. (Sanjay Radia)
- HDFS-2356. Support case insensitive query parameter names in webhdfs.
- (szetszwo)
-
- HDFS-2368. Move SPNEGO conf properties from hdfs-default.xml to
- hdfs-site.xml. (szetszwo)
-
HDFS-2355. Federation: enable using the same configuration file across
all the nodes in the cluster. (suresh)
@@ -58,9 +35,6 @@ Trunk (unreleased changes)
HDFS-2158. Add JournalSet to manage the set of journals. (jitendra)
- HDFS-2395. Add a root element in the JSON responses of webhdfs.
- (szetszwo)
-
HDFS-2459. Separate datatypes for JournalProtocol. (suresh)
HDFS-2480. Separate datatypes for NamenodeProtocol. (suresh)
@@ -72,16 +46,11 @@ Trunk (unreleased changes)
HDFS-2322. the build fails in Windows because commons-daemon TAR cannot be
fetched. (tucu)
- HDFS-2427. Change the default permission in webhdfs to 755 and add range
- check/validation for all parameters. (szetszwo)
-
HDFS-2489. Move Finalize and Register to separate file out of
DatanodeCommand.java. (suresh)
HDFS-2488. Separate datatypes for InterDatanodeProtocol. (suresh)
- HDFS-2501. Add version prefix and root methods to webhdfs. (szetszwo)
-
BUG FIXES
HDFS-2287. TestParallelRead has a small off-by-one bug. (todd)
@@ -94,12 +63,6 @@ Trunk (unreleased changes)
HDFS-2314. MRV1 test compilation broken after HDFS-2197 (todd)
- HDFS-2331. Fix WebHdfsFileSystem compilation problems for a bug in JDK
- version < 1.6.0_26. (Abhijit Suresh Shingate via szetszwo)
-
- HDFS-2333. Change DFSOutputStream back to package private, otherwise,
- there are two SC_START_IN_CTOR findbugs warnings. (szetszwo)
-
HDFS-2330. In NNStorage and FSImagePreTransactionalStorageInspector,
IOExceptions of stream closures can mask root exceptions. (Uma Maheswara
Rao G via szetszwo)
@@ -107,61 +70,23 @@ Trunk (unreleased changes)
HDFS-46. Change default namespace quota of root directory from
Integer.MAX_VALUE to Long.MAX_VALUE. (Uma Maheswara Rao G via szetszwo)
- HDFS-2366. Initialize WebHdfsFileSystem.ugi in object construction.
- (szetszwo)
-
HDFS-2373. Commands using webhdfs and hftp print unnecessary debug
info on the console with security enabled. (Arpit Gupta via suresh)
- HDFS-2361. hftp is broken, fixed username checks in JspHelper. (jitendra)
-
HDFS-2298. Fix TestDfsOverAvroRpc by changing ClientProtocol to
not include multiple methods of the same name. (cutting)
- HDFS-2403. NamenodeWebHdfsMethods.generateDelegationToken(..) does not use
- the renewer parameter. (szetszwo)
-
- HDFS-2409. _HOST in dfs.web.authentication.kerberos.principal. (jitendra)
-
- HDFS-2404. webhdfs liststatus json response is not correct. (suresh)
-
HDFS-2349. Corruption detected during block transfers between DNs
should log a WARN instead of INFO. (harsh)
- HDFS-2441. Remove the Content-Type set by HttpServer.QuotingInputFilter in
- webhdfs responses. (szetszwo)
-
- HDFS-2428. Convert com.sun.jersey.api.ParamException$QueryParamException
- to IllegalArgumentException and response it as http BAD_REQUEST in webhdfs.
- (szetszwo)
-
- HDFS-2424. Added a root element "HdfsFileStatuses" for the response
- of webhdfs listStatus. (szetszwo)
-
- MAPREDUCE-2764. Fix renewal of dfs delegation tokens. (Owen via jitendra)
-
- HDFS-2439. Fix NullPointerException in webhdfs when opening a non-existing
- file or creating a file without specifying the replication parameter.
- (szetszwo)
-
HDFS-2188. Make FSEditLog create its journals from a list of URIs rather
than NNStorage. (Ivan Kelly via jitendra)
- HDFS-2453. Fix http response code for partial content in webhdfs, added
- getDefaultBlockSize() and getDefaultReplication() in WebHdfsFileSystem
- and cleared content type in ExceptionHandler. (szetszwo)
-
HDFS-2481 Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol.
(sanjay)
HDFS-2497 Fix TestBackupNode failure. (suresh)
- HDFS-2411. The the auth to local mappings are not being respected, with
- webhdfs enabled. (jitendra)
-
- HDFS-2494. Close the streams and DFSClient in DatanodeWebHdfsMethods.
- (Uma Maheswara Rao G via szetszwo)
-
Release 0.23.0 - Unreleased
INCOMPATIBLE CHANGES
@@ -468,6 +393,23 @@ Release 0.23.0 - Unreleased
HDFS-2202. Add a new DFSAdmin command to set balancer bandwidth of
datanodes without restarting. (Eric Payne via szetszwo)
+ HDFS-2284. Add a new FileSystem, webhdfs://, for supporting write Http
+ access to HDFS. (szetszwo)
+
+ HDFS-2317. Support read access to HDFS in webhdfs. (szetszwo)
+
+ HDFS-2338. Add configuration option to enable/disable webhdfs.
+ (jitendra via szetszwo)
+
+ HDFS-2318. Provide authentication to webhdfs using SPNEGO and delegation
+ tokens. (szetszwo)
+
+ HDFS-2340. Support getFileBlockLocations and getDelegationToken in webhdfs.
+ (szetszwo)
+
+ HDFS-2348. Support getContentSummary and getFileChecksum in webhdfs.
+ (szetszwo)
+
IMPROVEMENTS
HDFS-1875. MiniDFSCluster hard-codes dfs.datanode.address to localhost
@@ -863,6 +805,20 @@ Release 0.23.0 - Unreleased
HDFS-2485. Improve code layout and constants in UnderReplicatedBlocks
(stevel)
+ HDFS-2356. Support case insensitive query parameter names in webhdfs.
+ (szetszwo)
+
+ HDFS-2368. Move SPNEGO conf properties from hdfs-default.xml to
+ hdfs-site.xml. (szetszwo)
+
+ HDFS-2395. Add a root element in the JSON responses of webhdfs.
+ (szetszwo)
+
+ HDFS-2427. Change the default permission in webhdfs to 755 and add range
+ check/validation for all parameters. (szetszwo)
+
+ HDFS-2501. Add version prefix and root methods to webhdfs. (szetszwo)
+
OPTIMIZATIONS
HDFS-1458. Improve checkpoint performance by avoiding unnecessary image
@@ -1198,6 +1154,50 @@ Release 0.23.0 - Unreleased
HDFS-2467. HftpFileSystem uses incorrect compare for finding delegation
tokens. (omalley)
+ HDFS-2331. Fix WebHdfsFileSystem compilation problems for a bug in JDK
+ version < 1.6.0_26. (Abhijit Suresh Shingate via szetszwo)
+
+ HDFS-2333. Change DFSOutputStream back to package private, otherwise,
+ there are two SC_START_IN_CTOR findbugs warnings. (szetszwo)
+
+ HDFS-2366. Initialize WebHdfsFileSystem.ugi in object construction.
+ (szetszwo)
+
+ HDFS-2361. hftp is broken, fixed username checks in JspHelper. (jitendra)
+
+ HDFS-2403. NamenodeWebHdfsMethods.generateDelegationToken(..) does not use
+ the renewer parameter. (szetszwo)
+
+ HDFS-2409. _HOST in dfs.web.authentication.kerberos.principal. (jitendra)
+
+ HDFS-2404. webhdfs liststatus json response is not correct. (suresh)
+
+ HDFS-2441. Remove the Content-Type set by HttpServer.QuotingInputFilter in
+ webhdfs responses. (szetszwo)
+
+ HDFS-2428. Convert com.sun.jersey.api.ParamException$QueryParamException
+ to IllegalArgumentException and response it as http BAD_REQUEST in webhdfs.
+ (szetszwo)
+
+ HDFS-2424. Added a root element "HdfsFileStatuses" for the response
+ of webhdfs listStatus. (szetszwo)
+
+ MAPREDUCE-2764. Fix renewal of dfs delegation tokens. (Owen via jitendra)
+
+ HDFS-2439. Fix NullPointerException in webhdfs when opening a non-existing
+ file or creating a file without specifying the replication parameter.
+ (szetszwo)
+
+ HDFS-2453. Fix http response code for partial content in webhdfs, added
+ getDefaultBlockSize() and getDefaultReplication() in WebHdfsFileSystem
+ and cleared content type in ExceptionHandler. (szetszwo)
+
+ HDFS-2411. The the auth to local mappings are not being respected, with
+ webhdfs enabled. (jitendra)
+
+ HDFS-2494. Close the streams and DFSClient in DatanodeWebHdfsMethods.
+ (Uma Maheswara Rao G via szetszwo)
+
BREAKDOWN OF HDFS-1073 SUBTASKS
HDFS-1521. Persist transaction ID on disk between NN restarts.