You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-commits@hadoop.apache.org by st...@apache.org on 2012/02/27 17:51:11 UTC
svn commit: r1294216 [2/2] -
/hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
Modified: hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt?rev=1294216&r1=1294215&r2=1294216&view=diff
==============================================================================
--- hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt (original)
+++ hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt Mon Feb 27 16:51:11 2012
@@ -15,21 +15,21 @@ Trunk (unreleased changes)
IMPROVEMENTS
- MAPREDUCE-3787. [Gridmix] Optimize job monitoring and STRESS mode for
+ MAPREDUCE-3787. [Gridmix] Optimize job monitoring and STRESS mode for
faster job submission. (amarrk)
MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
- MAPREDUCE-3597. [Rumen] Rumen should provide APIs to access all the
+ MAPREDUCE-3597. [Rumen] Rumen should provide APIs to access all the
job-history related information.
- MAPREDUCE-3375. [Gridmix] Memory Emulation system tests.
+ MAPREDUCE-3375. [Gridmix] Memory Emulation system tests.
(Vinay Thota via amarrk)
- MAPREDUCE-2733. [Gridmix] Gridmix3 cpu emulation system tests.
+ MAPREDUCE-2733. [Gridmix] Gridmix3 cpu emulation system tests.
(Vinay Thota via amarrk)
- MAPREDUCE-3008. Improvements to cumulative CPU emulation for short running
+ MAPREDUCE-3008. Improvements to cumulative CPU emulation for short running
tasks in Gridmix. (amarrk)
MAPREDUCE-2887 due to HADOOP-7524 Change RPC to allow multiple protocols
@@ -41,16 +41,16 @@ Trunk (unreleased changes)
MAPREDUCE-2836. Provide option to fail jobs when submitted to non-existent
fair scheduler pools. (Ahmed Radwan via todd)
- MAPREDUCE-3171. normalize nodemanager native code compilation with common/hdfs
+ MAPREDUCE-3171. normalize nodemanager native code compilation with common/hdfs
native. (tucu)
- MAPREDUCE-3149. Add a test to verify that TokenCache handles file system
+ MAPREDUCE-3149. Add a test to verify that TokenCache handles file system
uri with no authority. (John George via jitendra)
- MAPREDUCE-3169. Create a new MiniMRCluster equivalent which only provides
+ MAPREDUCE-3169. Create a new MiniMRCluster equivalent which only provides
client APIs cross MR1 and MR2 (Ahmed via tucu)
- HADOOP-7862 MR changes to work with HADOOP 7862:
+ HADOOP-7862 MR changes to work with HADOOP 7862:
Move the support for multiple protocols to lower layer so that Writable,
PB and Avro can all use it (Sanjay)
@@ -63,21 +63,21 @@ Trunk (unreleased changes)
MAPREDUCE-3194. "mapred mradmin" command is broken in mrv2
(Jason Lowe via bobby)
- MAPREDUCE-3462. Fix Gridmix JUnit testcase failures.
+ MAPREDUCE-3462. Fix Gridmix JUnit testcase failures.
(Ravi Prakash and Ravi Gummadi via amarrk)
- MAPREDUCE-3349. Log rack-name in JobHistory for unsuccessful tasks.
+ MAPREDUCE-3349. Log rack-name in JobHistory for unsuccessful tasks.
(Devaraj K and Amar Kamat via amarrk)
MAPREDUCE-3412. Fix 'ant docs'. (amarrk)
- MAPREDUCE-3346. [Rumen] LoggedTaskAttempt#getHostName() returns null.
+ MAPREDUCE-3346. [Rumen] LoggedTaskAttempt#getHostName() returns null.
(amarrk)
- MAPREDUCE-2950. [Gridmix] TestUserResolve fails in trunk.
+ MAPREDUCE-2950. [Gridmix] TestUserResolve fails in trunk.
(Ravi Gummadi via amarrk)
- MAPREDUCE-2784. [Gridmix] Bug fixes in ExecutionSummarizer and
+ MAPREDUCE-2784. [Gridmix] Bug fixes in ExecutionSummarizer and
ResourceUsageMatcher. (amarrk)
MAPREDUCE-2978. Fixed test-patch to make Jenkins report correct number of
@@ -88,28 +88,29 @@ Trunk (unreleased changes)
(Brandon Li via jitendra)
MAPREDUCE-3740. Fixed broken mapreduce compilation after the patch for
- HADOOP-7965. (Devaraj K via vinodkv)
+ HADOOP-7965. (Devaraj K via vinodkv)
MAPREDUCE-3818. Fixed broken compilation in TestSubmitJob after the patch
for HDFS-2895. (Suresh Srinivas via vinodkv)
-Release 0.23.3 - UNRELEASED
+Release 0.23.3 - UNRELEASED
INCOMPATIBLE CHANGES
- NEW FEATURES
-
+ NEW FEATURES
+
IMPROVEMENTS
OPTIMIZATIONS
BUG FIXES
-Release 0.23.2 - UNRELEASED
+Release 0.23.2 - UNRELEASED
INCOMPATIBLE CHANGES
- NEW FEATURES
+ NEW FEATURES
+
IMPROVEMENTS
MAPREDUCE-3849. Change TokenCache's reading of the binary token file
@@ -139,13 +140,13 @@ Release 0.23.2 - UNRELEASED
MAPREDUCE-3862. Nodemanager can appear to hang on shutdown due to lingering
DeletionService threads (Jason Lowe via bobby)
- MAPREDUCE-3680. FifoScheduler web service rest API can print out invalid
+ MAPREDUCE-3680. FifoScheduler web service rest API can print out invalid
JSON. (B Anil Kumar via tgraves)
- MAPREDUCE-3852. Test TestLinuxResourceCalculatorPlugin failing. (Thomas
+ MAPREDUCE-3852. Test TestLinuxResourceCalculatorPlugin failing. (Thomas
Graves via mahadev)
- MAPREDUCE-3736. Variable substitution depth too large for fs.default.name
+ MAPREDUCE-3736. Variable substitution depth too large for fs.default.name
causes jobs to fail (ahmed via tucu).
MAPREDUCE-3864. Fix cluster setup docs for correct SecondaryNameNode
@@ -169,7 +170,7 @@ Release 0.23.2 - UNRELEASED
dies unexpectedly (Jason Lowe via sseth)
MAPREDUCE-3904 Job history produced with mapreduce.cluster.acls.enabled
- false can not be viewed with mapreduce.cluster.acls.enabled true
+ false can not be viewed with mapreduce.cluster.acls.enabled true
(Jonathon Eagles via tgraves)
MAPREDUCE-3910. Fixed a bug in CapacityScheduler LeafQueue which was causing
@@ -179,15 +180,15 @@ Release 0.23.2 - UNRELEASED
zero counter values for framework counters. (Bhallamudi Venkata Siva Kamesh
via vinodkv)
- MAPREDUCE-3913. RM application webpage is unresponsive after 2000 jobs
+ MAPREDUCE-3913. RM application webpage is unresponsive after 2000 jobs
(Jason Lowe via tgraves)
-
-Release 0.23.1 - 2012-02-17
+
+Release 0.23.1 - 2012-02-17
INCOMPATIBLE CHANGES
- NEW FEATURES
-
+ NEW FEATURES
+
MAPREDUCE-3121. NodeManager should handle disk-failures (Ravi Gummadi via mahadev)
MAPREDUCE-2863. Support web services for YARN and MR components. (Thomas
@@ -211,16 +212,16 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3370. Fixed MiniMRYarnCluster and related tests to not use
a hard-coded path for the mr-app jar. (Ahmed Radwan via vinodkv)
- MAPREDUCE-3325. Improvements to CapacityScheduler doc. (Thomas Graves
+ MAPREDUCE-3325. Improvements to CapacityScheduler doc. (Thomas Graves
via mahadev)
MAPREDUCE-3341. Enhance logging of initalized queue limit values.
(Anupam Seth via mahadev)
- MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles
+ MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles
via mahadev)
- MAPREDUCE-3331. Improvement to single node cluster setup documentation for
+ MAPREDUCE-3331. Improvement to single node cluster setup documentation for
0.23 (Anupam Seth via mahadev)
MAPREDUCE-3102. Changed NodeManager to fail fast when LinuxContainerExecutor
@@ -235,7 +236,7 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3372. HADOOP_PREFIX cannot be overridden.
(Bruno Mahé via tomwhite)
- MAPREDUCE-3411. Performance Upgrade for jQuery (Jonathan Eagles via
+ MAPREDUCE-3411. Performance Upgrade for jQuery (Jonathan Eagles via
mahadev)
MAPREDUCE-3371. Review and improve the yarn-api javadocs. (Ravi Prakash
@@ -258,7 +259,7 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3369. Migrate MR1 tests to run on MR2 using the new interfaces
introduced in MAPREDUCE-3169. (Ahmed Radwan via tomwhite)
- MAPREDUCE-3518. mapred queue -info <queue> -showJobs throws NPE.
+ MAPREDUCE-3518. mapred queue -info <queue> -showJobs throws NPE.
(Jonathan Eagles via mahadev)
MAPREDUCE-3391. Making a trivial change to correct a log message in
@@ -289,10 +290,10 @@ Release 0.23.1 - 2012-02-17
Improved the earlier patch to not to JobHistoryServer repeatedly.
(Anupam Seth via vinodkv)
- MAPREDUCE-3553. Add support for data returned when exceptions thrown from web
+ MAPREDUCE-3553. Add support for data returned when exceptions thrown from web
service apis to be in either xml or in JSON. (Thomas Graves via mahadev)
- MAPREDUCE-3641. Making CapacityScheduler more conservative so as to
+ MAPREDUCE-3641. Making CapacityScheduler more conservative so as to
assign only one off-switch container in a single scheduling
iteration. (Arun C Murthy via vinodkv)
@@ -310,12 +311,12 @@ Release 0.23.1 - 2012-02-17
values for working at scale. (Hitesh Shah via vinodkv)
MAPREDUCE-3693. Added mapreduce.admin.user.env to mapred-default.xml.
- (Roman Shapshonik via acmurthy)
+ (Roman Shapshonik via acmurthy)
MAPREDUCE-3732. Modified CapacityScheduler to use only users with pending
requests for computing user-limits. (Arun C Murthy via vinodkv)
- MAPREDUCE-3679. AM logs and others should not automatically refresh after every 1
+ MAPREDUCE-3679. AM logs and others should not automatically refresh after every 1
second. (Vinod KV via mahadev)
MAPREDUCE-3754. Modified RM UI to filter applications based on state of the
@@ -361,10 +362,10 @@ Release 0.23.1 - 2012-02-17
on the webapps. (Bhallamudi Venkata Siva Kamesh and Jason Lowe via vinodkv)
MAPREDUCE-3756. Made single shuffle limit configurable. (Hitesh Shah via
- acmurthy)
+ acmurthy)
MAPREDUCE-3811. Made jobclient-to-AM retries configurable. (sseth via
- acmurthy)
+ acmurthy)
BUG FIXES
@@ -380,7 +381,7 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3217. Reenabled and fixed bugs in the failing ant test
TestAuditLogger. (Devaraj K via vinodkv)
- MAPREDUCE-3291. App fail to launch due to delegation token not
+ MAPREDUCE-3291. App fail to launch due to delegation token not
found in cache (Robert Evans via mahadev)
MAPREDUCE-3344. o.a.h.mapreduce.Reducer since 0.21 blindly casts to
@@ -402,7 +403,7 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3379. Fixed LocalResourceTracker in NodeManager to remove deleted
cache entries correctly. (Siddharth Seth via vinodkv)
- MAPREDUCE-3324. Not All HttpServer tools links (stacks,logs,config,metrics) are
+ MAPREDUCE-3324. Not All HttpServer tools links (stacks,logs,config,metrics) are
accessible through all UI servers (Jonathan Eagles via mahadev)
MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command
@@ -420,7 +421,7 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3454. [Gridmix] TestDistCacheEmulation is broken (Hitesh Shah
via mahadev)
- MAPREDUCE-3408. yarn-daemon.sh unconditionnaly sets yarn.root.logger
+ MAPREDUCE-3408. yarn-daemon.sh unconditionnaly sets yarn.root.logger
(Bruno Mahe via mahadev)
MAPREDUCE-3329. Fixed CapacityScheduler to ensure maximum-capacity cannot
@@ -429,7 +430,7 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3464. mapreduce jsp pages missing DOCTYPE. (Dave Vronay via mattf)
MAPREDUCE-3265. Removed debug logs during job submission to LOG.debug to
- cut down noise. (acmurthy)
+ cut down noise. (acmurthy)
MAPREDUCE-3433. Finding counters by legacy group name returns empty
counters. (tomwhite)
@@ -439,7 +440,7 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3488. Streaming jobs are failing because the main class
isnt set in the pom files. (mahadev)
-
+
MAPREDUCE-3463. Second AM fails to recover properly when first AM is killed with
java.lang.IllegalArgumentException causing lost job. (Siddharth Seth via mahadev)
@@ -457,22 +458,22 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3479. JobClient#getJob cannot find local jobs. (tomwhite)
- MAPREDUCE-3456. $HADOOP_PREFIX/bin/yarn should set defaults for
+ MAPREDUCE-3456. $HADOOP_PREFIX/bin/yarn should set defaults for
$HADOOP_*_HOME (Eric Payne via mahadev)
MAPREDUCE-3458. Fix findbugs warnings in hadoop-examples. (Devaraj K
via mahadev)
- MAPREDUCE-3485. DISKS_FAILED -101 error code should be defined in same location as
+ MAPREDUCE-3485. DISKS_FAILED -101 error code should be defined in same location as
ABORTED_CONTAINER_EXIT_STATUS. (Ravi Gummadi via mahadev)
MAPREDUCE-3496. Fixed client to print queue acls in consistent order.
- (Jonathan Eagles via acmurthy)
+ (Jonathan Eagles via acmurthy)
MAPREDUCE-3147. Handle leaf queues with the same name properly. (Ravi Prakash via
mahadev)
- MAPREDUCE-3327. RM web ui scheduler link doesn't show correct max value
+ MAPREDUCE-3327. RM web ui scheduler link doesn't show correct max value
for queues (Anupam Seth via mahadev)
MAPREDUCE-3513. Capacity Scheduler web UI has a spelling mistake for Memory.
@@ -484,14 +485,14 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3527. Fix minor API incompatibilities between 1.0 and 0.23.
(tomwhite)
- MAPREDUCE-3328. mapred queue -list output inconsistent and missing child
+ MAPREDUCE-3328. mapred queue -list output inconsistent and missing child
queues. (Ravi Prakash via mahadev)
- MAPREDUCE-3510. Capacity Scheduler inherited ACLs not displayed by mapred queue
+ MAPREDUCE-3510. Capacity Scheduler inherited ACLs not displayed by mapred queue
-showacls (Jonathan Eagles via mahadev)
MAPREDUCE-3537. Fix race condition in DefaultContainerExecutor which led
- to container localization occuring in wrong directories. (acmurthy)
+ to container localization occuring in wrong directories. (acmurthy)
MAPREDUCE-3542. Support "FileSystemCounter" legacy counter group name for
compatibility. (tomwhite)
@@ -500,7 +501,7 @@ Release 0.23.1 - 2012-02-17
in the correct directory to work properly in secure mode. (Hitesh Shah via
vinodkv)
- MAPREDUCE-3541. Fix broken TestJobQueueClient test. (Ravi Prakash via
+ MAPREDUCE-3541. Fix broken TestJobQueueClient test. (Ravi Prakash via
mahadev)
MAPREDUCE-3398. Fixed log aggregation to work correctly in secure mode.
@@ -515,7 +516,7 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3531. Fixed a race in ContainerTokenSecretManager. (Robert Joseph
Evans via sseth)
- MAPREDUCE-3560. TestRMNodeTransitions is failing on trunk.
+ MAPREDUCE-3560. TestRMNodeTransitions is failing on trunk.
(Siddharth Seth via mahadev)
MAPREDUCE-3487. Fixed JobHistory web-UI to display links to single task's
@@ -527,14 +528,14 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3422. Counter display names are not being picked up. (Jonathan
Eagles via sseth)
- MAPREDUCE-3366. Mapreduce component should use consistent directory structure
+ MAPREDUCE-3366. Mapreduce component should use consistent directory structure
layout as HDFS/common (Eric Yang via mahadev)
MAPREDUCE-3387. Fixed AM's tracking URL to always go through the proxy, even
before the job started, so that it works properly with oozie throughout
the job execution. (Robert Joseph Evans via vinodkv)
- MAPREDUCE-3579. ConverterUtils shouldn't include a port in a path from a url
+ MAPREDUCE-3579. ConverterUtils shouldn't include a port in a path from a url
without a port. (atm via harsh)
MAPREDUCE-3563. Fixed LocalJobRunner to work correctly with new mapreduce
@@ -553,21 +554,21 @@ Release 0.23.1 - 2012-02-17
thereby solving race conditions in MR AM shutdown. (vinodkv)
MAPREDUCE-3604. Fixed streaming to use new mapreduce.framework.name to
- check for local mode. (acmurthy)
+ check for local mode. (acmurthy)
MAPREDUCE-3521. Fixed streaming to ensure it doesn't silently ignore
- unknown arguments. (Robert Evans via acmurthy)
+ unknown arguments. (Robert Evans via acmurthy)
MAPREDUCE-3522. Ensure queues inherit ACLs from parent if they aren't
- explicitly specified. (Jonathan Eagles via acmurthy)
+ explicitly specified. (Jonathan Eagles via acmurthy)
MAPREDUCE-3608. Fixed compile issue with MAPREDUCE-3522. (mahadev via
- acmurthy)
+ acmurthy)
MAPREDUCE-3490. Fixed MapReduce AM to count failed maps also towards Reduce
ramp up. (Sharad Agarwal and Arun C Murthy via vinodkv)
- MAPREDUCE-1744. DistributedCache creates its own FileSytem instance when
+ MAPREDUCE-1744. DistributedCache creates its own FileSytem instance when
adding a file/archive to the path. (Dick King via tucu)
MAPREDUCE-3529. TokenCache does not cache viewfs credentials correctly
@@ -577,44 +578,44 @@ Release 0.23.1 - 2012-02-17
1 to 0.23 (Tom White via sseth)
MAPREDUCE-3566. Fixed MR AM to construct CLC only once across all tasks.
- (vinodkv via acmurthy)
+ (vinodkv via acmurthy)
MAPREDUCE-3572. Moved AM event dispatcher to a separate thread for
- performance reasons. (vinodkv via acmurthy)
+ performance reasons. (vinodkv via acmurthy)
MAPREDUCE-3615. Fix some ant test failures. (Thomas Graves via sseth)
MAPREDUCE-3326. Added detailed information about queue's to the
- CapacityScheduler web-ui. (Jason Lowe via acmurthy)
+ CapacityScheduler web-ui. (Jason Lowe via acmurthy)
MAPREDUCE-3548. Added more unit tests for MR AM & JHS web-services.
- (Thomas Graves via acmurthy)
+ (Thomas Graves via acmurthy)
MAPREDUCE-3617. Removed wrong default value for
yarn.resourcemanager.principal and yarn.nodemanager.principal. (Jonathan
- Eagles via acmurthy)
+ Eagles via acmurthy)
- MAPREDUCE-3183. hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
+ MAPREDUCE-3183. hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
missing license header. (Hitesh Shah via tucu).
MAPREDUCE-3003. Publish MR JARs to Maven snapshot repository. (tucu)
MAPREDUCE-3204. mvn site:site fails on MapReduce. (tucu)
- MAPREDUCE-3014. Rename and invert logic of '-cbuild' profile to 'native' and off
+ MAPREDUCE-3014. Rename and invert logic of '-cbuild' profile to 'native' and off
by default. (tucu)
MAPREDUCE-3477. Hadoop site documentation cannot be built anymore. (jeagles via tucu)
MAPREDUCE-3500. MRJobConfig creates an LD_LIBRARY_PATH using the platform ARCH. (tucu)
- MAPREDUCE-3389. MRApps loads the 'mrapp-generated-classpath' file with
+ MAPREDUCE-3389. MRApps loads the 'mrapp-generated-classpath' file with
classpath from the build machine. (tucu)
- MAPREDUCE-3544. gridmix build is broken, requires hadoop-archives to be added as
+ MAPREDUCE-3544. gridmix build is broken, requires hadoop-archives to be added as
ivy dependency. (tucu)
- MAPREDUCE-3557. MR1 test fail to compile because of missing hadoop-archives dependency.
+ MAPREDUCE-3557. MR1 test fail to compile because of missing hadoop-archives dependency.
(tucu)
MAPREDUCE-3624. Remove unnecessary dependency on JDK's tools.jar. (mahadev
@@ -626,7 +627,7 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3639. Fixed TokenCache to work with absent FileSystem canonical
service-names. (Siddharth Seth via vinodkv)
- MAPREDUCE-3380. Token infrastructure for running clients which are not kerberos
+ MAPREDUCE-3380. Token infrastructure for running clients which are not kerberos
authenticated. (mahadev)
MAPREDUCE-3648. TestJobConf failing. (Thomas Graves via mahadev)
@@ -634,8 +635,8 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3651. TestQueueManagerRefresh fails. (Thomas Graves via mahadev)
MAPREDUCE-3645. TestJobHistory fails. (Thomas Graves via mahadev)
-
- MAPREDUCE-3652. org.apache.hadoop.mapred.TestWebUIAuthorization.testWebUIAuthorization
+
+ MAPREDUCE-3652. org.apache.hadoop.mapred.TestWebUIAuthorization.testWebUIAuthorization
fails. (Thomas Graves via mahadev)
MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken.
@@ -656,7 +657,7 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3649. Job End notification gives an error on calling back.
(Ravi Prakash via mahadev)
- MAPREDUCE-3657. State machine visualize build fails. (Jason Lowe
+ MAPREDUCE-3657. State machine visualize build fails. (Jason Lowe
via mahadev)
MAPREDUCE-2450. Fixed a corner case with interrupted communication threads
@@ -677,24 +678,24 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3689. RM web UI doesn't handle newline in job name.
(Thomas Graves via mahadev)
- MAPREDUCE-3549. write api documentation for web service apis for RM, NM,
+ MAPREDUCE-3549. write api documentation for web service apis for RM, NM,
mapreduce app master, and job history server (Thomas Graves via mahadev)
- MAPREDUCE-3705. ant build fails on 0.23 branch. (Thomas Graves via
+ MAPREDUCE-3705. ant build fails on 0.23 branch. (Thomas Graves via
mahadev)
-
+
MAPREDUCE-3691. webservices add support to compress response.
(Thomas Graves via mahadev)
- MAPREDUCE-3702. internal server error trying access application master
+ MAPREDUCE-3702. internal server error trying access application master
via proxy with filter enabled (Thomas Graves via mahadev)
MAPREDUCE-3646. Remove redundant URL info from "mapred job" output.
(Jonathan Eagles via mahadev)
- MAPREDUCE-3681. Fixed computation of queue's usedCapacity. (acmurthy)
+ MAPREDUCE-3681. Fixed computation of queue's usedCapacity. (acmurthy)
- MAPREDUCE-3505. yarn APPLICATION_CLASSPATH needs to be overridable.
+ MAPREDUCE-3505. yarn APPLICATION_CLASSPATH needs to be overridable.
(ahmed via tucu)
MAPREDUCE-3714. Fixed EventFetcher and Fetcher threads to shut-down properly
@@ -717,7 +718,7 @@ Release 0.23.1 - 2012-02-17
per-application. (Arun C Murthy via vinodkv)
MAPREDUCE-3721. Fixed a race in shuffle which caused reduces to hang.
- (sseth via acmurthy)
+ (sseth via acmurthy)
MAPREDUCE-3733. Add Apache License Header to hadoop-distcp/pom.xml.
(mahadev)
@@ -726,7 +727,7 @@ Release 0.23.1 - 2012-02-17
(mahadev)
MAPREDUCE-3720. Changed bin/mapred job -list to not print job-specific
- information not available at RM. (vinodkv via acmurthy)
+ information not available at RM. (vinodkv via acmurthy)
MAPREDUCE-3742. "yarn logs" command fails with ClassNotFoundException.
(Jason Lowe via mahadev)
@@ -739,7 +740,7 @@ Release 0.23.1 - 2012-02-17
tasks. (Jonathan Eagles via vinodkv)
MAPREDUCE-3748. Changed a log in CapacityScheduler.nodeUpdate to debug.
- (ramya via acmurthy)
+ (ramya via acmurthy)
MAPREDUCE-3764. Fixed resource usage metrics for queues and users.
(acmurthy)
@@ -748,16 +749,16 @@ Release 0.23.1 - 2012-02-17
(tomwhite)
MAPREDUCE-3762. Fixed default CapacityScheduler configs. (mahadev via
- acmurthy)
+ acmurthy)
- MAPREDUCE-3499. New MiniMR does not setup proxyuser configuration
+ MAPREDUCE-3499. New MiniMR does not setup proxyuser configuration
correctly, thus tests using doAs do not work. (johnvijoe via tucu)
MAPREDUCE-3696. MR job via oozie does not work on hadoop 23.
(John George via mahadev)
MAPREDUCE-3427. Fix streaming unit tests broken after mavenization.
- (Hitesh Shah via acmurthy)
+ (Hitesh Shah via acmurthy)
MAPREDUCE-3640. Allow AMRecovery to work with partial JobHistory files.
(Arun C Murthy via sseth)
@@ -771,10 +772,10 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3780. Fixed a bug where applications killed before getting
activated were not getting cleaned up properly. (Hitesh Shah via acmurthy)
- MAPREDUCE-3708. Metrics: Incorrect Apps Submitted Count (Bhallamudi via
+ MAPREDUCE-3708. Metrics: Incorrect Apps Submitted Count (Bhallamudi via
mahadev)
- MAPREDUCE-3727. jobtoken location property in jobconf refers to wrong
+ MAPREDUCE-3727. jobtoken location property in jobconf refers to wrong
jobtoken file (tucu)
MAPREDUCE-3711. Fixed MR AM recovery so that only single selected task
@@ -793,14 +794,14 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3791. can't build site in hadoop-yarn-server-common.
(mahadev)
- MAPREDUCE-3723. TestAMWebServicesJobs & TestHSWebServicesJobs
+ MAPREDUCE-3723. TestAMWebServicesJobs & TestHSWebServicesJobs
incorrectly asserting tests (Bhallamudi Venkata Siva Kamesh
via mahadev)
MAPREDUCE-3795. "job -status" command line output is malformed.
(vinodkv via mahadev)
- MAPREDUCE-3759. ClassCastException thrown in -list-active-trackers when
+ MAPREDUCE-3759. ClassCastException thrown in -list-active-trackers when
there are a few unhealthy nodes (vinodkv via mahadev)
MAPREDUCE-3775. Change MiniYarnCluster to escape special chars in testname.
@@ -810,14 +811,14 @@ Release 0.23.1 - 2012-02-17
allocation-mb setting (Hitesh Shah via mahadev)
MAPREDUCE-3747. Initialize queue metrics upfront and added start/finish
- time to RM Web-UI. (acmurthy)
+ time to RM Web-UI. (acmurthy)
MAPREDUCE-3814. Fixed MRV1 compilation. (Arun C Murthy via vinodkv)
MAPREDUCE-3810. Performance tweaks - reduced logging in AM and defined
- hascode/equals for ResourceRequest & Priority. (vinodkv via acmurthy)
+ hascode/equals for ResourceRequest & Priority. (vinodkv via acmurthy)
- MAPREDUCE-3813. Added a cache for resolved racks. (vinodkv via acmurthy)
+ MAPREDUCE-3813. Added a cache for resolved racks. (vinodkv via acmurthy)
MAPREDUCE-3808. Fixed an NPE in FileOutputCommitter for jobs with maps
but no reduces. (Robert Joseph Evans via vinodkv)
@@ -826,24 +827,24 @@ Release 0.23.1 - 2012-02-17
(Dave Thompson via bobby)
MAPREDUCE-3354. Changed scripts so that jobhistory server is started by
- bin/mapred instead of bin/yarn. (Jonathan Eagles via acmurthy)
+ bin/mapred instead of bin/yarn. (Jonathan Eagles via acmurthy)
MAPREDUCE-3809. Ensure that there is no needless sleep in Task at the end
of the task. (sseth via acmurthy)
- MAPREDUCE-3794. Support mapred.Task.Counter and mapred.JobInProgress.Counter
+ MAPREDUCE-3794. Support mapred.Task.Counter and mapred.JobInProgress.Counter
enums for compatibility (Tom White via mahadev)
MAPREDUCE-3697. Support binary compatibility for Counters after
- MAPREDUCE-901. (mahadev via acmurthy)
+ MAPREDUCE-901. (mahadev via acmurthy)
- MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via
+ MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via
mahadev)
-
+
MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive
- jobs. (Arpit Gupta via acmurthy)
+ jobs. (Arpit Gupta via acmurthy)
- MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via
+ MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via
mahadev)
MAPREDUCE-3436. JobHistory webapp address should use the host configured
@@ -852,9 +853,9 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3815. Fixed MR AM to always use hostnames and never IPs when
requesting containers so that scheduler can give off data local containers
correctly. (Siddarth Seth via vinodkv)
-
+
MAPREDUCE-3833. Fixed a bug in reinitiaziling of queues. (Jason Lowe via
- acmurthy)
+ acmurthy)
MAPREDUCE-3826. Fixed a bug in RM web-ui which broke sorting. (Jonathan
Eagles via acmurthy)
@@ -863,7 +864,7 @@ Release 0.23.1 - 2012-02-17
finishes. (Vinod Kumar Vavilapalli via sseth)
MAPREDUCE-3827. Changed Counters to use ConcurrentSkipListMap for
- performance. (vinodkv via acmurthy)
+ performance. (vinodkv via acmurthy)
MAPREDUCE-3822. Changed FS counter computation to use all occurences of
the same FS scheme, instead of randomly using one. (Mahadev Konar via
@@ -874,14 +875,14 @@ Release 0.23.1 - 2012-02-17
be on the same rack. (Siddarth Seth via vinodkv)
MAPREDUCE-3828. Ensure that urls in single-node mode are correct. (sseth
- via acmurthy)
+ via acmurthy)
MAPREDUCE-3770. Zombie.getJobConf() results into NPE. (amarrk)
MAPREDUCE-3840. JobEndNotifier doesn't use the proxyToUse during connecting
(Ravi Prakash via bobby)
- MAPREDUCE-3843. Job summary log file found missing on the RM host
+ MAPREDUCE-3843. Job summary log file found missing on the RM host
(Anupam Seth via tgraves)
MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and then
@@ -899,7 +900,7 @@ Release 0.23.1 - 2012-02-17
MAPREDUCE-3880. Changed LCE binary to be 32-bit. (acmurthy)
-Release 0.23.0 - 2011-11-01
+Release 0.23.0 - 2011-11-01
INCOMPATIBLE CHANGES
@@ -913,12 +914,12 @@ Release 0.23.0 - 2011-11-01
NEW FEATURES
MAPREDUCE-2682. Add "mapred classpath" command to print classpath
- for MR applications. (vinodkv via acmurthy)
+ for MR applications. (vinodkv via acmurthy)
MAPREDUCE-2107. [Gridmix] Total heap usage emulation in Gridmix.
(Amar Kamat and Ravi Gummadi via amarrk)
- MAPREDUCE-2106. [Gridmix] Cumulative CPU usage emulation in Gridmix.
+ MAPREDUCE-2106. [Gridmix] Cumulative CPU usage emulation in Gridmix.
(amarrk)
MAPREDUCE-2543. [Gridmix] High-Ram feature emulation in Gridmix. (amarrk)
@@ -931,14 +932,14 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-461. Enable ServicePlugins for the JobTracker.
(Fredrik Hedberg via tomwhite)
- MAPREDUCE-2521. Create RPM and Debian packages for MapReduce. Changes
+ MAPREDUCE-2521. Create RPM and Debian packages for MapReduce. Changes
deployment layout to be consistent across the binary tgz, rpm, and deb.
(Eric Yang via omalley)
MAPREDUCE-2323. Add metrics to the fair scheduler. (todd)
MAPREDUCE-2037. Capture intermediate progress, CPU and memory usage for
- tasks. (Dick King via acmurthy)
+ tasks. (Dick King via acmurthy)
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by
Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey
@@ -958,55 +959,55 @@ Release 0.23.0 - 2011-11-01
make MR AMs resume their progress after restart. (Sharad Agarwal via vinodkv)
MAPREDUCE-2858. Added a WebApp Proxy for applications. (Robert Evans via
- acmurthy)
+ acmurthy)
IMPROVEMENTS
MAPREDUCE-2187. Reporter sends progress during sort/merge. (Anupam Seth via
- acmurthy)
+ acmurthy)
- MAPREDUCE-2365. Add counters to track bytes (read,written) via
+ MAPREDUCE-2365. Add counters to track bytes (read,written) via
File(Input,Output)Format. (Siddharth Seth via acmurthy)
-
- MAPREDUCE-2680. Display queue name in job client CLI. (acmurthy)
-
- MAPREDUCE-2679. Minor changes to sync trunk with MR-279 branch. (acmurthy)
-
- MAPREDUCE-2400. Remove Cluster's dependency on JobTracker via a
- ServiceProvider for the actual implementation. (tomwhite via acmurthy)
-
+
+ MAPREDUCE-2680. Display queue name in job client CLI. (acmurthy)
+
+ MAPREDUCE-2679. Minor changes to sync trunk with MR-279 branch. (acmurthy)
+
+ MAPREDUCE-2400. Remove Cluster's dependency on JobTracker via a
+ ServiceProvider for the actual implementation. (tomwhite via acmurthy)
+
MAPREDUCE-2596. [Gridmix] Summarize Gridmix runs. (amarrk)
- MAPREDUCE-2563. [Gridmix] Add High-Ram emulation system tests to
+ MAPREDUCE-2563. [Gridmix] Add High-Ram emulation system tests to
Gridmix. (Vinay Kumar Thota via amarrk)
- MAPREDUCE-2104. [Rumen] Add Cpu, Memory and Heap usages to
+ MAPREDUCE-2104. [Rumen] Add Cpu, Memory and Heap usages to
TraceBuilder's output. (amarrk)
- MAPREDUCE-2554. [Gridmix] Add distributed cache emulation system tests
+ MAPREDUCE-2554. [Gridmix] Add distributed cache emulation system tests
to Gridmix. (Vinay Kumar Thota via amarrk)
-
+
MAPREDUCE-2543. [Gridmix] High-Ram feature emulation testcase. (amarrk)
- MAPREDUCE-2469. Task counters should also report the total heap usage of
+ MAPREDUCE-2469. Task counters should also report the total heap usage of
the task. (Ravi Gummadi and Amar Ramesh Kamat via amarrk)
- MAPREDUCE-2544. [Gridmix] Add compression emulation system tests to
+ MAPREDUCE-2544. [Gridmix] Add compression emulation system tests to
Gridmix. (Vinay Kumar Thota via amarrk)
- MAPREDUCE-2517. [Gridmix] Add system tests to Gridmix.
+ MAPREDUCE-2517. [Gridmix] Add system tests to Gridmix.
(Vinay Kumar Thota via amarrk)
MAPREDUCE-2492. The new MapReduce API should make available task's
progress to the task. (amarrk)
- MAPREDUCE-2153. Bring in more job configuration properties in to the trace
+ MAPREDUCE-2153. Bring in more job configuration properties in to the trace
file. (Rajesh Balamohan via amarrk)
- MAPREDUCE-1461. Feature to instruct rumen-folder utility to skip jobs worth
+ MAPREDUCE-1461. Feature to instruct rumen-folder utility to skip jobs worth
of specific duration. (Rajesh Balamohan via amarrk)
- MAPREDUCE-2172. Added test-patch.properties required by test-patch.sh
+ MAPREDUCE-2172. Added test-patch.properties required by test-patch.sh
(nigel)
MAPREDUCE-2156. Raid-aware FSCK. (Patrick Kling via dhruba)
@@ -1065,12 +1066,12 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-2202. Generalize CLITest structure and interfaces to faciliate
upstream adoption (e.g. for web or system testing). (cos)
- MAPREDUCE-2420. JobTracker should be able to renew delegation token over
+ MAPREDUCE-2420. JobTracker should be able to renew delegation token over
HTTP (Boris Shkolnik via jitendra)
MAPREDUCE-2474. Add docs to the new API Partitioner on how to access the
Job Configuration. (Harsh J Chouraria via todd)
-
+
MAPREDUCE-2475. Disable IPV6 for junit tests. (suresh srinivas via mahadev)
MAPREDUCE-2422. Removed unused internal methods from DistributedCache.
@@ -1116,7 +1117,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-2494. Order distributed cache deletions by LRU. (Robert Joseph
Evans via cdouglas)
- MAPREDUCE-2452. Makes the cancellation of delegation tokens happen in a
+ MAPREDUCE-2452. Makes the cancellation of delegation tokens happen in a
separate thread. (ddas)
HADOOP-7106. Reorganize project SVN layout to "unsplit" the projects.
@@ -1131,10 +1132,10 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-2602. Allow setting of end-of-record delimiter for
TextInputFormat for the old API. (Ahmed Radwan via todd)
- MAPREDUCE-2705. Permits parallel multiple task launches.
+ MAPREDUCE-2705. Permits parallel multiple task launches.
(Thomas Graves via ddas)
- MAPREDUCE-2489. Jobsplits with random hostnames can make the queue
+ MAPREDUCE-2489. Jobsplits with random hostnames can make the queue
unusable (jeffrey naisbit via mahadev)
MAPREDUCE-2854. update INSTALL with config necessary run mapred on yarn.
@@ -1148,29 +1149,29 @@ Release 0.23.0 - 2011-11-01
vinodkv)
MAPREDUCE-2735. Add an applications summary log to ResourceManager.
- (Thomas Graves via acmurthy)
+ (Thomas Graves via acmurthy)
MAPREDUCE-2697. Enhance CapacityScheduler to cap concurrently running
- applications per-queue & per-user. (acmurthy)
+ applications per-queue & per-user. (acmurthy)
Configuration changes:
add yarn.capacity-scheduler.maximum-am-resource-percent
MAPREDUCE-2774. Add startup message to ResourceManager & NodeManager on
- startup. (Venu Gopala Rao via acmurthy)
+ startup. (Venu Gopala Rao via acmurthy)
MAPREDUCE-2655. Add audit logs to ResourceManager and NodeManager. (Thomas
Graves via acmurthy)
MAPREDUCE-2864. Normalize configuration variable names for YARN. (Robert
- Evans via acmurthy)
+ Evans via acmurthy)
- MAPREDUCE-2690. Web-page for FifoScheduler. (Eric Payne via acmurthy)
+ MAPREDUCE-2690. Web-page for FifoScheduler. (Eric Payne via acmurthy)
MAPREDUCE-2711. Update TestBlockPlacementPolicyRaid for the new namesystem
and block management APIs. (szetszwo)
MAPREDUCE-2933. Change allocate call to return ContainerStatus for
- completed containers rather than Container. (acmurthy)
+ completed containers rather than Container. (acmurthy)
MAPREDUCE-2675. Reformat JobHistory Server main page to be more
useful. (Robert Joseph Evans via vinodkv).
@@ -1179,16 +1180,16 @@ Release 0.23.0 - 2011-11-01
org.apache.hadoop.yarn.api.records.* to be get/set only. Added javadocs to
all public records. (acmurthy)
- MAPREDUCE-2676. MR-279: JobHistory Job page needs reformatted. (Robert Evans via
+ MAPREDUCE-2676. MR-279: JobHistory Job page needs reformatted. (Robert Evans via
mahadev)
- MAPREDUCE-2899. Replace major parts of ApplicationSubmissionContext with a
+ MAPREDUCE-2899. Replace major parts of ApplicationSubmissionContext with a
ContainerLaunchContext (Arun Murthy via mahadev)
MAPREDUCE-2966. Added ShutDown hooks for MRV2 processes so that they can
gracefully exit. (Abhijit Suresh Shingate via vinodkv)
- MAPREDUCE-2672. MR-279: JobHistory Server needs Analysis this job.
+ MAPREDUCE-2672. MR-279: JobHistory Server needs Analysis this job.
(Robert Evans via mahadev)
MAPREDUCE-2965. Streamlined the methods hashCode(), equals(), compareTo()
@@ -1216,9 +1217,9 @@ Release 0.23.0 - 2011-11-01
application's FinalStatus separately. (Hitesh Shah via vinodkv)
MAPREDUCE-2889. Added documentation for writing new YARN applications.
- (Hitesh Shah via acmurthy)
+ (Hitesh Shah via acmurthy)
- MAPREDUCE-3134. Added documentation the CapacityScheduler. (acmurthy)
+ MAPREDUCE-3134. Added documentation the CapacityScheduler. (acmurthy)
MAPREDUCE-3013. Removed YarnConfiguration.YARN_SECURITY_INFO and its usage
as it doesn't affect security any more. (vinodkv)
@@ -1234,21 +1235,21 @@ Release 0.23.0 - 2011-11-01
UI. (Robert Joseph Evans via vinodkv)
MAPREDUCE-2988. Reenabled TestLinuxContainerExecutor reflecting the
- current NodeManager code. (Robert Joseph Evans via vinodkv)
+ current NodeManager code. (Robert Joseph Evans via vinodkv)
MAPREDUCE-3161. Improved some javadocs and fixed some typos in
YARN. (Todd Lipcon via vinodkv)
MAPREDUCE-3148. Ported MAPREDUCE-2702 to old mapred api for aiding task
- recovery. (acmurthy)
+ recovery. (acmurthy)
MAPREDUCE-3133. Running a set of methods in a Single Test Class.
(Jonathan Eagles via mahadev)
- MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate
+ MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate
containers-allocated and aggregate containers-released.
(Devaraj K via mahadev)
-
+
MAPREDUCE-3187. Add names for various unnamed threads in MR2.
(Todd Lipcon and Siddharth Seth via mahadev)
@@ -1261,11 +1262,11 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-3144. Augmented JobHistory with the information needed for
serving aggregated logs. (Siddharth Seth via vinodkv)
-
+
MAPREDUCE-3163. JobClient spews errors when killing MR2 job.
(mahadev)
- MAPREDUCE-3239. Use new createSocketAddr API in MRv2 to give better
+ MAPREDUCE-3239. Use new createSocketAddr API in MRv2 to give better
error messages on misconfig (Todd Lipcon via mahadev)
MAPREDUCE-2747. Cleaned up LinuxContainerExecutor binary sources and changed
@@ -1273,7 +1274,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-3205. Fix memory specifications to be physical rather than
virtual, allowing for a ratio between the two to be configurable. (todd
- via acmurthy)
+ via acmurthy)
MAPREDUCE-2986. Fixed MiniYARNCluster to support multiple NodeManagers.
(Anupam Seth via vinodkv)
@@ -1290,7 +1291,7 @@ Release 0.23.0 - 2011-11-01
acmurthy)
MAPREDUCE-3322. Added a better index.html and an brief overview of YARN
- architecture. (acmurthy)
+ architecture. (acmurthy)
OPTIMIZATIONS
@@ -1308,11 +1309,11 @@ Release 0.23.0 - 2011-11-01
BUG FIXES
- MAPREDUCE-2603. Disable High-Ram emulation in system tests.
+ MAPREDUCE-2603. Disable High-Ram emulation in system tests.
(Vinay Kumar Thota via amarrk)
MAPREDUCE-2539. Fixed NPE in getMapTaskReports in JobClient. (Robert Evans via
- acmurthy)
+ acmurthy)
MAPREDUCE-1978. Rumen TraceBuilder should provide recursive
input folder scanning.
@@ -1331,7 +1332,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-1752. Implement getFileBlockLocations in HarFilesystem.
(Patrick Kling via dhruba)
- MAPREDUCE-2155. RaidNode should optionally use the mapreduce jobs to
+ MAPREDUCE-2155. RaidNode should optionally use the mapreduce jobs to
fix missing blocks. (Patrick Kling via dhruba)
MAPREDUCE-1334. Fix TestIndexUpdater by ignoring _SUCCESS file in HDFS.
@@ -1367,7 +1368,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-1242. Chain APIs error misleading.
(Harsh J Chouraria via tomwhite)
- MAPREDUCE-2379. Adds missing DistributedCache configurations in
+ MAPREDUCE-2379. Adds missing DistributedCache configurations in
mapred-default.xml (Todd Lipcon via amareshwari)
MAPREDUCE-2348. Disable mumak tests on trunk since they currently time out
@@ -1387,7 +1388,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-2451. Log the details from health check script at the
JobTracker. (Thomas Graves via cdouglas)
- MAPREDUCE-2467. HDFS-1052 changes break the raid contrib module in
+ MAPREDUCE-2467. HDFS-1052 changes break the raid contrib module in
MapReduce. (suresh srinivas via mahadev)
MAPREDUCE-2258. IFile reader closes stream and compressor in wrong order.
@@ -1441,7 +1442,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-2409. DistributedCache maps files and archives to the same path,
despite semantic incompatibility. (Siddharth Seth via cdouglas)
- MAPREDUCE-2575. TestMiniMRDFSCaching fails if test.build.dir is set
+ MAPREDUCE-2575. TestMiniMRDFSCaching fails if test.build.dir is set
to something other than build/test (Thomas Graves via mahadev)
MAPREDUCE-2622. Remove the last remaining reference to the deprecated
@@ -1466,12 +1467,12 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-2797. Update mapreduce tests and RAID for HDFS-2239. (szetszwo)
MAPREDUCE-2805. Update RAID for HDFS-2241. (szetszwo)
-
+
MAPREDUCE-2837. Ported bug fixes from y-merge to prepare for MAPREDUCE-279
- merge. (acmurthy)
+ merge. (acmurthy)
MAPREDUCE-2541. Fixed a race condition in IndexCache.removeMap. (Binglin
- Chang via acmurthy)
+ Chang via acmurthy)
MAPREDUCE-2458. Rename sanitized pom.xml in build directory to work around IDE
bug (Luke Lu via mahadev)
@@ -1528,10 +1529,10 @@ Release 0.23.0 - 2011-11-01
ApplicationMaster information. (acmurthy)
MAPREDUCE-279. Fix in MR-279 branch. Fixed computation of user-limits at
- runtime. (acmurthy)
+ runtime. (acmurthy)
MAPREDUCE-279. Fix in MR-279 branch. Added functionality to refresh queues at
- runtime via the 'bin/yarn rmadmin' command. (acmurthy)
+ runtime via the 'bin/yarn rmadmin' command. (acmurthy)
MAPREDUCE-279. Fix in MR-279 branch. Added functionality to stop/start queues.
(acmurthy)
@@ -1552,7 +1553,7 @@ Release 0.23.0 - 2011-11-01
failures. (sharad)
MAPREDUCE-279. Fix in MR-279 branch. Added support High-RAM applications in
- CapacityScheduler. (acmurthy)
+ CapacityScheduler. (acmurthy)
MAPREDUCE-279. Fix in MR-279 branch. Completing the ZooKeeper Store for
ResourceManager state. (mahadev)
@@ -1609,7 +1610,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-279. Fix in MR-279 branch. Fix refreshProxy in ClientServiceDelegate.
(sharad)
- MAPREDUCE-279. Fix in MR-279 branch. Fix Null Pointer in TestUberAM. (sharad)
+ MAPREDUCE-279. Fix in MR-279 branch. Fix Null Pointer in TestUberAM. (sharad)
MAPREDUCE-2478. Improve history server. (Siddharth Seth via sharad)
@@ -1688,7 +1689,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-279. Fix in MR-279 branch. Makes uber-task disabled by default (ddas)
MAPREDUCE-279. Fix in MR-279 branch. Make logging and memory for AM configurable
- for the user via command line (mahadev)
+ for the user via command line (mahadev)
MAPREDUCE-279. Fix in MR-279 branch. Fixing a bug in previous patch (r1103657).
Now bin/yarn truly shouldn't be launched multiple times in a single AM.
@@ -1703,26 +1704,26 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-279. Fix in MR-279 branch. Fix the tests to use jvm fork mode to avoid
errors in shutting down services (sidharth seth)
- MAPREDUCE-2500. PB factories are not thread safe (Siddharth Seth via mahadev)
+ MAPREDUCE-2500. PB factories are not thread safe (Siddharth Seth via mahadev)
MAPREDUCE-2504. race in JobHistoryEventHandler stop (Siddharth Seth via mahadev)
MAPREDUCE-279. Fix in MR-279 branch. Fix job hang if the AM launch fails.
- (mahadev)
+ (mahadev)
- MAPREDUCE-2509. Fix NPE in UI for pending attempts. (Luke Lu via mahadev)
+ MAPREDUCE-2509. Fix NPE in UI for pending attempts. (Luke Lu via mahadev)
MAPREDUCE-279. Fix in MR-279 branch. Add junit jar to lib in assembly (mahadev
and luke)
MAPREDUCE-279. Fix in MR-279 branch. Distributed cache bug fix to pass Terasort.
(vinodkv)
-
+
MAPREDUCE-279. Fix in MR-279 branch. Fix null pointer exception in kill task
attempt (mahadev)
MAPREDUCE-279. Fix in MR-279 branch. Refactored RMContainerAllocator to release
- unused containers. (sharad)
+ unused containers. (sharad)
MAPREDUCE-279. Fix in MR-279 branch. Changed Scheduler to return available limit
to AM in the allocate api. (acmurthy)
@@ -1761,7 +1762,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-279. Fix in MR-279 branch. Add public cache. (cdouglas)
MAPREDUCE-279. Fix in MR-279 branch. Made number of RPC server threads
- configurable. (acmurthy)
+ configurable. (acmurthy)
MAPREDUCE-279. Fix in MR-279 branch. Added acl check for RMAdmin. (acmurthy)
@@ -1820,7 +1821,7 @@ Release 0.23.0 - 2011-11-01
to get log-locations from an environmental variable. (vinodkv)
MAPREDUCE-279. Fix in MR-279 branch. Ensure 'lost' NodeManagers are dealt
- appropriately, the containers are released correctly. (acmurthy)
+ appropriately, the containers are released correctly. (acmurthy)
MAPREDUCE-279. Fix in MR-279 branch. Adding some more logging for AM expiry logs
(mahadev)
@@ -1832,7 +1833,7 @@ Release 0.23.0 - 2011-11-01
tasks. (vinodkv)
MAPREDUCE-279. Fix in MR-279 branch. Added ability to decommission nodes and
- completed RM administration tools to achieve parity with JobTracker. (acmurthy)
+ completed RM administration tools to achieve parity with JobTracker. (acmurthy)
MAPREDUCE-2551. Added JobSummaryLog. (Siddharth Seth via acmurthy)
@@ -1868,14 +1869,14 @@ Release 0.23.0 - 2011-11-01
user-logs to a separate hdfs file. (vinodkv)
MAPREDUCE-279. Fix in MR-279 branch. Fix calculation of max-capacity for a
- queue, also fixed a bug in registration of NodeManagers. (acmurthy)
+ queue, also fixed a bug in registration of NodeManagers. (acmurthy)
MAPREDUCE-279. Fix in MR-279 branch. More cleaning up constants, removing stale
code, and making conspicuous the envs that apps depend on to be provided by
YARN. (vinodkv)
MAPREDUCE-279. Fix in MR-279 branch. Fix container size rounding in AM and
- headroom in RM. (acmurthy and sharad)
+ headroom in RM. (acmurthy and sharad)
MAPREDUCE-279. Fix in MR-279 branch. Disable Job acls until fixed (mahadev)
@@ -1884,7 +1885,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-279. Fix in MR-279 branch. Fix a corner case in headroom computation -
now reservations are taken into account and headroom is computed much later to
- account for allocations/reservations. (acmurthy)
+ account for allocations/reservations. (acmurthy)
MAPREDUCE-2537. The RM writes its log to
yarn-mapred-resourcemanager-<RM_Host>.out (Robert Evans via mahadev)
@@ -1898,10 +1899,10 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-279. Fix in MR-279 branch. Support for min and max container capacity.
(acmurthy and sharad)
- MAPREDUCE-2531. Fixed jobcontrol to downgrade JobID. (Robert Evans via acmurthy)
+ MAPREDUCE-2531. Fixed jobcontrol to downgrade JobID. (Robert Evans via acmurthy)
MAPREDUCE-2539. Fixed NPE in getMapTaskReports in JobClient. (Robert Evans via
- acmurthy)
+ acmurthy)
MAPREDUCE-279. Fix in MR-279 branch. Fixing the wrong config key used in
JobHistory that prevented configuring move-thread interval. (vinodkv)
@@ -1968,7 +1969,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-279. Fix in MR-279 branch. Add ability to includes src files in
assembly target for maven (Luke Lu via mahadev)
- MAPREDUCE-2582. Cleanup JobHistory event generation.(Siddharth Seth via sharad)
+ MAPREDUCE-2582. Cleanup JobHistory event generation.(Siddharth Seth via sharad)
MAPREDUCE-279. Fix in MR-279 branch. Fix rounding off problem in reduce ramp up.
(sharad)
@@ -2097,7 +2098,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-2628. Add compiled on date to NM and RM info/about page.
MAPREDUCE-2400. Remove Cluster's dependency on JobTracker via a ServiceProvider
- for the actual implementation. (tomwhite via acmurthy)
+ for the actual implementation. (tomwhite via acmurthy)
MAPREDUCE-2663. Refactoring StateMachineFactory inner classes. (ahmed radwan via
mahadev)
@@ -2112,7 +2113,7 @@ Release 0.23.0 - 2011-11-01
explicitly set in the Configuration. (Josh Wills via vinodkv)
MAPREDUCE-2661. Fix TaskImpl to not access MapTaskImpl. (Ahmed Radwan via
- sharad)
+ sharad)
HADOOP-6929. Backport changes to MR-279 (mahadev and owen)
@@ -2141,7 +2142,7 @@ Release 0.23.0 - 2011-11-01
mahadev)
MAPREDUCE-279. Fix in MR-279 branch. Fix findbugs warnings in mr-client modules,
- part 1 (mahadev)
+ part 1 (mahadev)
MAPREDUCE-279. Fix in MR-279 branch. Fix findbugs warnings in mr-client modules
part 2 (mahadev)
@@ -2161,9 +2162,9 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-279. Fix in MR-279 branch. Fix for running ant targets to use the
right set of common/test jars (gkesavan via mahadev)
- MAPREDUCE-2782. Unit tests for CapacityScheduler. (acmurthy)
+ MAPREDUCE-2782. Unit tests for CapacityScheduler. (acmurthy)
- MAPREDUCE-2706. Log job submission failures. (Jeffrey Naisbitt via acmurthy)
+ MAPREDUCE-2706. Log job submission failures. (Jeffrey Naisbitt via acmurthy)
MAPREDUCE-2781. mr279 RM application finishtime not set (Thomas Graves via
mahadev)
@@ -2186,7 +2187,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-2727. Fix divide-by-zero error in SleepJob for sleepCount equals
0. (Jeffrey Naisbitt via acmurthy)
-
+
MAPREDUCE-2860. Fix log4j logging in the maven test cases. (mahadev)
MAPREDUCE-2867. Remove Unused TestApplicaitonCleanup in resourcemanager/applicationsmanager.
@@ -2195,41 +2196,41 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-2868. ant build broken in hadoop-mapreduce dir (mahadev, giri and arun via mahadev)
MAPREDUCE-2649. Handling of finished applications in RM. (Thomas Graves
- via acmurthy)
+ via acmurthy)
MAPREDUCE-2838. Fix MapReduce builds to use new hadoop-common test jars.
- (gkesavan via acmurthy)
-
- MAPREDUCE-2859. Fix eclipse plugin contrib module compilation (gkesavan)
+ (gkesavan via acmurthy)
+
+ MAPREDUCE-2859. Fix eclipse plugin contrib module compilation (gkesavan)
MAPREDUCE-2846. Fix missing synchronization in the task log management.
(omalley)
MAPREDUCE-2807. Fix AM restart and client redirection. (sharad)
- MAPREDUCE-2877. Add missing Apache license header in some files in MR
+ MAPREDUCE-2877. Add missing Apache license header in some files in MR
and also add the rat plugin to the poms. (mahadev)
MAPREDUCE-2796. Set start times for MR applications for clients to see.
- (Devaraj K via acmurthy)
+ (Devaraj K via acmurthy)
+
+ MAPREDUCE-2879. Fix version for MR-279 to 0.23.0. (acmurthy)
- MAPREDUCE-2879. Fix version for MR-279 to 0.23.0. (acmurthy)
-
MAPREDUCE-2881. Fix to include log4j 1.2.16 depenency (gkesavan)
MAPREDUCE-2885. Fix mapred-config.sh to look for hadoop-config.sh in
- HADOOP_COMMON_HOME/libexec. (acmurthy)
+ HADOOP_COMMON_HOME/libexec. (acmurthy)
MAPREDUCE-2893. Remove duplicate entry of YarnClientProtocolProvider in
- ClientProtocolProvider services file. (Liang-Chi Hsieh via acmurthy)
+ ClientProtocolProvider services file. (Liang-Chi Hsieh via acmurthy)
MAPREDUCE-2891. Javadoc for AMRMProtocol and related records. (acmurthy)
- MAPREDUCE-2898. Javadoc for ContainerManager protocol and related records.
+ MAPREDUCE-2898. Javadoc for ContainerManager protocol and related records.
(acmurthy)
MAPREDUCE-2904. Fixed bin/yarn to correctly include HDFS jars and
- clean up of stale refs to pre-mavenized Hadoop Common and HDFS.
+ clean up of stale refs to pre-mavenized Hadoop Common and HDFS.
(Sharad Agarwal and Arun C. Murthy via acmurthy)
MAPREDUCE-2737. Update the progress of jobs on client side. (Siddharth Seth
@@ -2237,17 +2238,17 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-2886. Fix Javadoc warnings in MapReduce. (mahadev)
- MAPREDUCE-2897. Javadoc for ClientRMProtocol protocol and related records.
+ MAPREDUCE-2897. Javadoc for ClientRMProtocol protocol and related records.
(acmurthy)
- MAPREDUCE-2916. Ivy build for MRv1 fails with bad organization for
+ MAPREDUCE-2916. Ivy build for MRv1 fails with bad organization for
common daemon. (mahadev)
MAPREDUCE-2917. Fixed corner case in container reservation which led to
- starvation and hung jobs. (acmurthy)
+ starvation and hung jobs. (acmurthy)
MAPREDUCE-2756. Better error handling in JobControl for failed jobs.
- (Robert Evans via acmurthy)
+ (Robert Evans via acmurthy)
MAPREDUCE-2716. MRReliabilityTest job fails because of missing
job-file. (Jeffrey Naisbitt via vinodkv)
@@ -2255,45 +2256,45 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-2882. TestLineRecordReader depends on ant jars. (todd)
MAPREDUCE-2687. Fix NodeManager to use the right version of
- LocalDirAllocator.getLocalPathToWrite. (mahadev & acmurthy)
+ LocalDirAllocator.getLocalPathToWrite. (mahadev & acmurthy)
MAPREDUCE-2800. Set final progress for tasks to ensure all task information
is correctly logged to JobHistory. (Siddharth Seth via acmurthy)
MAPREDUCE-2938. Log application submission failure in CapacityScheduler.
- (acmurthy)
+ (acmurthy)
MAPREDUCE-2948. Hadoop streaming test failure, post MR-2767 (mahadev)
- MAPREDUCE-2908. Fix all findbugs warnings. (vinodkv via acmurthy)
+ MAPREDUCE-2908. Fix all findbugs warnings. (vinodkv via acmurthy)
- MAPREDUCE-2942. TestNMAuditLogger.testNMAuditLoggerWithIP failing (Thomas Graves
+ MAPREDUCE-2942. TestNMAuditLogger.testNMAuditLoggerWithIP failing (Thomas Graves
via mahadev)
MAPREDUCE-2947. Fixed race condition in AuxiliaryServices. (vinodkv via
- acmurthy)
+ acmurthy)
MAPREDUCE-2844. Fixed display of nodes in UI. (Ravi Teja Ch N V via
- acmurthy)
+ acmurthy)
MAPREDUCE-2677. Fixed 404 for some links from HistoryServer. (Robert Evans
- via acmurthy)
+ via acmurthy)
MAPREDUCE-2937. Ensure reason for application failure is displayed to the
- user. (mahadev via acmurthy)
+ user. (mahadev via acmurthy)
- MAPREDUCE-2953. Fix a race condition on submission which caused client to
+ MAPREDUCE-2953. Fix a race condition on submission which caused client to
incorrectly assume application was gone by making submission synchronous
- for RMAppManager. (Thomas Graves via acmurthy)
+ for RMAppManager. (Thomas Graves via acmurthy)
+
+ MAPREDUCE-2963. Fix hang in TestMRJobs. (Siddharth Seth via acmurthy)
- MAPREDUCE-2963. Fix hang in TestMRJobs. (Siddharth Seth via acmurthy)
-
MAPREDUCE-2954. Fixed a deadlock in NM caused due to wrong synchronization
in protocol buffer records. (Siddharth Seth via vinodkv)
MAPREDUCE-2975. Fixed YARNRunner to use YarnConfiguration rather than
- Configuration. (mahadev via acmurthy)
-
+ Configuration. (mahadev via acmurthy)
+
MAPREDUCE-2971. ant build mapreduce fails protected access jc.displayJobList
(jobs) (Thomas Graves via mahadev)
@@ -2313,18 +2314,18 @@ Release 0.23.0 - 2011-11-01
acmurthy)
MAPREDUCE-2995. Better handling of expired containers in MapReduce
- ApplicationMaster. (vinodkv via acmurthy)
+ ApplicationMaster. (vinodkv via acmurthy)
- MAPREDUCE-2995. Fixed race condition in ContainerLauncher. (vinodkv via
- acmurthy)
+ MAPREDUCE-2995. Fixed race condition in ContainerLauncher. (vinodkv via
+ acmurthy)
MAPREDUCE-2949. Fixed NodeManager to shut-down correctly if a service
startup fails. (Ravi Teja via vinodkv)
MAPREDUCE-3005. Fix both FifoScheduler and CapacityScheduler to correctly
- enforce locality constraints. (acmurthy)
+ enforce locality constraints. (acmurthy)
- MAPREDUCE-3007. Fixed Yarn Mapreduce client to be able to connect to
+ MAPREDUCE-3007. Fixed Yarn Mapreduce client to be able to connect to
JobHistoryServer in secure mode. (vinodkv)
MAPREDUCE-2987. Fixed display of logged user on RM Web-UI. (Thomas Graves
@@ -2340,7 +2341,7 @@ Release 0.23.0 - 2011-11-01
reject all NMs. (Devaraj K via vinodkv)
MAPREDUCE-3042. Fixed default ResourceTracker address. (Chris Riccomini
- via acmurthy)
+ via acmurthy)
MAPREDUCE-3038. job history server not starting because conf() missing
HsController (Jeffrey Naisbitt via mahadev)
@@ -2353,9 +2354,9 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-3040. Fixed extra copy of Configuration in
YarnClientProtocolProvider and ensured MiniMRYarnCluster sets JobHistory
- configuration for tests. (acmurthy)
+ configuration for tests. (acmurthy)
- MAPREDUCE-3018. Fixed -file option for streaming. (mahadev via acmurthy)
+ MAPREDUCE-3018. Fixed -file option for streaming. (mahadev via acmurthy)
MAPREDUCE-3036. Fixed metrics for reserved resources in CS. (Robert Evans
via acmurthy)
@@ -2364,16 +2365,16 @@ Release 0.23.0 - 2011-11-01
bin/mapred too many times. (vinodkv via acmurthy)
MAPREDUCE-3023. Fixed clients to display queue state correctly. (Ravi
- Prakash via acmurthy)
+ Prakash via acmurthy)
MAPREDUCE-2970. Fixed NPEs in corner cases with different configurations
for mapreduce.framework.name. (Venu Gopala Rao via vinodkv)
MAPREDUCE-3062. Fixed default RMAdmin address. (Chris Riccomini
- via acmurthy)
+ via acmurthy)
- MAPREDUCE-3066. Fixed default ResourceTracker address for the NodeManager.
- (Chris Riccomini via acmurthy)
+ MAPREDUCE-3066. Fixed default ResourceTracker address for the NodeManager.
+ (Chris Riccomini via acmurthy)
MAPREDUCE-3044. Pipes jobs stuck without making progress. (mahadev)
@@ -2387,7 +2388,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-2990. Fixed display of NodeHealthStatus. (Subroto Sanyal via
- acmurthy)
+ acmurthy)
MAPREDUCE-3053. Better diagnostic message for unknown methods in ProtoBuf
RPCs. (vinodkv via acmurthy)
@@ -2395,12 +2396,12 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-2952. Fixed ResourceManager/MR-client to consume diagnostics
for AM failures in a couple of corner cases. (Arun C Murthy via vinodkv)
- MAPREDUCE-3064. 27 unit test failures with Invalid
- "mapreduce.jobtracker.address" configuration value for
+ MAPREDUCE-3064. 27 unit test failures with Invalid
+ "mapreduce.jobtracker.address" configuration value for
JobTracker: "local" (Venu Gopala Rao via mahadev)
MAPREDUCE-3090. Fix MR AM to use ApplicationAttemptId rather than
- (ApplicationId, startCount) consistently. (acmurthy)
+ (ApplicationId, startCount) consistently. (acmurthy)
MAPREDUCE-2646. Fixed AMRMProtocol to return containers based on
priority. (Sharad Agarwal and Arun C Murthy via vinodkv)
@@ -2411,7 +2412,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-2984. Better error message for displaying completed containers.
(Devaraj K via acmurthy)
- MAPREDUCE-3071. app master configuration web UI link under the Job menu
+ MAPREDUCE-3071. app master configuration web UI link under the Job menu
opens up application menu. (thomas graves via mahadev)
MAPREDUCE-3067. Ensure exit-code is set correctly for containers. (Hitesh
@@ -2426,7 +2427,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-3054. Unable to kill submitted jobs. (mahadev)
MAPREDUCE-3021. Change base urls for RM web-ui. (Thomas Graves via
- acmurthy)
+ acmurthy)
MAPREDUCE-3041. Fixed ClientRMProtocol to provide min/max resource
capabilities along-with new ApplicationId for application submission.
@@ -2450,13 +2451,13 @@ Release 0.23.0 - 2011-11-01
via acmurthy)
MAPREDUCE-3050. Add ability to get resource usage information for
- applications and nodes. (Robert Evans via acmurthy)
+ applications and nodes. (Robert Evans via acmurthy)
MAPREDUCE-3113. Ensure bin/yarn and bin/yarn-daemon.sh identify the root
- of the install properly. (Xie Xianshan via acmurthy)
+ of the install properly. (Xie Xianshan via acmurthy)
MAPREDUCE-2792. Replace usage of node ip-addresses with hostnames.
- (vinodkv via acmurthy)
+ (vinodkv via acmurthy)
MAPREDUCE-3112. Fixed recursive sourcing of HADOOP_OPTS environment
variable. (Eric Yang)
@@ -2467,7 +2468,7 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-2913. Fixed TestMRJobs.testFailingMapper to assert the correct
TaskCompletionEventStatus. (Jonathan Eagles via vinodkv)
- MAPREDUCE-2794. [MR-279] Incorrect metrics value for AvailableGB per
+ MAPREDUCE-2794. [MR-279] Incorrect metrics value for AvailableGB per
queue per user. (John George via mahadev)
MAPREDUCE-2783. Fixing RM web-UI to show no tracking-URL when AM
@@ -2483,19 +2484,19 @@ Release 0.23.0 - 2011-11-01
frameworks. (Hitesh Shah via acmurthy)
MAPREDUCE-2802. Ensure JobHistory filenames have jobId. (Jonathan Eagles
- via acmurthy)
+ via acmurthy)
MAPREDUCE-2876. Use a different config for ContainerAllocationExpirer.
- (Anupam Seth via acmurthy)
+ (Anupam Seth via acmurthy)
MAPREDUCE-3153. Fix TestFileOutputCommitter which was broken by
- MAPREDUCE-2702. (mahadev via acmurthy)
+ MAPREDUCE-2702. (mahadev via acmurthy)
MAPREDUCE-3123. Fix NM to quote symlink names to escape special
- characters. (Hitesh Shah via acmurthy)
+ characters. (Hitesh Shah via acmurthy)
MAPREDUCE-3154. Fix JobSubmitter to check for output specs before copying
- job submission files to fail fast. (Abhijit Suresh Shingate via acmurthy)
+ job submission files to fail fast. (Abhijit Suresh Shingate via acmurthy)
MAPREDUCE-3158. Fix test failures in MRv1 due to default framework being
set to yarn. (Hitesh Shah via acmurthy)
@@ -2510,7 +2511,7 @@ Release 0.23.0 - 2011-11-01
to all the services. (Thomas Graves via vinodkv)
MAPREDUCE-3126. Fixed a corner case in CapacityScheduler where headroom
- wasn't updated on changes to cluster size. (acmurthy)
+ wasn't updated on changes to cluster size. (acmurthy)
MAPREDUCE-3140. Fixed the invalid JobHistory URL for failed
applications. (Subroto Sanyal via vinodkv)
@@ -2519,31 +2520,31 @@ Release 0.23.0 - 2011-11-01
task-attempts for obtaining task's progress. (Hitesh Shah via vinodkv)
MAPREDUCE-2666. Retrieve shuffle port number from JobHistory on MR AM
- restart. (Jonathan Eagles via acmurthy)
+ restart. (Jonathan Eagles via acmurthy)
- MAPREDUCE-2789. Complete schedulingInfo on CLI. (Eric Payne via acmurthy)
+ MAPREDUCE-2789. Complete schedulingInfo on CLI. (Eric Payne via acmurthy)
MAPREDUCE-3170. Fixed job output commit for deep hierarchies. (Hitesh Shah
via acmurthy)
MAPREDUCE-3124. Fixed location of native libs i.e. libhadoop.so for
- containers. (John George via acmurthy)
+ containers. (John George via acmurthy)
- MAPREDUCE-3057. Job History Server goes of OutOfMemory with 1200 Jobs
+ MAPREDUCE-3057. Job History Server goes of OutOfMemory with 1200 Jobs
and Heap Size set to 10 GB. (Eric Payne via mahadev)
MAPREDUCE-2840. mr279 TestUberAM.testSleepJob test fails. (jonathan eagles
via mahadev)
MAPREDUCE-3190. Ensure bin/yarn fails early with a clear error message
- when HADOOP_COMMON_HOME or HADOOP_HDFS_HOME are not set. (todd & acmurthy
+ when HADOOP_COMMON_HOME or HADOOP_HDFS_HOME are not set. (todd & acmurthy
via acmurthy)
MAPREDUCE-3189. Add link decoration back to MR2's CSS. (Todd Lipcon via
mahadev)
-
+
MAPREDUCE-3127. Changed default value of yarn.resourcemanager.acl.enable
- to true and added some more documentation. (acmurthy)
+ to true and added some more documentation. (acmurthy)
MAPREDUCE-3032. Fixed TaskAttemptImpl so that JobHistory can have error
information about failed tasks. (Devaraj K via vinodkv)
@@ -2551,14 +2552,14 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-3196. TestLinuxContainerExecutorWithMocks fails on Mac OSX.
(Arun Murthy via mahadev)
- MAPREDUCE-3197. TestMRClientService failing on building clean checkout of
+ MAPREDUCE-3197. TestMRClientService failing on building clean checkout of
branch 0.23 (mahadev)
MAPREDUCE-2762. Cleanup MR staging directory on completion. (mahadev via
- acmurthy)
+ acmurthy)
MAPREDUCE-3165. Ensure logging options are set correctly for MR AM and
- tasks. (todd via acmurthy)
+ tasks. (todd via acmurthy)
MAPREDUCE-3203. Fix some javac warnings in MRAppMaster. (mahadev)
@@ -2572,30 +2573,30 @@ Release 0.23.0 - 2011-11-01
of wrong framework name. (Hitesh Shah via vinodkv)
MAPREDUCE-3181. Fixed MapReduce runtime to load yarn-default.xml and
- yarn-site.xml. (acmurthy)
+ yarn-site.xml. (acmurthy)
MAPREDUCE-2788. Normalize resource requests in FifoScheduler
- appropriately. (Ahmed Radwan via acmurthy)
+ appropriately. (Ahmed Radwan via acmurthy)
- MAPREDUCE-2693. Fix NPE in job-blacklisting. (Hitesh Shah via acmurthy)
+ MAPREDUCE-2693. Fix NPE in job-blacklisting. (Hitesh Shah via acmurthy)
MAPREDUCE-3208. Fix NPE task/container log appenders. (liangzhwa via
- acmurthy)
+ acmurthy)
- MAPREDUCE-3212. Fix usage/help message for bin/yarn. (Bhallamudi Venkata
- Siva Kamesh via acmurthy)
+ MAPREDUCE-3212. Fix usage/help message for bin/yarn. (Bhallamudi Venkata
+ Siva Kamesh via acmurthy)
MAPREDUCE-3179. Ensure failed tests exit with right error code. (Jonathan
Eagles via acmurthy)
- MAPREDUCE-3188. Ensure correct shutdown in services. (todd via acmurthy)
+ MAPREDUCE-3188. Ensure correct shutdown in services. (todd via acmurthy)
- MAPREDUCE-3226. Fix shutdown of fetcher threads. (vinodkv via acmurthy)
+ MAPREDUCE-3226. Fix shutdown of fetcher threads. (vinodkv via acmurthy)
MAPREDUCE-3070. Fix NodeManager to use ephemeral ports by default.
- (Devaraj K via acmurthy)
+ (Devaraj K via acmurthy)
- MAPREDUCE-3242. Trunk compilation broken with bad interaction from
+ MAPREDUCE-3242. Trunk compilation broken with bad interaction from
MAPREDUCE-3070 and MAPREDUCE-3239. (mahadev)
MAPREDUCE-3058. Fixed MR YarnChild to report failure when task throws an
@@ -2608,10 +2609,10 @@ Release 0.23.0 - 2011-11-01
application on AM crash. (Mahadev Konar via vinodkv)
MAPREDUCE-3028. Added job-end notification support. (Ravi Prakash via
- acmurthy)
+ acmurthy)
- MAPREDUCE-3249. Ensure shuffle-port is correctly used duringMR AM recovery.
- (vinodkv via acmurthy)
+ MAPREDUCE-3249. Ensure shuffle-port is correctly used duringMR AM recovery.
+ (vinodkv via acmurthy)
MAPREDUCE-3252. Fix map tasks to not rewrite data an extra time when
map output fits in spill buffer. (todd)
@@ -2619,31 +2620,31 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-3159. Ensure DefaultContainerExecutor doesn't delete application
directories during app-init. (todd via acmurthy)
- MAPREDUCE-3248. Fixed log4j properties. (vinodkv via acmurthy)
+ MAPREDUCE-3248. Fixed log4j properties. (vinodkv via acmurthy)
- MAPREDUCE-2746. Yarn servers can't communicate with each other with
+ MAPREDUCE-2746. Yarn servers can't communicate with each other with
hadoop.security.authorization set to true (acmurthy via mahadev)
MAPREDUCE-2821. Added missing fields (resourcePerMap & resourcePerReduce)
to JobSummary logs. (mahadev via acmurthy)
MAPREDUCE-3253. Fixed ContextFactory to clone JobContext correctly.
- (acmurthy)
+ (acmurthy)
MAPREDUCE-3263. Fixed the MAPREDUCE-3028 commit which broke MR1. (Hitesh
- Shah via acmurthy)
+ Shah via acmurthy)
MAPREDUCE-3269. Fixed log4j properties to correctly set logging options
- for JobHistoryServer vis-a-vis JobSummary logs. (mahadev via acmurthy)
+ for JobHistoryServer vis-a-vis JobSummary logs. (mahadev via acmurthy)
MAPREDUCE-2977. Fix ResourceManager to renew HDFS delegation tokens for
- applications. (acmurthy)
+ applications. (acmurthy)
- MAPREDUCE-3250. When AM restarts, client keeps reconnecting to the new AM
+ MAPREDUCE-3250. When AM restarts, client keeps reconnecting to the new AM
and prints a lots of logs. (vinodkv via mahadev)
MAPREDUCE-3254. Fixed streaming to set the job.jar by using the right
- JobConf ctor. (acmurthy)
+ JobConf ctor. (acmurthy)
MAPREDUCE-3264. mapreduce.job.user.name needs to be set automatically.
(acmurthy via mahadev)
@@ -2652,10 +2653,10 @@ Release 0.23.0 - 2011-11-01
etc. (Jonathan Eagles via acmurthy)
MAPREDUCE-3257. Added authorization checks for the protocol between
- ResourceManager and ApplicationMaster. (vinodkv via acmurthy)
+ ResourceManager and ApplicationMaster. (vinodkv via acmurthy)
MAPREDUCE-3259. Added java.library.path of NodeManager to
- ContainerLocalizer in LinuxContainerExecutor. (Kihwal Lee via acmurthy)
+ ContainerLocalizer in LinuxContainerExecutor. (Kihwal Lee via acmurthy)
MAPREDUCE-3279. Fixed TestJobHistoryParsing which assumed user name to be
mapred all the time. (Siddharth Seth via acmurthy)
@@ -2670,13 +2671,13 @@ Release 0.23.0 - 2011-11-01
via acmurthy)
MAPREDUCE-3284. Moved JobQueueClient to hadoop-mapreduce-client-core.
- (acmurthy)
+ (acmurthy)
- MAPREDUCE-3282. bin/mapred job -list throws exception. (acmurthy via
+ MAPREDUCE-3282. bin/mapred job -list throws exception. (acmurthy via
mahadev)
MAPREDUCE-3186. User jobs are getting hanged if the Resource manager
- process goes down and comes up while job is getting executed.
+ process goes down and comes up while job is getting executed.
(Eric Payne via mahadev)
MAPREDUCE-3209. Jenkins reports 160 FindBugs warnings (mahadev)
@@ -2684,13 +2685,13 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-3258. Fixed AM & JobHistory web-ui to display counters properly.
(Siddharth Seth via acmurthy)
- MAPREDUCE-3290. Fixed a NPE in ClientRMService. (acmurthy)
+ MAPREDUCE-3290. Fixed a NPE in ClientRMService. (acmurthy)
MAPREDUCE-3185. RM Web UI does not sort the columns in some cases.
(Jonathan Eagles via mahadev)
- MAPREDUCE-3292. In secure mode job submission fails with Provider
- org.apache.hadoop.mapreduce.security.token.JobTokenIndentifier$Renewer
+ MAPREDUCE-3292. In secure mode job submission fails with Provider
+ org.apache.hadoop.mapreduce.security.token.JobTokenIndentifier$Renewer
not found. (mahadev)
MAPREDUCE-3296. Fixed the remaining nine FindBugs warnings. (vinodkv)
@@ -2699,13 +2700,13 @@ Release 0.23.0 - 2011-11-01
decommissioned node to shutdown. (Devaraj K via vinodkv)
MAPREDUCE-3304. Fixed intermittent test failure due to a race in
- TestRMContainerAllocator#testBlackListedNodes. (Ravi Prakash via acmurthy)
+ TestRMContainerAllocator#testBlackListedNodes. (Ravi Prakash via acmurthy)
MAPREDUCE-3306. Fixed a bug in NodeManager ApplicationImpl that was causing
NodeManager to crash. (vinodkv)
MAPREDUCE-3256. Added authorization checks for the protocol between
- NodeManager and ApplicationMaster. (vinodkv via acmurthy)
+ NodeManager and ApplicationMaster. (vinodkv via acmurthy)
MAPREDUCE-3274. Fixed a race condition in MRAppMaster that was causing a
task-scheduling deadlock. (Robert Joseph Evans via vinodkv)
@@ -2727,11 +2728,11 @@ Release 0.23.0 - 2011-11-01
(chakravarthy via acmurthy)
MAPREDUCE-3321. Disabled a few MR tests for 0.23. (Hitesh Shah via
- acmurthy)
+ acmurthy)
- MAPREDUCE-3220. Fixed TestCombineOutputCollector. (Devaraj K via acmurthy)
+ MAPREDUCE-3220. Fixed TestCombineOutputCollector. (Devaraj K via acmurthy)
- MAPREDUCE-3103. Implement Job ACLs for MRAppMaster.
+ MAPREDUCE-3103. Implement Job ACLs for MRAppMaster.
(mahadev)
MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
@@ -2750,9 +2751,9 @@ Release 0.23.0 - 2011-11-01
(jitendra)
MAPREDUCE-3237. Move LocalJobRunner to hadoop-mapreduce-client-core.
- (tomwhite via acmurthy)
+ (tomwhite via acmurthy)
- MAPREDUCE-3316. Rebooted link is not working properly.
+ MAPREDUCE-3316. Rebooted link is not working properly.
(Bhallamudi Venkata Siva Kamesh via mahadev)
MAPREDUCE-3317. Rumen TraceBuilder is emiting null as hostname.
@@ -2761,8 +2762,8 @@ Release 0.23.0 - 2011-11-01
MAPREDUCE-3332. contrib/raid compile breaks due to changes in hdfs/protocol/datatransfer/
Sender#writeBlock related to checksum handling (Hitesh Shah via mahadev)
- MAPREDUCE-3337. Added missing license headers. (acmurthy)
-
+ MAPREDUCE-3337. Added missing license headers. (acmurthy)
+
Release 0.22.1 - Unreleased
INCOMPATIBLE CHANGES
@@ -2776,7 +2777,7 @@ Release 0.22.1 - Unreleased
BUG FIXES
MAPREDUCE-3837. Job tracker is not able to recover jobs after crash.
- (Mayank Bansal via shv)
+ (Mayank Bansal via shv)
Release 0.22.0 - 2011-11-29
@@ -2865,7 +2866,7 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-1851. Documents configuration parameters in streaming.
(amareshwari)
-
+
MAPREDUCE-1868. Add a read and connection timeout to JobClient while
pulling tasklogs. (Krishna Ramachandran via acmurthy)
@@ -2885,7 +2886,7 @@ Release 0.22.0 - 2011-11-29
Also includes compatibility with security enhancements, and scalability
improvements. (Amar Kamat, Rahul Singh, Hong Tang, and cdouglas)
- MAPREDUCE-1848. Put number of speculative, data local, rack local
+ MAPREDUCE-1848. Put number of speculative, data local, rack local
tasks in JobTracker metrics. (Scott Chen via dhruba)
MAPREDUCE-1935. Makes the Distcp to work in a secure environment.
@@ -2903,8 +2904,8 @@ Release 0.22.0 - 2011-11-29
specify a credentials file. The tokens from there will be passed to the job.
(Jitendra Pandey and Owen O'Malley via ddas)
- MAPREDUCE-1624. Documents the job credentials and associated details to do
- with delegation tokens (on the client side).
+ MAPREDUCE-1624. Documents the job credentials and associated details to do
+ with delegation tokens (on the client side).
(Jitendra Pandey and Devaraj Das via ddas)
MAPREDUCE-1834. TestSimulatorDeterministicReplay timesout on trunk.
@@ -2923,7 +2924,7 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-1881. Improve TaskTrackerInstrumentation to enable collection of
advanced metrics. (Matei Zaharia via acmurthy)
- MAPREDUCE-1548. Hadoop archives preserve times and other properties from
+ MAPREDUCE-1548. Hadoop archives preserve times and other properties from
original files. (Rodrigo Schmidt via dhruba)
MAPREDUCE-1517. Supports streaming job to run in the background. (Bochun Bai
@@ -2936,7 +2937,7 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-2147. Remove redundant lines in JobInProgress ctor.
(Harsh J Chouraria via cutting)
-
+
HADOOP-7007. Update the hudson-test-patch ant target to work with the
latest test-patch.sh script (gkesavan)
@@ -2949,7 +2950,7 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-1892. RaidNode can allow layered policies more efficiently.
(Ramkumar Vadali via schen)
- MAPREDUCE-1592. Generate Eclipse's .classpath file from Ivy config.
+ MAPREDUCE-1592. Generate Eclipse's .classpath file from Ivy config.
(tomwhite via nigel)
MAPREDUCE-2073. TestTrackerDistributedCacheManager should be up-front
@@ -2994,13 +2995,13 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-2505. Explain how to use ACLs in the fair scheduler.
(matei via eli)
- MAPREDUCE-3138. Add a utility to help applications bridge changes in
+ MAPREDUCE-3138. Add a utility to help applications bridge changes in
Context Objects APIs due to MAPREDUCE-954. (omalley via acmurthy)
OPTIMIZATIONS
MAPREDUCE-1354. Enhancements to JobTracker for better performance and
- scalability. (Arun C. Murthy & Richard King via acmurthy)
+ scalability. (Arun C. Murthy & Richard King via acmurthy)
MAPREDUCE-1829. JobInProgress.findSpeculativeTask should use min() to
find the candidate instead of sort(). (Scott Chen via vinodkv)
@@ -3012,12 +3013,12 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-1707. TaskRunner can get NPE in getting ugi from TaskTracker.
(Vinod Kumar Vavilapalli)
-
+
MAPREDUCE-1532. Ensures that delegation tokens is obtained as the
actual user when the proxy-user is used for submitting jobs. Also
refactors the DelegationTokenToRenew class. (ddas)
- MAPREDUCE-1558. Fixes MRAdmin to look up the principal of the
+ MAPREDUCE-1558. Fixes MRAdmin to look up the principal of the
JobTracker and use that in the RefreshUserToGroupsMapping protocol and
RefreshAuthorizationPolicyProtocol. (Boris Shkolnik via ddas)
@@ -3041,7 +3042,7 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-1225. Fixes DistributedCache to check if the file is fresh or not,
for the first localization also. (Zhong Wang via amareshwari)
- MAPREDUCE-1559. Fixes the token renewer to use the JobTracker's
+ MAPREDUCE-1559. Fixes the token renewer to use the JobTracker's
credentials for talking to the NameNode. (ddas)
MAPREDUCE-1492. Delete obsolete har files used on the parity files
@@ -3059,13 +3060,13 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-1864. Removes uninitialized/unused variables in
org.apache.hadoop.streaming.PipeMapRed. (amareshwari)
- MAPREDUCE-1888. Fixes Streaming to override output key and value types,
+ MAPREDUCE-1888. Fixes Streaming to override output key and value types,
only if mapper/reducer is a command. (Ravi Gummadi via amareshwari)
MAPREDUCE-577. Fixes duplicate records in StreamXmlRecordReader.
(Ravi Gummadi via amareshwari)
- MAPREDUCE-1894. Fixed a bug in DistributedRaidFileSystem.readFully()
+ MAPREDUCE-1894. Fixed a bug in DistributedRaidFileSystem.readFully()
that was causing it to loop infinitely. (Ramkumar Vadali via dhruba)
MAPREDUCE-1838. Reduce the time needed for raiding a bunch of files
@@ -3084,7 +3085,7 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-1621. Fixes NPE in TextOutputReader.getLastOutput if it has never
read any output. (amareshwari)
- MAPREDUCE-1911. Fixes errors in -info message in streaming. (amareshwari)
+ MAPREDUCE-1911. Fixes errors in -info message in streaming. (amareshwari)
MAPREDUCE-1772. Corrects errors in streaming documentation in forrest.
(amareshwari)
@@ -3095,7 +3096,7 @@ Release 0.22.0 - 2011-11-29
mapping that the tasks use at runtime for looking up delegation tokens.
(Boris Shkolnik via ddas)
- MAPREDUCE-1701. Fixes a problem to do with exception handling in
+ MAPREDUCE-1701. Fixes a problem to do with exception handling in
delegation-token renewals. (Boris Shkolnik via ddas)
MAPREDUCE-1686. Fixes StreamUtil.goodClassOrNull to find classes without
@@ -3105,7 +3106,7 @@ Release 0.22.0 - 2011-11-29
the owner of the localized file in the mapping from cache URIs to
CacheStatus objects. (ddas)
- MAPREDUCE-1982. Fixes Rumen's TraceBuilder to extract job name from either
+ MAPREDUCE-1982. Fixes Rumen's TraceBuilder to extract job name from either
of configuration properties "mapreduce.job.name" and "mapred.job.name".
(Ravi Gummadi via amareshwari)
@@ -3118,7 +3119,7 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-1992. Fixes a problem to do with bringing up the JobTracker in
unsecure mode. (Kan Zhang via ddas)
- MAPREDUCE-1999. Fixes ClientProtocol to use the correct
+ MAPREDUCE-1999. Fixes ClientProtocol to use the correct
DelegationTokenSelector. (Jitendra Pandey via ddas)
MAPREDUCE-1780. AccessControlList.toString() is used for serialization of
@@ -3135,7 +3136,7 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-1670. RAID policies should not scan their own destination path.
(Ramkumar Vadali via dhruba)
- MAPREDUCE-1668. RaidNode Hars a directory only if all its parity files
+ MAPREDUCE-1668. RaidNode Hars a directory only if all its parity files
have been created. (Ramkumar Vadali via dhruba)
MAPREDUCE-2021. Fixes duplicate hostnames in CombineFileInputFormat's
@@ -3180,7 +3181,7 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-2029. DistributedRaidFileSystem removes itself from FileSystem
cache when it is closed. (Ramkumar Vadali via dhruba)
- MAPREDUCE-1816. HAR files used for RAID parity-bite have configurable
+ MAPREDUCE-1816. HAR files used for RAID parity-bite have configurable
partfile size. (Ramkumar Vadali via dhruba)
MAPREDUCE-2082. Fixes Pipes to create the jobtoken file in the right
@@ -3266,7 +3267,7 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-2283. Add timeout for Raid Tests (Ramkumar Vadali via schen)
- MAPREDUCE-1754. Replace mapred.persmissions.supergroup with an
+ MAPREDUCE-1754. Replace mapred.persmissions.supergroup with an
acl : mapreduce.cluster.administrators (Amareshwari Sriramadasu via shv)
MAPREDUCE-2256. FairScheduler fairshare preemption from multiple pools may
@@ -3278,7 +3279,7 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-2200. TestUmbilicalProtocolWithJobToken is failing without Krb
evironment: needs to be conditional. (cos)
- MAPREDUCE-2077. Resolve name clash in the deprecated
+ MAPREDUCE-2077. Resolve name clash in the deprecated
o.a.h.util.MemoryCalculatorPlugin (Luke Lu via shv)
MAPREDUCE-2188. The new API MultithreadedMapper doesn't initialize
@@ -3318,7 +3319,7 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-2336. Tool-related packages should be in the Tool javadoc group.
(tomwhite)
-
+
MAPREDUCE-2394. JUnit output format doesn't propagate into raid contrib
build. (todd)
@@ -3363,14 +3364,14 @@ Release 0.22.0 - 2011-11-29
MAPREDUCE-2767. Remove Linux task-controller. (Milind Bhandarkar via shv)
- MAPREDUCE-2991. queueinfo.jsp fails to show queue status for Capacity
+ MAPREDUCE-2991. queueinfo.jsp fails to show queue status for Capacity
scheduler if queue names contain special symbols. (Priyo Mustafi via shv)
MAPREDUCE-2779. JobSplitWriter.java can't handle large job.split file.
(Ming Ma via shv)
MAPREDUCE-2531. Fixed jobcontrol to downgrade JobID. (Robert Evans via
- acmurthy)
+ acmurthy)
MAPREDUCE-3139. SlivePartitioner generates negative partitions. (jghoman)
@@ -3411,18 +3412,18 @@ Release 0.21.1 - Unreleased
MAPREDUCE-2317. Fix a NPE in HadoopArchives. (Devaraj K via szetszwo)
- MAPREDUCE-2127. mapreduce trunk builds are filing on hudson.
+ MAPREDUCE-2127. mapreduce trunk builds are filing on hudson.
(Bruno Mahé via eli)
Release 0.21.0 - 2010-08-13
INCOMPATIBLE CHANGES
- MAPREDUCE-516. Fix the starvation problem in the Capacity Scheduler
+ MAPREDUCE-516. Fix the starvation problem in the Capacity Scheduler
when running High RAM Jobs. (Arun Murthy via yhemanth)
- MAPREDUCE-358. Change org.apache.hadoop.examples. AggregateWordCount
- and org.apache.hadoop.examples.AggregateWordHistogram to use new
+ MAPREDUCE-358. Change org.apache.hadoop.examples. AggregateWordCount
+ and org.apache.hadoop.examples.AggregateWordHistogram to use new
mapreduce api. (Amareshwari Sriramadasu via sharad)
MAPREDUCE-245. Change Job and jobcontrol classes to use the List interface
@@ -3431,7 +3432,7 @@ Release 0.21.0 - 2010-08-13
MAPREDUCE-766. Enhanced list-blacklisted-trackers to display reasons
for blacklisting a node. (Sreekanth Ramakrishnan via yhemanth)
- MAPREDUCE-817. Add a cache for retired jobs with minimal job info and
+ MAPREDUCE-817. Add a cache for retired jobs with minimal job info and
provide a way to access history file url. (sharad)
MAPREDUCE-711. Moved Distributed Cache from Common to Map/Reduce
@@ -3444,16 +3445,16 @@ Release 0.21.0 - 2010-08-13
MAPREDUCE-479. Provide full task id to map output servlet rather than the
reduce id, only. (Jiaqi Tan via cdouglas)
- MAPREDUCE-873. Simplify job recovery. Incomplete jobs are resubmitted on
+ MAPREDUCE-873. Simplify job recovery. Incomplete jobs are resubmitted on
jobtracker restart. Removes a public constructor in JobInProgress. (sharad)
HADOOP-6230. Moved process tree and memory calculator related classes from
Common to Map/Reduce. (Vinod Kumar Vavilapalli via yhemanth)
- MAPREDUCE-157. Refactor job history APIs and change the history format to
+ MAPREDUCE-157. Refactor job history APIs and change the history format to
JSON. (Jothi Padmanabhan via sharad)
- MAPREDUCE-849. Rename configuration properties. (Amareshwari Sriramadasu
+ MAPREDUCE-849. Rename configuration properties. (Amareshwari Sriramadasu
via sharad)
MAPREDUCE-1287. Only call the partitioner with more than one reducer.
@@ -3470,7 +3471,7 @@ Release 0.21.0 - 2010-08-13
MAPREDUCE-1683. Remove JNI calls from ClusterStatus cstr. (Arun Murthy and
Luke Lu via cdouglas)
- MAPREDUCE-1855. Makes the refresh methods (for groups and proxy users)
+ MAPREDUCE-1855. Makes the refresh methods (for groups and proxy users)
independent of the client side configuration. (Boris Shkolnik via ddas)
NEW FEATURES
@@ -3496,17 +3497,17 @@ Release 0.21.0 - 2010-08-13
MAPREDUCE-637. Add an example, distbbp, which able to compute the n th bit
of Pi for some large n. (szetszwo)
- MAPREDUCE-532. Provide a way to limit the number of used slots
+ MAPREDUCE-532. Provide a way to limit the number of used slots
per queue in the capacity scheduler.
(Rahul Kumar Singh via yhemanth)
- MAPREDUCE-467. Provide ability to collect statistics about total tasks
+ MAPREDUCE-467. Provide ability to collect statistics about total tasks
and succeeded tasks in different time windows. (sharad)
MAPREDUCE-740. Log a job-summary at the end of a job, while allowing it
to be configured to use a custom appender if desired. (acmurthy)
- MAPREDUCE-814. Provide a way to configure completed job history files
+ MAPREDUCE-814. Provide a way to configure completed job history files
to be on HDFS. (sharad)
MAPREDUCE-800. MRUnit should support the new API. (Aaron Kimball via
@@ -3518,7 +3519,7 @@ Release 0.21.0 - 2010-08-13
MAPREDUCE-768. Provide an option to dump jobtracker configuration in JSON
format to standard output. (V.V.Chaitanya Krishna via yhemanth)
[... 711 lines stripped ...]