You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by dh...@apache.org on 2008/11/13 19:45:36 UTC
svn commit: r713782 - in /hadoop/core/branches/branch-0.19: CHANGES.txt
src/mapred/org/apache/hadoop/mapred/MultiFileSplit.java
Author: dhruba
Date: Thu Nov 13 10:45:36 2008
New Revision: 713782
URL: http://svn.apache.org/viewvc?rev=713782&view=rev
Log:
HADOOP-4500. Fix MultiFileSplit to get the FileSystem from the relevant
path rather than the JobClient. (Joydeep Sen Sarma via dhruba)
Modified:
hadoop/core/branches/branch-0.19/CHANGES.txt
hadoop/core/branches/branch-0.19/src/mapred/org/apache/hadoop/mapred/MultiFileSplit.java
Modified: hadoop/core/branches/branch-0.19/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.19/CHANGES.txt?rev=713782&r1=713781&r2=713782&view=diff
==============================================================================
--- hadoop/core/branches/branch-0.19/CHANGES.txt (original)
+++ hadoop/core/branches/branch-0.19/CHANGES.txt Thu Nov 13 10:45:36 2008
@@ -976,6 +976,9 @@
HADOOP-4471. Sort running jobs by priority in the capacity scheduler.
(Amar Kamat via yhemanth)
+ HADOOP-4500. Fix MultiFileSplit to get the FileSystem from the relevant
+ path rather than the JobClient. (Joydeep Sen Sarma via dhruba)
+
Release 0.18.3 - Unreleased
BUG FIXES
Modified: hadoop/core/branches/branch-0.19/src/mapred/org/apache/hadoop/mapred/MultiFileSplit.java
URL: http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.19/src/mapred/org/apache/hadoop/mapred/MultiFileSplit.java?rev=713782&r1=713781&r2=713782&view=diff
==============================================================================
--- hadoop/core/branches/branch-0.19/src/mapred/org/apache/hadoop/mapred/MultiFileSplit.java (original)
+++ hadoop/core/branches/branch-0.19/src/mapred/org/apache/hadoop/mapred/MultiFileSplit.java Thu Nov 13 10:45:36 2008
@@ -90,9 +90,8 @@
public String[] getLocations() throws IOException {
HashSet<String> hostSet = new HashSet<String>();
- JobClient jClient = new JobClient(job);
- FileSystem fs = jClient.getFs();
for (Path file : paths) {
+ FileSystem fs = file.getFileSystem(job);
FileStatus status = fs.getFileStatus(file);
BlockLocation[] blkLocations = fs.getFileBlockLocations(status,
0, status.getLen());