You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by dh...@apache.org on 2008/11/13 19:45:36 UTC

svn commit: r713782 - in /hadoop/core/branches/branch-0.19: CHANGES.txt src/mapred/org/apache/hadoop/mapred/MultiFileSplit.java

Author: dhruba
Date: Thu Nov 13 10:45:36 2008
New Revision: 713782

URL: http://svn.apache.org/viewvc?rev=713782&view=rev
Log:
HADOOP-4500. Fix MultiFileSplit to get the FileSystem from the relevant
path rather than the JobClient. (Joydeep Sen Sarma via dhruba)


Modified:
    hadoop/core/branches/branch-0.19/CHANGES.txt
    hadoop/core/branches/branch-0.19/src/mapred/org/apache/hadoop/mapred/MultiFileSplit.java

Modified: hadoop/core/branches/branch-0.19/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.19/CHANGES.txt?rev=713782&r1=713781&r2=713782&view=diff
==============================================================================
--- hadoop/core/branches/branch-0.19/CHANGES.txt (original)
+++ hadoop/core/branches/branch-0.19/CHANGES.txt Thu Nov 13 10:45:36 2008
@@ -976,6 +976,9 @@
     HADOOP-4471. Sort running jobs by priority in the capacity scheduler.
     (Amar Kamat via yhemanth) 
 
+    HADOOP-4500. Fix MultiFileSplit to get the FileSystem from the relevant
+    path rather than the JobClient. (Joydeep Sen Sarma via dhruba)
+
 Release 0.18.3 - Unreleased
 
   BUG FIXES

Modified: hadoop/core/branches/branch-0.19/src/mapred/org/apache/hadoop/mapred/MultiFileSplit.java
URL: http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.19/src/mapred/org/apache/hadoop/mapred/MultiFileSplit.java?rev=713782&r1=713781&r2=713782&view=diff
==============================================================================
--- hadoop/core/branches/branch-0.19/src/mapred/org/apache/hadoop/mapred/MultiFileSplit.java (original)
+++ hadoop/core/branches/branch-0.19/src/mapred/org/apache/hadoop/mapred/MultiFileSplit.java Thu Nov 13 10:45:36 2008
@@ -90,9 +90,8 @@
 
   public String[] getLocations() throws IOException {
     HashSet<String> hostSet = new HashSet<String>();
-    JobClient jClient = new JobClient(job);
-    FileSystem fs = jClient.getFs();
     for (Path file : paths) {
+      FileSystem fs = file.getFileSystem(job);
       FileStatus status = fs.getFileStatus(file);
       BlockLocation[] blkLocations = fs.getFileBlockLocations(status,
                                           0, status.getLen());