You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pig.apache.org by ga...@apache.org on 2009/07/31 20:49:21 UTC
svn commit: r799694 - in /hadoop/pig/branches/branch-0.3: CHANGES.txt
src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java
Author: gates
Date: Fri Jul 31 18:49:21 2009
New Revision: 799694
URL: http://svn.apache.org/viewvc?rev=799694&view=rev
Log:
PIG-878: Pig is returning too many blocks in the input split. (arunc via gates).
Modified:
hadoop/pig/branches/branch-0.3/CHANGES.txt
hadoop/pig/branches/branch-0.3/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java
Modified: hadoop/pig/branches/branch-0.3/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/pig/branches/branch-0.3/CHANGES.txt?rev=799694&r1=799693&r2=799694&view=diff
==============================================================================
--- hadoop/pig/branches/branch-0.3/CHANGES.txt (original)
+++ hadoop/pig/branches/branch-0.3/CHANGES.txt Fri Jul 31 18:49:21 2009
@@ -20,6 +20,10 @@
Pig Change Log
+BUG FIXES
+
+PIG-878: Pig is returning too many blocks in the input split. (arunc via gates).
+
Release 0.3.0 - 06/16/09
INCOMPATIBLE CHANGES
Modified: hadoop/pig/branches/branch-0.3/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java
URL: http://svn.apache.org/viewvc/hadoop/pig/branches/branch-0.3/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java?rev=799694&r1=799693&r2=799694&view=diff
==============================================================================
--- hadoop/pig/branches/branch-0.3/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java (original)
+++ hadoop/pig/branches/branch-0.3/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java Fri Jul 31 18:49:21 2009
@@ -92,7 +92,7 @@
for (String loc : wrapped.getLocations()) {
Path path = new Path(loc);
FileStatus status = fs.getFileStatus(path);
- BlockLocation[] b = fs.getFileBlockLocations(status, 0, status.getLen());
+ BlockLocation[] b = fs.getFileBlockLocations(status, wrapped.getStart(), wrapped.getLength());
int total = 0;
for (int i = 0; i < b.length; i++) {
total += b[i].getHosts().length;