You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pig.apache.org by ga...@apache.org on 2009/07/20 19:41:01 UTC
svn commit: r795931 - in /hadoop/pig/trunk: CHANGES.txt
src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java
Author: gates
Date: Mon Jul 20 17:41:01 2009
New Revision: 795931
URL: http://svn.apache.org/viewvc?rev=795931&view=rev
Log:
PIG-878: Pig is returning too many blocks in the input split.
Modified:
hadoop/pig/trunk/CHANGES.txt
hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java
Modified: hadoop/pig/trunk/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/pig/trunk/CHANGES.txt?rev=795931&r1=795930&r2=795931&view=diff
==============================================================================
--- hadoop/pig/trunk/CHANGES.txt (original)
+++ hadoop/pig/trunk/CHANGES.txt Mon Jul 20 17:41:01 2009
@@ -40,6 +40,8 @@
BUG FIXES
+ PIG-878: Pig is returning too many blocks in the input split. (arunc via gates).
+
PIG-888: Pig do not pass udf to the backend in some situation (daijy)
PIG-728: All backend error messages must be logged to preserve the
Modified: hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java
URL: http://svn.apache.org/viewvc/hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java?rev=795931&r1=795930&r2=795931&view=diff
==============================================================================
--- hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java (original)
+++ hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java Mon Jul 20 17:41:01 2009
@@ -92,7 +92,7 @@
for (String loc : wrapped.getLocations()) {
Path path = new Path(loc);
FileStatus status = fs.getFileStatus(path);
- BlockLocation[] b = fs.getFileBlockLocations(status, 0, status.getLen());
+ BlockLocation[] b = fs.getFileBlockLocations(status, wrapped.getStart(), wrapped.getLength());
int total = 0;
for (int i = 0; i < b.length; i++) {
total += b[i].getHosts().length;