[jira] Updated: (MAPREDUCE-1480) CombineFileRecordReader does not properly initialize child RecordReader

["dhruba borthakur (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

dhruba borthakur updated MAPREDUCE-1480:
----------------------------------------

    Status: Open  (was: Patch Available)

The code to initialize the reader looks right. However, the getProgress() method might need some more work. here is my first attempt at it:

{code}
  public float getProgress() throws IOException {
    long subprogress = 0;    // bytes processed in current split
    if (null != curReader) {
      subprogress = (long)(curReader.getProgress() * split.getLength());
    }
    return Math.min(1.0f,  (progress + subprogress)/(float)(split.getLength()));
  }
{code}

> CombineFileRecordReader does not properly initialize child RecordReader
> -----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1480
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1480
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: MAPREDUCE-1480.2.patch, MAPREDUCE-1480.patch
>
>
> CombineFileRecordReader instantiates child RecordReader instances but never calls their initialize() method to give them the proper TaskAttemptContext.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.