You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2007/01/23 19:48:49 UTC

[jira] Updated: (HADOOP-904) OutputFormat should be given the reduce id directly rather than a filename

     [ https://issues.apache.org/jira/browse/HADOOP-904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-904:
---------------------------------

    Description: 
The OutputFormat API should be changed to be more evolution proof:

public interface OutputFormatContext {
  JobConf getJobConf();
  Progressable getProgress();
}

public interface OutputFormat {
  RecordWriter getRecordWriter(int reduce, OutputFormatContext context) throws IOException;
  void checkOutputSpecs(OutputFormatContext context) throws IOException;
}

And OutputFormatBase would be renamed:

public abstract class FileOutputFormat implements OutputFormat {
  protected Path getOutputPath(int reduce, OutputFormatContext context) throws IOException { ... }
  ... current OutputFormatBase methods ...
}

  was:
The OutputFormat API should be changed to be more evolution proof:

public interface OutputFormatContext {
  JobConf getJobConf();
  Progressable getProgress();
}

public interface OutputFormat {
  RecordReader getRecordReader(int reduce, OutputFormatContext context) throws IOException;
  void checkOutputSpecs(OutputFormatContext context) throws IOException;
}

And OutputFormatBase would be renamed:

public abstract class FileOutputFormat implements OutputFormat {
  protected Path getOutputPath(int reduce, OutputFormatContext context) throws IOException { ... }
  ... current OutputFormatBase methods ...
}


> OutputFormat should be given the reduce id directly rather than a filename
> --------------------------------------------------------------------------
>
>                 Key: HADOOP-904
>                 URL: https://issues.apache.org/jira/browse/HADOOP-904
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.10.1
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.11.0
>
>
> The OutputFormat API should be changed to be more evolution proof:
> public interface OutputFormatContext {
>   JobConf getJobConf();
>   Progressable getProgress();
> }
> public interface OutputFormat {
>   RecordWriter getRecordWriter(int reduce, OutputFormatContext context) throws IOException;
>   void checkOutputSpecs(OutputFormatContext context) throws IOException;
> }
> And OutputFormatBase would be renamed:
> public abstract class FileOutputFormat implements OutputFormat {
>   protected Path getOutputPath(int reduce, OutputFormatContext context) throws IOException { ... }
>   ... current OutputFormatBase methods ...
> }

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.