You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Robert Joseph Evans (JIRA)" <ji...@apache.org> on 2012/06/21 16:34:42 UTC
[jira] [Commented] (HADOOP-8521) Port StreamInputFormat to new Map
Reduce API
[ https://issues.apache.org/jira/browse/HADOOP-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398453#comment-13398453 ]
Robert Joseph Evans commented on HADOOP-8521:
---------------------------------------------
I am a bit confused here. I see that you added in a new mapreduce StreamInputFormat, with the corresponding StreamXmlRecordReader and StreamBaseRecordReader, but how does this enable us to use the new MapReduce API? Can you update the documentation to provide some examples of how you can use these new classes you have added? Also the test you have added in is not actually testing the new code at all. It is still testing the old input format code. I can delete the new code entirely and the test still passes. It looks like a great start, but I think there is some more wiring that needs to be done to make this work.
> Port StreamInputFormat to new Map Reduce API
> --------------------------------------------
>
> Key: HADOOP-8521
> URL: https://issues.apache.org/jira/browse/HADOOP-8521
> Project: Hadoop Common
> Issue Type: Improvement
> Affects Versions: 0.23.0
> Reporter: madhukara phatak
> Assignee: madhukara phatak
> Attachments: HADOOP-8521.patch
>
>
> As of now , hadoop streaming uses old Hadoop M/R API. This JIRA ports it to the new M/R API.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira