You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Michael Katzenellenbogen (JIRA)" <ji...@apache.org> on 2012/11/13 22:36:13 UTC

[jira] [Created] (OOZIE-1063) Provide documentation on configuring Oozie to use new Hadoop API

Michael Katzenellenbogen created OOZIE-1063:
-----------------------------------------------

             Summary: Provide documentation on configuring Oozie to use new Hadoop API
                 Key: OOZIE-1063
                 URL: https://issues.apache.org/jira/browse/OOZIE-1063
             Project: Oozie
          Issue Type: Improvement
          Components: docs
            Reporter: Michael Katzenellenbogen


To use the newer mapreduce.* Hadoop API, the Oozie workflow XML configuration should have the mapred.mapper|reducer.new-api property set to true. This is currently undocumented (on the Oozie side), and throws mysterious RuntimeExceptions when using the newer API.

Example RuntimeExceptions:

java.lang.RuntimeException: class com.foo.bar.SomeMapper not org.apache.hadoop.mapred.Mapper 

java.lang.RuntimeException: class com.foo.bar.SomeOutputFormat not org.apache.hadoop.mapred.OutputFormat


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (OOZIE-1063) Provide documentation on configuring Oozie to use new Hadoop API

Posted by "Mohammad Kamrul Islam (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OOZIE-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496799#comment-13496799 ] 

Mohammad Kamrul Islam commented on OOZIE-1063:
----------------------------------------------

Some comments are there in old github wiki:
https://github.com/yahoo/oozie/wiki/Oozie-WF-use-cases

Looks for "How to run Map-reduce job written using new Hadoop API?"

We might need to integrate this into latest doc.
                
> Provide documentation on configuring Oozie to use new Hadoop API
> ----------------------------------------------------------------
>
>                 Key: OOZIE-1063
>                 URL: https://issues.apache.org/jira/browse/OOZIE-1063
>             Project: Oozie
>          Issue Type: Improvement
>          Components: docs
>            Reporter: Michael Katzenellenbogen
>
> To use the newer mapreduce.* Hadoop API, the Oozie workflow XML configuration should have the mapred.mapper|reducer.new-api property set to true. This is currently undocumented (on the Oozie side), and throws mysterious RuntimeExceptions when using the newer API.
> Example RuntimeExceptions:
> java.lang.RuntimeException: class com.foo.bar.SomeMapper not org.apache.hadoop.mapred.Mapper 
> java.lang.RuntimeException: class com.foo.bar.SomeOutputFormat not org.apache.hadoop.mapred.OutputFormat

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (OOZIE-1063) Provide documentation on configuring Oozie to use new Hadoop API

Posted by "Michael Katzenellenbogen (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OOZIE-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496805#comment-13496805 ] 

Michael Katzenellenbogen commented on OOZIE-1063:
-------------------------------------------------

Err, yeah, this was in reference to adding/integrating into the release documentation. Should've been more specific about that.
                
> Provide documentation on configuring Oozie to use new Hadoop API
> ----------------------------------------------------------------
>
>                 Key: OOZIE-1063
>                 URL: https://issues.apache.org/jira/browse/OOZIE-1063
>             Project: Oozie
>          Issue Type: Improvement
>          Components: docs
>            Reporter: Michael Katzenellenbogen
>
> To use the newer mapreduce.* Hadoop API, the Oozie workflow XML configuration should have the mapred.mapper|reducer.new-api property set to true. This is currently undocumented (on the Oozie side), and throws mysterious RuntimeExceptions when using the newer API.
> Example RuntimeExceptions:
> java.lang.RuntimeException: class com.foo.bar.SomeMapper not org.apache.hadoop.mapred.Mapper 
> java.lang.RuntimeException: class com.foo.bar.SomeOutputFormat not org.apache.hadoop.mapred.OutputFormat

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira