You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Britt Cyr (JIRA)" <ji...@apache.org> on 2012/06/26 17:48:44 UTC

[jira] [Created] (OOZIE-890) Support for map-reduce in OozieCLI

Britt Cyr created OOZIE-890:
-------------------------------

             Summary: Support for map-reduce in OozieCLI
                 Key: OOZIE-890
                 URL: https://issues.apache.org/jira/browse/OOZIE-890
             Project: Oozie
          Issue Type: Bug
            Reporter: Britt Cyr
            Assignee: Britt Cyr


Allow for users to use OozieCLI for map-reduce similar to pig.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (OOZIE-890) Support for map-reduce in OozieCLI

Posted by "Britt Cyr (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OOZIE-890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Britt Cyr updated OOZIE-890:
----------------------------

    Attachment: OOZIE-890.patch

Command Line mapreduce and update to the twiki.
                
> Support for map-reduce in OozieCLI
> ----------------------------------
>
>                 Key: OOZIE-890
>                 URL: https://issues.apache.org/jira/browse/OOZIE-890
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Britt Cyr
>            Assignee: Britt Cyr
>         Attachments: OOZIE-890.patch
>
>
> Allow for users to use OozieCLI for map-reduce similar to pig.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (OOZIE-890) Support for map-reduce in OozieCLI

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OOZIE-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13403220#comment-13403220 ] 

Alejandro Abdelnur commented on OOZIE-890:
------------------------------------------

just created OOZIE-894.

as part of the mapreduce cli we should also support streaming.
                
> Support for map-reduce in OozieCLI
> ----------------------------------
>
>                 Key: OOZIE-890
>                 URL: https://issues.apache.org/jira/browse/OOZIE-890
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Britt Cyr
>            Assignee: Britt Cyr
>
> Allow for users to use OozieCLI for map-reduce similar to pig.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (OOZIE-890) Support for map-reduce in OozieCLI

Posted by "Virag Kothari (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OOZIE-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13409993#comment-13409993 ] 

Virag Kothari commented on OOZIE-890:
-------------------------------------

Patch looks good.. It will be good to design a test case for this. This will also help when Oozie supports hive and other actions through CLI
                
> Support for map-reduce in OozieCLI
> ----------------------------------
>
>                 Key: OOZIE-890
>                 URL: https://issues.apache.org/jira/browse/OOZIE-890
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Britt Cyr
>            Assignee: Britt Cyr
>         Attachments: OOZIE-890-v2.patch, OOZIE-890-v3.patch, OOZIE-890-v4.patch, OOZIE-890.patch
>
>
> Allow for users to use OozieCLI for map-reduce similar to pig.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (OOZIE-890) Support for map-reduce in OozieCLI

Posted by "Virag Kothari (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OOZIE-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13411706#comment-13411706 ] 

Virag Kothari commented on OOZIE-890:
-------------------------------------

+1
                
> Support for map-reduce in OozieCLI
> ----------------------------------
>
>                 Key: OOZIE-890
>                 URL: https://issues.apache.org/jira/browse/OOZIE-890
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Britt Cyr
>            Assignee: Britt Cyr
>         Attachments: OOZIE-890-v2.patch, OOZIE-890-v3.patch, OOZIE-890-v4.patch, OOZIE-890-v5.patch, OOZIE-890.patch
>
>
> Allow for users to use OozieCLI for map-reduce similar to pig.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (OOZIE-890) Support for map-reduce in OozieCLI

Posted by "Britt Cyr (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OOZIE-890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Britt Cyr updated OOZIE-890:
----------------------------

    Attachment: OOZIE-890-v4.patch

Changes in documentation
                
> Support for map-reduce in OozieCLI
> ----------------------------------
>
>                 Key: OOZIE-890
>                 URL: https://issues.apache.org/jira/browse/OOZIE-890
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Britt Cyr
>            Assignee: Britt Cyr
>         Attachments: OOZIE-890-v2.patch, OOZIE-890-v3.patch, OOZIE-890-v4.patch, OOZIE-890.patch
>
>
> Allow for users to use OozieCLI for map-reduce similar to pig.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (OOZIE-890) Support for map-reduce in OozieCLI

Posted by "Virag Kothari (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OOZIE-890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Virag Kothari resolved OOZIE-890.
---------------------------------

       Resolution: Fixed
    Fix Version/s: trunk
    
> Support for map-reduce in OozieCLI
> ----------------------------------
>
>                 Key: OOZIE-890
>                 URL: https://issues.apache.org/jira/browse/OOZIE-890
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Britt Cyr
>            Assignee: Britt Cyr
>             Fix For: trunk
>
>         Attachments: OOZIE-890-v2.patch, OOZIE-890-v3.patch, OOZIE-890-v4.patch, OOZIE-890-v5.patch, OOZIE-890.patch
>
>
> Allow for users to use OozieCLI for map-reduce similar to pig.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (OOZIE-890) Support for map-reduce in OozieCLI

Posted by "Britt Cyr (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OOZIE-890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Britt Cyr updated OOZIE-890:
----------------------------

    Attachment: OOZIE-890-v2.patch

documentation
                
> Support for map-reduce in OozieCLI
> ----------------------------------
>
>                 Key: OOZIE-890
>                 URL: https://issues.apache.org/jira/browse/OOZIE-890
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Britt Cyr
>            Assignee: Britt Cyr
>         Attachments: OOZIE-890-v2.patch, OOZIE-890.patch
>
>
> Allow for users to use OozieCLI for map-reduce similar to pig.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (OOZIE-890) Support for map-reduce in OozieCLI

Posted by "Britt Cyr (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OOZIE-890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Britt Cyr updated OOZIE-890:
----------------------------

    Attachment: OOZIE-890-v5.patch

added tests
                
> Support for map-reduce in OozieCLI
> ----------------------------------
>
>                 Key: OOZIE-890
>                 URL: https://issues.apache.org/jira/browse/OOZIE-890
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Britt Cyr
>            Assignee: Britt Cyr
>         Attachments: OOZIE-890-v2.patch, OOZIE-890-v3.patch, OOZIE-890-v4.patch, OOZIE-890-v5.patch, OOZIE-890.patch
>
>
> Allow for users to use OozieCLI for map-reduce similar to pig.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (OOZIE-890) Support for map-reduce in OozieCLI

Posted by "Britt Cyr (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OOZIE-890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Britt Cyr updated OOZIE-890:
----------------------------

    Attachment: OOZIE-890-v3.patch

removed options since getConfigurations already throws an exception if no config file is specified.
                
> Support for map-reduce in OozieCLI
> ----------------------------------
>
>                 Key: OOZIE-890
>                 URL: https://issues.apache.org/jira/browse/OOZIE-890
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Britt Cyr
>            Assignee: Britt Cyr
>         Attachments: OOZIE-890-v2.patch, OOZIE-890-v3.patch, OOZIE-890.patch
>
>
> Allow for users to use OozieCLI for map-reduce similar to pig.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (OOZIE-890) Support for map-reduce in OozieCLI

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OOZIE-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13403219#comment-13403219 ] 

Alejandro Abdelnur commented on OOZIE-890:
------------------------------------------

and we should document this feature as well as the pig one. 

plus, we should also do this for hive, I'll create a JIRA for that.

                
> Support for map-reduce in OozieCLI
> ----------------------------------
>
>                 Key: OOZIE-890
>                 URL: https://issues.apache.org/jira/browse/OOZIE-890
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Britt Cyr
>            Assignee: Britt Cyr
>
> Allow for users to use OozieCLI for map-reduce similar to pig.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (OOZIE-890) Support for map-reduce in OozieCLI

Posted by "Mona Chitnis (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OOZIE-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13407501#comment-13407501 ] 

Mona Chitnis commented on OOZIE-890:
------------------------------------

In the mrCommand function, I dont see how the 'options' list is helping much. Its not being passed later on. Also the 'getConfiguration' function itself throws an exception if 'CONFIG_OPTION' does not have an argument
                
> Support for map-reduce in OozieCLI
> ----------------------------------
>
>                 Key: OOZIE-890
>                 URL: https://issues.apache.org/jira/browse/OOZIE-890
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Britt Cyr
>            Assignee: Britt Cyr
>         Attachments: OOZIE-890-v2.patch, OOZIE-890.patch
>
>
> Allow for users to use OozieCLI for map-reduce similar to pig.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira