You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2011/02/18 00:41:12 UTC

[jira] Created: (HADOOP-7150) Create a module system for adding extensions to Hadoop

Create a module system for adding extensions to Hadoop
------------------------------------------------------

                 Key: HADOOP-7150
                 URL: https://issues.apache.org/jira/browse/HADOOP-7150
             Project: Hadoop Common
          Issue Type: New Feature
          Components: util
            Reporter: Owen O'Malley
            Assignee: Owen O'Malley


Currently adding extensions to Hadoop is difficult. I propose adding the concept of modules that can add jars and libraries to the system.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-7150) Create a module system for adding extensions to Hadoop

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-7150:
----------------------------------

    Attachment: modules.pdf

a description of modules solution

> Create a module system for adding extensions to Hadoop
> ------------------------------------------------------
>
>                 Key: HADOOP-7150
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7150
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: util
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>         Attachments: modules.pdf
>
>
> Currently adding extensions to Hadoop is difficult. I propose adding the concept of modules that can add jars and libraries to the system.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HADOOP-7150) Create a module system for adding extensions to Hadoop

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12996252#comment-12996252 ] 

Owen O'Malley commented on HADOOP-7150:
---------------------------------------

It is primarily for clients, like adding filesystems, codecs, serializations, etc. It can also be used in the servers for adding things like filesystems, compression codecs, and metrics plugins.

> Create a module system for adding extensions to Hadoop
> ------------------------------------------------------
>
>                 Key: HADOOP-7150
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7150
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: util
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>         Attachments: modules.pdf
>
>
> Currently adding extensions to Hadoop is difficult. I propose adding the concept of modules that can add jars and libraries to the system.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HADOOP-7150) Create a module system for adding extensions to Hadoop

Posted by "Philip Zeyliger (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12996169#comment-12996169 ] 

Philip Zeyliger commented on HADOOP-7150:
-----------------------------------------

Owen,

To clarify, are you referring about adding libraries for user MapReduce code (e.g., an image manipulation library) or more about adding plugins/modules to the core services (e.g., https://issues.apache.org/jira/browse/HADOOP-5257, "adding service plugins for namenode/datanode"; there's a similar MR ticket).

Both are very handy; just curious which one you're thinking about.

Thanks!

> Create a module system for adding extensions to Hadoop
> ------------------------------------------------------
>
>                 Key: HADOOP-7150
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7150
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: util
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>
> Currently adding extensions to Hadoop is difficult. I propose adding the concept of modules that can add jars and libraries to the system.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-7150) Create a module system for adding extensions to Hadoop

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-7150:
----------------------------------

    Attachment: modules.tex

The latex source code for the document

> Create a module system for adding extensions to Hadoop
> ------------------------------------------------------
>
>                 Key: HADOOP-7150
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7150
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: util
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>         Attachments: modules.pdf, modules.tex
>
>
> Currently adding extensions to Hadoop is difficult. I propose adding the concept of modules that can add jars and libraries to the system.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira