You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Roman Shaposhnik (Created) (JIRA)" <ji...@apache.org> on 2012/03/23 23:21:27 UTC

[jira] [Created] (BIGTOP-485) transition package dependencies to hadoop-client package

transition package dependencies to hadoop-client package
--------------------------------------------------------

                 Key: BIGTOP-485
                 URL: https://issues.apache.org/jira/browse/BIGTOP-485
             Project: Bigtop
          Issue Type: Bug
          Components: General
    Affects Versions: 0.4.0
            Reporter: Roman Shaposhnik
            Assignee: Roman Shaposhnik
             Fix For: 0.4.0


Now that we have hadoop-client package in place it would make sense to migrate the client side dependencies to it. The only caveat here is that currently, only Oozie can take full advantage of the hadoop-client package since it manages its own classpath (or more precise Tomcat manages a classpath for it). All the other components (pig,hive,mahout,sqoop,hbase) use hadoop launcher script and thus can't be easily migrated to the classpath that is provided by hadoop-client. 

Still this will simplify package dependency management and will allow us to gradually educate hadoop launcher scripts on the benefits of the client package.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (BIGTOP-485) transition package dependencies to hadoop-client package

Posted by "Bruno Mahé (Commented JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BIGTOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13237216#comment-13237216 ] 

Bruno Mahé commented on BIGTOP-485:
-----------------------------------

Great idea!
                
> transition package dependencies to hadoop-client package
> --------------------------------------------------------
>
>                 Key: BIGTOP-485
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-485
>             Project: Bigtop
>          Issue Type: Bug
>          Components: General
>    Affects Versions: 0.4.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>             Fix For: 0.4.0
>
>
> Now that we have hadoop-client package in place it would make sense to migrate the client side dependencies to it. The only caveat here is that currently, only Oozie can take full advantage of the hadoop-client package since it manages its own classpath (or more precise Tomcat manages a classpath for it). All the other components (pig,hive,mahout,sqoop,hbase) use hadoop launcher script and thus can't be easily migrated to the classpath that is provided by hadoop-client. 
> Still this will simplify package dependency management and will allow us to gradually educate hadoop launcher scripts on the benefits of the client package.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (BIGTOP-485) transition package dependencies to hadoop-client package

Posted by "Bruno Mahé (Commented JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BIGTOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13239854#comment-13239854 ] 

Bruno Mahé commented on BIGTOP-485:
-----------------------------------

Just to confirm, it's meant for branch hadoop-0.23, isn't it?
                
> transition package dependencies to hadoop-client package
> --------------------------------------------------------
>
>                 Key: BIGTOP-485
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-485
>             Project: Bigtop
>          Issue Type: Bug
>          Components: General
>    Affects Versions: 0.4.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>             Fix For: 0.4.0
>
>         Attachments: BIGTOP-485.patch.txt
>
>
> Now that we have hadoop-client package in place it would make sense to migrate the client side dependencies to it. The only caveat here is that currently, only Oozie can take full advantage of the hadoop-client package since it manages its own classpath (or more precise Tomcat manages a classpath for it). All the other components (pig,hive,mahout,sqoop,hbase) use hadoop launcher script and thus can't be easily migrated to the classpath that is provided by hadoop-client. 
> Still this will simplify package dependency management and will allow us to gradually educate hadoop launcher scripts on the benefits of the client package.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Updated] (BIGTOP-485) transition package dependencies to hadoop-client package

Posted by "Roman Shaposhnik (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/BIGTOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Roman Shaposhnik updated BIGTOP-485:
------------------------------------

    Attachment: BIGTOP-485.patch.txt
    
> transition package dependencies to hadoop-client package
> --------------------------------------------------------
>
>                 Key: BIGTOP-485
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-485
>             Project: Bigtop
>          Issue Type: Bug
>          Components: General
>    Affects Versions: 0.4.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>             Fix For: 0.4.0
>
>         Attachments: BIGTOP-485.patch.txt
>
>
> Now that we have hadoop-client package in place it would make sense to migrate the client side dependencies to it. The only caveat here is that currently, only Oozie can take full advantage of the hadoop-client package since it manages its own classpath (or more precise Tomcat manages a classpath for it). All the other components (pig,hive,mahout,sqoop,hbase) use hadoop launcher script and thus can't be easily migrated to the classpath that is provided by hadoop-client. 
> Still this will simplify package dependency management and will allow us to gradually educate hadoop launcher scripts on the benefits of the client package.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (BIGTOP-485) transition package dependencies to hadoop-client package

Posted by "Bruno Mahé (Commented JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BIGTOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13239985#comment-13239985 ] 

Bruno Mahé commented on BIGTOP-485:
-----------------------------------

Thanks!
+1
                
> transition package dependencies to hadoop-client package
> --------------------------------------------------------
>
>                 Key: BIGTOP-485
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-485
>             Project: Bigtop
>          Issue Type: Bug
>          Components: General
>    Affects Versions: 0.4.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>             Fix For: 0.4.0
>
>         Attachments: BIGTOP-485.patch.txt
>
>
> Now that we have hadoop-client package in place it would make sense to migrate the client side dependencies to it. The only caveat here is that currently, only Oozie can take full advantage of the hadoop-client package since it manages its own classpath (or more precise Tomcat manages a classpath for it). All the other components (pig,hive,mahout,sqoop,hbase) use hadoop launcher script and thus can't be easily migrated to the classpath that is provided by hadoop-client. 
> Still this will simplify package dependency management and will allow us to gradually educate hadoop launcher scripts on the benefits of the client package.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (BIGTOP-485) transition package dependencies to hadoop-client package

Posted by "Peter Linnell (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BIGTOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13237228#comment-13237228 ] 

Peter Linnell commented on BIGTOP-485:
--------------------------------------

Sounds sane to me. 
                
> transition package dependencies to hadoop-client package
> --------------------------------------------------------
>
>                 Key: BIGTOP-485
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-485
>             Project: Bigtop
>          Issue Type: Bug
>          Components: General
>    Affects Versions: 0.4.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>             Fix For: 0.4.0
>
>
> Now that we have hadoop-client package in place it would make sense to migrate the client side dependencies to it. The only caveat here is that currently, only Oozie can take full advantage of the hadoop-client package since it manages its own classpath (or more precise Tomcat manages a classpath for it). All the other components (pig,hive,mahout,sqoop,hbase) use hadoop launcher script and thus can't be easily migrated to the classpath that is provided by hadoop-client. 
> Still this will simplify package dependency management and will allow us to gradually educate hadoop launcher scripts on the benefits of the client package.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (BIGTOP-485) transition package dependencies to hadoop-client package

Posted by "Roman Shaposhnik (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BIGTOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13239984#comment-13239984 ] 

Roman Shaposhnik commented on BIGTOP-485:
-----------------------------------------

Exclusively for hadoop-0.23. I'm pretty sure Hadoop 1.X line doesn't actually have the concept of hadoop-client.
                
> transition package dependencies to hadoop-client package
> --------------------------------------------------------
>
>                 Key: BIGTOP-485
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-485
>             Project: Bigtop
>          Issue Type: Bug
>          Components: General
>    Affects Versions: 0.4.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>             Fix For: 0.4.0
>
>         Attachments: BIGTOP-485.patch.txt
>
>
> Now that we have hadoop-client package in place it would make sense to migrate the client side dependencies to it. The only caveat here is that currently, only Oozie can take full advantage of the hadoop-client package since it manages its own classpath (or more precise Tomcat manages a classpath for it). All the other components (pig,hive,mahout,sqoop,hbase) use hadoop launcher script and thus can't be easily migrated to the classpath that is provided by hadoop-client. 
> Still this will simplify package dependency management and will allow us to gradually educate hadoop launcher scripts on the benefits of the client package.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira