You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Doug Cutting (JIRA)" <ji...@apache.org> on 2007/07/17 21:32:04 UTC
[jira] Commented: (HADOOP-1622) Hadoop should provide a way to
allow the user to specify jar file(s) the user job depends on
[ https://issues.apache.org/jira/browse/HADOOP-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12513336 ]
Doug Cutting commented on HADOOP-1622:
--------------------------------------
This can easily be implemented by packing the user jars together into a single jar, then submitting the job with that jar, right? I don't think the mapred kernel needs to deal with more than a single jar per job, but making the user API accept multiple jars is fine.
> Hadoop should provide a way to allow the user to specify jar file(s) the user job depends on
> --------------------------------------------------------------------------------------------
>
> Key: HADOOP-1622
> URL: https://issues.apache.org/jira/browse/HADOOP-1622
> Project: Hadoop
> Issue Type: Improvement
> Reporter: Runping Qi
>
> More likely than not, a user's job may depend on multiple jars.
> Right now, when submitting a job through bin/hadoop, there is no way for the user to specify that.
> A walk around for that is to re-package all the dependent jars into a new jar or put the dependent jar files in the lib dir of the new jar.
> This walk around causes unnecessary inconvenience to the user. Furthermore, if the user does not own the main function
> (like the case when the user uses Aggregate, or datajoin, streaming), the user has to re-package those system jar files too.
> It is much desired that hadoop provides a clean and simple way for the user to specify a list of dependent jar files at the time
> of job submission. Someting like:
> bin/hadoop .... --depending_jars j1.jar:j2.jar
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.