You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Kay Kay (JIRA)" <ji...@apache.org> on 2010/02/03 19:25:28 UTC
[jira] Commented: (MAPREDUCE-1332) Ant tasks for job submission
[ https://issues.apache.org/jira/browse/MAPREDUCE-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829175#action_12829175 ]
Kay Kay commented on MAPREDUCE-1332:
------------------------------------
On a related note - have put up a maven hadoop mojo here at - http://github.com/akkumar/maven-hadoop .
Pretty rudimentary at this point with a target for packing jar files , for submission . Hopefully , down the road should be polished more.
Interested people can follow more at - http://maven-hadoop.blogspot.com/ .
> Ant tasks for job submission
> ----------------------------
>
> Key: MAPREDUCE-1332
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1332
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Affects Versions: 0.22.0
> Environment: Both platforms, Linux and Windows
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
> Attachments: JobSubmitTask.java
>
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> Ant tasks to make it easy to work with hadoop filesystem and submit jobs.
> <submit> : uploads JAR, submits job as user, with various settings
> filesystem operations: mkdir, copyin, copyout, delete
> -We could maybe use Ant1.7 "resources" here, and so use hdfs as a source or dest in Ant's own tasks
> # security. Need to specify user; pick up user.name from JVM as default?
> # cluster binding: namenode/job tracker (hostname,port) or url are all that is needed?
> #job conf: how to configure the job that is submitted? support a list of <property name="name" value="something"> children
> # testing. AntUnit to generate <junitreport> compatible XML files
> # Documentation. With an example using Ivy to fetch the JARs for the tasks and hadoop client.
> # Polling: ant task to block for a job finished?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.