You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@twill.apache.org by "Fabian Murariu (JIRA)" <ji...@apache.org> on 2014/02/14 11:05:19 UTC

[jira] [Comment Edited] (TWILL-40) Add a way to specify a hostname or hdfs path in WeaveSpecification

    [ https://issues.apache.org/jira/browse/TWILL-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13901281#comment-13901281 ] 

Fabian Murariu edited comment on TWILL-40 at 2/14/14 10:03 AM:
---------------------------------------------------------------

First take at this one, it just exposes the hosts and racks APIs to the Twill ResourceSpecification and ApplicationMaster.
Basically you can now specify on what hosts or racks you need your runnable on this is just a hint. I'm not sure how to test this with the MiniYarnCluster


was (Author: fabianmurariu):
First take at this one, it just exposes the hosts and racks APIs to the Twill ResourceSpecification and ApplicationMaster.

> Add a way to specify a hostname or hdfs path in WeaveSpecification
> ------------------------------------------------------------------
>
>                 Key: TWILL-40
>                 URL: https://issues.apache.org/jira/browse/TWILL-40
>             Project: Apache Twill
>          Issue Type: New Feature
>          Components: api, yarn
>         Environment: *
>            Reporter: Fabian Murariu
>            Assignee: Fabian Murariu
>            Priority: Minor
>         Attachments: 0001-exposes-the-YARN-client-ContainerRequest-hosts-and-r.patch, 0002-fixing-checkstyle-violations-TWILL-40.patch
>
>
> I would like to be able to tell YARN through Weave API on what hosts to
> allocate the containers or by specifying the hdfs path and Weave can deduce
> the hosts via InputSplits.
> Please let me know if there is already a way to do this. If there is not
> I would like to add it myself. I could use some pointers just to get around quicker.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)