You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by raghavendhra rahul <ra...@gmail.com> on 2012/01/10 07:12:38 UTC
Container launch from appmaster
Hi all,
I am trying to write an application master.Is there a way to specify
node1: 10 conatiners
node2: 10 containers
Can we specify this kind of list using the application master????
Re: Container launch from appmaster
Posted by raghavendhra rahul <ra...@gmail.com>.
How can i find the rackname.Where to set it....
Also os ther a specific way to stop the application master other than
timeout option in the client.
Is there a command like
./hadoop -job kill jobid
2012/1/11 Bing Jiang <ji...@gmail.com>
> I figure out source code, and havenot already found the format of hostname
> besides "*"
> But it should contains "rackname" + "hostname" .
>
> 在 2012年1月11日 下午4:47，raghavendhra rahul <ra...@gmail.com>写道：
>
> When i provide hostname for "*" then the containers are not alloted for
>> the application till its end.
>> Is there a format to specify the hostname
>>
>>
>> 2012/1/11 Bing Jiang <ji...@gmail.com>
>>
>>> I think you can make control of allocated container, and check whether
>>> it meets your requirements.
>>>
>>>
>>>
>>> 2012/1/11 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
>>>
>>>> Yes, you can.
>>>>
>>>>
>>>> http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html#Writing_an_ApplicationMaster
>>>> should give you a very good idea and example code about this.
>>>>
>>>> But, the requirements are not hard-fixed. If the scheduler cannot find
>>>> free resources on the nodes you mention, it will try to get containers
>>>> on a different node. Despite that, the total number of containers can
>>>> be controlled by limiting the count against the entry for "*".
>>>>
>>>> HTH,
>>>> +Vinod
>>>>
>>>> On Mon, Jan 9, 2012 at 10:12 PM, raghavendhra rahul
>>>> <ra...@gmail.com> wrote:
>>>> > Hi all,
>>>> > I am trying to write an application master.Is there a way to specify
>>>> > node1: 10 conatiners
>>>> > node2: 10 containers
>>>> > Can we specify this kind of list using the application master????
>>>> >
>>>>
>>>
>>>
>>>
>>> --
>>> Bing Jiang
>>> Tel：(86)134-2619-1361
>>> weibo: http://weibo.com/jiangbinglover
>>> BLOG: http://blog.sina.com.cn/jiangbinglover
>>> National Research Center for Intelligent Computing Systems
>>> Institute of Computing technology
>>> Graduate University of Chinese Academy of Science
>>>
>>>
>>
>
>
> --
> Bing Jiang
> Tel：(86)134-2619-1361
> weibo: http://weibo.com/jiangbinglover
> BLOG: http://blog.sina.com.cn/jiangbinglover
> National Research Center for Intelligent Computing Systems
> Institute of Computing technology
> Graduate University of Chinese Academy of Science
>
>
Re: Container launch from appmaster
Posted by Bing Jiang <ji...@gmail.com>.
I figure out source code, and havenot already found the format of hostname
besides "*"
But it should contains "rackname" + "hostname" .
在 2012年1月11日 下午4:47，raghavendhra rahul <ra...@gmail.com>写道：
> When i provide hostname for "*" then the containers are not alloted for
> the application till its end.
> Is there a format to specify the hostname
>
>
> 2012/1/11 Bing Jiang <ji...@gmail.com>
>
>> I think you can make control of allocated container, and check whether it
>> meets your requirements.
>>
>>
>>
>> 2012/1/11 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
>>
>>> Yes, you can.
>>>
>>>
>>> http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html#Writing_an_ApplicationMaster
>>> should give you a very good idea and example code about this.
>>>
>>> But, the requirements are not hard-fixed. If the scheduler cannot find
>>> free resources on the nodes you mention, it will try to get containers
>>> on a different node. Despite that, the total number of containers can
>>> be controlled by limiting the count against the entry for "*".
>>>
>>> HTH,
>>> +Vinod
>>>
>>> On Mon, Jan 9, 2012 at 10:12 PM, raghavendhra rahul
>>> <ra...@gmail.com> wrote:
>>> > Hi all,
>>> > I am trying to write an application master.Is there a way to specify
>>> > node1: 10 conatiners
>>> > node2: 10 containers
>>> > Can we specify this kind of list using the application master????
>>> >
>>>
>>
>>
>>
>> --
>> Bing Jiang
>> Tel：(86)134-2619-1361
>> weibo: http://weibo.com/jiangbinglover
>> BLOG: http://blog.sina.com.cn/jiangbinglover
>> National Research Center for Intelligent Computing Systems
>> Institute of Computing technology
>> Graduate University of Chinese Academy of Science
>>
>>
>
--
Bing Jiang
Tel：(86)134-2619-1361
weibo: http://weibo.com/jiangbinglover
BLOG: http://blog.sina.com.cn/jiangbinglover
National Research Center for Intelligent Computing Systems
Institute of Computing technology
Graduate University of Chinese Academy of Science
Re: Container launch from appmaster
Posted by raghavendhra rahul <ra...@gmail.com>.
When i provide hostname for "*" then the containers are not alloted for the
application till its end.
Is there a format to specify the hostname
2012/1/11 Bing Jiang <ji...@gmail.com>
> I think you can make control of allocated container, and check whether it
> meets your requirements.
>
>
>
> 2012/1/11 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
>
>> Yes, you can.
>>
>>
>> http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html#Writing_an_ApplicationMaster
>> should give you a very good idea and example code about this.
>>
>> But, the requirements are not hard-fixed. If the scheduler cannot find
>> free resources on the nodes you mention, it will try to get containers
>> on a different node. Despite that, the total number of containers can
>> be controlled by limiting the count against the entry for "*".
>>
>> HTH,
>> +Vinod
>>
>> On Mon, Jan 9, 2012 at 10:12 PM, raghavendhra rahul
>> <ra...@gmail.com> wrote:
>> > Hi all,
>> > I am trying to write an application master.Is there a way to specify
>> > node1: 10 conatiners
>> > node2: 10 containers
>> > Can we specify this kind of list using the application master????
>> >
>>
>
>
>
> --
> Bing Jiang
> Tel：(86)134-2619-1361
> weibo: http://weibo.com/jiangbinglover
> BLOG: http://blog.sina.com.cn/jiangbinglover
> National Research Center for Intelligent Computing Systems
> Institute of Computing technology
> Graduate University of Chinese Academy of Science
>
>
Re: Container launch from appmaster
Posted by Bing Jiang <ji...@gmail.com>.
I think you can make control of allocated container, and check whether it
meets your requirements.
2012/1/11 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
> Yes, you can.
>
>
> http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html#Writing_an_ApplicationMaster
> should give you a very good idea and example code about this.
>
> But, the requirements are not hard-fixed. If the scheduler cannot find
> free resources on the nodes you mention, it will try to get containers
> on a different node. Despite that, the total number of containers can
> be controlled by limiting the count against the entry for "*".
>
> HTH,
> +Vinod
>
> On Mon, Jan 9, 2012 at 10:12 PM, raghavendhra rahul
> <ra...@gmail.com> wrote:
> > Hi all,
> > I am trying to write an application master.Is there a way to specify
> > node1: 10 conatiners
> > node2: 10 containers
> > Can we specify this kind of list using the application master????
> >
>
--
Bing Jiang
Tel：(86)134-2619-1361
weibo: http://weibo.com/jiangbinglover
BLOG: http://blog.sina.com.cn/jiangbinglover
National Research Center for Intelligent Computing Systems
Institute of Computing technology
Graduate University of Chinese Academy of Science
Re: Container launch from appmaster
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
Yes, you can.
http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html#Writing_an_ApplicationMaster
should give you a very good idea and example code about this.
But, the requirements are not hard-fixed. If the scheduler cannot find
free resources on the nodes you mention, it will try to get containers
on a different node. Despite that, the total number of containers can
be controlled by limiting the count against the entry for "*".
HTH,
+Vinod
On Mon, Jan 9, 2012 at 10:12 PM, raghavendhra rahul
<ra...@gmail.com> wrote:
> Hi all,
> I am trying to write an application master.Is there a way to specify
> node1: 10 conatiners
> node2: 10 containers
> Can we specify this kind of list using the application master????
>
Re: Container launch from appmaster
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
Yes, you can.
http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html#Writing_an_ApplicationMaster
should give you a very good idea and example code about this.
But, the requirements are not hard-fixed. If the scheduler cannot find
free resources on the nodes you mention, it will try to get containers
on a different node. Despite that, the total number of containers can
be controlled by limiting the count against the entry for "*".
HTH,
+Vinod
On Mon, Jan 9, 2012 at 10:12 PM, raghavendhra rahul
<ra...@gmail.com> wrote:
> Hi all,
> I am trying to write an application master.Is there a way to specify
> node1: 10 conatiners
> node2: 10 containers
> Can we specify this kind of list using the application master????
>