You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Bill Q <bi...@gmail.com> on 2013/11/12 20:34:11 UTC
Writing an application based on YARN 2.2
Hi friends,
I am trying to migrate a distributed data mining system to YARN 2.2 from a
custom-built multi-nodes resources management system.
I am having some difficulties to find a up-to-date working example of
writing an application based on YARN 2.2. The example in the ASF Hadoop
page is not complete and outdated.
I would appreciate a lot if anyone can share some experiences here.
Many thanks.
Bill
RE: Writing an application based on YARN 2.2
Posted by John Lilley <jo...@redpoint.net>.
The distributed shell example is the best one that I know of.
John
From: Bill Q [mailto:bill.q.hdp@gmail.com]
Sent: Tuesday, November 12, 2013 12:51 PM
To: user@hadoop.apache.org
Subject: Re: Writing an application based on YARN 2.2
Hi Lohit,
Thanks a lot. Is there any updated docs that would serve as a good entry point for writing a simple application on YARN? Thanks a lot.
Many thanks.
Bill
On Tue, Nov 12, 2013 at 2:40 PM, lohit <lo...@gmail.com>> wrote:
Apart from existing docs, there are few code examples which might be useful.
hadoop-yarn-applications-distributedshell subproject within yarn
Storm on YARN https://github.com/yahoo/storm-yarn
2013/11/12 Bill Q <bi...@gmail.com>>
Hi friends,
I am trying to migrate a distributed data mining system to YARN 2.2 from a custom-built multi-nodes resources management system.
I am having some difficulties to find a up-to-date working example of writing an application based on YARN 2.2. The example in the ASF Hadoop page is not complete and outdated.
I would appreciate a lot if anyone can share some experiences here.
Many thanks.
Bill
--
Have a Nice Day!
Lohit
RE: Writing an application based on YARN 2.2
Posted by John Lilley <jo...@redpoint.net>.
The distributed shell example is the best one that I know of.
John
From: Bill Q [mailto:bill.q.hdp@gmail.com]
Sent: Tuesday, November 12, 2013 12:51 PM
To: user@hadoop.apache.org
Subject: Re: Writing an application based on YARN 2.2
Hi Lohit,
Thanks a lot. Is there any updated docs that would serve as a good entry point for writing a simple application on YARN? Thanks a lot.
Many thanks.
Bill
On Tue, Nov 12, 2013 at 2:40 PM, lohit <lo...@gmail.com>> wrote:
Apart from existing docs, there are few code examples which might be useful.
hadoop-yarn-applications-distributedshell subproject within yarn
Storm on YARN https://github.com/yahoo/storm-yarn
2013/11/12 Bill Q <bi...@gmail.com>>
Hi friends,
I am trying to migrate a distributed data mining system to YARN 2.2 from a custom-built multi-nodes resources management system.
I am having some difficulties to find a up-to-date working example of writing an application based on YARN 2.2. The example in the ASF Hadoop page is not complete and outdated.
I would appreciate a lot if anyone can share some experiences here.
Many thanks.
Bill
--
Have a Nice Day!
Lohit
RE: Writing an application based on YARN 2.2
Posted by John Lilley <jo...@redpoint.net>.
The distributed shell example is the best one that I know of.
John
From: Bill Q [mailto:bill.q.hdp@gmail.com]
Sent: Tuesday, November 12, 2013 12:51 PM
To: user@hadoop.apache.org
Subject: Re: Writing an application based on YARN 2.2
Hi Lohit,
Thanks a lot. Is there any updated docs that would serve as a good entry point for writing a simple application on YARN? Thanks a lot.
Many thanks.
Bill
On Tue, Nov 12, 2013 at 2:40 PM, lohit <lo...@gmail.com>> wrote:
Apart from existing docs, there are few code examples which might be useful.
hadoop-yarn-applications-distributedshell subproject within yarn
Storm on YARN https://github.com/yahoo/storm-yarn
2013/11/12 Bill Q <bi...@gmail.com>>
Hi friends,
I am trying to migrate a distributed data mining system to YARN 2.2 from a custom-built multi-nodes resources management system.
I am having some difficulties to find a up-to-date working example of writing an application based on YARN 2.2. The example in the ASF Hadoop page is not complete and outdated.
I would appreciate a lot if anyone can share some experiences here.
Many thanks.
Bill
--
Have a Nice Day!
Lohit
RE: Writing an application based on YARN 2.2
Posted by John Lilley <jo...@redpoint.net>.
The distributed shell example is the best one that I know of.
John
From: Bill Q [mailto:bill.q.hdp@gmail.com]
Sent: Tuesday, November 12, 2013 12:51 PM
To: user@hadoop.apache.org
Subject: Re: Writing an application based on YARN 2.2
Hi Lohit,
Thanks a lot. Is there any updated docs that would serve as a good entry point for writing a simple application on YARN? Thanks a lot.
Many thanks.
Bill
On Tue, Nov 12, 2013 at 2:40 PM, lohit <lo...@gmail.com>> wrote:
Apart from existing docs, there are few code examples which might be useful.
hadoop-yarn-applications-distributedshell subproject within yarn
Storm on YARN https://github.com/yahoo/storm-yarn
2013/11/12 Bill Q <bi...@gmail.com>>
Hi friends,
I am trying to migrate a distributed data mining system to YARN 2.2 from a custom-built multi-nodes resources management system.
I am having some difficulties to find a up-to-date working example of writing an application based on YARN 2.2. The example in the ASF Hadoop page is not complete and outdated.
I would appreciate a lot if anyone can share some experiences here.
Many thanks.
Bill
--
Have a Nice Day!
Lohit
Re: Writing an application based on YARN 2.2
Posted by Bill Q <bi...@gmail.com>.
Hi Lohit,
Thanks a lot. Is there any updated docs that would serve as a good entry
point for writing a simple application on YARN? Thanks a lot.
Many thanks.
Bill
On Tue, Nov 12, 2013 at 2:40 PM, lohit <lo...@gmail.com> wrote:
> Apart from existing docs, there are few code examples which might be
> useful.
>
> hadoop-yarn-applications-distributedshell subproject within yarn
> Storm on YARN https://github.com/yahoo/storm-yarn
>
>
>
> 2013/11/12 Bill Q <bi...@gmail.com>
>
>> Hi friends,
>> I am trying to migrate a distributed data mining system to YARN 2.2 from
>> a custom-built multi-nodes resources management system.
>>
>> I am having some difficulties to find a up-to-date working example of
>> writing an application based on YARN 2.2. The example in the ASF Hadoop
>> page is not complete and outdated.
>>
>> I would appreciate a lot if anyone can share some experiences here.
>>
>> Many thanks.
>>
>>
>> Bill
>>
>
>
>
> --
> Have a Nice Day!
> Lohit
>
Re: Writing an application based on YARN 2.2
Posted by Bill Q <bi...@gmail.com>.
Hi Lohit,
Thanks a lot. Is there any updated docs that would serve as a good entry
point for writing a simple application on YARN? Thanks a lot.
Many thanks.
Bill
On Tue, Nov 12, 2013 at 2:40 PM, lohit <lo...@gmail.com> wrote:
> Apart from existing docs, there are few code examples which might be
> useful.
>
> hadoop-yarn-applications-distributedshell subproject within yarn
> Storm on YARN https://github.com/yahoo/storm-yarn
>
>
>
> 2013/11/12 Bill Q <bi...@gmail.com>
>
>> Hi friends,
>> I am trying to migrate a distributed data mining system to YARN 2.2 from
>> a custom-built multi-nodes resources management system.
>>
>> I am having some difficulties to find a up-to-date working example of
>> writing an application based on YARN 2.2. The example in the ASF Hadoop
>> page is not complete and outdated.
>>
>> I would appreciate a lot if anyone can share some experiences here.
>>
>> Many thanks.
>>
>>
>> Bill
>>
>
>
>
> --
> Have a Nice Day!
> Lohit
>
Re: Writing an application based on YARN 2.2
Posted by Bill Q <bi...@gmail.com>.
Hi Lohit,
Thanks a lot. Is there any updated docs that would serve as a good entry
point for writing a simple application on YARN? Thanks a lot.
Many thanks.
Bill
On Tue, Nov 12, 2013 at 2:40 PM, lohit <lo...@gmail.com> wrote:
> Apart from existing docs, there are few code examples which might be
> useful.
>
> hadoop-yarn-applications-distributedshell subproject within yarn
> Storm on YARN https://github.com/yahoo/storm-yarn
>
>
>
> 2013/11/12 Bill Q <bi...@gmail.com>
>
>> Hi friends,
>> I am trying to migrate a distributed data mining system to YARN 2.2 from
>> a custom-built multi-nodes resources management system.
>>
>> I am having some difficulties to find a up-to-date working example of
>> writing an application based on YARN 2.2. The example in the ASF Hadoop
>> page is not complete and outdated.
>>
>> I would appreciate a lot if anyone can share some experiences here.
>>
>> Many thanks.
>>
>>
>> Bill
>>
>
>
>
> --
> Have a Nice Day!
> Lohit
>
Re: Writing an application based on YARN 2.2
Posted by Bill Q <bi...@gmail.com>.
Hi Lohit,
Thanks a lot. Is there any updated docs that would serve as a good entry
point for writing a simple application on YARN? Thanks a lot.
Many thanks.
Bill
On Tue, Nov 12, 2013 at 2:40 PM, lohit <lo...@gmail.com> wrote:
> Apart from existing docs, there are few code examples which might be
> useful.
>
> hadoop-yarn-applications-distributedshell subproject within yarn
> Storm on YARN https://github.com/yahoo/storm-yarn
>
>
>
> 2013/11/12 Bill Q <bi...@gmail.com>
>
>> Hi friends,
>> I am trying to migrate a distributed data mining system to YARN 2.2 from
>> a custom-built multi-nodes resources management system.
>>
>> I am having some difficulties to find a up-to-date working example of
>> writing an application based on YARN 2.2. The example in the ASF Hadoop
>> page is not complete and outdated.
>>
>> I would appreciate a lot if anyone can share some experiences here.
>>
>> Many thanks.
>>
>>
>> Bill
>>
>
>
>
> --
> Have a Nice Day!
> Lohit
>
Re: Writing an application based on YARN 2.2
Posted by lohit <lo...@gmail.com>.
Apart from existing docs, there are few code examples which might be useful.
hadoop-yarn-applications-distributedshell subproject within yarn
Storm on YARN https://github.com/yahoo/storm-yarn
2013/11/12 Bill Q <bi...@gmail.com>
> Hi friends,
> I am trying to migrate a distributed data mining system to YARN 2.2 from a
> custom-built multi-nodes resources management system.
>
> I am having some difficulties to find a up-to-date working example of
> writing an application based on YARN 2.2. The example in the ASF Hadoop
> page is not complete and outdated.
>
> I would appreciate a lot if anyone can share some experiences here.
>
> Many thanks.
>
>
> Bill
>
--
Have a Nice Day!
Lohit
Re: Writing an application based on YARN 2.2
Posted by lohit <lo...@gmail.com>.
Apart from existing docs, there are few code examples which might be useful.
hadoop-yarn-applications-distributedshell subproject within yarn
Storm on YARN https://github.com/yahoo/storm-yarn
2013/11/12 Bill Q <bi...@gmail.com>
> Hi friends,
> I am trying to migrate a distributed data mining system to YARN 2.2 from a
> custom-built multi-nodes resources management system.
>
> I am having some difficulties to find a up-to-date working example of
> writing an application based on YARN 2.2. The example in the ASF Hadoop
> page is not complete and outdated.
>
> I would appreciate a lot if anyone can share some experiences here.
>
> Many thanks.
>
>
> Bill
>
--
Have a Nice Day!
Lohit
Re: Writing an application based on YARN 2.2
Posted by lohit <lo...@gmail.com>.
Apart from existing docs, there are few code examples which might be useful.
hadoop-yarn-applications-distributedshell subproject within yarn
Storm on YARN https://github.com/yahoo/storm-yarn
2013/11/12 Bill Q <bi...@gmail.com>
> Hi friends,
> I am trying to migrate a distributed data mining system to YARN 2.2 from a
> custom-built multi-nodes resources management system.
>
> I am having some difficulties to find a up-to-date working example of
> writing an application based on YARN 2.2. The example in the ASF Hadoop
> page is not complete and outdated.
>
> I would appreciate a lot if anyone can share some experiences here.
>
> Many thanks.
>
>
> Bill
>
--
Have a Nice Day!
Lohit
Re: Writing an application based on YARN 2.2
Posted by krispyjala <kr...@gmail.com>.
I also found this post to be of great help:
http://tzulitai.wordpress.com/2013/08/30/yarn-applications-code-level-breakdown-client
I think he has another post that covers ApplicationMaster code breakdown.
-- Kris.
--
View this message in context: http://hadoop-common.472056.n3.nabble.com/Writing-an-application-based-on-YARN-2-2-tp4029200p4029497.html
Sent from the Users mailing list archive at Nabble.com.
Re: Writing an application based on YARN 2.2
Posted by lohit <lo...@gmail.com>.
Apart from existing docs, there are few code examples which might be useful.
hadoop-yarn-applications-distributedshell subproject within yarn
Storm on YARN https://github.com/yahoo/storm-yarn
2013/11/12 Bill Q <bi...@gmail.com>
> Hi friends,
> I am trying to migrate a distributed data mining system to YARN 2.2 from a
> custom-built multi-nodes resources management system.
>
> I am having some difficulties to find a up-to-date working example of
> writing an application based on YARN 2.2. The example in the ASF Hadoop
> page is not complete and outdated.
>
> I would appreciate a lot if anyone can share some experiences here.
>
> Many thanks.
>
>
> Bill
>
--
Have a Nice Day!
Lohit