You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Chui-Hui Chiu <cc...@tigers.lsu.edu> on 2013/07/14 21:55:47 UTC
Running example programs on YARN
Hello,
I have a Hadoop 2.0.5 Alpha cluster. In the etc/hadoop/mapred-site.xml, I
specify nothing more than that the cluster adopts the YARN architecture so
that the cluster is a pure YARN cluster.
I also read the source code of "hadoop-mapreduce-examples-2.0.5-alpha.jar".
They do not have Clients and Application Masters. How are they launched?
Is there a default Client and an Application Master somewhere else for all
kinds of MapReduce programs?
Thanks,
Chui-hui
Re: Running example programs on YARN
Posted by Harsh J <ha...@cloudera.com>.
The MR (MR2) application would reside in the project/jar called
hadoop-mapreduce-client-app-*.jar. In a tarball, this would be at
$HADOOP_PREFIX/share/hadoop/mapreduce/
On Mon, Jul 15, 2013 at 1:57 AM, Jian He <jh...@hortonworks.com> wrote:
> Yes, check the code base, there's a thing called MRAppMaster for all MR
> programs and YARNRunner to enable current JobClient to run on YARN.
>
> Jian
>
>
> On Sun, Jul 14, 2013 at 12:55 PM, Chui-Hui Chiu <cc...@tigers.lsu.edu>
> wrote:
>>
>> Hello,
>>
>> I have a Hadoop 2.0.5 Alpha cluster. In the etc/hadoop/mapred-site.xml, I
>> specify nothing more than that the cluster adopts the YARN architecture so
>> that the cluster is a pure YARN cluster.
>>
>> I also read the source code of
>> "hadoop-mapreduce-examples-2.0.5-alpha.jar". They do not have Clients and
>> Application Masters. How are they launched? Is there a default Client and
>> an Application Master somewhere else for all kinds of MapReduce programs?
>>
>> Thanks,
>> Chui-hui
>
>
--
Harsh J
Re: Running example programs on YARN
Posted by Harsh J <ha...@cloudera.com>.
The MR (MR2) application would reside in the project/jar called
hadoop-mapreduce-client-app-*.jar. In a tarball, this would be at
$HADOOP_PREFIX/share/hadoop/mapreduce/
On Mon, Jul 15, 2013 at 1:57 AM, Jian He <jh...@hortonworks.com> wrote:
> Yes, check the code base, there's a thing called MRAppMaster for all MR
> programs and YARNRunner to enable current JobClient to run on YARN.
>
> Jian
>
>
> On Sun, Jul 14, 2013 at 12:55 PM, Chui-Hui Chiu <cc...@tigers.lsu.edu>
> wrote:
>>
>> Hello,
>>
>> I have a Hadoop 2.0.5 Alpha cluster. In the etc/hadoop/mapred-site.xml, I
>> specify nothing more than that the cluster adopts the YARN architecture so
>> that the cluster is a pure YARN cluster.
>>
>> I also read the source code of
>> "hadoop-mapreduce-examples-2.0.5-alpha.jar". They do not have Clients and
>> Application Masters. How are they launched? Is there a default Client and
>> an Application Master somewhere else for all kinds of MapReduce programs?
>>
>> Thanks,
>> Chui-hui
>
>
--
Harsh J
Re: Running example programs on YARN
Posted by Harsh J <ha...@cloudera.com>.
The MR (MR2) application would reside in the project/jar called
hadoop-mapreduce-client-app-*.jar. In a tarball, this would be at
$HADOOP_PREFIX/share/hadoop/mapreduce/
On Mon, Jul 15, 2013 at 1:57 AM, Jian He <jh...@hortonworks.com> wrote:
> Yes, check the code base, there's a thing called MRAppMaster for all MR
> programs and YARNRunner to enable current JobClient to run on YARN.
>
> Jian
>
>
> On Sun, Jul 14, 2013 at 12:55 PM, Chui-Hui Chiu <cc...@tigers.lsu.edu>
> wrote:
>>
>> Hello,
>>
>> I have a Hadoop 2.0.5 Alpha cluster. In the etc/hadoop/mapred-site.xml, I
>> specify nothing more than that the cluster adopts the YARN architecture so
>> that the cluster is a pure YARN cluster.
>>
>> I also read the source code of
>> "hadoop-mapreduce-examples-2.0.5-alpha.jar". They do not have Clients and
>> Application Masters. How are they launched? Is there a default Client and
>> an Application Master somewhere else for all kinds of MapReduce programs?
>>
>> Thanks,
>> Chui-hui
>
>
--
Harsh J
Re: Running example programs on YARN
Posted by Harsh J <ha...@cloudera.com>.
The MR (MR2) application would reside in the project/jar called
hadoop-mapreduce-client-app-*.jar. In a tarball, this would be at
$HADOOP_PREFIX/share/hadoop/mapreduce/
On Mon, Jul 15, 2013 at 1:57 AM, Jian He <jh...@hortonworks.com> wrote:
> Yes, check the code base, there's a thing called MRAppMaster for all MR
> programs and YARNRunner to enable current JobClient to run on YARN.
>
> Jian
>
>
> On Sun, Jul 14, 2013 at 12:55 PM, Chui-Hui Chiu <cc...@tigers.lsu.edu>
> wrote:
>>
>> Hello,
>>
>> I have a Hadoop 2.0.5 Alpha cluster. In the etc/hadoop/mapred-site.xml, I
>> specify nothing more than that the cluster adopts the YARN architecture so
>> that the cluster is a pure YARN cluster.
>>
>> I also read the source code of
>> "hadoop-mapreduce-examples-2.0.5-alpha.jar". They do not have Clients and
>> Application Masters. How are they launched? Is there a default Client and
>> an Application Master somewhere else for all kinds of MapReduce programs?
>>
>> Thanks,
>> Chui-hui
>
>
--
Harsh J
Re: Running example programs on YARN
Posted by Jian He <jh...@hortonworks.com>.
Yes, check the code base, there's a thing called MRAppMaster for all MR
programs and YARNRunner to enable current JobClient to run on YARN.
Jian
On Sun, Jul 14, 2013 at 12:55 PM, Chui-Hui Chiu <cc...@tigers.lsu.edu>wrote:
> Hello,
>
> I have a Hadoop 2.0.5 Alpha cluster. In the etc/hadoop/mapred-site.xml, I
> specify nothing more than that the cluster adopts the YARN architecture so
> that the cluster is a pure YARN cluster.
>
> I also read the source code of
> "hadoop-mapreduce-examples-2.0.5-alpha.jar". They do not have Clients and
> Application Masters. How are they launched? Is there a default Client and
> an Application Master somewhere else for all kinds of MapReduce programs?
>
> Thanks,
> Chui-hui
>
Re: Running example programs on YARN
Posted by Jian He <jh...@hortonworks.com>.
Yes, check the code base, there's a thing called MRAppMaster for all MR
programs and YARNRunner to enable current JobClient to run on YARN.
Jian
On Sun, Jul 14, 2013 at 12:55 PM, Chui-Hui Chiu <cc...@tigers.lsu.edu>wrote:
> Hello,
>
> I have a Hadoop 2.0.5 Alpha cluster. In the etc/hadoop/mapred-site.xml, I
> specify nothing more than that the cluster adopts the YARN architecture so
> that the cluster is a pure YARN cluster.
>
> I also read the source code of
> "hadoop-mapreduce-examples-2.0.5-alpha.jar". They do not have Clients and
> Application Masters. How are they launched? Is there a default Client and
> an Application Master somewhere else for all kinds of MapReduce programs?
>
> Thanks,
> Chui-hui
>
Re: Running example programs on YARN
Posted by Jian He <jh...@hortonworks.com>.
Yes, check the code base, there's a thing called MRAppMaster for all MR
programs and YARNRunner to enable current JobClient to run on YARN.
Jian
On Sun, Jul 14, 2013 at 12:55 PM, Chui-Hui Chiu <cc...@tigers.lsu.edu>wrote:
> Hello,
>
> I have a Hadoop 2.0.5 Alpha cluster. In the etc/hadoop/mapred-site.xml, I
> specify nothing more than that the cluster adopts the YARN architecture so
> that the cluster is a pure YARN cluster.
>
> I also read the source code of
> "hadoop-mapreduce-examples-2.0.5-alpha.jar". They do not have Clients and
> Application Masters. How are they launched? Is there a default Client and
> an Application Master somewhere else for all kinds of MapReduce programs?
>
> Thanks,
> Chui-hui
>
Re: Running example programs on YARN
Posted by Jian He <jh...@hortonworks.com>.
Yes, check the code base, there's a thing called MRAppMaster for all MR
programs and YARNRunner to enable current JobClient to run on YARN.
Jian
On Sun, Jul 14, 2013 at 12:55 PM, Chui-Hui Chiu <cc...@tigers.lsu.edu>wrote:
> Hello,
>
> I have a Hadoop 2.0.5 Alpha cluster. In the etc/hadoop/mapred-site.xml, I
> specify nothing more than that the cluster adopts the YARN architecture so
> that the cluster is a pure YARN cluster.
>
> I also read the source code of
> "hadoop-mapreduce-examples-2.0.5-alpha.jar". They do not have Clients and
> Application Masters. How are they launched? Is there a default Client and
> an Application Master somewhere else for all kinds of MapReduce programs?
>
> Thanks,
> Chui-hui
>