You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Yehia Elshater <y....@gmail.com> on 2014/10/21 19:01:56 UTC
Hadoop 2.0 job simulation using MiniCluster
Hi All,
I am wondering how can I simulate a Hadoop 2.0 Job using MiniCluster and
MiniDFS ? for example, I want to simulate a submission of a Hadoop job with
some map/reduce tasks given some data input splits.
Your help is really appreciated.
Yehia
Re: Hadoop 2.0 job simulation using MiniCluster
Posted by Yehia Elshater <y....@gmail.com>.
Thanks a lot. That is what I need.
On 21 October 2014 18:13, Hitesh Shah <hi...@apache.org> wrote:
> Maybe check TestMRJobs.java (
> hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobs.java
> ) ?
>
> — Hitesh
>
> On Oct 21, 2014, at 10:01 AM, Yehia Elshater <y....@gmail.com>
> wrote:
>
> > Hi All,
> >
> > I am wondering how can I simulate a Hadoop 2.0 Job using MiniCluster and
> MiniDFS ? for example, I want to simulate a submission of a Hadoop job with
> some map/reduce tasks given some data input splits.
> >
> > Your help is really appreciated.
> > Yehia
>
>
Re: Hadoop 2.0 job simulation using MiniCluster
Posted by Yehia Elshater <y....@gmail.com>.
Thanks a lot. That is what I need.
On 21 October 2014 18:13, Hitesh Shah <hi...@apache.org> wrote:
> Maybe check TestMRJobs.java (
> hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobs.java
> ) ?
>
> — Hitesh
>
> On Oct 21, 2014, at 10:01 AM, Yehia Elshater <y....@gmail.com>
> wrote:
>
> > Hi All,
> >
> > I am wondering how can I simulate a Hadoop 2.0 Job using MiniCluster and
> MiniDFS ? for example, I want to simulate a submission of a Hadoop job with
> some map/reduce tasks given some data input splits.
> >
> > Your help is really appreciated.
> > Yehia
>
>
Re: Hadoop 2.0 job simulation using MiniCluster
Posted by Yehia Elshater <y....@gmail.com>.
Thanks a lot. That is what I need.
On 21 October 2014 18:13, Hitesh Shah <hi...@apache.org> wrote:
> Maybe check TestMRJobs.java (
> hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobs.java
> ) ?
>
> — Hitesh
>
> On Oct 21, 2014, at 10:01 AM, Yehia Elshater <y....@gmail.com>
> wrote:
>
> > Hi All,
> >
> > I am wondering how can I simulate a Hadoop 2.0 Job using MiniCluster and
> MiniDFS ? for example, I want to simulate a submission of a Hadoop job with
> some map/reduce tasks given some data input splits.
> >
> > Your help is really appreciated.
> > Yehia
>
>
Re: Hadoop 2.0 job simulation using MiniCluster
Posted by Yehia Elshater <y....@gmail.com>.
Thanks a lot. That is what I need.
On 21 October 2014 18:13, Hitesh Shah <hi...@apache.org> wrote:
> Maybe check TestMRJobs.java (
> hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobs.java
> ) ?
>
> — Hitesh
>
> On Oct 21, 2014, at 10:01 AM, Yehia Elshater <y....@gmail.com>
> wrote:
>
> > Hi All,
> >
> > I am wondering how can I simulate a Hadoop 2.0 Job using MiniCluster and
> MiniDFS ? for example, I want to simulate a submission of a Hadoop job with
> some map/reduce tasks given some data input splits.
> >
> > Your help is really appreciated.
> > Yehia
>
>
Re: Hadoop 2.0 job simulation using MiniCluster
Posted by Hitesh Shah <hi...@apache.org>.
Maybe check TestMRJobs.java ( hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobs.java ) ?
— Hitesh
On Oct 21, 2014, at 10:01 AM, Yehia Elshater <y....@gmail.com> wrote:
> Hi All,
>
> I am wondering how can I simulate a Hadoop 2.0 Job using MiniCluster and MiniDFS ? for example, I want to simulate a submission of a Hadoop job with some map/reduce tasks given some data input splits.
>
> Your help is really appreciated.
> Yehia
Re: Hadoop 2.0 job simulation using MiniCluster
Posted by Hitesh Shah <hi...@apache.org>.
Maybe check TestMRJobs.java ( hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobs.java ) ?
— Hitesh
On Oct 21, 2014, at 10:01 AM, Yehia Elshater <y....@gmail.com> wrote:
> Hi All,
>
> I am wondering how can I simulate a Hadoop 2.0 Job using MiniCluster and MiniDFS ? for example, I want to simulate a submission of a Hadoop job with some map/reduce tasks given some data input splits.
>
> Your help is really appreciated.
> Yehia
Re: Hadoop 2.0 job simulation using MiniCluster
Posted by Hitesh Shah <hi...@apache.org>.
Maybe check TestMRJobs.java ( hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobs.java ) ?
— Hitesh
On Oct 21, 2014, at 10:01 AM, Yehia Elshater <y....@gmail.com> wrote:
> Hi All,
>
> I am wondering how can I simulate a Hadoop 2.0 Job using MiniCluster and MiniDFS ? for example, I want to simulate a submission of a Hadoop job with some map/reduce tasks given some data input splits.
>
> Your help is really appreciated.
> Yehia
Re: Hadoop 2.0 job simulation using MiniCluster
Posted by Hitesh Shah <hi...@apache.org>.
Maybe check TestMRJobs.java ( hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobs.java ) ?
— Hitesh
On Oct 21, 2014, at 10:01 AM, Yehia Elshater <y....@gmail.com> wrote:
> Hi All,
>
> I am wondering how can I simulate a Hadoop 2.0 Job using MiniCluster and MiniDFS ? for example, I want to simulate a submission of a Hadoop job with some map/reduce tasks given some data input splits.
>
> Your help is really appreciated.
> Yehia