You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Kevin Burton <rk...@charter.net> on 2013/04/25 14:27:15 UTC
Comparison between JobClient/JobConf and Job/Configuration
I notice that in some beginning texts on starting a Hadoop MapReduce job
sometimes JobClient/JobConf is used and sometimes Job/Configuration is used.
I have yet to see anyone comment on the features/benefits of either set of
methods. Could someone comment on their preferred method for starting a
MapReduce job from a Java program?
Thank you.
Re: Comparison between JobClient/JobConf and Job/Configuration
Posted by Arun C Murthy <ac...@hortonworks.com>.
Actually, if you care about being binary compatible b/w hadoop-1 and hadoop-2, stay with "old" mapred API.
On Apr 25, 2013, at 10:04 AM, Sandy Ryza wrote:
> Hi Kevin,
>
> JobClient/JobConf is the "old" mapred API and Job/Configuration is the improved "new" API, so in general the latter is preferred.
>
> -Sandy
>
>
> On Thu, Apr 25, 2013 at 5:27 AM, Kevin Burton <rk...@charter.net> wrote:
> I notice that in some beginning texts on starting a Hadoop MapReduce job sometimes JobClient/JobConf is used and sometimes Job/Configuration is used. I have yet to see anyone comment on the features/benefits of either set of methods. Could someone comment on their preferred method for starting a MapReduce job from a Java program?
>
>
>
> Thank you.
>
>
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
Re: Comparison between JobClient/JobConf and Job/Configuration
Posted by Arun C Murthy <ac...@hortonworks.com>.
Actually, if you care about being binary compatible b/w hadoop-1 and hadoop-2, stay with "old" mapred API.
On Apr 25, 2013, at 10:04 AM, Sandy Ryza wrote:
> Hi Kevin,
>
> JobClient/JobConf is the "old" mapred API and Job/Configuration is the improved "new" API, so in general the latter is preferred.
>
> -Sandy
>
>
> On Thu, Apr 25, 2013 at 5:27 AM, Kevin Burton <rk...@charter.net> wrote:
> I notice that in some beginning texts on starting a Hadoop MapReduce job sometimes JobClient/JobConf is used and sometimes Job/Configuration is used. I have yet to see anyone comment on the features/benefits of either set of methods. Could someone comment on their preferred method for starting a MapReduce job from a Java program?
>
>
>
> Thank you.
>
>
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
Re: Comparison between JobClient/JobConf and Job/Configuration
Posted by Arun C Murthy <ac...@hortonworks.com>.
Actually, if you care about being binary compatible b/w hadoop-1 and hadoop-2, stay with "old" mapred API.
On Apr 25, 2013, at 10:04 AM, Sandy Ryza wrote:
> Hi Kevin,
>
> JobClient/JobConf is the "old" mapred API and Job/Configuration is the improved "new" API, so in general the latter is preferred.
>
> -Sandy
>
>
> On Thu, Apr 25, 2013 at 5:27 AM, Kevin Burton <rk...@charter.net> wrote:
> I notice that in some beginning texts on starting a Hadoop MapReduce job sometimes JobClient/JobConf is used and sometimes Job/Configuration is used. I have yet to see anyone comment on the features/benefits of either set of methods. Could someone comment on their preferred method for starting a MapReduce job from a Java program?
>
>
>
> Thank you.
>
>
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
Re: Comparison between JobClient/JobConf and Job/Configuration
Posted by Arun C Murthy <ac...@hortonworks.com>.
Actually, if you care about being binary compatible b/w hadoop-1 and hadoop-2, stay with "old" mapred API.
On Apr 25, 2013, at 10:04 AM, Sandy Ryza wrote:
> Hi Kevin,
>
> JobClient/JobConf is the "old" mapred API and Job/Configuration is the improved "new" API, so in general the latter is preferred.
>
> -Sandy
>
>
> On Thu, Apr 25, 2013 at 5:27 AM, Kevin Burton <rk...@charter.net> wrote:
> I notice that in some beginning texts on starting a Hadoop MapReduce job sometimes JobClient/JobConf is used and sometimes Job/Configuration is used. I have yet to see anyone comment on the features/benefits of either set of methods. Could someone comment on their preferred method for starting a MapReduce job from a Java program?
>
>
>
> Thank you.
>
>
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
Re: Comparison between JobClient/JobConf and Job/Configuration
Posted by Sandy Ryza <sa...@cloudera.com>.
Hi Kevin,
JobClient/JobConf is the "old" mapred API and Job/Configuration is the
improved "new" API, so in general the latter is preferred.
-Sandy
On Thu, Apr 25, 2013 at 5:27 AM, Kevin Burton <rk...@charter.net>wrote:
> I notice that in some beginning texts on starting a Hadoop MapReduce job
> sometimes JobClient/JobConf is used and sometimes Job/Configuration is
> used. I have yet to see anyone comment on the features/benefits of either
> set of methods. Could someone comment on their preferred method for
> starting a MapReduce job from a Java program? ****
>
> ** **
>
> Thank you.****
>
Re: Comparison between JobClient/JobConf and Job/Configuration
Posted by Sandy Ryza <sa...@cloudera.com>.
Hi Kevin,
JobClient/JobConf is the "old" mapred API and Job/Configuration is the
improved "new" API, so in general the latter is preferred.
-Sandy
On Thu, Apr 25, 2013 at 5:27 AM, Kevin Burton <rk...@charter.net>wrote:
> I notice that in some beginning texts on starting a Hadoop MapReduce job
> sometimes JobClient/JobConf is used and sometimes Job/Configuration is
> used. I have yet to see anyone comment on the features/benefits of either
> set of methods. Could someone comment on their preferred method for
> starting a MapReduce job from a Java program? ****
>
> ** **
>
> Thank you.****
>
Re: Comparison between JobClient/JobConf and Job/Configuration
Posted by Sandy Ryza <sa...@cloudera.com>.
Hi Kevin,
JobClient/JobConf is the "old" mapred API and Job/Configuration is the
improved "new" API, so in general the latter is preferred.
-Sandy
On Thu, Apr 25, 2013 at 5:27 AM, Kevin Burton <rk...@charter.net>wrote:
> I notice that in some beginning texts on starting a Hadoop MapReduce job
> sometimes JobClient/JobConf is used and sometimes Job/Configuration is
> used. I have yet to see anyone comment on the features/benefits of either
> set of methods. Could someone comment on their preferred method for
> starting a MapReduce job from a Java program? ****
>
> ** **
>
> Thank you.****
>
Re: Comparison between JobClient/JobConf and Job/Configuration
Posted by Sandy Ryza <sa...@cloudera.com>.
Hi Kevin,
JobClient/JobConf is the "old" mapred API and Job/Configuration is the
improved "new" API, so in general the latter is preferred.
-Sandy
On Thu, Apr 25, 2013 at 5:27 AM, Kevin Burton <rk...@charter.net>wrote:
> I notice that in some beginning texts on starting a Hadoop MapReduce job
> sometimes JobClient/JobConf is used and sometimes Job/Configuration is
> used. I have yet to see anyone comment on the features/benefits of either
> set of methods. Could someone comment on their preferred method for
> starting a MapReduce job from a Java program? ****
>
> ** **
>
> Thank you.****
>