You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Marco Shaw <ma...@gmail.com> on 2014/02/26 22:26:55 UTC
Old vs new MR API
Tom White's Hadoop book refers to old vs new MR APIs.
Is this strictly a MR1 vs MR2 (YARN) comparison, or something before MR2?
Re: Old vs new MR API
Posted by Ahmed Radwan <a....@gmail.com>.
Old vs new MR APIs refers to changes from org.apache.hadoop.mapred to
org.apache.hadoop.mapreduce packages which are changes in how you construct
your job, mappers, reducers, etc.
This is not related to Yarn/MR2 which generally refers to new Hadoop 2
design where there is separation between resource management (handled by
yarn) and application life cycle management (handled by application
master). Just google yarn and you'll find a lot of docs and blog posts
describing these details.
Best Regards
Ahmed
On Wed, Feb 26, 2014 at 1:26 PM, Marco Shaw <ma...@gmail.com> wrote:
> Tom White's Hadoop book refers to old vs new MR APIs.
>
> Is this strictly a MR1 vs MR2 (YARN) comparison, or something before MR2?
>
--
Ahmed
Re: Old vs new MR API
Posted by Ahmed Radwan <a....@gmail.com>.
Old vs new MR APIs refers to changes from org.apache.hadoop.mapred to
org.apache.hadoop.mapreduce packages which are changes in how you construct
your job, mappers, reducers, etc.
This is not related to Yarn/MR2 which generally refers to new Hadoop 2
design where there is separation between resource management (handled by
yarn) and application life cycle management (handled by application
master). Just google yarn and you'll find a lot of docs and blog posts
describing these details.
Best Regards
Ahmed
On Wed, Feb 26, 2014 at 1:26 PM, Marco Shaw <ma...@gmail.com> wrote:
> Tom White's Hadoop book refers to old vs new MR APIs.
>
> Is this strictly a MR1 vs MR2 (YARN) comparison, or something before MR2?
>
--
Ahmed
Re: Old vs new MR API
Posted by Ahmed Radwan <a....@gmail.com>.
Old vs new MR APIs refers to changes from org.apache.hadoop.mapred to
org.apache.hadoop.mapreduce packages which are changes in how you construct
your job, mappers, reducers, etc.
This is not related to Yarn/MR2 which generally refers to new Hadoop 2
design where there is separation between resource management (handled by
yarn) and application life cycle management (handled by application
master). Just google yarn and you'll find a lot of docs and blog posts
describing these details.
Best Regards
Ahmed
On Wed, Feb 26, 2014 at 1:26 PM, Marco Shaw <ma...@gmail.com> wrote:
> Tom White's Hadoop book refers to old vs new MR APIs.
>
> Is this strictly a MR1 vs MR2 (YARN) comparison, or something before MR2?
>
--
Ahmed
Re: Old vs new MR API
Posted by Ahmed Radwan <a....@gmail.com>.
Old vs new MR APIs refers to changes from org.apache.hadoop.mapred to
org.apache.hadoop.mapreduce packages which are changes in how you construct
your job, mappers, reducers, etc.
This is not related to Yarn/MR2 which generally refers to new Hadoop 2
design where there is separation between resource management (handled by
yarn) and application life cycle management (handled by application
master). Just google yarn and you'll find a lot of docs and blog posts
describing these details.
Best Regards
Ahmed
On Wed, Feb 26, 2014 at 1:26 PM, Marco Shaw <ma...@gmail.com> wrote:
> Tom White's Hadoop book refers to old vs new MR APIs.
>
> Is this strictly a MR1 vs MR2 (YARN) comparison, or something before MR2?
>
--
Ahmed