You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Amir Sanjar <v1...@us.ibm.com> on 2013/04/22 00:45:06 UTC
mrv1 vs YARN
Would an application compiled against YARN/MRv2 run transparently on MRv1?
Are there any API differences ?
How stable is YARN/MRV2?
Best Regards
Amir Sanjar
System Management Architect
PowerLinux Open Source Hadoop development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
Re: mrv1 vs YARN
Posted by Robert Evans <ev...@yahoo-inc.com>.
Like with most major releases of Hadoop the releases are API compatible,
but not necessarily binary compatible. That means a job for 1.0 can be
recompiled against 2.0 and it should compile and run similarly to 1.0. If
it does not feel free to file a JAIR on the incompatibility. There have
been a few and we have worked to make them backwards compatible. As far a
binary compatibility is concerned. For the most part you should be able to
run your jobs without recompiling. There are some people trying to make
it as binary compatible as possible, but it is not a guarantee.
I would expect to have a non-alpha semi-stable release of 2.0 by late June
or early July. I am not an expert on this and there are lots of things
that could show up and cause those dates to slip.
--Bobby
On 4/21/13 6:45 PM, "Shekhar Gupta" <sh...@gmail.com> wrote:
>I am sorry Amir. I don't have answers for these questions. Because I don't
>use Hadoop for any real production jobs.
>Mainly I play with the Scheduler and ResourceManager of YARN as part of my
>thesis. So I just run some simple jobs to test the performance of the
>scheduler.
>
>
>On Sun, Apr 21, 2013 at 4:18 PM, Amir Sanjar <v1...@us.ibm.com> wrote:
>
>> thanks Shekhar, do you know when we will have an stable release for
>>hadoop
>> 2.0 (not alpha)?
>> Also from you experience, what component of hadoop 2.0.3 are most
>>unstable
>> and are more likely need more attention?
>>
>> Best Regards
>> Amir Sanjar
>>
>> System Management Architect
>> PowerLinux Open Source Hadoop development lead
>> IBM Senior Software Engineer
>> Phone# 512-286-8393
>> Fax# 512-838-8858
>>
>>
>>
>> [image: Inactive hide details for Shekhar Gupta ---04/21/2013 06:06:33
>> PM---As par my experience the MapReduce API is same for both YAR]Shekhar
>> Gupta ---04/21/2013 06:06:33 PM---As par my experience the MapReduce
>>API is
>> same for both YARN and MRv2. Applications compiled again Y
>>
>> From: Shekhar Gupta <sh...@gmail.com>
>> To: common-dev@hadoop.apache.org,
>> Date: 04/21/2013 06:06 PM
>> Subject: Re: mrv1 vs YARN
>> ------------------------------
>>
>>
>>
>> As par my experience the MapReduce API is same for both YARN and MRv2.
>> Applications compiled again YARN should run smoothly on MRv1. Ans the
>>vice
>> versa is also true.
>> And in general YARN is pretty stable now.
>>
>> Regards,
>> Shekhar
>>
>>
>>
>> On Sun, Apr 21, 2013 at 3:45 PM, Amir Sanjar <v1...@us.ibm.com>
>>wrote:
>>
>> > Would an application compiled against YARN/MRv2 run transparently on
>> MRv1?
>> > Are there any API differences ?
>> > How stable is YARN/MRV2?
>> >
>> > Best Regards
>> > Amir Sanjar
>> >
>> > System Management Architect
>> > PowerLinux Open Source Hadoop development lead
>> > IBM Senior Software Engineer
>> > Phone# 512-286-8393
>> > Fax# 512-838-8858
>> >
>>
>>
Re: mrv1 vs YARN
Posted by Shekhar Gupta <sh...@gmail.com>.
I am sorry Amir. I don't have answers for these questions. Because I don't
use Hadoop for any real production jobs.
Mainly I play with the Scheduler and ResourceManager of YARN as part of my
thesis. So I just run some simple jobs to test the performance of the
scheduler.
On Sun, Apr 21, 2013 at 4:18 PM, Amir Sanjar <v1...@us.ibm.com> wrote:
> thanks Shekhar, do you know when we will have an stable release for hadoop
> 2.0 (not alpha)?
> Also from you experience, what component of hadoop 2.0.3 are most unstable
> and are more likely need more attention?
>
> Best Regards
> Amir Sanjar
>
> System Management Architect
> PowerLinux Open Source Hadoop development lead
> IBM Senior Software Engineer
> Phone# 512-286-8393
> Fax# 512-838-8858
>
>
>
> [image: Inactive hide details for Shekhar Gupta ---04/21/2013 06:06:33
> PM---As par my experience the MapReduce API is same for both YAR]Shekhar
> Gupta ---04/21/2013 06:06:33 PM---As par my experience the MapReduce API is
> same for both YARN and MRv2. Applications compiled again Y
>
> From: Shekhar Gupta <sh...@gmail.com>
> To: common-dev@hadoop.apache.org,
> Date: 04/21/2013 06:06 PM
> Subject: Re: mrv1 vs YARN
> ------------------------------
>
>
>
> As par my experience the MapReduce API is same for both YARN and MRv2.
> Applications compiled again YARN should run smoothly on MRv1. Ans the vice
> versa is also true.
> And in general YARN is pretty stable now.
>
> Regards,
> Shekhar
>
>
>
> On Sun, Apr 21, 2013 at 3:45 PM, Amir Sanjar <v1...@us.ibm.com> wrote:
>
> > Would an application compiled against YARN/MRv2 run transparently on
> MRv1?
> > Are there any API differences ?
> > How stable is YARN/MRV2?
> >
> > Best Regards
> > Amir Sanjar
> >
> > System Management Architect
> > PowerLinux Open Source Hadoop development lead
> > IBM Senior Software Engineer
> > Phone# 512-286-8393
> > Fax# 512-838-8858
> >
>
>
Re: mrv1 vs YARN
Posted by Amir Sanjar <v1...@us.ibm.com>.
thanks Shekhar, do you know when we will have an stable release for hadoop
2.0 (not alpha)?
Also from you experience, what component of hadoop 2.0.3 are most unstable
and are more likely need more attention?
Best Regards
Amir Sanjar
System Management Architect
PowerLinux Open Source Hadoop development lead
IBM Senior Software Engineer
Phone# 512-286-8393
Fax# 512-838-8858
From: Shekhar Gupta <sh...@gmail.com>
To: common-dev@hadoop.apache.org,
Date: 04/21/2013 06:06 PM
Subject: Re: mrv1 vs YARN
As par my experience the MapReduce API is same for both YARN and MRv2.
Applications compiled again YARN should run smoothly on MRv1. Ans the vice
versa is also true.
And in general YARN is pretty stable now.
Regards,
Shekhar
On Sun, Apr 21, 2013 at 3:45 PM, Amir Sanjar <v1...@us.ibm.com> wrote:
> Would an application compiled against YARN/MRv2 run transparently on
MRv1?
> Are there any API differences ?
> How stable is YARN/MRV2?
>
> Best Regards
> Amir Sanjar
>
> System Management Architect
> PowerLinux Open Source Hadoop development lead
> IBM Senior Software Engineer
> Phone# 512-286-8393
> Fax# 512-838-8858
>
Re: mrv1 vs YARN
Posted by Shekhar Gupta <sh...@gmail.com>.
As par my experience the MapReduce API is same for both YARN and MRv2.
Applications compiled again YARN should run smoothly on MRv1. Ans the vice
versa is also true.
And in general YARN is pretty stable now.
Regards,
Shekhar
On Sun, Apr 21, 2013 at 3:45 PM, Amir Sanjar <v1...@us.ibm.com> wrote:
> Would an application compiled against YARN/MRv2 run transparently on MRv1?
> Are there any API differences ?
> How stable is YARN/MRV2?
>
> Best Regards
> Amir Sanjar
>
> System Management Architect
> PowerLinux Open Source Hadoop development lead
> IBM Senior Software Engineer
> Phone# 512-286-8393
> Fax# 512-838-8858
>