You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Jay Vyas <ja...@gmail.com> on 2014/02/11 19:40:33 UTC
YARN FSDownload: How did Mr1 do it ?
Im noticing that resource localization is much more complex in YARN than
MR1, in particular, the timestamps need to be identical, or else, an
exception is thrown.
i never saw that in MR1.
How did MR1 JobTrackers handle resource localization differently than MR2
App Masters?
--
Jay Vyas
http://jayunit100.blogspot.com
Re: YARN FSDownload: How did Mr1 do it ?
Posted by Harsh J <ha...@cloudera.com>.
DistributedCache has also had timestamp checks in MR1 for quite a
while now: https://github.com/apache/hadoop-common/blob/release-0.20.2/src/core/org/apache/hadoop/filecache/DistributedCache.java#L481
(See also the doc at
https://github.com/apache/hadoop-common/blob/release-0.20.2/src/core/org/apache/hadoop/filecache/DistributedCache.java#L56).
On Wed, Feb 12, 2014 at 12:10 AM, Jay Vyas <ja...@gmail.com> wrote:
> Im noticing that resource localization is much more complex in YARN than
> MR1, in particular, the timestamps need to be identical, or else, an
> exception is thrown.
>
> i never saw that in MR1.
>
> How did MR1 JobTrackers handle resource localization differently than MR2
> App Masters?
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com
--
Harsh J
Re: YARN FSDownload: How did Mr1 do it ?
Posted by Harsh J <ha...@cloudera.com>.
DistributedCache has also had timestamp checks in MR1 for quite a
while now: https://github.com/apache/hadoop-common/blob/release-0.20.2/src/core/org/apache/hadoop/filecache/DistributedCache.java#L481
(See also the doc at
https://github.com/apache/hadoop-common/blob/release-0.20.2/src/core/org/apache/hadoop/filecache/DistributedCache.java#L56).
On Wed, Feb 12, 2014 at 12:10 AM, Jay Vyas <ja...@gmail.com> wrote:
> Im noticing that resource localization is much more complex in YARN than
> MR1, in particular, the timestamps need to be identical, or else, an
> exception is thrown.
>
> i never saw that in MR1.
>
> How did MR1 JobTrackers handle resource localization differently than MR2
> App Masters?
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com
--
Harsh J
Re: YARN FSDownload: How did Mr1 do it ?
Posted by Harsh J <ha...@cloudera.com>.
DistributedCache has also had timestamp checks in MR1 for quite a
while now: https://github.com/apache/hadoop-common/blob/release-0.20.2/src/core/org/apache/hadoop/filecache/DistributedCache.java#L481
(See also the doc at
https://github.com/apache/hadoop-common/blob/release-0.20.2/src/core/org/apache/hadoop/filecache/DistributedCache.java#L56).
On Wed, Feb 12, 2014 at 12:10 AM, Jay Vyas <ja...@gmail.com> wrote:
> Im noticing that resource localization is much more complex in YARN than
> MR1, in particular, the timestamps need to be identical, or else, an
> exception is thrown.
>
> i never saw that in MR1.
>
> How did MR1 JobTrackers handle resource localization differently than MR2
> App Masters?
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com
--
Harsh J
Re: YARN FSDownload: How did Mr1 do it ?
Posted by Harsh J <ha...@cloudera.com>.
DistributedCache has also had timestamp checks in MR1 for quite a
while now: https://github.com/apache/hadoop-common/blob/release-0.20.2/src/core/org/apache/hadoop/filecache/DistributedCache.java#L481
(See also the doc at
https://github.com/apache/hadoop-common/blob/release-0.20.2/src/core/org/apache/hadoop/filecache/DistributedCache.java#L56).
On Wed, Feb 12, 2014 at 12:10 AM, Jay Vyas <ja...@gmail.com> wrote:
> Im noticing that resource localization is much more complex in YARN than
> MR1, in particular, the timestamps need to be identical, or else, an
> exception is thrown.
>
> i never saw that in MR1.
>
> How did MR1 JobTrackers handle resource localization differently than MR2
> App Masters?
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com
--
Harsh J