You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by Karthik Kambatla <ka...@cloudera.com> on 2014/10/07 19:58:16 UTC

YARN-2566. Local dir creation

Hi folks,

I just wanted to bring YARN-2566 to your notice - the JIRA proposes to pick
directory with most available space instead of the first directory.

While I believe it is definitely an improvement over picking the first
directory always, I understand this can cause hot-spotting on nodes with
widely varied availabilities.

If you have opinions on picking a local directory, please comment on the
JIRA.

Thanks
Karthik

Re: YARN-2566. Local dir creation

Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
Tx for the heads-up Karthik. I commented on the JIRA:
https://issues.apache.org/jira/browse/YARN-2566?focusedCommentId=14162216&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14162216

+Vinod

On Tue, Oct 7, 2014 at 10:58 AM, Karthik Kambatla <ka...@cloudera.com>
wrote:

> Hi folks,
>
> I just wanted to bring YARN-2566 to your notice - the JIRA proposes to pick
> directory with most available space instead of the first directory.
>
> While I believe it is definitely an improvement over picking the first
> directory always, I understand this can cause hot-spotting on nodes with
> widely varied availabilities.
>
> If you have opinions on picking a local directory, please comment on the
> JIRA.
>
> Thanks
> Karthik
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.