You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by Karthik Kambatla <ka...@cloudera.com> on 2014/10/07 19:58:16 UTC
YARN-2566. Local dir creation
Hi folks,
I just wanted to bring YARN-2566 to your notice - the JIRA proposes to pick
directory with most available space instead of the first directory.
While I believe it is definitely an improvement over picking the first
directory always, I understand this can cause hot-spotting on nodes with
widely varied availabilities.
If you have opinions on picking a local directory, please comment on the
JIRA.
Thanks
Karthik
Re: YARN-2566. Local dir creation
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
Tx for the heads-up Karthik. I commented on the JIRA:
https://issues.apache.org/jira/browse/YARN-2566?focusedCommentId=14162216&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14162216
+Vinod
On Tue, Oct 7, 2014 at 10:58 AM, Karthik Kambatla <ka...@cloudera.com>
wrote:
> Hi folks,
>
> I just wanted to bring YARN-2566 to your notice - the JIRA proposes to pick
> directory with most available space instead of the first directory.
>
> While I believe it is definitely an improvement over picking the first
> directory always, I understand this can cause hot-spotting on nodes with
> widely varied availabilities.
>
> If you have opinions on picking a local directory, please comment on the
> JIRA.
>
> Thanks
> Karthik
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.