You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Qi Zhu (Jira)" <ji...@apache.org> on 2021/04/25 08:54:00 UTC
[jira] [Commented] (YARN-7713) Add parallel copying of directories
into FSDownload
[ https://issues.apache.org/jira/browse/YARN-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331460#comment-17331460 ]
Qi Zhu commented on YARN-7713:
------------------------------
[~ChrisKarampeazis]
Thanks for your work here.
cc [~ebadger] [~epayne] [~Jim_Brennan] [~pbacsko] [~gandras]
I think it's a very good improvement.
If you can take a look this when you are free?
Thanks.
> Add parallel copying of directories into FSDownload
> ---------------------------------------------------
>
> Key: YARN-7713
> URL: https://issues.apache.org/jira/browse/YARN-7713
> Project: Hadoop YARN
> Issue Type: Improvement
> Reporter: Miklos Szegedi
> Priority: Major
> Labels: newbie, pull-request-available
> Time Spent: 50m
> Remaining Estimate: 0h
>
> YARN currently copies directories sequentially when localizing. This could be improved to do in parallel, since the source blocks are normally on different nodes.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org