You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Lei (Eddy) Xu (JIRA)" <ji...@apache.org> on 2015/01/30 02:30:37 UTC
[jira] [Assigned] (HADOOP-11525) FileSystem should expose some
performance characteristics for caller (e.g., FsShell) to choose the right
algorithm.
[ https://issues.apache.org/jira/browse/HADOOP-11525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lei (Eddy) Xu reassigned HADOOP-11525:
--------------------------------------
Assignee: Lei (Eddy) Xu
> FileSystem should expose some performance characteristics for caller (e.g., FsShell) to choose the right algorithm.
> -------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-11525
> URL: https://issues.apache.org/jira/browse/HADOOP-11525
> Project: Hadoop Common
> Issue Type: Improvement
> Components: tools
> Affects Versions: 2.6.0
> Reporter: Lei (Eddy) Xu
> Assignee: Lei (Eddy) Xu
>
> When running {{hadoop fs -put}}, {{FsShell}} creates a {{._COPYING_.}} file on the target directory, and then renames it to target file when the write is done. However, for some targeted systems, such as S3, Azure and Swift, a partial failure write request (i.e., {{PUT}}) has not side effect, while the {{rename}} operation is expensive.
> {{FileSystem}} should expose some characteristics so that the operation such as {{CommandWithDestination#copyStreamToTarget()}} can detect and choose the right way to do.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)