You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Rui Li (JIRA)" <ji...@apache.org> on 2016/04/21 05:27:25 UTC
[jira] [Updated] (HIVE-13572) Redundant setting full file status in
Hive::copyFiles
[ https://issues.apache.org/jira/browse/HIVE-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rui Li updated HIVE-13572:
--------------------------
Description:
We set full file status in each copy-file thread. I think it's redundant and hurts performance when we have multiple files to copy.
{code}
if (inheritPerms) {
ShimLoader.getHadoopShims().setFullFileStatus(conf, fullDestStatus, destFs, destf);
}
{code}
> Redundant setting full file status in Hive::copyFiles
> -----------------------------------------------------
>
> Key: HIVE-13572
> URL: https://issues.apache.org/jira/browse/HIVE-13572
> Project: Hive
> Issue Type: Bug
> Reporter: Rui Li
> Assignee: Rui Li
>
> We set full file status in each copy-file thread. I think it's redundant and hurts performance when we have multiple files to copy.
> {code}
> if (inheritPerms) {
> ShimLoader.getHadoopShims().setFullFileStatus(conf, fullDestStatus, destFs, destf);
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)