You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hawq.apache.org by "hongwu (JIRA)" <ji...@apache.org> on 2016/10/25 13:54:58 UTC

[jira] [Updated] (HAWQ-1120) Optimize hawqregister performance

     [ https://issues.apache.org/jira/browse/HAWQ-1120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

hongwu updated HAWQ-1120:
-------------------------
    Description: 
move_files_in_hdfs, check_sizes_valid and check_file_not_folder take 30% execute time of hawqregister since invoking hadoop shell command has 1-2s lantency each time.

In check_sizes_valid, we could bind "du" operation together to optimize. For the other two functions, there is nothing to do.

  was:
move_files_in_hdfs, check_sizes_valid and check_file_not_folder take 30% execute time of hawqregister since invoking hadoop shell command has 1-2s lantency.

In check_sizes_valid, we could bind du operation together to optimize. For the other two functions, there is nothing to do with it.


> Optimize hawqregister performance
> ---------------------------------
>
>                 Key: HAWQ-1120
>                 URL: https://issues.apache.org/jira/browse/HAWQ-1120
>             Project: Apache HAWQ
>          Issue Type: Sub-task
>          Components: Command Line Tools
>            Reporter: hongwu
>            Assignee: hongwu
>             Fix For: 2.0.1.0-incubating
>
>
> move_files_in_hdfs, check_sizes_valid and check_file_not_folder take 30% execute time of hawqregister since invoking hadoop shell command has 1-2s lantency each time.
> In check_sizes_valid, we could bind "du" operation together to optimize. For the other two functions, there is nothing to do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)