[jira] [Updated] (HIVE-28523) 删表或删分区时可能存在的性能问题

["liux (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-28523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

liux updated HIVE-28523:
------------------------
    Attachment: ME1726238367718.jpg

> 删表或删分区时可能存在的性能问题
> ----------------
>
>                 Key: HIVE-28523
>                 URL: https://issues.apache.org/jira/browse/HIVE-28523
>             Project: Hive
>          Issue Type: Improvement
>      Security Level: Public(Viewable by anyone) 
>          Components: Standalone Metastore
>            Reporter: liux
>            Assignee: liux
>            Priority: Major
>         Attachments: ME1726238367718.jpg
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> 1. 删除表或者分区对象时的遍历可能存在性能问题
> 具体位置在：standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/HMSHandler.java 中的
> for{color:#1f2328} ({color}{color:#1f2328}String{color}{color:#1f2328} {color}{color:#1f2328}partName{color}{color:#1f2328} : {color}{color:#1f2328}partNames{color}{color:#1f2328}) {{color}
> {color:#1f2328}Path{color}{color:#1f2328} {color}{color:#1f2328}partPath{color}{color:#1f2328} = {color}{color:#1f2328}wh{color}{color:#1f2328}.{color}getDnsPath{color:#1f2328}({color}new{color:#1f2328} {color}{color:#1f2328}Path{color}{color:#1f2328}({color}{color:#1f2328}pathString{color}{color:#1f2328}));{color}
> }
> 假定wh.getDnsPath一次耗时在10毫秒左右，那么对于20w分区对象的遍历，耗时为33分钟，这可能导致删大表或分区超时；
> 2.没有必要在遍历所有分区名时都执行wh.getDnsPath(new Path(pathString))语句，只需要在分区非表下子目录的情况执行就够了



--
This message was sent by Atlassian Jira
(v8.20.10#820010)