You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "nichunen (JIRA)" <ji...@apache.org> on 2018/03/02 09:28:00 UTC

[jira] [Created] (KYLIN-3271) Optimize sub-path check of ResourceTool

nichunen created KYLIN-3271:
-------------------------------

             Summary: Optimize sub-path check of ResourceTool
                 Key: KYLIN-3271
                 URL: https://issues.apache.org/jira/browse/KYLIN-3271
             Project: Kylin
          Issue Type: Improvement
          Components: Metadata
    Affects Versions: v2.2.0
            Reporter: nichunen
            Assignee: nichunen
             Fix For: v2.4.0


kylin uses class org.apache.kylin.common.persistence.ResourceTool to do metadata download, upload, remove, etc. The algorithm for resource transversal is not very effective. For instance, for an "execute_output" with key "/execute_output/\{uuid}", the algorithm will try to check whether it's a folder with sub-resources, this makes un-necessary time cost, and in cases of metadata with lots of jobs, it may last for a long time before the finish.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)