You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/06/05 04:19:01 UTC
[jira] [Commented] (KYLIN-3271) Optimize sub-path check of
ResourceTool
[ https://issues.apache.org/jira/browse/KYLIN-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856324#comment-16856324 ]
ASF GitHub Bot commented on KYLIN-3271:
---------------------------------------
jiezouSH commented on pull request #674: KYLIN-3271 KYLIN-3454 minor refactor, accelerate ResourceTool
URL: https://github.com/apache/kylin/pull/674
KYLIN-3271 KYLIN-3454 minor refactor, accelerate ResourceTool
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
> Optimize sub-path check of ResourceTool
> ---------------------------------------
>
> Key: KYLIN-3271
> URL: https://issues.apache.org/jira/browse/KYLIN-3271
> Project: Kylin
> Issue Type: Improvement
> Components: Metadata
> Affects Versions: v2.2.0
> Reporter: nichunen
> Assignee: nichunen
> Priority: Minor
> Fix For: v2.4.0
>
>
> kylin uses class org.apache.kylin.common.persistence.ResourceTool to do metadata download, upload, remove, etc. The algorithm for resource transversal is not very effective. For instance, for an "execute_output" with key "/execute_output/\{uuid}", the algorithm will try to check whether it's a folder with sub-resources, this makes un-necessary time cost, and in cases of metadata with lots of jobs, it may last for a long time before the finish.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)