You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "pengfei.zhan (Jira)" <ji...@apache.org> on 2024/03/30 02:42:00 UTC

[jira] [Commented] (KYLIN-5768) Refine some code for localcache

    [ https://issues.apache.org/jira/browse/KYLIN-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17832358#comment-17832358 ] 

pengfei.zhan commented on KYLIN-5768:
-------------------------------------

KylinCacheFileSystem is the key class for enabling localcache, and is internally a proxy for DistributedFileSystem in HDFS scenarios.

However, at runtime, due to the FileSystem CACHE, the initialized class is not KylinCacheFileSystem, so localcache does not take effect as expected.

Configuring KylinCacheFileSystem only in kylin.properties.override does not take effect, as followsKylinCacheFileSystem is the key class for enabling localcache, and is internally a proxy for DistributedFileSystem in HDFS scenarios.
However, at runtime, due to the FileSystem CACHE, the initialized class is not KylinCacheFileSystem, so localcache does not take effect as expected.
Configuring KylinCacheFileSystem only in kylin.properties.override does not take effect, as follows
{code:java}
kylin.storage.columnar.spark-conf.spark.hadoop.fs.hdfs.impl=io.kyligence.kap.cache.kylin.KylinCacheFileSystem {code}

> Refine some code for localcache
> -------------------------------
>
>                 Key: KYLIN-5768
>                 URL: https://issues.apache.org/jira/browse/KYLIN-5768
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Query Engine
>    Affects Versions: 5.0-beta
>            Reporter: pengfei.zhan
>            Assignee: pengfei.zhan
>            Priority: Major
>             Fix For: 5.0.0
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)