Re: [jira] [Created] (KYLIN-2648) Encounter cube merge error when deploy kylin on stand alone hbase cluster

[Li Yang <li...@apache.org>]

Let's avoid due post and keep discussion in JIRA. Thanks.


Yang

On Mon, May 29, 2017 at 2:52 PM, suheng.cloud <pe...@hotmail.com>
wrote:

> Hi, shaofeng & yang
> I try to modiry property "kylin.env.hdfs-working-dir" to full qualified
> path
> " hdfs://cdh5/kylin-83-hadoop",
> and found it can't work around.
> The error stacktrace is similar as before:
>  "Wrong FS:
> hdfs://cdh5/kylin-83-hadoop/kylin_metadata/kylin-9e6272e3-
> d813-481d-82c0-182b85a0ad8f,
> expected: hdfs://cdh5-mini"
>
> I checked kylin source, in HDFSPathGarbageCollectionStep.java func doWork:
>
> *dropHdfsPathOnCluster(toDeletePaths, HadoopUtil.getWorkingFileSystem());
>             if
> (StringUtils.isNotEmpty(context.getConfig().getHBaseClusterFs())) {
>                 dropHdfsPathOnCluster(toDeletePaths,
> FileSystem.get(HBaseConnection.getCurrentHBaseConfiguration()));
>             }*
> As long as the property kylin.storage.hbase.cluster-fs(which I set to
> hdfs://cdh5-mini) has been set,
> Kylin will always try to find and delete the "toDeletePaths" on hbase
> cluster,and if we use full qualified path like
> "hdfs://cdh5/kylin-83-hadoop",in function dropHdfsPathOnCluster, exception
> will be thrown out by the checkpath function since the authority of
> hdfs://cdh5/kylin-83-hadoop/xxx was not equal to the authority of
> hdfs://cdh5-mini".So I think it should be a relative path,so kylin check on
> both hadoop cluster?
>
> Do we have some other work around way? Or what your standard deploy method
> when hbase cluster seperate from main cluster?
>
> I was trying to check if kylin can meet our olap demand,and stuck on this
> for a long time, really need your help, thank you!
>
> full log as follows:
> err_stacktrace.txt
> <http://apache-kylin.74782.x6.nabble.com/file/n8121/err_stacktrace.txt>
>
> Best wishes!
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/jira-Created-KYLIN-2648-Encounter-cube-merge-
> error-when-deploy-kylin-on-stand-alone-hbase-cluster-tp8096p8121.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>