You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "gene (Jira)" <ji...@apache.org> on 2022/06/22 04:33:00 UTC
[jira] [Updated] (KYLIN-5198) kylin无法build，org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:file:/kylin/kylin_metadata/kylin-xxxxxx/kylin_intermediate_empcubexxxxis not a directory or unable to create one
[ https://issues.apache.org/jira/browse/KYLIN-5198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
gene updated KYLIN-5198:
------------------------
Attachment: core-site.xml
kylin.properties
> kylin无法build，org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:file:/kylin/kylin_metadata/kylin-xxxxxx/kylin_intermediate_empcubexxxxis not a directory or unable to create one
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: KYLIN-5198
> URL: https://issues.apache.org/jira/browse/KYLIN-5198
> Project: Kylin
> Issue Type: Bug
> Affects Versions: v3.0.2
> Reporter: gene
> Priority: Major
> Attachments: core-site.xml, kylin.properties
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> *你好，问下 我kylin启动和构建cube是正常的，下面包括了我个人的分析，但是问题仍然无法解决，这个问题困扰了我几天了，希望能获得帮助*
> *前置条件：hbase用集群启动，但是只配置了一个节点， 写hivesql 时 感觉用的本地方式而不是 dfs方式，但是hbase配置的是hdfs方式的， kylin启动为啥用file:///方式呢*
> *1 但是 在build的时候出错了：*
> 2022-06-22 10:34:51,476 INFO [04b2d097-0a4f-4dd0-bf14-a0bc69435398 main] metastore.HiveMetaStoreClient: Connected to metastore.
> 2022-06-22 10:34:51,476 INFO [04b2d097-0a4f-4dd0-bf14-a0bc69435398 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
> 2022-06-22 10:34:51,512 ERROR [04b2d097-0a4f-4dd0-bf14-a0bc69435398 main] exec.DDLTask: Failed
> org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:file:/kylin/kylin_metadata/kylin-3204c1d5-c244-7873-07b5-d9fb8ae38996/kylin_intermediate_empcube3_8285e2f7_4de0_827f_2644_7c391ccf661b is not a directory or unable to create one)
> at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:939)
> at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:944)
> at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:4957)
> at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:428)
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:205)
> at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97)
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2664)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2335)
> at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2011)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1709)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1703)
> at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:157)
> at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:218)
> at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239)
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188)
> at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402)
> at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:335)
> at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:787)
> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
> Caused by: MetaException(message:file:/kylin/kylin_metadata/kylin-3204c1d5-c244-7873-07b5-d9fb8ae38996/kylin_intermediate_empcube3_8285e2f7_4de0_827f_2644_7c391ccf661b is not a directory or unable to create one)
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result$create_table_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:54908)
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result$create_table_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:54876)
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result.read(ThriftHiveMetastore.java:54802)
> at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:86)
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_create_table_with_environment_context(ThriftHiveMetastore.java:1556)
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.create_table_with_environment_context(ThriftHiveMetastore.java:1542)
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.create_table_with_environment_context(HiveMetaStoreClient.java:2867)
> at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.create_table_with_environment_context(SessionHiveMetaStoreClient.java:121)
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:837)
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:822)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:212)
> at com.sun.proxy.$Proxy34.createTable(Unknown Source)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient$SynchronizedHandler.invoke(HiveMetaStoreClient.java:2773)
> at com.sun.proxy.$Proxy34.createTable(Unknown Source)
> at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:928)
> ... 25 more
> 2022-06-22 10:34:51,516 INFO [04b2d097-0a4f-4dd0-bf14-a0bc69435398 main] reexec.ReOptimizePlugin: ReOptimization: retryPossible: false
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:file:/kylin/kylin_metadata/kylin-3204c1d5
> *2 我个人分析是在建hive表的时候出错的，建表语句比较奇怪*
> CREATE EXTERNAL TABLE IF NOT EXISTS kylin_intermediate_empcube3_8285e2f7_4de0_827f_2644_7c391ccf661b
> (
> `EMP_EMPNO` int
> ,`EMP_ENAME` string
> ,`EMP_JOB` string
> ,`EMP_DEPTNO` int
> ,`DEPT_DEPTNO` int
> ,`EMP_SAL` double
> )
> STORED AS SEQUENCEFILE
> {color:#de350b}*_LOCATION 'file:///_*{color}kylin/kylin_metadata/kylin-3204c1d5-c244-7873-07b5-d9fb8ae38996/kylin_intermediate_empcube3_8285e2f7_4de0_827f_2644_7c391ccf661b'
> *正常情况下应该不是 fill:///kylin,应该是 /kylin吧，项目启动时有这样一句话：*
> *2022-06-22 10:32:15,958 DEBUG [main] hbase.HBaseConnection:317 : HTable 'kylin_metadata' already exists*
> *2022-06-22 10:32:16,249 DEBUG [main] hbase.HBaseConnection:182 : Using the working dir FS for HBase: _{color:#de350b}file:///{color}_*
> *2022-06-22 10:32:16,249 INFO [main] hbase.HBaseConnection:268 : connection is null or closed, creating a new one*
>
> *但是我看网上的视频教程 用的 working dir fs 是 hdfs:/xxxx:9000/hbase xxxx，个人感觉hbase是没有配置错误的，为啥会这样呢*
--
This message was sent by Atlassian Jira
(v8.20.7#820007)