You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by Yiming Liu <li...@gmail.com> on 2016/07/21 01:55:35 UTC
NPE when metastore cleanup
It seems need NULL check when doing cleanup dictionary tables.
2016-07-21 01:51:51,893 INFO [main CubeDescManager:197]: Reloading Cube
Metadata from folder kylin_metadata(key='/cube_desc')@kylin_metadata@hbase
2016-07-21 01:51:51,984 DEBUG [main MetadataManager:311]: Reloading
SourceTable from folder kylin_metadata(key='/table')@kylin_metadata@hbase
2016-07-21 01:51:52,098 DEBUG [main MetadataManager:320]: Loaded 5
SourceTable(s)
2016-07-21 01:51:52,098 DEBUG [main MetadataManager:252]: Reloading
SourceTable exd info from folder
kylin_metadata(key='/table_exd')@kylin_metadata@hbase
2016-07-21 01:51:52,148 DEBUG [main MetadataManager:261]: Loaded 5
SourceTable EXD(s)
2016-07-21 01:51:52,149 DEBUG [main MetadataManager:412]: Reloading
DataModel from folder kylin_metadata(key='/model_desc')@kylin_metadata@hbase
2016-07-21 01:51:52,183 DEBUG [main MetadataManager:426]: Loaded 1
DataModel(s)
2016-07-21 01:51:52,183 DEBUG [main MetadataManager:297]: Reloading
ExternalFilter from folder
kylin_metadata(key='/ext_filter')@kylin_metadata@hbase
2016-07-21 01:51:52,192 DEBUG [main MetadataManager:306]: Loaded 0
ExternalFilter(s)
2016-07-21 01:51:52,211 DEBUG [main CubeDescManager:222]: Loaded 1 Cube(s)
2016-07-21 01:51:52,216 DEBUG [main CubeManager:855]: Reloaded new cube:
ssb with reference beingCUBE[name=ssb] having 1 segments:KYLIN_KGEI5B28X9
2016-07-21 01:51:52,216 INFO [main CubeManager:826]: Loaded 1 cubes, fail
on 0 cubes
usage: MetadataCleanupJob
-delete <delete> Delete the unused metadata
Exception in thread "main" java.lang.NullPointerException
at
org.apache.kylin.engine.mr.steps.MetadataCleanupJob.cleanup(MetadataCleanupJob.java:136)
at
org.apache.kylin.engine.mr.steps.MetadataCleanupJob.run(MetadataCleanupJob.java:80)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at
org.apache.kylin.engine.mr.steps.MetadataCleanupJob.main(MetadataCleanupJob.java:183)
2016-07-21 01:51:52,249 INFO [Thread-2
ConnectionManager$HConnectionImplementation:2220]: Closing master protocol:
MasterService
2016-07-21 01:51:52,254 INFO [Thread-2
ConnectionManager$HConnectionImplementation:1876]: Closing zookeeper
sessionid=0x1560af24691000a
2016-07-21 01:51:52,260 INFO [main-EventThread ClientCnxn:512]:
EventThread shut down
2016-07-21 01:51:52,260 INFO [Thread-2 ZooKeeper:684]: Session:
0x1560af24691000a closed
Re: NPE when metastore cleanup
Posted by hongbin ma <ma...@apache.org>.
is there a way to reproduce the issue?
On Thu, Jul 21, 2016 at 9:55 AM, Yiming Liu <li...@gmail.com> wrote:
> It seems need NULL check when doing cleanup dictionary tables.
>
>
> 2016-07-21 01:51:51,893 INFO [main CubeDescManager:197]: Reloading Cube
> Metadata from folder kylin_metadata(key='/cube_desc')@kylin_metadata@hbase
>
> 2016-07-21 01:51:51,984 DEBUG [main MetadataManager:311]: Reloading
> SourceTable from folder kylin_metadata(key='/table')@kylin_metadata@hbase
>
> 2016-07-21 01:51:52,098 DEBUG [main MetadataManager:320]: Loaded 5
> SourceTable(s)
>
> 2016-07-21 01:51:52,098 DEBUG [main MetadataManager:252]: Reloading
> SourceTable exd info from folder
> kylin_metadata(key='/table_exd')@kylin_metadata@hbase
>
> 2016-07-21 01:51:52,148 DEBUG [main MetadataManager:261]: Loaded 5
> SourceTable EXD(s)
>
> 2016-07-21 01:51:52,149 DEBUG [main MetadataManager:412]: Reloading
> DataModel from folder
> kylin_metadata(key='/model_desc')@kylin_metadata@hbase
>
> 2016-07-21 01:51:52,183 DEBUG [main MetadataManager:426]: Loaded 1
> DataModel(s)
>
> 2016-07-21 01:51:52,183 DEBUG [main MetadataManager:297]: Reloading
> ExternalFilter from folder
> kylin_metadata(key='/ext_filter')@kylin_metadata@hbase
>
> 2016-07-21 01:51:52,192 DEBUG [main MetadataManager:306]: Loaded 0
> ExternalFilter(s)
>
> 2016-07-21 01:51:52,211 DEBUG [main CubeDescManager:222]: Loaded 1 Cube(s)
>
> 2016-07-21 01:51:52,216 DEBUG [main CubeManager:855]: Reloaded new cube:
> ssb with reference beingCUBE[name=ssb] having 1 segments:KYLIN_KGEI5B28X9
>
> 2016-07-21 01:51:52,216 INFO [main CubeManager:826]: Loaded 1 cubes, fail
> on 0 cubes
>
> usage: MetadataCleanupJob
>
> -delete <delete> Delete the unused metadata
>
> Exception in thread "main" java.lang.NullPointerException
>
> at
>
> org.apache.kylin.engine.mr.steps.MetadataCleanupJob.cleanup(MetadataCleanupJob.java:136)
>
> at
>
> org.apache.kylin.engine.mr.steps.MetadataCleanupJob.run(MetadataCleanupJob.java:80)
>
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>
> at
>
> org.apache.kylin.engine.mr.steps.MetadataCleanupJob.main(MetadataCleanupJob.java:183)
>
> 2016-07-21 01:51:52,249 INFO [Thread-2
> ConnectionManager$HConnectionImplementation:2220]: Closing master protocol:
> MasterService
>
> 2016-07-21 01:51:52,254 INFO [Thread-2
> ConnectionManager$HConnectionImplementation:1876]: Closing zookeeper
> sessionid=0x1560af24691000a
>
> 2016-07-21 01:51:52,260 INFO [main-EventThread ClientCnxn:512]:
> EventThread shut down
>
> 2016-07-21 01:51:52,260 INFO [Thread-2 ZooKeeper:684]: Session:
> 0x1560af24691000a closed
>
--
Regards,
*Bin Mahone | 马洪宾*