You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by 梅振楠 <me...@zuoyebang.com> on 2018/12/13 13:21:17 UTC
回复:Re: when create htable ,occur error
kylin 2.5.1
the engin is mapreduce
--------------原始邮件--------------
发件人："Chao Long "<wa...@qq.com>;
发送时间：2018年12月13日(星期四) 晚上9:18
收件人："user" <us...@kylin.apache.org>;
主题：Re: when create htable ,occur error
-----------------------------------
Hi,
What's your Kylin version and which build engine you use?
------------------
Best Regards,
Chao Long
------------------ Original ------------------
From: "梅振楠"<me...@zuoyebang.com>;
Date: Thu, Dec 13, 2018 09:10 PM
To: "user"<us...@kylin.apache.org>;
Subject: when create htable ,occur error
hi,all
when Create HTable ,i get this errors.
resume this cube, do not work.
how can i resolve the problem .
----------------------------------------------------
2018-12-13 20:49:50,439 INFO [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] common.HadoopShellExecutable:59 : parameters of the HadoopShellExecutable: -cubename kuaidui_offline_action_crm_cube -segmentid e26a43d4-879a-6219-7edf-8b2528851207 -partitions hdfs://ns1/kylin/kylin_metadata/kylin-feed250d-4bbc-242f-ab6f-aa8317aacd87/kuaidui_offline_action_crm_cube/rowkey_stats/part-r-00000 -cuboidMode CURRENT -hbaseConfPath hdfs://ns1/kylin/kylin_metadata/kylin-feed250d-4bbc-242f-ab6f-aa8317aacd87/hbase-conf.xml
2018-12-13 20:49:50,533 ERROR [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] common.HadoopShellExecutable:65 : error execute HadoopShellExecutable{id=feed250d-4bbc-242f-ab6f-aa8317aacd87-05, name=Create HTable, state=RUNNING}
java.lang.NullPointerException
at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:207)
at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:165)
at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:100)
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92)
at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-12-13 20:49:50,550 INFO [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] execution.ExecutableManager:434 : job id:feed250d-4bbc-242f-ab6f-aa8317aacd87-05 from RUNNING to ERROR
2018-12-13 20:49:50,552 ERROR [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] execution.AbstractExecutable:165 : error running Executable: CubingJob{id=feed250d-4bbc-242f-ab6f-aa8317aacd87, name=BUILD CUBE - kuaidui_offline_action_crm_cube - 20181201000000_20181202000000 - GMT+08:00 2018-12-13 20:25:57, state=RUNNING}
2018-12-13 20:49:50,561 DEBUG [pool-12-thread-1] cachesync.Broadcaster:113 : Servers in the cluster: [localhost:7070]
2018-12-13 20:49:50,562 DEBUG [pool-12-thread-1] cachesync.Broadcaster:123 : Announcing new broadcast to all: BroadcastEvent{entity=execute_output, event=update, cacheKey=feed250d-4bbc-242f-ab6f-aa8317aacd87}
2018-12-13 20:49:50,566 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:247 : Broadcasting UPDATE, execute_output, feed250d-4bbc-242f-ab6f-aa8317aacd87
2018-12-13 20:49:50,569 INFO [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] execution.ExecutableManager:434 : job id:feed250d-4bbc-242f-ab6f-aa8317aacd87 from RUNNING to ERROR
2018-12-13 20:49:50,569 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:281 : Done broadcasting UPDATE, execute_output, feed250d-4bbc-242f-ab6f-aa8317aacd87
2018-12-13 20:49:50,569 DEBUG [pool-12-thread-1] cachesync.Broadcaster:113 : Servers in the cluster: [localhost:7070]
2018-12-13 20:49:50,569 DEBUG [pool-12-thread-1] cachesync.Broadcaster:123 : Announcing new broadcast to all: BroadcastEvent{entity=execute_output, event=update, cacheKey=feed250d-4bbc-242f-ab6f-aa8317aacd87}
2018-12-13 20:49:50,575 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:247 : Broadcasting UPDATE, execute_output, feed250d-4bbc-242f-ab6f-aa8317aacd87
2018-12-13 20:49:50,578 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:281 : Done broadcasting UPDATE, execute_output, feed250d-4bbc-242f-ab6f-aa8317aacd87
2018-12-13 20:49:50,613 INFO [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] execution.AbstractExecutable:343 : prepare to send email to:[meizhennan@zuoyebang.com, liwenjie01@zuoyebang.com]
2018-12-13 20:49:50,614 INFO [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] execution.AbstractExecutable:344 : job name:BUILD CUBE - kuaidui_offline_action_crm_cube - 20181201000000_20181202000000 - GMT+08:00 2018-12-13 20:25:57
2018-12-13 20:49:50,614 INFO [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] execution.AbstractExecutable:345 : submitter:ADMIN
2018-12-13 20:49:50,614 INFO [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871] execution.AbstractExecutable:346 : notify list:[meizhennan@zuoyebang.com, liwenjie01@zuoyebang.com]
2018-12-13 20:49:52,898 ERROR [pool-10-thread-8] threadpool.DefaultScheduler:115 : ExecuteException job:feed250d-4bbc-242f-ab6f-aa8317aacd87
org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.engine.mr.exception.HadoopShellException: java.lang.NullPointerException
at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:207)
at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:165)
at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:100)
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92)
at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
result code:2
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.engine.mr.exception.HadoopShellException: java.lang.NullPointerException
at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:207)
at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:165)
at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:100)
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92)
at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
result code:2
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
... 4 more
Caused by: org.apache.kylin.engine.mr.exception.HadoopShellException: java.lang.NullPointerException
at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:207)
at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:165)
at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:100)
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92)
at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
result code:2
at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:73)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
... 6 more