Kylin WriteConflictException

[lk_hadoop <lk...@163.com>]

I'm now using apache-kylin-2.6.3-bin-cdh57  ，sometime job will stop with WriteConflictException , after I resume the job ,all work well. what this Exception mean ? I have checked the time use timedatectl , the kylin job server and hbase server , the different between them is not over 1 second.

2019-10-29 10:31:18,802 ERROR [pool-10-thread-9] threadpool.DefaultScheduler:116 : ExecuteException job:2515066e-bcf3-fb84-f2af-fb1ab1696c05
org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.common.persistence.WriteConflictException: Overwriting conflict /execute_output/2515066e-bcf3-fb84-f2af-fb1ab1696c05-07, expect old TS 1572316263308, but it is 1572316273315
 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:182)
 at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
 at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.common.persistence.WriteConflictException: Overwriting conflict /execute_output/2515066e-bcf3-fb84-f2af-fb1ab1696c05-07, expect old TS 1572316263308, but it is 1572316273315
 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:189)
 at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
 ... 4 more
Caused by: org.apache.kylin.common.persistence.WriteConflictException: Overwriting conflict /execute_output/2515066e-bcf3-fb84-f2af-fb1ab1696c05-07, expect old TS 1572316263308, but it is 1572316273315
 at org.apache.kylin.storage.hbase.HBaseResourceStore.checkAndPutResourceImpl(HBaseResourceStore.java:338)
 at org.apache.kylin.common.persistence.ResourceStore$6.call(ResourceStore.java:439)
 at org.apache.kylin.common.persistence.ResourceStore$6.call(ResourceStore.java:436)
 at org.apache.kylin.common.persistence.ExponentialBackoffRetry.doWithRetry(ExponentialBackoffRetry.java:52)
 at org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceWithRetry(ResourceStore.java:436)
 at org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceCheckpoint(ResourceStore.java:424)
 at org.apache.kylin.common.persistence.ResourceStore.checkAndPutResource(ResourceStore.java:418)
 at org.apache.kylin.common.persistence.ResourceStore.checkAndPutResource(ResourceStore.java:401)
 at org.apache.kylin.common.persistence.ResourceStore.checkAndPutResource(ResourceStore.java:381)
 at org.apache.kylin.job.dao.ExecutableDao.writeJobOutputResource(ExecutableDao.java:252)
 at org.apache.kylin.job.dao.ExecutableDao.updateJobOutput(ExecutableDao.java:426)
 at org.apache.kylin.job.execution.ExecutableManager.addJobInfo(ExecutableManager.java:566)
 at org.apache.kylin.job.execution.ExecutableManager.addJobInfo(ExecutableManager.java:576)
 at org.apache.kylin.job.execution.AbstractExecutable.onExecuteError(AbstractExecutable.java:137)
 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:181)
 ... 6 more

2019-10-29


lk_hadoop