You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@kylin.apache.org by 梅振楠 <me...@zuoyebang.com> on 2018/12/22 02:51:59 UTC

Overwriting conflict error

hi,all
when i build the cube,the error is occasional.
but resume the cube,it’s right.
kylin version:2.5 
the engine is mr
the log:
org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.common.persistence.WriteConflictException: Overwriting conflict /execute_output/39902bf2-8c6c-5f84-8722-29ff78e3a8aa-08, expect old TS 1545431623779, but it is 1545431633802
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
	at org.apache.kylin.job.impl.threadpool.DefaultScheduler\$JobRunner.run(DefaultScheduler.java:113)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor\$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.kylin.common.persistence.WriteConflictException: Overwriting conflict /execute_output/39902bf2-8c6c-5f84-8722-29ff78e3a8aa-08, expect old TS 1545431623779, but it is 1545431633802
	at org.apache.kylin.storage.hbase.HBaseResourceStore.checkAndPutResourceImpl(HBaseResourceStore.java:325)
	at org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceCheckpoint(ResourceStore.java:323)
	at org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:308)
	at org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:287)
	at org.apache.kylin.job.dao.ExecutableDao.writeJobOutputResource(ExecutableDao.java:223)
	at org.apache.kylin.job.dao.ExecutableDao.updateJobOutput(ExecutableDao.java:374)
	at org.apache.kylin.job.execution.ExecutableManager.addJobInfo(ExecutableManager.java:503)
	at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:163)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
	... 6 more

thanks

Re:Overwriting conflict error

Posted by nichunen <ni...@apache.org>.

I guess this may due to your hbase cluster is not in good status, or there is more than one job kylin instance configured with the same metastore url.But I think ExecutableManager should be robust enough to deal with such situations...Would you  please open a jira issue?


Best regards,

 

Ni Chunen / George


At 2018-12-22 10:51:59, "梅振楠" <me...@zuoyebang.com> wrote:

hi,all
when i build the cube,the error is occasional.
but resume the cube,it’s right.
kylin version:2.5 
the engine is mr
the log:
org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.common.persistence.WriteConflictException: Overwriting conflict /execute_output/39902bf2-8c6c-5f84-8722-29ff78e3a8aa-08, expect old TS 1545431623779, but it is 1545431633802
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
	at org.apache.kylin.job.impl.threadpool.DefaultScheduler\$JobRunner.run(DefaultScheduler.java:113)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor\$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.kylin.common.persistence.WriteConflictException: Overwriting conflict /execute_output/39902bf2-8c6c-5f84-8722-29ff78e3a8aa-08, expect old TS 1545431623779, but it is 1545431633802
	at org.apache.kylin.storage.hbase.HBaseResourceStore.checkAndPutResourceImpl(HBaseResourceStore.java:325)
	at org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceCheckpoint(ResourceStore.java:323)
	at org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:308)
	at org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:287)
	at org.apache.kylin.job.dao.ExecutableDao.writeJobOutputResource(ExecutableDao.java:223)
	at org.apache.kylin.job.dao.ExecutableDao.updateJobOutput(ExecutableDao.java:374)
	at org.apache.kylin.job.execution.ExecutableManager.addJobInfo(ExecutableManager.java:503)
	at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:163)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
	... 6 more


thanks