You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "ZhouKang (Jira)" <ji...@apache.org> on 2019/09/02 12:27:00 UTC
[jira] [Updated] (KYLIN-4143) truncate spark executable job output
[ https://issues.apache.org/jira/browse/KYLIN-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ZhouKang updated KYLIN-4143:
----------------------------
Summary: truncate spark executable job output (was: Get job status fail when too much content in job output)
> truncate spark executable job output
> -------------------------------------
>
> Key: KYLIN-4143
> URL: https://issues.apache.org/jira/browse/KYLIN-4143
> Project: Kylin
> Issue Type: Bug
> Affects Versions: v2.5.2
> Reporter: ZhouKang
> Priority: Major
>
> Kylin: 2.5.2
> job engine: spark
>
> After long time running, job executor will record plenty of content in job output file, which make ExecutableManager get output fail. And the job will be marked as "error".
> {code:java}
> // code placeholder
> 2019-08-15 11:58:34,442 ERROR [Scheduler 1278051386 Job db9b01d0-fd8c-d168-8cfa-2e11d807972c-128] spark.SparkExecutable:359 : error run spark job:
> java.lang.RuntimeException: org.apache.kylin.job.exception.PersistentException: com.fasterxml.jackson.databind.JsonMappingException: Unexpected end-of-input in VALUE_STRING
> at [Source: (DataInputStream); line: 5, column: 10728969]
> at [Source: (DataInputStream); line: 5, column: 15] (through reference chain: org.apache.kylin.job.dao.ExecutableOutputPO["content"])
> at org.apache.kylin.job.execution.ExecutableManager.getOutput(ExecutableManager.java:164)
> at org.apache.kylin.job.execution.AbstractExecutable.getOutput(AbstractExecutable.java:414)
> at org.apache.kylin.job.execution.AbstractExecutable.isDiscarded(AbstractExecutable.java:525)
> at org.apache.kylin.engine.spark.SparkExecutable.doWork(SparkExecutable.java:304)
> at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
> at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
> at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
> at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.kylin.job.exception.PersistentException: com.fasterxml.jackson.databind.JsonMappingException: Unexpected end-of-input in VALUE_STRING
> at [Source: (DataInputStream); line: 5, column: 10728969]
> at [Source: (DataInputStream); line: 5, column: 15] (through reference chain: org.apache.kylin.job.dao.ExecutableOutputPO["content"])
> at org.apache.kylin.job.dao.ExecutableDao.getJobOutput(ExecutableDao.java:356)
> at org.apache.kylin.job.execution.ExecutableManager.getOutput(ExecutableManager.java:159)
>
> ... 10 more
> Caused by: com.fasterxml.jackson.databind.JsonMappingException: Unexpected end-of-input in VALUE_STRING
> at [Source: (DataInputStream); line: 5, column: 10728969]
> at [Source: (DataInputStream); line: 5, column: 15] (through reference chain: org.apache.kylin.job.dao.ExecutableOutputPO["content"])
> at com.fasterxml.jackson.databind.JsonMappingException.wrapWithPath(JsonMappingException.java:391)
> at com.fasterxml.jackson.databind.JsonMappingException.wrapWithPath(JsonMappingException.java:351)
> at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.wrapAndThrow(BeanDeserializerBase.java:1704)
> at com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:290)
> at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:151)
> at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4001)
> at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3058)
> at org.apache.kylin.common.util.JsonUtil.readValue(JsonUtil.java:69)
> at org.apache.kylin.common.persistence.JsonSerializer.deserialize(JsonSerializer.java:46)
> at org.apache.kylin.common.persistence.ResourceStore.getResource(ResourceStore.java:182)
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.2#803003)