You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "wangrupeng (Jira)" <ji...@apache.org> on 2020/07/10 10:25:00 UTC
[jira] [Issue Comment Deleted] (KYLIN-4632) No such element
exception:spark.driver.cores
[ https://issues.apache.org/jira/browse/KYLIN-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
wangrupeng updated KYLIN-4632:
------------------------------
Comment: was deleted
(was: [https://github.com/apache/kylin/pull/1310/])
> No such element exception:spark.driver.cores
> --------------------------------------------
>
> Key: KYLIN-4632
> URL: https://issues.apache.org/jira/browse/KYLIN-4632
> Project: Kylin
> Issue Type: Bug
> Components: Spark Engine
> Affects Versions: v4.0.0-beta
> Reporter: wangrupeng
> Assignee: wangrupeng
> Priority: Major
> Fix For: v4.0.0-beta
>
>
> When submit a build job, it throws an exception. But the build job still can run successfully.
> 20/07/10 14:06:29 WARN SparkApplication: Error occurred when check resource. Ignore it and try to submit this job.
> java.util.NoSuchElementException: spark.driver.cores
> at org.apache.spark.SparkConf$$anonfun$get$1.apply(SparkConf.scala:245)
> at org.apache.spark.SparkConf$$anonfun$get$1.apply(SparkConf.scala:245)
> at scala.Option.getOrElse(Option.scala:121)
> at org.apache.spark.SparkConf.get(SparkConf.scala:245)
> at org.apache.spark.utils.ResourceUtils$.checkResource(ResourceUtils.scala:71)
> at org.apache.spark.utils.ResourceUtils.checkResource(ResourceUtils.scala)
> at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:156)
> at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:76)
> at org.apache.spark.application.JobWorker$$anon$2.run(JobWorker.scala:55)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)