You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "wangrupeng (Jira)" <ji...@apache.org> on 2020/07/10 06:10:00 UTC

[jira] [Created] (KYLIN-4632) No such element exception:spark.driver.cores

wangrupeng created KYLIN-4632:
---------------------------------

             Summary: No such element exception:spark.driver.cores
                 Key: KYLIN-4632
                 URL: https://issues.apache.org/jira/browse/KYLIN-4632
             Project: Kylin
          Issue Type: Bug
          Components: Spark Engine
    Affects Versions: v4.0.0-beta
            Reporter: wangrupeng
            Assignee: wangrupeng
             Fix For: v4.0.0-beta


When submit a build job, it throws an exception. But the build job still can run successfully.
20/07/10 14:06:29 WARN SparkApplication: Error occurred when check resource. Ignore it and try to submit this job.
java.util.NoSuchElementException: spark.driver.cores
at org.apache.spark.SparkConf$$anonfun$get$1.apply(SparkConf.scala:245)
at org.apache.spark.SparkConf$$anonfun$get$1.apply(SparkConf.scala:245)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.SparkConf.get(SparkConf.scala:245)
at org.apache.spark.utils.ResourceUtils$.checkResource(ResourceUtils.scala:71)
at org.apache.spark.utils.ResourceUtils.checkResource(ResourceUtils.scala)
at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:156)
at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:76)
at org.apache.spark.application.JobWorker$$anon$2.run(JobWorker.scala:55)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)