You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Gaurav Rawat (Jira)" <ji...@apache.org> on 2021/04/16 12:55:00 UTC
[jira] [Comment Edited] (KYLIN-4976) error
java.lang.NoSuchMethodError:
scala.Predef$.refArrayOps([Ljava/lang/Object;)[Ljava/lang/Object; while
building sample cube
[ https://issues.apache.org/jira/browse/KYLIN-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17323787#comment-17323787 ]
Gaurav Rawat edited comment on KYLIN-4976 at 4/16/21, 12:54 PM:
----------------------------------------------------------------
HI [~xxyu] yes did follow the instructions there is no error on the UI though but I see this error in the logs , The build job now has been running since 652 mins ..
As I am using emr **6.0** with **hadoop 3.2.1-amzn-0v I had used spark-**2.4.7-bin-without-hadoop-scala-2.12.tgz* *for kylin though I am not sure why cant we use the existing emr spark version **2.4.7**
was (Author: gauravbrills):
yes did follow the instructions there is no error on the UI though but I see this error in the logs , The build job now has been running since 652 mins ..
As I am using emr **6.0** with **hadoop 3.2.1-amzn-0v I had used spark-**2.4.7-bin-without-hadoop-scala-2.12.tgz** for kylin though I am not sure why cant we use the existing emr spark version **2.4.7**
> error java.lang.NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Object;)[Ljava/lang/Object; while building sample cube
> -------------------------------------------------------------------------------------------------------------------------------
>
> Key: KYLIN-4976
> URL: https://issues.apache.org/jira/browse/KYLIN-4976
> Project: Kylin
> Issue Type: Bug
> Affects Versions: v4.0.0-beta
> Reporter: Gaurav Rawat
> Priority: Blocker
>
> running kylin 4.0.0 and when building the sample cube get the below error on spark 2.4.6 EMR 6.0.0
>
> {code:java}
> 2021-04-16 02:03:59,074 INFO [Scheduler 866535267 Job 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : Exception in thread "main" java.lang.NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Object;)[Ljava/lang/Object;
> 2021-04-16 02:03:59,074 INFO [Scheduler 866535267 Job 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at org.apache.spark.deploy.SparkSubmitUtils$.parseSparkConfProperty(SparkSubmit.scala:1331)
> 2021-04-16 02:03:59,074 INFO [Scheduler 866535267 Job 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at org.apache.spark.deploy.SparkSubmitArguments.handle(SparkSubmitArguments.scala:448)
> 2021-04-16 02:03:59,074 INFO [Scheduler 866535267 Job 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at org.apache.spark.launcher.SparkSubmitOptionParser.parse(SparkSubmitOptionParser.java:163)
> 2021-04-16 02:03:59,074 INFO [Scheduler 866535267 Job 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at org.apache.spark.deploy.SparkSubmitArguments.<init>(SparkSubmitArguments.scala:109)
> 2021-04-16 02:03:59,075 INFO [Scheduler 866535267 Job 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at org.apache.spark.deploy.SparkSubmit$$anon$2$$anon$3.<init>(SparkSubmit.scala:907)
> 2021-04-16 02:03:59,075 INFO [Scheduler 866535267 Job 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at org.apache.spark.deploy.SparkSubmit$$anon$2.parseArguments(SparkSubmit.scala:907)
> 2021-04-16 02:03:59,075 INFO [Scheduler 866535267 Job 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:81)
> 2021-04-16 02:03:59,075 INFO [Scheduler 866535267 Job 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
> 2021-04-16 02:03:59,075 INFO [Scheduler 866535267 Job 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
> 2021-04-16 02:03:59,075 INFO [Scheduler 866535267 Job 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)