You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Duma (Jira)" <ji...@apache.org> on 2024/07/04 13:47:00 UTC

[jira] [Updated] (KYLIN-5849) File does not exist: /apache-kylin-4.0.4-bin-spark3/conf/fairscheduler.xml

     [ https://issues.apache.org/jira/browse/KYLIN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Duma updated KYLIN-5849:
------------------------
    Attachment: kylin.out

>  File does not exist: /apache-kylin-4.0.4-bin-spark3/conf/fairscheduler.xml
> ---------------------------------------------------------------------------
>
>                 Key: KYLIN-5849
>                 URL: https://issues.apache.org/jira/browse/KYLIN-5849
>             Project: Kylin
>          Issue Type: Bug
>            Reporter: Duma
>            Priority: Critical
>         Attachments: kylin.out
>
>
> When I attempt to start kylin is failing to start due to this error below. I am using Spark 3.2.4 that was already installed. I am not using spark within the kylin installation directory. Please help 
> [Thread-24661] INFO org.sparkproject.jetty.server.AbstractConnector - Stopped Spark@3edb1cb3\{HTTP/1.1, (http/1.1)}{0.0.0.0:4041}
> [Thread-24661] INFO org.apache.spark.ui.SparkUI - Stopped Spark web UI at http://bg-data-master:4041
> [dispatcher-event-loop-7] INFO org.apache.spark.MapOutputTrackerMasterEndpoint - MapOutputTrackerMasterEndpoint stopped!
> [Thread-24661] INFO org.apache.spark.storage.memory.MemoryStore - MemoryStore cleared
> [Thread-24661] INFO org.apache.spark.storage.BlockManager - BlockManager stopped
> [Thread-24661] INFO org.apache.spark.storage.BlockManagerMaster - BlockManagerMaster stopped
> [Thread-24661] WARN org.apache.spark.metrics.MetricsSystem - Stopping a MetricsSystem that is not running
> [dispatcher-event-loop-12] INFO org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint - OutputCommitCoordinator stopped!
> [Thread-24661] INFO org.apache.spark.SparkContext - Successfully stopped SparkContext
> {color:#FF0000}*[Thread-24661] ERROR org.apache.spark.sql.SparderContext - Error for initializing spark*{color}
> {color:#FF0000}*org.apache.spark.SparkException: External scheduler cannot be instantiated*{color}
> {color:#FF0000}        *at*{color} org.apache.spark.SparkContext$.org$apache$spark$SparkContext$$createTaskScheduler(SparkContext.scala:2989)
>         at org.apache.spark.SparkContext.<init>(SparkContext.scala:569)
>         at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2700)
>         at org.apache.spark.sql.KylinSession$KylinBuilder.$anonfun$getOrCreateKylinSession$2(KylinSession.scala:102)
>         at scala.Option.getOrElse(Option.scala:189)
>         at org.apache.spark.sql.KylinSession$KylinBuilder.getOrCreateKylinSession(KylinSession.scala:96)
>         at org.apache.spark.sql.SparderContext$$anon$1.run(SparderContext.scala:145)
>         at java.lang.Thread.run(Thread.java:750)
> {color:#FF0000}*Caused by: java.io.FileNotFoundException: File does not exist: /data1/kylin/apache-kylin-4.0.4-bin-spark3/conf/fairscheduler.xml*{color}
>         at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:86)
>         at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:76)
> Caused by: org.apache.hadoop.ipc.RemoteException(java.io.FileNotFoundException): File does not exist: /data1/kylin/apache-kylin-4.0.4-bin-spark3/conf/fairscheduler.xml
>         at org.ap        at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:86)
>         at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:76)
>         at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getBlockLocations(FSDirStatAndListingOp.java:156)
>         at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:2002)
>         at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:773)
>         at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:442)
>         at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)