You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2016/08/17 20:50:20 UTC
[jira] [Resolved] (SPARK-17111) Spark2 History server got "Failed
to load application attempt"
[ https://issues.apache.org/jira/browse/SPARK-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved SPARK-17111.
-------------------------------
Resolution: Duplicate
> Spark2 History server got "Failed to load application attempt"
> --------------------------------------------------------------
>
> Key: SPARK-17111
> URL: https://issues.apache.org/jira/browse/SPARK-17111
> Project: Spark
> Issue Type: Bug
> Affects Versions: 2.0.0
> Reporter: Yesha Vora
>
> Steps followed:
> * Run sparkPi application in yarn-client mode
> * SparkPi app (application_1471416622386_0083) finished at 09:03:37. At 09:03:49, Spark2 history server rest api was used to get app data. But it failed with "no such app: application_1471416622386_0083".
> {code}
> http://xxx:18081/api/v1/applications/application_1471416622386_0083/executors
> HTTP Code: 404
> HTTP Data: no such app: application_1471416622386_0083{code}
> {code:title=spark history server log}
> 16/08/17 09:00:10 INFO FsHistoryProvider: Replaying log path: hdfs://xxx:8020/spark2-history/application_1471416622386_0083.inprogress
> 16/08/17 09:03:41 INFO FsHistoryProvider: Replaying log path: hdfs://xxx:8020/spark2-history/application_1471416622386_0083
> 16/08/17 09:03:49 INFO SecurityManager: Changing view acls to: spark
> 16/08/17 09:03:49 INFO SecurityManager: Changing modify acls to: spark
> 16/08/17 09:03:49 INFO SecurityManager: Changing view acls groups to:
> 16/08/17 09:03:49 INFO SecurityManager: Changing modify acls groups to:
> 16/08/17 09:03:49 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(spark); groups with view permissions: Set(); users with modify permissions: Set(spark); groups with modify permissions: Set()
> 16/08/17 09:03:49 INFO ApplicationCache: Failed to load application attempt application_1471416622386_0083/None
> 16/08/17 09:14:31 INFO FsHistoryProvider: Replaying log path: hdfs://xxx:8020/spark2-history/application_1471416622386_0066_1.inprogress
> 16/08/17 09:32:54 INFO FsHistoryProvider: Replaying log path: hdfs://xxx:8020/spark2-history/application_1471416622386_0073_1.inprogress
> 16/08/17 09:36:25 INFO FsHistoryProvider: Replaying log path: hdfs://xxx:8020/spark2-history/application_1471416622386_0074_1.inprogress
> 16/08/17 09:43:06 INFO FsHistoryProvider: Replaying log path: hdfs://xxx:8020/spark2-history/application_1471416622386_0076_1.inprogress
> 16/08/17 17:53:19 INFO SecurityManager: Changing view acls to: spark
> 16/08/17 17:53:19 INFO SecurityManager: Changing modify acls to: spark
> 16/08/17 17:53:19 INFO SecurityManager: Changing view acls groups to:
> 16/08/17 17:53:19 INFO SecurityManager: Changing modify acls groups to:
> 16/08/17 17:53:19 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(spark); groups with view permissions: Set(); users with modify permissions: Set(spark); groups with modify permissions: Set()
> 16/08/17 17:53:19 INFO FsHistoryProvider: Replaying log path: hdfs://xxx:8020/spark2-history/application_1471416622386_0083
> 16/08/17 17:53:31 INFO SecurityManager: Changing acls enabled to: false
> 16/08/17 17:53:31 INFO SecurityManager: Changing admin acls to:
> 16/08/17 17:53:31 INFO SecurityManager: Changing view acls to: hrt_qa
> 16/08/17 17:53:31 INFO SecurityManager: Changing admin acls groups to:
> 16/08/17 17:53:31 INFO SecurityManager: Changing view acls groups to:
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@34cb487a{/history/application_1471416622386_0083/jobs,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@9927642{/history/application_1471416622386_0083/jobs/json,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@74151089{/history/application_1471416622386_0083/jobs/job,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@66605367{/history/application_1471416622386_0083/jobs/job/json,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@38c54bf5{/history/application_1471416622386_0083/stages,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@707a18ef{/history/application_1471416622386_0083/stages/json,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@42afbe71{/history/application_1471416622386_0083/stages/stage,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@5a3ca0e2{/history/application_1471416622386_0083/stages/stage/json,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@b7d5e57{/history/application_1471416622386_0083/stages/pool,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@4538d13e{/history/application_1471416622386_0083/stages/pool/json,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@6119809f{/history/application_1471416622386_0083/storage,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@7a269b27{/history/application_1471416622386_0083/storage/json,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@68973e79{/history/application_1471416622386_0083/storage/rdd,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@7fcb199e{/history/application_1471416622386_0083/storage/rdd/json,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@513fb950{/history/application_1471416622386_0083/environment,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@151f4319{/history/application_1471416622386_0083/environment/json,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@68430a55{/history/application_1471416622386_0083/executors,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@48021af8{/history/application_1471416622386_0083/executors/json,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@2a1ee2d9{/static,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@11eb727{/history/application_1471416622386_0083,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@7cc77f66{/api,null,AVAILABLE}
> 16/08/17 17:53:31 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@38cd1579{/stages/stage/kill,null,AVAILABLE}{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org