You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Thomas Graves (JIRA)" <ji...@apache.org> on 2014/09/02 21:35:21 UTC
[jira] [Comment Edited] (SPARK-3351) Yarn YarnRMClientImpl.shutdown
can be called before register - NPE
[ https://issues.apache.org/jira/browse/SPARK-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118574#comment-14118574 ]
Thomas Graves edited comment on SPARK-3351 at 9/2/14 7:34 PM:
--------------------------------------------------------------
Note I was running on yarn alpha but I think the same applies for yarn stable.
Its also very likely that resourceManager is null since its initialized in register.
was (Author: tgraves):
Note I was running on yarn alpha but I think the same applies for yarn stable.
> Yarn YarnRMClientImpl.shutdown can be called before register - NPE
> ------------------------------------------------------------------
>
> Key: SPARK-3351
> URL: https://issues.apache.org/jira/browse/SPARK-3351
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.2.0
> Reporter: Thomas Graves
>
> If the SparkContext exits while its in the applicationmaster.waitForSparkContextInitialized then the YarnRMClientImpl.shutdown can be called before register and you get a null pointer exception on the uihistoryAddress.
> 14/09/02 18:59:21 INFO ApplicationMaster: Finishing ApplicationMaster with FAILED (diag message: Timed out waiting for SparkContext.)
> Exception in thread "main" java.lang.NullPointerException
> at org.apache.hadoop.yarn.proto.YarnServiceProtos$FinishApplicationMasterRequestProto$Builder.setTrackingUrl(YarnServiceProtos.java:2312)
> at org.apache.hadoop.yarn.api.protocolrecords.impl.pb.FinishApplicationMasterRequestPBImpl.setTrackingUrl(FinishApplicationMasterRequestPBImpl.java:121)
> at org.apache.spark.deploy.yarn.YarnRMClientImpl.shutdown(YarnRMClientImpl.scala:73)
> at org.apache.spark.deploy.yarn.ApplicationMaster.finish(ApplicationMaster.scala:140)
> at org.apache.spark.deploy.yarn.ApplicationMaster.runDriver(ApplicationMaster.scala:178)
> at org.apache.spark.deploy.yarn.ApplicationMaster.run(ApplicationMaster.scala:113)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org