Exception thrown in awaitResult during application launch in yarn cluster

[Shiyuan <gs...@gmail.com>]

Hi Spark-users,
   I am using pyspark on a yarn cluster. One of my spark application launch
failed. Only the driver container had started before it failed on the
ACCEPTED state. The error message is very short and I cannot make sense of
it. The error message is attached below. Any possible causes for this
error?  Thank you!

18/05/18 06:33:09 INFO ApplicationMaster: Starting the user application in
a separate Thread
18/05/18 06:33:09 INFO ApplicationMaster: Waiting for spark context
initialization...
18/05/18 06:33:14 ERROR ApplicationMaster: User application exited with
status 2
18/05/18 06:33:14 INFO ApplicationMaster: Final app status: FAILED,
exitCode: 2, (reason: User application exited with status 2)
18/05/18 06:33:14 ERROR ApplicationMaster: Uncaught exception:
org.apache.spark.SparkException: Exception thrown in awaitResult:
        at
org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:194)
        at
org.apache.spark.deploy.yarn.ApplicationMaster.runDriver(ApplicationMaster.scala:428)
        at
org.apache.spark.deploy.yarn.ApplicationMaster.run(ApplicationMaster.scala:281)
        at
org.apache.spark.deploy.yarn.ApplicationMaster$$anonfun$main$1.apply$mcV$sp(ApplicationMaster.scala:783)
        at
org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:67)
        at
org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:66)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
        at
org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:66)
        at
org.apache.spark.deploy.yarn.ApplicationMaster$.main(ApplicationMaster.scala:781)
        at
org.apache.spark.deploy.yarn.ApplicationMaster.main(ApplicationMaster.scala)
Caused by: org.apache.spark.SparkUserAppException: User application exited
with 2
        at
org.apache.spark.deploy.PythonRunner$.main(PythonRunner.scala:104)
        at org.apache.spark.deploy.PythonRunner.main(PythonRunner.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at
org.apache.spark.deploy.yarn.ApplicationMaster$$anon$3.run(ApplicationMaster.scala:654)
18/05/18 06:33:14 INFO ApplicationMaster: Unregistering ApplicationMaster
with FAILED (diag message: User application exited with status 2)
18/05/18 06:33:14 INFO ApplicationMaster: Deleting staging directory