You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Venkata siva kamesh Bhallamudi <ka...@gmail.com> on 2014/03/08 11:24:42 UTC

exception while running pi example on yarn cluster

Hi All,
 I am new to Spark and running pi example on Yarn Cluster. I am getting the
following exception

Exception in thread "main" java.lang.NullPointerException
    at
scala.collection.mutable.ArrayOps$ofRef$.length$extension(ArrayOps.scala:114)
    at scala.collection.mutable.ArrayOps$ofRef.length(ArrayOps.scala:114)
    at
scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:32)
    at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108)
    at
org.apache.spark.deploy.yarn.Client$.populateClasspath(Client.scala:518)
    at org.apache.spark.deploy.yarn.Client.setupLaunchEnv(Client.scala:333)
    at org.apache.spark.deploy.yarn.Client.runApp(Client.scala:94)
    at org.apache.spark.deploy.yarn.Client.run(Client.scala:115)
    at org.apache.spark.deploy.yarn.Client$.main(Client.scala:492)
    at org.apache.spark.deploy.yarn.Client.main(Client.scala)

I am using
Spark Version : 0.9.0
Yarn Version : 2.3.0

Please help me where am I doing wrong.

Thanks & Regards
Kamesh.

Re: exception while running pi example on yarn cluster

Posted by Sandy Ryza <sa...@cloudera.com>.
I think this is caused by not setting yarn.application.classpath in your
yarn-site.xml.

-Sandy


On Sat, Mar 8, 2014 at 2:24 AM, Venkata siva kamesh Bhallamudi <
kam.iitkgp@gmail.com> wrote:

> Hi All,
>  I am new to Spark and running pi example on Yarn Cluster. I am getting
> the following exception
>
> Exception in thread "main" java.lang.NullPointerException
>     at
> scala.collection.mutable.ArrayOps$ofRef$.length$extension(ArrayOps.scala:114)
>     at scala.collection.mutable.ArrayOps$ofRef.length(ArrayOps.scala:114)
>     at
> scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:32)
>     at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108)
>     at
> org.apache.spark.deploy.yarn.Client$.populateClasspath(Client.scala:518)
>     at org.apache.spark.deploy.yarn.Client.setupLaunchEnv(Client.scala:333)
>     at org.apache.spark.deploy.yarn.Client.runApp(Client.scala:94)
>     at org.apache.spark.deploy.yarn.Client.run(Client.scala:115)
>     at org.apache.spark.deploy.yarn.Client$.main(Client.scala:492)
>     at org.apache.spark.deploy.yarn.Client.main(Client.scala)
>
> I am using
> Spark Version : 0.9.0
> Yarn Version : 2.3.0
>
> Please help me where am I doing wrong.
>
> Thanks & Regards
> Kamesh.
>