[jira] [Created] (SPARK-5034) Spark on Yarn within HDInsight on Windows

["Rice (JIRA)" <ji...@apache.org>]

Rice created SPARK-5034:
---------------------------

             Summary: Spark on Yarn within HDInsight on Windows
                 Key: SPARK-5034
                 URL: https://issues.apache.org/jira/browse/SPARK-5034
             Project: Spark
          Issue Type: Bug
          Components: YARN
    Affects Versions: 1.2.0, 1.1.1, 1.1.0
         Environment: Spark on Yarn within HDInsight on Windows Azure
            Reporter: Rice


Windows Environment

I'm trying to run JavaSparkPi example on YARN with master = yarn-client but I have a problem. 
It runs smoothly with submitting application, first container for Application Master works too. 
When job is starting and there are some tasks to do I'm getting this warning on console (I'm using windows cmd if this makes any difference): 
WARN cluster.YarnClientClusterScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient memory 
When I'm checking logs for container with Application Masters it is launching containers for executors "properly", then goes with: 
INFO YarnAllocationHandler: Completed container container_1409217202587_0003_01_000002 (state: COMPLETE, exit status: 1) 
INFO YarnAllocationHandler: Container marked as failed: container_1409217202587_0003_01_000002 
And tries to re-launch them. 

On failed container log there is only this: 
Error: Could not find or load main class PWD..spark@GBV06758291.my.secret.address.net:63680.user.CoarseGrainedScheduler 




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org