[jira] [Created] (SPARK-19264) Work maybe should start driver, the same to AM of yarn

["hustfxj (JIRA)" <ji...@apache.org>]

hustfxj created SPARK-19264:
-------------------------------

             Summary: Work maybe should start driver, the same to  AM  of yarn 
                 Key: SPARK-19264
                 URL: https://issues.apache.org/jira/browse/SPARK-19264
             Project: Spark
          Issue Type: Improvement
            Reporter: hustfxj


  I think work can't start driver by "ProcessBuilderLike",  thus we can't know the application's main thread is finished or not if the application's main thread contains some daemon threads. Because the program terminates when there no longer is any non-daemon thread running (or someone called System.exit). The main thread can have finished long ago. 

    worker should  start driver like AM of YARN . As followed:
    
    ```
      mainMethod.invoke(null, userArgs.toArray)
     finish(FinalApplicationStatus.SUCCEEDED, ApplicationMaster.EXIT_SUCCESS)
     logDebug("Done running users class")
    ```
Then the work can monitor the driver's main thread, and know the application's state. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org