You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by sudeep mishra <su...@gmail.com> on 2016/02/26 06:55:10 UTC

YARN REST API to submit a job

Hi,

I am trying to submit a spark job to YARN 2.7.1.

The format of the request is as below.

Post Data

url - http://<YARN_HOST>:8088/ws/v1/cluster/apps
<http://c1t14366.itcs.hpecorp.net:8088/ws/v1/cluster/apps>



header

                Content-Type: application/json



request body :

                {

    "application-id":"application_id",

    "application-name":"test-rest-api",

    "am-container-spec":

    {

                "credentials":

      {

  "secrets":

      {



        "entry":

        [

          {

            "key":"anchd",

           "value":"kjldjldjlj" ---changed it to base64 encode

          }

        ]

                                }

      },

      "commands":

      {

        "command":"spark-submit --class com.hpe.wordcount.WordCount
--master yarn --deploy-mode cluster
/opt/mount2/hpefs/hpfs-ep-contract-details-1.0.0/worcount-1.0.0.jar"

      }



    },



    "application-type":"SPARK"



  }



But when the job fails as it is being submitted as a user dr.who.


[image: Inline image 1]

How can I pass correct user information to run the job?


Thanks & Regards,

Sudeep