[jira] [Created] (OOZIE-3332) Update the spark action examples to make it easier to run them on yarn in client and cluster mode

["Daniel Becker (JIRA)" <ji...@apache.org>]

Daniel Becker created OOZIE-3332:
------------------------------------

             Summary: Update the spark action examples to make it easier to run them on yarn in client and cluster mode
                 Key: OOZIE-3332
                 URL: https://issues.apache.org/jira/browse/OOZIE-3332
             Project: Oozie
          Issue Type: Improvement
          Components: examples
            Reporter: Daniel Becker
            Assignee: Daniel Becker


The spark and pyspark examples do not have a <mode> element in their workflow.xml files, probably because of the old way the spark CLI worked, in which to run spark on yarn in client mode, you would write `--master yarn-client` on the command line (https://spark.apache.org/docs/1.5.0/running-on-yarn.html). This still works, but from spark 1.6, the spark documentation (https://spark.apache.org/docs/1.6.0/running-on-yarn.html) says the way to do it is `--master yarn --mode client`.
We should update the two examples to have <mode> elements in workflow.xml and corresponding values in job.properties.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)