[jira] [Commented] (OOZIE-3332) [examples] Spark examples should feature yarn client and cluster modes

["Andras Piros (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/OOZIE-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16591348#comment-16591348 ] 

Andras Piros commented on OOZIE-3332:
-------------------------------------

Thanks for the contribution [~daniel.becker]! +1

> [examples] Spark examples should feature yarn client and cluster modes
> ----------------------------------------------------------------------
>
>                 Key: OOZIE-3332
>                 URL: https://issues.apache.org/jira/browse/OOZIE-3332
>             Project: Oozie
>          Issue Type: Improvement
>          Components: examples
>            Reporter: Daniel Becker
>            Assignee: Daniel Becker
>            Priority: Trivial
>         Attachments: OOZIE-3332.2.patch, OOZIE-3332.patch
>
>
> The spark and pyspark examples do not have a <mode> element in their workflow.xml files, probably because of the old way the spark CLI worked, in which to run spark on yarn in client mode, you would write 
> {code:java}
> --master yarn-client
> {code}
>  on the command line (https://spark.apache.org/docs/1.5.0/running-on-yarn.html). This still works, but from spark 1.6, the spark documentation (https://spark.apache.org/docs/1.6.0/running-on-yarn.html) says the way to do it is 
> {code:java}
> --master yarn --mode client
> {code}
> .
> We should update the two examples to have <mode> elements in workflow.xml and corresponding values in job.properties.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)