You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Mridul Muralidharan (JIRA)" <ji...@apache.org> on 2014/05/03 19:43:17 UTC

[jira] [Issue Comment Deleted] (SPARK-1606) spark-submit needs `--arg` for every application parameter

     [ https://issues.apache.org/jira/browse/SPARK-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mridul Muralidharan updated SPARK-1606:
---------------------------------------

    Comment: was deleted

(was: Crap, got to this too late.
We really should not have added this - and I would have -1'ed it.

We have had too many issues with trying to parse the user command line and getting into all sorts of issues which are entirely avoidable by simply being explicit about what the user wants to pass.
Trying to pass strings which contain escape characters and/or whitespace, etc is just going to be a nightmare about this change.)

> spark-submit needs `--arg` for every application parameter
> ----------------------------------------------------------
>
>                 Key: SPARK-1606
>                 URL: https://issues.apache.org/jira/browse/SPARK-1606
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 1.0.0
>            Reporter: Xiangrui Meng
>            Assignee: Patrick Wendell
>            Priority: Blocker
>             Fix For: 1.0.0
>
>
> If the application has a few parameters, the spark-submit command looks like the following:
> {code}
> spark-submit --master yarn-cluster --class main.Class --arg --numPartitions --arg 8 --arg --kryo --arg true
> {code}
> It is a little bit hard to read and modify. Maybe it is okay to treat all arguments after `main.Class` as application parameters.
> {code}
> spark-submit --master yarn-cluster --class main.Class --numPartitions 8 --kryo true
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)