[jira] [Created] (SPARK-7367) CLI --help -h overrides the application arguments

["Gianmario Spacagna (JIRA)" <ji...@apache.org>]

Gianmario Spacagna created SPARK-7367:
-----------------------------------------

             Summary: CLI --help -h overrides the application arguments
                 Key: SPARK-7367
                 URL: https://issues.apache.org/jira/browse/SPARK-7367
             Project: Spark
          Issue Type: Bug
          Components: Spark Submit
    Affects Versions: 1.0.0
            Reporter: Gianmario Spacagna
            Priority: Minor


The spark-submit script will parse the --help argument even if when is provided as application argument.

E.g. 
spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass /MyLocalJAR.jar --help

or

spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass /MyLocalJAR.jar -h

If my application is using a parsing library, such as Scallop, then it will never be able to run the application with --help as argument.

I think the spark-submit script should only print the help message when is provided as single argument like this:

spark-submit --help

or it should provide a separator for trailing arguments:

spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass /MyLocalJAR.jar -- --help --arg1 --arg2




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org