You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Gianmario Spacagna (JIRA)" <ji...@apache.org> on 2015/05/05 13:58:00 UTC
[jira] [Updated] (SPARK-7367) CLI --help -h overrides the
application arguments
[ https://issues.apache.org/jira/browse/SPARK-7367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gianmario Spacagna updated SPARK-7367:
--------------------------------------
Description:
The spark-submit script will parse the --help argument even if is provided as application argument.
E.g.
spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass /MyLocalJAR.jar --help
or
spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass /MyLocalJAR.jar -h
If my application is using a parsing library, such as Scallop, then it will never be able to run the application with --help as argument.
I think the spark-submit script should only print the help message when is provided as single argument like this:
spark-submit --help
or it should provide a separator for trailing arguments:
spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass /MyLocalJAR.jar -- --help --arg1 --arg2
was:
The spark-submit script will parse the --help argument even if when is provided as application argument.
E.g.
spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass /MyLocalJAR.jar --help
or
spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass /MyLocalJAR.jar -h
If my application is using a parsing library, such as Scallop, then it will never be able to run the application with --help as argument.
I think the spark-submit script should only print the help message when is provided as single argument like this:
spark-submit --help
or it should provide a separator for trailing arguments:
spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass /MyLocalJAR.jar -- --help --arg1 --arg2
> CLI --help -h overrides the application arguments
> -------------------------------------------------
>
> Key: SPARK-7367
> URL: https://issues.apache.org/jira/browse/SPARK-7367
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit
> Affects Versions: 1.0.0
> Reporter: Gianmario Spacagna
> Priority: Minor
>
> The spark-submit script will parse the --help argument even if is provided as application argument.
> E.g.
> spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass /MyLocalJAR.jar --help
> or
> spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass /MyLocalJAR.jar -h
> If my application is using a parsing library, such as Scallop, then it will never be able to run the application with --help as argument.
> I think the spark-submit script should only print the help message when is provided as single argument like this:
> spark-submit --help
> or it should provide a separator for trailing arguments:
> spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass /MyLocalJAR.jar -- --help --arg1 --arg2
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org