You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by pwendell <gi...@git.apache.org> on 2014/07/20 06:14:18 UTC

[GitHub] spark pull request: SPARK-2310. Support arbitrary Spark properties...

Github user pwendell commented on the pull request:

    https://github.com/apache/spark/pull/1253#issuecomment-49536672
  
    Hey @sryza - I did a straw poll offline discussing this with a few other contributors. The consensus was that it might be better to have a `--conf` flag with an `=` sign instead of representing spark conf properties directly as flags.
    
    I.e. `--conf spark.app.name=blah`
    
    On admittedly bad thing about this approach is that if users have arguments with spaces in them, they will have to quote the entire thing:
    
    ```
    ./bin/spark-submit --conf "spark.app.name=My app"
    ```
    
    Which might not be intuitive, so it would be good to document that (provided you are generally okay with this proposed syntax).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---