[jira] [Commented] (TOREE-386) spark kernel `--name test` or `--conf spark.app.name=test` parameter to spark_opts is not applied

["Corey A Stubbs (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TOREE-386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15869901#comment-15869901 ] 

Corey A Stubbs commented on TOREE-386:
--------------------------------------

[~sachin aggarwal], sorry for the confusion. It is not an issue with spark. I believe it is an issue with Toree, where the line I mentioned above is overwriting the argument you are passing in.

> spark kernel `--name test` or `--conf spark.app.name=test` parameter to spark_opts is not applied 
> --------------------------------------------------------------------------------------------------
>
>                 Key: TOREE-386
>                 URL: https://issues.apache.org/jira/browse/TOREE-386
>             Project: TOREE
>          Issue Type: Bug
>            Reporter: Sachin Aggarwal
>
> this is my kernel.json
> {code}
> {
>   "language": "scala",
>   "display_name": "toree_special - Scala",
>   "env": {
>     "SPARK_OPTS": "--name MyAPP --master yarn --deploy-mode client",
>     "SPARK_HOME": "spark_home",
>     "__TOREE_OPTS__": "",
>     "DEFAULT_INTERPRETER": "Scala",
>     "PYTHONPATH": "spark_home/python:spark_home/python/lib/py4j-0.9-src.zip",
>     "PYTHON_EXEC": "python"
>   },
>   "argv": [
>     "/root/.local/share/jupyter/kernels/toree_special_scala/bin/run.sh",
>     "--profile",
>     "{connection_file}"
>   ]
> }
> {code}
> the parameter that I added {color:red}--name MyAPP{color} is not applied I still see app name in yarn resource ui as {color:red}IBM Spark Kernel{color}
> update: In new version of toree {color:red}IBM Spark Kernel{color} is renamed to {color:red}Apache Toree{color}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)