You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/02/20 06:38:00 UTC
[jira] [Commented] (SPARK-26926) Disable sparkUI
[ https://issues.apache.org/jira/browse/SPARK-26926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772668#comment-16772668 ]
Hyukjin Kwon commented on SPARK-26926:
--------------------------------------
{{pyspark}} does not support any application options. I can't reproduce this against current master. Please provide a reproducible step if it happens in the current master as well.
If this issue is indeed existent in lower versions, we should identify the JIRA that fixes the issue.
> Disable sparkUI
> ---------------
>
> Key: SPARK-26926
> URL: https://issues.apache.org/jira/browse/SPARK-26926
> Project: Spark
> Issue Type: Bug
> Components: PySpark, Spark Submit
> Affects Versions: 2.3.2
> Reporter: Carlos Perez
> Priority: Major
>
> When you disable spark.ui with {color:#000000}spark{color}{color:#000000}.{color}{color:#000000}ui{color}{color:#000000}.{color}{color:#000000}enabled{color}{color:#000000}={color}{color:#000a65}false{color} in spark2-defaults.xml
> The job fail
> {color:#00a250}/usr/hdp/current/spark2-client/python/pyspark/context.py{color} in {color:#60c6c8}uiWebUrl{color}{color:#208ffb}(self){color} {color:#007427} 400{color} {color:#00a250}def{color} uiWebUrl{color:#208ffb}({color}self{color:#208ffb}){color}{color:#208ffb}:{color} {color:#007427} 401{color} {color:#208ffb}"""Return the URL of the SparkUI instance started by this SparkContext"""{color} {color:#00a250}--> 402{color} {color:#00a250}return{color} self{color:#208ffb}.{color}_jsc{color:#208ffb}.{color}sc{color:#208ffb}({color}{color:#208ffb}){color}{color:#208ffb}.{color}uiWebUrl{color:#208ffb}({color}{color:#208ffb}){color}{color:#208ffb}.{color}get{color:#208ffb}({color}{color:#208ffb}){color} {color:#007427} 403{color} {color:#007427} 404{color} {color:#208ffb}@{color}property
>
> Same issue with : {color:#000000}pyspark —conf spark.ui.enabled=false{color}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org