You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Weiqing Yang (JIRA)" <ji...@apache.org> on 2016/08/09 16:35:20 UTC
[jira] [Comment Edited] (SPARK-16966) App Name is a randomUUID even
when "spark.app.name" exists
[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15413810#comment-15413810 ]
Weiqing Yang edited comment on SPARK-16966 at 8/9/16 4:34 PM:
--------------------------------------------------------------
In the tests, I modified org.apache.spark.examples.SparkKMeans to comment its appName() call.
val spark = SparkSession
.builder
// .appName("SparkKMeans")
.getOrCreate()
was (Author: weiqingyang):
In the tests, I modified org.apache.spark.examples.SparkKMeans example to comment its appName() call.
val spark = SparkSession
.builder
// .appName("SparkKMeans")
.getOrCreate()
> App Name is a randomUUID even when "spark.app.name" exists
> ----------------------------------------------------------
>
> Key: SPARK-16966
> URL: https://issues.apache.org/jira/browse/SPARK-16966
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Reporter: Weiqing Yang
>
> When submitting an application with "--name":
> ./bin/spark-submit --name myApplicationTest --verbose --executor-cores 3 --num-executors 1 --master yarn --deploy-mode client --class org.apache.spark.examples.SparkKMeans examples/target/original-spark-examples_2.11-2.1.0-SNAPSHOT.jar hdfs://localhost:9000/lr_big.txt 2 5
> In the history server UI:
> App ID: application_1470694797714_0016
> App Name: 70c06dc5-1b99-4b4a-a826-ea27497e977b
> The App Name should not be a randomUUID "70c06dc5-1b99-4b4a-a826-ea27497e977b" since the "spark.app.name" was myApplicationTest.
> The application "org.apache.spark.examples.SparkKMeans" above did not invoke ".appName()".
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org