You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2015/11/18 22:35:11 UTC
[jira] [Commented] (SPARK-11828) DAGScheduler source registered too
early with MetricsSystem
[ https://issues.apache.org/jira/browse/SPARK-11828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012036#comment-15012036 ]
Apache Spark commented on SPARK-11828:
--------------------------------------
User 'vanzin' has created a pull request for this issue:
https://github.com/apache/spark/pull/9820
> DAGScheduler source registered too early with MetricsSystem
> -----------------------------------------------------------
>
> Key: SPARK-11828
> URL: https://issues.apache.org/jira/browse/SPARK-11828
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.6.0
> Reporter: Marcelo Vanzin
> Priority: Minor
>
> I see this log message when starting apps on YARN:
> {quote}
> 15/11/18 13:12:56 WARN MetricsSystem: Using default name DAGScheduler for source because spark.app.id is not set.
> {quote}
> That's because DAGScheduler registers itself with the metrics system in its constructor, and the DAGScheduler is instantiated before "spark.app.id" is set in the context's SparkConf.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org