You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Pierre Borckmans (JIRA)" <ji...@apache.org> on 2015/12/19 17:58:46 UTC
[jira] [Updated] (SPARK-12440) [CORE] Avoid setCheckpointDir
warning when filesystem is not local
[ https://issues.apache.org/jira/browse/SPARK-12440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Pierre Borckmans updated SPARK-12440:
-------------------------------------
Description:
In SparkContext method `setCheckpointDir`, a warning is issued when spark master is not local and the passed directory for the checkpoint dir appears to be local.
In practice, when relying on hdfs configuration file and using relative path (incomplete URI without hdfs scheme, ...), this warning should not be issued and might be confusing.
> [CORE] Avoid setCheckpointDir warning when filesystem is not local
> ------------------------------------------------------------------
>
> Key: SPARK-12440
> URL: https://issues.apache.org/jira/browse/SPARK-12440
> Project: Spark
> Issue Type: Improvement
> Affects Versions: 1.5.2, 1.6.0, 1.6.1
> Reporter: Pierre Borckmans
>
> In SparkContext method `setCheckpointDir`, a warning is issued when spark master is not local and the passed directory for the checkpoint dir appears to be local.
> In practice, when relying on hdfs configuration file and using relative path (incomplete URI without hdfs scheme, ...), this warning should not be issued and might be confusing.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org