You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 04:33:54 UTC

[jira] [Resolved] (SPARK-10347) Investigate the usage of normalizePath()

     [ https://issues.apache.org/jira/browse/SPARK-10347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon resolved SPARK-10347.
----------------------------------
    Resolution: Incomplete

> Investigate the usage of normalizePath()
> ----------------------------------------
>
>                 Key: SPARK-10347
>                 URL: https://issues.apache.org/jira/browse/SPARK-10347
>             Project: Spark
>          Issue Type: Bug
>          Components: SparkR
>            Reporter: Sun Rui
>            Priority: Minor
>              Labels: bulk-closed
>
> Currently normalizePath() is used in several places allowing users to specify paths via the use of tilde expansion, or to normalize a relative path to an absolute path. However, normalizePath() is used for paths which are actually expected to be a URI. normalizePath() may display warning messages when it does not recognize a URI as a local file path. So suppressWarnings() is used to suppress the possible warnings.
> Worse than warnings, call normalizePath() on a URI may cause error. Because it may turn a user specified relative path to an absolute path using the local current directory, but this may not be true because the path is actually relative to the working directory of the default file system instead of the local file system (depends on the Hadoop configuration of Spark).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org