[jira] [Commented] (SPARK-15899) file scheme should be used correctly

["Kazuaki Ishizaki (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326537#comment-15326537 ] 

Kazuaki Ishizaki commented on SPARK-15899:
------------------------------------------

Thank you for your comments.

It is a little bit complicated since there is a difference among platforms as described [here|https://en.wikipedia.org/wiki/File_URI_scheme#Examples]. On Linux, we have to make a prefix {{file://}} (add the two extra slashes) to {{file:}} since a file path that we get is {{/path/to}}. On Windows, we have to make a prefix {{file:///}} (add the three extra slashes) to {{file:}} since a file path that we get is {{c:/windows}}.
How will we address this?

> file scheme should be used correctly
> ------------------------------------
>
>                 Key: SPARK-15899
>                 URL: https://issues.apache.org/jira/browse/SPARK-15899
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>            Reporter: Kazuaki Ishizaki
>            Priority: Minor
>
> [A RFC|https://www.ietf.org/rfc/rfc1738.txt] defines file scheme as {{file://host/}} or {{file:///}}. [Wikipedia|https://en.wikipedia.org/wiki/File_URI_scheme]
> [Some code stuffs|https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala#L58] use different prefix such as {{file:}}.
> It would be good to prepare a utility method to correctly add {{file://host}} or {{file://} prefix.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org