You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Rajesh Kartha (JIRA)" <ji...@apache.org> on 2015/05/02 02:37:07 UTC
[jira] [Updated] (HADOOP-8087) Paths that start with a double slash
cause "No filesystem for scheme: null" errors
[ https://issues.apache.org/jira/browse/HADOOP-8087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rajesh Kartha updated HADOOP-8087:
----------------------------------
Attachment: HADOOP-8087.003.patch
While the previous patches resolved the double slash '//', it does not fix if there are more slashes, example:
[hadoop@localhost common]$ hadoop fs -ls ///user/
ls: No FileSystem for scheme: null
[hadoop@localhost common]$ hadoop fs -ls ////user/
ls: No FileSystem for scheme: null
Attaching a patch that resolves any number of slashes to be consistent as regular Linux systems. With the new patch:
[hadoop@localhost hadoop-3.0.0-SNAPSHOT]$ hadoop fs -ls /user
Found 2 items
drwxr-xr-x - hadoop supergroup 0 2015-04-21 00:00 /user/hadoop
drwxr-xr-x - rajeshk supergroup 0 2015-04-20 22:37 /user/rajeshk
[hadoop@localhost hadoop-3.0.0-SNAPSHOT]$ hadoop fs -ls //user
Found 2 items
drwxr-xr-x - hadoop supergroup 0 2015-04-21 00:00 /user/hadoop
drwxr-xr-x - rajeshk supergroup 0 2015-04-20 22:37 /user/rajeshk
[hadoop@localhost hadoop-3.0.0-SNAPSHOT]$ hadoop fs -ls ///user
Found 2 items
drwxr-xr-x - hadoop supergroup 0 2015-04-21 00:00 /user/hadoop
drwxr-xr-x - rajeshk supergroup 0 2015-04-20 22:37 /user/rajeshk
[hadoop@localhost hadoop-3.0.0-SNAPSHOT]$ hadoop fs -ls ////user
Found 2 items
drwxr-xr-x - hadoop supergroup 0 2015-04-21 00:00 /user/hadoop
drwxr-xr-x - rajeshk supergroup 0 2015-04-20 22:37 /user/rajeshk
[hadoop@localhost hadoop-3.0.0-SNAPSHOT]$ hadoop fs -ls //////////user
Found 2 items
drwxr-xr-x - hadoop supergroup 0 2015-04-21 00:00 /user/hadoop
drwxr-xr-x - rajeshk supergroup 0 2015-04-20 22:37 /user/rajeshk
I will update the patch by adding/updating Unit test cases.
> Paths that start with a double slash cause "No filesystem for scheme: null" errors
> ----------------------------------------------------------------------------------
>
> Key: HADOOP-8087
> URL: https://issues.apache.org/jira/browse/HADOOP-8087
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Daryn Sharp
> Assignee: Rajesh Kartha
> Attachments: HADOOP-8087.001.patch, HADOOP-8087.002.patch, HADOOP-8087.003.patch
>
>
> {{Path}} is incorrectly parsing {{//dir/path}} in a very unexpected way. While it should translate to the directory {{$fs.default.name}/dir/path}}, it instead discards the {{//dir}} and returns
> {{$fs.default.name/path}}. The problem is {{Path}} is trying to parsing an authority even when a scheme is not present.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)