You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Brandon Li (JIRA)" <ji...@apache.org> on 2014/01/17 23:02:23 UTC
[jira] [Updated] (HADOOP-10112) har file listing doesn't work with
wild card
[ https://issues.apache.org/jira/browse/HADOOP-10112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brandon Li updated HADOOP-10112:
--------------------------------
Attachment: HADOOP-10112.004.patch
Basically, the problem is that: when a wildcard is in the path, FileSystem object splits the whole path into components, and then get matches/status of each component. However, Har file root path doesn't start with "/" so it can't process any prefix.
For example, the .har file is created at /user/me/foo.har.
When user does "hadoop dfs -ls har:///test/foo.har/* ", FileSystem object passes each component path to HarFileSystem: /, /test, /test/foo.har, /test/foo.har/*. HarFileSystem doesn't recognize any prefix pathes "/" or "/test" since they are not in har file system.
The fix is to redirect the request to its source file system(e.g., HDFS) for the prefix paths.
Uploaded a patch for branch 2.3.
> har file listing doesn't work with wild card
> ---------------------------------------------
>
> Key: HADOOP-10112
> URL: https://issues.apache.org/jira/browse/HADOOP-10112
> Project: Hadoop Common
> Issue Type: Bug
> Components: tools
> Affects Versions: 2.3.0
> Reporter: Brandon Li
> Assignee: Brandon Li
> Attachments: HADOOP-10112.004.patch
>
>
> [test@test001 root]$ hdfs dfs -ls har:///tmp/filename.har/*
> -ls: Can not create a Path from an empty string
> Usage: hadoop fs [generic options] -ls [-d] [-h] [-R] [<path> ...]
> It works without "*".
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)