You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2014/07/30 23:00:39 UTC
[jira] [Moved] (HADOOP-10906) getConetentSummary() for
HarFileSystem throws IllegalArgumentException
[ https://issues.apache.org/jira/browse/HADOOP-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Allen Wittenauer moved MAPREDUCE-1877 to HADOOP-10906:
------------------------------------------------------
Component/s: (was: harchive)
Affects Version/s: (was: 0.22.0)
Key: HADOOP-10906 (was: MAPREDUCE-1877)
Project: Hadoop Common (was: Hadoop Map/Reduce)
> getConetentSummary() for HarFileSystem throws IllegalArgumentException
> ----------------------------------------------------------------------
>
> Key: HADOOP-10906
> URL: https://issues.apache.org/jira/browse/HADOOP-10906
> Project: Hadoop Common
> Issue Type: Bug
> Reporter: Paul Yang
>
> As HarFileSystem does not implement getContentSummary(), the implementation from FilterFileSystem is inherited by default. However, FilterFileSystem.getContentSummary() does not work for the HarFileSystem because the method attempts to use HarFileSystem's underlying FS to call getContentSummary(). In the case where the the underlying filesystem is HDFS, an exception similar to the following is thrown:
> {code}
> java.lang.IllegalArgumentException: Wrong FS: har://hdfs-example.com:9000/tmp/data.har, expected: hdfs://example.com:9000
> at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:352)
> at org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.java:99)
> at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:155)
> at org.apache.hadoop.hdfs.DistributedFileSystem.getContentSummary(DistributedFileSystem.java:232)
> at org.apache.hadoop.fs.FilterFileSystem.getContentSummary(FilterFileSystem.java:287)
> at org.apache.hadoop.fs.FilterFileSystem.getContentSummary(FilterFileSystem.java:287)
> {code}
> One solution is to implement HarFileSystem.getContentSummary() using code similar to FileSystem.getContentSummary().
--
This message was sent by Atlassian JIRA
(v6.2#6252)