You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org> on 2010/02/27 01:02:05 UTC
[jira] Created: (HADOOP-6601) HarFileSystem shows incorrect
replication numbers
HarFileSystem shows incorrect replication numbers
-------------------------------------------------
Key: HADOOP-6601
URL: https://issues.apache.org/jira/browse/HADOOP-6601
Project: Hadoop Common
Issue Type: Bug
Components: fs
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Mahadev konar
In the har dir, the replication # of part-0 is 3.
{noformat}
-bash-3.1$ hadoop fs -ls ${DIR}.har
Found 3 items
-rw------- 5 tsz users 1141 2010-02-10 18:34 /user/tsz/t20.har/_index
-rw------- 5 tsz users 24 2010-02-10 18:34 /user/tsz/t20.har/_masterindex
-rw------- 3 tsz users 15052 2010-02-10 18:34 /user/tsz/t20.har/part-0
{noformat}
but the replication # of the individual har:// files is shown as 5.
{noformat}
-bash-3.1$ hadoop fs -ls ${HAR_FULL}/${DIR}
Found 20 items
-rw------- 5 tsz users 723 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000000
-rw------- 5 tsz users 779 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000001
-rw------- 5 tsz users 818 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000002
-rw------- 5 tsz users 811 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000003
...
{noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6601) HarFileSystem shows incorrect
replication numbers and permissions
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-6601:
-------------------------------------------
Description:
In the har dir, the replication # of part-0 is 3.
{noformat}
-bash-3.1$ hadoop fs -ls ${DIR}.har
Found 3 items
-rw------- 5 tsz users 1141 2010-02-10 18:34 /user/tsz/t20.har/_index
-rw------- 5 tsz users 24 2010-02-10 18:34 /user/tsz/t20.har/_masterindex
-rw------- 3 tsz users 15052 2010-02-10 18:34 /user/tsz/t20.har/part-0
{noformat}
but the replication # of the individual har:// files is shown as 5.
{noformat}
-bash-3.1$ hadoop fs -lsr ${HAR_FULL}/
drw------- - tsz users 0 2010-02-10 18:34 /user/tsz/t20.har/t20
-rw------- 5 tsz users 723 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000000
-rw------- 5 tsz users 779 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000001
-rw------- 5 tsz users 818 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000002
...
{noformat}
The permission also has similar problem. Clearly, the permission of t20.har/t20 shown above is incorrect.
was:
In the har dir, the replication # of part-0 is 3.
{noformat}
-bash-3.1$ hadoop fs -ls ${DIR}.har
Found 3 items
-rw------- 5 tsz users 1141 2010-02-10 18:34 /user/tsz/t20.har/_index
-rw------- 5 tsz users 24 2010-02-10 18:34 /user/tsz/t20.har/_masterindex
-rw------- 3 tsz users 15052 2010-02-10 18:34 /user/tsz/t20.har/part-0
{noformat}
but the replication # of the individual har:// files is shown as 5.
{noformat}
-bash-3.1$ hadoop fs -ls ${HAR_FULL}/${DIR}
Found 20 items
-rw------- 5 tsz users 723 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000000
-rw------- 5 tsz users 779 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000001
-rw------- 5 tsz users 818 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000002
-rw------- 5 tsz users 811 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000003
...
{noformat}
Summary: HarFileSystem shows incorrect replication numbers and permissions (was: HarFileSystem shows incorrect replication numbers)
> HarFileSystem shows incorrect replication numbers and permissions
> -----------------------------------------------------------------
>
> Key: HADOOP-6601
> URL: https://issues.apache.org/jira/browse/HADOOP-6601
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Reporter: Tsz Wo (Nicholas), SZE
> Assignee: Mahadev konar
>
> In the har dir, the replication # of part-0 is 3.
> {noformat}
> -bash-3.1$ hadoop fs -ls ${DIR}.har
> Found 3 items
> -rw------- 5 tsz users 1141 2010-02-10 18:34 /user/tsz/t20.har/_index
> -rw------- 5 tsz users 24 2010-02-10 18:34 /user/tsz/t20.har/_masterindex
> -rw------- 3 tsz users 15052 2010-02-10 18:34 /user/tsz/t20.har/part-0
> {noformat}
> but the replication # of the individual har:// files is shown as 5.
> {noformat}
> -bash-3.1$ hadoop fs -lsr ${HAR_FULL}/
> drw------- - tsz users 0 2010-02-10 18:34 /user/tsz/t20.har/t20
> -rw------- 5 tsz users 723 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000000
> -rw------- 5 tsz users 779 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000001
> -rw------- 5 tsz users 818 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000002
> ...
> {noformat}
> The permission also has similar problem. Clearly, the permission of t20.har/t20 shown above is incorrect.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6601) HarFileSystem shows incorrect
replication numbers and permissions
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-6601:
----------------------------------
Fix Version/s: 0.22.0
> HarFileSystem shows incorrect replication numbers and permissions
> -----------------------------------------------------------------
>
> Key: HADOOP-6601
> URL: https://issues.apache.org/jira/browse/HADOOP-6601
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Reporter: Tsz Wo (Nicholas), SZE
> Assignee: Mahadev konar
> Fix For: 0.22.0
>
>
> In the har dir, the replication # of part-0 is 3.
> {noformat}
> -bash-3.1$ hadoop fs -ls ${DIR}.har
> Found 3 items
> -rw------- 5 tsz users 1141 2010-02-10 18:34 /user/tsz/t20.har/_index
> -rw------- 5 tsz users 24 2010-02-10 18:34 /user/tsz/t20.har/_masterindex
> -rw------- 3 tsz users 15052 2010-02-10 18:34 /user/tsz/t20.har/part-0
> {noformat}
> but the replication # of the individual har:// files is shown as 5.
> {noformat}
> -bash-3.1$ hadoop fs -lsr ${HAR_FULL}/
> drw------- - tsz users 0 2010-02-10 18:34 /user/tsz/t20.har/t20
> -rw------- 5 tsz users 723 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000000
> -rw------- 5 tsz users 779 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000001
> -rw------- 5 tsz users 818 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000002
> ...
> {noformat}
> The permission also has similar problem. Clearly, the permission of t20.har/t20 shown above is incorrect.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.