You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Hairong Kuang (JIRA)" <ji...@apache.org> on 2008/06/18 02:22:45 UTC
[jira] Created: (HADOOP-3588) Bug report for archives
Bug report for archives
-----------------------
Key: HADOOP-3588
URL: https://issues.apache.org/jira/browse/HADOOP-3588
Project: Hadoop Core
Issue Type: Bug
Components: tools/harchive
Reporter: Hairong Kuang
Assignee: Mahadev konar
Fix For: 0.18.0
I tested archives. Here is the bug report:
Documentation:
Add examples to section 3 to illustrate the use of listing/cating files in an archive.
User interface:
Case 1:
$ hadoop archive -archiveName xx.har /conf
Index: 0, Size: 0
Case 2: archive does not occur in destination
$ hadoop archive -archiveName /dd/xx.har /conf /cc
08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
...
$ hadoop dfs -ls /dd
Found 1 items
drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
$ hadoop dfs -ls /cc
ls: Cannot access /cc: No such file or directory.
Case 3: archive gets overwritten without any warning
$ hadoop dfs -ls /dd
Found 1 items
drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
$ hadoop archive -archiveName xx.har /conf /dd
08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
...
$ hadoop dfs -ls /dd
Found 1 items
drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
Case 4: src & dst are the same - I think we should not allow this
$ hadoop archive -archiveName xx.har /conf /conf
08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
...
$ hadoop dfs -ls /conf
Found 3 items
-rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
-rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
Case 5: dst is a file - more informative message
$ hadoop dfs -ls /hadoop-site.xml
Found 1 items
-rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
$ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
Job failed!
Functionality:
Case 5: error message is better to be "op" not allowed.
$ hadoop dfs -ls har:///test/xx.har/conf
Found 2 items
-rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
-rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
$ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
Found 1 items
-rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
$ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
rm: Har: delete not implemented
$ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
Case 6: count is not implemented
$ hadoop dfs -count har:///test/xx.har/conf
Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Priority: Blocker (was: Major)
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this to trunk and 0.18.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch, Hadoop-3588-trunk_3.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Attachment: Hadoop-3588-trunk_3.patch
attached the wrong file.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch, Hadoop-3588-trunk_3.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Attachment: Hadoop-3588-trunk_3.patch
updated the patch with jothi's comments.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Attachment: Hadoop-3588-18_1.patch
here is a patch for 0.18.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-18_1.patch, Hadoop-3588-trunk_1.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3588) Bug report for archives
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12609106#action_12609106 ]
Hudson commented on HADOOP-3588:
--------------------------------
Integrated in Hadoop-trunk #533 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/533/])
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch, Hadoop-3588-trunk_3.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Status: Open (was: Patch Available)
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3588) Bug report for archives
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12608570#action_12608570 ]
Hadoop QA commented on HADOOP-3588:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12384780/Hadoop-3588-trunk_3.patch
against trunk revision 671563.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2751/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2751/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2751/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2751/console
This message is automatically generated.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch, Hadoop-3588-trunk_3.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Attachment: Hadoop-3588-trunk_2.patch
this patch is without running ant docs.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Status: Open (was: Patch Available)
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Status: Patch Available (was: Open)
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-18_1.patch, Hadoop-3588-trunk_1.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3588) Bug report for archives
Posted by "Jothi Padmanabhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12608654#action_12608654 ]
Jothi Padmanabhan commented on HADOOP-3588:
-------------------------------------------
+1. Looks fine.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch, Hadoop-3588-trunk_3.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Status: Patch Available (was: Open)
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch, Hadoop-3588-trunk_3.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Attachment: (was: Hadoop-3588-18_1.patch)
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_1.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3588) Bug report for archives
Posted by "Jothi Padmanabhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12608341#action_12608341 ]
Jothi Padmanabhan commented on HADOOP-3588:
-------------------------------------------
Looks good. A couple of minor comments
1. In HadoopArchives.java, should
if (args.length < 2) not be if (args.length < 4)
as we will always need (at the minumum) -archiveName xxx.har Src Dest
2. The method checkValidName(archiveName) is being called both in run and also in the archive ()
One of them is redundant.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Attachment: (was: Hadoop-3588-18_1.patch)
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12608574#action_12608574 ]
Mahadev konar commented on HADOOP-3588:
---------------------------------------
the test failures do not have anything to do with this patch.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch, Hadoop-3588-trunk_3.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Status: Open (was: Patch Available)
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Attachment: Hadoop-3588-trunk_1.patch
this patch is for trunk and fixes issues
1, 2, 3, 5, 5.
For 4) I dont think we should disallow it. It is sematically correct to create a har dir in the input dir and it should be allowed as is allowed in tar or others. If we are worrying about users to be deleting the directory after they create the archives then that is something users should be warned about and not programmed into the code.
For 6) it would need some changes to the Command class that is used by count to use uris for input. I will open another bug for that.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_1.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Status: Patch Available (was: Open)
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Status: Patch Available (was: Open)
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_1.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Status: Patch Available (was: Open)
running through hudson again.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Status: Open (was: Patch Available)
trying hudson again with patch jsut for trunk. hudson applied 0.18 -- removing it and trying just with the trunk patch.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_1.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3588) Bug report for archives
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607714#action_12607714 ]
Hadoop QA commented on HADOOP-3588:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12384607/Hadoop-3588-18_1.patch
against trunk revision 671277.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2725/console
This message is automatically generated.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-18_1.patch, Hadoop-3588-trunk_1.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3588) Bug report for archives
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607744#action_12607744 ]
Hadoop QA commented on HADOOP-3588:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12384606/Hadoop-3588-trunk_1.patch
against trunk revision 671277.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2726/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2726/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2726/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2726/console
This message is automatically generated.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_1.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Attachment: (was: Hadoop-3588-trunk_1.patch)
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Attachment: (was: Hadoop-3588-trunk_3.patch)
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3588) Bug report for archives
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3588:
----------------------------------
Attachment: Hadoop-3588-18_1.patch
this is a patch for 0.18 branch.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-18_1.patch, Hadoop-3588-trunk_1.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3588) Bug report for archives
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12608317#action_12608317 ]
Hadoop QA commented on HADOOP-3588:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12384736/Hadoop-3588-trunk_2.patch
against trunk revision 671563.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2744/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2744/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2744/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2744/console
This message is automatically generated.
> Bug report for archives
> -----------------------
>
> Key: HADOOP-3588
> URL: https://issues.apache.org/jira/browse/HADOOP-3588
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Hairong Kuang
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: Hadoop-3588-trunk_2.patch
>
>
> I tested archives. Here is the bug report:
> Documentation:
> Add examples to section 3 to illustrate the use of listing/cating files in an archive.
>
> User interface:
> Case 1:
> $ hadoop archive -archiveName xx.har /conf
> Index: 0, Size: 0
> Case 2: archive does not occur in destination
> $ hadoop archive -archiveName /dd/xx.har /conf /cc
> 08/06/17 22:36:35 INFO mapred.JobClient: Running job: job_200806172141_0005
> 08/06/17 22:36:36 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:36:39 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:36:46 INFO mapred.JobClient: Job complete: job_200806172141_0005
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop dfs -ls /cc
> ls: Cannot access /cc: No such file or directory.
> Case 3: archive gets overwritten without any warning
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:36 /dd/xx.har
> $ hadoop archive -archiveName xx.har /conf /dd
> 08/06/17 22:43:46 INFO mapred.JobClient: Running job: job_200806172141_0006
> 08/06/17 22:43:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:43:49 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:43:56 INFO mapred.JobClient: Job complete: job_200806172141_0006
> ...
> $ hadoop dfs -ls /dd
> Found 1 items
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:43 /dd/xx.har
> Case 4: src & dst are the same - I think we should not allow this
> $ hadoop archive -archiveName xx.har /conf /conf
> 08/06/17 22:52:16 INFO mapred.JobClient: Running job: job_200806172141_0008
> 08/06/17 22:52:17 INFO mapred.JobClient: map 0% reduce 0%
> 08/06/17 22:52:22 INFO mapred.JobClient: map 100% reduce 0%
> 08/06/17 22:52:30 INFO mapred.JobClient: Job complete: job_200806172141_0008
> ...
> $ hadoop dfs -ls /conf
> Found 3 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 21:43 /conf/hadoop-site.xml
> -rw-r--r-- 1 hairong supergroup 2844 2008-06-17 21:43 /conf/log4j.properties
> drwxr-xr-x - hairong supergroup 0 2008-06-17 22:52 /conf/xx.har
> Case 5: dst is a file - more informative message
> $ hadoop dfs -ls /hadoop-site.xml
> Found 1 items
> -rw-r--r-- 1 hairong supergroup 3889 2008-06-17 23:06 /hadoop-site.xml
> $ hadoop archive -archiveName xx.har /conf /hadoop-site.xml
> 08/06/17 23:06:54 INFO mapred.JobClient: Running job: job_200806172141_0009
> Job failed!
> Functionality:
> Case 5: error message is better to be "op" not allowed.
> $ hadoop dfs -ls har:///test/xx.har/conf
> Found 2 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> -rw-r--r-- 10 hairong supergroup 2844 2008-06-17 23:24 /test/xx.har/conf/log4j.properties
> $ hadoop dfs -ls har:///test/xx.har/conf/hadoop-site.xml
> Found 1 items
> -rw-r--r-- 10 hairong supergroup 3889 2008-06-17 23:24 /test/xx.har/conf/hadoop-site.xml
> $ hadoop dfs -rm har:///test/xx.har/conf/hadoop-site.xml
> rm: Har: delete not implemented
> $ hadoop dfs -mv har:///test/xx.har/conf/hadoop-site.xml har:///test/xx.har/conf/hadoop-default.xml
> mv: Failed to rename har:/test/xx.har/conf/hadoop-site.xml to har:/test/xx.har/conf/hadoop-default.xml
> Case 6: count is not implemented
> $ hadoop dfs -count har:///test/xx.har/conf
> Can not find listing for har:///test/xx.har/conf
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.