You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Iyappan Srinivasan (JIRA)" <ji...@apache.org> on 2009/03/06 09:23:56 UTC
[jira] Created: (HADOOP-5422) In hdfs /*/* globbing does not work
In hdfs /*/* globbing does not work
-----------------------------------
Key: HADOOP-5422
URL: https://issues.apache.org/jira/browse/HADOOP-5422
Project: Hadoop Core
Issue Type: Bug
Components: fs
Environment: cluster brought up with hod.
Reporter: Iyappan Srinivasan
With reference to Jira issue : 3497, we tried globbing /*/*. But it does not work. Output is given below.
bin/hadoop --config /tmp/cluster/ fs -lsr /
log4j:WARN No appenders could be found for logger (org.apache.hadoop.conf.Configuration).
log4j:WARN Please initialize the log4j system properly.
drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a
drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b
drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b/c
bin/hadoop --config /tmp/cluster/ fs -lsr /*/*
lsr: Cannot access /bin/arch: No such file or directory.
lsr: Cannot access /bin/ash: No such file or directory.
lsr: Cannot access /bin/ash.static: No such file or directory.
lsr: Cannot access /bin/awk: No such file or directory.
lsr: Cannot access /bin/basename: No such file or directory.
lsr: Cannot access /bin/bash: No such file or directory.
lsr: Cannot access /bin/bsh: No such file or directory.
lsr: Cannot access /bin/cat: No such file or directory.
....
....
...
It keeps giving a long list like this without showing the results.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5422) In hdfs /*/* globbing does not work
Posted by "Iyappan Srinivasan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Iyappan Srinivasan updated HADOOP-5422:
---------------------------------------
Description:
With reference to Jira issue : 3497, we tried globbing /*/*. But it does not work. Output is given below.
bin/hadoop --config /tmp/cluster/ fs -lsr /
log4j:WARN No appenders could be found for logger (org.apache.hadoop.conf.Configuration).
log4j:WARN Please initialize the log4j system properly.
drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a
drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b
drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b/c
bin/hadoop --config /tmp/cluster/ fs -lsr /*/*
Actually it is "bin/hadoop --config /tmp/cluster/ fs -lsr Forward slash followed by star followed by forward slash followed by star"
output:
lsr: Cannot access /bin/arch: No such file or directory.
lsr: Cannot access /bin/ash: No such file or directory.
lsr: Cannot access /bin/ash.static: No such file or directory.
lsr: Cannot access /bin/awk: No such file or directory.
lsr: Cannot access /bin/basename: No such file or directory.
lsr: Cannot access /bin/bash: No such file or directory.
lsr: Cannot access /bin/bsh: No such file or directory.
lsr: Cannot access /bin/cat: No such file or directory.
....
....
...
It keeps giving a long list like this without showing the results.
was:
With reference to Jira issue : 3497, we tried globbing /*/*. But it does not work. Output is given below.
bin/hadoop --config /tmp/cluster/ fs -lsr /
log4j:WARN No appenders could be found for logger (org.apache.hadoop.conf.Configuration).
log4j:WARN Please initialize the log4j system properly.
drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a
drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b
drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b/c
bin/hadoop --config /tmp/cluster/ fs -lsr /*/*
lsr: Cannot access /bin/arch: No such file or directory.
lsr: Cannot access /bin/ash: No such file or directory.
lsr: Cannot access /bin/ash.static: No such file or directory.
lsr: Cannot access /bin/awk: No such file or directory.
lsr: Cannot access /bin/basename: No such file or directory.
lsr: Cannot access /bin/bash: No such file or directory.
lsr: Cannot access /bin/bsh: No such file or directory.
lsr: Cannot access /bin/cat: No such file or directory.
....
....
...
It keeps giving a long list like this without showing the results.
> In hdfs /*/* globbing does not work
> -----------------------------------
>
> Key: HADOOP-5422
> URL: https://issues.apache.org/jira/browse/HADOOP-5422
> Project: Hadoop Core
> Issue Type: Bug
> Components: fs
> Environment: cluster brought up with hod.
> Reporter: Iyappan Srinivasan
>
> With reference to Jira issue : 3497, we tried globbing /*/*. But it does not work. Output is given below.
> bin/hadoop --config /tmp/cluster/ fs -lsr /
> log4j:WARN No appenders could be found for logger (org.apache.hadoop.conf.Configuration).
> log4j:WARN Please initialize the log4j system properly.
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b/c
> bin/hadoop --config /tmp/cluster/ fs -lsr /*/*
> Actually it is "bin/hadoop --config /tmp/cluster/ fs -lsr Forward slash followed by star followed by forward slash followed by star"
> output:
> lsr: Cannot access /bin/arch: No such file or directory.
> lsr: Cannot access /bin/ash: No such file or directory.
> lsr: Cannot access /bin/ash.static: No such file or directory.
> lsr: Cannot access /bin/awk: No such file or directory.
> lsr: Cannot access /bin/basename: No such file or directory.
> lsr: Cannot access /bin/bash: No such file or directory.
> lsr: Cannot access /bin/bsh: No such file or directory.
> lsr: Cannot access /bin/cat: No such file or directory.
> ....
> ....
> ...
> It keeps giving a long list like this without showing the results.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5422) In hdfs /*/* globbing does not work
Posted by "Iyappan Srinivasan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12680757#action_12680757 ]
Iyappan Srinivasan commented on HADOOP-5422:
--------------------------------------------
Hi Nigel,All,
It works when escape charecters are given in front of star or the whole expression under double quotes.
bin/hadoop --config /tmp/cluster/ fs -ls /\*/\*
log4j:WARN No appenders could be found for logger (org.apache.hadoop.conf.Configuration).
log4j:WARN Please initialize the log4j system properly.
drwxr-xr-x - karthv supergroup 0 2009-03-09 04:28 /a/b/c
drwxr-xr-x - karthv supergroup 0 2009-03-09 04:23 /proc/karthv/karthv
The documentatation does not mention this anywhere in hadoop FS shell guide(FS_Shell.html). It will be nice if it is mentioned somewhere, say in examples.
I will change this to a documentation jira.
> In hdfs /*/* globbing does not work
> -----------------------------------
>
> Key: HADOOP-5422
> URL: https://issues.apache.org/jira/browse/HADOOP-5422
> Project: Hadoop Core
> Issue Type: Bug
> Components: documentation
> Environment: cluster brought up with hod.
> Reporter: Iyappan Srinivasan
>
> With reference to Jira issue : 3497, we tried globbing /*/*. But it does not work. Output is given below.
> bin/hadoop --config /tmp/cluster/ fs -lsr /
> log4j:WARN No appenders could be found for logger (org.apache.hadoop.conf.Configuration).
> log4j:WARN Please initialize the log4j system properly.
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b/c
> bin/hadoop --config /tmp/cluster/ fs -lsr /*/*
> Actually it is "bin/hadoop --config /tmp/cluster/ fs -lsr Forward slash followed by star followed by forward slash followed by star"
> output:
> lsr: Cannot access /bin/arch: No such file or directory.
> lsr: Cannot access /bin/ash: No such file or directory.
> lsr: Cannot access /bin/ash.static: No such file or directory.
> lsr: Cannot access /bin/awk: No such file or directory.
> lsr: Cannot access /bin/basename: No such file or directory.
> lsr: Cannot access /bin/bash: No such file or directory.
> lsr: Cannot access /bin/bsh: No such file or directory.
> lsr: Cannot access /bin/cat: No such file or directory.
> ....
> ....
> ...
> It keeps giving a long list like this without showing the results.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5422) In hdfs /*/* globbing does not work
Posted by "Iyappan Srinivasan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Iyappan Srinivasan updated HADOOP-5422:
---------------------------------------
Component/s: (was: fs)
documentation
> In hdfs /*/* globbing does not work
> -----------------------------------
>
> Key: HADOOP-5422
> URL: https://issues.apache.org/jira/browse/HADOOP-5422
> Project: Hadoop Core
> Issue Type: Bug
> Components: documentation
> Environment: cluster brought up with hod.
> Reporter: Iyappan Srinivasan
>
> With reference to Jira issue : 3497, we tried globbing /*/*. But it does not work. Output is given below.
> bin/hadoop --config /tmp/cluster/ fs -lsr /
> log4j:WARN No appenders could be found for logger (org.apache.hadoop.conf.Configuration).
> log4j:WARN Please initialize the log4j system properly.
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b/c
> bin/hadoop --config /tmp/cluster/ fs -lsr /*/*
> Actually it is "bin/hadoop --config /tmp/cluster/ fs -lsr Forward slash followed by star followed by forward slash followed by star"
> output:
> lsr: Cannot access /bin/arch: No such file or directory.
> lsr: Cannot access /bin/ash: No such file or directory.
> lsr: Cannot access /bin/ash.static: No such file or directory.
> lsr: Cannot access /bin/awk: No such file or directory.
> lsr: Cannot access /bin/basename: No such file or directory.
> lsr: Cannot access /bin/bash: No such file or directory.
> lsr: Cannot access /bin/bsh: No such file or directory.
> lsr: Cannot access /bin/cat: No such file or directory.
> ....
> ....
> ...
> It keeps giving a long list like this without showing the results.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5422) In hdfs /*/* globbing does not work
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12680267#action_12680267 ]
Nigel Daley commented on HADOOP-5422:
-------------------------------------
Is this a regression? I suspect not and that Lohit's suggestion needs to be followed. Iyappan, please confirm.
> In hdfs /*/* globbing does not work
> -----------------------------------
>
> Key: HADOOP-5422
> URL: https://issues.apache.org/jira/browse/HADOOP-5422
> Project: Hadoop Core
> Issue Type: Bug
> Components: fs
> Environment: cluster brought up with hod.
> Reporter: Iyappan Srinivasan
>
> With reference to Jira issue : 3497, we tried globbing /*/*. But it does not work. Output is given below.
> bin/hadoop --config /tmp/cluster/ fs -lsr /
> log4j:WARN No appenders could be found for logger (org.apache.hadoop.conf.Configuration).
> log4j:WARN Please initialize the log4j system properly.
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b/c
> bin/hadoop --config /tmp/cluster/ fs -lsr /*/*
> Actually it is "bin/hadoop --config /tmp/cluster/ fs -lsr Forward slash followed by star followed by forward slash followed by star"
> output:
> lsr: Cannot access /bin/arch: No such file or directory.
> lsr: Cannot access /bin/ash: No such file or directory.
> lsr: Cannot access /bin/ash.static: No such file or directory.
> lsr: Cannot access /bin/awk: No such file or directory.
> lsr: Cannot access /bin/basename: No such file or directory.
> lsr: Cannot access /bin/bash: No such file or directory.
> lsr: Cannot access /bin/bsh: No such file or directory.
> lsr: Cannot access /bin/cat: No such file or directory.
> ....
> ....
> ...
> It keeps giving a long list like this without showing the results.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-5422) In hdfs /*/* globbing does not work
Posted by "Lohit Vijayarenu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lohit Vijayarenu resolved HADOOP-5422.
--------------------------------------
Resolution: Invalid
What seem to happen here is that
{noformat}
hadoop dfs -lsr /*/*
{noformat}
Regular expression is expanded by the shell.
So, you are seeing /bin and such as output.
Please try using '\' or quote the regular expression.
> In hdfs /*/* globbing does not work
> -----------------------------------
>
> Key: HADOOP-5422
> URL: https://issues.apache.org/jira/browse/HADOOP-5422
> Project: Hadoop Core
> Issue Type: Bug
> Components: fs
> Environment: cluster brought up with hod.
> Reporter: Iyappan Srinivasan
>
> With reference to Jira issue : 3497, we tried globbing /*/*. But it does not work. Output is given below.
> bin/hadoop --config /tmp/cluster/ fs -lsr /
> log4j:WARN No appenders could be found for logger (org.apache.hadoop.conf.Configuration).
> log4j:WARN Please initialize the log4j system properly.
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b/c
> bin/hadoop --config /tmp/cluster/ fs -lsr /*/*
> Actually it is "bin/hadoop --config /tmp/cluster/ fs -lsr Forward slash followed by star followed by forward slash followed by star"
> output:
> lsr: Cannot access /bin/arch: No such file or directory.
> lsr: Cannot access /bin/ash: No such file or directory.
> lsr: Cannot access /bin/ash.static: No such file or directory.
> lsr: Cannot access /bin/awk: No such file or directory.
> lsr: Cannot access /bin/basename: No such file or directory.
> lsr: Cannot access /bin/bash: No such file or directory.
> lsr: Cannot access /bin/bsh: No such file or directory.
> lsr: Cannot access /bin/cat: No such file or directory.
> ....
> ....
> ...
> It keeps giving a long list like this without showing the results.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5422) In hdfs /*/* globbing does not work
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12680280#action_12680280 ]
Nigel Daley commented on HADOOP-5422:
-------------------------------------
Iyappan, please confirm this is in the documentation. If not, modify this Jira to reflect the need for documentation.
> In hdfs /*/* globbing does not work
> -----------------------------------
>
> Key: HADOOP-5422
> URL: https://issues.apache.org/jira/browse/HADOOP-5422
> Project: Hadoop Core
> Issue Type: Bug
> Components: fs
> Environment: cluster brought up with hod.
> Reporter: Iyappan Srinivasan
>
> With reference to Jira issue : 3497, we tried globbing /*/*. But it does not work. Output is given below.
> bin/hadoop --config /tmp/cluster/ fs -lsr /
> log4j:WARN No appenders could be found for logger (org.apache.hadoop.conf.Configuration).
> log4j:WARN Please initialize the log4j system properly.
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b/c
> bin/hadoop --config /tmp/cluster/ fs -lsr /*/*
> Actually it is "bin/hadoop --config /tmp/cluster/ fs -lsr Forward slash followed by star followed by forward slash followed by star"
> output:
> lsr: Cannot access /bin/arch: No such file or directory.
> lsr: Cannot access /bin/ash: No such file or directory.
> lsr: Cannot access /bin/ash.static: No such file or directory.
> lsr: Cannot access /bin/awk: No such file or directory.
> lsr: Cannot access /bin/basename: No such file or directory.
> lsr: Cannot access /bin/bash: No such file or directory.
> lsr: Cannot access /bin/bsh: No such file or directory.
> lsr: Cannot access /bin/cat: No such file or directory.
> ....
> ....
> ...
> It keeps giving a long list like this without showing the results.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5422) In hdfs /*/* globbing does not work
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12680275#action_12680275 ]
Tsz Wo (Nicholas), SZE commented on HADOOP-5422:
------------------------------------------------
I tested this. Globbing for /\*/\* works fine in HDFS. Special characters like * need to be escaped as mentioned by Lohit.
> In hdfs /*/* globbing does not work
> -----------------------------------
>
> Key: HADOOP-5422
> URL: https://issues.apache.org/jira/browse/HADOOP-5422
> Project: Hadoop Core
> Issue Type: Bug
> Components: fs
> Environment: cluster brought up with hod.
> Reporter: Iyappan Srinivasan
>
> With reference to Jira issue : 3497, we tried globbing /*/*. But it does not work. Output is given below.
> bin/hadoop --config /tmp/cluster/ fs -lsr /
> log4j:WARN No appenders could be found for logger (org.apache.hadoop.conf.Configuration).
> log4j:WARN Please initialize the log4j system properly.
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b
> drwxr-xr-x - karthv supergroup 0 2009-03-06 08:00 /a/b/c
> bin/hadoop --config /tmp/cluster/ fs -lsr /*/*
> Actually it is "bin/hadoop --config /tmp/cluster/ fs -lsr Forward slash followed by star followed by forward slash followed by star"
> output:
> lsr: Cannot access /bin/arch: No such file or directory.
> lsr: Cannot access /bin/ash: No such file or directory.
> lsr: Cannot access /bin/ash.static: No such file or directory.
> lsr: Cannot access /bin/awk: No such file or directory.
> lsr: Cannot access /bin/basename: No such file or directory.
> lsr: Cannot access /bin/bash: No such file or directory.
> lsr: Cannot access /bin/bsh: No such file or directory.
> lsr: Cannot access /bin/cat: No such file or directory.
> ....
> ....
> ...
> It keeps giving a long list like this without showing the results.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.