You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by "Eason.Lee" <le...@gmail.com> on 2010/01/22 06:37:56 UTC
Problem with fuse-dfs~
I'am trying to mount hdfs to my system using fuse-dfs
hadoop:hadoop-0.20.1+152
fuse:fuse-2.8.1
os:SUSE Linux Enterprise Server 10 SP2 (x86_64)
I compile fuse-dfs like this:
ant compile -Dcompile.c++=true -Dlibhdfs=true
ln -s $HADOOP_HOME/build/c++/Linux-amd64-64/lib $HADOOP_HOME/build/libhdfs
export LD_LIBRARY_PATH=/usr/lib:/usr/local/lib:$HADOOP_HOME/build/libhdfs:$JAVA_HOME/jre/lib/amd64/server
ant compile-contrib -Dlibhdfs=1 -Dfusedfs=1
and then followed
http://wiki.apache.org/hadoop/MountableHDFS
finally,i can mount my hdfs to /home/hadoop/hdfs
but when I run ls:
hadoop@hadoop1:~/hdfs> ls
ase dia er me nchmarks p shome stem
hadoop@hadoop1:~/hdfs> ls -all
/bin/ls: nchmarks: No such file or directory
/bin/ls: ase: No such file or directory
/bin/ls: me: No such file or directory
/bin/ls: dia: No such file or directory
/bin/ls: stem: No such file or directory
/bin/ls: p: No such file or directory
/bin/ls: shome: No such file or directory
/bin/ls: er: No such file or directory
total 6
drwxr-xr-x 10 hadoop 99 4096 2010-01-22 10:47 .
drwxr-xr-x 29 hadoop users 1544 2010-01-22 10:29 ..
The first two letters a lost causing the problem
nchmarks=====benchmarks
ase =====hbase
……
Anyone could help?
thx
ps:
what does this means?
modprobe fuse to load it
Re: Problem with fuse-dfs~
Posted by "Eason.Lee" <le...@gmail.com>.
Yes~
It works!
Thanks very much~~~
2010/1/22 Michael Thomas <th...@hep.caltech.edu>
> On 01/21/2010 09:37 PM, Eason.Lee wrote:
>
>> I'am trying to mount hdfs to my system using fuse-dfs
>> hadoop:hadoop-0.20.1+152
>> fuse:fuse-2.8.1
>> os:SUSE Linux Enterprise Server 10 SP2 (x86_64)
>>
>> I compile fuse-dfs like this:
>>
>> ant compile -Dcompile.c++=true -Dlibhdfs=true
>> ln -s $HADOOP_HOME/build/c++/Linux-amd64-64/lib $HADOOP_HOME/build/libhdfs
>> export
>> LD_LIBRARY_PATH=/usr/lib:/usr/local/lib:$HADOOP_HOME/build/libhdfs:$JAVA_HOME/jre/lib/amd64/server
>> ant compile-contrib -Dlibhdfs=1 -Dfusedfs=1
>>
>> and then followed
>> http://wiki.apache.org/hadoop/MountableHDFS
>>
>> finally,i can mount my hdfs to /home/hadoop/hdfs
>>
>> but when I run ls:
>> hadoop@hadoop1:~/hdfs> ls
>> ase dia er me nchmarks p shome stem
>>
>> hadoop@hadoop1:~/hdfs> ls -all
>> /bin/ls: nchmarks: No such file or directory
>> /bin/ls: ase: No such file or directory
>> /bin/ls: me: No such file or directory
>> /bin/ls: dia: No such file or directory
>> /bin/ls: stem: No such file or directory
>> /bin/ls: p: No such file or directory
>> /bin/ls: shome: No such file or directory
>> /bin/ls: er: No such file or directory
>> total 6
>> drwxr-xr-x 10 hadoop 99 4096 2010-01-22 10:47 .
>> drwxr-xr-x 29 hadoop users 1544 2010-01-22 10:29 ..
>>
>> The first two letters a lost causing the problem
>> nchmarks=====benchmarks
>> ase =====hbase
>> ……
>>
>> Anyone could help?
>> thx
>>
>> ps:
>>
>> what does this means?
>> modprobe fuse to load it
>>
>
> Check that the hostname that you use for your namenode in hadoop-site.xml
> matches exactly the hostname you use on the fuse_dfs command line.
> Somewhere in fuse_dfs it assumes the lengths of the two will be the same,
> and if they are not then you'll see missing letters from the filenames in
> the output of 'ls' and the like.
>
> --Mike
>
>
Re: Problem with fuse-dfs~
Posted by Michael Thomas <th...@hep.caltech.edu>.
On 01/21/2010 09:37 PM, Eason.Lee wrote:
> I'am trying to mount hdfs to my system using fuse-dfs
> hadoop:hadoop-0.20.1+152
> fuse:fuse-2.8.1
> os:SUSE Linux Enterprise Server 10 SP2 (x86_64)
>
> I compile fuse-dfs like this:
>
> ant compile -Dcompile.c++=true -Dlibhdfs=true
> ln -s $HADOOP_HOME/build/c++/Linux-amd64-64/lib $HADOOP_HOME/build/libhdfs
> export LD_LIBRARY_PATH=/usr/lib:/usr/local/lib:$HADOOP_HOME/build/libhdfs:$JAVA_HOME/jre/lib/amd64/server
> ant compile-contrib -Dlibhdfs=1 -Dfusedfs=1
>
> and then followed
> http://wiki.apache.org/hadoop/MountableHDFS
>
> finally,i can mount my hdfs to /home/hadoop/hdfs
>
> but when I run ls:
> hadoop@hadoop1:~/hdfs> ls
> ase dia er me nchmarks p shome stem
>
> hadoop@hadoop1:~/hdfs> ls -all
> /bin/ls: nchmarks: No such file or directory
> /bin/ls: ase: No such file or directory
> /bin/ls: me: No such file or directory
> /bin/ls: dia: No such file or directory
> /bin/ls: stem: No such file or directory
> /bin/ls: p: No such file or directory
> /bin/ls: shome: No such file or directory
> /bin/ls: er: No such file or directory
> total 6
> drwxr-xr-x 10 hadoop 99 4096 2010-01-22 10:47 .
> drwxr-xr-x 29 hadoop users 1544 2010-01-22 10:29 ..
>
> The first two letters a lost causing the problem
> nchmarks=====benchmarks
> ase =====hbase
> ……
>
> Anyone could help?
> thx
>
> ps:
>
> what does this means?
> modprobe fuse to load it
Check that the hostname that you use for your namenode in
hadoop-site.xml matches exactly the hostname you use on the fuse_dfs
command line. Somewhere in fuse_dfs it assumes the lengths of the two
will be the same, and if they are not then you'll see missing letters
from the filenames in the output of 'ls' and the like.
--Mike