You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by xa...@orange-ftgroup.com on 2008/03/10 23:23:10 UTC
How to compile fuse-dfs
Hi everybody,
I'm trying to compile fuse-dfs but I have problems. I don't have a lot
of experience with C++.
I would like to know:
Is it a clear readme file with the instructions to compile, install
fuse-dfs?
Do I need to replace fuse_dfs.c with the one in
fuse-dfs/src/fuse_dfs.c?
Do I need to set up different flag if I'm using a i386 or 86 machine?
Which one and Where?
Which make file do I need to use to compile the code?
Thanks
Xavier
RE: How to compile fuse-dfs
Posted by xa...@orange-ftgroup.com.
Yes, all those commands works fine but I need to copy a file to the hdfs
Thanks again.
Xavier
-----Original Message-----
From: Pete Wyckoff [mailto:pwyckoff@facebook.com]
Sent: Tuesday, March 11, 2008 11:26 AM
To: core-user@hadoop.apache.org
Subject: Re: How to compile fuse-dfs
But, to be clear, you can do mv, rm, mkdir, rmdir.
On 3/11/08 10:24 AM, "xavier.quintuna@orange-ftgroup.com"
<xa...@orange-ftgroup.com> wrote:
> Thanks Pete. I'll be waiting for 0.17 then
Re: How to compile fuse-dfs
Posted by Pete Wyckoff <pw...@facebook.com>.
But, to be clear, you can do mv, rm, mkdir, rmdir.
On 3/11/08 10:24 AM, "xavier.quintuna@orange-ftgroup.com"
<xa...@orange-ftgroup.com> wrote:
> Thanks Pete. I'll be waiting for 0.17 then
RE: How to compile fuse-dfs
Posted by xa...@orange-ftgroup.com.
Thanks Pete. I'll be waiting for 0.17 then
Xavier
-----Original Message-----
From: Pete Wyckoff [mailto:pwyckoff@facebook.com]
Sent: Tuesday, March 11, 2008 11:16 AM
To: QUINTUNA Xavier RD-ILAB-SSF; core-user@hadoop.apache.org
Subject: Re: How to compile fuse-dfs
Oh sorry xavier - you can't write to DFS - although you shouldn't be
getting an exception. It should return an IO error but create an empty
file.
Fuse_dfs relies on appends working in DFS and since this didn't make it
into 16, we'll have to wait for 0.17 for this to work.
I will look at this error though.
-- pete
On 3/11/08 10:03 AM, "xavier.quintuna@orange-ftgroup.com"
<xa...@orange-ftgroup.com> wrote:
> dfs,138549488,'FLV',4096) Exception in thread "Thread-7"
> java.nio.BufferOverflowException
Re: How to compile fuse-dfs
Posted by Pete Wyckoff <pw...@facebook.com>.
Oh sorry xavier - you can't write to DFS - although you shouldn't be getting
an exception. It should return an IO error but create an empty file.
Fuse_dfs relies on appends working in DFS and since this didn't make it into
16, we'll have to wait for 0.17 for this to work.
I will look at this error though.
-- pete
On 3/11/08 10:03 AM, "xavier.quintuna@orange-ftgroup.com"
<xa...@orange-ftgroup.com> wrote:
> dfs,138549488,'FLV',4096) Exception in thread "Thread-7"
> java.nio.BufferOverflowException
RE: How to compile fuse-dfs
Posted by xa...@orange-ftgroup.com.
Hi Pete,
I was able to compile the fuse_dfs.c. Thanks. But now I have another
question for you.
I'm able to read a file but I'm not able to copy a file to the hdfs. I
wonder if you solve this problem? And How?
In my logs I have this message
----
hdfsWrite(dfs,138549488,'FLV',4096) Exception in thread "Thread-7"
java.nio.BufferOverflowException at
java.nio.Buffer.nextPutIndex(Buffer.java:425) at
java.nio.HeapByteBuffer.putInt(HeapByteBuffer.java:347) at
org.apache.hadoop.dfs.DFSClient$DFSOutputStream$Packet.writeInt(DFSClien
t.java:1537) at
org.apache.hadoop.dfs.DFSClient$DFSOutputStream.writeChunk(DFSClient.jav
a:2128) at
org.apache.hadoop.fs.FSOutputSummer.writeChecksumChunk(FSOutputSummer.ja
va:141) at
org.apache.hadoop.fs.FSOutputSummer.write1(FSOutputSummer.java:100)
at org.apache.hadoop.fs.FSOutputSummer.write(FSOutputSummer.java:86)
at
org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutput
Stream.java:41) at
java.io.DataOutputStream.write(DataOutputStream.java:90) at
java.io.FilterOutputStream.write(FilterOutputStream.java:80) Call to
org.apache.hadoop.fs.FSDataOutputStream::write failed!
./fuse_dfs[14561]: ERROR: fuse problem - could not write all the bytes
for /user/xavier/movie/le_plat.flv -1!=4096fuse_dfs.c:702 08/03/11
10:57:50 WARN fs.DFSClient: DataStreamer Exception: java.io.IOException:
BlockSize 0 is smaller than data size. Offset of packet in block 0
Aborting file /user/xavier/movie/le_plat.flv
---
I really appreciate your help
Xavier
-----Original Message-----
From: Pete Wyckoff [mailto:pwyckoff@facebook.com]
Sent: Monday, March 10, 2008 7:43 PM
To: core-user@hadoop.apache.org
Subject: Re: How to compile fuse-dfs
Hi Xavier,
If you run ./bootsrap.sh does it not create a Makefile for you? There
is a bug in the Makefile that hardcodes it to amd64. I will look at
this.
What kernel are you using and what HW?
--pete
On 3/10/08 2:23 PM, "xavier.quintuna@orange-ftgroup.com"
<xa...@orange-ftgroup.com> wrote:
> Hi everybody,
>
> I'm trying to compile fuse-dfs but I have problems. I don't have a lot
> of experience with C++.
> I would like to know:
> Is it a clear readme file with the instructions to compile, install
> fuse-dfs?
> Do I need to replace fuse_dfs.c with the one in
> fuse-dfs/src/fuse_dfs.c?
> Do I need to set up different flag if I'm using a i386 or 86 machine?
> Which one and Where?
> Which make file do I need to use to compile the code?
>
>
>
> Thanks
>
> Xavier
>
>
>
Re: How to compile fuse-dfs
Posted by Pete Wyckoff <pw...@facebook.com>.
Hi Xavier,
If you run ./bootsrap.sh does it not create a Makefile for you? There is a
bug in the Makefile that hardcodes it to amd64. I will look at this.
What kernel are you using and what HW?
--pete
On 3/10/08 2:23 PM, "xavier.quintuna@orange-ftgroup.com"
<xa...@orange-ftgroup.com> wrote:
> Hi everybody,
>
> I'm trying to compile fuse-dfs but I have problems. I don't have a lot
> of experience with C++.
> I would like to know:
> Is it a clear readme file with the instructions to compile, install
> fuse-dfs?
> Do I need to replace fuse_dfs.c with the one in
> fuse-dfs/src/fuse_dfs.c?
> Do I need to set up different flag if I'm using a i386 or 86 machine?
> Which one and Where?
> Which make file do I need to use to compile the code?
>
>
>
> Thanks
>
> Xavier
>
>
>