You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by "J. Ryan Earl" <os...@jryanearl.us> on 2011/06/10 04:07:24 UTC

I/O Error on rsync to hdfs-fuse mount

Are there any glaring culprits to check for errors like this:

receiving incremental file list
rsync: failed to set times on "/mnt/hdfs/user/hadoop/reports_new":
Input/output error (5)
rsync: failed to set times on
"/mnt/hdfs/user/hadoop/reports_new/regenerator_201012": Input/output error
(5)
rsync: failed to set times on
"/mnt/hdfs/user/hadoop/reports_new/regenerator_201012/_logs": Input/output
error (5)

I can create files and directories from the command line, but all rsync
write-style operations seem to give an I/O error.

I'm guess it's a bad build, but wondering if there might be another cause.

Thanks,
-JR

Re: I/O Error on rsync to hdfs-fuse mount

Posted by "J. Ryan Earl" <os...@jryanearl.us>.
Jun  9 07:09:39 aushadoop1 fuse_dfs: ERROR: hdfs trying to utime
/user/hadoop/tab/tab/cars/2011-05-28/124950 to 1306596859/1307596179
Jun  9 07:09:57 aushadoop1 fuse_dfs: ERROR: hdfs trying to utime
/user/hadoop/tab/tab/cars/2011-06-05 to 1307310302/1307596197
Jun  9 07:09:57 aushadoop1 fuse_dfs: ERROR: could not connect open file
fuse_impls_open.c:54
Jun  9 07:09:57 aushadoop1 fuse_dfs: ERROR: hdfs trying to utime
/user/hadoop/tab/tab/cars/2011-06-05/021850 to 1307251672/1307596197
Jun  9 07:10:01 aushadoop1 fuse_dfs: ERROR: could not connect open file
fuse_impls_open.c:54
Jun  9 07:10:16 aushadoop1 last message repeated 8 times

The disk is a 'fuse_dfs' mounted HDFS instance.

On Thu, Jun 9, 2011 at 9:37 PM, Marcos Ortiz <ml...@uci.cu> wrote:

> Did you check dmesg to search what is happening in your system?
> It seems that's a disc problem
>
> El 6/9/2011 10:07 PM, J. Ryan Earl escribió:
>
>  Are there any glaring culprits to check for errors like this:
>>
>> receiving incremental file list
>> rsync: failed to set times on "/mnt/hdfs/user/hadoop/reports_new":
>> Input/output error (5)
>> rsync: failed to set times on
>> "/mnt/hdfs/user/hadoop/reports_new/regenerator_201012": Input/output error
>> (5)
>> rsync: failed to set times on
>> "/mnt/hdfs/user/hadoop/reports_new/regenerator_201012/_logs": Input/output
>> error (5)
>>
>> I can create files and directories from the command line, but all rsync
>> write-style operations seem to give an I/O error.
>>
>> I'm guess it's a bad build, but wondering if there might be another cause.
>>
>> Thanks,
>> -JR
>>
>
> --
> Marcos Luís Ortíz Valmaseda
>  Software Engineer (UCI)
>  http://marcosluis2186.posterous.com
>  http://twitter.com/marcosluis2186
>
>

Re: I/O Error on rsync to hdfs-fuse mount

Posted by Marcos Ortiz <ml...@uci.cu>.
Did you check dmesg to search what is happening in your system?
It seems that's a disc problem

El 6/9/2011 10:07 PM, J. Ryan Earl escribió:
> Are there any glaring culprits to check for errors like this:
>
> receiving incremental file list
> rsync: failed to set times on "/mnt/hdfs/user/hadoop/reports_new": 
> Input/output error (5)
> rsync: failed to set times on 
> "/mnt/hdfs/user/hadoop/reports_new/regenerator_201012": Input/output 
> error (5)
> rsync: failed to set times on 
> "/mnt/hdfs/user/hadoop/reports_new/regenerator_201012/_logs": 
> Input/output error (5)
>
> I can create files and directories from the command line, but all 
> rsync write-style operations seem to give an I/O error.
>
> I'm guess it's a bad build, but wondering if there might be another cause.
>
> Thanks,
> -JR

-- 
Marcos Luís Ortíz Valmaseda
  Software Engineer (UCI)
  http://marcosluis2186.posterous.com
  http://twitter.com/marcosluis2186