You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by ch huang <ju...@gmail.com> on 2014/02/20 02:02:23 UTC

issue abount hdfsWrite: FSDataOutputStream#write error:

hi,maillist:
         i use scribe write log into hadoop hdfs, but one of my scribe
report the problem ,and it seems some problem happen when scribe append
data to hdfs file,how can i fix it, my hdfs block size is default .

[Thu Feb 20 08:55:54 2014] "[hdfs] Connecting to HDFS for
/user/hive/warehouse/adx.db/ssp_request/2014-02-20/data_00000"
java.nio.channels.ClosedChannelException
        at
org.apache.hadoop.hdfs.DFSOutputStream.checkClosed(DFSOutputStream.java:1266)
        at org.apache.hadoop.fs.FSOutputSummer.write(FSOutputSummer.java:96)
        at
org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:54)
        at java.io.DataOutputStream.write(DataOutputStream.java:107)
        at java.io.FilterOutputStream.write(FilterOutputStream.java:97)
[Thu Feb 20 08:55:54 2014] "[adx_dsp_request] File store failed to write
(100) messages to file"