You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Ajay Srivastava <Aj...@guavus.com> on 2013/07/19 14:24:18 UTC

Unexpected problem in creating temporary file 

Hi,

I am seeing many such errors on a datanode -

2013-07-18 22:10:49,473 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(10.254.0.40:50010, storageID=DS-595314104-10.254.0.40-50010-1374154266946, infoPort=50075, ipcPort=50020):DataXceiver
java.io.IOException: Unexpected problem in creating temporary file for blk_-395633752903233591_3721.  File /data/hadoop-admin/tmp/blk_-395633752903233591 should not be present, but is.
        at org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolume.createTmpFile(FSDataset.java:429)
        at org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolume.createTmpFile(FSDataset.java:407)
        at org.apache.hadoop.hdfs.server.datanode.FSDataset.createTmpFile(FSDataset.java:1242)
        at org.apache.hadoop.hdfs.server.datanode.FSDataset.writeToBlock(FSDataset.java:1131)
        at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:99)
        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:305)
        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:113)
        at java.lang.Thread.run(Unknown Source)

What could be the reason behind it ? It is causing system to slow down.
Before these errors, there were few exceptions with "connection reset by peer" which I guess are harmless.


Regards,
Ajay Srivastava

Re: Unexpected problem in creating temporary file

Posted by Ajay Srivastava <Aj...@guavus.com>.
Any suggestion ?
I am stuck.


Regards,
Ajay Srivastava


On 19-Jul-2013, at 5:54 PM, Ajay Srivastava wrote:

> Hi,
> 
> I am seeing many such errors on a datanode -
> 
> 2013-07-18 22:10:49,473 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(10.254.0.40:50010, storageID=DS-595314104-10.254.0.40-50010-1374154266946, infoPort=50075, ipcPort=50020):DataXceiver
> java.io.IOException: Unexpected problem in creating temporary file for blk_-395633752903233591_3721.  File /data/hadoop-admin/tmp/blk_-395633752903233591 should not be present, but is.
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolume.createTmpFile(FSDataset.java:429)
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolume.createTmpFile(FSDataset.java:407)
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset.createTmpFile(FSDataset.java:1242)
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset.writeToBlock(FSDataset.java:1131)
>        at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:99)
>        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:305)
>        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:113)
>        at java.lang.Thread.run(Unknown Source)
> 
> What could be the reason behind it ? It is causing system to slow down.
> Before these errors, there were few exceptions with "connection reset by peer" which I guess are harmless.
> 
> 
> Regards,
> Ajay Srivastava

Re: Unexpected problem in creating temporary file

Posted by Ajay Srivastava <Aj...@guavus.com>.
Any suggestion ?
I am stuck.


Regards,
Ajay Srivastava


On 19-Jul-2013, at 5:54 PM, Ajay Srivastava wrote:

> Hi,
> 
> I am seeing many such errors on a datanode -
> 
> 2013-07-18 22:10:49,473 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(10.254.0.40:50010, storageID=DS-595314104-10.254.0.40-50010-1374154266946, infoPort=50075, ipcPort=50020):DataXceiver
> java.io.IOException: Unexpected problem in creating temporary file for blk_-395633752903233591_3721.  File /data/hadoop-admin/tmp/blk_-395633752903233591 should not be present, but is.
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolume.createTmpFile(FSDataset.java:429)
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolume.createTmpFile(FSDataset.java:407)
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset.createTmpFile(FSDataset.java:1242)
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset.writeToBlock(FSDataset.java:1131)
>        at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:99)
>        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:305)
>        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:113)
>        at java.lang.Thread.run(Unknown Source)
> 
> What could be the reason behind it ? It is causing system to slow down.
> Before these errors, there were few exceptions with "connection reset by peer" which I guess are harmless.
> 
> 
> Regards,
> Ajay Srivastava

Re: Unexpected problem in creating temporary file

Posted by Ajay Srivastava <Aj...@guavus.com>.
Any suggestion ?
I am stuck.


Regards,
Ajay Srivastava


On 19-Jul-2013, at 5:54 PM, Ajay Srivastava wrote:

> Hi,
> 
> I am seeing many such errors on a datanode -
> 
> 2013-07-18 22:10:49,473 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(10.254.0.40:50010, storageID=DS-595314104-10.254.0.40-50010-1374154266946, infoPort=50075, ipcPort=50020):DataXceiver
> java.io.IOException: Unexpected problem in creating temporary file for blk_-395633752903233591_3721.  File /data/hadoop-admin/tmp/blk_-395633752903233591 should not be present, but is.
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolume.createTmpFile(FSDataset.java:429)
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolume.createTmpFile(FSDataset.java:407)
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset.createTmpFile(FSDataset.java:1242)
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset.writeToBlock(FSDataset.java:1131)
>        at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:99)
>        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:305)
>        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:113)
>        at java.lang.Thread.run(Unknown Source)
> 
> What could be the reason behind it ? It is causing system to slow down.
> Before these errors, there were few exceptions with "connection reset by peer" which I guess are harmless.
> 
> 
> Regards,
> Ajay Srivastava

Re: Unexpected problem in creating temporary file

Posted by Ajay Srivastava <Aj...@guavus.com>.
Any suggestion ?
I am stuck.


Regards,
Ajay Srivastava


On 19-Jul-2013, at 5:54 PM, Ajay Srivastava wrote:

> Hi,
> 
> I am seeing many such errors on a datanode -
> 
> 2013-07-18 22:10:49,473 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(10.254.0.40:50010, storageID=DS-595314104-10.254.0.40-50010-1374154266946, infoPort=50075, ipcPort=50020):DataXceiver
> java.io.IOException: Unexpected problem in creating temporary file for blk_-395633752903233591_3721.  File /data/hadoop-admin/tmp/blk_-395633752903233591 should not be present, but is.
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolume.createTmpFile(FSDataset.java:429)
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolume.createTmpFile(FSDataset.java:407)
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset.createTmpFile(FSDataset.java:1242)
>        at org.apache.hadoop.hdfs.server.datanode.FSDataset.writeToBlock(FSDataset.java:1131)
>        at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:99)
>        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:305)
>        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:113)
>        at java.lang.Thread.run(Unknown Source)
> 
> What could be the reason behind it ? It is causing system to slow down.
> Before these errors, there were few exceptions with "connection reset by peer" which I guess are harmless.
> 
> 
> Regards,
> Ajay Srivastava