You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Nigel Daley (JIRA)" <ji...@apache.org> on 2007/03/14 20:03:09 UTC

[jira] Created: (HADOOP-1119) DataNode receives an unknown opcode

DataNode receives an unknown opcode
-----------------------------------

                 Key: HADOOP-1119
                 URL: https://issues.apache.org/jira/browse/HADOOP-1119
             Project: Hadoop
          Issue Type: Bug
          Components: dfs
    Affects Versions: 0.12.0
            Reporter: Nigel Daley


I'm seeing 3 instance of *each* of these exceptions across various logs when running RandomWriter.  The times seem to be well correlated.

JT Log:
2007-03-14 06:23:29,312 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0001_m_000051_0: java.io.FileNotFoundException: /e/c/k/hqa/dfs/data500/tmp/client-8331829540309757259 (No such file or directory)
        at java.io.FileInputStream.open(Native Method)
        at java.io.FileInputStream.<init>(FileInputStream.java:106)
        at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.endBlock(DFSClient.java:1284)
        at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1236)
        at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.write(DFSClient.java:1218)
        at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:38)
        at java.io.BufferedOutputStream.write(BufferedOutputStream.java:105)
        at java.io.DataOutputStream.write(DataOutputStream.java:90)
        at org.apache.hadoop.fs.ChecksumFileSystem$FSOutputSummer.write(ChecksumFileSystem.java:391)
        at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:38)
        at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
        at java.io.BufferedOutputStream.write(BufferedOutputStream.java:109)
        at java.io.DataOutputStream.write(DataOutputStream.java:90)
        at org.apache.hadoop.io.SequenceFile$Writer.append(SequenceFile.java:771)
        at org.apache.hadoop.examples.RandomWriter$Map.map(RandomWriter.java:164)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:175)
        at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)

DN Log:
2007-03-14 06:23:26,166 ERROR org.apache.hadoop.dfs.DataNode: DataXCeiver
java.io.IOException: Unknown opcode for incoming data stream
        at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:605)

NN Log:
2007-03-14 06:23:45,935 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.startFile: failed to create file /u/hqa/sort/input/part-51 for DFSClient_task_0001_m_000051_1 on client 72.3.5.5 because pendingCreates is non-null.
2007-03-14 06:23:45,938 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 8020 call error: org.apache.hadoop.dfs.AlreadyBeingCreatedException: failed to create file /u/hqa/sort/input/part-51 for DFSClient_task_0001_m_000051_1 on client 72.3.5.5 because pendingCreates is non-null.
org.apache.hadoop.dfs.AlreadyBeingCreatedException: failed to create file /u/hqa/sort/input/part-51 for DFSClient_task_0001_m_000051_1 on client 72.3.5.5 because pendingCreates is non-null.
        at org.apache.hadoop.dfs.FSNamesystem.startFile(FSNamesystem.java:701)
        at org.apache.hadoop.dfs.NameNode.create(NameNode.java:283)
        at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:336)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:559)


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HADOOP-1119) DataNode receives an unknown opcode

Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raghu Angadi resolved HADOOP-1119.
----------------------------------

    Resolution: Won't Fix

A lot has changed since 0.12. Closing this for now.

> DataNode receives an unknown opcode
> -----------------------------------
>
>                 Key: HADOOP-1119
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1119
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>
> I'm seeing 3 instance of *each* of these exceptions across various logs when running RandomWriter.  The times seem to be well correlated.
> JT Log:
> 2007-03-14 06:23:29,312 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0001_m_000051_0: java.io.FileNotFoundException: /e/c/k/hqa/dfs/data500/tmp/client-8331829540309757259 (No such file or directory)
>         at java.io.FileInputStream.open(Native Method)
>         at java.io.FileInputStream.<init>(FileInputStream.java:106)
>         at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.endBlock(DFSClient.java:1284)
>         at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1236)
>         at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.write(DFSClient.java:1218)
>         at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:38)
>         at java.io.BufferedOutputStream.write(BufferedOutputStream.java:105)
>         at java.io.DataOutputStream.write(DataOutputStream.java:90)
>         at org.apache.hadoop.fs.ChecksumFileSystem$FSOutputSummer.write(ChecksumFileSystem.java:391)
>         at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:38)
>         at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
>         at java.io.BufferedOutputStream.write(BufferedOutputStream.java:109)
>         at java.io.DataOutputStream.write(DataOutputStream.java:90)
>         at org.apache.hadoop.io.SequenceFile$Writer.append(SequenceFile.java:771)
>         at org.apache.hadoop.examples.RandomWriter$Map.map(RandomWriter.java:164)
>         at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:175)
>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)
> DN Log:
> 2007-03-14 06:23:26,166 ERROR org.apache.hadoop.dfs.DataNode: DataXCeiver
> java.io.IOException: Unknown opcode for incoming data stream
>         at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:605)
> NN Log:
> 2007-03-14 06:23:45,935 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.startFile: failed to create file /u/hqa/sort/input/part-51 for DFSClient_task_0001_m_000051_1 on client 72.3.5.5 because pendingCreates is non-null.
> 2007-03-14 06:23:45,938 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 8020 call error: org.apache.hadoop.dfs.AlreadyBeingCreatedException: failed to create file /u/hqa/sort/input/part-51 for DFSClient_task_0001_m_000051_1 on client 72.3.5.5 because pendingCreates is non-null.
> org.apache.hadoop.dfs.AlreadyBeingCreatedException: failed to create file /u/hqa/sort/input/part-51 for DFSClient_task_0001_m_000051_1 on client 72.3.5.5 because pendingCreates is non-null.
>         at org.apache.hadoop.dfs.FSNamesystem.startFile(FSNamesystem.java:701)
>         at org.apache.hadoop.dfs.NameNode.create(NameNode.java:283)
>         at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:336)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:559)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.