You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Mukund Madhugiri (JIRA)" <ji...@apache.org> on 2008/01/25 19:25:34 UTC
[jira] Created: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
-------------------------------------------------------------------
Key: HADOOP-2713
URL: https://issues.apache.org/jira/browse/HADOOP-2713
Project: Hadoop Core
Issue Type: Bug
Components: dfs
Affects Versions: 0.16.0
Environment: Windows
Reporter: Mukund Madhugiri
Assignee: Robert Chansler
Priority: Blocker
Fix For: 0.16.0
Unit test fails consistently on Windows with a timeout:
Test: org.apache.hadoop.dfs.TestDatanodeDeath
Here is a snippet of the console log:
[junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
[junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
[junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
[junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
[junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
[junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
[junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
[junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
[junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
[junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
[junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
[junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
[junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
[junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
[junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
[junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
[junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
[junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
[junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
[junit] at java.lang.Thread.run(Thread.java:595)
[junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
[junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
[junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
[junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
[junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
[junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
[junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
[junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
[junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
[junit] at java.lang.Thread.run(Thread.java:595)
[junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
[junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
[junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "Robert Chansler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Chansler reassigned HADOOP-2713:
---------------------------------------
Assignee: Hairong Kuang (was: Robert Chansler)
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: Hairong Kuang
> Priority: Blocker
> Fix For: 0.16.0
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12562804#action_12562804 ]
Raghu Angadi commented on HADOOP-2713:
--------------------------------------
Can we have a description of bug and the fix? Looks like this patch fixes HADOOP-2714 as well.
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: Hairong Kuang
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch, TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-2713:
-------------------------------------
Status: Open (was: Patch Available)
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: Hairong Kuang
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch, TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12563110#action_12563110 ]
Hadoop QA commented on HADOOP-2713:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12374168/TestDatanodeDeath.patch
against trunk revision 615723.
@author +1. The patch does not contain any @author tags.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1691/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1691/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1691/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1691/console
This message is automatically generated.
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch, TestDatanodeDeath.patch, TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12562815#action_12562815 ]
dhruba borthakur commented on HADOOP-2713:
------------------------------------------
The source datanode of a replication request sends all the data to the destination datanode but does not require any response. There was a race where the destination datanode was trying to send a response and encountering an exception because the source datanode had already closed the connection.
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: Hairong Kuang
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch, TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-2713:
-------------------------------------
Status: Patch Available (was: Open)
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: Hairong Kuang
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-2713:
-------------------------------------
Status: Open (was: Patch Available)
I am not sure that the failures in the unit test is connected with this patch.
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: Hairong Kuang
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch, TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12562819#action_12562819 ]
Hadoop QA commented on HADOOP-2713:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12374109/TestDatanodeDeath.patch
against trunk revision 614721.
@author +1. The patch does not contain any @author tags.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new compiler warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests -1. The patch failed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1685/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1685/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1685/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1685/console
This message is automatically generated.
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: Hairong Kuang
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch, TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur reassigned HADOOP-2713:
----------------------------------------
Assignee: dhruba borthakur (was: Hairong Kuang)
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch, TestDatanodeDeath.patch, TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12562839#action_12562839 ]
Hadoop QA commented on HADOOP-2713:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12374109/TestDatanodeDeath.patch
against trunk revision 614721.
@author +1. The patch does not contain any @author tags.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new compiler warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests -1. The patch failed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1689/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1689/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1689/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1689/console
This message is automatically generated.
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: Hairong Kuang
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch, TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-2713:
-------------------------------------
Attachment: TestDatanodeDeath.patch
Review comments from Hairong.
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: Hairong Kuang
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch, TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-2713:
-------------------------------------
Attachment: TestDatanodeDeath.patch
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: Hairong Kuang
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12562788#action_12562788 ]
Hairong Kuang commented on HADOOP-2713:
---------------------------------------
+1 The code looks fine.
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: Hairong Kuang
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch, TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-2713:
-------------------------------------
Attachment: TestDatanodeDeath.patch
Fixed an additional race condition in DFSOutputStream.close() that was causing an NPE (HADOOP-2717).
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: Hairong Kuang
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch, TestDatanodeDeath.patch, TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-2713:
-------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this.
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch, TestDatanodeDeath.patch, TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-2713:
-------------------------------------
Status: Patch Available (was: Open)
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch, TestDatanodeDeath.patch, TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2713) Unit test fails on Windows:
org.apache.hadoop.dfs.TestDatanodeDeath
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-2713:
-------------------------------------
Status: Patch Available (was: Open)
> Unit test fails on Windows: org.apache.hadoop.dfs.TestDatanodeDeath
> -------------------------------------------------------------------
>
> Key: HADOOP-2713
> URL: https://issues.apache.org/jira/browse/HADOOP-2713
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Windows
> Reporter: Mukund Madhugiri
> Assignee: Hairong Kuang
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: TestDatanodeDeath.patch, TestDatanodeDeath.patch
>
>
> Unit test fails consistently on Windows with a timeout:
> Test: org.apache.hadoop.dfs.TestDatanodeDeath
> Here is a snippet of the console log:
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:47,841 WARN fs.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(209)) - PendingReplicationMonitor timed out block blk_2509851293741663991
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] 2008-01-25 09:10:52,839 INFO dfs.StateChange (FSNamesystem.java:pendingTransfers(3249)) - BLOCK* NameSystem.pendingTransfer: ask 127.0.0.1:3773 to replicate blk_2509851293741663991 to datanode(s) 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:transferBlocks(786)) - 127.0.0.1:3773 Starting thread to transfer block blk_2509851293741663991 to 127.0.0.1:3767
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1035)) - Receiving block blk_2509851293741663991 from /127.0.0.1
> [junit] 2008-01-25 09:10:53,526 INFO dfs.DataNode (DataNode.java:writeBlock(1147)) - writeBlock blk_2509851293741663991 received exception java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] 2008-01-25 09:10:53,526 ERROR dfs.DataNode (DataNode.java:run(948)) - 127.0.0.1:3767:DataXceiver: java.io.IOException: Block blk_2509851293741663991 has already been started (though not completed), and thus cannot be created.
> [junit] at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:638)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1949)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:1060)
> [junit] at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:925)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-01-25 09:10:53,526 WARN dfs.DataNode (DataNode.java:run(2366)) - 127.0.0.1:3773:Failed to transfer blk_2509851293741663991 to 127.0.0.1:3767 got java.net.SocketException: Software caused connection abort: socket write error
> [junit] at java.net.SocketOutputStream.socketWrite0(Native Method)
> [junit] at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> [junit] at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
> [junit] at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> [junit] at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
> [junit] at java.io.DataOutputStream.flush(DataOutputStream.java:106)
> [junit] at org.apache.hadoop.dfs.DataNode$BlockSender.sendBlock(DataNode.java:1621)
> [junit] at org.apache.hadoop.dfs.DataNode$DataTransfer.run(DataNode.java:2360)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] File simpletest.dat has 3 blocks: The 0 block has only 2 replicas but is expected to have 3 replicas.
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit] Test org.apache.hadoop.dfs.TestDatanodeDeath FAILED (timeout)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.