You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Eli Collins (JIRA)" <ji...@apache.org> on 2012/09/27 18:40:10 UTC
[jira] [Created] (HDFS-3985) TestMulitipleNNDataBlockScanner may
hang
Eli Collins created HDFS-3985:
---------------------------------
Summary: TestMulitipleNNDataBlockScanner may hang
Key: HDFS-3985
URL: https://issues.apache.org/jira/browse/HDFS-3985
Project: Hadoop HDFS
Issue Type: Bug
Components: test
Affects Versions: 2.0.2-alpha
Reporter: Eli Collins
Saw TestMulitipleNNDataBlockScanner hang in a jenkins job recently. Let's add the relevant test timeouts so we can see what's going on.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3985) TestMulitipleNNDataBlockScanner may
hang
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated HDFS-3985:
------------------------------
Resolution: Fixed
Fix Version/s: 2.0.3-alpha
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
I've committed this and merged to branch-2. We can open another jira for whatever is causing the timeout once we identify it.
> TestMulitipleNNDataBlockScanner may hang
> ----------------------------------------
>
> Key: HDFS-3985
> URL: https://issues.apache.org/jira/browse/HDFS-3985
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
> Affects Versions: 2.0.2-alpha
> Reporter: Eli Collins
> Labels: test-fail
> Fix For: 2.0.3-alpha
>
> Attachments: hdfs-3985-timeouts.txt
>
>
> Saw TestMulitipleNNDataBlockScanner hang in a jenkins job recently. Let's add the relevant test timeouts so we can see what's going on.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3985) TestMulitipleNNDataBlockScanner may
hang
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13476835#comment-13476835 ]
Hadoop QA commented on HDFS-3985:
---------------------------------
{color:green}+1 overall{color}. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12549267/hdfs-3985-timeouts.txt
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/3342//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3342//console
This message is automatically generated.
> TestMulitipleNNDataBlockScanner may hang
> ----------------------------------------
>
> Key: HDFS-3985
> URL: https://issues.apache.org/jira/browse/HDFS-3985
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
> Affects Versions: 2.0.2-alpha
> Reporter: Eli Collins
> Labels: test-fail
> Attachments: hdfs-3985-timeouts.txt
>
>
> Saw TestMulitipleNNDataBlockScanner hang in a jenkins job recently. Let's add the relevant test timeouts so we can see what's going on.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3985) Add timeouts to
TestMulitipleNNDataBlockScanner
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated HDFS-3985:
------------------------------
Summary: Add timeouts to TestMulitipleNNDataBlockScanner (was: TestMulitipleNNDataBlockScanner may hang)
> Add timeouts to TestMulitipleNNDataBlockScanner
> -----------------------------------------------
>
> Key: HDFS-3985
> URL: https://issues.apache.org/jira/browse/HDFS-3985
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
> Affects Versions: 2.0.2-alpha
> Reporter: Eli Collins
> Labels: test-fail
> Fix For: 2.0.3-alpha
>
> Attachments: hdfs-3985-timeouts.txt
>
>
> Saw TestMulitipleNNDataBlockScanner hang in a jenkins job recently. Let's add the relevant test timeouts so we can see what's going on.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3985) Add timeouts to
TestMulitipleNNDataBlockScanner
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477873#comment-13477873 ]
Hudson commented on HDFS-3985:
------------------------------
Integrated in Hadoop-Mapreduce-trunk #1228 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1228/])
HDFS-3985. Add timeouts to TestMulitipleNNDataBlockScanner. Contributed by Todd Lipcon (Revision 1398874)
Result = FAILURE
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1398874
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestMultipleNNDataBlockScanner.java
> Add timeouts to TestMulitipleNNDataBlockScanner
> -----------------------------------------------
>
> Key: HDFS-3985
> URL: https://issues.apache.org/jira/browse/HDFS-3985
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
> Affects Versions: 2.0.2-alpha
> Reporter: Eli Collins
> Labels: test-fail
> Fix For: 2.0.3-alpha
>
> Attachments: hdfs-3985-timeouts.txt
>
>
> Saw TestMulitipleNNDataBlockScanner hang in a jenkins job recently. Let's add the relevant test timeouts so we can see what's going on.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3985) Add timeouts to
TestMulitipleNNDataBlockScanner
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477842#comment-13477842 ]
Hudson commented on HDFS-3985:
------------------------------
Integrated in Hadoop-Hdfs-trunk #1198 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1198/])
HDFS-3985. Add timeouts to TestMulitipleNNDataBlockScanner. Contributed by Todd Lipcon (Revision 1398874)
Result = SUCCESS
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1398874
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestMultipleNNDataBlockScanner.java
> Add timeouts to TestMulitipleNNDataBlockScanner
> -----------------------------------------------
>
> Key: HDFS-3985
> URL: https://issues.apache.org/jira/browse/HDFS-3985
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
> Affects Versions: 2.0.2-alpha
> Reporter: Eli Collins
> Labels: test-fail
> Fix For: 2.0.3-alpha
>
> Attachments: hdfs-3985-timeouts.txt
>
>
> Saw TestMulitipleNNDataBlockScanner hang in a jenkins job recently. Let's add the relevant test timeouts so we can see what's going on.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3985) TestMulitipleNNDataBlockScanner may
hang
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated HDFS-3985:
------------------------------
Status: Patch Available (was: Open)
> TestMulitipleNNDataBlockScanner may hang
> ----------------------------------------
>
> Key: HDFS-3985
> URL: https://issues.apache.org/jira/browse/HDFS-3985
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
> Affects Versions: 2.0.2-alpha
> Reporter: Eli Collins
> Labels: test-fail
> Attachments: hdfs-3985-timeouts.txt
>
>
> Saw TestMulitipleNNDataBlockScanner hang in a jenkins job recently. Let's add the relevant test timeouts so we can see what's going on.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3985) TestMulitipleNNDataBlockScanner may
hang
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477111#comment-13477111 ]
Eli Collins commented on HDFS-3985:
-----------------------------------
+1 lgtm
> TestMulitipleNNDataBlockScanner may hang
> ----------------------------------------
>
> Key: HDFS-3985
> URL: https://issues.apache.org/jira/browse/HDFS-3985
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
> Affects Versions: 2.0.2-alpha
> Reporter: Eli Collins
> Labels: test-fail
> Attachments: hdfs-3985-timeouts.txt
>
>
> Saw TestMulitipleNNDataBlockScanner hang in a jenkins job recently. Let's add the relevant test timeouts so we can see what's going on.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3985) Add timeouts to
TestMulitipleNNDataBlockScanner
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477138#comment-13477138 ]
Hudson commented on HDFS-3985:
------------------------------
Integrated in Hadoop-trunk-Commit #2869 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/2869/])
HDFS-3985. Add timeouts to TestMulitipleNNDataBlockScanner. Contributed by Todd Lipcon (Revision 1398874)
Result = SUCCESS
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1398874
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestMultipleNNDataBlockScanner.java
> Add timeouts to TestMulitipleNNDataBlockScanner
> -----------------------------------------------
>
> Key: HDFS-3985
> URL: https://issues.apache.org/jira/browse/HDFS-3985
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
> Affects Versions: 2.0.2-alpha
> Reporter: Eli Collins
> Labels: test-fail
> Fix For: 2.0.3-alpha
>
> Attachments: hdfs-3985-timeouts.txt
>
>
> Saw TestMulitipleNNDataBlockScanner hang in a jenkins job recently. Let's add the relevant test timeouts so we can see what's going on.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3985) Add timeouts to
TestMulitipleNNDataBlockScanner
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477773#comment-13477773 ]
Hudson commented on HDFS-3985:
------------------------------
Integrated in Hadoop-Yarn-trunk #6 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/6/])
HDFS-3985. Add timeouts to TestMulitipleNNDataBlockScanner. Contributed by Todd Lipcon (Revision 1398874)
Result = FAILURE
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1398874
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestMultipleNNDataBlockScanner.java
> Add timeouts to TestMulitipleNNDataBlockScanner
> -----------------------------------------------
>
> Key: HDFS-3985
> URL: https://issues.apache.org/jira/browse/HDFS-3985
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
> Affects Versions: 2.0.2-alpha
> Reporter: Eli Collins
> Labels: test-fail
> Fix For: 2.0.3-alpha
>
> Attachments: hdfs-3985-timeouts.txt
>
>
> Saw TestMulitipleNNDataBlockScanner hang in a jenkins job recently. Let's add the relevant test timeouts so we can see what's going on.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3985) TestMulitipleNNDataBlockScanner may
hang
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated HDFS-3985:
------------------------------
Labels: test-fail (was: )
> TestMulitipleNNDataBlockScanner may hang
> ----------------------------------------
>
> Key: HDFS-3985
> URL: https://issues.apache.org/jira/browse/HDFS-3985
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
> Affects Versions: 2.0.2-alpha
> Reporter: Eli Collins
> Labels: test-fail
>
> Saw TestMulitipleNNDataBlockScanner hang in a jenkins job recently. Let's add the relevant test timeouts so we can see what's going on.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3985) TestMulitipleNNDataBlockScanner may
hang
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated HDFS-3985:
------------------------------
Attachment: hdfs-3985-timeouts.txt
Attached patch adds 120sec timeouts to all the test cases in this suite.
The last nightly run took 145 seconds, and a run on my laptop had these timings:
{code}
<testcase time="25.516" classname="org.apache.hadoop.hdfs.server.datanode.TestMultipleNNDataBlockScanner" name="testDataBlockScanner"/>
<testcase time="21.932" classname="org.apache.hadoop.hdfs.server.datanode.TestMultipleNNDataBlockScanner" name="testBlockScannerAfterRefresh"/>
<testcase time="26.999" classname="org.apache.hadoop.hdfs.server.datanode.TestMultipleNNDataBlockScanner" name="testBlockScannerAfterRestart"/>
<testcase time="51.206" classname="org.apache.hadoop.hdfs.server.datanode.TestMultipleNNDataBlockScanner" name="test2NNBlockRescanInterval"/>
<testcase time="20.61" classname="org.apache.hadoop.hdfs.server.datanode.TestMultipleNNDataBlockScanner" name="testBlockRescanInterval"/>
{code}
So 120sec should be plenty of time to not inflict false errors but hopefully will catch the next time it gets "stuck"
> TestMulitipleNNDataBlockScanner may hang
> ----------------------------------------
>
> Key: HDFS-3985
> URL: https://issues.apache.org/jira/browse/HDFS-3985
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
> Affects Versions: 2.0.2-alpha
> Reporter: Eli Collins
> Labels: test-fail
> Attachments: hdfs-3985-timeouts.txt
>
>
> Saw TestMulitipleNNDataBlockScanner hang in a jenkins job recently. Let's add the relevant test timeouts so we can see what's going on.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira