You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2008/02/01 23:23:08 UTC
[jira] Created: (HADOOP-2769) TestNNThroughputBenchmark should not
used a fixed http port
TestNNThroughputBenchmark should not used a fixed http port
-----------------------------------------------------------
Key: HADOOP-2769
URL: https://issues.apache.org/jira/browse/HADOOP-2769
Project: Hadoop Core
Issue Type: Bug
Components: test
Reporter: Owen O'Malley
Assignee: Owen O'Malley
Fix For: 0.16.1
HADOOP-2601 only fixed the main namenode port. It also needed to fix the namenode http port. I get failures like:
{quote}
Testcase: testNNThroughput took 1.048 sec
Caused an ERROR
Address already in use java.net.BindException: Address already in use
at java.net.PlainSocketImpl.socketBind(Native Method)
at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:359)
at java.net.ServerSocket.bind(ServerSocket.java:319)
at java.net.ServerSocket.<init>(ServerSocket.java:185)
at org.mortbay.util.ThreadedServer.newServerSocket(ThreadedServer.java:391)
at org.mortbay.util.ThreadedServer.open(ThreadedServer.java:477)
at org.mortbay.util.ThreadedServer.start(ThreadedServer.java:503)
at org.mortbay.http.SocketListener.start(SocketListener.java:203)
at org.mortbay.http.HttpServer.doStart(HttpServer.java:761)
at org.mortbay.util.Container.start(Container.java:72)
at org.apache.hadoop.mapred.StatusHttpServer.start(StatusHttpServer.java:182)
at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:294)
at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
at org.apache.hadoop.dfs.NNThroughputBenchmark.<init>(NNThroughputBenchmark.java:74)
at org.apache.hadoop.dfs.NNThroughputBenchmark.runBenchmark(NNThroughputBenchmark.java:769)
at org.apache.hadoop.dfs.TestNNThroughputBenchmark.testNNThroughput(TestNNThroughputBenchmark.java:32)
{quote}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2769) TestNNThroughputBenchmark should not
used a fixed http port
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-2769:
----------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this.
> TestNNThroughputBenchmark should not used a fixed http port
> -----------------------------------------------------------
>
> Key: HADOOP-2769
> URL: https://issues.apache.org/jira/browse/HADOOP-2769
> Project: Hadoop Core
> Issue Type: Bug
> Components: test
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Fix For: 0.16.1
>
> Attachments: nn-bench-port.patch
>
>
> HADOOP-2601 only fixed the main namenode port. It also needed to fix the namenode http port. I get failures like:
> {quote}
> Testcase: testNNThroughput took 1.048 sec
> Caused an ERROR
> Address already in use java.net.BindException: Address already in use
> at java.net.PlainSocketImpl.socketBind(Native Method)
> at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:359)
> at java.net.ServerSocket.bind(ServerSocket.java:319)
> at java.net.ServerSocket.<init>(ServerSocket.java:185)
> at org.mortbay.util.ThreadedServer.newServerSocket(ThreadedServer.java:391)
> at org.mortbay.util.ThreadedServer.open(ThreadedServer.java:477)
> at org.mortbay.util.ThreadedServer.start(ThreadedServer.java:503)
> at org.mortbay.http.SocketListener.start(SocketListener.java:203)
> at org.mortbay.http.HttpServer.doStart(HttpServer.java:761)
> at org.mortbay.util.Container.start(Container.java:72)
> at org.apache.hadoop.mapred.StatusHttpServer.start(StatusHttpServer.java:182)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:294)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NNThroughputBenchmark.<init>(NNThroughputBenchmark.java:74)
> at org.apache.hadoop.dfs.NNThroughputBenchmark.runBenchmark(NNThroughputBenchmark.java:769)
> at org.apache.hadoop.dfs.TestNNThroughputBenchmark.testNNThroughput(TestNNThroughputBenchmark.java:32)
> {quote}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2769) TestNNThroughputBenchmark should not
used a fixed http port
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-2769:
----------------------------------
Status: Patch Available (was: Open)
> TestNNThroughputBenchmark should not used a fixed http port
> -----------------------------------------------------------
>
> Key: HADOOP-2769
> URL: https://issues.apache.org/jira/browse/HADOOP-2769
> Project: Hadoop Core
> Issue Type: Bug
> Components: test
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Fix For: 0.16.1
>
> Attachments: nn-bench-port.patch
>
>
> HADOOP-2601 only fixed the main namenode port. It also needed to fix the namenode http port. I get failures like:
> {quote}
> Testcase: testNNThroughput took 1.048 sec
> Caused an ERROR
> Address already in use java.net.BindException: Address already in use
> at java.net.PlainSocketImpl.socketBind(Native Method)
> at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:359)
> at java.net.ServerSocket.bind(ServerSocket.java:319)
> at java.net.ServerSocket.<init>(ServerSocket.java:185)
> at org.mortbay.util.ThreadedServer.newServerSocket(ThreadedServer.java:391)
> at org.mortbay.util.ThreadedServer.open(ThreadedServer.java:477)
> at org.mortbay.util.ThreadedServer.start(ThreadedServer.java:503)
> at org.mortbay.http.SocketListener.start(SocketListener.java:203)
> at org.mortbay.http.HttpServer.doStart(HttpServer.java:761)
> at org.mortbay.util.Container.start(Container.java:72)
> at org.apache.hadoop.mapred.StatusHttpServer.start(StatusHttpServer.java:182)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:294)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NNThroughputBenchmark.<init>(NNThroughputBenchmark.java:74)
> at org.apache.hadoop.dfs.NNThroughputBenchmark.runBenchmark(NNThroughputBenchmark.java:769)
> at org.apache.hadoop.dfs.TestNNThroughputBenchmark.testNNThroughput(TestNNThroughputBenchmark.java:32)
> {quote}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2769) TestNNThroughputBenchmark should not
used a fixed http port
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-2769:
----------------------------------
Attachment: nn-bench-port.patch
Patch sets the hdfs http port to automatic (0) for this unit test.
> TestNNThroughputBenchmark should not used a fixed http port
> -----------------------------------------------------------
>
> Key: HADOOP-2769
> URL: https://issues.apache.org/jira/browse/HADOOP-2769
> Project: Hadoop Core
> Issue Type: Bug
> Components: test
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Fix For: 0.16.1
>
> Attachments: nn-bench-port.patch
>
>
> HADOOP-2601 only fixed the main namenode port. It also needed to fix the namenode http port. I get failures like:
> {quote}
> Testcase: testNNThroughput took 1.048 sec
> Caused an ERROR
> Address already in use java.net.BindException: Address already in use
> at java.net.PlainSocketImpl.socketBind(Native Method)
> at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:359)
> at java.net.ServerSocket.bind(ServerSocket.java:319)
> at java.net.ServerSocket.<init>(ServerSocket.java:185)
> at org.mortbay.util.ThreadedServer.newServerSocket(ThreadedServer.java:391)
> at org.mortbay.util.ThreadedServer.open(ThreadedServer.java:477)
> at org.mortbay.util.ThreadedServer.start(ThreadedServer.java:503)
> at org.mortbay.http.SocketListener.start(SocketListener.java:203)
> at org.mortbay.http.HttpServer.doStart(HttpServer.java:761)
> at org.mortbay.util.Container.start(Container.java:72)
> at org.apache.hadoop.mapred.StatusHttpServer.start(StatusHttpServer.java:182)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:294)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NNThroughputBenchmark.<init>(NNThroughputBenchmark.java:74)
> at org.apache.hadoop.dfs.NNThroughputBenchmark.runBenchmark(NNThroughputBenchmark.java:769)
> at org.apache.hadoop.dfs.TestNNThroughputBenchmark.testNNThroughput(TestNNThroughputBenchmark.java:32)
> {quote}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2769) TestNNThroughputBenchmark should
not used a fixed http port
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12569129#action_12569129 ]
Hadoop QA commented on HADOOP-2769:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12375627/nn-bench-port.patch
against trunk revision 619744.
@author +1. The patch does not contain any @author tags.
tests included +1. The patch appears to include 3 new or modified tests.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1802/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1802/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1802/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1802/console
This message is automatically generated.
> TestNNThroughputBenchmark should not used a fixed http port
> -----------------------------------------------------------
>
> Key: HADOOP-2769
> URL: https://issues.apache.org/jira/browse/HADOOP-2769
> Project: Hadoop Core
> Issue Type: Bug
> Components: test
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Fix For: 0.16.1
>
> Attachments: nn-bench-port.patch
>
>
> HADOOP-2601 only fixed the main namenode port. It also needed to fix the namenode http port. I get failures like:
> {quote}
> Testcase: testNNThroughput took 1.048 sec
> Caused an ERROR
> Address already in use java.net.BindException: Address already in use
> at java.net.PlainSocketImpl.socketBind(Native Method)
> at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:359)
> at java.net.ServerSocket.bind(ServerSocket.java:319)
> at java.net.ServerSocket.<init>(ServerSocket.java:185)
> at org.mortbay.util.ThreadedServer.newServerSocket(ThreadedServer.java:391)
> at org.mortbay.util.ThreadedServer.open(ThreadedServer.java:477)
> at org.mortbay.util.ThreadedServer.start(ThreadedServer.java:503)
> at org.mortbay.http.SocketListener.start(SocketListener.java:203)
> at org.mortbay.http.HttpServer.doStart(HttpServer.java:761)
> at org.mortbay.util.Container.start(Container.java:72)
> at org.apache.hadoop.mapred.StatusHttpServer.start(StatusHttpServer.java:182)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:294)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NNThroughputBenchmark.<init>(NNThroughputBenchmark.java:74)
> at org.apache.hadoop.dfs.NNThroughputBenchmark.runBenchmark(NNThroughputBenchmark.java:769)
> at org.apache.hadoop.dfs.TestNNThroughputBenchmark.testNNThroughput(TestNNThroughputBenchmark.java:32)
> {quote}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2769) TestNNThroughputBenchmark should
not used a fixed http port
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12570499#action_12570499 ]
Chris Douglas commented on HADOOP-2769:
---------------------------------------
+1
> TestNNThroughputBenchmark should not used a fixed http port
> -----------------------------------------------------------
>
> Key: HADOOP-2769
> URL: https://issues.apache.org/jira/browse/HADOOP-2769
> Project: Hadoop Core
> Issue Type: Bug
> Components: test
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Fix For: 0.16.1
>
> Attachments: nn-bench-port.patch
>
>
> HADOOP-2601 only fixed the main namenode port. It also needed to fix the namenode http port. I get failures like:
> {quote}
> Testcase: testNNThroughput took 1.048 sec
> Caused an ERROR
> Address already in use java.net.BindException: Address already in use
> at java.net.PlainSocketImpl.socketBind(Native Method)
> at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:359)
> at java.net.ServerSocket.bind(ServerSocket.java:319)
> at java.net.ServerSocket.<init>(ServerSocket.java:185)
> at org.mortbay.util.ThreadedServer.newServerSocket(ThreadedServer.java:391)
> at org.mortbay.util.ThreadedServer.open(ThreadedServer.java:477)
> at org.mortbay.util.ThreadedServer.start(ThreadedServer.java:503)
> at org.mortbay.http.SocketListener.start(SocketListener.java:203)
> at org.mortbay.http.HttpServer.doStart(HttpServer.java:761)
> at org.mortbay.util.Container.start(Container.java:72)
> at org.apache.hadoop.mapred.StatusHttpServer.start(StatusHttpServer.java:182)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:294)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NNThroughputBenchmark.<init>(NNThroughputBenchmark.java:74)
> at org.apache.hadoop.dfs.NNThroughputBenchmark.runBenchmark(NNThroughputBenchmark.java:769)
> at org.apache.hadoop.dfs.TestNNThroughputBenchmark.testNNThroughput(TestNNThroughputBenchmark.java:32)
> {quote}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2769) TestNNThroughputBenchmark should
not used a fixed http port
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12571026#action_12571026 ]
Hudson commented on HADOOP-2769:
--------------------------------
Integrated in Hadoop-trunk #407 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/407/])
> TestNNThroughputBenchmark should not used a fixed http port
> -----------------------------------------------------------
>
> Key: HADOOP-2769
> URL: https://issues.apache.org/jira/browse/HADOOP-2769
> Project: Hadoop Core
> Issue Type: Bug
> Components: test
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Fix For: 0.16.1
>
> Attachments: nn-bench-port.patch
>
>
> HADOOP-2601 only fixed the main namenode port. It also needed to fix the namenode http port. I get failures like:
> {quote}
> Testcase: testNNThroughput took 1.048 sec
> Caused an ERROR
> Address already in use java.net.BindException: Address already in use
> at java.net.PlainSocketImpl.socketBind(Native Method)
> at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:359)
> at java.net.ServerSocket.bind(ServerSocket.java:319)
> at java.net.ServerSocket.<init>(ServerSocket.java:185)
> at org.mortbay.util.ThreadedServer.newServerSocket(ThreadedServer.java:391)
> at org.mortbay.util.ThreadedServer.open(ThreadedServer.java:477)
> at org.mortbay.util.ThreadedServer.start(ThreadedServer.java:503)
> at org.mortbay.http.SocketListener.start(SocketListener.java:203)
> at org.mortbay.http.HttpServer.doStart(HttpServer.java:761)
> at org.mortbay.util.Container.start(Container.java:72)
> at org.apache.hadoop.mapred.StatusHttpServer.start(StatusHttpServer.java:182)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:294)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NNThroughputBenchmark.<init>(NNThroughputBenchmark.java:74)
> at org.apache.hadoop.dfs.NNThroughputBenchmark.runBenchmark(NNThroughputBenchmark.java:769)
> at org.apache.hadoop.dfs.TestNNThroughputBenchmark.testNNThroughput(TestNNThroughputBenchmark.java:32)
> {quote}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.