You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Michael Taggart <mi...@webco.tv> on 2005/12/14 22:49:22 UTC
java.net.ConnectException: Connection refused
I've followed the steps in the media-style wiki for setting up a map
reduce system. I am only having one strange error when I attempt to
start the tasktrackers. Here is my output:
[root@srv08 nutch]# bin/nutch-daemon.sh start tasktracker
starting tasktracker, logging
to /usr/local/nutch/nutch-root-tasktracker-srv08.xxxxx.com.log
051214 133808 parsing file:/usr/local/nutch/conf/nutch-default.xml
051214 133808 parsing file:/usr/local/nutch/conf/nutch-site.xml
051214 133808 Server listener on port 50050: starting
051214 133808 Server handler 0 on 50050: starting
051214 133808 Server handler 1 on 50050: starting
051214 133808 Server listener on port 50040: starting
051214 133808 Server handler 0 on 50040: starting
051214 133808 Server handler 1 on 50040: starting
java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
I have configured my nutch-site.xml as follows on each box:
?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="nutch-conf.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<nutch-conf>
<property>
<name>fs.default.name</name>
<value>srv05.xxxxx.com:50000</value>
<description>The name of the default file system. Either the
literal string "local" or a host:port for NDFS.</description>
</property>
<property>
<name>mapred.job.tracker</name>
<value>srv05.xxxxx.com:50020</value>
<description>The host and port that the MapReduce job tracker runs
at. If "local", then jobs are run in-process as a single map
and reduce task.
</description>
</property>
</nutch-conf>
srv05 is my namenode and jobtracker. That server starts up the namenode
and jobtracker services just fine. Maybe I am supposed to reference
fs.default.name as srv08:50000 on srv08? I thought from reading the
mediawiki that I need to reference my BoxA on every other machine.
No firewall on this internal network so I am wondering why I am getting
a connection refused. Anyone have any ideas?
Thanks,
Mike
Tomcat with -security?
Posted by Bill Goffe <go...@Oswego.EDU>.
I would like to run Tomcat w/ the security option, so I did the following:
$CATALINA_HOME/bin/startup.sh -security
in the appropriate directory. My Nutch search page comes up fine, but a
search results in an error. The log is below. Any idea about what I might do?
FWIW, I'm running Tomcat 5.0.28.
- Bill
2005-12-14 17:26:59 StandardWrapperValve[jsp]: Servlet.service() for servlet jsp threw exception
java.lang.NoClassDefFoundError
at org.apache.jsp.search_jsp.<clinit>(search_jsp.java:29)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:274)
at java.lang.Class.newInstance0(Class.java:308)
at java.lang.Class.newInstance(Class.java:261)
at org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper.java:137)
at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:307)
at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:292)
at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:236)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:324)
at org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:239)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAsPrivileged(Subject.java:500)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:268)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:157)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.access$000(ApplicationFilterChain.java:50)
at org.apache.catalina.core.ApplicationFilterChain$1.run(ApplicationFilterChain.java:140)
at java.security.AccessController.doPrivileged(Native Method)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:214)
at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
at org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:198)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:152)
at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:137)
at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:118)
at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:535)
at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:929)
at org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:160)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:799)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:705)
at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java:577)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:683)
at java.lang.Thread.run(Thread.java:534)
--
*------------------------------------------------------*
| Bill Goffe goffe@oswego.edu |
| Department of Economics voice: (315) 312-3444 |
| SUNY Oswego fax: (315) 312-5444 |
| 416 Mahar Hall <http://cook.rfe.org> |
| Oswego, NY 13126 |
*--------*------------------------------------------------------*-----------*
| "Some predicted the disclosure would set off strong reactions from |
| governments of the target countries." |
| -- A description of how China, Russia, Iraq, North Korea, Iran, Libya |
| and Syria might feel about the revelation that the U.S. has |
| contingency plans to use nuclear weapons against them. "U.S. Works |
| Up Plan for Using Nuclear Arms," Paul Richter, LA Times, |
| March 9, 2002. |
*---------------------------------------------------------------------------*
Re: java.net.ConnectException: Connection refused
Posted by Michael Taggart <mi...@webco.tv>.
Well, that's kinda what's happening. I checked and the tasktrackers are
running like you said. However, when I follow the tutorial at
http://wiki.media-style.com/display/nutchDocu/setup+a+map+reduce+multi
+box+system
When I get to command to generate segments and check the generated
segment, the command bin/nutch ndfs -ls segments always returns 0
results. It's supposed to give me a file like 20051214001226. In
addition, that connection refused thing occurs when I try to generate
the segments to crawldb.
On Wed, 2005-12-14 at 14:02 -0800, Matt Zytaruk wrote:
> I get the same error sometimes, although everything seems to work fine
> after that, even though it gives that error, so it's probably not a problem.
>
> - Matt Zytaruk
>
>
> Michael Taggart wrote:
>
> >I've followed the steps in the media-style wiki for setting up a map
> >reduce system. I am only having one strange error when I attempt to
> >start the tasktrackers. Here is my output:
> >
> >[root@srv08 nutch]# bin/nutch-daemon.sh start tasktracker
> >starting tasktracker, logging
> >to /usr/local/nutch/nutch-root-tasktracker-srv08.xxxxx.com.log
> >051214 133808 parsing file:/usr/local/nutch/conf/nutch-default.xml
> >051214 133808 parsing file:/usr/local/nutch/conf/nutch-site.xml
> >051214 133808 Server listener on port 50050: starting
> >051214 133808 Server handler 0 on 50050: starting
> >051214 133808 Server handler 1 on 50050: starting
> >051214 133808 Server listener on port 50040: starting
> >051214 133808 Server handler 0 on 50040: starting
> >051214 133808 Server handler 1 on 50040: starting
> >java.net.ConnectException: Connection refused
> > at java.net.PlainSocketImpl.socketConnect(Native Method)
> >
> >I have configured my nutch-site.xml as follows on each box:
> >?xml version="1.0"?>
> ><?xml-stylesheet type="text/xsl" href="nutch-conf.xsl"?>
> >
> ><!-- Put site-specific property overrides in this file. -->
> >
> ><nutch-conf>
> ><property>
> > <name>fs.default.name</name>
> > <value>srv05.xxxxx.com:50000</value>
> > <description>The name of the default file system. Either the
> > literal string "local" or a host:port for NDFS.</description>
> ></property>
> ><property>
> > <name>mapred.job.tracker</name>
> > <value>srv05.xxxxx.com:50020</value>
> > <description>The host and port that the MapReduce job tracker runs
> > at. If "local", then jobs are run in-process as a single map
> > and reduce task.
> > </description>
> ></property>
> ></nutch-conf>
> >
> >srv05 is my namenode and jobtracker. That server starts up the namenode
> >and jobtracker services just fine. Maybe I am supposed to reference
> >fs.default.name as srv08:50000 on srv08? I thought from reading the
> >mediawiki that I need to reference my BoxA on every other machine.
> >No firewall on this internal network so I am wondering why I am getting
> >a connection refused. Anyone have any ideas?
> >Thanks,
> >Mike
> >
> >
> >
> >
>
Re: java.net.ConnectException: Connection refused
Posted by Matt Zytaruk <ma...@wavefire.com>.
I get the same error sometimes, although everything seems to work fine
after that, even though it gives that error, so it's probably not a problem.
- Matt Zytaruk
Michael Taggart wrote:
>I've followed the steps in the media-style wiki for setting up a map
>reduce system. I am only having one strange error when I attempt to
>start the tasktrackers. Here is my output:
>
>[root@srv08 nutch]# bin/nutch-daemon.sh start tasktracker
>starting tasktracker, logging
>to /usr/local/nutch/nutch-root-tasktracker-srv08.xxxxx.com.log
>051214 133808 parsing file:/usr/local/nutch/conf/nutch-default.xml
>051214 133808 parsing file:/usr/local/nutch/conf/nutch-site.xml
>051214 133808 Server listener on port 50050: starting
>051214 133808 Server handler 0 on 50050: starting
>051214 133808 Server handler 1 on 50050: starting
>051214 133808 Server listener on port 50040: starting
>051214 133808 Server handler 0 on 50040: starting
>051214 133808 Server handler 1 on 50040: starting
>java.net.ConnectException: Connection refused
> at java.net.PlainSocketImpl.socketConnect(Native Method)
>
>I have configured my nutch-site.xml as follows on each box:
>?xml version="1.0"?>
><?xml-stylesheet type="text/xsl" href="nutch-conf.xsl"?>
>
><!-- Put site-specific property overrides in this file. -->
>
><nutch-conf>
><property>
> <name>fs.default.name</name>
> <value>srv05.xxxxx.com:50000</value>
> <description>The name of the default file system. Either the
> literal string "local" or a host:port for NDFS.</description>
></property>
><property>
> <name>mapred.job.tracker</name>
> <value>srv05.xxxxx.com:50020</value>
> <description>The host and port that the MapReduce job tracker runs
> at. If "local", then jobs are run in-process as a single map
> and reduce task.
> </description>
></property>
></nutch-conf>
>
>srv05 is my namenode and jobtracker. That server starts up the namenode
>and jobtracker services just fine. Maybe I am supposed to reference
>fs.default.name as srv08:50000 on srv08? I thought from reading the
>mediawiki that I need to reference my BoxA on every other machine.
>No firewall on this internal network so I am wondering why I am getting
>a connection refused. Anyone have any ideas?
>Thanks,
>Mike
>
>
>
>
Re: java.net.ConnectException: Connection refused
Posted by Michael Taggart <mi...@webco.tv>.
Stefan,
I remember reading this in your tutorial so I was careful to use the
boxA.companyDomain.com format. In fact, and entry is in
the /etc/host.conf file of srv05 like this:
127.0.0.1 srv05.xxxxx.com
In addition an nslookup for srv05.xxxxx.com from the other boxes
gives me back the correct ip. So I know they can see each other. Could
it be an issue with java? Just shooting in the dark.
Mike
On Wed, 2005-12-14 at 23:56 +0100, Stefan Groschupf wrote:
> A common problem is that a boxA says to boxB my name is
> boxA.localnetwork but boxB can not connect the box with the name
> boxA.localnetwork since the name from the outside would be somthing
> like:
> boxA.companyDomain.com So double check that the name the boxA use to
> identify itself against other boxes (host.conf) is also setuped in
> the dns the other boxes use.
>
> HTH
> Stefan
>
>
> Am 14.12.2005 um 22:49 schrieb Michael Taggart:
>
> > I've followed the steps in the media-style wiki for setting up a map
> > reduce system. I am only having one strange error when I attempt to
> > start the tasktrackers. Here is my output:
> >
> > [root@srv08 nutch]# bin/nutch-daemon.sh start tasktracker
> > starting tasktracker, logging
> > to /usr/local/nutch/nutch-root-tasktracker-srv08.xxxxx.com.log
> > 051214 133808 parsing file:/usr/local/nutch/conf/nutch-default.xml
> > 051214 133808 parsing file:/usr/local/nutch/conf/nutch-site.xml
> > 051214 133808 Server listener on port 50050: starting
> > 051214 133808 Server handler 0 on 50050: starting
> > 051214 133808 Server handler 1 on 50050: starting
> > 051214 133808 Server listener on port 50040: starting
> > 051214 133808 Server handler 0 on 50040: starting
> > 051214 133808 Server handler 1 on 50040: starting
> > java.net.ConnectException: Connection refused
> > at java.net.PlainSocketImpl.socketConnect(Native Method)
> >
> > I have configured my nutch-site.xml as follows on each box:
> > ?xml version="1.0"?>
> > <?xml-stylesheet type="text/xsl" href="nutch-conf.xsl"?>
> >
> > <!-- Put site-specific property overrides in this file. -->
> >
> > <nutch-conf>
> > <property>
> > <name>fs.default.name</name>
> > <value>srv05.xxxxx.com:50000</value>
> > <description>The name of the default file system. Either the
> > literal string "local" or a host:port for NDFS.</description>
> > </property>
> > <property>
> > <name>mapred.job.tracker</name>
> > <value>srv05.xxxxx.com:50020</value>
> > <description>The host and port that the MapReduce job tracker runs
> > at. If "local", then jobs are run in-process as a single map
> > and reduce task.
> > </description>
> > </property>
> > </nutch-conf>
> >
> > srv05 is my namenode and jobtracker. That server starts up the
> > namenode
> > and jobtracker services just fine. Maybe I am supposed to reference
> > fs.default.name as srv08:50000 on srv08? I thought from reading the
> > mediawiki that I need to reference my BoxA on every other machine.
> > No firewall on this internal network so I am wondering why I am
> > getting
> > a connection refused. Anyone have any ideas?
> > Thanks,
> > Mike
> >
>
> ---------------------------------------------------------------
> company: http://www.media-style.com
> forum: http://www.text-mining.org
> blog: http://www.find23.net
>
>
Re: java.net.ConnectException: Connection refused
Posted by Michael Taggart <mi...@webco.tv>.
Marko,
Thanks for the reply. Copying that folder to my nutch installation
worked! No errors here. Can't wait to unleash the power of this program.
Thanks Again,
Mike
On Thu, 2005-12-15 at 09:42 +0100, Marko Bauhardt wrote:
> Hi Mike,
>
> > Exception in thread "main" java.lang.NullPointerException
> > at
> > org.apache.nutch.mapred.JobTrackerInfoServer.<init>
> > (JobTrackerInfoServer.java:67)
> > at
>
> This is a little bug. You must copy the src/webapps folder to the
> root path of your nutch-installation. After that the namenode works
> fine.
>
> Regards, Marko
>
Re: java.net.ConnectException: Connection refused
Posted by Marko Bauhardt <mb...@media-style.com>.
Hi Mike,
> Exception in thread "main" java.lang.NullPointerException
> at
> org.apache.nutch.mapred.JobTrackerInfoServer.<init>
> (JobTrackerInfoServer.java:67)
> at
This is a little bug. You must copy the src/webapps folder to the
root path of your nutch-installation. After that the namenode works
fine.
Regards, Marko
Re: java.net.ConnectException: Connection refused
Posted by Michael Taggart <mi...@webco.tv>.
Stefan,
As an update I am positive everything with dns is setup as it should be.
I can start the namenode service on BoxA and I can also start the
datanode service on boxes B-D. In fact, when I run a bin/nutch ndfs
-report on BoxA it shows the 3 datanodes connected and their stats.
Something is wrong with the jobtracker. Can I have the namenode also be
the jobtracker or would this cause a conflict?
Mike
On Wed, 2005-12-14 at 16:36 -0800, Michael Taggart wrote:
> Ok, I think I have boiled the problem down. Turns out the jobtracker was
> actually never running on my BoxA When I start the program I get this
> error at the end of my jobtracker-log
> Exception in thread "main" java.lang.NullPointerException
> at
> org.apache.nutch.mapred.JobTrackerInfoServer.<init>(JobTrackerInfoServer.java:67)
> at
> org.apache.nutch.mapred.JobTracker.<init>(JobTracker.java:241)
> at
> org.apache.nutch.mapred.JobTracker.startTracker(JobTracker.java:45)
> at org.apache.nutch.mapred.JobTracker.main(JobTracker.java:1070)
>
> Trying to figure out what this means now.
> On Wed, 2005-12-14 at 23:56 +0100, Stefan Groschupf wrote:
> > A common problem is that a boxA says to boxB my name is
> > boxA.localnetwork but boxB can not connect the box with the name
> > boxA.localnetwork since the name from the outside would be somthing
> > like:
> > boxA.companyDomain.com So double check that the name the boxA use to
> > identify itself against other boxes (host.conf) is also setuped in
> > the dns the other boxes use.
> >
> > HTH
> > Stefan
> >
> >
> > Am 14.12.2005 um 22:49 schrieb Michael Taggart:
> >
> > > I've followed the steps in the media-style wiki for setting up a map
> > > reduce system. I am only having one strange error when I attempt to
> > > start the tasktrackers. Here is my output:
> > >
> > > [root@srv08 nutch]# bin/nutch-daemon.sh start tasktracker
> > > starting tasktracker, logging
> > > to /usr/local/nutch/nutch-root-tasktracker-srv08.xxxxx.com.log
> > > 051214 133808 parsing file:/usr/local/nutch/conf/nutch-default.xml
> > > 051214 133808 parsing file:/usr/local/nutch/conf/nutch-site.xml
> > > 051214 133808 Server listener on port 50050: starting
> > > 051214 133808 Server handler 0 on 50050: starting
> > > 051214 133808 Server handler 1 on 50050: starting
> > > 051214 133808 Server listener on port 50040: starting
> > > 051214 133808 Server handler 0 on 50040: starting
> > > 051214 133808 Server handler 1 on 50040: starting
> > > java.net.ConnectException: Connection refused
> > > at java.net.PlainSocketImpl.socketConnect(Native Method)
> > >
> > > I have configured my nutch-site.xml as follows on each box:
> > > ?xml version="1.0"?>
> > > <?xml-stylesheet type="text/xsl" href="nutch-conf.xsl"?>
> > >
> > > <!-- Put site-specific property overrides in this file. -->
> > >
> > > <nutch-conf>
> > > <property>
> > > <name>fs.default.name</name>
> > > <value>srv05.xxxxx.com:50000</value>
> > > <description>The name of the default file system. Either the
> > > literal string "local" or a host:port for NDFS.</description>
> > > </property>
> > > <property>
> > > <name>mapred.job.tracker</name>
> > > <value>srv05.xxxxx.com:50020</value>
> > > <description>The host and port that the MapReduce job tracker runs
> > > at. If "local", then jobs are run in-process as a single map
> > > and reduce task.
> > > </description>
> > > </property>
> > > </nutch-conf>
> > >
> > > srv05 is my namenode and jobtracker. That server starts up the
> > > namenode
> > > and jobtracker services just fine. Maybe I am supposed to reference
> > > fs.default.name as srv08:50000 on srv08? I thought from reading the
> > > mediawiki that I need to reference my BoxA on every other machine.
> > > No firewall on this internal network so I am wondering why I am
> > > getting
> > > a connection refused. Anyone have any ideas?
> > > Thanks,
> > > Mike
> > >
> >
> > ---------------------------------------------------------------
> > company: http://www.media-style.com
> > forum: http://www.text-mining.org
> > blog: http://www.find23.net
> >
> >
Re: java.net.ConnectException: Connection refused
Posted by Michael Taggart <mi...@webco.tv>.
Ok, I think I have boiled the problem down. Turns out the jobtracker was
actually never running on my BoxA When I start the program I get this
error at the end of my jobtracker-log
Exception in thread "main" java.lang.NullPointerException
at
org.apache.nutch.mapred.JobTrackerInfoServer.<init>(JobTrackerInfoServer.java:67)
at
org.apache.nutch.mapred.JobTracker.<init>(JobTracker.java:241)
at
org.apache.nutch.mapred.JobTracker.startTracker(JobTracker.java:45)
at org.apache.nutch.mapred.JobTracker.main(JobTracker.java:1070)
Trying to figure out what this means now.
On Wed, 2005-12-14 at 23:56 +0100, Stefan Groschupf wrote:
> A common problem is that a boxA says to boxB my name is
> boxA.localnetwork but boxB can not connect the box with the name
> boxA.localnetwork since the name from the outside would be somthing
> like:
> boxA.companyDomain.com So double check that the name the boxA use to
> identify itself against other boxes (host.conf) is also setuped in
> the dns the other boxes use.
>
> HTH
> Stefan
>
>
> Am 14.12.2005 um 22:49 schrieb Michael Taggart:
>
> > I've followed the steps in the media-style wiki for setting up a map
> > reduce system. I am only having one strange error when I attempt to
> > start the tasktrackers. Here is my output:
> >
> > [root@srv08 nutch]# bin/nutch-daemon.sh start tasktracker
> > starting tasktracker, logging
> > to /usr/local/nutch/nutch-root-tasktracker-srv08.xxxxx.com.log
> > 051214 133808 parsing file:/usr/local/nutch/conf/nutch-default.xml
> > 051214 133808 parsing file:/usr/local/nutch/conf/nutch-site.xml
> > 051214 133808 Server listener on port 50050: starting
> > 051214 133808 Server handler 0 on 50050: starting
> > 051214 133808 Server handler 1 on 50050: starting
> > 051214 133808 Server listener on port 50040: starting
> > 051214 133808 Server handler 0 on 50040: starting
> > 051214 133808 Server handler 1 on 50040: starting
> > java.net.ConnectException: Connection refused
> > at java.net.PlainSocketImpl.socketConnect(Native Method)
> >
> > I have configured my nutch-site.xml as follows on each box:
> > ?xml version="1.0"?>
> > <?xml-stylesheet type="text/xsl" href="nutch-conf.xsl"?>
> >
> > <!-- Put site-specific property overrides in this file. -->
> >
> > <nutch-conf>
> > <property>
> > <name>fs.default.name</name>
> > <value>srv05.xxxxx.com:50000</value>
> > <description>The name of the default file system. Either the
> > literal string "local" or a host:port for NDFS.</description>
> > </property>
> > <property>
> > <name>mapred.job.tracker</name>
> > <value>srv05.xxxxx.com:50020</value>
> > <description>The host and port that the MapReduce job tracker runs
> > at. If "local", then jobs are run in-process as a single map
> > and reduce task.
> > </description>
> > </property>
> > </nutch-conf>
> >
> > srv05 is my namenode and jobtracker. That server starts up the
> > namenode
> > and jobtracker services just fine. Maybe I am supposed to reference
> > fs.default.name as srv08:50000 on srv08? I thought from reading the
> > mediawiki that I need to reference my BoxA on every other machine.
> > No firewall on this internal network so I am wondering why I am
> > getting
> > a connection refused. Anyone have any ideas?
> > Thanks,
> > Mike
> >
>
> ---------------------------------------------------------------
> company: http://www.media-style.com
> forum: http://www.text-mining.org
> blog: http://www.find23.net
>
>
Re: java.net.ConnectException: Connection refused
Posted by Stefan Groschupf <sg...@media-style.com>.
A common problem is that a boxA says to boxB my name is
boxA.localnetwork but boxB can not connect the box with the name
boxA.localnetwork since the name from the outside would be somthing
like:
boxA.companyDomain.com So double check that the name the boxA use to
identify itself against other boxes (host.conf) is also setuped in
the dns the other boxes use.
HTH
Stefan
Am 14.12.2005 um 22:49 schrieb Michael Taggart:
> I've followed the steps in the media-style wiki for setting up a map
> reduce system. I am only having one strange error when I attempt to
> start the tasktrackers. Here is my output:
>
> [root@srv08 nutch]# bin/nutch-daemon.sh start tasktracker
> starting tasktracker, logging
> to /usr/local/nutch/nutch-root-tasktracker-srv08.xxxxx.com.log
> 051214 133808 parsing file:/usr/local/nutch/conf/nutch-default.xml
> 051214 133808 parsing file:/usr/local/nutch/conf/nutch-site.xml
> 051214 133808 Server listener on port 50050: starting
> 051214 133808 Server handler 0 on 50050: starting
> 051214 133808 Server handler 1 on 50050: starting
> 051214 133808 Server listener on port 50040: starting
> 051214 133808 Server handler 0 on 50040: starting
> 051214 133808 Server handler 1 on 50040: starting
> java.net.ConnectException: Connection refused
> at java.net.PlainSocketImpl.socketConnect(Native Method)
>
> I have configured my nutch-site.xml as follows on each box:
> ?xml version="1.0"?>
> <?xml-stylesheet type="text/xsl" href="nutch-conf.xsl"?>
>
> <!-- Put site-specific property overrides in this file. -->
>
> <nutch-conf>
> <property>
> <name>fs.default.name</name>
> <value>srv05.xxxxx.com:50000</value>
> <description>The name of the default file system. Either the
> literal string "local" or a host:port for NDFS.</description>
> </property>
> <property>
> <name>mapred.job.tracker</name>
> <value>srv05.xxxxx.com:50020</value>
> <description>The host and port that the MapReduce job tracker runs
> at. If "local", then jobs are run in-process as a single map
> and reduce task.
> </description>
> </property>
> </nutch-conf>
>
> srv05 is my namenode and jobtracker. That server starts up the
> namenode
> and jobtracker services just fine. Maybe I am supposed to reference
> fs.default.name as srv08:50000 on srv08? I thought from reading the
> mediawiki that I need to reference my BoxA on every other machine.
> No firewall on this internal network so I am wondering why I am
> getting
> a connection refused. Anyone have any ideas?
> Thanks,
> Mike
>
---------------------------------------------------------------
company: http://www.media-style.com
forum: http://www.text-mining.org
blog: http://www.find23.net