You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Mark Kerzner <ma...@gmail.com> on 2011/01/14 02:02:07 UTC
cannot connect from slaves
Hi,
my list file command
hadoop fs -ls hdfs://master-url/
works locally on the master, but cannot connect from any of the slaves.
What should I check for?
Thank you,
Mark
Re: cannot connect from slaves
Posted by Mark Kerzner <ma...@gmail.com>.
Yes
On Jan 13, 2011 7:36 PM, "Zhang Jianfeng" <jz...@gmail.com> wrote:
> Can you connect the other slaves by ssh or ping cmd?
>
> On Fri, Jan 14, 2011 at 9:02 AM, Mark Kerzner <ma...@gmail.com>
wrote:
>
>> Hi,
>>
>> my list file command
>>
>> hadoop fs -ls hdfs://master-url/
>>
>> works locally on the master, but cannot connect from any of the slaves.
>>
>> What should I check for?
>>
>> Thank you,
>> Mark
>>
Re: cannot connect from slaves
Posted by Zhang Jianfeng <jz...@gmail.com>.
Can you connect the other slaves by ssh or ping cmd?
On Fri, Jan 14, 2011 at 9:02 AM, Mark Kerzner <ma...@gmail.com> wrote:
> Hi,
>
> my list file command
>
> hadoop fs -ls hdfs://master-url/
>
> works locally on the master, but cannot connect from any of the slaves.
>
> What should I check for?
>
> Thank you,
> Mark
>
Re: cannot connect from slaves
Posted by Mark Kerzner <ma...@gmail.com>.
probably that's what it was - since with the network change it finally
connects
On Thu, Jan 13, 2011 at 10:44 PM, rishi pathak <ma...@gmail.com>wrote:
> Hello,
> It can be a firewall issue. Try telnet from master and from
> slaves and see:
>
> (master)# telnet master 8020
>
> and
> (slave)# telnet master 8020
>
>
> On Fri, Jan 14, 2011 at 8:19 AM, Mark Kerzner <ma...@gmail.com>
> wrote:
>
> > I did this, and tried both ways:
> >
> > hadoop fs -ls /
> > 11/01/14 02:45:25 INFO ipc.Client: Retrying connect to server: /
> > 10.113.118.244:8020. Already tried 0 time(s).
> > 11/01/14 02:45:29 INFO ipc.Client: Retrying connect to server: /
> > 10.113.118.244:8020. Already tried 1 time(s).
> >
> > and
> >
> > hadoop fs -ls hdfs://10.113.118.244/
> > 11/01/14 02:48:56 INFO ipc.Client: Retrying connect to server: /
> > 10.113.118.244:8020. Already tried 0 time(s).
> >
> > I am suspecting the port 8020 - how do I test it outside of hadoop?
> >
> > Thank you,
> > Mark
> >
> > On Thu, Jan 13, 2011 at 8:29 PM, George Datskos <
> > george.datskos@jp.fujitsu.com> wrote:
> >
> > > Hello
> > >
> > >
> > > On 2011/01/14 10:02, Mark Kerzner wrote:
> > >
> > >> hadoop fs -ls hdfs://master-url/
> > >>
> > >> works locally on the master, but cannot connect from any of the
> slaves.
> > >>
> > >
> > > Make sure to replicate conf/core-site.xml to each of the slaves. The
> > > fs.default.name property should point to the master node. That way
> the
> > > slaves know how to reach the NameNode.
> > >
> > > <name>fs.default.name</name>
> > > <value>hdfs://master:8020</value>
> > >
> > >
> > > (adjust the host name and port as necessary)
> > >
> > >
> > > George
> > >
> > >
> >
>
>
>
> --
> Regards--
> Rishi Pathak
> National PARAM Supercomputing Facility
> Center for Development of Advanced Computing(C-DAC)
> Pune University Campus,Ganesh Khind Road
> Pune-Maharastra
>
Re: cannot connect from slaves
Posted by rishi pathak <ma...@gmail.com>.
Hello,
It can be a firewall issue. Try telnet from master and from
slaves and see:
(master)# telnet master 8020
and
(slave)# telnet master 8020
On Fri, Jan 14, 2011 at 8:19 AM, Mark Kerzner <ma...@gmail.com> wrote:
> I did this, and tried both ways:
>
> hadoop fs -ls /
> 11/01/14 02:45:25 INFO ipc.Client: Retrying connect to server: /
> 10.113.118.244:8020. Already tried 0 time(s).
> 11/01/14 02:45:29 INFO ipc.Client: Retrying connect to server: /
> 10.113.118.244:8020. Already tried 1 time(s).
>
> and
>
> hadoop fs -ls hdfs://10.113.118.244/
> 11/01/14 02:48:56 INFO ipc.Client: Retrying connect to server: /
> 10.113.118.244:8020. Already tried 0 time(s).
>
> I am suspecting the port 8020 - how do I test it outside of hadoop?
>
> Thank you,
> Mark
>
> On Thu, Jan 13, 2011 at 8:29 PM, George Datskos <
> george.datskos@jp.fujitsu.com> wrote:
>
> > Hello
> >
> >
> > On 2011/01/14 10:02, Mark Kerzner wrote:
> >
> >> hadoop fs -ls hdfs://master-url/
> >>
> >> works locally on the master, but cannot connect from any of the slaves.
> >>
> >
> > Make sure to replicate conf/core-site.xml to each of the slaves. The
> > fs.default.name property should point to the master node. That way the
> > slaves know how to reach the NameNode.
> >
> > <name>fs.default.name</name>
> > <value>hdfs://master:8020</value>
> >
> >
> > (adjust the host name and port as necessary)
> >
> >
> > George
> >
> >
>
--
Regards--
Rishi Pathak
National PARAM Supercomputing Facility
Center for Development of Advanced Computing(C-DAC)
Pune University Campus,Ganesh Khind Road
Pune-Maharastra
Re: cannot connect from slaves
Posted by Mark Kerzner <ma...@gmail.com>.
I did this, and tried both ways:
hadoop fs -ls /
11/01/14 02:45:25 INFO ipc.Client: Retrying connect to server: /
10.113.118.244:8020. Already tried 0 time(s).
11/01/14 02:45:29 INFO ipc.Client: Retrying connect to server: /
10.113.118.244:8020. Already tried 1 time(s).
and
hadoop fs -ls hdfs://10.113.118.244/
11/01/14 02:48:56 INFO ipc.Client: Retrying connect to server: /
10.113.118.244:8020. Already tried 0 time(s).
I am suspecting the port 8020 - how do I test it outside of hadoop?
Thank you,
Mark
On Thu, Jan 13, 2011 at 8:29 PM, George Datskos <
george.datskos@jp.fujitsu.com> wrote:
> Hello
>
>
> On 2011/01/14 10:02, Mark Kerzner wrote:
>
>> hadoop fs -ls hdfs://master-url/
>>
>> works locally on the master, but cannot connect from any of the slaves.
>>
>
> Make sure to replicate conf/core-site.xml to each of the slaves. The
> fs.default.name property should point to the master node. That way the
> slaves know how to reach the NameNode.
>
> <name>fs.default.name</name>
> <value>hdfs://master:8020</value>
>
>
> (adjust the host name and port as necessary)
>
>
> George
>
>
Re: cannot connect from slaves
Posted by George Datskos <ge...@jp.fujitsu.com>.
Hello
On 2011/01/14 10:02, Mark Kerzner wrote:
> hadoop fs -ls hdfs://master-url/
>
> works locally on the master, but cannot connect from any of the slaves.
Make sure to replicate conf/core-site.xml to each of the slaves. The
fs.default.name property should point to the master node. That way the
slaves know how to reach the NameNode.
<name>fs.default.name</name>
<value>hdfs://master:8020</value>
(adjust the host name and port as necessary)
George