You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by douxin <do...@gmail.com> on 2013/09/26 16:24:28 UTC
please HELP me with a WebHDFS problem
Hi guys,
I had a small cluster including 1 namenode and 2 datanodes
I got webhdfs enabled
and I sent an OPEN request as follow:
curl -i -L 'http://namenode:50070/webhdfs/v1/path/to/somefile?op=OPEN'
It redirected to
http://datanode:50075/webhdfs/v1/path/to/somefile?op=OPEN
what weird was that the redirected URL used "localhost" as its netloc,
the URL is like
"http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN"
I have checked the config files and I didn't figured out what
influenced it.
In addiction when I check the active data nodes via
"http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE"
The node column' datanodes' name were all "localhost"
why?
Any body knows what's going on about that?
Thanks,
Dou
Re: please HELP me with a WebHDFS problem
Posted by douxin <do...@gmail.com>.
Hi Pawar,
> can you share your /etc/hosts file ?
sure,
as below:
namenode (Fedora-19 192.168.1.217)
===============================================
#cat /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4
localhost4.localdomain4
::1 localhost localhost.localdomain localhost6
localhost6.localdomain6
192.168.1.244 hadoop1
192.168.1.248 hadoop2
192.168.1.217 Fedora-19
===============================================
datanode1 (hadoop1 192.168.1.244)
===============================================
#cat /etc/hosts
127.0.0.1 localhost
# The following lines are desirable for IPv6 capable hosts
::1 localhost ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
ff02::3 ip6-allhosts
192.168.1.217 Fedora-19
192.168.1.244 hadoop1
192.168.1.248 hadoop2
===============================================
datanode2 (hadoop2 192.168.1.248)
===============================================
#cat /etc/hosts
127.0.0.1 localhost
# The following lines are desirable for IPv6 capable hosts
::1 localhost ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
ff02::3 ip6-allhosts
192.168.1.217 Fedora-19
192.168.1.244 hadoop1
192.168.1.248 hadoop2
===============================================
Cheers,
Dou
>
>
> On Thu, Sep 26, 2013 at 7:54 PM, douxin <do...@gmail.com> wrote:
>
>> Hi guys,
>>
>> I had a small cluster including 1 namenode and 2 datanodes
>>
>> I got webhdfs enabled
>>
>> and I sent an OPEN request as follow:
>> curl -i -L 'http://namenode:50070/webhdfs/v1/path/to/somefile?op=OPEN'
>>
>> It redirected to
>> http://datanode:50075/webhdfs/v1/path/to/somefile?op=OPEN
>> what weird was that the redirected URL used "localhost" as its netloc,
>> the URL is like
>> "http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN"<http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN>
>> I have checked the config files and I didn't figured out what influenced
>> it.
>>
>> In addiction when I check the active data nodes via
>> "http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE"<http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE>
>> The node column' datanodes' name were all "localhost"
>> why?
>>
>> Any body knows what's going on about that?
>>
>> Thanks,
>> Dou
>>
>>
>>
>
Re: please HELP me with a WebHDFS problem
Posted by douxin <do...@gmail.com>.
Hi Pawar,
> can you share your /etc/hosts file ?
sure,
as below:
namenode (Fedora-19 192.168.1.217)
===============================================
#cat /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4
localhost4.localdomain4
::1 localhost localhost.localdomain localhost6
localhost6.localdomain6
192.168.1.244 hadoop1
192.168.1.248 hadoop2
192.168.1.217 Fedora-19
===============================================
datanode1 (hadoop1 192.168.1.244)
===============================================
#cat /etc/hosts
127.0.0.1 localhost
# The following lines are desirable for IPv6 capable hosts
::1 localhost ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
ff02::3 ip6-allhosts
192.168.1.217 Fedora-19
192.168.1.244 hadoop1
192.168.1.248 hadoop2
===============================================
datanode2 (hadoop2 192.168.1.248)
===============================================
#cat /etc/hosts
127.0.0.1 localhost
# The following lines are desirable for IPv6 capable hosts
::1 localhost ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
ff02::3 ip6-allhosts
192.168.1.217 Fedora-19
192.168.1.244 hadoop1
192.168.1.248 hadoop2
===============================================
Cheers,
Dou
>
>
> On Thu, Sep 26, 2013 at 7:54 PM, douxin <do...@gmail.com> wrote:
>
>> Hi guys,
>>
>> I had a small cluster including 1 namenode and 2 datanodes
>>
>> I got webhdfs enabled
>>
>> and I sent an OPEN request as follow:
>> curl -i -L 'http://namenode:50070/webhdfs/v1/path/to/somefile?op=OPEN'
>>
>> It redirected to
>> http://datanode:50075/webhdfs/v1/path/to/somefile?op=OPEN
>> what weird was that the redirected URL used "localhost" as its netloc,
>> the URL is like
>> "http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN"<http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN>
>> I have checked the config files and I didn't figured out what influenced
>> it.
>>
>> In addiction when I check the active data nodes via
>> "http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE"<http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE>
>> The node column' datanodes' name were all "localhost"
>> why?
>>
>> Any body knows what's going on about that?
>>
>> Thanks,
>> Dou
>>
>>
>>
>
Re: please HELP me with a WebHDFS problem
Posted by douxin <do...@gmail.com>.
Hi Pawar,
> can you share your /etc/hosts file ?
sure,
as below:
namenode (Fedora-19 192.168.1.217)
===============================================
#cat /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4
localhost4.localdomain4
::1 localhost localhost.localdomain localhost6
localhost6.localdomain6
192.168.1.244 hadoop1
192.168.1.248 hadoop2
192.168.1.217 Fedora-19
===============================================
datanode1 (hadoop1 192.168.1.244)
===============================================
#cat /etc/hosts
127.0.0.1 localhost
# The following lines are desirable for IPv6 capable hosts
::1 localhost ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
ff02::3 ip6-allhosts
192.168.1.217 Fedora-19
192.168.1.244 hadoop1
192.168.1.248 hadoop2
===============================================
datanode2 (hadoop2 192.168.1.248)
===============================================
#cat /etc/hosts
127.0.0.1 localhost
# The following lines are desirable for IPv6 capable hosts
::1 localhost ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
ff02::3 ip6-allhosts
192.168.1.217 Fedora-19
192.168.1.244 hadoop1
192.168.1.248 hadoop2
===============================================
Cheers,
Dou
>
>
> On Thu, Sep 26, 2013 at 7:54 PM, douxin <do...@gmail.com> wrote:
>
>> Hi guys,
>>
>> I had a small cluster including 1 namenode and 2 datanodes
>>
>> I got webhdfs enabled
>>
>> and I sent an OPEN request as follow:
>> curl -i -L 'http://namenode:50070/webhdfs/v1/path/to/somefile?op=OPEN'
>>
>> It redirected to
>> http://datanode:50075/webhdfs/v1/path/to/somefile?op=OPEN
>> what weird was that the redirected URL used "localhost" as its netloc,
>> the URL is like
>> "http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN"<http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN>
>> I have checked the config files and I didn't figured out what influenced
>> it.
>>
>> In addiction when I check the active data nodes via
>> "http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE"<http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE>
>> The node column' datanodes' name were all "localhost"
>> why?
>>
>> Any body knows what's going on about that?
>>
>> Thanks,
>> Dou
>>
>>
>>
>
Re: please HELP me with a WebHDFS problem
Posted by douxin <do...@gmail.com>.
Hi Pawar,
> can you share your /etc/hosts file ?
sure,
as below:
namenode (Fedora-19 192.168.1.217)
===============================================
#cat /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4
localhost4.localdomain4
::1 localhost localhost.localdomain localhost6
localhost6.localdomain6
192.168.1.244 hadoop1
192.168.1.248 hadoop2
192.168.1.217 Fedora-19
===============================================
datanode1 (hadoop1 192.168.1.244)
===============================================
#cat /etc/hosts
127.0.0.1 localhost
# The following lines are desirable for IPv6 capable hosts
::1 localhost ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
ff02::3 ip6-allhosts
192.168.1.217 Fedora-19
192.168.1.244 hadoop1
192.168.1.248 hadoop2
===============================================
datanode2 (hadoop2 192.168.1.248)
===============================================
#cat /etc/hosts
127.0.0.1 localhost
# The following lines are desirable for IPv6 capable hosts
::1 localhost ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
ff02::3 ip6-allhosts
192.168.1.217 Fedora-19
192.168.1.244 hadoop1
192.168.1.248 hadoop2
===============================================
Cheers,
Dou
>
>
> On Thu, Sep 26, 2013 at 7:54 PM, douxin <do...@gmail.com> wrote:
>
>> Hi guys,
>>
>> I had a small cluster including 1 namenode and 2 datanodes
>>
>> I got webhdfs enabled
>>
>> and I sent an OPEN request as follow:
>> curl -i -L 'http://namenode:50070/webhdfs/v1/path/to/somefile?op=OPEN'
>>
>> It redirected to
>> http://datanode:50075/webhdfs/v1/path/to/somefile?op=OPEN
>> what weird was that the redirected URL used "localhost" as its netloc,
>> the URL is like
>> "http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN"<http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN>
>> I have checked the config files and I didn't figured out what influenced
>> it.
>>
>> In addiction when I check the active data nodes via
>> "http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE"<http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE>
>> The node column' datanodes' name were all "localhost"
>> why?
>>
>> Any body knows what's going on about that?
>>
>> Thanks,
>> Dou
>>
>>
>>
>
Re: please HELP me with a WebHDFS problem
Posted by Nitin Pawar <ni...@gmail.com>.
can you share your /etc/hosts file ?
On Thu, Sep 26, 2013 at 7:54 PM, douxin <do...@gmail.com> wrote:
> Hi guys,
>
> I had a small cluster including 1 namenode and 2 datanodes
>
> I got webhdfs enabled
>
> and I sent an OPEN request as follow:
> curl -i -L 'http://namenode:50070/webhdfs/v1/path/to/somefile?op=OPEN'
>
> It redirected to
> http://datanode:50075/webhdfs/v1/path/to/somefile?op=OPEN
> what weird was that the redirected URL used "localhost" as its netloc,
> the URL is like
> "http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN"<http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN>
> I have checked the config files and I didn't figured out what influenced
> it.
>
> In addiction when I check the active data nodes via
> "http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE"<http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE>
> The node column' datanodes' name were all "localhost"
> why?
>
> Any body knows what's going on about that?
>
> Thanks,
> Dou
>
>
>
--
Nitin Pawar
Re: please HELP me with a WebHDFS problem
Posted by Nitin Pawar <ni...@gmail.com>.
can you share your /etc/hosts file ?
On Thu, Sep 26, 2013 at 7:54 PM, douxin <do...@gmail.com> wrote:
> Hi guys,
>
> I had a small cluster including 1 namenode and 2 datanodes
>
> I got webhdfs enabled
>
> and I sent an OPEN request as follow:
> curl -i -L 'http://namenode:50070/webhdfs/v1/path/to/somefile?op=OPEN'
>
> It redirected to
> http://datanode:50075/webhdfs/v1/path/to/somefile?op=OPEN
> what weird was that the redirected URL used "localhost" as its netloc,
> the URL is like
> "http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN"<http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN>
> I have checked the config files and I didn't figured out what influenced
> it.
>
> In addiction when I check the active data nodes via
> "http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE"<http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE>
> The node column' datanodes' name were all "localhost"
> why?
>
> Any body knows what's going on about that?
>
> Thanks,
> Dou
>
>
>
--
Nitin Pawar
Re: please HELP me with a WebHDFS problem
Posted by Nitin Pawar <ni...@gmail.com>.
can you share your /etc/hosts file ?
On Thu, Sep 26, 2013 at 7:54 PM, douxin <do...@gmail.com> wrote:
> Hi guys,
>
> I had a small cluster including 1 namenode and 2 datanodes
>
> I got webhdfs enabled
>
> and I sent an OPEN request as follow:
> curl -i -L 'http://namenode:50070/webhdfs/v1/path/to/somefile?op=OPEN'
>
> It redirected to
> http://datanode:50075/webhdfs/v1/path/to/somefile?op=OPEN
> what weird was that the redirected URL used "localhost" as its netloc,
> the URL is like
> "http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN"<http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN>
> I have checked the config files and I didn't figured out what influenced
> it.
>
> In addiction when I check the active data nodes via
> "http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE"<http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE>
> The node column' datanodes' name were all "localhost"
> why?
>
> Any body knows what's going on about that?
>
> Thanks,
> Dou
>
>
>
--
Nitin Pawar
Re: please HELP me with a WebHDFS problem
Posted by Nitin Pawar <ni...@gmail.com>.
can you share your /etc/hosts file ?
On Thu, Sep 26, 2013 at 7:54 PM, douxin <do...@gmail.com> wrote:
> Hi guys,
>
> I had a small cluster including 1 namenode and 2 datanodes
>
> I got webhdfs enabled
>
> and I sent an OPEN request as follow:
> curl -i -L 'http://namenode:50070/webhdfs/v1/path/to/somefile?op=OPEN'
>
> It redirected to
> http://datanode:50075/webhdfs/v1/path/to/somefile?op=OPEN
> what weird was that the redirected URL used "localhost" as its netloc,
> the URL is like
> "http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN"<http://localhost:50075/webhdfs/v1/path/to/somefile?op=OPEN>
> I have checked the config files and I didn't figured out what influenced
> it.
>
> In addiction when I check the active data nodes via
> "http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE"<http://namenode:50070/dfsnodelist.jsp?whatNodes=LIVE>
> The node column' datanodes' name were all "localhost"
> why?
>
> Any body knows what's going on about that?
>
> Thanks,
> Dou
>
>
>
--
Nitin Pawar