You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Kun Ren <re...@gmail.com> on 2016/04/28 02:30:16 UTC
HDFS Federation
Hi Genius,
I have two questions about the HDFS Federation:
(1) Since there are multiple namenodes, there should be some code that
analysis the client request and transfer the request to the appropriate
namenode, could you please point to me where I can find the related code?
(2) .Also just confirm that the Hadoop 2.7.2 support HDFS Federation, but
in default there is only 1 namenode, is this correct? Meanwhile, do you
think it is possible to configure the HDFS Fderation in the pseudo
distributed mode in one node?
Thanks so much in advance.
Best,
Kun Ren
Re: HDFS Federation
Posted by Kun Ren <re...@gmail.com>.
Thanks a lot.
On Fri, Apr 29, 2016 at 2:32 PM, Akira AJISAKA <aj...@oss.nttdata.co.jp>
wrote:
> > Do you know where is the 50070 come form or where to set it?
>
> 50070 comes from "dfs.namenode.http-address".
> You can set this in hdfs-site.xml.
>
> > If I configure the Federation in one node, I probably will change this,
> right?
> No. If you configure NameNode federation, you need to set
> "dfs.nameservices" and "dfs.namenode.http-address.<nameservice ID>".
> Please see
> https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/Federation.html
> for the detail.
>
> -Akira
>
> On 4/28/16 22:48, Kun Ren wrote:
>
>> Thanks a lot, Akira.
>>
>> When the Federation is disabled, I can view the namenode from
>> http://localhost:50070
>>
>> Do you know where is the 50070 come form or where to set it? If I
>> configure the Federation in one node, I probably will change this, right?
>>
>> Thanks a lot.
>>
>> On Thu, Apr 28, 2016 at 1:55 AM, Akira AJISAKA
>> <ajisakaa@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>>
>> Hi Kun,
>>
>> (1) ViewFileSystem is related.
>>
>> https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/ViewFs.html
>>
>> (2) Yes, NameNode Federation is disabled by default.
>> I suppose it is possible to configure NameNode Federation in one
>> node by setting different HTTP/RPC port and fsimage/edits directory
>> for each NameNode. I haven't tried this, so perhaps it is not
>> possible.
>>
>> Regards,
>> Akira
>>
>> On 4/28/16 09:30, Kun Ren wrote:
>>
>> Hi Genius,
>>
>> I have two questions about the HDFS Federation:
>> (1) Since there are multiple namenodes, there should be some
>> code that
>> analysis the client request and transfer the request to the
>> appropriate
>> namenode, could you please point to me where I can find the
>> related code?
>>
>> (2) .Also just confirm that the Hadoop 2.7.2 support HDFS
>> Federation,
>> but in default there is only 1 namenode, is this correct?
>> Meanwhile, do
>> you think it is possible to configure the HDFS Fderation in the
>> pseudo
>> distributed mode in one node?
>>
>> Thanks so much in advance.
>>
>> Best,
>> Kun Ren
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
>> <ma...@hadoop.apache.org>
>> For additional commands, e-mail: user-help@hadoop.apache.org
>> <ma...@hadoop.apache.org>
>>
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: user-help@hadoop.apache.org
>
>
Re: HDFS Federation
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
> Do you know where is the 50070 come form or where to set it?
50070 comes from "dfs.namenode.http-address".
You can set this in hdfs-site.xml.
> If I configure the Federation in one node, I probably will change
this, right?
No. If you configure NameNode federation, you need to set
"dfs.nameservices" and "dfs.namenode.http-address.<nameservice ID>".
Please see
https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/Federation.html
for the detail.
-Akira
On 4/28/16 22:48, Kun Ren wrote:
> Thanks a lot, Akira.
>
> When the Federation is disabled, I can view the namenode from
> http://localhost:50070
>
> Do you know where is the 50070 come form or where to set it? If I
> configure the Federation in one node, I probably will change this, right?
>
> Thanks a lot.
>
> On Thu, Apr 28, 2016 at 1:55 AM, Akira AJISAKA
> <ajisakaa@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Hi Kun,
>
> (1) ViewFileSystem is related.
> https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/ViewFs.html
>
> (2) Yes, NameNode Federation is disabled by default.
> I suppose it is possible to configure NameNode Federation in one
> node by setting different HTTP/RPC port and fsimage/edits directory
> for each NameNode. I haven't tried this, so perhaps it is not possible.
>
> Regards,
> Akira
>
> On 4/28/16 09:30, Kun Ren wrote:
>
> Hi Genius,
>
> I have two questions about the HDFS Federation:
> (1) Since there are multiple namenodes, there should be some
> code that
> analysis the client request and transfer the request to the
> appropriate
> namenode, could you please point to me where I can find the
> related code?
>
> (2) .Also just confirm that the Hadoop 2.7.2 support HDFS
> Federation,
> but in default there is only 1 namenode, is this correct?
> Meanwhile, do
> you think it is possible to configure the HDFS Fderation in the
> pseudo
> distributed mode in one node?
>
> Thanks so much in advance.
>
> Best,
> Kun Ren
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
> <ma...@hadoop.apache.org>
> For additional commands, e-mail: user-help@hadoop.apache.org
> <ma...@hadoop.apache.org>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org
Re: HDFS Federation
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
> Do you know where is the 50070 come form or where to set it?
50070 comes from "dfs.namenode.http-address".
You can set this in hdfs-site.xml.
> If I configure the Federation in one node, I probably will change
this, right?
No. If you configure NameNode federation, you need to set
"dfs.nameservices" and "dfs.namenode.http-address.<nameservice ID>".
Please see
https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/Federation.html
for the detail.
-Akira
On 4/28/16 22:48, Kun Ren wrote:
> Thanks a lot, Akira.
>
> When the Federation is disabled, I can view the namenode from
> http://localhost:50070
>
> Do you know where is the 50070 come form or where to set it? If I
> configure the Federation in one node, I probably will change this, right?
>
> Thanks a lot.
>
> On Thu, Apr 28, 2016 at 1:55 AM, Akira AJISAKA
> <ajisakaa@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Hi Kun,
>
> (1) ViewFileSystem is related.
> https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/ViewFs.html
>
> (2) Yes, NameNode Federation is disabled by default.
> I suppose it is possible to configure NameNode Federation in one
> node by setting different HTTP/RPC port and fsimage/edits directory
> for each NameNode. I haven't tried this, so perhaps it is not possible.
>
> Regards,
> Akira
>
> On 4/28/16 09:30, Kun Ren wrote:
>
> Hi Genius,
>
> I have two questions about the HDFS Federation:
> (1) Since there are multiple namenodes, there should be some
> code that
> analysis the client request and transfer the request to the
> appropriate
> namenode, could you please point to me where I can find the
> related code?
>
> (2) .Also just confirm that the Hadoop 2.7.2 support HDFS
> Federation,
> but in default there is only 1 namenode, is this correct?
> Meanwhile, do
> you think it is possible to configure the HDFS Fderation in the
> pseudo
> distributed mode in one node?
>
> Thanks so much in advance.
>
> Best,
> Kun Ren
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
> <ma...@hadoop.apache.org>
> For additional commands, e-mail: user-help@hadoop.apache.org
> <ma...@hadoop.apache.org>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org
Re: HDFS Federation
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
> Do you know where is the 50070 come form or where to set it?
50070 comes from "dfs.namenode.http-address".
You can set this in hdfs-site.xml.
> If I configure the Federation in one node, I probably will change
this, right?
No. If you configure NameNode federation, you need to set
"dfs.nameservices" and "dfs.namenode.http-address.<nameservice ID>".
Please see
https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/Federation.html
for the detail.
-Akira
On 4/28/16 22:48, Kun Ren wrote:
> Thanks a lot, Akira.
>
> When the Federation is disabled, I can view the namenode from
> http://localhost:50070
>
> Do you know where is the 50070 come form or where to set it? If I
> configure the Federation in one node, I probably will change this, right?
>
> Thanks a lot.
>
> On Thu, Apr 28, 2016 at 1:55 AM, Akira AJISAKA
> <ajisakaa@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Hi Kun,
>
> (1) ViewFileSystem is related.
> https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/ViewFs.html
>
> (2) Yes, NameNode Federation is disabled by default.
> I suppose it is possible to configure NameNode Federation in one
> node by setting different HTTP/RPC port and fsimage/edits directory
> for each NameNode. I haven't tried this, so perhaps it is not possible.
>
> Regards,
> Akira
>
> On 4/28/16 09:30, Kun Ren wrote:
>
> Hi Genius,
>
> I have two questions about the HDFS Federation:
> (1) Since there are multiple namenodes, there should be some
> code that
> analysis the client request and transfer the request to the
> appropriate
> namenode, could you please point to me where I can find the
> related code?
>
> (2) .Also just confirm that the Hadoop 2.7.2 support HDFS
> Federation,
> but in default there is only 1 namenode, is this correct?
> Meanwhile, do
> you think it is possible to configure the HDFS Fderation in the
> pseudo
> distributed mode in one node?
>
> Thanks so much in advance.
>
> Best,
> Kun Ren
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
> <ma...@hadoop.apache.org>
> For additional commands, e-mail: user-help@hadoop.apache.org
> <ma...@hadoop.apache.org>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org
Re: HDFS Federation
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
> Do you know where is the 50070 come form or where to set it?
50070 comes from "dfs.namenode.http-address".
You can set this in hdfs-site.xml.
> If I configure the Federation in one node, I probably will change
this, right?
No. If you configure NameNode federation, you need to set
"dfs.nameservices" and "dfs.namenode.http-address.<nameservice ID>".
Please see
https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/Federation.html
for the detail.
-Akira
On 4/28/16 22:48, Kun Ren wrote:
> Thanks a lot, Akira.
>
> When the Federation is disabled, I can view the namenode from
> http://localhost:50070
>
> Do you know where is the 50070 come form or where to set it? If I
> configure the Federation in one node, I probably will change this, right?
>
> Thanks a lot.
>
> On Thu, Apr 28, 2016 at 1:55 AM, Akira AJISAKA
> <ajisakaa@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Hi Kun,
>
> (1) ViewFileSystem is related.
> https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/ViewFs.html
>
> (2) Yes, NameNode Federation is disabled by default.
> I suppose it is possible to configure NameNode Federation in one
> node by setting different HTTP/RPC port and fsimage/edits directory
> for each NameNode. I haven't tried this, so perhaps it is not possible.
>
> Regards,
> Akira
>
> On 4/28/16 09:30, Kun Ren wrote:
>
> Hi Genius,
>
> I have two questions about the HDFS Federation:
> (1) Since there are multiple namenodes, there should be some
> code that
> analysis the client request and transfer the request to the
> appropriate
> namenode, could you please point to me where I can find the
> related code?
>
> (2) .Also just confirm that the Hadoop 2.7.2 support HDFS
> Federation,
> but in default there is only 1 namenode, is this correct?
> Meanwhile, do
> you think it is possible to configure the HDFS Fderation in the
> pseudo
> distributed mode in one node?
>
> Thanks so much in advance.
>
> Best,
> Kun Ren
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
> <ma...@hadoop.apache.org>
> For additional commands, e-mail: user-help@hadoop.apache.org
> <ma...@hadoop.apache.org>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org
Re: HDFS Federation
Posted by Kun Ren <re...@gmail.com>.
Thanks a lot, Akira.
When the Federation is disabled, I can view the namenode from
http://localhost:50070
Do you know where is the 50070 come form or where to set it? If I configure
the Federation in one node, I probably will change this, right?
Thanks a lot.
On Thu, Apr 28, 2016 at 1:55 AM, Akira AJISAKA <aj...@oss.nttdata.co.jp>
wrote:
> Hi Kun,
>
> (1) ViewFileSystem is related.
>
> https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/ViewFs.html
>
> (2) Yes, NameNode Federation is disabled by default.
> I suppose it is possible to configure NameNode Federation in one node by
> setting different HTTP/RPC port and fsimage/edits directory for each
> NameNode. I haven't tried this, so perhaps it is not possible.
>
> Regards,
> Akira
>
> On 4/28/16 09:30, Kun Ren wrote:
>
>> Hi Genius,
>>
>> I have two questions about the HDFS Federation:
>> (1) Since there are multiple namenodes, there should be some code that
>> analysis the client request and transfer the request to the appropriate
>> namenode, could you please point to me where I can find the related code?
>>
>> (2) .Also just confirm that the Hadoop 2.7.2 support HDFS Federation,
>> but in default there is only 1 namenode, is this correct? Meanwhile, do
>> you think it is possible to configure the HDFS Fderation in the pseudo
>> distributed mode in one node?
>>
>> Thanks so much in advance.
>>
>> Best,
>> Kun Ren
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: user-help@hadoop.apache.org
>
>
Re: HDFS Federation
Posted by Kun Ren <re...@gmail.com>.
Thanks a lot, Akira.
When the Federation is disabled, I can view the namenode from
http://localhost:50070
Do you know where is the 50070 come form or where to set it? If I configure
the Federation in one node, I probably will change this, right?
Thanks a lot.
On Thu, Apr 28, 2016 at 1:55 AM, Akira AJISAKA <aj...@oss.nttdata.co.jp>
wrote:
> Hi Kun,
>
> (1) ViewFileSystem is related.
>
> https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/ViewFs.html
>
> (2) Yes, NameNode Federation is disabled by default.
> I suppose it is possible to configure NameNode Federation in one node by
> setting different HTTP/RPC port and fsimage/edits directory for each
> NameNode. I haven't tried this, so perhaps it is not possible.
>
> Regards,
> Akira
>
> On 4/28/16 09:30, Kun Ren wrote:
>
>> Hi Genius,
>>
>> I have two questions about the HDFS Federation:
>> (1) Since there are multiple namenodes, there should be some code that
>> analysis the client request and transfer the request to the appropriate
>> namenode, could you please point to me where I can find the related code?
>>
>> (2) .Also just confirm that the Hadoop 2.7.2 support HDFS Federation,
>> but in default there is only 1 namenode, is this correct? Meanwhile, do
>> you think it is possible to configure the HDFS Fderation in the pseudo
>> distributed mode in one node?
>>
>> Thanks so much in advance.
>>
>> Best,
>> Kun Ren
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: user-help@hadoop.apache.org
>
>
Re: HDFS Federation
Posted by Kun Ren <re...@gmail.com>.
Thanks a lot, Akira.
When the Federation is disabled, I can view the namenode from
http://localhost:50070
Do you know where is the 50070 come form or where to set it? If I configure
the Federation in one node, I probably will change this, right?
Thanks a lot.
On Thu, Apr 28, 2016 at 1:55 AM, Akira AJISAKA <aj...@oss.nttdata.co.jp>
wrote:
> Hi Kun,
>
> (1) ViewFileSystem is related.
>
> https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/ViewFs.html
>
> (2) Yes, NameNode Federation is disabled by default.
> I suppose it is possible to configure NameNode Federation in one node by
> setting different HTTP/RPC port and fsimage/edits directory for each
> NameNode. I haven't tried this, so perhaps it is not possible.
>
> Regards,
> Akira
>
> On 4/28/16 09:30, Kun Ren wrote:
>
>> Hi Genius,
>>
>> I have two questions about the HDFS Federation:
>> (1) Since there are multiple namenodes, there should be some code that
>> analysis the client request and transfer the request to the appropriate
>> namenode, could you please point to me where I can find the related code?
>>
>> (2) .Also just confirm that the Hadoop 2.7.2 support HDFS Federation,
>> but in default there is only 1 namenode, is this correct? Meanwhile, do
>> you think it is possible to configure the HDFS Fderation in the pseudo
>> distributed mode in one node?
>>
>> Thanks so much in advance.
>>
>> Best,
>> Kun Ren
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: user-help@hadoop.apache.org
>
>
Re: HDFS Federation
Posted by Kun Ren <re...@gmail.com>.
Thanks a lot, Akira.
When the Federation is disabled, I can view the namenode from
http://localhost:50070
Do you know where is the 50070 come form or where to set it? If I configure
the Federation in one node, I probably will change this, right?
Thanks a lot.
On Thu, Apr 28, 2016 at 1:55 AM, Akira AJISAKA <aj...@oss.nttdata.co.jp>
wrote:
> Hi Kun,
>
> (1) ViewFileSystem is related.
>
> https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/ViewFs.html
>
> (2) Yes, NameNode Federation is disabled by default.
> I suppose it is possible to configure NameNode Federation in one node by
> setting different HTTP/RPC port and fsimage/edits directory for each
> NameNode. I haven't tried this, so perhaps it is not possible.
>
> Regards,
> Akira
>
> On 4/28/16 09:30, Kun Ren wrote:
>
>> Hi Genius,
>>
>> I have two questions about the HDFS Federation:
>> (1) Since there are multiple namenodes, there should be some code that
>> analysis the client request and transfer the request to the appropriate
>> namenode, could you please point to me where I can find the related code?
>>
>> (2) .Also just confirm that the Hadoop 2.7.2 support HDFS Federation,
>> but in default there is only 1 namenode, is this correct? Meanwhile, do
>> you think it is possible to configure the HDFS Fderation in the pseudo
>> distributed mode in one node?
>>
>> Thanks so much in advance.
>>
>> Best,
>> Kun Ren
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: user-help@hadoop.apache.org
>
>
Re: HDFS Federation
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Kun,
(1) ViewFileSystem is related.
https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/ViewFs.html
(2) Yes, NameNode Federation is disabled by default.
I suppose it is possible to configure NameNode Federation in one node by
setting different HTTP/RPC port and fsimage/edits directory for each
NameNode. I haven't tried this, so perhaps it is not possible.
Regards,
Akira
On 4/28/16 09:30, Kun Ren wrote:
> Hi Genius,
>
> I have two questions about the HDFS Federation:
> (1) Since there are multiple namenodes, there should be some code that
> analysis the client request and transfer the request to the appropriate
> namenode, could you please point to me where I can find the related code?
>
> (2) .Also just confirm that the Hadoop 2.7.2 support HDFS Federation,
> but in default there is only 1 namenode, is this correct? Meanwhile, do
> you think it is possible to configure the HDFS Fderation in the pseudo
> distributed mode in one node?
>
> Thanks so much in advance.
>
> Best,
> Kun Ren
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org
Re: HDFS Federation
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Kun,
(1) ViewFileSystem is related.
https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/ViewFs.html
(2) Yes, NameNode Federation is disabled by default.
I suppose it is possible to configure NameNode Federation in one node by
setting different HTTP/RPC port and fsimage/edits directory for each
NameNode. I haven't tried this, so perhaps it is not possible.
Regards,
Akira
On 4/28/16 09:30, Kun Ren wrote:
> Hi Genius,
>
> I have two questions about the HDFS Federation:
> (1) Since there are multiple namenodes, there should be some code that
> analysis the client request and transfer the request to the appropriate
> namenode, could you please point to me where I can find the related code?
>
> (2) .Also just confirm that the Hadoop 2.7.2 support HDFS Federation,
> but in default there is only 1 namenode, is this correct? Meanwhile, do
> you think it is possible to configure the HDFS Fderation in the pseudo
> distributed mode in one node?
>
> Thanks so much in advance.
>
> Best,
> Kun Ren
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org
Re: HDFS Federation
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Kun,
(1) ViewFileSystem is related.
https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/ViewFs.html
(2) Yes, NameNode Federation is disabled by default.
I suppose it is possible to configure NameNode Federation in one node by
setting different HTTP/RPC port and fsimage/edits directory for each
NameNode. I haven't tried this, so perhaps it is not possible.
Regards,
Akira
On 4/28/16 09:30, Kun Ren wrote:
> Hi Genius,
>
> I have two questions about the HDFS Federation:
> (1) Since there are multiple namenodes, there should be some code that
> analysis the client request and transfer the request to the appropriate
> namenode, could you please point to me where I can find the related code?
>
> (2) .Also just confirm that the Hadoop 2.7.2 support HDFS Federation,
> but in default there is only 1 namenode, is this correct? Meanwhile, do
> you think it is possible to configure the HDFS Fderation in the pseudo
> distributed mode in one node?
>
> Thanks so much in advance.
>
> Best,
> Kun Ren
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org
Re: HDFS Federation
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Kun,
(1) ViewFileSystem is related.
https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/ViewFs.html
(2) Yes, NameNode Federation is disabled by default.
I suppose it is possible to configure NameNode Federation in one node by
setting different HTTP/RPC port and fsimage/edits directory for each
NameNode. I haven't tried this, so perhaps it is not possible.
Regards,
Akira
On 4/28/16 09:30, Kun Ren wrote:
> Hi Genius,
>
> I have two questions about the HDFS Federation:
> (1) Since there are multiple namenodes, there should be some code that
> analysis the client request and transfer the request to the appropriate
> namenode, could you please point to me where I can find the related code?
>
> (2) .Also just confirm that the Hadoop 2.7.2 support HDFS Federation,
> but in default there is only 1 namenode, is this correct? Meanwhile, do
> you think it is possible to configure the HDFS Fderation in the pseudo
> distributed mode in one node?
>
> Thanks so much in advance.
>
> Best,
> Kun Ren
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org