You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by an...@free.fr on 2013/04/21 12:01:14 UTC
HDFS load-balancing
Hello everybody.
I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
Is that right?
But with only one server answering all requests, I can't imagine it could be enough.
I have also read that facebook use that FS so it might be possible, isn't it?
Regards.
Anthony.
Re: HDFS load-balancin
Posted by Hadoop <bi...@gmail.com>.
LThanks and RegardsPm
Benoy Antonyppm
POn Apr 21, 2013, at 3:01 AM, anthony.lelong@free.fr wrote:
> Hello everybody.
>
> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>
> Is that right?
>
> But with only one server answering all requests, I can't imagine it could be enough.
> I have also read that facebook use that FS so it might be possible, isn't it?
>
> Regards.
>
> Anthony.
Re: HDFS load-balancin
Posted by Hadoop <bi...@gmail.com>.
LThanks and RegardsPm
Benoy Antonyppm
POn Apr 21, 2013, at 3:01 AM, anthony.lelong@free.fr wrote:
> Hello everybody.
>
> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>
> Is that right?
>
> But with only one server answering all requests, I can't imagine it could be enough.
> I have also read that facebook use that FS so it might be possible, isn't it?
>
> Regards.
>
> Anthony.
Re: HDFS load-balancin
Posted by Hadoop <bi...@gmail.com>.
LThanks and RegardsPm
Benoy Antonyppm
POn Apr 21, 2013, at 3:01 AM, anthony.lelong@free.fr wrote:
> Hello everybody.
>
> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>
> Is that right?
>
> But with only one server answering all requests, I can't imagine it could be enough.
> I have also read that facebook use that FS so it might be possible, isn't it?
>
> Regards.
>
> Anthony.
Re: HDFS load-balancin
Posted by Hadoop <bi...@gmail.com>.
LThanks and RegardsPm
Benoy Antonyppm
POn Apr 21, 2013, at 3:01 AM, anthony.lelong@free.fr wrote:
> Hello everybody.
>
> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>
> Is that right?
>
> But with only one server answering all requests, I can't imagine it could be enough.
> I have also read that facebook use that FS so it might be possible, isn't it?
>
> Regards.
>
> Anthony.
Re: HDFS load-balancing
Posted by Harsh J <ha...@cloudera.com>.
Federation is already distributed (a namespace part per node); are you
asking about something else?
On Sun, Apr 21, 2013 at 5:47 PM, <an...@free.fr> wrote:
> Hm, yes, it looks interesting. Thank you.
>
> Do you know if that functionality is planned to be distributed?
>
> Anthony.
>
>
> ----- Mail original -----
> De: "Harsh J" <ha...@cloudera.com>
> À: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>
> Envoyé: Dimanche 21 Avril 2013 14:06:45
> Objet: Re: HDFS load-balancing
>
> Are you speaking of load balancing of the metadata requests served by
> the NameNode? There isn't a direct way right now but HDFS Federation
> features would interest you, as it helps divide the namespace itself
> into several different NNs.
>
> Read more about Federation at
> http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/Federation.html
>
> On Sun, Apr 21, 2013 at 3:31 PM, <an...@free.fr> wrote:
>> Hello everybody.
>>
>> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>>
>> Is that right?
>>
>> But with only one server answering all requests, I can't imagine it could be enough.
>> I have also read that facebook use that FS so it might be possible, isn't it?
>>
>> Regards.
>>
>> Anthony.
>
>
>
> --
> Harsh J
--
Harsh J
Re: HDFS load-balancing
Posted by Harsh J <ha...@cloudera.com>.
Federation is already distributed (a namespace part per node); are you
asking about something else?
On Sun, Apr 21, 2013 at 5:47 PM, <an...@free.fr> wrote:
> Hm, yes, it looks interesting. Thank you.
>
> Do you know if that functionality is planned to be distributed?
>
> Anthony.
>
>
> ----- Mail original -----
> De: "Harsh J" <ha...@cloudera.com>
> À: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>
> Envoyé: Dimanche 21 Avril 2013 14:06:45
> Objet: Re: HDFS load-balancing
>
> Are you speaking of load balancing of the metadata requests served by
> the NameNode? There isn't a direct way right now but HDFS Federation
> features would interest you, as it helps divide the namespace itself
> into several different NNs.
>
> Read more about Federation at
> http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/Federation.html
>
> On Sun, Apr 21, 2013 at 3:31 PM, <an...@free.fr> wrote:
>> Hello everybody.
>>
>> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>>
>> Is that right?
>>
>> But with only one server answering all requests, I can't imagine it could be enough.
>> I have also read that facebook use that FS so it might be possible, isn't it?
>>
>> Regards.
>>
>> Anthony.
>
>
>
> --
> Harsh J
--
Harsh J
Re: HDFS load-balancing
Posted by Harsh J <ha...@cloudera.com>.
Federation is already distributed (a namespace part per node); are you
asking about something else?
On Sun, Apr 21, 2013 at 5:47 PM, <an...@free.fr> wrote:
> Hm, yes, it looks interesting. Thank you.
>
> Do you know if that functionality is planned to be distributed?
>
> Anthony.
>
>
> ----- Mail original -----
> De: "Harsh J" <ha...@cloudera.com>
> À: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>
> Envoyé: Dimanche 21 Avril 2013 14:06:45
> Objet: Re: HDFS load-balancing
>
> Are you speaking of load balancing of the metadata requests served by
> the NameNode? There isn't a direct way right now but HDFS Federation
> features would interest you, as it helps divide the namespace itself
> into several different NNs.
>
> Read more about Federation at
> http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/Federation.html
>
> On Sun, Apr 21, 2013 at 3:31 PM, <an...@free.fr> wrote:
>> Hello everybody.
>>
>> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>>
>> Is that right?
>>
>> But with only one server answering all requests, I can't imagine it could be enough.
>> I have also read that facebook use that FS so it might be possible, isn't it?
>>
>> Regards.
>>
>> Anthony.
>
>
>
> --
> Harsh J
--
Harsh J
Re: HDFS load-balancing
Posted by Harsh J <ha...@cloudera.com>.
Federation is already distributed (a namespace part per node); are you
asking about something else?
On Sun, Apr 21, 2013 at 5:47 PM, <an...@free.fr> wrote:
> Hm, yes, it looks interesting. Thank you.
>
> Do you know if that functionality is planned to be distributed?
>
> Anthony.
>
>
> ----- Mail original -----
> De: "Harsh J" <ha...@cloudera.com>
> À: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>
> Envoyé: Dimanche 21 Avril 2013 14:06:45
> Objet: Re: HDFS load-balancing
>
> Are you speaking of load balancing of the metadata requests served by
> the NameNode? There isn't a direct way right now but HDFS Federation
> features would interest you, as it helps divide the namespace itself
> into several different NNs.
>
> Read more about Federation at
> http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/Federation.html
>
> On Sun, Apr 21, 2013 at 3:31 PM, <an...@free.fr> wrote:
>> Hello everybody.
>>
>> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>>
>> Is that right?
>>
>> But with only one server answering all requests, I can't imagine it could be enough.
>> I have also read that facebook use that FS so it might be possible, isn't it?
>>
>> Regards.
>>
>> Anthony.
>
>
>
> --
> Harsh J
--
Harsh J
Re: HDFS load-balancing
Posted by an...@free.fr.
Hm, yes, it looks interesting. Thank you.
Do you know if that functionality is planned to be distributed?
Anthony.
----- Mail original -----
De: "Harsh J" <ha...@cloudera.com>
À: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>
Envoyé: Dimanche 21 Avril 2013 14:06:45
Objet: Re: HDFS load-balancing
Are you speaking of load balancing of the metadata requests served by
the NameNode? There isn't a direct way right now but HDFS Federation
features would interest you, as it helps divide the namespace itself
into several different NNs.
Read more about Federation at
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/Federation.html
On Sun, Apr 21, 2013 at 3:31 PM, <an...@free.fr> wrote:
> Hello everybody.
>
> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>
> Is that right?
>
> But with only one server answering all requests, I can't imagine it could be enough.
> I have also read that facebook use that FS so it might be possible, isn't it?
>
> Regards.
>
> Anthony.
--
Harsh J
Re: HDFS load-balancing
Posted by an...@free.fr.
Hm, yes, it looks interesting. Thank you.
Do you know if that functionality is planned to be distributed?
Anthony.
----- Mail original -----
De: "Harsh J" <ha...@cloudera.com>
À: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>
Envoyé: Dimanche 21 Avril 2013 14:06:45
Objet: Re: HDFS load-balancing
Are you speaking of load balancing of the metadata requests served by
the NameNode? There isn't a direct way right now but HDFS Federation
features would interest you, as it helps divide the namespace itself
into several different NNs.
Read more about Federation at
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/Federation.html
On Sun, Apr 21, 2013 at 3:31 PM, <an...@free.fr> wrote:
> Hello everybody.
>
> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>
> Is that right?
>
> But with only one server answering all requests, I can't imagine it could be enough.
> I have also read that facebook use that FS so it might be possible, isn't it?
>
> Regards.
>
> Anthony.
--
Harsh J
Re: HDFS load-balancing
Posted by an...@free.fr.
Hm, yes, it looks interesting. Thank you.
Do you know if that functionality is planned to be distributed?
Anthony.
----- Mail original -----
De: "Harsh J" <ha...@cloudera.com>
À: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>
Envoyé: Dimanche 21 Avril 2013 14:06:45
Objet: Re: HDFS load-balancing
Are you speaking of load balancing of the metadata requests served by
the NameNode? There isn't a direct way right now but HDFS Federation
features would interest you, as it helps divide the namespace itself
into several different NNs.
Read more about Federation at
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/Federation.html
On Sun, Apr 21, 2013 at 3:31 PM, <an...@free.fr> wrote:
> Hello everybody.
>
> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>
> Is that right?
>
> But with only one server answering all requests, I can't imagine it could be enough.
> I have also read that facebook use that FS so it might be possible, isn't it?
>
> Regards.
>
> Anthony.
--
Harsh J
Re: HDFS load-balancing
Posted by an...@free.fr.
Hm, yes, it looks interesting. Thank you.
Do you know if that functionality is planned to be distributed?
Anthony.
----- Mail original -----
De: "Harsh J" <ha...@cloudera.com>
À: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>
Envoyé: Dimanche 21 Avril 2013 14:06:45
Objet: Re: HDFS load-balancing
Are you speaking of load balancing of the metadata requests served by
the NameNode? There isn't a direct way right now but HDFS Federation
features would interest you, as it helps divide the namespace itself
into several different NNs.
Read more about Federation at
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/Federation.html
On Sun, Apr 21, 2013 at 3:31 PM, <an...@free.fr> wrote:
> Hello everybody.
>
> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>
> Is that right?
>
> But with only one server answering all requests, I can't imagine it could be enough.
> I have also read that facebook use that FS so it might be possible, isn't it?
>
> Regards.
>
> Anthony.
--
Harsh J
Re: HDFS load-balancing
Posted by Harsh J <ha...@cloudera.com>.
Are you speaking of load balancing of the metadata requests served by
the NameNode? There isn't a direct way right now but HDFS Federation
features would interest you, as it helps divide the namespace itself
into several different NNs.
Read more about Federation at
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/Federation.html
On Sun, Apr 21, 2013 at 3:31 PM, <an...@free.fr> wrote:
> Hello everybody.
>
> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>
> Is that right?
>
> But with only one server answering all requests, I can't imagine it could be enough.
> I have also read that facebook use that FS so it might be possible, isn't it?
>
> Regards.
>
> Anthony.
--
Harsh J
Re: HDFS load-balancing
Posted by Harsh J <ha...@cloudera.com>.
Are you speaking of load balancing of the metadata requests served by
the NameNode? There isn't a direct way right now but HDFS Federation
features would interest you, as it helps divide the namespace itself
into several different NNs.
Read more about Federation at
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/Federation.html
On Sun, Apr 21, 2013 at 3:31 PM, <an...@free.fr> wrote:
> Hello everybody.
>
> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>
> Is that right?
>
> But with only one server answering all requests, I can't imagine it could be enough.
> I have also read that facebook use that FS so it might be possible, isn't it?
>
> Regards.
>
> Anthony.
--
Harsh J
Re: HDFS load-balancing
Posted by Harsh J <ha...@cloudera.com>.
Are you speaking of load balancing of the metadata requests served by
the NameNode? There isn't a direct way right now but HDFS Federation
features would interest you, as it helps divide the namespace itself
into several different NNs.
Read more about Federation at
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/Federation.html
On Sun, Apr 21, 2013 at 3:31 PM, <an...@free.fr> wrote:
> Hello everybody.
>
> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>
> Is that right?
>
> But with only one server answering all requests, I can't imagine it could be enough.
> I have also read that facebook use that FS so it might be possible, isn't it?
>
> Regards.
>
> Anthony.
--
Harsh J
Re: HDFS load-balancing
Posted by Harsh J <ha...@cloudera.com>.
Are you speaking of load balancing of the metadata requests served by
the NameNode? There isn't a direct way right now but HDFS Federation
features would interest you, as it helps divide the namespace itself
into several different NNs.
Read more about Federation at
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/Federation.html
On Sun, Apr 21, 2013 at 3:31 PM, <an...@free.fr> wrote:
> Hello everybody.
>
> I am wondering how HDFS deals with load balancing. I mean, there is on primary namenode and only one secondary namenode (if I well understood the documentation).
>
> Is that right?
>
> But with only one server answering all requests, I can't imagine it could be enough.
> I have also read that facebook use that FS so it might be possible, isn't it?
>
> Regards.
>
> Anthony.
--
Harsh J