You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Manickam P <ma...@outlook.com> on 2013/09/24 22:14:50 UTC
Yarn and Hdfs federation
Guys,
I have installed federated cluster with two name nodes and 3 data nodes. Now i want to have separate RM for yarn. Can i install like that? Then will my name node
work like NM? How it will work?
Can i install hive in any one of the name node in federated cluster?
Pls help me to understand this.
Thanks,
Manickam P
Re: Yarn and Hdfs federation
Posted by Harsh J <ha...@cloudera.com>.
Hi Manickam,
Can you explain what you're really trying to achieve/construct here?
YARN has little to do with Federation. One typically runs federation
to divide the namespace across multiple NameNodes (lowering load
compared to a single NN). YARN and MR though would run across the
whole cluster in a singular manner. Its the jobs that use federated
namespaces, not the YARN/MR2 framework - they can run off of either
one and still serve jobs that use the other.
On Wed, Sep 25, 2013 at 1:44 AM, Manickam P <ma...@outlook.com> wrote:
> Guys,
>
> I have installed federated cluster with two name nodes and 3 data nodes. Now
> i want to have separate RM for yarn. Can i install like that? Then will my
> name node
> work like NM? How it will work?
>
> Can i install hive in any one of the name node in federated cluster?
>
> Pls help me to understand this.
>
>
> Thanks,
> Manickam P
--
Harsh J
Re: Yarn and Hdfs federation
Posted by Harsh J <ha...@cloudera.com>.
Hi Manickam,
Can you explain what you're really trying to achieve/construct here?
YARN has little to do with Federation. One typically runs federation
to divide the namespace across multiple NameNodes (lowering load
compared to a single NN). YARN and MR though would run across the
whole cluster in a singular manner. Its the jobs that use federated
namespaces, not the YARN/MR2 framework - they can run off of either
one and still serve jobs that use the other.
On Wed, Sep 25, 2013 at 1:44 AM, Manickam P <ma...@outlook.com> wrote:
> Guys,
>
> I have installed federated cluster with two name nodes and 3 data nodes. Now
> i want to have separate RM for yarn. Can i install like that? Then will my
> name node
> work like NM? How it will work?
>
> Can i install hive in any one of the name node in federated cluster?
>
> Pls help me to understand this.
>
>
> Thanks,
> Manickam P
--
Harsh J
Re: Yarn and Hdfs federation
Posted by Harsh J <ha...@cloudera.com>.
Hi Manickam,
Can you explain what you're really trying to achieve/construct here?
YARN has little to do with Federation. One typically runs federation
to divide the namespace across multiple NameNodes (lowering load
compared to a single NN). YARN and MR though would run across the
whole cluster in a singular manner. Its the jobs that use federated
namespaces, not the YARN/MR2 framework - they can run off of either
one and still serve jobs that use the other.
On Wed, Sep 25, 2013 at 1:44 AM, Manickam P <ma...@outlook.com> wrote:
> Guys,
>
> I have installed federated cluster with two name nodes and 3 data nodes. Now
> i want to have separate RM for yarn. Can i install like that? Then will my
> name node
> work like NM? How it will work?
>
> Can i install hive in any one of the name node in federated cluster?
>
> Pls help me to understand this.
>
>
> Thanks,
> Manickam P
--
Harsh J
Re: Yarn and Hdfs federation
Posted by Harsh J <ha...@cloudera.com>.
Hi Manickam,
Can you explain what you're really trying to achieve/construct here?
YARN has little to do with Federation. One typically runs federation
to divide the namespace across multiple NameNodes (lowering load
compared to a single NN). YARN and MR though would run across the
whole cluster in a singular manner. Its the jobs that use federated
namespaces, not the YARN/MR2 framework - they can run off of either
one and still serve jobs that use the other.
On Wed, Sep 25, 2013 at 1:44 AM, Manickam P <ma...@outlook.com> wrote:
> Guys,
>
> I have installed federated cluster with two name nodes and 3 data nodes. Now
> i want to have separate RM for yarn. Can i install like that? Then will my
> name node
> work like NM? How it will work?
>
> Can i install hive in any one of the name node in federated cluster?
>
> Pls help me to understand this.
>
>
> Thanks,
> Manickam P
--
Harsh J