You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Jitendra Yadav <je...@gmail.com> on 2013/05/23 11:50:01 UTC
Hadoop Rack awareness on virtual system
Hi,
Can we create and test hadoop rack awareness functionality in virtual box
system(like on laptop .etc)?.
Thanks~
Re: Hadoop Rack awareness on virtual system
Posted by Harsh J <ha...@cloudera.com>.
An example topology file and script is available on the Wiki at
http://wiki.apache.org/hadoop/topology_rack_awareness_scripts
On Thu, May 23, 2013 at 8:38 PM, Jitendra Yadav
<je...@gmail.com>wrote:
> Hi Leonid,
>
> Thanks for you reply.
>
> please you please give me an example how to make topology.sh file?
>
> Lets say I have below slave servers(data nodes)
>
> 192.168.45.1 dnode1
> 192.168.45.2 dnode2
> 192.168.45.3 dnode3
> 192.168.45.4 dnode4
> 192.168.45.5 dnode5
>
> Thanks
>
> On Thu, May 23, 2013 at 8:02 PM, Leonid Fedotov <lf...@hortonworks.com>wrote:
>
>> You definitely can.
>> Just set rack script on your VMs.
>>
>> Leonid
>>
>>
>> On Thu, May 23, 2013 at 2:50 AM, Jitendra Yadav <
>> jeetuyadav200890@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Can we create and test hadoop rack awareness functionality in virtual
>>> box system(like on laptop .etc)?.
>>>
>>>
>>> Thanks~
>>>
>>
>>
>
--
Harsh J
Re: Hadoop Rack awareness on virtual system
Posted by Harsh J <ha...@cloudera.com>.
An example topology file and script is available on the Wiki at
http://wiki.apache.org/hadoop/topology_rack_awareness_scripts
On Thu, May 23, 2013 at 8:38 PM, Jitendra Yadav
<je...@gmail.com>wrote:
> Hi Leonid,
>
> Thanks for you reply.
>
> please you please give me an example how to make topology.sh file?
>
> Lets say I have below slave servers(data nodes)
>
> 192.168.45.1 dnode1
> 192.168.45.2 dnode2
> 192.168.45.3 dnode3
> 192.168.45.4 dnode4
> 192.168.45.5 dnode5
>
> Thanks
>
> On Thu, May 23, 2013 at 8:02 PM, Leonid Fedotov <lf...@hortonworks.com>wrote:
>
>> You definitely can.
>> Just set rack script on your VMs.
>>
>> Leonid
>>
>>
>> On Thu, May 23, 2013 at 2:50 AM, Jitendra Yadav <
>> jeetuyadav200890@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Can we create and test hadoop rack awareness functionality in virtual
>>> box system(like on laptop .etc)?.
>>>
>>>
>>> Thanks~
>>>
>>
>>
>
--
Harsh J
Re: Hadoop Rack awareness on virtual system
Posted by Harsh J <ha...@cloudera.com>.
An example topology file and script is available on the Wiki at
http://wiki.apache.org/hadoop/topology_rack_awareness_scripts
On Thu, May 23, 2013 at 8:38 PM, Jitendra Yadav
<je...@gmail.com>wrote:
> Hi Leonid,
>
> Thanks for you reply.
>
> please you please give me an example how to make topology.sh file?
>
> Lets say I have below slave servers(data nodes)
>
> 192.168.45.1 dnode1
> 192.168.45.2 dnode2
> 192.168.45.3 dnode3
> 192.168.45.4 dnode4
> 192.168.45.5 dnode5
>
> Thanks
>
> On Thu, May 23, 2013 at 8:02 PM, Leonid Fedotov <lf...@hortonworks.com>wrote:
>
>> You definitely can.
>> Just set rack script on your VMs.
>>
>> Leonid
>>
>>
>> On Thu, May 23, 2013 at 2:50 AM, Jitendra Yadav <
>> jeetuyadav200890@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Can we create and test hadoop rack awareness functionality in virtual
>>> box system(like on laptop .etc)?.
>>>
>>>
>>> Thanks~
>>>
>>
>>
>
--
Harsh J
Re: Hadoop Rack awareness on virtual system
Posted by Harsh J <ha...@cloudera.com>.
An example topology file and script is available on the Wiki at
http://wiki.apache.org/hadoop/topology_rack_awareness_scripts
On Thu, May 23, 2013 at 8:38 PM, Jitendra Yadav
<je...@gmail.com>wrote:
> Hi Leonid,
>
> Thanks for you reply.
>
> please you please give me an example how to make topology.sh file?
>
> Lets say I have below slave servers(data nodes)
>
> 192.168.45.1 dnode1
> 192.168.45.2 dnode2
> 192.168.45.3 dnode3
> 192.168.45.4 dnode4
> 192.168.45.5 dnode5
>
> Thanks
>
> On Thu, May 23, 2013 at 8:02 PM, Leonid Fedotov <lf...@hortonworks.com>wrote:
>
>> You definitely can.
>> Just set rack script on your VMs.
>>
>> Leonid
>>
>>
>> On Thu, May 23, 2013 at 2:50 AM, Jitendra Yadav <
>> jeetuyadav200890@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Can we create and test hadoop rack awareness functionality in virtual
>>> box system(like on laptop .etc)?.
>>>
>>>
>>> Thanks~
>>>
>>
>>
>
--
Harsh J
Re: Hadoop Rack awareness on virtual system
Posted by Jitendra Yadav <je...@gmail.com>.
Hi Leonid,
Thanks for you reply.
please you please give me an example how to make topology.sh file?
Lets say I have below slave servers(data nodes)
192.168.45.1 dnode1
192.168.45.2 dnode2
192.168.45.3 dnode3
192.168.45.4 dnode4
192.168.45.5 dnode5
Thanks
On Thu, May 23, 2013 at 8:02 PM, Leonid Fedotov <lf...@hortonworks.com>wrote:
> You definitely can.
> Just set rack script on your VMs.
>
> Leonid
>
>
> On Thu, May 23, 2013 at 2:50 AM, Jitendra Yadav <
> jeetuyadav200890@gmail.com> wrote:
>
>> Hi,
>>
>> Can we create and test hadoop rack awareness functionality in virtual box
>> system(like on laptop .etc)?.
>>
>>
>> Thanks~
>>
>
>
Re: Hadoop Rack awareness on virtual system
Posted by Jitendra Yadav <je...@gmail.com>.
Hi Leonid,
Thanks for you reply.
please you please give me an example how to make topology.sh file?
Lets say I have below slave servers(data nodes)
192.168.45.1 dnode1
192.168.45.2 dnode2
192.168.45.3 dnode3
192.168.45.4 dnode4
192.168.45.5 dnode5
Thanks
On Thu, May 23, 2013 at 8:02 PM, Leonid Fedotov <lf...@hortonworks.com>wrote:
> You definitely can.
> Just set rack script on your VMs.
>
> Leonid
>
>
> On Thu, May 23, 2013 at 2:50 AM, Jitendra Yadav <
> jeetuyadav200890@gmail.com> wrote:
>
>> Hi,
>>
>> Can we create and test hadoop rack awareness functionality in virtual box
>> system(like on laptop .etc)?.
>>
>>
>> Thanks~
>>
>
>
Re: Hadoop Rack awareness on virtual system
Posted by Jitendra Yadav <je...@gmail.com>.
Hi Leonid,
Thanks for you reply.
please you please give me an example how to make topology.sh file?
Lets say I have below slave servers(data nodes)
192.168.45.1 dnode1
192.168.45.2 dnode2
192.168.45.3 dnode3
192.168.45.4 dnode4
192.168.45.5 dnode5
Thanks
On Thu, May 23, 2013 at 8:02 PM, Leonid Fedotov <lf...@hortonworks.com>wrote:
> You definitely can.
> Just set rack script on your VMs.
>
> Leonid
>
>
> On Thu, May 23, 2013 at 2:50 AM, Jitendra Yadav <
> jeetuyadav200890@gmail.com> wrote:
>
>> Hi,
>>
>> Can we create and test hadoop rack awareness functionality in virtual box
>> system(like on laptop .etc)?.
>>
>>
>> Thanks~
>>
>
>
Re: Hadoop Rack awareness on virtual system
Posted by Jitendra Yadav <je...@gmail.com>.
Hi Leonid,
Thanks for you reply.
please you please give me an example how to make topology.sh file?
Lets say I have below slave servers(data nodes)
192.168.45.1 dnode1
192.168.45.2 dnode2
192.168.45.3 dnode3
192.168.45.4 dnode4
192.168.45.5 dnode5
Thanks
On Thu, May 23, 2013 at 8:02 PM, Leonid Fedotov <lf...@hortonworks.com>wrote:
> You definitely can.
> Just set rack script on your VMs.
>
> Leonid
>
>
> On Thu, May 23, 2013 at 2:50 AM, Jitendra Yadav <
> jeetuyadav200890@gmail.com> wrote:
>
>> Hi,
>>
>> Can we create and test hadoop rack awareness functionality in virtual box
>> system(like on laptop .etc)?.
>>
>>
>> Thanks~
>>
>
>
Re: Hadoop Rack awareness on virtual system
Posted by Leonid Fedotov <lf...@hortonworks.com>.
You definitely can.
Just set rack script on your VMs.
Leonid
On Thu, May 23, 2013 at 2:50 AM, Jitendra Yadav
<je...@gmail.com>wrote:
> Hi,
>
> Can we create and test hadoop rack awareness functionality in virtual box
> system(like on laptop .etc)?.
>
>
> Thanks~
>
Re: Hadoop Rack awareness on virtual system
Posted by Leonid Fedotov <lf...@hortonworks.com>.
You definitely can.
Just set rack script on your VMs.
Leonid
On Thu, May 23, 2013 at 2:50 AM, Jitendra Yadav
<je...@gmail.com>wrote:
> Hi,
>
> Can we create and test hadoop rack awareness functionality in virtual box
> system(like on laptop .etc)?.
>
>
> Thanks~
>
Re: Hadoop Rack awareness on virtual system
Posted by Leonid Fedotov <lf...@hortonworks.com>.
You definitely can.
Just set rack script on your VMs.
Leonid
On Thu, May 23, 2013 at 2:50 AM, Jitendra Yadav
<je...@gmail.com>wrote:
> Hi,
>
> Can we create and test hadoop rack awareness functionality in virtual box
> system(like on laptop .etc)?.
>
>
> Thanks~
>
Re: Hadoop Rack awareness on virtual system
Posted by Leonid Fedotov <lf...@hortonworks.com>.
You definitely can.
Just set rack script on your VMs.
Leonid
On Thu, May 23, 2013 at 2:50 AM, Jitendra Yadav
<je...@gmail.com>wrote:
> Hi,
>
> Can we create and test hadoop rack awareness functionality in virtual box
> system(like on laptop .etc)?.
>
>
> Thanks~
>