You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Shashidhar Rao <ra...@gmail.com> on 2014/04/15 05:59:54 UTC
Hadoop and Hbase
Hi,
Please somebody clarify how hadoop and hbase are both used in real
production environment.
Do the Region Servers of Hbase can be installed in Hadoop Datanodes or
Region servers are separated from Hadoop data nodes in multiple clusters.
I know it's Hbase centric but still if someone has experienced in real
production environment please share your experiences.
Regards
Shashidhar
Re: Hadoop and Hbase
Posted by Shashidhar Rao <ra...@gmail.com>.
Thanks Ted Yu
On Tue, Apr 15, 2014 at 9:37 AM, Ted Yu <yu...@gmail.com> wrote:
> When Region Servers are co-located with Datanodes, you can utilize short
> circuit read feature.
> See 12.11.2 of http://hbase.apache.org/book.html#perf.hdfs
>
> Factors to consider co-location include the allocation of memory of server
> - so that region server and Data node can have ample memory to fulfill
> their tasks.
>
> Cheers
>
>
> On Mon, Apr 14, 2014 at 8:59 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
>> Hi,
>>
>> Please somebody clarify how hadoop and hbase are both used in real
>> production environment.
>>
>> Do the Region Servers of Hbase can be installed in Hadoop Datanodes or
>> Region servers are separated from Hadoop data nodes in multiple clusters.
>>
>> I know it's Hbase centric but still if someone has experienced in real
>> production environment please share your experiences.
>>
>> Regards
>> Shashidhar
>>
>
>
Re: Hadoop and Hbase
Posted by Shashidhar Rao <ra...@gmail.com>.
Thanks Ted Yu
On Tue, Apr 15, 2014 at 9:37 AM, Ted Yu <yu...@gmail.com> wrote:
> When Region Servers are co-located with Datanodes, you can utilize short
> circuit read feature.
> See 12.11.2 of http://hbase.apache.org/book.html#perf.hdfs
>
> Factors to consider co-location include the allocation of memory of server
> - so that region server and Data node can have ample memory to fulfill
> their tasks.
>
> Cheers
>
>
> On Mon, Apr 14, 2014 at 8:59 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
>> Hi,
>>
>> Please somebody clarify how hadoop and hbase are both used in real
>> production environment.
>>
>> Do the Region Servers of Hbase can be installed in Hadoop Datanodes or
>> Region servers are separated from Hadoop data nodes in multiple clusters.
>>
>> I know it's Hbase centric but still if someone has experienced in real
>> production environment please share your experiences.
>>
>> Regards
>> Shashidhar
>>
>
>
Re: Hadoop and Hbase
Posted by Shashidhar Rao <ra...@gmail.com>.
Thanks Ted Yu
On Tue, Apr 15, 2014 at 9:37 AM, Ted Yu <yu...@gmail.com> wrote:
> When Region Servers are co-located with Datanodes, you can utilize short
> circuit read feature.
> See 12.11.2 of http://hbase.apache.org/book.html#perf.hdfs
>
> Factors to consider co-location include the allocation of memory of server
> - so that region server and Data node can have ample memory to fulfill
> their tasks.
>
> Cheers
>
>
> On Mon, Apr 14, 2014 at 8:59 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
>> Hi,
>>
>> Please somebody clarify how hadoop and hbase are both used in real
>> production environment.
>>
>> Do the Region Servers of Hbase can be installed in Hadoop Datanodes or
>> Region servers are separated from Hadoop data nodes in multiple clusters.
>>
>> I know it's Hbase centric but still if someone has experienced in real
>> production environment please share your experiences.
>>
>> Regards
>> Shashidhar
>>
>
>
Re: Hadoop and Hbase
Posted by Shashidhar Rao <ra...@gmail.com>.
Thanks Ted Yu
On Tue, Apr 15, 2014 at 9:37 AM, Ted Yu <yu...@gmail.com> wrote:
> When Region Servers are co-located with Datanodes, you can utilize short
> circuit read feature.
> See 12.11.2 of http://hbase.apache.org/book.html#perf.hdfs
>
> Factors to consider co-location include the allocation of memory of server
> - so that region server and Data node can have ample memory to fulfill
> their tasks.
>
> Cheers
>
>
> On Mon, Apr 14, 2014 at 8:59 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
>> Hi,
>>
>> Please somebody clarify how hadoop and hbase are both used in real
>> production environment.
>>
>> Do the Region Servers of Hbase can be installed in Hadoop Datanodes or
>> Region servers are separated from Hadoop data nodes in multiple clusters.
>>
>> I know it's Hbase centric but still if someone has experienced in real
>> production environment please share your experiences.
>>
>> Regards
>> Shashidhar
>>
>
>
Re: Hadoop and Hbase
Posted by Ted Yu <yu...@gmail.com>.
When Region Servers are co-located with Datanodes, you can utilize short
circuit read feature.
See 12.11.2 of http://hbase.apache.org/book.html#perf.hdfs
Factors to consider co-location include the allocation of memory of server
- so that region server and Data node can have ample memory to fulfill
their tasks.
Cheers
On Mon, Apr 14, 2014 at 8:59 PM, Shashidhar Rao
<ra...@gmail.com>wrote:
> Hi,
>
> Please somebody clarify how hadoop and hbase are both used in real
> production environment.
>
> Do the Region Servers of Hbase can be installed in Hadoop Datanodes or
> Region servers are separated from Hadoop data nodes in multiple clusters.
>
> I know it's Hbase centric but still if someone has experienced in real
> production environment please share your experiences.
>
> Regards
> Shashidhar
>
Re: Hadoop and Hbase
Posted by Ted Yu <yu...@gmail.com>.
When Region Servers are co-located with Datanodes, you can utilize short
circuit read feature.
See 12.11.2 of http://hbase.apache.org/book.html#perf.hdfs
Factors to consider co-location include the allocation of memory of server
- so that region server and Data node can have ample memory to fulfill
their tasks.
Cheers
On Mon, Apr 14, 2014 at 8:59 PM, Shashidhar Rao
<ra...@gmail.com>wrote:
> Hi,
>
> Please somebody clarify how hadoop and hbase are both used in real
> production environment.
>
> Do the Region Servers of Hbase can be installed in Hadoop Datanodes or
> Region servers are separated from Hadoop data nodes in multiple clusters.
>
> I know it's Hbase centric but still if someone has experienced in real
> production environment please share your experiences.
>
> Regards
> Shashidhar
>
Re: Hadoop and Hbase
Posted by Ted Yu <yu...@gmail.com>.
When Region Servers are co-located with Datanodes, you can utilize short
circuit read feature.
See 12.11.2 of http://hbase.apache.org/book.html#perf.hdfs
Factors to consider co-location include the allocation of memory of server
- so that region server and Data node can have ample memory to fulfill
their tasks.
Cheers
On Mon, Apr 14, 2014 at 8:59 PM, Shashidhar Rao
<ra...@gmail.com>wrote:
> Hi,
>
> Please somebody clarify how hadoop and hbase are both used in real
> production environment.
>
> Do the Region Servers of Hbase can be installed in Hadoop Datanodes or
> Region servers are separated from Hadoop data nodes in multiple clusters.
>
> I know it's Hbase centric but still if someone has experienced in real
> production environment please share your experiences.
>
> Regards
> Shashidhar
>
Re: Hadoop and Hbase
Posted by Ted Yu <yu...@gmail.com>.
When Region Servers are co-located with Datanodes, you can utilize short
circuit read feature.
See 12.11.2 of http://hbase.apache.org/book.html#perf.hdfs
Factors to consider co-location include the allocation of memory of server
- so that region server and Data node can have ample memory to fulfill
their tasks.
Cheers
On Mon, Apr 14, 2014 at 8:59 PM, Shashidhar Rao
<ra...@gmail.com>wrote:
> Hi,
>
> Please somebody clarify how hadoop and hbase are both used in real
> production environment.
>
> Do the Region Servers of Hbase can be installed in Hadoop Datanodes or
> Region servers are separated from Hadoop data nodes in multiple clusters.
>
> I know it's Hbase centric but still if someone has experienced in real
> production environment please share your experiences.
>
> Regards
> Shashidhar
>