You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Abhishek <ab...@gmail.com> on 2012/07/27 18:40:42 UTC
Fwd: High availability with hive
>
> Hi all,
>
> I am trying to install CDH4, I have a doubt can hive manage HIGH AVALIABILITY?
>
> Regards
> abhishek
Re: High availability with hive
Posted by Abhishek <ab...@gmail.com>.
Hi Edward,
Thanks for the reply, but Iam trying to install hive with hbase
Regards
Abhishek
Sent from my iPhone
On Jul 27, 2012, at 3:15 PM, Edward Capriolo <ed...@gmail.com> wrote:
> Datastax backends the hive metastore into Cassandra making it highly
> available, an open sourced Brisk did this originally but the
> technology was not actively maintained.
>
> Edward
>
> On Fri, Jul 27, 2012 at 3:02 PM, Bejoy Ks <be...@yahoo.com> wrote:
>> Hi Abshiek
>>
>> Hadoop 2.0/CDH4 has HA on hdfs level so this HA would be available to all
>> clients of hdfs like hive. AFAIK clients don't need any particular
>> configuration for this.
>>
>> However if your question is does hive have HA, with hadoop HA hive also has
>> HA in terms of data. However in hive the metadata is stored in metastore db
>> and the only possibility that hinders HA in hive is this db. Normally in
>> production clusters the metastore db (mysql db) is backed up frequently, but
>> that is just for a back up and recovery mechanism.
>>
>> I don't have much knowledge of HA in mysql dbs, but If you can employ HA in
>> metastore db then you can claim full HA in hive.
>>
>>
>>
>> Regards,
>> Bejoy KS
>>
>> ________________________________
>> From: Abhishek <ab...@gmail.com>
>> To: Hive <us...@hive.apache.org>
>> Sent: Friday, July 27, 2012 10:10 PM
>> Subject: Fwd: High availability with hive
>>
>>
>>>
>>> Hi all,
>>>
>>> I am trying to install CDH4, I have a doubt can hive manage HIGH
>>> AVALIABILITY?
>>>
>>> Regards
>>> abhishek
>>
>>
Re: Fwd: High availability with hive
Posted by Edward Capriolo <ed...@gmail.com>.
Datastax backends the hive metastore into Cassandra making it highly
available, an open sourced Brisk did this originally but the
technology was not actively maintained.
Edward
On Fri, Jul 27, 2012 at 3:02 PM, Bejoy Ks <be...@yahoo.com> wrote:
> Hi Abshiek
>
> Hadoop 2.0/CDH4 has HA on hdfs level so this HA would be available to all
> clients of hdfs like hive. AFAIK clients don't need any particular
> configuration for this.
>
> However if your question is does hive have HA, with hadoop HA hive also has
> HA in terms of data. However in hive the metadata is stored in metastore db
> and the only possibility that hinders HA in hive is this db. Normally in
> production clusters the metastore db (mysql db) is backed up frequently, but
> that is just for a back up and recovery mechanism.
>
> I don't have much knowledge of HA in mysql dbs, but If you can employ HA in
> metastore db then you can claim full HA in hive.
>
>
>
> Regards,
> Bejoy KS
>
> ________________________________
> From: Abhishek <ab...@gmail.com>
> To: Hive <us...@hive.apache.org>
> Sent: Friday, July 27, 2012 10:10 PM
> Subject: Fwd: High availability with hive
>
>
>>
>> Hi all,
>>
>> I am trying to install CDH4, I have a doubt can hive manage HIGH
>> AVALIABILITY?
>>
>> Regards
>> abhishek
>
>
Re: High availability with hive
Posted by Abhishek <ab...@gmail.com>.
Thanks for the reply Bejoy. Backing up metastore.db stored in mysql is the only to provide HA in hive?
Regards
Abhishek
Sent from my iPhone
On Jul 27, 2012, at 3:02 PM, Bejoy Ks <be...@yahoo.com> wrote:
> Hi Abshiek
>
> Hadoop 2.0/CDH4 has HA on hdfs level so this HA would be available to all clients of hdfs like hive. AFAIK clients don't need any particular configuration for this.
>
> However if your question is does hive have HA, with hadoop HA hive also has HA in terms of data. However in hive the metadata is stored in metastore db and the only possibility that hinders HA in hive is this db. Normally in production clusters the metastore db (mysql db) is backed up frequently, but that is just for a back up and recovery mechanism.
>
> I don't have much knowledge of HA in mysql dbs, but If you can employ HA in metastore db then you can claim full HA in hive.
>
>
>
> Regards,
> Bejoy KS
>
> From: Abhishek <ab...@gmail.com>
> To: Hive <us...@hive.apache.org>
> Sent: Friday, July 27, 2012 10:10 PM
> Subject: Fwd: High availability with hive
>
>
> >
> > Hi all,
> >
> > I am trying to install CDH4, I have a doubt can hive manage HIGH AVALIABILITY?
> >
> > Regards
> > abhishek
>
>
Re: Fwd: High availability with hive
Posted by Bejoy Ks <be...@yahoo.com>.
Hi Abshiek
Hadoop 2.0/CDH4 has HA on hdfs level so this HA would be available to all clients of hdfs like hive. AFAIK clients don't need any particular configuration for this.
However if your question is does hive have HA, with hadoop HA hive also has HA in terms of data. However in hive the metadata is stored in metastore db and the only possibility that hinders HA in hive is this db. Normally in production clusters the metastore db (mysql db) is backed up frequently, but that is just for a back up and recovery mechanism.
I don't have much knowledge of HA in mysql dbs, but If you can employ HA in metastore db then you can claim full HA in hive.
Regards,
Bejoy KS
________________________________
From: Abhishek <ab...@gmail.com>
To: Hive <us...@hive.apache.org>
Sent: Friday, July 27, 2012 10:10 PM
Subject: Fwd: High availability with hive
>
> Hi all,
>
> I am trying to install CDH4, I have a doubt can hive manage HIGH AVALIABILITY?
>
> Regards
> abhishek