You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Eva Tse <et...@netflix.com> on 2009/06/11 18:21:12 UTC
Setting up local repository w/ derby
We would like to know how/if possible to use the embedded derby driver to
setup a local repository. If so, what configuration could achieve this.
We want to test Hive on EC2 and don¹t want to provision another machine on
the cloud to run mysql for the metastore just yet.
Thanks!
Eva.
Re: Setting up local repository w/ derby
Posted by Eva Tse <et...@netflix.com>.
Thanks for the suggestion. We will give that a try.
Eva.
On 6/11/09 2:23 PM, "Stephen Corona" <sc...@adknowledge.com> wrote:
> We use an EBS volume to hold our derby database when running Hive on EC2. It's
> pretty simple to setup and works great.
>
> -Steve
> ________________________________________
> From: Prasad Chakka [pchakka@facebook.com]
> Sent: Thursday, June 11, 2009 5:05 PM
> To: hive-user@hadoop.apache.org
> Subject: Re: Setting up local repository w/ derby
>
> I am not sure how to handle permanent storage in EC2 but you can run derby as
> a networked database similar to that of mysql. You can run derby server on the
> same node as jobtracker and when you are done with the cluster, you can copy
> the directory on which derby is running to a permanent place. When you need
> the metastore again in a new cluster setup, copy the file to any node in the
> cluster and then start the derby server on that file.
>
> Instructions on how to setup a derby server are here
> http://wiki.apache.org/hadoop/HiveDerbyServerMode (derby docs @
> http://db.apache.org/derby/docs/10.4/adminguide/cadminov825266.html)
>
> Prasad
>
>
> ________________________________
> From: Eva Tse <et...@netflix.com>
> Reply-To: <hi...@hadoop.apache.org>
> Date: Thu, 11 Jun 2009 09:21:12 -0700
> To: <hi...@hadoop.apache.org>
> Subject: Setting up local repository w/ derby
>
> We would like to know how/if possible to use the embedded derby driver to
> setup a local repository. If so, what configuration could achieve this.
>
> We want to test Hive on EC2 and don¹t want to provision another machine on the
> cloud to run mysql for the metastore just yet.
>
> Thanks!
> Eva.
RE: Setting up local repository w/ derby
Posted by Stephen Corona <sc...@adknowledge.com>.
We use an EBS volume to hold our derby database when running Hive on EC2. It's pretty simple to setup and works great.
-Steve
________________________________________
From: Prasad Chakka [pchakka@facebook.com]
Sent: Thursday, June 11, 2009 5:05 PM
To: hive-user@hadoop.apache.org
Subject: Re: Setting up local repository w/ derby
I am not sure how to handle permanent storage in EC2 but you can run derby as a networked database similar to that of mysql. You can run derby server on the same node as jobtracker and when you are done with the cluster, you can copy the directory on which derby is running to a permanent place. When you need the metastore again in a new cluster setup, copy the file to any node in the cluster and then start the derby server on that file.
Instructions on how to setup a derby server are here http://wiki.apache.org/hadoop/HiveDerbyServerMode (derby docs @ http://db.apache.org/derby/docs/10.4/adminguide/cadminov825266.html)
Prasad
________________________________
From: Eva Tse <et...@netflix.com>
Reply-To: <hi...@hadoop.apache.org>
Date: Thu, 11 Jun 2009 09:21:12 -0700
To: <hi...@hadoop.apache.org>
Subject: Setting up local repository w/ derby
We would like to know how/if possible to use the embedded derby driver to setup a local repository. If so, what configuration could achieve this.
We want to test Hive on EC2 and don’t want to provision another machine on the cloud to run mysql for the metastore just yet.
Thanks!
Eva.
Re: Setting up local repository w/ derby
Posted by Prasad Chakka <pc...@facebook.com>.
I am not sure how to handle permanent storage in EC2 but you can run derby as a networked database similar to that of mysql. You can run derby server on the same node as jobtracker and when you are done with the cluster, you can copy the directory on which derby is running to a permanent place. When you need the metastore again in a new cluster setup, copy the file to any node in the cluster and then start the derby server on that file.
Instructions on how to setup a derby server are here http://wiki.apache.org/hadoop/HiveDerbyServerMode (derby docs @ http://db.apache.org/derby/docs/10.4/adminguide/cadminov825266.html)
Prasad
________________________________
From: Eva Tse <et...@netflix.com>
Reply-To: <hi...@hadoop.apache.org>
Date: Thu, 11 Jun 2009 09:21:12 -0700
To: <hi...@hadoop.apache.org>
Subject: Setting up local repository w/ derby
We would like to know how/if possible to use the embedded derby driver to setup a local repository. If so, what configuration could achieve this.
We want to test Hive on EC2 and don't want to provision another machine on the cloud to run mysql for the metastore just yet.
Thanks!
Eva.