You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Raj Hadoop <ha...@yahoo.com> on 2013/05/21 19:08:24 UTC
hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Thanks Sanjay
________________________________
From: Sanjay Subramanian <Sa...@wizecommerce.com>
To: bharath vissapragada <bh...@gmail.com>; "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 2:27 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi Raj
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Quick-Start/cdh4qs_topic_3.html
Installing CDH4 on a Single Linux Node in Pseudo-distributed Mode
On the left panel of the page u will find info on Hive installation etc.
I suggest CHD4 distribution only because it helps u to get started quickly…as developers I love to install from individual tar balls but sometimes there is little time to learn and execute
There are some great notes here
sanjay
From: bharath vissapragada <bh...@gmail.com>
Date: Tuesday, May 21, 2013 11:12 AM
To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
Cc: Sanjay Subramanian <sa...@wizecommerce.com>, User <us...@hadoop.apache.org>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Yes !
On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <ha...@yahoo.com> wrote:
So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
>
>
>
>From: Dean Wampler <de...@gmail.com>
>To: Raj Hadoop <ha...@yahoo.com>
>Cc: Sanjay Subramanian <Sa...@wizecommerce.com>; "user@hive.apache.org" <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 2:06 PM
>
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS.
>
>
>Also there's a typo in your hive.xml:
>
>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>
>Should be
>
>
> <value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
>
>
>On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Thanks Sanjay.
>>
>>My environment is like this.
>>
>>$ echo $HADOOP_HOME
>>/software/home/hadoop/hadoop/hadoop-1.1.2
>>
>>$ echo $HIVE_HOME
>>/software/home/hadoop/hive/hive-0.9.0
>>
>>$ id
>>uid=50052(hadoop) gid=600(apps) groups=600(apps)
>>
>>
>>So can i do like this:
>>
>>$pwd
>>/software/home/hadoop/hive/hive-0.9.0
>>
>>$mkdir warehouse
>>
>>$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>>
>>$ in hive-site.xml<property>
>> <name>hive.metastore.warehouse.dir</name>
>> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>> <description>location of default database for the warehouse</description>
>></property>
>>
>>Where should I create the HDFS directory ?
>>
>>
>>From: Sanjay Subramanian <Sa...@wizecommerce.com>
>>To: "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>; Dean Wampler <de...@gmail.com>
>>Cc: User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:53 PM
>>
>>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Notes below
>>
>>From: Raj Hadoop <ha...@yahoo.com>
>>Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
>>Date: Tuesday, May 21, 2013 10:49 AM
>>To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <us...@hive.apache.org>
>>Cc: User <us...@hadoop.apache.org>
>>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Ok.I got it. My questions -
>>
>>1) Should a local physical directory be created before using this property?
>>I created a directory in HDFS during Hive installation
>>/user/hive/warehouse
>>
>>
>>My hive-site.xml has the following property defined
>>
>>
>><property>
>> <name>hive.metastore.warehouse.dir</name>
>> <value>/user/hive/warehouse</value>
>> <description>location of default database for the warehouse</description>
>></property>
>>
>>2) Should a HDFS file directory be created from Hadoop before using this property?
>>hdfs dfs -mkdir /user/hive/warehouse
>>Change the owner:group to hive:hive
>>
>>
>>
>>From: Dean Wampler <de...@gmail.com>
>>To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
>>Cc: User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:44 PM
>>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
>>
>>
>>dean
>>
>>
>>On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>>
>>Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>>>
>>>
>>>
>>>From: Raj Hadoop <ha...@yahoo.com>
>>>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>>>Sent: Tuesday, May 21, 2013 1:08 PM
>>>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>>>
>>>
>>>
>>>Hi,
>>>
>>>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>>>
>>>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>>>
>>>Thanks,
>>>Raj
>>>
>>>
>>
>>
>>
>>--
>>Dean Wampler, Ph.D.
>>@deanwampler
>>http://polyglotprogramming.com/
>>
>>
>>
>>CONFIDENTIALITY NOTICE
>>======================
>>This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
>>
>>
>>
>
>
>
>--
>Dean Wampler, Ph.D.
>@deanwampler
>http://polyglotprogramming.com/
>
>
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Thanks Sanjay
________________________________
From: Sanjay Subramanian <Sa...@wizecommerce.com>
To: bharath vissapragada <bh...@gmail.com>; "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 2:27 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi Raj
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Quick-Start/cdh4qs_topic_3.html
Installing CDH4 on a Single Linux Node in Pseudo-distributed Mode
On the left panel of the page u will find info on Hive installation etc.
I suggest CHD4 distribution only because it helps u to get started quickly…as developers I love to install from individual tar balls but sometimes there is little time to learn and execute
There are some great notes here
sanjay
From: bharath vissapragada <bh...@gmail.com>
Date: Tuesday, May 21, 2013 11:12 AM
To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
Cc: Sanjay Subramanian <sa...@wizecommerce.com>, User <us...@hadoop.apache.org>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Yes !
On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <ha...@yahoo.com> wrote:
So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
>
>
>
>From: Dean Wampler <de...@gmail.com>
>To: Raj Hadoop <ha...@yahoo.com>
>Cc: Sanjay Subramanian <Sa...@wizecommerce.com>; "user@hive.apache.org" <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 2:06 PM
>
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS.
>
>
>Also there's a typo in your hive.xml:
>
>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>
>Should be
>
>
> <value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
>
>
>On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Thanks Sanjay.
>>
>>My environment is like this.
>>
>>$ echo $HADOOP_HOME
>>/software/home/hadoop/hadoop/hadoop-1.1.2
>>
>>$ echo $HIVE_HOME
>>/software/home/hadoop/hive/hive-0.9.0
>>
>>$ id
>>uid=50052(hadoop) gid=600(apps) groups=600(apps)
>>
>>
>>So can i do like this:
>>
>>$pwd
>>/software/home/hadoop/hive/hive-0.9.0
>>
>>$mkdir warehouse
>>
>>$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>>
>>$ in hive-site.xml<property>
>> <name>hive.metastore.warehouse.dir</name>
>> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>> <description>location of default database for the warehouse</description>
>></property>
>>
>>Where should I create the HDFS directory ?
>>
>>
>>From: Sanjay Subramanian <Sa...@wizecommerce.com>
>>To: "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>; Dean Wampler <de...@gmail.com>
>>Cc: User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:53 PM
>>
>>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Notes below
>>
>>From: Raj Hadoop <ha...@yahoo.com>
>>Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
>>Date: Tuesday, May 21, 2013 10:49 AM
>>To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <us...@hive.apache.org>
>>Cc: User <us...@hadoop.apache.org>
>>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Ok.I got it. My questions -
>>
>>1) Should a local physical directory be created before using this property?
>>I created a directory in HDFS during Hive installation
>>/user/hive/warehouse
>>
>>
>>My hive-site.xml has the following property defined
>>
>>
>><property>
>> <name>hive.metastore.warehouse.dir</name>
>> <value>/user/hive/warehouse</value>
>> <description>location of default database for the warehouse</description>
>></property>
>>
>>2) Should a HDFS file directory be created from Hadoop before using this property?
>>hdfs dfs -mkdir /user/hive/warehouse
>>Change the owner:group to hive:hive
>>
>>
>>
>>From: Dean Wampler <de...@gmail.com>
>>To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
>>Cc: User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:44 PM
>>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
>>
>>
>>dean
>>
>>
>>On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>>
>>Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>>>
>>>
>>>
>>>From: Raj Hadoop <ha...@yahoo.com>
>>>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>>>Sent: Tuesday, May 21, 2013 1:08 PM
>>>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>>>
>>>
>>>
>>>Hi,
>>>
>>>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>>>
>>>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>>>
>>>Thanks,
>>>Raj
>>>
>>>
>>
>>
>>
>>--
>>Dean Wampler, Ph.D.
>>@deanwampler
>>http://polyglotprogramming.com/
>>
>>
>>
>>CONFIDENTIALITY NOTICE
>>======================
>>This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
>>
>>
>>
>
>
>
>--
>Dean Wampler, Ph.D.
>@deanwampler
>http://polyglotprogramming.com/
>
>
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Thanks Sanjay
________________________________
From: Sanjay Subramanian <Sa...@wizecommerce.com>
To: bharath vissapragada <bh...@gmail.com>; "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 2:27 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi Raj
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Quick-Start/cdh4qs_topic_3.html
Installing CDH4 on a Single Linux Node in Pseudo-distributed Mode
On the left panel of the page u will find info on Hive installation etc.
I suggest CHD4 distribution only because it helps u to get started quickly…as developers I love to install from individual tar balls but sometimes there is little time to learn and execute
There are some great notes here
sanjay
From: bharath vissapragada <bh...@gmail.com>
Date: Tuesday, May 21, 2013 11:12 AM
To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
Cc: Sanjay Subramanian <sa...@wizecommerce.com>, User <us...@hadoop.apache.org>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Yes !
On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <ha...@yahoo.com> wrote:
So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
>
>
>
>From: Dean Wampler <de...@gmail.com>
>To: Raj Hadoop <ha...@yahoo.com>
>Cc: Sanjay Subramanian <Sa...@wizecommerce.com>; "user@hive.apache.org" <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 2:06 PM
>
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS.
>
>
>Also there's a typo in your hive.xml:
>
>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>
>Should be
>
>
> <value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
>
>
>On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Thanks Sanjay.
>>
>>My environment is like this.
>>
>>$ echo $HADOOP_HOME
>>/software/home/hadoop/hadoop/hadoop-1.1.2
>>
>>$ echo $HIVE_HOME
>>/software/home/hadoop/hive/hive-0.9.0
>>
>>$ id
>>uid=50052(hadoop) gid=600(apps) groups=600(apps)
>>
>>
>>So can i do like this:
>>
>>$pwd
>>/software/home/hadoop/hive/hive-0.9.0
>>
>>$mkdir warehouse
>>
>>$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>>
>>$ in hive-site.xml<property>
>> <name>hive.metastore.warehouse.dir</name>
>> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>> <description>location of default database for the warehouse</description>
>></property>
>>
>>Where should I create the HDFS directory ?
>>
>>
>>From: Sanjay Subramanian <Sa...@wizecommerce.com>
>>To: "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>; Dean Wampler <de...@gmail.com>
>>Cc: User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:53 PM
>>
>>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Notes below
>>
>>From: Raj Hadoop <ha...@yahoo.com>
>>Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
>>Date: Tuesday, May 21, 2013 10:49 AM
>>To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <us...@hive.apache.org>
>>Cc: User <us...@hadoop.apache.org>
>>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Ok.I got it. My questions -
>>
>>1) Should a local physical directory be created before using this property?
>>I created a directory in HDFS during Hive installation
>>/user/hive/warehouse
>>
>>
>>My hive-site.xml has the following property defined
>>
>>
>><property>
>> <name>hive.metastore.warehouse.dir</name>
>> <value>/user/hive/warehouse</value>
>> <description>location of default database for the warehouse</description>
>></property>
>>
>>2) Should a HDFS file directory be created from Hadoop before using this property?
>>hdfs dfs -mkdir /user/hive/warehouse
>>Change the owner:group to hive:hive
>>
>>
>>
>>From: Dean Wampler <de...@gmail.com>
>>To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
>>Cc: User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:44 PM
>>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
>>
>>
>>dean
>>
>>
>>On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>>
>>Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>>>
>>>
>>>
>>>From: Raj Hadoop <ha...@yahoo.com>
>>>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>>>Sent: Tuesday, May 21, 2013 1:08 PM
>>>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>>>
>>>
>>>
>>>Hi,
>>>
>>>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>>>
>>>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>>>
>>>Thanks,
>>>Raj
>>>
>>>
>>
>>
>>
>>--
>>Dean Wampler, Ph.D.
>>@deanwampler
>>http://polyglotprogramming.com/
>>
>>
>>
>>CONFIDENTIALITY NOTICE
>>======================
>>This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
>>
>>
>>
>
>
>
>--
>Dean Wampler, Ph.D.
>@deanwampler
>http://polyglotprogramming.com/
>
>
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Thanks Sanjay
________________________________
From: Sanjay Subramanian <Sa...@wizecommerce.com>
To: bharath vissapragada <bh...@gmail.com>; "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 2:27 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi Raj
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Quick-Start/cdh4qs_topic_3.html
Installing CDH4 on a Single Linux Node in Pseudo-distributed Mode
On the left panel of the page u will find info on Hive installation etc.
I suggest CHD4 distribution only because it helps u to get started quickly…as developers I love to install from individual tar balls but sometimes there is little time to learn and execute
There are some great notes here
sanjay
From: bharath vissapragada <bh...@gmail.com>
Date: Tuesday, May 21, 2013 11:12 AM
To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
Cc: Sanjay Subramanian <sa...@wizecommerce.com>, User <us...@hadoop.apache.org>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Yes !
On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <ha...@yahoo.com> wrote:
So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
>
>
>
>From: Dean Wampler <de...@gmail.com>
>To: Raj Hadoop <ha...@yahoo.com>
>Cc: Sanjay Subramanian <Sa...@wizecommerce.com>; "user@hive.apache.org" <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 2:06 PM
>
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS.
>
>
>Also there's a typo in your hive.xml:
>
>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>
>Should be
>
>
> <value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
>
>
>On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Thanks Sanjay.
>>
>>My environment is like this.
>>
>>$ echo $HADOOP_HOME
>>/software/home/hadoop/hadoop/hadoop-1.1.2
>>
>>$ echo $HIVE_HOME
>>/software/home/hadoop/hive/hive-0.9.0
>>
>>$ id
>>uid=50052(hadoop) gid=600(apps) groups=600(apps)
>>
>>
>>So can i do like this:
>>
>>$pwd
>>/software/home/hadoop/hive/hive-0.9.0
>>
>>$mkdir warehouse
>>
>>$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>>
>>$ in hive-site.xml<property>
>> <name>hive.metastore.warehouse.dir</name>
>> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>> <description>location of default database for the warehouse</description>
>></property>
>>
>>Where should I create the HDFS directory ?
>>
>>
>>From: Sanjay Subramanian <Sa...@wizecommerce.com>
>>To: "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>; Dean Wampler <de...@gmail.com>
>>Cc: User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:53 PM
>>
>>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Notes below
>>
>>From: Raj Hadoop <ha...@yahoo.com>
>>Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
>>Date: Tuesday, May 21, 2013 10:49 AM
>>To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <us...@hive.apache.org>
>>Cc: User <us...@hadoop.apache.org>
>>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Ok.I got it. My questions -
>>
>>1) Should a local physical directory be created before using this property?
>>I created a directory in HDFS during Hive installation
>>/user/hive/warehouse
>>
>>
>>My hive-site.xml has the following property defined
>>
>>
>><property>
>> <name>hive.metastore.warehouse.dir</name>
>> <value>/user/hive/warehouse</value>
>> <description>location of default database for the warehouse</description>
>></property>
>>
>>2) Should a HDFS file directory be created from Hadoop before using this property?
>>hdfs dfs -mkdir /user/hive/warehouse
>>Change the owner:group to hive:hive
>>
>>
>>
>>From: Dean Wampler <de...@gmail.com>
>>To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
>>Cc: User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:44 PM
>>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
>>
>>
>>dean
>>
>>
>>On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>>
>>Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>>>
>>>
>>>
>>>From: Raj Hadoop <ha...@yahoo.com>
>>>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>>>Sent: Tuesday, May 21, 2013 1:08 PM
>>>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>>>
>>>
>>>
>>>Hi,
>>>
>>>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>>>
>>>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>>>
>>>Thanks,
>>>Raj
>>>
>>>
>>
>>
>>
>>--
>>Dean Wampler, Ph.D.
>>@deanwampler
>>http://polyglotprogramming.com/
>>
>>
>>
>>CONFIDENTIALITY NOTICE
>>======================
>>This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
>>
>>
>>
>
>
>
>--
>Dean Wampler, Ph.D.
>@deanwampler
>http://polyglotprogramming.com/
>
>
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Thanks Sanjay
________________________________
From: Sanjay Subramanian <Sa...@wizecommerce.com>
To: bharath vissapragada <bh...@gmail.com>; "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 2:27 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi Raj
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Quick-Start/cdh4qs_topic_3.html
Installing CDH4 on a Single Linux Node in Pseudo-distributed Mode
On the left panel of the page u will find info on Hive installation etc.
I suggest CHD4 distribution only because it helps u to get started quickly…as developers I love to install from individual tar balls but sometimes there is little time to learn and execute
There are some great notes here
sanjay
From: bharath vissapragada <bh...@gmail.com>
Date: Tuesday, May 21, 2013 11:12 AM
To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
Cc: Sanjay Subramanian <sa...@wizecommerce.com>, User <us...@hadoop.apache.org>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Yes !
On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <ha...@yahoo.com> wrote:
So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
>
>
>
>From: Dean Wampler <de...@gmail.com>
>To: Raj Hadoop <ha...@yahoo.com>
>Cc: Sanjay Subramanian <Sa...@wizecommerce.com>; "user@hive.apache.org" <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 2:06 PM
>
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS.
>
>
>Also there's a typo in your hive.xml:
>
>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>
>Should be
>
>
> <value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
>
>
>On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Thanks Sanjay.
>>
>>My environment is like this.
>>
>>$ echo $HADOOP_HOME
>>/software/home/hadoop/hadoop/hadoop-1.1.2
>>
>>$ echo $HIVE_HOME
>>/software/home/hadoop/hive/hive-0.9.0
>>
>>$ id
>>uid=50052(hadoop) gid=600(apps) groups=600(apps)
>>
>>
>>So can i do like this:
>>
>>$pwd
>>/software/home/hadoop/hive/hive-0.9.0
>>
>>$mkdir warehouse
>>
>>$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>>
>>$ in hive-site.xml<property>
>> <name>hive.metastore.warehouse.dir</name>
>> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>> <description>location of default database for the warehouse</description>
>></property>
>>
>>Where should I create the HDFS directory ?
>>
>>
>>From: Sanjay Subramanian <Sa...@wizecommerce.com>
>>To: "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>; Dean Wampler <de...@gmail.com>
>>Cc: User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:53 PM
>>
>>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Notes below
>>
>>From: Raj Hadoop <ha...@yahoo.com>
>>Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
>>Date: Tuesday, May 21, 2013 10:49 AM
>>To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <us...@hive.apache.org>
>>Cc: User <us...@hadoop.apache.org>
>>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Ok.I got it. My questions -
>>
>>1) Should a local physical directory be created before using this property?
>>I created a directory in HDFS during Hive installation
>>/user/hive/warehouse
>>
>>
>>My hive-site.xml has the following property defined
>>
>>
>><property>
>> <name>hive.metastore.warehouse.dir</name>
>> <value>/user/hive/warehouse</value>
>> <description>location of default database for the warehouse</description>
>></property>
>>
>>2) Should a HDFS file directory be created from Hadoop before using this property?
>>hdfs dfs -mkdir /user/hive/warehouse
>>Change the owner:group to hive:hive
>>
>>
>>
>>From: Dean Wampler <de...@gmail.com>
>>To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
>>Cc: User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:44 PM
>>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
>>
>>
>>dean
>>
>>
>>On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>>
>>Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>>>
>>>
>>>
>>>From: Raj Hadoop <ha...@yahoo.com>
>>>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>>>Sent: Tuesday, May 21, 2013 1:08 PM
>>>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>>>
>>>
>>>
>>>Hi,
>>>
>>>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>>>
>>>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>>>
>>>Thanks,
>>>Raj
>>>
>>>
>>
>>
>>
>>--
>>Dean Wampler, Ph.D.
>>@deanwampler
>>http://polyglotprogramming.com/
>>
>>
>>
>>CONFIDENTIALITY NOTICE
>>======================
>>This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
>>
>>
>>
>
>
>
>--
>Dean Wampler, Ph.D.
>@deanwampler
>http://polyglotprogramming.com/
>
>
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical
directory
Posted by Sanjay Subramanian <Sa...@wizecommerce.com>.
Hi Raj
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Quick-Start/cdh4qs_topic_3.html
Installing CDH4 on a Single Linux Node in Pseudo-distributed Mode
On the left panel of the page u will find info on Hive installation etc.
I suggest CHD4 distribution only because it helps u to get started quickly…as developers I love to install from individual tar balls but sometimes there is little time to learn and execute
There are some great notes here
sanjay
From: bharath vissapragada <bh...@gmail.com>>
Date: Tuesday, May 21, 2013 11:12 AM
To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>, Raj Hadoop <ha...@yahoo.com>>
Cc: Sanjay Subramanian <sa...@wizecommerce.com>>, User <us...@hadoop.apache.org>>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Yes !
On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
From: Dean Wampler <de...@gmail.com>>
To: Raj Hadoop <ha...@yahoo.com>>
Cc: Sanjay Subramanian <Sa...@wizecommerce.com>>; "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>; User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 2:06 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS.
Also there's a typo in your hive.xml:
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
Should be
<value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
Thanks Sanjay.
My environment is like this.
$ echo $HADOOP_HOME
/software/home/hadoop/hadoop/hadoop-1.1.2
$ echo $HIVE_HOME
/software/home/hadoop/hive/hive-0.9.0
$ id
uid=50052(hadoop) gid=600(apps) groups=600(apps)
So can i do like this:
$pwd
/software/home/hadoop/hive/hive-0.9.0
$mkdir warehouse
$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
$ in hive-site.xml
<property>
<name>hive.metastore.warehouse.dir</name>
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
Where should I create the HDFS directory ?
From: Sanjay Subramanian <Sa...@wizecommerce.com>>
To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>; Raj Hadoop <ha...@yahoo.com>>; Dean Wampler <de...@gmail.com>>
Cc: User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:53 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Notes below
From: Raj Hadoop <ha...@yahoo.com>>
Reply-To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>, Raj Hadoop <ha...@yahoo.com>>
Date: Tuesday, May 21, 2013 10:49 AM
To: Dean Wampler <de...@gmail.com>>, "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Cc: User <us...@hadoop.apache.org>>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
I created a directory in HDFS during Hive installation
/user/hive/warehouse
My hive-site.xml has the following property defined
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
2) Should a HDFS file directory be created from Hadoop before using this property?
hdfs dfs -mkdir /user/hive/warehouse
Change the owner:group to hive:hive
From: Dean Wampler <de...@gmail.com>>
To: user@hive.apache.org<ma...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>>
Cc: User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
From: Raj Hadoop <ha...@yahoo.com>>
To: Hive <us...@hive.apache.org>>; User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:08 PM
Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name<http://fs.default.name/>. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical
directory
Posted by Sanjay Subramanian <Sa...@wizecommerce.com>.
Hi Raj
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Quick-Start/cdh4qs_topic_3.html
Installing CDH4 on a Single Linux Node in Pseudo-distributed Mode
On the left panel of the page u will find info on Hive installation etc.
I suggest CHD4 distribution only because it helps u to get started quickly…as developers I love to install from individual tar balls but sometimes there is little time to learn and execute
There are some great notes here
sanjay
From: bharath vissapragada <bh...@gmail.com>>
Date: Tuesday, May 21, 2013 11:12 AM
To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>, Raj Hadoop <ha...@yahoo.com>>
Cc: Sanjay Subramanian <sa...@wizecommerce.com>>, User <us...@hadoop.apache.org>>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Yes !
On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
From: Dean Wampler <de...@gmail.com>>
To: Raj Hadoop <ha...@yahoo.com>>
Cc: Sanjay Subramanian <Sa...@wizecommerce.com>>; "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>; User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 2:06 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS.
Also there's a typo in your hive.xml:
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
Should be
<value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
Thanks Sanjay.
My environment is like this.
$ echo $HADOOP_HOME
/software/home/hadoop/hadoop/hadoop-1.1.2
$ echo $HIVE_HOME
/software/home/hadoop/hive/hive-0.9.0
$ id
uid=50052(hadoop) gid=600(apps) groups=600(apps)
So can i do like this:
$pwd
/software/home/hadoop/hive/hive-0.9.0
$mkdir warehouse
$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
$ in hive-site.xml
<property>
<name>hive.metastore.warehouse.dir</name>
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
Where should I create the HDFS directory ?
From: Sanjay Subramanian <Sa...@wizecommerce.com>>
To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>; Raj Hadoop <ha...@yahoo.com>>; Dean Wampler <de...@gmail.com>>
Cc: User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:53 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Notes below
From: Raj Hadoop <ha...@yahoo.com>>
Reply-To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>, Raj Hadoop <ha...@yahoo.com>>
Date: Tuesday, May 21, 2013 10:49 AM
To: Dean Wampler <de...@gmail.com>>, "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Cc: User <us...@hadoop.apache.org>>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
I created a directory in HDFS during Hive installation
/user/hive/warehouse
My hive-site.xml has the following property defined
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
2) Should a HDFS file directory be created from Hadoop before using this property?
hdfs dfs -mkdir /user/hive/warehouse
Change the owner:group to hive:hive
From: Dean Wampler <de...@gmail.com>>
To: user@hive.apache.org<ma...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>>
Cc: User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
From: Raj Hadoop <ha...@yahoo.com>>
To: Hive <us...@hive.apache.org>>; User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:08 PM
Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name<http://fs.default.name/>. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical
directory
Posted by Sanjay Subramanian <Sa...@wizecommerce.com>.
Hi Raj
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Quick-Start/cdh4qs_topic_3.html
Installing CDH4 on a Single Linux Node in Pseudo-distributed Mode
On the left panel of the page u will find info on Hive installation etc.
I suggest CHD4 distribution only because it helps u to get started quickly…as developers I love to install from individual tar balls but sometimes there is little time to learn and execute
There are some great notes here
sanjay
From: bharath vissapragada <bh...@gmail.com>>
Date: Tuesday, May 21, 2013 11:12 AM
To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>, Raj Hadoop <ha...@yahoo.com>>
Cc: Sanjay Subramanian <sa...@wizecommerce.com>>, User <us...@hadoop.apache.org>>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Yes !
On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
From: Dean Wampler <de...@gmail.com>>
To: Raj Hadoop <ha...@yahoo.com>>
Cc: Sanjay Subramanian <Sa...@wizecommerce.com>>; "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>; User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 2:06 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS.
Also there's a typo in your hive.xml:
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
Should be
<value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
Thanks Sanjay.
My environment is like this.
$ echo $HADOOP_HOME
/software/home/hadoop/hadoop/hadoop-1.1.2
$ echo $HIVE_HOME
/software/home/hadoop/hive/hive-0.9.0
$ id
uid=50052(hadoop) gid=600(apps) groups=600(apps)
So can i do like this:
$pwd
/software/home/hadoop/hive/hive-0.9.0
$mkdir warehouse
$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
$ in hive-site.xml
<property>
<name>hive.metastore.warehouse.dir</name>
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
Where should I create the HDFS directory ?
From: Sanjay Subramanian <Sa...@wizecommerce.com>>
To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>; Raj Hadoop <ha...@yahoo.com>>; Dean Wampler <de...@gmail.com>>
Cc: User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:53 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Notes below
From: Raj Hadoop <ha...@yahoo.com>>
Reply-To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>, Raj Hadoop <ha...@yahoo.com>>
Date: Tuesday, May 21, 2013 10:49 AM
To: Dean Wampler <de...@gmail.com>>, "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Cc: User <us...@hadoop.apache.org>>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
I created a directory in HDFS during Hive installation
/user/hive/warehouse
My hive-site.xml has the following property defined
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
2) Should a HDFS file directory be created from Hadoop before using this property?
hdfs dfs -mkdir /user/hive/warehouse
Change the owner:group to hive:hive
From: Dean Wampler <de...@gmail.com>>
To: user@hive.apache.org<ma...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>>
Cc: User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
From: Raj Hadoop <ha...@yahoo.com>>
To: Hive <us...@hive.apache.org>>; User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:08 PM
Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name<http://fs.default.name/>. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical
directory
Posted by Sanjay Subramanian <Sa...@wizecommerce.com>.
Hi Raj
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Quick-Start/cdh4qs_topic_3.html
Installing CDH4 on a Single Linux Node in Pseudo-distributed Mode
On the left panel of the page u will find info on Hive installation etc.
I suggest CHD4 distribution only because it helps u to get started quickly…as developers I love to install from individual tar balls but sometimes there is little time to learn and execute
There are some great notes here
sanjay
From: bharath vissapragada <bh...@gmail.com>>
Date: Tuesday, May 21, 2013 11:12 AM
To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>, Raj Hadoop <ha...@yahoo.com>>
Cc: Sanjay Subramanian <sa...@wizecommerce.com>>, User <us...@hadoop.apache.org>>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Yes !
On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
From: Dean Wampler <de...@gmail.com>>
To: Raj Hadoop <ha...@yahoo.com>>
Cc: Sanjay Subramanian <Sa...@wizecommerce.com>>; "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>; User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 2:06 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS.
Also there's a typo in your hive.xml:
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
Should be
<value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
Thanks Sanjay.
My environment is like this.
$ echo $HADOOP_HOME
/software/home/hadoop/hadoop/hadoop-1.1.2
$ echo $HIVE_HOME
/software/home/hadoop/hive/hive-0.9.0
$ id
uid=50052(hadoop) gid=600(apps) groups=600(apps)
So can i do like this:
$pwd
/software/home/hadoop/hive/hive-0.9.0
$mkdir warehouse
$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
$ in hive-site.xml
<property>
<name>hive.metastore.warehouse.dir</name>
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
Where should I create the HDFS directory ?
From: Sanjay Subramanian <Sa...@wizecommerce.com>>
To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>; Raj Hadoop <ha...@yahoo.com>>; Dean Wampler <de...@gmail.com>>
Cc: User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:53 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Notes below
From: Raj Hadoop <ha...@yahoo.com>>
Reply-To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>, Raj Hadoop <ha...@yahoo.com>>
Date: Tuesday, May 21, 2013 10:49 AM
To: Dean Wampler <de...@gmail.com>>, "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Cc: User <us...@hadoop.apache.org>>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
I created a directory in HDFS during Hive installation
/user/hive/warehouse
My hive-site.xml has the following property defined
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
2) Should a HDFS file directory be created from Hadoop before using this property?
hdfs dfs -mkdir /user/hive/warehouse
Change the owner:group to hive:hive
From: Dean Wampler <de...@gmail.com>>
To: user@hive.apache.org<ma...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>>
Cc: User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
From: Raj Hadoop <ha...@yahoo.com>>
To: Hive <us...@hive.apache.org>>; User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:08 PM
Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name<http://fs.default.name/>. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical
directory
Posted by Sanjay Subramanian <Sa...@wizecommerce.com>.
Hi Raj
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Quick-Start/cdh4qs_topic_3.html
Installing CDH4 on a Single Linux Node in Pseudo-distributed Mode
On the left panel of the page u will find info on Hive installation etc.
I suggest CHD4 distribution only because it helps u to get started quickly…as developers I love to install from individual tar balls but sometimes there is little time to learn and execute
There are some great notes here
sanjay
From: bharath vissapragada <bh...@gmail.com>>
Date: Tuesday, May 21, 2013 11:12 AM
To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>, Raj Hadoop <ha...@yahoo.com>>
Cc: Sanjay Subramanian <sa...@wizecommerce.com>>, User <us...@hadoop.apache.org>>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Yes !
On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
From: Dean Wampler <de...@gmail.com>>
To: Raj Hadoop <ha...@yahoo.com>>
Cc: Sanjay Subramanian <Sa...@wizecommerce.com>>; "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>; User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 2:06 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS.
Also there's a typo in your hive.xml:
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
Should be
<value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
Thanks Sanjay.
My environment is like this.
$ echo $HADOOP_HOME
/software/home/hadoop/hadoop/hadoop-1.1.2
$ echo $HIVE_HOME
/software/home/hadoop/hive/hive-0.9.0
$ id
uid=50052(hadoop) gid=600(apps) groups=600(apps)
So can i do like this:
$pwd
/software/home/hadoop/hive/hive-0.9.0
$mkdir warehouse
$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
$ in hive-site.xml
<property>
<name>hive.metastore.warehouse.dir</name>
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
Where should I create the HDFS directory ?
From: Sanjay Subramanian <Sa...@wizecommerce.com>>
To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>; Raj Hadoop <ha...@yahoo.com>>; Dean Wampler <de...@gmail.com>>
Cc: User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:53 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Notes below
From: Raj Hadoop <ha...@yahoo.com>>
Reply-To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>, Raj Hadoop <ha...@yahoo.com>>
Date: Tuesday, May 21, 2013 10:49 AM
To: Dean Wampler <de...@gmail.com>>, "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Cc: User <us...@hadoop.apache.org>>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
I created a directory in HDFS during Hive installation
/user/hive/warehouse
My hive-site.xml has the following property defined
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
2) Should a HDFS file directory be created from Hadoop before using this property?
hdfs dfs -mkdir /user/hive/warehouse
Change the owner:group to hive:hive
From: Dean Wampler <de...@gmail.com>>
To: user@hive.apache.org<ma...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>>
Cc: User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
From: Raj Hadoop <ha...@yahoo.com>>
To: Hive <us...@hive.apache.org>>; User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:08 PM
Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name<http://fs.default.name/>. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by bharath vissapragada <bh...@gmail.com>.
Yes !
On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> So that means I need to create a HDFS ( Not an OS physical directory )
> directory under Hadoop that need to be used in the Hive config file for
> this property. Right?
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* Raj Hadoop <ha...@yahoo.com>
> *Cc:* Sanjay Subramanian <Sa...@wizecommerce.com>; "
> user@hive.apache.org" <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>
> *Sent:* Tuesday, May 21, 2013 2:06 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> No, you only need a directory in HDFS, which will be "virtually located"
> somewhere in your cluster automatically by HDFS.
>
> Also there's a typo in your hive.xml:
>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>
> Should be
>
> <value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
>
> On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Thanks Sanjay.
>
> My environment is like this.
>
> $ echo $HADOOP_HOME
> /software/home/hadoop/hadoop/hadoop-1.1.2
>
> $ echo $HIVE_HOME
> /software/home/hadoop/hive/hive-0.9.0
>
> $ id
> uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
> So can i do like this:
>
> $pwd
> /software/home/hadoop/hive/hive-0.9.0
>
> $mkdir warehouse
>
> $cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
> $ in hive-site.xml
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> Where should I create the HDFS directory ?
>
>
> *From:* Sanjay Subramanian <Sa...@wizecommerce.com>
> *To:* "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>; Dean Wampler <de...@gmail.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:53 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> Notes below
>
> From: Raj Hadoop <ha...@yahoo.com>
> Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <
> hadoopraj@yahoo.com>
> Date: Tuesday, May 21, 2013 10:49 AM
> To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <
> user@hive.apache.org>
> Cc: User <us...@hadoop.apache.org>
> Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
> I created a directory in HDFS during Hive installation
> /user/hive/warehouse
>
> My hive-site.xml has the following property defined
>
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value>/user/hive/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> 2) Should a HDFS file directory be created from Hadoop before using
> this property?
> hdfs dfs -mkdir /user/hive/warehouse
> Change the owner:group to hive:hive
>
>
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
> CONFIDENTIALITY NOTICE
> ======================
> This email message and any attachments are for the exclusive use of the
> intended recipient(s) and may contain confidential and privileged
> information. Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the intended recipient, please contact the
> sender by reply email and destroy all copies of the original message along
> with any attachments, from your computer system. If you are the intended
> recipient, please be advised that the content of this message is subject to
> access, review and disclosure by the sender's Email System Administrator.
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by bharath vissapragada <bh...@gmail.com>.
Yes !
On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> So that means I need to create a HDFS ( Not an OS physical directory )
> directory under Hadoop that need to be used in the Hive config file for
> this property. Right?
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* Raj Hadoop <ha...@yahoo.com>
> *Cc:* Sanjay Subramanian <Sa...@wizecommerce.com>; "
> user@hive.apache.org" <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>
> *Sent:* Tuesday, May 21, 2013 2:06 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> No, you only need a directory in HDFS, which will be "virtually located"
> somewhere in your cluster automatically by HDFS.
>
> Also there's a typo in your hive.xml:
>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>
> Should be
>
> <value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
>
> On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Thanks Sanjay.
>
> My environment is like this.
>
> $ echo $HADOOP_HOME
> /software/home/hadoop/hadoop/hadoop-1.1.2
>
> $ echo $HIVE_HOME
> /software/home/hadoop/hive/hive-0.9.0
>
> $ id
> uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
> So can i do like this:
>
> $pwd
> /software/home/hadoop/hive/hive-0.9.0
>
> $mkdir warehouse
>
> $cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
> $ in hive-site.xml
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> Where should I create the HDFS directory ?
>
>
> *From:* Sanjay Subramanian <Sa...@wizecommerce.com>
> *To:* "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>; Dean Wampler <de...@gmail.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:53 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> Notes below
>
> From: Raj Hadoop <ha...@yahoo.com>
> Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <
> hadoopraj@yahoo.com>
> Date: Tuesday, May 21, 2013 10:49 AM
> To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <
> user@hive.apache.org>
> Cc: User <us...@hadoop.apache.org>
> Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
> I created a directory in HDFS during Hive installation
> /user/hive/warehouse
>
> My hive-site.xml has the following property defined
>
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value>/user/hive/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> 2) Should a HDFS file directory be created from Hadoop before using
> this property?
> hdfs dfs -mkdir /user/hive/warehouse
> Change the owner:group to hive:hive
>
>
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
> CONFIDENTIALITY NOTICE
> ======================
> This email message and any attachments are for the exclusive use of the
> intended recipient(s) and may contain confidential and privileged
> information. Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the intended recipient, please contact the
> sender by reply email and destroy all copies of the original message along
> with any attachments, from your computer system. If you are the intended
> recipient, please be advised that the content of this message is subject to
> access, review and disclosure by the sender's Email System Administrator.
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by bharath vissapragada <bh...@gmail.com>.
Yes !
On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> So that means I need to create a HDFS ( Not an OS physical directory )
> directory under Hadoop that need to be used in the Hive config file for
> this property. Right?
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* Raj Hadoop <ha...@yahoo.com>
> *Cc:* Sanjay Subramanian <Sa...@wizecommerce.com>; "
> user@hive.apache.org" <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>
> *Sent:* Tuesday, May 21, 2013 2:06 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> No, you only need a directory in HDFS, which will be "virtually located"
> somewhere in your cluster automatically by HDFS.
>
> Also there's a typo in your hive.xml:
>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>
> Should be
>
> <value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
>
> On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Thanks Sanjay.
>
> My environment is like this.
>
> $ echo $HADOOP_HOME
> /software/home/hadoop/hadoop/hadoop-1.1.2
>
> $ echo $HIVE_HOME
> /software/home/hadoop/hive/hive-0.9.0
>
> $ id
> uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
> So can i do like this:
>
> $pwd
> /software/home/hadoop/hive/hive-0.9.0
>
> $mkdir warehouse
>
> $cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
> $ in hive-site.xml
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> Where should I create the HDFS directory ?
>
>
> *From:* Sanjay Subramanian <Sa...@wizecommerce.com>
> *To:* "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>; Dean Wampler <de...@gmail.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:53 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> Notes below
>
> From: Raj Hadoop <ha...@yahoo.com>
> Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <
> hadoopraj@yahoo.com>
> Date: Tuesday, May 21, 2013 10:49 AM
> To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <
> user@hive.apache.org>
> Cc: User <us...@hadoop.apache.org>
> Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
> I created a directory in HDFS during Hive installation
> /user/hive/warehouse
>
> My hive-site.xml has the following property defined
>
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value>/user/hive/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> 2) Should a HDFS file directory be created from Hadoop before using
> this property?
> hdfs dfs -mkdir /user/hive/warehouse
> Change the owner:group to hive:hive
>
>
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
> CONFIDENTIALITY NOTICE
> ======================
> This email message and any attachments are for the exclusive use of the
> intended recipient(s) and may contain confidential and privileged
> information. Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the intended recipient, please contact the
> sender by reply email and destroy all copies of the original message along
> with any attachments, from your computer system. If you are the intended
> recipient, please be advised that the content of this message is subject to
> access, review and disclosure by the sender's Email System Administrator.
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by bharath vissapragada <bh...@gmail.com>.
Yes !
On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> So that means I need to create a HDFS ( Not an OS physical directory )
> directory under Hadoop that need to be used in the Hive config file for
> this property. Right?
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* Raj Hadoop <ha...@yahoo.com>
> *Cc:* Sanjay Subramanian <Sa...@wizecommerce.com>; "
> user@hive.apache.org" <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>
> *Sent:* Tuesday, May 21, 2013 2:06 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> No, you only need a directory in HDFS, which will be "virtually located"
> somewhere in your cluster automatically by HDFS.
>
> Also there's a typo in your hive.xml:
>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>
> Should be
>
> <value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
>
> On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Thanks Sanjay.
>
> My environment is like this.
>
> $ echo $HADOOP_HOME
> /software/home/hadoop/hadoop/hadoop-1.1.2
>
> $ echo $HIVE_HOME
> /software/home/hadoop/hive/hive-0.9.0
>
> $ id
> uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
> So can i do like this:
>
> $pwd
> /software/home/hadoop/hive/hive-0.9.0
>
> $mkdir warehouse
>
> $cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
> $ in hive-site.xml
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> Where should I create the HDFS directory ?
>
>
> *From:* Sanjay Subramanian <Sa...@wizecommerce.com>
> *To:* "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>; Dean Wampler <de...@gmail.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:53 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> Notes below
>
> From: Raj Hadoop <ha...@yahoo.com>
> Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <
> hadoopraj@yahoo.com>
> Date: Tuesday, May 21, 2013 10:49 AM
> To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <
> user@hive.apache.org>
> Cc: User <us...@hadoop.apache.org>
> Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
> I created a directory in HDFS during Hive installation
> /user/hive/warehouse
>
> My hive-site.xml has the following property defined
>
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value>/user/hive/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> 2) Should a HDFS file directory be created from Hadoop before using
> this property?
> hdfs dfs -mkdir /user/hive/warehouse
> Change the owner:group to hive:hive
>
>
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
> CONFIDENTIALITY NOTICE
> ======================
> This email message and any attachments are for the exclusive use of the
> intended recipient(s) and may contain confidential and privileged
> information. Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the intended recipient, please contact the
> sender by reply email and destroy all copies of the original message along
> with any attachments, from your computer system. If you are the intended
> recipient, please be advised that the content of this message is subject to
> access, review and disclosure by the sender's Email System Administrator.
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by bharath vissapragada <bh...@gmail.com>.
Yes !
On Tue, May 21, 2013 at 11:41 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> So that means I need to create a HDFS ( Not an OS physical directory )
> directory under Hadoop that need to be used in the Hive config file for
> this property. Right?
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* Raj Hadoop <ha...@yahoo.com>
> *Cc:* Sanjay Subramanian <Sa...@wizecommerce.com>; "
> user@hive.apache.org" <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>
> *Sent:* Tuesday, May 21, 2013 2:06 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> No, you only need a directory in HDFS, which will be "virtually located"
> somewhere in your cluster automatically by HDFS.
>
> Also there's a typo in your hive.xml:
>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
>
> Should be
>
> <value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
>
> On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Thanks Sanjay.
>
> My environment is like this.
>
> $ echo $HADOOP_HOME
> /software/home/hadoop/hadoop/hadoop-1.1.2
>
> $ echo $HIVE_HOME
> /software/home/hadoop/hive/hive-0.9.0
>
> $ id
> uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
> So can i do like this:
>
> $pwd
> /software/home/hadoop/hive/hive-0.9.0
>
> $mkdir warehouse
>
> $cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
> $ in hive-site.xml
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> Where should I create the HDFS directory ?
>
>
> *From:* Sanjay Subramanian <Sa...@wizecommerce.com>
> *To:* "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>; Dean Wampler <de...@gmail.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:53 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> Notes below
>
> From: Raj Hadoop <ha...@yahoo.com>
> Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <
> hadoopraj@yahoo.com>
> Date: Tuesday, May 21, 2013 10:49 AM
> To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <
> user@hive.apache.org>
> Cc: User <us...@hadoop.apache.org>
> Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
> I created a directory in HDFS during Hive installation
> /user/hive/warehouse
>
> My hive-site.xml has the following property defined
>
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value>/user/hive/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> 2) Should a HDFS file directory be created from Hadoop before using
> this property?
> hdfs dfs -mkdir /user/hive/warehouse
> Change the owner:group to hive:hive
>
>
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
> CONFIDENTIALITY NOTICE
> ======================
> This email message and any attachments are for the exclusive use of the
> intended recipient(s) and may contain confidential and privileged
> information. Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the intended recipient, please contact the
> sender by reply email and destroy all copies of the original message along
> with any attachments, from your computer system. If you are the intended
> recipient, please be advised that the content of this message is subject to
> access, review and disclosure by the sender's Email System Administrator.
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
________________________________
From: Dean Wampler <de...@gmail.com>
To: Raj Hadoop <ha...@yahoo.com>
Cc: Sanjay Subramanian <Sa...@wizecommerce.com>; "user@hive.apache.org" <us...@hive.apache.org>; User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 2:06 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS.
Also there's a typo in your hive.xml:
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
Should be
<value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Thanks Sanjay.
>
>My environment is like this.
>
>$ echo $HADOOP_HOME
>/software/home/hadoop/hadoop/hadoop-1.1.2
>
>$ echo $HIVE_HOME
>/software/home/hadoop/hive/hive-0.9.0
>
>$ id
>uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
>
>So can i do like this:
>
>$pwd
>/software/home/hadoop/hive/hive-0.9.0
>
>$mkdir warehouse
>
>$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
>$ in hive-site.xml<property>
> <name>hive.metastore.warehouse.dir</name>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
> <description>location of default database for the warehouse</description>
></property>
>
>Where should I create the HDFS directory ?
>
>
>From: Sanjay Subramanian <Sa...@wizecommerce.com>
>To: "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>; Dean Wampler <de...@gmail.com>
>Cc: User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:53 PM
>
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Notes below
>
>From: Raj Hadoop <ha...@yahoo.com>
>Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
>Date: Tuesday, May 21, 2013 10:49 AM
>To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <us...@hive.apache.org>
>Cc: User <us...@hadoop.apache.org>
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Ok.I got it. My questions -
>
>1) Should a local physical directory be created before using this property?
>I created a directory in HDFS during Hive installation
>/user/hive/warehouse
>
>
>My hive-site.xml has the following property defined
>
>
><property>
> <name>hive.metastore.warehouse.dir</name>
> <value>/user/hive/warehouse</value>
> <description>location of default database for the warehouse</description>
></property>
>
>2) Should a HDFS file directory be created from Hadoop before using this property?
>hdfs dfs -mkdir /user/hive/warehouse
>Change the owner:group to hive:hive
>
>
>
>From: Dean Wampler <de...@gmail.com>
>To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
>Cc: User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:44 PM
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
>
>
>dean
>
>
>On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>>
>>
>>
>>From: Raj Hadoop <ha...@yahoo.com>
>>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:08 PM
>>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Hi,
>>
>>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>>
>>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>>
>>Thanks,
>>Raj
>>
>>
>
>
>
>--
>Dean Wampler, Ph.D.
>@deanwampler
>http://polyglotprogramming.com/
>
>
>
>CONFIDENTIALITY NOTICE
>======================
>This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
>
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
________________________________
From: Dean Wampler <de...@gmail.com>
To: Raj Hadoop <ha...@yahoo.com>
Cc: Sanjay Subramanian <Sa...@wizecommerce.com>; "user@hive.apache.org" <us...@hive.apache.org>; User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 2:06 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS.
Also there's a typo in your hive.xml:
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
Should be
<value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Thanks Sanjay.
>
>My environment is like this.
>
>$ echo $HADOOP_HOME
>/software/home/hadoop/hadoop/hadoop-1.1.2
>
>$ echo $HIVE_HOME
>/software/home/hadoop/hive/hive-0.9.0
>
>$ id
>uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
>
>So can i do like this:
>
>$pwd
>/software/home/hadoop/hive/hive-0.9.0
>
>$mkdir warehouse
>
>$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
>$ in hive-site.xml<property>
> <name>hive.metastore.warehouse.dir</name>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
> <description>location of default database for the warehouse</description>
></property>
>
>Where should I create the HDFS directory ?
>
>
>From: Sanjay Subramanian <Sa...@wizecommerce.com>
>To: "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>; Dean Wampler <de...@gmail.com>
>Cc: User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:53 PM
>
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Notes below
>
>From: Raj Hadoop <ha...@yahoo.com>
>Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
>Date: Tuesday, May 21, 2013 10:49 AM
>To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <us...@hive.apache.org>
>Cc: User <us...@hadoop.apache.org>
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Ok.I got it. My questions -
>
>1) Should a local physical directory be created before using this property?
>I created a directory in HDFS during Hive installation
>/user/hive/warehouse
>
>
>My hive-site.xml has the following property defined
>
>
><property>
> <name>hive.metastore.warehouse.dir</name>
> <value>/user/hive/warehouse</value>
> <description>location of default database for the warehouse</description>
></property>
>
>2) Should a HDFS file directory be created from Hadoop before using this property?
>hdfs dfs -mkdir /user/hive/warehouse
>Change the owner:group to hive:hive
>
>
>
>From: Dean Wampler <de...@gmail.com>
>To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
>Cc: User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:44 PM
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
>
>
>dean
>
>
>On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>>
>>
>>
>>From: Raj Hadoop <ha...@yahoo.com>
>>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:08 PM
>>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Hi,
>>
>>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>>
>>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>>
>>Thanks,
>>Raj
>>
>>
>
>
>
>--
>Dean Wampler, Ph.D.
>@deanwampler
>http://polyglotprogramming.com/
>
>
>
>CONFIDENTIALITY NOTICE
>======================
>This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
>
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
________________________________
From: Dean Wampler <de...@gmail.com>
To: Raj Hadoop <ha...@yahoo.com>
Cc: Sanjay Subramanian <Sa...@wizecommerce.com>; "user@hive.apache.org" <us...@hive.apache.org>; User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 2:06 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS.
Also there's a typo in your hive.xml:
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
Should be
<value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Thanks Sanjay.
>
>My environment is like this.
>
>$ echo $HADOOP_HOME
>/software/home/hadoop/hadoop/hadoop-1.1.2
>
>$ echo $HIVE_HOME
>/software/home/hadoop/hive/hive-0.9.0
>
>$ id
>uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
>
>So can i do like this:
>
>$pwd
>/software/home/hadoop/hive/hive-0.9.0
>
>$mkdir warehouse
>
>$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
>$ in hive-site.xml<property>
> <name>hive.metastore.warehouse.dir</name>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
> <description>location of default database for the warehouse</description>
></property>
>
>Where should I create the HDFS directory ?
>
>
>From: Sanjay Subramanian <Sa...@wizecommerce.com>
>To: "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>; Dean Wampler <de...@gmail.com>
>Cc: User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:53 PM
>
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Notes below
>
>From: Raj Hadoop <ha...@yahoo.com>
>Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
>Date: Tuesday, May 21, 2013 10:49 AM
>To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <us...@hive.apache.org>
>Cc: User <us...@hadoop.apache.org>
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Ok.I got it. My questions -
>
>1) Should a local physical directory be created before using this property?
>I created a directory in HDFS during Hive installation
>/user/hive/warehouse
>
>
>My hive-site.xml has the following property defined
>
>
><property>
> <name>hive.metastore.warehouse.dir</name>
> <value>/user/hive/warehouse</value>
> <description>location of default database for the warehouse</description>
></property>
>
>2) Should a HDFS file directory be created from Hadoop before using this property?
>hdfs dfs -mkdir /user/hive/warehouse
>Change the owner:group to hive:hive
>
>
>
>From: Dean Wampler <de...@gmail.com>
>To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
>Cc: User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:44 PM
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
>
>
>dean
>
>
>On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>>
>>
>>
>>From: Raj Hadoop <ha...@yahoo.com>
>>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:08 PM
>>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Hi,
>>
>>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>>
>>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>>
>>Thanks,
>>Raj
>>
>>
>
>
>
>--
>Dean Wampler, Ph.D.
>@deanwampler
>http://polyglotprogramming.com/
>
>
>
>CONFIDENTIALITY NOTICE
>======================
>This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
>
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
________________________________
From: Dean Wampler <de...@gmail.com>
To: Raj Hadoop <ha...@yahoo.com>
Cc: Sanjay Subramanian <Sa...@wizecommerce.com>; "user@hive.apache.org" <us...@hive.apache.org>; User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 2:06 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS.
Also there's a typo in your hive.xml:
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
Should be
<value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Thanks Sanjay.
>
>My environment is like this.
>
>$ echo $HADOOP_HOME
>/software/home/hadoop/hadoop/hadoop-1.1.2
>
>$ echo $HIVE_HOME
>/software/home/hadoop/hive/hive-0.9.0
>
>$ id
>uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
>
>So can i do like this:
>
>$pwd
>/software/home/hadoop/hive/hive-0.9.0
>
>$mkdir warehouse
>
>$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
>$ in hive-site.xml<property>
> <name>hive.metastore.warehouse.dir</name>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
> <description>location of default database for the warehouse</description>
></property>
>
>Where should I create the HDFS directory ?
>
>
>From: Sanjay Subramanian <Sa...@wizecommerce.com>
>To: "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>; Dean Wampler <de...@gmail.com>
>Cc: User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:53 PM
>
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Notes below
>
>From: Raj Hadoop <ha...@yahoo.com>
>Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
>Date: Tuesday, May 21, 2013 10:49 AM
>To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <us...@hive.apache.org>
>Cc: User <us...@hadoop.apache.org>
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Ok.I got it. My questions -
>
>1) Should a local physical directory be created before using this property?
>I created a directory in HDFS during Hive installation
>/user/hive/warehouse
>
>
>My hive-site.xml has the following property defined
>
>
><property>
> <name>hive.metastore.warehouse.dir</name>
> <value>/user/hive/warehouse</value>
> <description>location of default database for the warehouse</description>
></property>
>
>2) Should a HDFS file directory be created from Hadoop before using this property?
>hdfs dfs -mkdir /user/hive/warehouse
>Change the owner:group to hive:hive
>
>
>
>From: Dean Wampler <de...@gmail.com>
>To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
>Cc: User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:44 PM
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
>
>
>dean
>
>
>On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>>
>>
>>
>>From: Raj Hadoop <ha...@yahoo.com>
>>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:08 PM
>>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Hi,
>>
>>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>>
>>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>>
>>Thanks,
>>Raj
>>
>>
>
>
>
>--
>Dean Wampler, Ph.D.
>@deanwampler
>http://polyglotprogramming.com/
>
>
>
>CONFIDENTIALITY NOTICE
>======================
>This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
>
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
________________________________
From: Dean Wampler <de...@gmail.com>
To: Raj Hadoop <ha...@yahoo.com>
Cc: Sanjay Subramanian <Sa...@wizecommerce.com>; "user@hive.apache.org" <us...@hive.apache.org>; User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 2:06 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS.
Also there's a typo in your hive.xml:
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
Should be
<value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Thanks Sanjay.
>
>My environment is like this.
>
>$ echo $HADOOP_HOME
>/software/home/hadoop/hadoop/hadoop-1.1.2
>
>$ echo $HIVE_HOME
>/software/home/hadoop/hive/hive-0.9.0
>
>$ id
>uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
>
>So can i do like this:
>
>$pwd
>/software/home/hadoop/hive/hive-0.9.0
>
>$mkdir warehouse
>
>$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
>$ in hive-site.xml<property>
> <name>hive.metastore.warehouse.dir</name>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
> <description>location of default database for the warehouse</description>
></property>
>
>Where should I create the HDFS directory ?
>
>
>From: Sanjay Subramanian <Sa...@wizecommerce.com>
>To: "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>; Dean Wampler <de...@gmail.com>
>Cc: User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:53 PM
>
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Notes below
>
>From: Raj Hadoop <ha...@yahoo.com>
>Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
>Date: Tuesday, May 21, 2013 10:49 AM
>To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <us...@hive.apache.org>
>Cc: User <us...@hadoop.apache.org>
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Ok.I got it. My questions -
>
>1) Should a local physical directory be created before using this property?
>I created a directory in HDFS during Hive installation
>/user/hive/warehouse
>
>
>My hive-site.xml has the following property defined
>
>
><property>
> <name>hive.metastore.warehouse.dir</name>
> <value>/user/hive/warehouse</value>
> <description>location of default database for the warehouse</description>
></property>
>
>2) Should a HDFS file directory be created from Hadoop before using this property?
>hdfs dfs -mkdir /user/hive/warehouse
>Change the owner:group to hive:hive
>
>
>
>From: Dean Wampler <de...@gmail.com>
>To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
>Cc: User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:44 PM
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
>
>
>dean
>
>
>On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>>
>>
>>
>>From: Raj Hadoop <ha...@yahoo.com>
>>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:08 PM
>>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Hi,
>>
>>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>>
>>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>>
>>Thanks,
>>Raj
>>
>>
>
>
>
>--
>Dean Wampler, Ph.D.
>@deanwampler
>http://polyglotprogramming.com/
>
>
>
>CONFIDENTIALITY NOTICE
>======================
>This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
>
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Dean Wampler <de...@gmail.com>.
No, you only need a directory in HDFS, which will be "virtually located"
somewhere in your cluster automatically by HDFS.
Also there's a typo in your hive.xml:
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
Should be
<value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> Thanks Sanjay.
>
> My environment is like this.
>
> $ echo $HADOOP_HOME
> /software/home/hadoop/hadoop/hadoop-1.1.2
>
> $ echo $HIVE_HOME
> /software/home/hadoop/hive/hive-0.9.0
>
> $ id
> uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
> So can i do like this:
>
> $pwd
> /software/home/hadoop/hive/hive-0.9.0
>
> $mkdir warehouse
>
> $cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
> $ in hive-site.xml
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> Where should I create the HDFS directory ?
>
>
> *From:* Sanjay Subramanian <Sa...@wizecommerce.com>
> *To:* "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>; Dean Wampler <de...@gmail.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:53 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> Notes below
>
> From: Raj Hadoop <ha...@yahoo.com>
> Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <
> hadoopraj@yahoo.com>
> Date: Tuesday, May 21, 2013 10:49 AM
> To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <
> user@hive.apache.org>
> Cc: User <us...@hadoop.apache.org>
> Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
> I created a directory in HDFS during Hive installation
> /user/hive/warehouse
>
> My hive-site.xml has the following property defined
>
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value>/user/hive/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> 2) Should a HDFS file directory be created from Hadoop before using
> this property?
> hdfs dfs -mkdir /user/hive/warehouse
> Change the owner:group to hive:hive
>
>
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
> CONFIDENTIALITY NOTICE
> ======================
> This email message and any attachments are for the exclusive use of the
> intended recipient(s) and may contain confidential and privileged
> information. Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the intended recipient, please contact the
> sender by reply email and destroy all copies of the original message along
> with any attachments, from your computer system. If you are the intended
> recipient, please be advised that the content of this message is subject to
> access, review and disclosure by the sender's Email System Administrator.
>
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Dean Wampler <de...@gmail.com>.
No, you only need a directory in HDFS, which will be "virtually located"
somewhere in your cluster automatically by HDFS.
Also there's a typo in your hive.xml:
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
Should be
<value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> Thanks Sanjay.
>
> My environment is like this.
>
> $ echo $HADOOP_HOME
> /software/home/hadoop/hadoop/hadoop-1.1.2
>
> $ echo $HIVE_HOME
> /software/home/hadoop/hive/hive-0.9.0
>
> $ id
> uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
> So can i do like this:
>
> $pwd
> /software/home/hadoop/hive/hive-0.9.0
>
> $mkdir warehouse
>
> $cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
> $ in hive-site.xml
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> Where should I create the HDFS directory ?
>
>
> *From:* Sanjay Subramanian <Sa...@wizecommerce.com>
> *To:* "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>; Dean Wampler <de...@gmail.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:53 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> Notes below
>
> From: Raj Hadoop <ha...@yahoo.com>
> Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <
> hadoopraj@yahoo.com>
> Date: Tuesday, May 21, 2013 10:49 AM
> To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <
> user@hive.apache.org>
> Cc: User <us...@hadoop.apache.org>
> Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
> I created a directory in HDFS during Hive installation
> /user/hive/warehouse
>
> My hive-site.xml has the following property defined
>
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value>/user/hive/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> 2) Should a HDFS file directory be created from Hadoop before using
> this property?
> hdfs dfs -mkdir /user/hive/warehouse
> Change the owner:group to hive:hive
>
>
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
> CONFIDENTIALITY NOTICE
> ======================
> This email message and any attachments are for the exclusive use of the
> intended recipient(s) and may contain confidential and privileged
> information. Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the intended recipient, please contact the
> sender by reply email and destroy all copies of the original message along
> with any attachments, from your computer system. If you are the intended
> recipient, please be advised that the content of this message is subject to
> access, review and disclosure by the sender's Email System Administrator.
>
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Dean Wampler <de...@gmail.com>.
No, you only need a directory in HDFS, which will be "virtually located"
somewhere in your cluster automatically by HDFS.
Also there's a typo in your hive.xml:
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
Should be
<value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> Thanks Sanjay.
>
> My environment is like this.
>
> $ echo $HADOOP_HOME
> /software/home/hadoop/hadoop/hadoop-1.1.2
>
> $ echo $HIVE_HOME
> /software/home/hadoop/hive/hive-0.9.0
>
> $ id
> uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
> So can i do like this:
>
> $pwd
> /software/home/hadoop/hive/hive-0.9.0
>
> $mkdir warehouse
>
> $cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
> $ in hive-site.xml
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> Where should I create the HDFS directory ?
>
>
> *From:* Sanjay Subramanian <Sa...@wizecommerce.com>
> *To:* "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>; Dean Wampler <de...@gmail.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:53 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> Notes below
>
> From: Raj Hadoop <ha...@yahoo.com>
> Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <
> hadoopraj@yahoo.com>
> Date: Tuesday, May 21, 2013 10:49 AM
> To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <
> user@hive.apache.org>
> Cc: User <us...@hadoop.apache.org>
> Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
> I created a directory in HDFS during Hive installation
> /user/hive/warehouse
>
> My hive-site.xml has the following property defined
>
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value>/user/hive/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> 2) Should a HDFS file directory be created from Hadoop before using
> this property?
> hdfs dfs -mkdir /user/hive/warehouse
> Change the owner:group to hive:hive
>
>
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
> CONFIDENTIALITY NOTICE
> ======================
> This email message and any attachments are for the exclusive use of the
> intended recipient(s) and may contain confidential and privileged
> information. Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the intended recipient, please contact the
> sender by reply email and destroy all copies of the original message along
> with any attachments, from your computer system. If you are the intended
> recipient, please be advised that the content of this message is subject to
> access, review and disclosure by the sender's Email System Administrator.
>
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Dean Wampler <de...@gmail.com>.
No, you only need a directory in HDFS, which will be "virtually located"
somewhere in your cluster automatically by HDFS.
Also there's a typo in your hive.xml:
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
Should be
<value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> Thanks Sanjay.
>
> My environment is like this.
>
> $ echo $HADOOP_HOME
> /software/home/hadoop/hadoop/hadoop-1.1.2
>
> $ echo $HIVE_HOME
> /software/home/hadoop/hive/hive-0.9.0
>
> $ id
> uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
> So can i do like this:
>
> $pwd
> /software/home/hadoop/hive/hive-0.9.0
>
> $mkdir warehouse
>
> $cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
> $ in hive-site.xml
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> Where should I create the HDFS directory ?
>
>
> *From:* Sanjay Subramanian <Sa...@wizecommerce.com>
> *To:* "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>; Dean Wampler <de...@gmail.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:53 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> Notes below
>
> From: Raj Hadoop <ha...@yahoo.com>
> Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <
> hadoopraj@yahoo.com>
> Date: Tuesday, May 21, 2013 10:49 AM
> To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <
> user@hive.apache.org>
> Cc: User <us...@hadoop.apache.org>
> Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
> I created a directory in HDFS during Hive installation
> /user/hive/warehouse
>
> My hive-site.xml has the following property defined
>
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value>/user/hive/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> 2) Should a HDFS file directory be created from Hadoop before using
> this property?
> hdfs dfs -mkdir /user/hive/warehouse
> Change the owner:group to hive:hive
>
>
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
> CONFIDENTIALITY NOTICE
> ======================
> This email message and any attachments are for the exclusive use of the
> intended recipient(s) and may contain confidential and privileged
> information. Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the intended recipient, please contact the
> sender by reply email and destroy all copies of the original message along
> with any attachments, from your computer system. If you are the intended
> recipient, please be advised that the content of this message is subject to
> access, review and disclosure by the sender's Email System Administrator.
>
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Dean Wampler <de...@gmail.com>.
No, you only need a directory in HDFS, which will be "virtually located"
somewhere in your cluster automatically by HDFS.
Also there's a typo in your hive.xml:
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
Should be
<value>/correct/path/in/hdfs/to/your/warehouse/directory</value>
On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> Thanks Sanjay.
>
> My environment is like this.
>
> $ echo $HADOOP_HOME
> /software/home/hadoop/hadoop/hadoop-1.1.2
>
> $ echo $HIVE_HOME
> /software/home/hadoop/hive/hive-0.9.0
>
> $ id
> uid=50052(hadoop) gid=600(apps) groups=600(apps)
>
> So can i do like this:
>
> $pwd
> /software/home/hadoop/hive/hive-0.9.0
>
> $mkdir warehouse
>
> $cd /software/home/hadoop/hive/hive-0.9.0/warehouse
>
> $ in hive-site.xml
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> Where should I create the HDFS directory ?
>
>
> *From:* Sanjay Subramanian <Sa...@wizecommerce.com>
> *To:* "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <
> hadoopraj@yahoo.com>; Dean Wampler <de...@gmail.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:53 PM
>
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> Notes below
>
> From: Raj Hadoop <ha...@yahoo.com>
> Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <
> hadoopraj@yahoo.com>
> Date: Tuesday, May 21, 2013 10:49 AM
> To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <
> user@hive.apache.org>
> Cc: User <us...@hadoop.apache.org>
> Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
> I created a directory in HDFS during Hive installation
> /user/hive/warehouse
>
> My hive-site.xml has the following property defined
>
> <property>
> <name>hive.metastore.warehouse.dir</name>
> <value>/user/hive/warehouse</value>
> <description>location of default database for the
> warehouse</description>
> </property>
>
> 2) Should a HDFS file directory be created from Hadoop before using
> this property?
> hdfs dfs -mkdir /user/hive/warehouse
> Change the owner:group to hive:hive
>
>
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
> CONFIDENTIALITY NOTICE
> ======================
> This email message and any attachments are for the exclusive use of the
> intended recipient(s) and may contain confidential and privileged
> information. Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the intended recipient, please contact the
> sender by reply email and destroy all copies of the original message along
> with any attachments, from your computer system. If you are the intended
> recipient, please be advised that the content of this message is subject to
> access, review and disclosure by the sender's Email System Administrator.
>
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Thanks Sanjay.
My environment is like this.
$ echo $HADOOP_HOME
/software/home/hadoop/hadoop/hadoop-1.1.2
$ echo $HIVE_HOME
/software/home/hadoop/hive/hive-0.9.0
$ id
uid=50052(hadoop) gid=600(apps) groups=600(apps)
So can i do like this:
$pwd
/software/home/hadoop/hive/hive-0.9.0
$mkdir warehouse
$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
$ in hive-site.xml<property>
<name>hive.metastore.warehouse.dir</name>
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
Where should I create the HDFS directory ?
________________________________
From: Sanjay Subramanian <Sa...@wizecommerce.com>
To: "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>; Dean Wampler <de...@gmail.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:53 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Notes below
From: Raj Hadoop <ha...@yahoo.com>
Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
Date: Tuesday, May 21, 2013 10:49 AM
To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <us...@hive.apache.org>
Cc: User <us...@hadoop.apache.org>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
I created a directory in HDFS during Hive installation
/user/hive/warehouse
My hive-site.xml has the following property defined
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
2) Should a HDFS file directory be created from Hadoop before using this property?
hdfs dfs -mkdir /user/hive/warehouse
Change the owner:group to hive:hive
________________________________
From: Dean Wampler <de...@gmail.com>
To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>
>
>
>From: Raj Hadoop <ha...@yahoo.com>
>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:08 PM
>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Hi,
>
>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>
>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>
>Thanks,
>Raj
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Thanks Sanjay.
My environment is like this.
$ echo $HADOOP_HOME
/software/home/hadoop/hadoop/hadoop-1.1.2
$ echo $HIVE_HOME
/software/home/hadoop/hive/hive-0.9.0
$ id
uid=50052(hadoop) gid=600(apps) groups=600(apps)
So can i do like this:
$pwd
/software/home/hadoop/hive/hive-0.9.0
$mkdir warehouse
$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
$ in hive-site.xml<property>
<name>hive.metastore.warehouse.dir</name>
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
Where should I create the HDFS directory ?
________________________________
From: Sanjay Subramanian <Sa...@wizecommerce.com>
To: "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>; Dean Wampler <de...@gmail.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:53 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Notes below
From: Raj Hadoop <ha...@yahoo.com>
Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
Date: Tuesday, May 21, 2013 10:49 AM
To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <us...@hive.apache.org>
Cc: User <us...@hadoop.apache.org>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
I created a directory in HDFS during Hive installation
/user/hive/warehouse
My hive-site.xml has the following property defined
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
2) Should a HDFS file directory be created from Hadoop before using this property?
hdfs dfs -mkdir /user/hive/warehouse
Change the owner:group to hive:hive
________________________________
From: Dean Wampler <de...@gmail.com>
To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>
>
>
>From: Raj Hadoop <ha...@yahoo.com>
>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:08 PM
>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Hi,
>
>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>
>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>
>Thanks,
>Raj
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Thanks Sanjay.
My environment is like this.
$ echo $HADOOP_HOME
/software/home/hadoop/hadoop/hadoop-1.1.2
$ echo $HIVE_HOME
/software/home/hadoop/hive/hive-0.9.0
$ id
uid=50052(hadoop) gid=600(apps) groups=600(apps)
So can i do like this:
$pwd
/software/home/hadoop/hive/hive-0.9.0
$mkdir warehouse
$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
$ in hive-site.xml<property>
<name>hive.metastore.warehouse.dir</name>
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
Where should I create the HDFS directory ?
________________________________
From: Sanjay Subramanian <Sa...@wizecommerce.com>
To: "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>; Dean Wampler <de...@gmail.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:53 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Notes below
From: Raj Hadoop <ha...@yahoo.com>
Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
Date: Tuesday, May 21, 2013 10:49 AM
To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <us...@hive.apache.org>
Cc: User <us...@hadoop.apache.org>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
I created a directory in HDFS during Hive installation
/user/hive/warehouse
My hive-site.xml has the following property defined
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
2) Should a HDFS file directory be created from Hadoop before using this property?
hdfs dfs -mkdir /user/hive/warehouse
Change the owner:group to hive:hive
________________________________
From: Dean Wampler <de...@gmail.com>
To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>
>
>
>From: Raj Hadoop <ha...@yahoo.com>
>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:08 PM
>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Hi,
>
>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>
>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>
>Thanks,
>Raj
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Thanks Sanjay.
My environment is like this.
$ echo $HADOOP_HOME
/software/home/hadoop/hadoop/hadoop-1.1.2
$ echo $HIVE_HOME
/software/home/hadoop/hive/hive-0.9.0
$ id
uid=50052(hadoop) gid=600(apps) groups=600(apps)
So can i do like this:
$pwd
/software/home/hadoop/hive/hive-0.9.0
$mkdir warehouse
$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
$ in hive-site.xml<property>
<name>hive.metastore.warehouse.dir</name>
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
Where should I create the HDFS directory ?
________________________________
From: Sanjay Subramanian <Sa...@wizecommerce.com>
To: "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>; Dean Wampler <de...@gmail.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:53 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Notes below
From: Raj Hadoop <ha...@yahoo.com>
Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
Date: Tuesday, May 21, 2013 10:49 AM
To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <us...@hive.apache.org>
Cc: User <us...@hadoop.apache.org>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
I created a directory in HDFS during Hive installation
/user/hive/warehouse
My hive-site.xml has the following property defined
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
2) Should a HDFS file directory be created from Hadoop before using this property?
hdfs dfs -mkdir /user/hive/warehouse
Change the owner:group to hive:hive
________________________________
From: Dean Wampler <de...@gmail.com>
To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>
>
>
>From: Raj Hadoop <ha...@yahoo.com>
>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:08 PM
>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Hi,
>
>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>
>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>
>Thanks,
>Raj
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Thanks Sanjay.
My environment is like this.
$ echo $HADOOP_HOME
/software/home/hadoop/hadoop/hadoop-1.1.2
$ echo $HIVE_HOME
/software/home/hadoop/hive/hive-0.9.0
$ id
uid=50052(hadoop) gid=600(apps) groups=600(apps)
So can i do like this:
$pwd
/software/home/hadoop/hive/hive-0.9.0
$mkdir warehouse
$cd /software/home/hadoop/hive/hive-0.9.0/warehouse
$ in hive-site.xml<property>
<name>hive.metastore.warehouse.dir</name>
<value/software/home/hadoop/hive/hive-0.9.0/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
Where should I create the HDFS directory ?
________________________________
From: Sanjay Subramanian <Sa...@wizecommerce.com>
To: "user@hive.apache.org" <us...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>; Dean Wampler <de...@gmail.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:53 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Notes below
From: Raj Hadoop <ha...@yahoo.com>
Reply-To: "user@hive.apache.org" <us...@hive.apache.org>, Raj Hadoop <ha...@yahoo.com>
Date: Tuesday, May 21, 2013 10:49 AM
To: Dean Wampler <de...@gmail.com>, "user@hive.apache.org" <us...@hive.apache.org>
Cc: User <us...@hadoop.apache.org>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
I created a directory in HDFS during Hive installation
/user/hive/warehouse
My hive-site.xml has the following property defined
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
2) Should a HDFS file directory be created from Hadoop before using this property?
hdfs dfs -mkdir /user/hive/warehouse
Change the owner:group to hive:hive
________________________________
From: Dean Wampler <de...@gmail.com>
To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>
>
>
>From: Raj Hadoop <ha...@yahoo.com>
>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:08 PM
>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Hi,
>
>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>
>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>
>Thanks,
>Raj
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
yes thats what i meant. local physical directory. thanks.
________________________________
From: bharath vissapragada <bh...@gmail.com>
To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:59 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
If by "local physical directory" you mean a directory in the underlying OS file system, then No. You just need to create a directory in HDFS and ad it to that xml config file.
Thanks,
On Tue, May 21, 2013 at 11:19 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Ok.I got it. My questions -
>
>1) Should a local physical directory be created before using this property?
>2) Should a HDFS file directory be created from Hadoop before using this property?
>
>
>
>
>From: Dean Wampler <de...@gmail.com>
>To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
>Cc: User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:44 PM
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
>
>
>dean
>
>
>On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>>
>>
>>
>>From: Raj Hadoop <ha...@yahoo.com>
>>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:08 PM
>>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Hi,
>>
>>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>>
>>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>>
>>Thanks,
>>Raj
>>
>>
>
>
>
>--
>Dean Wampler, Ph.D.
>@deanwampler
>http://polyglotprogramming.com/
>
>
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
yes thats what i meant. local physical directory. thanks.
________________________________
From: bharath vissapragada <bh...@gmail.com>
To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:59 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
If by "local physical directory" you mean a directory in the underlying OS file system, then No. You just need to create a directory in HDFS and ad it to that xml config file.
Thanks,
On Tue, May 21, 2013 at 11:19 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Ok.I got it. My questions -
>
>1) Should a local physical directory be created before using this property?
>2) Should a HDFS file directory be created from Hadoop before using this property?
>
>
>
>
>From: Dean Wampler <de...@gmail.com>
>To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
>Cc: User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:44 PM
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
>
>
>dean
>
>
>On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>>
>>
>>
>>From: Raj Hadoop <ha...@yahoo.com>
>>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:08 PM
>>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Hi,
>>
>>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>>
>>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>>
>>Thanks,
>>Raj
>>
>>
>
>
>
>--
>Dean Wampler, Ph.D.
>@deanwampler
>http://polyglotprogramming.com/
>
>
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
yes thats what i meant. local physical directory. thanks.
________________________________
From: bharath vissapragada <bh...@gmail.com>
To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:59 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
If by "local physical directory" you mean a directory in the underlying OS file system, then No. You just need to create a directory in HDFS and ad it to that xml config file.
Thanks,
On Tue, May 21, 2013 at 11:19 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Ok.I got it. My questions -
>
>1) Should a local physical directory be created before using this property?
>2) Should a HDFS file directory be created from Hadoop before using this property?
>
>
>
>
>From: Dean Wampler <de...@gmail.com>
>To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
>Cc: User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:44 PM
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
>
>
>dean
>
>
>On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>>
>>
>>
>>From: Raj Hadoop <ha...@yahoo.com>
>>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:08 PM
>>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Hi,
>>
>>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>>
>>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>>
>>Thanks,
>>Raj
>>
>>
>
>
>
>--
>Dean Wampler, Ph.D.
>@deanwampler
>http://polyglotprogramming.com/
>
>
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
yes thats what i meant. local physical directory. thanks.
________________________________
From: bharath vissapragada <bh...@gmail.com>
To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:59 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
If by "local physical directory" you mean a directory in the underlying OS file system, then No. You just need to create a directory in HDFS and ad it to that xml config file.
Thanks,
On Tue, May 21, 2013 at 11:19 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Ok.I got it. My questions -
>
>1) Should a local physical directory be created before using this property?
>2) Should a HDFS file directory be created from Hadoop before using this property?
>
>
>
>
>From: Dean Wampler <de...@gmail.com>
>To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
>Cc: User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:44 PM
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
>
>
>dean
>
>
>On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>>
>>
>>
>>From: Raj Hadoop <ha...@yahoo.com>
>>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:08 PM
>>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Hi,
>>
>>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>>
>>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>>
>>Thanks,
>>Raj
>>
>>
>
>
>
>--
>Dean Wampler, Ph.D.
>@deanwampler
>http://polyglotprogramming.com/
>
>
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
yes thats what i meant. local physical directory. thanks.
________________________________
From: bharath vissapragada <bh...@gmail.com>
To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:59 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
If by "local physical directory" you mean a directory in the underlying OS file system, then No. You just need to create a directory in HDFS and ad it to that xml config file.
Thanks,
On Tue, May 21, 2013 at 11:19 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Ok.I got it. My questions -
>
>1) Should a local physical directory be created before using this property?
>2) Should a HDFS file directory be created from Hadoop before using this property?
>
>
>
>
>From: Dean Wampler <de...@gmail.com>
>To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
>Cc: User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:44 PM
>Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
>
>
>dean
>
>
>On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
>Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>>
>>
>>
>>From: Raj Hadoop <ha...@yahoo.com>
>>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>>Sent: Tuesday, May 21, 2013 1:08 PM
>>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>>
>>
>>
>>Hi,
>>
>>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>>
>>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>>
>>Thanks,
>>Raj
>>
>>
>
>
>
>--
>Dean Wampler, Ph.D.
>@deanwampler
>http://polyglotprogramming.com/
>
>
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by bharath vissapragada <bh...@gmail.com>.
Hi,
If by "local physical directory" you mean a directory in the underlying OS
file system, then No. You just need to create a directory in HDFS and ad it
to that xml config file.
Thanks,
On Tue, May 21, 2013 at 11:19 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
> 2) Should a HDFS file directory be created from Hadoop before using this
> property?
>
>
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by bharath vissapragada <bh...@gmail.com>.
Hi,
If by "local physical directory" you mean a directory in the underlying OS
file system, then No. You just need to create a directory in HDFS and ad it
to that xml config file.
Thanks,
On Tue, May 21, 2013 at 11:19 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
> 2) Should a HDFS file directory be created from Hadoop before using this
> property?
>
>
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by bharath vissapragada <bh...@gmail.com>.
Hi,
If by "local physical directory" you mean a directory in the underlying OS
file system, then No. You just need to create a directory in HDFS and ad it
to that xml config file.
Thanks,
On Tue, May 21, 2013 at 11:19 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
> 2) Should a HDFS file directory be created from Hadoop before using this
> property?
>
>
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by bharath vissapragada <bh...@gmail.com>.
Hi,
If by "local physical directory" you mean a directory in the underlying OS
file system, then No. You just need to create a directory in HDFS and ad it
to that xml config file.
Thanks,
On Tue, May 21, 2013 at 11:19 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
> 2) Should a HDFS file directory be created from Hadoop before using this
> property?
>
>
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by bharath vissapragada <bh...@gmail.com>.
Hi,
If by "local physical directory" you mean a directory in the underlying OS
file system, then No. You just need to create a directory in HDFS and ad it
to that xml config file.
Thanks,
On Tue, May 21, 2013 at 11:19 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> Ok.I got it. My questions -
>
> 1) Should a local physical directory be created before using this property?
> 2) Should a HDFS file directory be created from Hadoop before using this
> property?
>
>
>
> *From:* Dean Wampler <de...@gmail.com>
> *To:* user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
> *Cc:* User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:44 PM
> *Subject:* Re: hive.metastore.warehouse.dir - Should it point to a
> physical directory
>
> The name is misleading; this is the directory within HDFS where Hive
> stores the data, by default. (External tables can go elsewhere). It doesn't
> really have anything to do with the metastore.
>
> dean
>
> On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
>
> Can some one help me on this ? I am stuck installing and configuring
> Hive with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
>
>
> --
> Dean Wampler, Ph.D.
> @deanwampler
> http://polyglotprogramming.com/
>
>
>
Re: hive.metastore.warehouse.dir - Should it point to a physical
directory
Posted by Sanjay Subramanian <Sa...@wizecommerce.com>.
Notes below
From: Raj Hadoop <ha...@yahoo.com>>
Reply-To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>, Raj Hadoop <ha...@yahoo.com>>
Date: Tuesday, May 21, 2013 10:49 AM
To: Dean Wampler <de...@gmail.com>>, "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Cc: User <us...@hadoop.apache.org>>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
I created a directory in HDFS during Hive installation
/user/hive/warehouse
My hive-site.xml has the following property defined
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
2) Should a HDFS file directory be created from Hadoop before using this property?
hdfs dfs -mkdir /user/hive/warehouse
Change the owner:group to hive:hive
From: Dean Wampler <de...@gmail.com>>
To: user@hive.apache.org<ma...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>>
Cc: User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
From: Raj Hadoop <ha...@yahoo.com>>
To: Hive <us...@hive.apache.org>>; User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:08 PM
Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name<http://fs.default.name/>. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical
directory
Posted by Sanjay Subramanian <Sa...@wizecommerce.com>.
Notes below
From: Raj Hadoop <ha...@yahoo.com>>
Reply-To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>, Raj Hadoop <ha...@yahoo.com>>
Date: Tuesday, May 21, 2013 10:49 AM
To: Dean Wampler <de...@gmail.com>>, "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Cc: User <us...@hadoop.apache.org>>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
I created a directory in HDFS during Hive installation
/user/hive/warehouse
My hive-site.xml has the following property defined
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
2) Should a HDFS file directory be created from Hadoop before using this property?
hdfs dfs -mkdir /user/hive/warehouse
Change the owner:group to hive:hive
From: Dean Wampler <de...@gmail.com>>
To: user@hive.apache.org<ma...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>>
Cc: User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
From: Raj Hadoop <ha...@yahoo.com>>
To: Hive <us...@hive.apache.org>>; User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:08 PM
Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name<http://fs.default.name/>. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical
directory
Posted by Sanjay Subramanian <Sa...@wizecommerce.com>.
Notes below
From: Raj Hadoop <ha...@yahoo.com>>
Reply-To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>, Raj Hadoop <ha...@yahoo.com>>
Date: Tuesday, May 21, 2013 10:49 AM
To: Dean Wampler <de...@gmail.com>>, "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Cc: User <us...@hadoop.apache.org>>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
I created a directory in HDFS during Hive installation
/user/hive/warehouse
My hive-site.xml has the following property defined
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
2) Should a HDFS file directory be created from Hadoop before using this property?
hdfs dfs -mkdir /user/hive/warehouse
Change the owner:group to hive:hive
From: Dean Wampler <de...@gmail.com>>
To: user@hive.apache.org<ma...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>>
Cc: User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
From: Raj Hadoop <ha...@yahoo.com>>
To: Hive <us...@hive.apache.org>>; User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:08 PM
Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name<http://fs.default.name/>. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical
directory
Posted by Sanjay Subramanian <Sa...@wizecommerce.com>.
Notes below
From: Raj Hadoop <ha...@yahoo.com>>
Reply-To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>, Raj Hadoop <ha...@yahoo.com>>
Date: Tuesday, May 21, 2013 10:49 AM
To: Dean Wampler <de...@gmail.com>>, "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Cc: User <us...@hadoop.apache.org>>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
I created a directory in HDFS during Hive installation
/user/hive/warehouse
My hive-site.xml has the following property defined
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
2) Should a HDFS file directory be created from Hadoop before using this property?
hdfs dfs -mkdir /user/hive/warehouse
Change the owner:group to hive:hive
From: Dean Wampler <de...@gmail.com>>
To: user@hive.apache.org<ma...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>>
Cc: User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
From: Raj Hadoop <ha...@yahoo.com>>
To: Hive <us...@hive.apache.org>>; User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:08 PM
Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name<http://fs.default.name/>. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical
directory
Posted by Sanjay Subramanian <Sa...@wizecommerce.com>.
Notes below
From: Raj Hadoop <ha...@yahoo.com>>
Reply-To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>, Raj Hadoop <ha...@yahoo.com>>
Date: Tuesday, May 21, 2013 10:49 AM
To: Dean Wampler <de...@gmail.com>>, "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Cc: User <us...@hadoop.apache.org>>
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
I created a directory in HDFS during Hive installation
/user/hive/warehouse
My hive-site.xml has the following property defined
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
2) Should a HDFS file directory be created from Hadoop before using this property?
hdfs dfs -mkdir /user/hive/warehouse
Change the owner:group to hive:hive
From: Dean Wampler <de...@gmail.com>>
To: user@hive.apache.org<ma...@hive.apache.org>; Raj Hadoop <ha...@yahoo.com>>
Cc: User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com>> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
From: Raj Hadoop <ha...@yahoo.com>>
To: Hive <us...@hive.apache.org>>; User <us...@hadoop.apache.org>>
Sent: Tuesday, May 21, 2013 1:08 PM
Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name<http://fs.default.name/>. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
CONFIDENTIALITY NOTICE
======================
This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
2) Should a HDFS file directory be created from Hadoop before using this property?
________________________________
From: Dean Wampler <de...@gmail.com>
To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>
>
>
>From: Raj Hadoop <ha...@yahoo.com>
>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:08 PM
>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Hi,
>
>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>
>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>
>Thanks,
>Raj
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
2) Should a HDFS file directory be created from Hadoop before using this property?
________________________________
From: Dean Wampler <de...@gmail.com>
To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>
>
>
>From: Raj Hadoop <ha...@yahoo.com>
>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:08 PM
>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Hi,
>
>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>
>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>
>Thanks,
>Raj
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
2) Should a HDFS file directory be created from Hadoop before using this property?
________________________________
From: Dean Wampler <de...@gmail.com>
To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>
>
>
>From: Raj Hadoop <ha...@yahoo.com>
>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:08 PM
>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Hi,
>
>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>
>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>
>Thanks,
>Raj
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
2) Should a HDFS file directory be created from Hadoop before using this property?
________________________________
From: Dean Wampler <de...@gmail.com>
To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>
>
>
>From: Raj Hadoop <ha...@yahoo.com>
>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:08 PM
>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Hi,
>
>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>
>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>
>Thanks,
>Raj
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Ok.I got it. My questions -
1) Should a local physical directory be created before using this property?
2) Should a HDFS file directory be created from Hadoop before using this property?
________________________________
From: Dean Wampler <de...@gmail.com>
To: user@hive.apache.org; Raj Hadoop <ha...@yahoo.com>
Cc: User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:44 PM
Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory
The name is misleading; this is the directory within HDFS where Hive stores the data, by default. (External tables can go elsewhere). It doesn't really have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
>
>
>
>From: Raj Hadoop <ha...@yahoo.com>
>To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
>Sent: Tuesday, May 21, 2013 1:08 PM
>Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
>
>
>
>Hi,
>
>I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
>
>Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
>
>Thanks,
>Raj
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com/
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Dean Wampler <de...@gmail.com>.
The name is misleading; this is the directory within HDFS where Hive stores
the data, by default. (External tables can go elsewhere). It doesn't really
have anything to do with the metastore.
dean
On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <ha...@yahoo.com> wrote:
> Can some one help me on this ? I am stuck installing and configuring Hive
> with Oracle. Your timely help is really aprreciated.
>
> *From:* Raj Hadoop <ha...@yahoo.com>
> *To:* Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
> *Sent:* Tuesday, May 21, 2013 1:08 PM
> *Subject:* hive.metastore.warehouse.dir - Should it point to a physical
> directory
>
> Hi,
>
> I am configurinig Hive. I ahve a question on the property
> hive.metastore.warehouse.dir.
>
> Should this point to a physical directory. I am guessing it is a logical
> directory under Hadoop fs.default.name. Please advise whether I need to
> create any directory for the variable hive.metastore.warehouse.dir
>
> Thanks,
> Raj
>
>
>
--
Dean Wampler, Ph.D.
@deanwampler
http://polyglotprogramming.com
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
________________________________
From: Raj Hadoop <ha...@yahoo.com>
To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:08 PM
Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
________________________________
From: Raj Hadoop <ha...@yahoo.com>
To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:08 PM
Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
________________________________
From: Raj Hadoop <ha...@yahoo.com>
To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:08 PM
Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
________________________________
From: Raj Hadoop <ha...@yahoo.com>
To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:08 PM
Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj
Re: hive.metastore.warehouse.dir - Should it point to a physical directory
Posted by Raj Hadoop <ha...@yahoo.com>.
Can some one help me on this ? I am stuck installing and configuring Hive with Oracle. Your timely help is really aprreciated.
________________________________
From: Raj Hadoop <ha...@yahoo.com>
To: Hive <us...@hive.apache.org>; User <us...@hadoop.apache.org>
Sent: Tuesday, May 21, 2013 1:08 PM
Subject: hive.metastore.warehouse.dir - Should it point to a physical directory
Hi,
I am configurinig Hive. I ahve a question on the property hive.metastore.warehouse.dir.
Should this point to a physical directory. I am guessing it is a logical directory under Hadoop fs.default.name. Please advise whether I need to create any directory for the variable hive.metastore.warehouse.dir
Thanks,
Raj