You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hive.apache.org by Pradeep Kamath <pr...@yahoo-inc.com> on 2010/05/24 22:37:07 UTC

metastore set up with Oracle backend?

Hi,

  Can hive metastore be setup with Oracle as backend without any code
changes? Has anyone tried this? Any pointers would be much appreciated.

 

Thanks,

Pradeep

RE: metastore set up with Oracle backend?

Posted by Pradeep Kamath <pr...@yahoo-inc.com>.

Thanks for the information Carl - will give it a shot.

________________________________

From: Carl Steinbach [mailto:carl@cloudera.com] 
Sent: Tuesday, May 25, 2010 11:28 AM
To: hive-user@hadoop.apache.org
Subject: Re: metastore set up with Oracle backend?

Hi Pradeep,

Your config values will need to look something like this:

javax.jdo.option.ConnectionURL =
jdbc:oracle:thin:@'host':'port':'db-name'

javax.jdo.option.ConnectionDriverName = oracle.jdbc.driver.OracleDriver

javax.jdo.option.ConnectionUserName = your-user-name

javax.jdo.option.ConnectionPassword = your-password

Obviously you need to replace 'host', 'port' and 'db-name' with
appropriate values. You also need to get a copy of the Oracle thin JDBC
driver (or some other JDBC driver that supports Oracle) and make sure
that it is available in Hive's classpath (e.g. by referencing it in
HIVE_AUX_JARS_PATH). If this does not work out of the box I recommend
consulting the documentation that comes with your JDBC driver.

Thanks.

Carl

On Tue, May 25, 2010 at 11:12 AM, Pradeep Kamath
<pr...@yahoo-inc.com> wrote:

Hi Sonal,
 I want to set up hive metastore with Oracle as backend and wanted the
config values for that.

Thanks,
Pradee

-----Original Message-----
From: Sonal Goyal [mailto:sonalgoyal4@gmail.com]
Sent: Tuesday, May 25, 2010 10:42 AM
To: hive-user@hadoop.apache.org

Subject: Fwd: metastore set up with Oracle backend?

Hi Pradeep,

You can check the config values for MySQL as a metastore for Hive at
the following link:

http://www.mazsoft.com/blog/post/2010/02/01/Setting-up-HadoopHive-to-use
-MySQL-as-metastore.aspx

Thanks and Regards,
Sonal
www.meghsoft.com
http://in.linkedin.com/in/sonalgoyal

On Tue, May 25, 2010 at 10:00 PM, Pradeep Kamath
<pr...@yahoo-inc.com> wrote:
>
> Hi Aaron,
>
>   Can you share some details along the lines of what is described in
http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin#Local_Meta
store for MySQL? (Essentially what changes are needed in properties to
get this working)
>
>
>
> Thanks,
>
> Pradeep
>
>
>
> ________________________________
>
> From: Aaron McCurry [mailto:amccurry@gmail.com]
> Sent: Monday, May 24, 2010 1:42 PM
> To: hive-user@hadoop.apache.org
> Subject: Re: metastore set up with Oracle backend?
>
>
>
> I have done it, everything seemed to work just fine.
>
>
>
> Aaron
>
>
>
>
>
> On Mon, May 24, 2010 at 4:37 PM, Pradeep Kamath
<pr...@yahoo-inc.com> wrote:
>
> Hi,
>
>   Can hive metastore be setup with Oracle as backend without any code
changes? Has anyone tried this? Any pointers would be much appreciated.
>
>
>
> Thanks,
>
> Pradeep
>
>

Re: metastore set up with Oracle backend?

Posted by John Sichi <js...@facebook.com>.

I don't know how to do that.  If CLOB gets mapped correctly for MySQL and Derby, we could just change the default so it would be Oracle-compatible.  Otherwise, if we can't find some other place to override the mapping, maybe we could templatize the .jdo file, although I'm not sure how that would work since it gets burned into a .jar.

Another option is to precreate your schema in Oracle and then tell JDO not to try to create/update it automatically.

JVS

On Jun 4, 2010, at 1:58 PM, Pradeep Kamath wrote:

Thanks for the pointer John! - I got it working by editing metastore/src/model/package.jdo to make the following change:

       <field name="viewOriginalText">
-        <column name="VIEW_ORIGINAL_TEXT" jdbc-type="LONGVARCHAR"/>
+        <column name="VIEW_ORIGINAL_TEXT" jdbc-type="CLOB"/>
       </field>
       <field name="viewExpandedText">
-        <column name="VIEW_EXPANDED_TEXT" jdbc-type="LONGVARCHAR"/>
+        <column name="VIEW_EXPANDED_TEXT" jdbc-type="CLOB"/>
       </field>

I then rebuilt hive and used the resulting build and it worked - is there a way to achieve the same without changing metastore/src/model/package.jdo and rebuilding?

Thanks,
Pradeep

John Sichi wrote:

Hmm, this is because MTable now has two LONGVARCHAR fields (viewOriginalText and viewExpandedText).  Can you find a way to get the Oracle driver or JDO to map these to CLOB instead of LONG VARCHAR?  Oracle allows multiple CLOB fields on the same table, but only one LONG VARCHAR (legacy crud).

JVS

________________________________________
From: Pradeep Kamath [pradeepk@yahoo-inc.com<ma...@yahoo-inc.com>]
Sent: Friday, June 04, 2010 9:22 AM
To: hive-user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: metastore set up with Oracle backend?

Hi,
  I tried using the oracle thin jdbc driver with the settings below in hive-site.xml but got the exception pasted below[1]- anybody hit this? (I am using Oracle 11g and hive trunk as of a month back).

Thanks,
Pradeep

[1]
-bash-3.1$ bin/hive
Hive history file=/tmp/pradeepk/hive_job_log_pradeepk_201006032327_643566363.txt
hive> show tables;
FAILED: Error in metadata: MetaException(message:Got exception: javax.jdo.JDODataStoreException An exception was thrown while adding/validating class(es) : ORA-01754: a table may contain only one column of type LONG

java.sql.SQLSyntaxErrorException: ORA-01754: a table may contain only one column of type LONG

        at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:91)
        at oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:133)
        at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:206)
        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:455)
        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:413)
        at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:1034)
        at oracle.jdbc.driver.T4CStatement.doOall8(T4CStatement.java:183)
        at oracle.jdbc.driver.T4CStatement.executeForRows(T4CStatement.java:942)
        at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1222)
        at oracle.jdbc.driver.OracleStatement.executeInternal(OracleStatement.java:1770)
        at oracle.jdbc.driver.OracleStatement.execute(OracleStatement.java:1739)



Carl Steinbach wrote:
Hi Pradeep,

Your config values will need to look something like this:

javax.jdo.option.ConnectionURL = jdbc:oracle:thin:@'host':'port':'db-name'
javax.jdo.option.ConnectionDriverName = oracle.jdbc.driver.OracleDriver
javax.jdo.option.ConnectionUserName</hadoop/ConnectionUserName> = your-user-name
javax.jdo.option.ConnectionPassword</hadoop/ConnectionPassword> = your-password

Obviously you need to replace 'host', 'port' and 'db-name' with appropriate values. You also need to get a copy of the Oracle thin JDBC driver (or some other JDBC driver that supports Oracle) and make sure that it is available in Hive's classpath (e.g. by referencing it in HIVE_AUX_JARS_PATH). If this does not work out of the box I recommend consulting the documentation that comes with your JDBC driver.

Thanks.

Carl

On Tue, May 25, 2010 at 11:12 AM, Pradeep Kamath <pr...@yahoo-inc.com>> wrote:
Hi Sonal,
 I want to set up hive metastore with Oracle as backend and wanted the config values for that.

Thanks,
Pradee

-----Original Message-----
From: Sonal Goyal [mailto:sonalgoyal4@gmail.com<ma...@gmail.com>]
Sent: Tuesday, May 25, 2010 10:42 AM
To: hive-user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Fwd: metastore set up with Oracle backend?

Hi Pradeep,

You can check the config values for MySQL as a metastore for Hive at
the following link:

http://www.mazsoft.com/blog/post/2010/02/01/Setting-up-HadoopHive-to-use-MySQL-as-metastore.aspx

Thanks and Regards,
Sonal
www.meghsoft.com<http://www.meghsoft.com/><http://www.meghsoft.com><http://www.meghsoft.com/>
http://in.linkedin.com/in/sonalgoyal


On Tue, May 25, 2010 at 10:00 PM, Pradeep Kamath <pr...@yahoo-inc.com>> wrote:


Hi Aaron,

  Can you share some details along the lines of what is described in http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin#Local_Metastore for MySQL? (Essentially what changes are needed in properties to get this working)



Thanks,

Pradeep



________________________________

From: Aaron McCurry [mailto:amccurry@gmail.com<ma...@gmail.com>]
Sent: Monday, May 24, 2010 1:42 PM
To: hive-user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: metastore set up with Oracle backend?



I have done it, everything seemed to work just fine.



Aaron





On Mon, May 24, 2010 at 4:37 PM, Pradeep Kamath <pr...@yahoo-inc.com>> wrote:

Hi,

  Can hive metastore be setup with Oracle as backend without any code changes? Has anyone tried this? Any pointers would be much appreciated.



Thanks,

Pradeep

Re: metastore set up with Oracle backend?

Posted by Pradeep Kamath <pr...@yahoo-inc.com>.

Thanks for the pointer John! - I got it working by editing 
metastore/src/model/package.jdo to make the following change:

       <field name="viewOriginalText">
-        <column name="VIEW_ORIGINAL_TEXT" jdbc-type="LONGVARCHAR"/>
+        <column name="VIEW_ORIGINAL_TEXT" jdbc-type="CLOB"/>
       </field>
       <field name="viewExpandedText">
-        <column name="VIEW_EXPANDED_TEXT" jdbc-type="LONGVARCHAR"/>
+        <column name="VIEW_EXPANDED_TEXT" jdbc-type="CLOB"/>
       </field>

I then rebuilt hive and used the resulting build and it worked - is 
there a way to achieve the same without changing 
metastore/src/model/package.jdo and rebuilding?

Thanks,
Pradeep

John Sichi wrote:
> Hmm, this is because MTable now has two LONGVARCHAR fields (viewOriginalText and viewExpandedText).  Can you find a way to get the Oracle driver or JDO to map these to CLOB instead of LONG VARCHAR?  Oracle allows multiple CLOB fields on the same table, but only one LONG VARCHAR (legacy crud).
>
> JVS
>
> ________________________________________
> From: Pradeep Kamath [pradeepk@yahoo-inc.com]
> Sent: Friday, June 04, 2010 9:22 AM
> To: hive-user@hadoop.apache.org
> Subject: Re: metastore set up with Oracle backend?
>
> Hi,
>   I tried using the oracle thin jdbc driver with the settings below in hive-site.xml but got the exception pasted below[1]- anybody hit this? (I am using Oracle 11g and hive trunk as of a month back).
>
> Thanks,
> Pradeep
>
> [1]
> -bash-3.1$ bin/hive
> Hive history file=/tmp/pradeepk/hive_job_log_pradeepk_201006032327_643566363.txt
> hive> show tables;
> FAILED: Error in metadata: MetaException(message:Got exception: javax.jdo.JDODataStoreException An exception was thrown while adding/validating class(es) : ORA-01754: a table may contain only one column of type LONG
>
> java.sql.SQLSyntaxErrorException: ORA-01754: a table may contain only one column of type LONG
>
>         at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:91)
>         at oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:133)
>         at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:206)
>         at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:455)
>         at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:413)
>         at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:1034)
>         at oracle.jdbc.driver.T4CStatement.doOall8(T4CStatement.java:183)
>         at oracle.jdbc.driver.T4CStatement.executeForRows(T4CStatement.java:942)
>         at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1222)
>         at oracle.jdbc.driver.OracleStatement.executeInternal(OracleStatement.java:1770)
>         at oracle.jdbc.driver.OracleStatement.execute(OracleStatement.java:1739)
>
>
>
> Carl Steinbach wrote:
> Hi Pradeep,
>
> Your config values will need to look something like this:
>
> javax.jdo.option.ConnectionURL = jdbc:oracle:thin:@'host':'port':'db-name'
> javax.jdo.option.ConnectionDriverName = oracle.jdbc.driver.OracleDriver
> javax.jdo.option.ConnectionUserName</hadoop/ConnectionUserName> = your-user-name
> javax.jdo.option.ConnectionPassword</hadoop/ConnectionPassword> = your-password
>
> Obviously you need to replace 'host', 'port' and 'db-name' with appropriate values. You also need to get a copy of the Oracle thin JDBC driver (or some other JDBC driver that supports Oracle) and make sure that it is available in Hive's classpath (e.g. by referencing it in HIVE_AUX_JARS_PATH). If this does not work out of the box I recommend consulting the documentation that comes with your JDBC driver.
>
> Thanks.
>
> Carl
>
> On Tue, May 25, 2010 at 11:12 AM, Pradeep Kamath <pr...@yahoo-inc.com>> wrote:
> Hi Sonal,
>  I want to set up hive metastore with Oracle as backend and wanted the config values for that.
>
> Thanks,
> Pradee
>
> -----Original Message-----
> From: Sonal Goyal [mailto:sonalgoyal4@gmail.com<ma...@gmail.com>]
> Sent: Tuesday, May 25, 2010 10:42 AM
> To: hive-user@hadoop.apache.org<ma...@hadoop.apache.org>
> Subject: Fwd: metastore set up with Oracle backend?
>
> Hi Pradeep,
>
> You can check the config values for MySQL as a metastore for Hive at
> the following link:
>
> http://www.mazsoft.com/blog/post/2010/02/01/Setting-up-HadoopHive-to-use-MySQL-as-metastore.aspx
>
> Thanks and Regards,
> Sonal
> www.meghsoft.com<http://www.meghsoft.com>
> http://in.linkedin.com/in/sonalgoyal
>
>
> On Tue, May 25, 2010 at 10:00 PM, Pradeep Kamath <pr...@yahoo-inc.com>> wrote:
>   
>> Hi Aaron,
>>
>>   Can you share some details along the lines of what is described in http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin#Local_Metastore for MySQL? (Essentially what changes are needed in properties to get this working)
>>
>>
>>
>> Thanks,
>>
>> Pradeep
>>
>>
>>
>> ________________________________
>>
>> From: Aaron McCurry [mailto:amccurry@gmail.com<ma...@gmail.com>]
>> Sent: Monday, May 24, 2010 1:42 PM
>> To: hive-user@hadoop.apache.org<ma...@hadoop.apache.org>
>> Subject: Re: metastore set up with Oracle backend?
>>
>>
>>
>> I have done it, everything seemed to work just fine.
>>
>>
>>
>> Aaron
>>
>>
>>
>>
>>
>> On Mon, May 24, 2010 at 4:37 PM, Pradeep Kamath <pr...@yahoo-inc.com>> wrote:
>>
>> Hi,
>>
>>   Can hive metastore be setup with Oracle as backend without any code changes? Has anyone tried this? Any pointers would be much appreciated.
>>
>>
>>
>> Thanks,
>>
>> Pradeep
>>
>>
>>     
>
>
>

RE: metastore set up with Oracle backend?

Posted by John Sichi <js...@facebook.com>.

Hmm, this is because MTable now has two LONGVARCHAR fields (viewOriginalText and viewExpandedText).  Can you find a way to get the Oracle driver or JDO to map these to CLOB instead of LONG VARCHAR?  Oracle allows multiple CLOB fields on the same table, but only one LONG VARCHAR (legacy crud).

JVS

________________________________________
From: Pradeep Kamath [pradeepk@yahoo-inc.com]
Sent: Friday, June 04, 2010 9:22 AM
To: hive-user@hadoop.apache.org
Subject: Re: metastore set up with Oracle backend?

Hi,
  I tried using the oracle thin jdbc driver with the settings below in hive-site.xml but got the exception pasted below[1]- anybody hit this? (I am using Oracle 11g and hive trunk as of a month back).

Thanks,
Pradeep

[1]
-bash-3.1$ bin/hive
Hive history file=/tmp/pradeepk/hive_job_log_pradeepk_201006032327_643566363.txt
hive> show tables;
FAILED: Error in metadata: MetaException(message:Got exception: javax.jdo.JDODataStoreException An exception was thrown while adding/validating class(es) : ORA-01754: a table may contain only one column of type LONG

java.sql.SQLSyntaxErrorException: ORA-01754: a table may contain only one column of type LONG

        at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:91)
        at oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:133)
        at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:206)
        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:455)
        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:413)
        at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:1034)
        at oracle.jdbc.driver.T4CStatement.doOall8(T4CStatement.java:183)
        at oracle.jdbc.driver.T4CStatement.executeForRows(T4CStatement.java:942)
        at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1222)
        at oracle.jdbc.driver.OracleStatement.executeInternal(OracleStatement.java:1770)
        at oracle.jdbc.driver.OracleStatement.execute(OracleStatement.java:1739)

Carl Steinbach wrote:
Hi Pradeep,

Your config values will need to look something like this:

javax.jdo.option.ConnectionURL = jdbc:oracle:thin:@'host':'port':'db-name'
javax.jdo.option.ConnectionDriverName = oracle.jdbc.driver.OracleDriver
javax.jdo.option.ConnectionUserName</hadoop/ConnectionUserName> = your-user-name
javax.jdo.option.ConnectionPassword</hadoop/ConnectionPassword> = your-password

Obviously you need to replace 'host', 'port' and 'db-name' with appropriate values. You also need to get a copy of the Oracle thin JDBC driver (or some other JDBC driver that supports Oracle) and make sure that it is available in Hive's classpath (e.g. by referencing it in HIVE_AUX_JARS_PATH). If this does not work out of the box I recommend consulting the documentation that comes with your JDBC driver.

Thanks.

Carl

On Tue, May 25, 2010 at 11:12 AM, Pradeep Kamath <pr...@yahoo-inc.com>> wrote:
Hi Sonal,
 I want to set up hive metastore with Oracle as backend and wanted the config values for that.

Thanks,
Pradee

-----Original Message-----
From: Sonal Goyal [mailto:sonalgoyal4@gmail.com<ma...@gmail.com>]
Sent: Tuesday, May 25, 2010 10:42 AM
To: hive-user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Fwd: metastore set up with Oracle backend?

Hi Pradeep,

You can check the config values for MySQL as a metastore for Hive at
the following link:

http://www.mazsoft.com/blog/post/2010/02/01/Setting-up-HadoopHive-to-use-MySQL-as-metastore.aspx

Thanks and Regards,
Sonal
www.meghsoft.com<http://www.meghsoft.com>
http://in.linkedin.com/in/sonalgoyal

On Tue, May 25, 2010 at 10:00 PM, Pradeep Kamath <pr...@yahoo-inc.com>> wrote:
>
> Hi Aaron,
>
>   Can you share some details along the lines of what is described in http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin#Local_Metastore for MySQL? (Essentially what changes are needed in properties to get this working)
>
>
>
> Thanks,
>
> Pradeep
>
>
>
> ________________________________
>
> From: Aaron McCurry [mailto:amccurry@gmail.com<ma...@gmail.com>]
> Sent: Monday, May 24, 2010 1:42 PM
> To: hive-user@hadoop.apache.org<ma...@hadoop.apache.org>
> Subject: Re: metastore set up with Oracle backend?
>
>
>
> I have done it, everything seemed to work just fine.
>
>
>
> Aaron
>
>
>
>
>
> On Mon, May 24, 2010 at 4:37 PM, Pradeep Kamath <pr...@yahoo-inc.com>> wrote:
>
> Hi,
>
>   Can hive metastore be setup with Oracle as backend without any code changes? Has anyone tried this? Any pointers would be much appreciated.
>
>
>
> Thanks,
>
> Pradeep
>
>

Re: metastore set up with Oracle backend?

Posted by Pradeep Kamath <pr...@yahoo-inc.com>.

Hi,
  I tried using the oracle thin jdbc driver with the settings below in 
hive-site.xml but got the exception pasted below[1]- anybody hit this? 
(I am using Oracle 11g and hive trunk as of a month back).

Thanks,
Pradeep

[1]
-bash-3.1$ bin/hive
Hive history 
file=/tmp/pradeepk/hive_job_log_pradeepk_201006032327_643566363.txt
hive> show tables;
FAILED: Error in metadata: MetaException(message:Got exception: 
javax.jdo.JDODataStoreException An exception was thrown while 
adding/validating class(es) : ORA-01754: a table may contain only one 
column of type LONG

java.sql.SQLSyntaxErrorException: ORA-01754: a table may contain only 
one column of type LONG

        at 
oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:91)
        at 
oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:133)
        at 
oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:206)
        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:455)
        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:413)
        at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:1034)
        at oracle.jdbc.driver.T4CStatement.doOall8(T4CStatement.java:183)
        at 
oracle.jdbc.driver.T4CStatement.executeForRows(T4CStatement.java:942)
        at 
oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1222)
        at 
oracle.jdbc.driver.OracleStatement.executeInternal(OracleStatement.java:1770)
        at 
oracle.jdbc.driver.OracleStatement.execute(OracleStatement.java:1739)



Carl Steinbach wrote:
> Hi Pradeep,
>
> Your config values will need to look something like this:
>
> javax.jdo.option.ConnectionURL = jdbc:oracle:thin:@'host':'port':'db-name'
> javax.jdo.option.ConnectionDriverName = oracle.jdbc.driver.OracleDriver
> javax.jdo.option.ConnectionUserName </hadoop/ConnectionUserName> = 
> your-user-name
> javax.jdo.option.ConnectionPassword </hadoop/ConnectionPassword> = 
> your-password
>
> Obviously you need to replace 'host', 'port' and 'db-name' with 
> appropriate values. You also need to get a copy of the Oracle thin 
> JDBC driver (or some other JDBC driver that supports Oracle) and make 
> sure that it is available in Hive's classpath (e.g. by referencing it 
> in HIVE_AUX_JARS_PATH). If this does not work out of the box I 
> recommend consulting the documentation that comes with your JDBC driver.
>
> Thanks.
>
> Carl
>
> On Tue, May 25, 2010 at 11:12 AM, Pradeep Kamath 
> <pradeepk@yahoo-inc.com <ma...@yahoo-inc.com>> wrote:
>
>     Hi Sonal,
>      I want to set up hive metastore with Oracle as backend and wanted
>     the config values for that.
>
>     Thanks,
>     Pradee
>
>     -----Original Message-----
>     From: Sonal Goyal [mailto:sonalgoyal4@gmail.com
>     <ma...@gmail.com>]
>     Sent: Tuesday, May 25, 2010 10:42 AM
>     To: hive-user@hadoop.apache.org <ma...@hadoop.apache.org>
>     Subject: Fwd: metastore set up with Oracle backend?
>
>     Hi Pradeep,
>
>     You can check the config values for MySQL as a metastore for Hive at
>     the following link:
>
>     http://www.mazsoft.com/blog/post/2010/02/01/Setting-up-HadoopHive-to-use-MySQL-as-metastore.aspx
>
>     Thanks and Regards,
>     Sonal
>     www.meghsoft.com <http://www.meghsoft.com>
>     http://in.linkedin.com/in/sonalgoyal
>
>
>     On Tue, May 25, 2010 at 10:00 PM, Pradeep Kamath
>     <pradeepk@yahoo-inc.com <ma...@yahoo-inc.com>> wrote:
>     >
>     > Hi Aaron,
>     >
>     >   Can you share some details along the lines of what is
>     described in
>     http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin#Local_Metastore
>     for MySQL? (Essentially what changes are needed in properties to
>     get this working)
>     >
>     >
>     >
>     > Thanks,
>     >
>     > Pradeep
>     >
>     >
>     >
>     > ________________________________
>     >
>     > From: Aaron McCurry [mailto:amccurry@gmail.com
>     <ma...@gmail.com>]
>     > Sent: Monday, May 24, 2010 1:42 PM
>     > To: hive-user@hadoop.apache.org <ma...@hadoop.apache.org>
>     > Subject: Re: metastore set up with Oracle backend?
>     >
>     >
>     >
>     > I have done it, everything seemed to work just fine.
>     >
>     >
>     >
>     > Aaron
>     >
>     >
>     >
>     >
>     >
>     > On Mon, May 24, 2010 at 4:37 PM, Pradeep Kamath
>     <pradeepk@yahoo-inc.com <ma...@yahoo-inc.com>> wrote:
>     >
>     > Hi,
>     >
>     >   Can hive metastore be setup with Oracle as backend without any
>     code changes? Has anyone tried this? Any pointers would be much
>     appreciated.
>     >
>     >
>     >
>     > Thanks,
>     >
>     > Pradeep
>     >
>     >
>
>

Re: metastore set up with Oracle backend?

Posted by Carl Steinbach <ca...@cloudera.com>.

Hi Pradeep,

Your config values will need to look something like this:

javax.jdo.option.ConnectionURL = jdbc:oracle:thin:@'host':'port':'db-name'
javax.jdo.option.ConnectionDriverName = oracle.jdbc.driver.OracleDriver
javax.jdo.option.ConnectionUserName </hadoop/ConnectionUserName> =
your-user-name
javax.jdo.option.ConnectionPassword </hadoop/ConnectionPassword> =
your-password

Obviously you need to replace 'host', 'port' and 'db-name' with appropriate
values. You also need to get a copy of the Oracle thin JDBC driver (or some
other JDBC driver that supports Oracle) and make sure that it is available
in Hive's classpath (e.g. by referencing it in HIVE_AUX_JARS_PATH). If this
does not work out of the box I recommend consulting the documentation that
comes with your JDBC driver.

Thanks.

Carl

On Tue, May 25, 2010 at 11:12 AM, Pradeep Kamath <pr...@yahoo-inc.com>wrote:

> Hi Sonal,
>  I want to set up hive metastore with Oracle as backend and wanted the
> config values for that.
>
> Thanks,
> Pradee
>
> -----Original Message-----
> From: Sonal Goyal [mailto:sonalgoyal4@gmail.com]
> Sent: Tuesday, May 25, 2010 10:42 AM
> To: hive-user@hadoop.apache.org
> Subject: Fwd: metastore set up with Oracle backend?
>
> Hi Pradeep,
>
> You can check the config values for MySQL as a metastore for Hive at
> the following link:
>
>
> http://www.mazsoft.com/blog/post/2010/02/01/Setting-up-HadoopHive-to-use-MySQL-as-metastore.aspx
>
> Thanks and Regards,
> Sonal
> www.meghsoft.com
> http://in.linkedin.com/in/sonalgoyal
>
>
> On Tue, May 25, 2010 at 10:00 PM, Pradeep Kamath <pr...@yahoo-inc.com>
> wrote:
> >
> > Hi Aaron,
> >
> >   Can you share some details along the lines of what is described in
> http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin#Local_Metastorefor MySQL? (Essentially what changes are needed in properties to get this
> working)
> >
> >
> >
> > Thanks,
> >
> > Pradeep
> >
> >
> >
> > ________________________________
> >
> > From: Aaron McCurry [mailto:amccurry@gmail.com]
> > Sent: Monday, May 24, 2010 1:42 PM
> > To: hive-user@hadoop.apache.org
> > Subject: Re: metastore set up with Oracle backend?
> >
> >
> >
> > I have done it, everything seemed to work just fine.
> >
> >
> >
> > Aaron
> >
> >
> >
> >
> >
> > On Mon, May 24, 2010 at 4:37 PM, Pradeep Kamath <pr...@yahoo-inc.com>
> wrote:
> >
> > Hi,
> >
> >   Can hive metastore be setup with Oracle as backend without any code
> changes? Has anyone tried this? Any pointers would be much appreciated.
> >
> >
> >
> > Thanks,
> >
> > Pradeep
> >
> >
>

RE: metastore set up with Oracle backend?

Posted by Pradeep Kamath <pr...@yahoo-inc.com>.

Hi Sonal,
  I want to set up hive metastore with Oracle as backend and wanted the config values for that.

Thanks,
Pradee 

-----Original Message-----
From: Sonal Goyal [mailto:sonalgoyal4@gmail.com] 
Sent: Tuesday, May 25, 2010 10:42 AM
To: hive-user@hadoop.apache.org
Subject: Fwd: metastore set up with Oracle backend?

Hi Pradeep,

You can check the config values for MySQL as a metastore for Hive at
the following link:

http://www.mazsoft.com/blog/post/2010/02/01/Setting-up-HadoopHive-to-use-MySQL-as-metastore.aspx

Thanks and Regards,
Sonal
www.meghsoft.com
http://in.linkedin.com/in/sonalgoyal


On Tue, May 25, 2010 at 10:00 PM, Pradeep Kamath <pr...@yahoo-inc.com> wrote:
>
> Hi Aaron,
>
>   Can you share some details along the lines of what is described in http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin#Local_Metastore for MySQL? (Essentially what changes are needed in properties to get this working)
>
>
>
> Thanks,
>
> Pradeep
>
>
>
> ________________________________
>
> From: Aaron McCurry [mailto:amccurry@gmail.com]
> Sent: Monday, May 24, 2010 1:42 PM
> To: hive-user@hadoop.apache.org
> Subject: Re: metastore set up with Oracle backend?
>
>
>
> I have done it, everything seemed to work just fine.
>
>
>
> Aaron
>
>
>
>
>
> On Mon, May 24, 2010 at 4:37 PM, Pradeep Kamath <pr...@yahoo-inc.com> wrote:
>
> Hi,
>
>   Can hive metastore be setup with Oracle as backend without any code changes? Has anyone tried this? Any pointers would be much appreciated.
>
>
>
> Thanks,
>
> Pradeep
>
>

Fwd: metastore set up with Oracle backend?

Posted by Sonal Goyal <so...@gmail.com>.

Hi Pradeep,

You can check the config values for MySQL as a metastore for Hive at
the following link:

http://www.mazsoft.com/blog/post/2010/02/01/Setting-up-HadoopHive-to-use-MySQL-as-metastore.aspx

Thanks and Regards,
Sonal
www.meghsoft.com
http://in.linkedin.com/in/sonalgoyal


On Tue, May 25, 2010 at 10:00 PM, Pradeep Kamath <pr...@yahoo-inc.com> wrote:
>
> Hi Aaron,
>
>   Can you share some details along the lines of what is described in http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin#Local_Metastore for MySQL? (Essentially what changes are needed in properties to get this working)
>
>
>
> Thanks,
>
> Pradeep
>
>
>
> ________________________________
>
> From: Aaron McCurry [mailto:amccurry@gmail.com]
> Sent: Monday, May 24, 2010 1:42 PM
> To: hive-user@hadoop.apache.org
> Subject: Re: metastore set up with Oracle backend?
>
>
>
> I have done it, everything seemed to work just fine.
>
>
>
> Aaron
>
>
>
>
>
> On Mon, May 24, 2010 at 4:37 PM, Pradeep Kamath <pr...@yahoo-inc.com> wrote:
>
> Hi,
>
>   Can hive metastore be setup with Oracle as backend without any code changes? Has anyone tried this? Any pointers would be much appreciated.
>
>
>
> Thanks,
>
> Pradeep
>
>

RE: metastore set up with Oracle backend?

Posted by Pradeep Kamath <pr...@yahoo-inc.com>.

Hi Aaron,

  Can you share some details along the lines of what is described in
http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin#Local_Meta
store for MySQL? (Essentially what changes are needed in properties to
get this working)

 

Thanks,

Pradeep

 

________________________________

From: Aaron McCurry [mailto:amccurry@gmail.com] 
Sent: Monday, May 24, 2010 1:42 PM
To: hive-user@hadoop.apache.org
Subject: Re: metastore set up with Oracle backend?

 

I have done it, everything seemed to work just fine.

 

Aaron

 

 

On Mon, May 24, 2010 at 4:37 PM, Pradeep Kamath <pr...@yahoo-inc.com>
wrote:

Hi,

  Can hive metastore be setup with Oracle as backend without any code
changes? Has anyone tried this? Any pointers would be much appreciated.

 

Thanks,

Pradeep

Re: metastore set up with Oracle backend?

Posted by Aaron McCurry <am...@gmail.com>.

I have done it, everything seemed to work just fine.

Aaron

On Mon, May 24, 2010 at 4:37 PM, Pradeep Kamath <pr...@yahoo-inc.com>wrote:

>  Hi,
>
>   Can hive metastore be setup with Oracle as backend without any code
> changes? Has anyone tried this? Any pointers would be much appreciated.
>
>
>
> Thanks,
>
> Pradeep
>