You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Aditya Singh30 <Ad...@infosys.com> on 2011/12/09 05:27:26 UTC
Loading data into hive tables
Hi,
I want to know if there is any way to load data directly from some other DB, say Oracle/MySQL etc., into hive tables, without getting the data from DB into a text/rcfile/sequence file in a specific format and then loading the data from that file into hive table.
Regards,
Aditya
**************** CAUTION - Disclaimer *****************
This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
for the use of the addressee(s). If you are not the intended recipient, please
notify the sender by e-mail and delete the original message. Further, you are not
to copy, disclose, or distribute this e-mail or its contents to any other person and
any such actions are unlawful. This e-mail may contain viruses. Infosys has taken
every reasonable precaution to minimize this risk, but is not liable for any damage
you may sustain as a result of any virus in this e-mail. You should carry out your
own virus checks before opening the e-mail or attachment. Infosys reserves the
right to monitor and review the content of all messages sent to or from this e-mail
address. Messages sent to or from this e-mail address may be stored on the
Infosys e-mail system.
***INFOSYS******** End of Disclaimer ********INFOSYS***
Re: Loading data into hive tables
Posted by alo alt <wg...@googlemail.com>.
u welcome :)
On Fri, Dec 9, 2011 at 9:44 AM, Aditya Singh30
<Ad...@infosys.com>wrote:
> Thanks a lot. It is the very thing I was looking for.. J****
>
> ** **
>
> *From:* alo alt [mailto:wget.null@googlemail.com]
> *Sent:* Friday, December 09, 2011 1:27 PM
> *To:* user@hive.apache.org; bejoy_ks@yahoo.com
> *Subject:* Re: Loading data into hive tables****
>
> ** **
>
> Adithya,****
>
> ** **
>
> Here small articles about:****
>
> MS SQL => Sqoop****
>
> http://mapredit.blogspot.com/2011/10/sqoop-and-microsoft-sql-server.html**
> **
>
> ** **
>
> And to use the self-generated classes:****
>
> http://mapredit.blogspot.com/2011/10/speedup-sqoop.html****
>
> ** **
>
> - Alex****
>
> ** **
>
> On Fri, Dec 9, 2011 at 5:51 AM, <be...@yahoo.com> wrote:****
>
> Adithya
> The answer is yes. SQOOP is the tool you are looking for. It has an import
> option to load data from from any jdbc compliant database into hive. It
> even creates the hive table for you by refering to the source db table.
>
> Hope It helps!..****
>
> Regards
> Bejoy K S****
> ------------------------------
>
> *From: *Aditya Singh30 <Ad...@infosys.com> ****
>
> *Date: *Fri, 9 Dec 2011 09:57:26 +0530****
>
> *To: *user@hive.apache.org<us...@hive.apache.org>****
>
> *ReplyTo: *user@hive.apache.org ****
>
> *Subject: *Loading data into hive tables****
>
> ** **
>
> Hi,****
>
> I want to know if there is any way to load data directly
> from some other DB, say Oracle/MySQL etc., into hive tables, without
> getting the data from DB into a text/rcfile/sequence file in a specific
> format and then loading the data from that file into hive table. ****
>
> ****
>
> Regards,****
>
> Aditya****
>
> **************** CAUTION - Disclaimer *********************
>
> This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely****
>
> for the use of the addressee(s). If you are not the intended recipient, please****
>
> notify the sender by e-mail and delete the original message. Further, you are not****
>
> to copy, disclose, or distribute this e-mail or its contents to any other person and****
>
> any such actions are unlawful. This e-mail may contain viruses. Infosys has taken****
>
> every reasonable precaution to minimize this risk, but is not liable for any damage****
>
> you may sustain as a result of any virus in this e-mail. You should carry out your****
>
> own virus checks before opening the e-mail or attachment. Infosys reserves the****
>
> right to monitor and review the content of all messages sent to or from this e-mail****
>
> address. Messages sent to or from this e-mail address may be stored on the****
>
> Infosys e-mail system.****
>
> ***INFOSYS******** End of Disclaimer ********INFOSYS*******
>
>
>
> ****
>
> ** **
>
> -- ****
>
> Alexander Lorenz****
>
> http://mapredit.blogspot.com****
>
> ** **
>
> *P **Think of the environment: please don't print this email unless you
> really need to.*****
>
> ** **
>
> ** **
>
--
Alexander Lorenz
http://mapredit.blogspot.com
*P **Think of the environment: please don't print this email unless you
really need to.*
RE: Loading data into hive tables
Posted by Aditya Singh30 <Ad...@infosys.com>.
Thanks a lot. It is the very thing I was looking for.. :)
From: alo alt [mailto:wget.null@googlemail.com]
Sent: Friday, December 09, 2011 1:27 PM
To: user@hive.apache.org; bejoy_ks@yahoo.com
Subject: Re: Loading data into hive tables
Adithya,
Here small articles about:
MS SQL => Sqoop
http://mapredit.blogspot.com/2011/10/sqoop-and-microsoft-sql-server.html
And to use the self-generated classes:
http://mapredit.blogspot.com/2011/10/speedup-sqoop.html
- Alex
On Fri, Dec 9, 2011 at 5:51 AM, <be...@yahoo.com>> wrote:
Adithya
The answer is yes. SQOOP is the tool you are looking for. It has an import option to load data from from any jdbc compliant database into hive. It even creates the hive table for you by refering to the source db table.
Hope It helps!..
Regards
Bejoy K S
________________________________
From: Aditya Singh30 <Ad...@infosys.com>>
Date: Fri, 9 Dec 2011 09:57:26 +0530
To: user@hive.apache.org<ma...@hive.apache.org>>
ReplyTo: user@hive.apache.org<ma...@hive.apache.org>
Subject: Loading data into hive tables
Hi,
I want to know if there is any way to load data directly from some other DB, say Oracle/MySQL etc., into hive tables, without getting the data from DB into a text/rcfile/sequence file in a specific format and then loading the data from that file into hive table.
Regards,
Aditya
**************** CAUTION - Disclaimer *****************
This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
for the use of the addressee(s). If you are not the intended recipient, please
notify the sender by e-mail and delete the original message. Further, you are not
to copy, disclose, or distribute this e-mail or its contents to any other person and
any such actions are unlawful. This e-mail may contain viruses. Infosys has taken
every reasonable precaution to minimize this risk, but is not liable for any damage
you may sustain as a result of any virus in this e-mail. You should carry out your
own virus checks before opening the e-mail or attachment. Infosys reserves the
right to monitor and review the content of all messages sent to or from this e-mail
address. Messages sent to or from this e-mail address may be stored on the
Infosys e-mail system.
***INFOSYS******** End of Disclaimer ********INFOSYS***
--
Alexander Lorenz
http://mapredit.blogspot.com
P Think of the environment: please don't print this email unless you really need to.
Re: Loading data into hive tables
Posted by alo alt <wg...@googlemail.com>.
Adithya,
Here small articles about:
MS SQL => Sqoop
http://mapredit.blogspot.com/2011/10/sqoop-and-microsoft-sql-server.html
And to use the self-generated classes:
http://mapredit.blogspot.com/2011/10/speedup-sqoop.html
- Alex
On Fri, Dec 9, 2011 at 5:51 AM, <be...@yahoo.com> wrote:
> Adithya
> The answer is yes. SQOOP is the tool you are looking for. It has an import
> option to load data from from any jdbc compliant database into hive. It
> even creates the hive table for you by refering to the source db table.
>
> Hope It helps!..
> Regards
> Bejoy K S
> ------------------------------
> *From: * Aditya Singh30 <Ad...@infosys.com>
> *Date: *Fri, 9 Dec 2011 09:57:26 +0530
> *To: *user@hive.apache.org<us...@hive.apache.org>
> *ReplyTo: * user@hive.apache.org
> *Subject: *Loading data into hive tables
>
> Hi,****
>
> I want to know if there is any way to load data directly
> from some other DB, say Oracle/MySQL etc., into hive tables, without
> getting the data from DB into a text/rcfile/sequence file in a specific
> format and then loading the data from that file into hive table. ****
>
> ** **
>
> Regards,****
>
> Aditya****
>
> **************** CAUTION - Disclaimer *****************
> This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
> for the use of the addressee(s). If you are not the intended recipient, please
> notify the sender by e-mail and delete the original message. Further, you are not
> to copy, disclose, or distribute this e-mail or its contents to any other person and
> any such actions are unlawful. This e-mail may contain viruses. Infosys has taken
> every reasonable precaution to minimize this risk, but is not liable for any damage
> you may sustain as a result of any virus in this e-mail. You should carry out your
> own virus checks before opening the e-mail or attachment. Infosys reserves the
> right to monitor and review the content of all messages sent to or from this e-mail
> address. Messages sent to or from this e-mail address may be stored on the
> Infosys e-mail system.
> ***INFOSYS******** End of Disclaimer ********INFOSYS***
>
>
--
Alexander Lorenz
http://mapredit.blogspot.com
*P **Think of the environment: please don't print this email unless you
really need to.*
Re: Loading data into hive tables
Posted by be...@yahoo.com.
Adithya
The answer is yes. SQOOP is the tool you are looking for. It has an import option to load data from from any jdbc compliant database into hive. It even creates the hive table for you by refering to the source db table.
Hope It helps!..
Regards
Bejoy K S
-----Original Message-----
From: Aditya Singh30 <Ad...@infosys.com>
Date: Fri, 9 Dec 2011 09:57:26
To: user@hive.apache.org<us...@hive.apache.org>
Reply-To: user@hive.apache.org
Subject: Loading data into hive tables
Hi,
I want to know if there is any way to load data directly from some other DB, say Oracle/MySQL etc., into hive tables, without getting the data from DB into a text/rcfile/sequence file in a specific format and then loading the data from that file into hive table.
Regards,
Aditya
**************** CAUTION - Disclaimer *****************
This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
for the use of the addressee(s). If you are not the intended recipient, please
notify the sender by e-mail and delete the original message. Further, you are not
to copy, disclose, or distribute this e-mail or its contents to any other person and
any such actions are unlawful. This e-mail may contain viruses. Infosys has taken
every reasonable precaution to minimize this risk, but is not liable for any damage
you may sustain as a result of any virus in this e-mail. You should carry out your
own virus checks before opening the e-mail or attachment. Infosys reserves the
right to monitor and review the content of all messages sent to or from this e-mail
address. Messages sent to or from this e-mail address may be stored on the
Infosys e-mail system.
***INFOSYS******** End of Disclaimer ********INFOSYS***