You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@sqoop.apache.org by prabhu k <pr...@gmail.com> on 2012/07/11 10:39:49 UTC
Load from Hive table to HDFS using sqoop
Hi Users list,
Please help me on the below .
1. how to load from Hive table to HDFS using sqoop
2. How to load from mysql database to HDFS using sqoop
3. How to load from HDFS to Hive table using sqoop.
Thanks,
Prabhu.
Re: Load from Hive table to HDFS using sqoop
Posted by Kathleen Ting <ka...@apache.org>.
Hi Prabhu, you may find the Sqoop wiki page
https://cwiki.apache.org/confluence/display/SQOOP/Home helpful.
Regards, Kathleen
On Wed, Jul 11, 2012 at 9:07 PM, prabhu k <pr...@gmail.com> wrote:
> Hi Kathleen,
>
> Thanks for providing the link, can you please share more links for sqoop.
>
> as Am learning stage, I have to learn more on sqoop.
>
> I am waiting for your response.
>
> Regards,
> Prabhu.
>
>
> On Thu, Jul 12, 2012 at 12:39 AM, Kathleen Ting <ka...@apache.org> wrote:
>>
>> Hi Prabhu,
>>
>> To add on to what Bejoy mentioned, while Sqoop is generally used to
>> transfer data between a JDBC compliant RDBMS and Hadoop, it is not
>> restricted to it - an example is Sqoop's connector to Couchbase.
>>
>> Furthermore in Sqoop 2, connectors will no longer be restricted to the
>> JDBC model, but can rather define their own vocabulary, e.g. Couchbase
>> no longer needs to specify a table name, only to overload it as a
>> backfill or dump operation:
>> https://blogs.apache.org/sqoop/entry/apache_sqoop_highlights_of_sqoop
>>
>> Regards, Kathleen
>>
>> On Wed, Jul 11, 2012 at 10:56 AM, prabhu k <pr...@gmail.com> wrote:
>> > Thanks for the response, I will go through the guide and come back to
>> > you..
>> >
>> > On Wed, Jul 11, 2012 at 2:26 PM, Bejoy KS <be...@gmail.com> wrote:ha
>> >
>> >> Hi Prabhu
>> >>
>> >> Sqoop is used to transfer data between Jdbc compliant RDBMS and hadoop.
>> >>
>> >> For hive the underlying storage is mostly hdfs, so the question for
>> >> data
>> >> transfer between hdfs and hive seems irrelevant
>> >>
>> >> You can use SQOOP import to transfer data from rdbms to hadoop. Specify
>> >> the connection parameters and other required arguments. Please refer
>> >> Sqoop
>> >> User guide for details on sqoop import.
>> >> Regards
>> >> Bejoy KS
>> >>
>> >> Sent from handheld, please excuse typos.
>> >> ________________________________
>> >> From: prabhu k <pr...@gmail.com>
>> >> Date: Wed, 11 Jul 2012 14:09:49 +0530
>> >> To: <us...@sqoop.apache.org>
>> >> ReplyTo: user@sqoop.apache.org
>> >> Subject: Load from Hive table to HDFS using sqoop
>> >>
>> >> Hi Users list,
>> >>
>> >> Please help me on the below .
>> >>
>> >> 1. how to load from Hive table to HDFS using sqoop
>> >>
>> >> 2. How to load from mysql database to HDFS using sqoop
>> >>
>> >> 3. How to load from HDFS to Hive table using sqoop.
>> >>
>> >> Thanks,
>> >> Prabhu.
>> >
>> >
>
>
Re: Load from Hive table to HDFS using sqoop
Posted by prabhu k <pr...@gmail.com>.
Hi Kathleen,
Thanks for providing the link, can you please share more links for sqoop.
as Am learning stage, I have to learn more on sqoop.
I am waiting for your response.
Regards,
Prabhu.
On Thu, Jul 12, 2012 at 12:39 AM, Kathleen Ting <ka...@apache.org> wrote:
> Hi Prabhu,
>
> To add on to what Bejoy mentioned, while Sqoop is generally used to
> transfer data between a JDBC compliant RDBMS and Hadoop, it is not
> restricted to it - an example is Sqoop's connector to Couchbase.
>
> Furthermore in Sqoop 2, connectors will no longer be restricted to the
> JDBC model, but can rather define their own vocabulary, e.g. Couchbase
> no longer needs to specify a table name, only to overload it as a
> backfill or dump operation:
> https://blogs.apache.org/sqoop/entry/apache_sqoop_highlights_of_sqoop
>
> Regards, Kathleen
>
> On Wed, Jul 11, 2012 at 10:56 AM, prabhu k <pr...@gmail.com> wrote:
> > Thanks for the response, I will go through the guide and come back to
> you..
> >
> > On Wed, Jul 11, 2012 at 2:26 PM, Bejoy KS <be...@gmail.com> wrote:ha
> >
> >> Hi Prabhu
> >>
> >> Sqoop is used to transfer data between Jdbc compliant RDBMS and hadoop.
> >>
> >> For hive the underlying storage is mostly hdfs, so the question for data
> >> transfer between hdfs and hive seems irrelevant
> >>
> >> You can use SQOOP import to transfer data from rdbms to hadoop. Specify
> >> the connection parameters and other required arguments. Please refer
> Sqoop
> >> User guide for details on sqoop import.
> >> Regards
> >> Bejoy KS
> >>
> >> Sent from handheld, please excuse typos.
> >> ________________________________
> >> From: prabhu k <pr...@gmail.com>
> >> Date: Wed, 11 Jul 2012 14:09:49 +0530
> >> To: <us...@sqoop.apache.org>
> >> ReplyTo: user@sqoop.apache.org
> >> Subject: Load from Hive table to HDFS using sqoop
> >>
> >> Hi Users list,
> >>
> >> Please help me on the below .
> >>
> >> 1. how to load from Hive table to HDFS using sqoop
> >>
> >> 2. How to load from mysql database to HDFS using sqoop
> >>
> >> 3. How to load from HDFS to Hive table using sqoop.
> >>
> >> Thanks,
> >> Prabhu.
> >
> >
>
Re: Load from Hive table to HDFS using sqoop
Posted by Kathleen Ting <ka...@apache.org>.
Hi Prabhu,
To add on to what Bejoy mentioned, while Sqoop is generally used to
transfer data between a JDBC compliant RDBMS and Hadoop, it is not
restricted to it - an example is Sqoop's connector to Couchbase.
Furthermore in Sqoop 2, connectors will no longer be restricted to the
JDBC model, but can rather define their own vocabulary, e.g. Couchbase
no longer needs to specify a table name, only to overload it as a
backfill or dump operation:
https://blogs.apache.org/sqoop/entry/apache_sqoop_highlights_of_sqoop
Regards, Kathleen
On Wed, Jul 11, 2012 at 10:56 AM, prabhu k <pr...@gmail.com> wrote:
> Thanks for the response, I will go through the guide and come back to you..
>
> On Wed, Jul 11, 2012 at 2:26 PM, Bejoy KS <be...@gmail.com> wrote:ha
>
>> Hi Prabhu
>>
>> Sqoop is used to transfer data between Jdbc compliant RDBMS and hadoop.
>>
>> For hive the underlying storage is mostly hdfs, so the question for data
>> transfer between hdfs and hive seems irrelevant
>>
>> You can use SQOOP import to transfer data from rdbms to hadoop. Specify
>> the connection parameters and other required arguments. Please refer Sqoop
>> User guide for details on sqoop import.
>> Regards
>> Bejoy KS
>>
>> Sent from handheld, please excuse typos.
>> ________________________________
>> From: prabhu k <pr...@gmail.com>
>> Date: Wed, 11 Jul 2012 14:09:49 +0530
>> To: <us...@sqoop.apache.org>
>> ReplyTo: user@sqoop.apache.org
>> Subject: Load from Hive table to HDFS using sqoop
>>
>> Hi Users list,
>>
>> Please help me on the below .
>>
>> 1. how to load from Hive table to HDFS using sqoop
>>
>> 2. How to load from mysql database to HDFS using sqoop
>>
>> 3. How to load from HDFS to Hive table using sqoop.
>>
>> Thanks,
>> Prabhu.
>
>
Re: Load from Hive table to HDFS using sqoop
Posted by prabhu k <pr...@gmail.com>.
Thanks for the response, I will go through the guide and come back to you..
On Wed, Jul 11, 2012 at 2:26 PM, Bejoy KS <be...@gmail.com> wrote:ha
> **
> Hi Prabhu
>
> Sqoop is used to transfer data between Jdbc compliant RDBMS and hadoop.
>
> For hive the underlying storage is mostly hdfs, so the question for data
> transfer between hdfs and hive seems irrelevant
>
> You can use SQOOP import to transfer data from rdbms to hadoop. Specify
> the connection parameters and other required arguments. Please refer Sqoop
> User guide for details on sqoop import.
> Regards
> Bejoy KS
>
> Sent from handheld, please excuse typos.
> ------------------------------
> *From: * prabhu k <pr...@gmail.com>
> *Date: *Wed, 11 Jul 2012 14:09:49 +0530
> *To: *<us...@sqoop.apache.org>
> *ReplyTo: * user@sqoop.apache.org
> *Subject: *Load from Hive table to HDFS using sqoop
>
> Hi Users list,
>
> Please help me on the below .
>
> 1. how to load from Hive table to HDFS using sqoop
>
> 2. How to load from mysql database to HDFS using sqoop
>
> 3. How to load from HDFS to Hive table using sqoop.
>
> Thanks,
> Prabhu.
>
Re: Load from Hive table to HDFS using sqoop
Posted by Bejoy KS <be...@gmail.com>.
Hi Prabhu
Sqoop is used to transfer data between Jdbc compliant RDBMS and hadoop.
For hive the underlying storage is mostly hdfs, so the question for data transfer between hdfs and hive seems irrelevant
You can use SQOOP import to transfer data from rdbms to hadoop. Specify the connection parameters and other required arguments. Please refer Sqoop User guide for details on sqoop import.
Regards
Bejoy KS
Sent from handheld, please excuse typos.
-----Original Message-----
From: prabhu k <pr...@gmail.com>
Date: Wed, 11 Jul 2012 14:09:49
To: <us...@sqoop.apache.org>
Reply-To: user@sqoop.apache.org
Subject: Load from Hive table to HDFS using sqoop
Hi Users list,
Please help me on the below .
1. how to load from Hive table to HDFS using sqoop
2. How to load from mysql database to HDFS using sqoop
3. How to load from HDFS to Hive table using sqoop.
Thanks,
Prabhu.