You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by samir das mohapatra <sa...@gmail.com> on 2013/02/27 12:09:38 UTC
How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Hi All,
Using sqoop how to take entire database table into HDFS insted of Table
by Table ?.
How do you guys did it?
Is there some trick?
Regards,
samir.
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by Kai Voigt <k...@123.org>.
http://sqoop.apache.org/docs/1.4.1-incubating/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal is your friend
Kai
Am 27.02.2013 um 12:09 schrieb samir das mohapatra <sa...@gmail.com>:
> Hi All,
>
> Using sqoop how to take entire database table into HDFS insted of Table by Table ?.
>
> How do you guys did it?
> Is there some trick?
>
> Regards,
> samir.
--
Kai Voigt
k@123.org
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by samir das mohapatra <sa...@gmail.com>.
Is it good way to take total 5PB data through the JAVA/JDBC Program ?
On Wed, Feb 27, 2013 at 5:56 PM, Michel Segel <mi...@hotmail.com>wrote:
> I wouldn't use sqoop if you are taking everything.
> Simpler to write your own java/jdbc program that writes its output to HDFS.
>
> Just saying...
>
> Sent from a remote device. Please excuse any typos...
>
> Mike Segel
>
> On Feb 27, 2013, at 5:15 AM, samir das mohapatra <sa...@gmail.com>
> wrote:
>
> thanks all.
>
>
>
> On Wed, Feb 27, 2013 at 4:41 PM, Jagat Singh <ja...@gmail.com> wrote:
>
>> You might want to read this
>>
>>
>> http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
>>
>>
>>
>>
>> On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <
>> samir.helpdoc@gmail.com> wrote:
>>
>>> Hi All,
>>>
>>> Using sqoop how to take entire database table into HDFS insted of
>>> Table by Table ?.
>>>
>>> How do you guys did it?
>>> Is there some trick?
>>>
>>> Regards,
>>> samir.
>>>
>>
>>
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by samir das mohapatra <sa...@gmail.com>.
Is it good way to take total 5PB data through the JAVA/JDBC Program ?
On Wed, Feb 27, 2013 at 5:56 PM, Michel Segel <mi...@hotmail.com>wrote:
> I wouldn't use sqoop if you are taking everything.
> Simpler to write your own java/jdbc program that writes its output to HDFS.
>
> Just saying...
>
> Sent from a remote device. Please excuse any typos...
>
> Mike Segel
>
> On Feb 27, 2013, at 5:15 AM, samir das mohapatra <sa...@gmail.com>
> wrote:
>
> thanks all.
>
>
>
> On Wed, Feb 27, 2013 at 4:41 PM, Jagat Singh <ja...@gmail.com> wrote:
>
>> You might want to read this
>>
>>
>> http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
>>
>>
>>
>>
>> On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <
>> samir.helpdoc@gmail.com> wrote:
>>
>>> Hi All,
>>>
>>> Using sqoop how to take entire database table into HDFS insted of
>>> Table by Table ?.
>>>
>>> How do you guys did it?
>>> Is there some trick?
>>>
>>> Regards,
>>> samir.
>>>
>>
>>
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by samir das mohapatra <sa...@gmail.com>.
Is it good way to take total 5PB data through the JAVA/JDBC Program ?
On Wed, Feb 27, 2013 at 5:56 PM, Michel Segel <mi...@hotmail.com>wrote:
> I wouldn't use sqoop if you are taking everything.
> Simpler to write your own java/jdbc program that writes its output to HDFS.
>
> Just saying...
>
> Sent from a remote device. Please excuse any typos...
>
> Mike Segel
>
> On Feb 27, 2013, at 5:15 AM, samir das mohapatra <sa...@gmail.com>
> wrote:
>
> thanks all.
>
>
>
> On Wed, Feb 27, 2013 at 4:41 PM, Jagat Singh <ja...@gmail.com> wrote:
>
>> You might want to read this
>>
>>
>> http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
>>
>>
>>
>>
>> On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <
>> samir.helpdoc@gmail.com> wrote:
>>
>>> Hi All,
>>>
>>> Using sqoop how to take entire database table into HDFS insted of
>>> Table by Table ?.
>>>
>>> How do you guys did it?
>>> Is there some trick?
>>>
>>> Regards,
>>> samir.
>>>
>>
>>
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by samir das mohapatra <sa...@gmail.com>.
Is it good way to take total 5PB data through the JAVA/JDBC Program ?
On Wed, Feb 27, 2013 at 5:56 PM, Michel Segel <mi...@hotmail.com>wrote:
> I wouldn't use sqoop if you are taking everything.
> Simpler to write your own java/jdbc program that writes its output to HDFS.
>
> Just saying...
>
> Sent from a remote device. Please excuse any typos...
>
> Mike Segel
>
> On Feb 27, 2013, at 5:15 AM, samir das mohapatra <sa...@gmail.com>
> wrote:
>
> thanks all.
>
>
>
> On Wed, Feb 27, 2013 at 4:41 PM, Jagat Singh <ja...@gmail.com> wrote:
>
>> You might want to read this
>>
>>
>> http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
>>
>>
>>
>>
>> On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <
>> samir.helpdoc@gmail.com> wrote:
>>
>>> Hi All,
>>>
>>> Using sqoop how to take entire database table into HDFS insted of
>>> Table by Table ?.
>>>
>>> How do you guys did it?
>>> Is there some trick?
>>>
>>> Regards,
>>> samir.
>>>
>>
>>
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by Michel Segel <mi...@hotmail.com>.
I wouldn't use sqoop if you are taking everything.
Simpler to write your own java/jdbc program that writes its output to HDFS.
Just saying...
Sent from a remote device. Please excuse any typos...
Mike Segel
On Feb 27, 2013, at 5:15 AM, samir das mohapatra <sa...@gmail.com> wrote:
> thanks all.
>
>
>
> On Wed, Feb 27, 2013 at 4:41 PM, Jagat Singh <ja...@gmail.com> wrote:
>> You might want to read this
>>
>> http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
>>
>>
>>
>>
>> On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <sa...@gmail.com> wrote:
>>> Hi All,
>>>
>>> Using sqoop how to take entire database table into HDFS insted of Table by Table ?.
>>>
>>> How do you guys did it?
>>> Is there some trick?
>>>
>>> Regards,
>>> samir.
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by Michel Segel <mi...@hotmail.com>.
I wouldn't use sqoop if you are taking everything.
Simpler to write your own java/jdbc program that writes its output to HDFS.
Just saying...
Sent from a remote device. Please excuse any typos...
Mike Segel
On Feb 27, 2013, at 5:15 AM, samir das mohapatra <sa...@gmail.com> wrote:
> thanks all.
>
>
>
> On Wed, Feb 27, 2013 at 4:41 PM, Jagat Singh <ja...@gmail.com> wrote:
>> You might want to read this
>>
>> http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
>>
>>
>>
>>
>> On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <sa...@gmail.com> wrote:
>>> Hi All,
>>>
>>> Using sqoop how to take entire database table into HDFS insted of Table by Table ?.
>>>
>>> How do you guys did it?
>>> Is there some trick?
>>>
>>> Regards,
>>> samir.
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by Michel Segel <mi...@hotmail.com>.
I wouldn't use sqoop if you are taking everything.
Simpler to write your own java/jdbc program that writes its output to HDFS.
Just saying...
Sent from a remote device. Please excuse any typos...
Mike Segel
On Feb 27, 2013, at 5:15 AM, samir das mohapatra <sa...@gmail.com> wrote:
> thanks all.
>
>
>
> On Wed, Feb 27, 2013 at 4:41 PM, Jagat Singh <ja...@gmail.com> wrote:
>> You might want to read this
>>
>> http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
>>
>>
>>
>>
>> On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <sa...@gmail.com> wrote:
>>> Hi All,
>>>
>>> Using sqoop how to take entire database table into HDFS insted of Table by Table ?.
>>>
>>> How do you guys did it?
>>> Is there some trick?
>>>
>>> Regards,
>>> samir.
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by Michel Segel <mi...@hotmail.com>.
I wouldn't use sqoop if you are taking everything.
Simpler to write your own java/jdbc program that writes its output to HDFS.
Just saying...
Sent from a remote device. Please excuse any typos...
Mike Segel
On Feb 27, 2013, at 5:15 AM, samir das mohapatra <sa...@gmail.com> wrote:
> thanks all.
>
>
>
> On Wed, Feb 27, 2013 at 4:41 PM, Jagat Singh <ja...@gmail.com> wrote:
>> You might want to read this
>>
>> http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
>>
>>
>>
>>
>> On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <sa...@gmail.com> wrote:
>>> Hi All,
>>>
>>> Using sqoop how to take entire database table into HDFS insted of Table by Table ?.
>>>
>>> How do you guys did it?
>>> Is there some trick?
>>>
>>> Regards,
>>> samir.
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by samir das mohapatra <sa...@gmail.com>.
thanks all.
On Wed, Feb 27, 2013 at 4:41 PM, Jagat Singh <ja...@gmail.com> wrote:
> You might want to read this
>
>
> http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
>
>
>
>
> On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <
> samir.helpdoc@gmail.com> wrote:
>
>> Hi All,
>>
>> Using sqoop how to take entire database table into HDFS insted of
>> Table by Table ?.
>>
>> How do you guys did it?
>> Is there some trick?
>>
>> Regards,
>> samir.
>>
>
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by samir das mohapatra <sa...@gmail.com>.
thanks all.
On Wed, Feb 27, 2013 at 4:41 PM, Jagat Singh <ja...@gmail.com> wrote:
> You might want to read this
>
>
> http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
>
>
>
>
> On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <
> samir.helpdoc@gmail.com> wrote:
>
>> Hi All,
>>
>> Using sqoop how to take entire database table into HDFS insted of
>> Table by Table ?.
>>
>> How do you guys did it?
>> Is there some trick?
>>
>> Regards,
>> samir.
>>
>
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by samir das mohapatra <sa...@gmail.com>.
thanks all.
On Wed, Feb 27, 2013 at 4:41 PM, Jagat Singh <ja...@gmail.com> wrote:
> You might want to read this
>
>
> http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
>
>
>
>
> On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <
> samir.helpdoc@gmail.com> wrote:
>
>> Hi All,
>>
>> Using sqoop how to take entire database table into HDFS insted of
>> Table by Table ?.
>>
>> How do you guys did it?
>> Is there some trick?
>>
>> Regards,
>> samir.
>>
>
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by samir das mohapatra <sa...@gmail.com>.
thanks all.
On Wed, Feb 27, 2013 at 4:41 PM, Jagat Singh <ja...@gmail.com> wrote:
> You might want to read this
>
>
> http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
>
>
>
>
> On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <
> samir.helpdoc@gmail.com> wrote:
>
>> Hi All,
>>
>> Using sqoop how to take entire database table into HDFS insted of
>> Table by Table ?.
>>
>> How do you guys did it?
>> Is there some trick?
>>
>> Regards,
>> samir.
>>
>
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by Jagat Singh <ja...@gmail.com>.
You might want to read this
http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <
samir.helpdoc@gmail.com> wrote:
> Hi All,
>
> Using sqoop how to take entire database table into HDFS insted of Table
> by Table ?.
>
> How do you guys did it?
> Is there some trick?
>
> Regards,
> samir.
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by Kai Voigt <k...@123.org>.
http://sqoop.apache.org/docs/1.4.1-incubating/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal is your friend
Kai
Am 27.02.2013 um 12:09 schrieb samir das mohapatra <sa...@gmail.com>:
> Hi All,
>
> Using sqoop how to take entire database table into HDFS insted of Table by Table ?.
>
> How do you guys did it?
> Is there some trick?
>
> Regards,
> samir.
--
Kai Voigt
k@123.org
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by Kai Voigt <k...@123.org>.
http://sqoop.apache.org/docs/1.4.1-incubating/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal is your friend
Kai
Am 27.02.2013 um 12:09 schrieb samir das mohapatra <sa...@gmail.com>:
> Hi All,
>
> Using sqoop how to take entire database table into HDFS insted of Table by Table ?.
>
> How do you guys did it?
> Is there some trick?
>
> Regards,
> samir.
--
Kai Voigt
k@123.org
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by Jagat Singh <ja...@gmail.com>.
You might want to read this
http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <
samir.helpdoc@gmail.com> wrote:
> Hi All,
>
> Using sqoop how to take entire database table into HDFS insted of Table
> by Table ?.
>
> How do you guys did it?
> Is there some trick?
>
> Regards,
> samir.
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by Jagat Singh <ja...@gmail.com>.
You might want to read this
http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <
samir.helpdoc@gmail.com> wrote:
> Hi All,
>
> Using sqoop how to take entire database table into HDFS insted of Table
> by Table ?.
>
> How do you guys did it?
> Is there some trick?
>
> Regards,
> samir.
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by Jagat Singh <ja...@gmail.com>.
You might want to read this
http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra <
samir.helpdoc@gmail.com> wrote:
> Hi All,
>
> Using sqoop how to take entire database table into HDFS insted of Table
> by Table ?.
>
> How do you guys did it?
> Is there some trick?
>
> Regards,
> samir.
>
Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table
Posted by Kai Voigt <k...@123.org>.
http://sqoop.apache.org/docs/1.4.1-incubating/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal is your friend
Kai
Am 27.02.2013 um 12:09 schrieb samir das mohapatra <sa...@gmail.com>:
> Hi All,
>
> Using sqoop how to take entire database table into HDFS insted of Table by Table ?.
>
> How do you guys did it?
> Is there some trick?
>
> Regards,
> samir.
--
Kai Voigt
k@123.org