You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by shakun grover <s2...@gmail.com> on 2016/08/31 05:19:35 UTC
Connector in Sqoop
Hi All,
Like the option that we have in Sqoop2 for creating custom generic JDBC
Connector, do we have any similar option in Sqoop?
Please let me know.
Thanks in advance!
--
Thanks & Regards,
Shakun Grover
Re: Connector in Sqoop
Posted by Erzsebet Szilagyi <li...@cloudera.com>.
Hi Shakun,
Your questions stayed with me since you mentioned "custom generic JDBC
Connector" and that gave me an idea.
Is it possible that the GenericJdbcManager Sqoop has already covers your
use case? Or alternatively, can your ideas improve on Sqoop's already
existing GenericJdbcManager?
Thanks,
Liz
On Wed, Aug 31, 2016 at 1:04 PM, Erzsebet Szilagyi <
liz.szilagyi@cloudera.com> wrote:
> Hi Shakun,
> Sqoop2 is designed to be modular in this way, Sqoop(1) doesn't have this
> quality.
> It is not impossible to develop a new/custom connector, but it's a lot
> more complicated and not well separated from the main code base of Sqoop(1).
>
> What exactly would you like to connect to? It might be useful for Sqoop to
> have your connector built-in, so this could be a great contribution to the
> overall project. The community could also help guiding you in the
> development if you are not sure how to go about it.
>
> Cheers,
> Liz
>
> On Wed, Aug 31, 2016 at 12:37 PM, shakun grover <s2...@gmail.com>
> wrote:
>
>> Custom Connector Development like mentioned in this link:
>>
>> https://sqoop.apache.org/docs/1.99.4/ConnectorDevelopment.html
>>
>> On Wed, Aug 31, 2016 at 4:05 PM, shakun grover <s2...@gmail.com>
>> wrote:
>>
>> > Thanks Erzsebet for the reply.
>> >
>> > Does that mean that we can't create our own custom connector like we do
>> in
>> > Sqoop2?
>> >
>> >
>> > On Wed, Aug 31, 2016 at 3:53 PM, Erzsebet Szilagyi <
>> > liz.szilagyi@cloudera.com> wrote:
>> >
>> >> Hi Shakun,
>> >> The best answer/explanation is available here:
>> >> https://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html#_sup
>> >> ported_databases
>> >> Cheers,
>> >> Liz
>> >>
>> >> On Wed, Aug 31, 2016 at 7:19 AM, shakun grover <s2...@gmail.com>
>> >> wrote:
>> >>
>> >> > Hi All,
>> >> >
>> >> > Like the option that we have in Sqoop2 for creating custom generic
>> JDBC
>> >> > Connector, do we have any similar option in Sqoop?
>> >> >
>> >> > Please let me know.
>> >> >
>> >> > Thanks in advance!
>> >> > --
>> >> > Thanks & Regards,
>> >> > Shakun Grover
>> >> >
>> >>
>> >>
>> >>
>> >> --
>> >> Erzsebet Szilagyi
>> >> Software Engineer
>> >> [image: www.cloudera.com] <http://www.cloudera.com>
>> >>
>> >
>> >
>> >
>> > --
>> > Thanks & Regards,
>> > Shakun Grover
>> >
>>
>>
>>
>> --
>> Thanks & Regards,
>> Shakun Grover
>>
>
>
>
> --
> Erzsebet Szilagyi
> Software Engineer
> [image: www.cloudera.com] <http://www.cloudera.com>
>
--
Erzsebet Szilagyi
Software Engineer
[image: www.cloudera.com] <http://www.cloudera.com>
Re: Connector in Sqoop
Posted by Erzsebet Szilagyi <li...@cloudera.com>.
Hi Shakun,
Sqoop2 is designed to be modular in this way, Sqoop(1) doesn't have this
quality.
It is not impossible to develop a new/custom connector, but it's a lot more
complicated and not well separated from the main code base of Sqoop(1).
What exactly would you like to connect to? It might be useful for Sqoop to
have your connector built-in, so this could be a great contribution to the
overall project. The community could also help guiding you in the
development if you are not sure how to go about it.
Cheers,
Liz
On Wed, Aug 31, 2016 at 12:37 PM, shakun grover <s2...@gmail.com> wrote:
> Custom Connector Development like mentioned in this link:
>
> https://sqoop.apache.org/docs/1.99.4/ConnectorDevelopment.html
>
> On Wed, Aug 31, 2016 at 4:05 PM, shakun grover <s2...@gmail.com> wrote:
>
> > Thanks Erzsebet for the reply.
> >
> > Does that mean that we can't create our own custom connector like we do
> in
> > Sqoop2?
> >
> >
> > On Wed, Aug 31, 2016 at 3:53 PM, Erzsebet Szilagyi <
> > liz.szilagyi@cloudera.com> wrote:
> >
> >> Hi Shakun,
> >> The best answer/explanation is available here:
> >> https://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html#_sup
> >> ported_databases
> >> Cheers,
> >> Liz
> >>
> >> On Wed, Aug 31, 2016 at 7:19 AM, shakun grover <s2...@gmail.com>
> >> wrote:
> >>
> >> > Hi All,
> >> >
> >> > Like the option that we have in Sqoop2 for creating custom generic
> JDBC
> >> > Connector, do we have any similar option in Sqoop?
> >> >
> >> > Please let me know.
> >> >
> >> > Thanks in advance!
> >> > --
> >> > Thanks & Regards,
> >> > Shakun Grover
> >> >
> >>
> >>
> >>
> >> --
> >> Erzsebet Szilagyi
> >> Software Engineer
> >> [image: www.cloudera.com] <http://www.cloudera.com>
> >>
> >
> >
> >
> > --
> > Thanks & Regards,
> > Shakun Grover
> >
>
>
>
> --
> Thanks & Regards,
> Shakun Grover
>
--
Erzsebet Szilagyi
Software Engineer
[image: www.cloudera.com] <http://www.cloudera.com>
Re: Connector in Sqoop
Posted by shakun grover <s2...@gmail.com>.
Custom Connector Development like mentioned in this link:
https://sqoop.apache.org/docs/1.99.4/ConnectorDevelopment.html
On Wed, Aug 31, 2016 at 4:05 PM, shakun grover <s2...@gmail.com> wrote:
> Thanks Erzsebet for the reply.
>
> Does that mean that we can't create our own custom connector like we do in
> Sqoop2?
>
>
> On Wed, Aug 31, 2016 at 3:53 PM, Erzsebet Szilagyi <
> liz.szilagyi@cloudera.com> wrote:
>
>> Hi Shakun,
>> The best answer/explanation is available here:
>> https://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html#_sup
>> ported_databases
>> Cheers,
>> Liz
>>
>> On Wed, Aug 31, 2016 at 7:19 AM, shakun grover <s2...@gmail.com>
>> wrote:
>>
>> > Hi All,
>> >
>> > Like the option that we have in Sqoop2 for creating custom generic JDBC
>> > Connector, do we have any similar option in Sqoop?
>> >
>> > Please let me know.
>> >
>> > Thanks in advance!
>> > --
>> > Thanks & Regards,
>> > Shakun Grover
>> >
>>
>>
>>
>> --
>> Erzsebet Szilagyi
>> Software Engineer
>> [image: www.cloudera.com] <http://www.cloudera.com>
>>
>
>
>
> --
> Thanks & Regards,
> Shakun Grover
>
--
Thanks & Regards,
Shakun Grover
Re: Connector in Sqoop
Posted by shakun grover <s2...@gmail.com>.
Thanks Erzsebet for the reply.
Does that mean that we can't create our own custom connector like we do in
Sqoop2?
On Wed, Aug 31, 2016 at 3:53 PM, Erzsebet Szilagyi <
liz.szilagyi@cloudera.com> wrote:
> Hi Shakun,
> The best answer/explanation is available here:
> https://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html#_
> supported_databases
> Cheers,
> Liz
>
> On Wed, Aug 31, 2016 at 7:19 AM, shakun grover <s2...@gmail.com> wrote:
>
> > Hi All,
> >
> > Like the option that we have in Sqoop2 for creating custom generic JDBC
> > Connector, do we have any similar option in Sqoop?
> >
> > Please let me know.
> >
> > Thanks in advance!
> > --
> > Thanks & Regards,
> > Shakun Grover
> >
>
>
>
> --
> Erzsebet Szilagyi
> Software Engineer
> [image: www.cloudera.com] <http://www.cloudera.com>
>
--
Thanks & Regards,
Shakun Grover
Re: Connector in Sqoop
Posted by Erzsebet Szilagyi <li...@cloudera.com>.
Hi Shakun,
The best answer/explanation is available here:
https://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html#_supported_databases
Cheers,
Liz
On Wed, Aug 31, 2016 at 7:19 AM, shakun grover <s2...@gmail.com> wrote:
> Hi All,
>
> Like the option that we have in Sqoop2 for creating custom generic JDBC
> Connector, do we have any similar option in Sqoop?
>
> Please let me know.
>
> Thanks in advance!
> --
> Thanks & Regards,
> Shakun Grover
>
--
Erzsebet Szilagyi
Software Engineer
[image: www.cloudera.com] <http://www.cloudera.com>