Sample JDBC Plugin for Apache Drill

[Magnus Pierre <mp...@maprtech.com>]

Hello Drill developers,

I'm an Systems Engineer at MapR (i.e. Sales), and I've developed a
primitive Sample JDBC Plugin for Apache Drill that I've shown for a few
people and companies with great interest as result. The plugin works in the
context of doing simple SQL queries against MySQL and Netezza (the only two
tested so far), and returning the result to Apache Drill.

I would like to share my work with the Apache Drill community, and
cooperate with all of you to move this into something that would actually
work in Apache Drill. I'm new to open source so consider me as a blank
paper. Any guides / procedures for how things are conducted in the scope of
the project would be very helpful.

Currently the code is done for 0.9 but I will migrate the code to support
Apache Drill 1.0 today.
Currently the code is using standard JDBC classes but it has been suggested
to switch to Calcite which I fully support.
There's work to be done on all pieces but some base code is there to
consider at least.

What's the procedure to make this happen?

Regards,
Magnus

Re: Sample JDBC Plugin for Apache Drill

[rahul challapalli <ch...@gmail.com>]

Great Work Magnus!

I have seen teams spending considerable engineering time in building tools
for data movement between an RDBMS and hadoop. With this new storage
plugin, data movement should be a breeze ( Just a CTAS query) or even
better they can directly execute a join query between an RDBMS table and a
file on HDFS.

- Rahul

On Mon, May 25, 2015 at 12:30 PM, Jacques Nadeau <ja...@apache.org> wrote:

> Welcome Magnus!  This is great news as I know a lot of people are
> interested in this.
>
> Leveraging all the capabilities in Calcite is definitely a good idea.  I
> propose you open a new JIRA issue and attach whatever your current code is.
>
>
> Once created, we can get it assigned to you and get the code incorporated.
> Since this is your first patch, we'll work with you to figure it out.
>
> thanks,
> Jacques
>
> On Mon, May 25, 2015 at 12:43 AM, Magnus Pierre <mp...@maprtech.com>
> wrote:
>
> > Hello Drill developers,
> >
> > I'm an Systems Engineer at MapR (i.e. Sales), and I've developed a
> > primitive Sample JDBC Plugin for Apache Drill that I've shown for a few
> > people and companies with great interest as result. The plugin works in
> the
> > context of doing simple SQL queries against MySQL and Netezza (the only
> two
> > tested so far), and returning the result to Apache Drill.
> >
> > I would like to share my work with the Apache Drill community, and
> > cooperate with all of you to move this into something that would actually
> > work in Apache Drill. I'm new to open source so consider me as a blank
> > paper. Any guides / procedures for how things are conducted in the scope
> of
> > the project would be very helpful.
> >
> > Currently the code is done for 0.9 but I will migrate the code to support
> > Apache Drill 1.0 today.
> > Currently the code is using standard JDBC classes but it has been
> suggested
> > to switch to Calcite which I fully support.
> > There's work to be done on all pieces but some base code is there to
> > consider at least.
> >
> > What's the procedure to make this happen?
> >
> > Regards,
> > Magnus
> >
>

Re: Sample JDBC Plugin for Apache Drill

[Jacques Nadeau <ja...@apache.org>]

Welcome Magnus!  This is great news as I know a lot of people are
interested in this.

Leveraging all the capabilities in Calcite is definitely a good idea.  I
propose you open a new JIRA issue and attach whatever your current code is.


Once created, we can get it assigned to you and get the code incorporated.
Since this is your first patch, we'll work with you to figure it out.

thanks,
Jacques

On Mon, May 25, 2015 at 12:43 AM, Magnus Pierre <mp...@maprtech.com>
wrote:

> Hello Drill developers,
>
> I'm an Systems Engineer at MapR (i.e. Sales), and I've developed a
> primitive Sample JDBC Plugin for Apache Drill that I've shown for a few
> people and companies with great interest as result. The plugin works in the
> context of doing simple SQL queries against MySQL and Netezza (the only two
> tested so far), and returning the result to Apache Drill.
>
> I would like to share my work with the Apache Drill community, and
> cooperate with all of you to move this into something that would actually
> work in Apache Drill. I'm new to open source so consider me as a blank
> paper. Any guides / procedures for how things are conducted in the scope of
> the project would be very helpful.
>
> Currently the code is done for 0.9 but I will migrate the code to support
> Apache Drill 1.0 today.
> Currently the code is using standard JDBC classes but it has been suggested
> to switch to Calcite which I fully support.
> There's work to be done on all pieces but some base code is there to
> consider at least.
>
> What's the procedure to make this happen?
>
> Regards,
> Magnus
>