Development of a Storage Plugin

[Christophe Rannou <ra...@gmail.com>]

Hello everyone,

I am currently doing an internship in a company who would like to connect
drill to its own data managing platform. This goes through the development
of a storage plugin. I downloaded the sources about the HBase, MongoDB and
hive storage plugin and so far I do not really understand what to do to
develop this storage plugin.

As a consequence I would like to have some guidelines concerning the
different steps of a storage plugin development and an explanation about
how does work a storage plugin.

My only goal so far is to perform a simple SELECT query from the company
platform through Drill.

Best regards,

Chris

Re: Development of a Storage Plugin

[Magnus Pierre <mp...@maprtech.com>]

Hello Christophe,

I did a very similar exercise recently in order to connect Drill with JDBC databases. I used the existing source code in Apache Drill as basis for getting things in a shape that is working. I have not seen a concise documentation regarding how to develop Storage Plugins, but I’ll claim that the source code for existing storage plugins are pretty good at detailing whats needed. 

If you look at: https://issues.apache.org/jira/browse/DRILL-3180 <https://issues.apache.org/jira/browse/DRILL-3180> you will see the code that I produced which is basically a bare bones implementation of a Storage Plugin. My plugin only touches the functionalities provided by Apache Drill and does not do anything advanced so it seems to be quite close to what you aim for.

Best regards,
Magnus
> 3 jun 2015 kl. 17:20 skrev Christophe Rannou <ra...@gmail.com>:
> 
> Hello everyone,
> 
> I am currently doing an internship in a company who would like to connect
> drill to its own data managing platform. This goes through the development
> of a storage plugin. I downloaded the sources about the HBase, MongoDB and
> hive storage plugin and so far I do not really understand what to do to
> develop this storage plugin.
> 
> As a consequence I would like to have some guidelines concerning the
> different steps of a storage plugin development and an explanation about
> how does work a storage plugin.
> 
> My only goal so far is to perform a simple SELECT query from the company
> platform through Drill.
> 
> Best regards,
> 
> Chris