Question current/future functionality

["Kojoukhov, Dmitry" <dm...@roche.com>]

Dear Sir or Madam,

We are currently evaluating Apache Drill for use as a data integration
solution in one of our projects, and we are quite impressed by user
friendliness and ease of configuration of the product.

There is however one feature that we consider critical: we are looking for
a product that can, among other things, connect to a generic REST web
service based data source (by, for instance, letting the client code a
custom REST connector for such a data source). Then it would be possible to
use such a WS based data source just as any other data source that Drill
currently supports: run SQL queries against multiple data sources etc.

Going through Drill documentation I have not found any mention of such
functionality. Could you please comment as to whether such functionality is
available or whether there are plans to add such functionality to Drill in
the foreseeable future?

Many thanks in advance,
Dmitry Kozhukhov
Hoffman - La Roche

Re: Question current/future functionality

[Charles Givre <cg...@gmail.com>]

I concur with Dmitry here.  Having the ability to query a REST API from Drill would be super useful.  There is this repo on github: https://github.com/kevinlynx/drill-storage-http, but it looks abandoned.  I'd really love for someone to take this up and get it into Drill. 
-- C



> On May 29, 2019, at 4:48 PM, Ted Dunning <te...@gmail.com> wrote:
> 
> Various people have done pretty much what you suggest.
> 
> Can you say just a bit more about what you want to do? Are you looking to
> push queries down into the web service?
> 
> Does is the web service basically exposing a limited number of datasets
> that are not subject to filtering inside the web service?
> 
> 
> 
> On Wed, May 29, 2019 at 1:03 PM Kojoukhov, Dmitry <
> dmitry.kojoukhov@roche.com> wrote:
> 
>> Dear Sir or Madam,
>> 
>> We are currently evaluating Apache Drill for use as a data integration
>> solution in one of our projects, and we are quite impressed by user
>> friendliness and ease of configuration of the product.
>> 
>> There is however one feature that we consider critical: we are looking for
>> a product that can, among other things, connect to a generic REST web
>> service based data source (by, for instance, letting the client code a
>> custom REST connector for such a data source). Then it would be possible to
>> use such a WS based data source just as any other data source that Drill
>> currently supports: run SQL queries against multiple data sources etc.
>> 
>> Going through Drill documentation I have not found any mention of such
>> functionality. Could you please comment as to whether such functionality is
>> available or whether there are plans to add such functionality to Drill in
>> the foreseeable future?
>> 
>> Many thanks in advance,
>> Dmitry Kozhukhov
>> Hoffman - La Roche
>> 

Re: Question current/future functionality

[Ted Dunning <te...@gmail.com>]

Various people have done pretty much what you suggest.

Can you say just a bit more about what you want to do? Are you looking to
push queries down into the web service?

Does is the web service basically exposing a limited number of datasets
that are not subject to filtering inside the web service?



On Wed, May 29, 2019 at 1:03 PM Kojoukhov, Dmitry <
dmitry.kojoukhov@roche.com> wrote:

> Dear Sir or Madam,
>
> We are currently evaluating Apache Drill for use as a data integration
> solution in one of our projects, and we are quite impressed by user
> friendliness and ease of configuration of the product.
>
> There is however one feature that we consider critical: we are looking for
> a product that can, among other things, connect to a generic REST web
> service based data source (by, for instance, letting the client code a
> custom REST connector for such a data source). Then it would be possible to
> use such a WS based data source just as any other data source that Drill
> currently supports: run SQL queries against multiple data sources etc.
>
> Going through Drill documentation I have not found any mention of such
> functionality. Could you please comment as to whether such functionality is
> available or whether there are plans to add such functionality to Drill in
> the foreseeable future?
>
> Many thanks in advance,
> Dmitry Kozhukhov
> Hoffman - La Roche
>