You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by Edmon Begoli <eb...@gmail.com> on 2016/02/26 04:27:01 UTC
The praises for Drill
Hello fellow Driilers,
I have been inactive on the development side of the project, as we got busy
being heavy/power users of the Drill in the last few months.
I just want to share some great experiences with the latest versions of
Drill.
Just tonight, as we were scrambling to meet the deadline, we were able to
query two years of flat psv files of claims/billing and clinical data in
Drill in less than 60 seconds.
No ETL, no warehousing - just plain SQL against tons of files. Run SQL, get
results.
Amazing!
We have also done some much more important things too, and we had a paper
accepted to Big Data Services about the experiences. The co-author of the
paper is Drill's own Dr. Ted Dunning :-)
I will share it once it is published.
Anyway, cheers to all, and hope to re-join the dev activities soon.
Best,
Edmon
Re: The praises for Drill
Posted by Abdel Hakim Deneche <ad...@maprtech.com>.
Looking forward to reading the paper!
On Fri, Feb 26, 2016 at 10:19 AM, Parth Chandra <pa...@apache.org> wrote:
> Welcome back Edmon, and thanks for the praise :). Hope to see you on the
> next hangout.
>
> On Thu, Feb 25, 2016 at 7:27 PM, Edmon Begoli <eb...@gmail.com> wrote:
>
> > Hello fellow Driilers,
> >
> > I have been inactive on the development side of the project, as we got
> busy
> > being heavy/power users of the Drill in the last few months.
> >
> > I just want to share some great experiences with the latest versions of
> > Drill.
> >
> > Just tonight, as we were scrambling to meet the deadline, we were able to
> > query two years of flat psv files of claims/billing and clinical data in
> > Drill in less than 60 seconds.
> >
> > No ETL, no warehousing - just plain SQL against tons of files. Run SQL,
> get
> > results.
> >
> > Amazing!
> >
> > We have also done some much more important things too, and we had a paper
> > accepted to Big Data Services about the experiences. The co-author of the
> > paper is Drill's own Dr. Ted Dunning :-)
> > I will share it once it is published.
> >
> > Anyway, cheers to all, and hope to re-join the dev activities soon.
> >
> > Best,
> > Edmon
> >
>
--
Abdelhakim Deneche
Software Engineer
<http://www.mapr.com/>
Now Available - Free Hadoop On-Demand Training
<http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available>
Re: The praises for Drill
Posted by Abdel Hakim Deneche <ad...@maprtech.com>.
Looking forward to reading the paper!
On Fri, Feb 26, 2016 at 10:19 AM, Parth Chandra <pa...@apache.org> wrote:
> Welcome back Edmon, and thanks for the praise :). Hope to see you on the
> next hangout.
>
> On Thu, Feb 25, 2016 at 7:27 PM, Edmon Begoli <eb...@gmail.com> wrote:
>
> > Hello fellow Driilers,
> >
> > I have been inactive on the development side of the project, as we got
> busy
> > being heavy/power users of the Drill in the last few months.
> >
> > I just want to share some great experiences with the latest versions of
> > Drill.
> >
> > Just tonight, as we were scrambling to meet the deadline, we were able to
> > query two years of flat psv files of claims/billing and clinical data in
> > Drill in less than 60 seconds.
> >
> > No ETL, no warehousing - just plain SQL against tons of files. Run SQL,
> get
> > results.
> >
> > Amazing!
> >
> > We have also done some much more important things too, and we had a paper
> > accepted to Big Data Services about the experiences. The co-author of the
> > paper is Drill's own Dr. Ted Dunning :-)
> > I will share it once it is published.
> >
> > Anyway, cheers to all, and hope to re-join the dev activities soon.
> >
> > Best,
> > Edmon
> >
>
--
Abdelhakim Deneche
Software Engineer
<http://www.mapr.com/>
Now Available - Free Hadoop On-Demand Training
<http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available>
Re: The praises for Drill
Posted by Parth Chandra <pa...@apache.org>.
Welcome back Edmon, and thanks for the praise :). Hope to see you on the
next hangout.
On Thu, Feb 25, 2016 at 7:27 PM, Edmon Begoli <eb...@gmail.com> wrote:
> Hello fellow Driilers,
>
> I have been inactive on the development side of the project, as we got busy
> being heavy/power users of the Drill in the last few months.
>
> I just want to share some great experiences with the latest versions of
> Drill.
>
> Just tonight, as we were scrambling to meet the deadline, we were able to
> query two years of flat psv files of claims/billing and clinical data in
> Drill in less than 60 seconds.
>
> No ETL, no warehousing - just plain SQL against tons of files. Run SQL, get
> results.
>
> Amazing!
>
> We have also done some much more important things too, and we had a paper
> accepted to Big Data Services about the experiences. The co-author of the
> paper is Drill's own Dr. Ted Dunning :-)
> I will share it once it is published.
>
> Anyway, cheers to all, and hope to re-join the dev activities soon.
>
> Best,
> Edmon
>
Re: The praises for Drill
Posted by "Antonio Romero (carnorom)" <ca...@cisco.com>.
Can you tell us what the volume of those files was? How many records, how many files, how many columns?
Sent from my iPhone
> On Feb 25, 2016, at 7:27 PM, "Edmon Begoli" <eb...@gmail.com> wrote:
>
> Hello fellow Driilers,
>
> I have been inactive on the development side of the project, as we got busy
> being heavy/power users of the Drill in the last few months.
>
> I just want to share some great experiences with the latest versions of
> Drill.
>
> Just tonight, as we were scrambling to meet the deadline, we were able to
> query two years of flat psv files of claims/billing and clinical data in
> Drill in less than 60 seconds.
>
> No ETL, no warehousing - just plain SQL against tons of files. Run SQL, get
> results.
>
> Amazing!
>
> We have also done some much more important things too, and we had a paper
> accepted to Big Data Services about the experiences. The co-author of the
> paper is Drill's own Dr. Ted Dunning :-)
> I will share it once it is published.
>
> Anyway, cheers to all, and hope to re-join the dev activities soon.
>
> Best,
> Edmon
Re: The praises for Drill
Posted by Parth Chandra <pa...@apache.org>.
Welcome back Edmon, and thanks for the praise :). Hope to see you on the
next hangout.
On Thu, Feb 25, 2016 at 7:27 PM, Edmon Begoli <eb...@gmail.com> wrote:
> Hello fellow Driilers,
>
> I have been inactive on the development side of the project, as we got busy
> being heavy/power users of the Drill in the last few months.
>
> I just want to share some great experiences with the latest versions of
> Drill.
>
> Just tonight, as we were scrambling to meet the deadline, we were able to
> query two years of flat psv files of claims/billing and clinical data in
> Drill in less than 60 seconds.
>
> No ETL, no warehousing - just plain SQL against tons of files. Run SQL, get
> results.
>
> Amazing!
>
> We have also done some much more important things too, and we had a paper
> accepted to Big Data Services about the experiences. The co-author of the
> paper is Drill's own Dr. Ted Dunning :-)
> I will share it once it is published.
>
> Anyway, cheers to all, and hope to re-join the dev activities soon.
>
> Best,
> Edmon
>
Re: The praises for Drill
Posted by cc...@maprtech.com.
So good to hear Drill is useful in real life.
Chun
> On Feb 25, 2016, at 7:27 PM, Edmon Begoli <eb...@gmail.com> wrote:
>
> Hello fellow Driilers,
>
> I have been inactive on the development side of the project, as we got busy
> being heavy/power users of the Drill in the last few months.
>
> I just want to share some great experiences with the latest versions of
> Drill.
>
> Just tonight, as we were scrambling to meet the deadline, we were able to
> query two years of flat psv files of claims/billing and clinical data in
> Drill in less than 60 seconds.
>
> No ETL, no warehousing - just plain SQL against tons of files. Run SQL, get
> results.
>
> Amazing!
>
> We have also done some much more important things too, and we had a paper
> accepted to Big Data Services about the experiences. The co-author of the
> paper is Drill's own Dr. Ted Dunning :-)
> I will share it once it is published.
>
> Anyway, cheers to all, and hope to re-join the dev activities soon.
>
> Best,
> Edmon
Re: The praises for Drill
Posted by "Antonio Romero (carnorom)" <ca...@cisco.com>.
Can you tell us what the volume of those files was? How many records, how many files, how many columns?
Sent from my iPhone
> On Feb 25, 2016, at 7:27 PM, "Edmon Begoli" <eb...@gmail.com> wrote:
>
> Hello fellow Driilers,
>
> I have been inactive on the development side of the project, as we got busy
> being heavy/power users of the Drill in the last few months.
>
> I just want to share some great experiences with the latest versions of
> Drill.
>
> Just tonight, as we were scrambling to meet the deadline, we were able to
> query two years of flat psv files of claims/billing and clinical data in
> Drill in less than 60 seconds.
>
> No ETL, no warehousing - just plain SQL against tons of files. Run SQL, get
> results.
>
> Amazing!
>
> We have also done some much more important things too, and we had a paper
> accepted to Big Data Services about the experiences. The co-author of the
> paper is Drill's own Dr. Ted Dunning :-)
> I will share it once it is published.
>
> Anyway, cheers to all, and hope to re-join the dev activities soon.
>
> Best,
> Edmon
Re: The praises for Drill
Posted by cc...@maprtech.com.
So good to hear Drill is useful in real life.
Chun
> On Feb 25, 2016, at 7:27 PM, Edmon Begoli <eb...@gmail.com> wrote:
>
> Hello fellow Driilers,
>
> I have been inactive on the development side of the project, as we got busy
> being heavy/power users of the Drill in the last few months.
>
> I just want to share some great experiences with the latest versions of
> Drill.
>
> Just tonight, as we were scrambling to meet the deadline, we were able to
> query two years of flat psv files of claims/billing and clinical data in
> Drill in less than 60 seconds.
>
> No ETL, no warehousing - just plain SQL against tons of files. Run SQL, get
> results.
>
> Amazing!
>
> We have also done some much more important things too, and we had a paper
> accepted to Big Data Services about the experiences. The co-author of the
> paper is Drill's own Dr. Ted Dunning :-)
> I will share it once it is published.
>
> Anyway, cheers to all, and hope to re-join the dev activities soon.
>
> Best,
> Edmon