You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by 王亮 <wa...@gmail.com> on 2018/10/25 08:43:11 UTC
Is there any instructions for new developers for drill
I want to write some plugins for drill.
but the documentation in drill site is mainly for users, but not for
developers.
For example, I want to import drill into Eclipse or Idea, but there seems
no related information in Google.
I only find some tips in https://github.com/paul-rogers/drill/wiki
Is there any more documents?
Re: Is there any instructions for new developers for drill
Posted by Paul Rogers <pa...@yahoo.com.INVALID>.
Thanks! Glad you found the book useful.
- Paul
On Friday, December 7, 2018, 8:00:29 PM PST, 王亮 <wa...@gmail.com> wrote:
Thanks, I have one "Learning Apache Drill:Query and Analyze Distributed
Data Sources with SQL" , wonderful book: )
Re: Is there any instructions for new developers for drill
Posted by 王亮 <wa...@gmail.com>.
Thanks, I have one "Learning Apache Drill:Query and Analyze Distributed
Data Sources with SQL" , wonderful book: )
Paul Rogers <pa...@yahoo.com.invalid> 于2018年10月26日周五 上午1:03写道：
> Hi Wangliang,
>
> I'll also offer a quick pitch for our upcoming O'Reilly book Learning
> Apache Drill. We have chapters about setting up your dev environment,
> writing a UDF and writing a format plugin. Available from Safari as an
> early release; to be published later this year.
>
> The material on my wiki is are my working notes created when researching
> the book material, so that is also a handy resource.
>
> Also, if you look though the history of this list, you'll see occasional
> discussions about this topic.
>
> Thanks,
> - Paul
>
>
>
> On Thursday, October 25, 2018, 3:02:55 AM PDT, Vitalii Diravka <
> vitalii@apache.org> wrote:
>
> Hi Wangliang,
>
> Do you have some issues with importing project?
> Did *mvn clean install* execute successfully for you?
>
> You can start from Drill documentation, it has some general info, which can
> be useful for you [1].
> Is this Format Plugin for File System Storage Plugin [2]? Or it is separate
> Storage Plugin [3] [4]?
>
> The usual way to write the new plugin is to look into some similar existed
> Storage Plugin and
> use the same or write new implementations for some main interfaces, such
> as:
> *StoragePlugin, RecordReader, GroupScan, DrillTable, SchemaFactory*
> and optionally other interfaces from *org/apache/drill/exec/store*
> [5] package
>
> And as you have mentioned Paul's wikis [6] is a good guide to investigate
> Drill sources.
>
> [1]
>
> http://drill.apache.org/docs/apache-drill-contribution-ideas/#support-for-new-file-format-readers/writers
> [2] https://drill.apache.org/docs/file-system-storage-plugin/
> [3] https://drill.apache.org/docs/connect-a-data-source-introduction/
> [4] https://github.com/apache/drill/tree/master/contrib
> [5]
>
> https://github.com/apache/drill/tree/master/exec/java-exec/src/main/java/org/apache/drill/exec/store
> [6] https://github.com/paul-rogers/drill/wiki
>
> Kind regards
> Vitalii
>
>
> On Thu, Oct 25, 2018 at 11:43 AM 王亮 <wa...@gmail.com> wrote:
>
> > I want to write some plugins for drill.
> >
> > but the documentation in drill site is mainly for users, but not for
> > developers.
> > For example, I want to import drill into Eclipse or Idea, but there seems
> > no related information in Google.
> >
> > I only find some tips in https://github.com/paul-rogers/drill/wiki
> > Is there any more documents?
> >
Re: Is there any instructions for new developers for drill
Posted by Paul Rogers <pa...@yahoo.com.INVALID>.
Hi Wangliang,
I'll also offer a quick pitch for our upcoming O'Reilly book Learning Apache Drill. We have chapters about setting up your dev environment, writing a UDF and writing a format plugin. Available from Safari as an early release; to be published later this year.
The material on my wiki is are my working notes created when researching the book material, so that is also a handy resource.
Also, if you look though the history of this list, you'll see occasional discussions about this topic.
Thanks,
- Paul
On Thursday, October 25, 2018, 3:02:55 AM PDT, Vitalii Diravka <vi...@apache.org> wrote:
Hi Wangliang,
Do you have some issues with importing project?
Did *mvn clean install* execute successfully for you?
You can start from Drill documentation, it has some general info, which can
be useful for you [1].
Is this Format Plugin for File System Storage Plugin [2]? Or it is separate
Storage Plugin [3] [4]?
The usual way to write the new plugin is to look into some similar existed
Storage Plugin and
use the same or write new implementations for some main interfaces, such
as:
*StoragePlugin, RecordReader, GroupScan, DrillTable, SchemaFactory*
and optionally other interfaces from *org/apache/drill/exec/store*
[5] package
And as you have mentioned Paul's wikis [6] is a good guide to investigate
Drill sources.
[1]
http://drill.apache.org/docs/apache-drill-contribution-ideas/#support-for-new-file-format-readers/writers
[2] https://drill.apache.org/docs/file-system-storage-plugin/
[3] https://drill.apache.org/docs/connect-a-data-source-introduction/
[4] https://github.com/apache/drill/tree/master/contrib
[5]
https://github.com/apache/drill/tree/master/exec/java-exec/src/main/java/org/apache/drill/exec/store
[6] https://github.com/paul-rogers/drill/wiki
Kind regards
Vitalii
On Thu, Oct 25, 2018 at 11:43 AM 王亮 <wa...@gmail.com> wrote:
> I want to write some plugins for drill.
>
> but the documentation in drill site is mainly for users, but not for
> developers.
> For example, I want to import drill into Eclipse or Idea, but there seems
> no related information in Google.
>
> I only find some tips in https://github.com/paul-rogers/drill/wiki
> Is there any more documents?
>
Re: Is there any instructions for new developers for drill
Posted by Charles Givre <cg...@gmail.com>.
Hi Wangliang,
Allow me to put in a shameless plug for the forthcoming O’Reilly book Learning Drill (https://amzn.to/2EJljUb) which should be available on Safari soon and covers this topic.
—C
> On Oct 25, 2018, at 06:02, Vitalii Diravka <vi...@apache.org> wrote:
>
> Hi Wangliang,
>
> Do you have some issues with importing project?
> Did *mvn clean install* execute successfully for you?
>
> You can start from Drill documentation, it has some general info, which can
> be useful for you [1].
> Is this Format Plugin for File System Storage Plugin [2]? Or it is separate
> Storage Plugin [3] [4]?
>
> The usual way to write the new plugin is to look into some similar existed
> Storage Plugin and
> use the same or write new implementations for some main interfaces, such
> as:
> *StoragePlugin, RecordReader, GroupScan, DrillTable, SchemaFactory*
> and optionally other interfaces from *org/apache/drill/exec/store*
> [5] package
>
> And as you have mentioned Paul's wikis [6] is a good guide to investigate
> Drill sources.
>
> [1]
> http://drill.apache.org/docs/apache-drill-contribution-ideas/#support-for-new-file-format-readers/writers
> [2] https://drill.apache.org/docs/file-system-storage-plugin/
> [3] https://drill.apache.org/docs/connect-a-data-source-introduction/
> [4] https://github.com/apache/drill/tree/master/contrib
> [5]
> https://github.com/apache/drill/tree/master/exec/java-exec/src/main/java/org/apache/drill/exec/store
> [6] https://github.com/paul-rogers/drill/wiki
>
> Kind regards
> Vitalii
>
>
> On Thu, Oct 25, 2018 at 11:43 AM 王亮 <wa...@gmail.com> wrote:
>
>> I want to write some plugins for drill.
>>
>> but the documentation in drill site is mainly for users, but not for
>> developers.
>> For example, I want to import drill into Eclipse or Idea, but there seems
>> no related information in Google.
>>
>> I only find some tips in https://github.com/paul-rogers/drill/wiki
>> Is there any more documents?
>>
Re: Is there any instructions for new developers for drill
Posted by Vitalii Diravka <vi...@apache.org>.
Hi Wangliang,
Do you have some issues with importing project?
Did *mvn clean install* execute successfully for you?
You can start from Drill documentation, it has some general info, which can
be useful for you [1].
Is this Format Plugin for File System Storage Plugin [2]? Or it is separate
Storage Plugin [3] [4]?
The usual way to write the new plugin is to look into some similar existed
Storage Plugin and
use the same or write new implementations for some main interfaces, such
as:
*StoragePlugin, RecordReader, GroupScan, DrillTable, SchemaFactory*
and optionally other interfaces from *org/apache/drill/exec/store*
[5] package
And as you have mentioned Paul's wikis [6] is a good guide to investigate
Drill sources.
[1]
http://drill.apache.org/docs/apache-drill-contribution-ideas/#support-for-new-file-format-readers/writers
[2] https://drill.apache.org/docs/file-system-storage-plugin/
[3] https://drill.apache.org/docs/connect-a-data-source-introduction/
[4] https://github.com/apache/drill/tree/master/contrib
[5]
https://github.com/apache/drill/tree/master/exec/java-exec/src/main/java/org/apache/drill/exec/store
[6] https://github.com/paul-rogers/drill/wiki
Kind regards
Vitalii
On Thu, Oct 25, 2018 at 11:43 AM 王亮 <wa...@gmail.com> wrote:
> I want to write some plugins for drill.
>
> but the documentation in drill site is mainly for users, but not for
> developers.
> For example, I want to import drill into Eclipse or Idea, but there seems
> no related information in Google.
>
> I only find some tips in https://github.com/paul-rogers/drill/wiki
> Is there any more documents?
>