You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by Arina Ielchiieva <ar...@apache.org> on 2018/11/01 13:42:35 UTC

November Apache Drill board report

Hi all,

please take a look at the draft board report for the last quarter and let
me know if you have any comments.

Thanks,
Arina

=====

 ## Description:
 - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
Storage.

## Issues:
 - There are no issues requiring board attention at this time.

## Activity:
 - Since the last board report, Drill has released version 1.14.0,
   including the following enhancements:
- Drill in a Docket container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
 - There were active discussions about schema provision in Drill.
   Based on these discussions two projects are currently evolving:
   Drill metastore and schema provision in the file and in a query.
 - Apache Drill book has been written by two PMC members (Charles and Paul).
 - Drill developer meet up will be held on November 14, 2019.
   The following areas are going to be discussed:
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow

## Health report:
 - The project is healthy. Development activity
   as reflected in the pull requests and JIRAs is good.
 - Activity on the dev and user mailing lists are stable.
 - Three committers and three new PMC member were added in the last period.

## PMC changes:

 - Currently 23 PMC members.
 - New PMC members:
    - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
    - Charles Givre was added to the PMC on Mon Sep 03 2018
    - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018

## Committer base changes:

 - Currently 48 committers.
 - New commmitters:
    - Chunhui Shi was added as a committer on Thu Sep 27 2018
    - Gautam Parai was added as a committer on Mon Oct 22 2018
    - Weijie Tong was added as a committer on Fri Aug 31 2018

## Releases:

 - 1.14.0 was released on Sat Aug 04 2018

## Mailing list activity:

 - dev@drill.apache.org:
    - 427 subscribers (down -6 in the last 3 months):
    - 2827 emails sent to list (2126 in previous quarter)

 - issues@drill.apache.org:
    - 18 subscribers (down -1 in the last 3 months):
    - 3487 emails sent to list (4769 in previous quarter)

 - user@drill.apache.org:
    - 597 subscribers (down -6 in the last 3 months):
    - 332 emails sent to list (346 in previous quarter)


## JIRA activity:

 - 164 JIRA tickets created in the last 3 months
 - 128 JIRA tickets closed/resolved in the last 3 months

Re: November Apache Drill board report

Posted by Arina Ielchiieva <ar...@apache.org>.
Thanks everyone for the feedback. Report has been submitted.

Kind regards,
Arina

On Wed, Nov 7, 2018 at 6:28 PM Arina Yelchiyeva <ar...@gmail.com>
wrote:

> Release notes were generated automatically based on resolved Jiras with
> fix version 1.14.0.
>
> Updated the report.
> I am going to sen it tomorrow if there won't be any other comments.
>
> ----------------------
>
> =====
>
>  ## Description:
>  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> Storage.
>
> ## Issues:
>  - There are no issues requiring board attention at this time.
>
> ## Activity:
>  - Since the last board report, Drill has released version 1.14.0,
>    including the following enhancements:
> - Drill in a Docker container
> - Image metadata format plugin
> - Upgrade to Calcite 1.16.0
> - Kafka plugin push down support
> - Phonetic and String functions
> - Enhanced decimal data support
> - Spill to disk for the Hash Join support
> - CGROUPs resource management support
> - Lateral / Unnest support (disabled by default)
> - Support Transitive Closure during Filter Push Down and Partition Pruning
> - Batch processing improvements to limit the amount of memory for Hash
> Join,
>   Union All, Project, Hash Aggregate and Nested Loop Join.
>  - There were active discussions about schema provision in Drill.
>    Based on these discussions two projects are currently evolving:
>    Drill metastore and schema provision in the file and in a query.
>  - Apache Drill book has been written by two PMC members (Charles and
> Paul).
>  - Drill developer meet up will be held on November 14, 2018.
>
>    The following areas are going to be discussed:
> - Storage plugins
> - Schema discovery & Evolution
> - Metadata Management
> - Resource management
> - Integration with Apache Arrow
>
> ## Health report:
>  - The project is healthy. Development activity
>    as reflected in the pull requests and JIRAs is good.
>  - Activity on the dev and user mailing lists are stable.
>  - Three committers and three new PMC member were added in the last period.
>
> ## PMC changes:
>
>  - Currently 23 PMC members.
>  - New PMC members:
>     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
>     - Charles Givre was added to the PMC on Mon Sep 03 2018
>     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
>
> ## Committer base changes:
>
>  - Currently 48 committers.
>  - New commmitters:
>     - Chunhui Shi was added as a committer on Thu Sep 27 2018
>     - Gautam Parai was added as a committer on Mon Oct 22 2018
>     - Weijie Tong was added as a committer on Fri Aug 31 2018
>
> ## Releases:
>
>  - 1.14.0 was released on Sat Aug 04 2018
>
> ## Mailing list activity:
>
>  - dev@drill.apache.org:
>     - 427 subscribers (down -6 in the last 3 months):
>     - 2827 emails sent to list (2126 in previous quarter)
>
>  - issues@drill.apache.org:
>     - 18 subscribers (down -1 in the last 3 months):
>     - 3487 emails sent to list (4769 in previous quarter)
>
>  - user@drill.apache.org:
>     - 597 subscribers (down -6 in the last 3 months):
>     - 332 emails sent to list (346 in previous quarter)
>
>
> ## JIRA activity:
>
>  - 164 JIRA tickets created in the last 3 months
>  - 128 JIRA tickets closed/resolved in the last 3 months
>
>
>
> On Wed, Nov 7, 2018 at 5:37 PM Padma Penumarthy <
> penumarthy.padma@gmail.com> wrote:
>
>> 1.14 release notes should mention batch sizing also.
>>
>> For the board report, can you please add the following :
>> Batch processing improvements to limit the amount of memory for Hash Join,
>> Union All, Project, Hash Aggregate and Nested Loop Join.
>>
>> Just FYI for everyone. Here is the link to the document which has details
>> about batch sizing work:
>>
>> https://docs.google.com/document/d/1Z-67Y_KNcbA2YYWCHEwf2PUEmXRPWSXsw-CHnXW_98Q/
>>
>> Thanks
>> Padma
>>
>>
>>
>>
>>
>> On Wed, Nov 7, 2018 at 5:56 AM Arina Ielchiieva <ar...@apache.org> wrote:
>>
>> > Hi Padma,
>> >
>> > I can include mention about batch sizing but I am not sure what I should
>> > mention, quick search over release notes shows a couple of changes
>> related
>> > to batch sizing:
>> > https://drill.apache.org/docs/apache-drill-1-14-0-release-notes/
>> > Could you please propose what I should include?
>> >
>> > @PMCs and committers
>> > Only one PMC member has given +1 for the report. Could more folks please
>> > review the report?
>> >
>> > Kind regards,
>> > Arina
>> >
>> > On Fri, Nov 2, 2018 at 8:33 PM Padma Penumarthy <
>> > penumarthy.padma@gmail.com>
>> > wrote:
>> >
>> > > Hi Arina,
>> > >
>> > > Can you add batch sizing (for bunch of operators and parquet reader)
>> > also ?
>> > >
>> > > Thanks
>> > > Padma
>> > >
>> > >
>> > > On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org>
>> > wrote:
>> > >
>> > > > Sure, let's mention.
>> > > > Updated the report.
>> > > >
>> > > > =====
>> > > >
>> > > >  ## Description:
>> > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
>> Cloud
>> > > > Storage.
>> > > >
>> > > > ## Issues:
>> > > >  - There are no issues requiring board attention at this time.
>> > > >
>> > > > ## Activity:
>> > > >  - Since the last board report, Drill has released version 1.14.0,
>> > > >    including the following enhancements:
>> > > > - Drill in a Docker container
>> > > > - Image metadata format plugin
>> > > > - Upgrade to Calcite 1.16.0
>> > > > - Kafka plugin push down support
>> > > > - Phonetic and String functions
>> > > > - Enhanced decimal data support
>> > > > - Spill to disk for the Hash Join support
>> > > > - CGROUPs resource management support
>> > > > - Lateral / Unnest support (disabled by default)
>> > > >  - There were active discussions about schema provision in Drill.
>> > > >    Based on these discussions two projects are currently evolving:
>> > > >    Drill metastore and schema provision in the file and in a query.
>> > > >  - Apache Drill book has been written by two PMC members (Charles
>> and
>> > > > Paul).
>> > > >  - Drill developer meet up will be held on November 14, 2018.
>> > > >
>> > > >    The following areas are going to be discussed:
>> > > > - Storage plugins
>> > > > - Schema discovery & Evolution
>> > > > - Metadata Management
>> > > > - Resource management
>> > > > - Integration with Apache Arrow
>> > > >
>> > > > ## Health report:
>> > > >  - The project is healthy. Development activity
>> > > >    as reflected in the pull requests and JIRAs is good.
>> > > >  - Activity on the dev and user mailing lists are stable.
>> > > >  - Three committers and three new PMC member were added in the last
>> > > period.
>> > > >
>> > > > ## PMC changes:
>> > > >
>> > > >  - Currently 23 PMC members.
>> > > >  - New PMC members:
>> > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
>> > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
>> > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
>> > > >
>> > > > ## Committer base changes:
>> > > >
>> > > >  - Currently 48 committers.
>> > > >  - New commmitters:
>> > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
>> > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
>> > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
>> > > >
>> > > > ## Releases:
>> > > >
>> > > >  - 1.14.0 was released on Sat Aug 04 2018
>> > > >
>> > > > ## Mailing list activity:
>> > > >
>> > > >  - dev@drill.apache.org:
>> > > >     - 427 subscribers (down -6 in the last 3 months):
>> > > >     - 2827 emails sent to list (2126 in previous quarter)
>> > > >
>> > > >  - issues@drill.apache.org:
>> > > >     - 18 subscribers (down -1 in the last 3 months):
>> > > >     - 3487 emails sent to list (4769 in previous quarter)
>> > > >
>> > > >  - user@drill.apache.org:
>> > > >     - 597 subscribers (down -6 in the last 3 months):
>> > > >     - 332 emails sent to list (346 in previous quarter)
>> > > >
>> > > >
>> > > > ## JIRA activity:
>> > > >
>> > > >  - 164 JIRA tickets created in the last 3 months
>> > > >  - 128 JIRA tickets closed/resolved in the last 3 months
>> > > >
>> > > >
>> > > >
>> > > > On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <
>> > shamirwasia@mapr.com>
>> > > > wrote:
>> > > >
>> > > > > Hi Arina,
>> > > > > Lateral/Unnest feature was part of 1.14 though it was disabled by
>> > > > default.
>> > > > > Should we mention it as part of 1.14 enhancements in the report?
>> > > > >
>> > > > > Thanks,
>> > > > > Sorabh
>> > > > >
>> > > > > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
>> > > > > arina.yelchiyeva@gmail.com>
>> > > > > wrote:
>> > > > >
>> > > > > > Thanks, Aman!  Updated the report.
>> > > > > > I went too far with 2019, luckily the meet up will be much
>> earlier
>> > :)
>> > > > > >
>> > > > > > =====
>> > > > > >
>> > > > > >  ## Description:
>> > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
>> > > Cloud
>> > > > > > Storage.
>> > > > > >
>> > > > > > ## Issues:
>> > > > > >  - There are no issues requiring board attention at this time.
>> > > > > >
>> > > > > > ## Activity:
>> > > > > >  - Since the last board report, Drill has released version
>> 1.14.0,
>> > > > > >    including the following enhancements:
>> > > > > > - Drill in a Docker container
>> > > > > > - Image metadata format plugin
>> > > > > > - Upgrade to Calcite 1.16.0
>> > > > > > - Kafka plugin push down support
>> > > > > > - Phonetic and String functions
>> > > > > > - Enhanced decimal data support
>> > > > > > - Spill to disk for the Hash Join support
>> > > > > > - CGROUPs resource management support
>> > > > > >  - There were active discussions about schema provision in
>> Drill.
>> > > > > >    Based on these discussions two projects are currently
>> evolving:
>> > > > > >    Drill metastore and schema provision in the file and in a
>> query.
>> > > > > >  - Apache Drill book has been written by two PMC members
>> (Charles
>> > and
>> > > > > > Paul).
>> > > > > >  - Drill developer meet up will be held on November 14, 2018.
>> > > > > >    The following areas are going to be discussed:
>> > > > > > - Storage plugins
>> > > > > > - Schema discovery & Evolution
>> > > > > > - Metadata Management
>> > > > > > - Resource management
>> > > > > > - Integration with Apache Arrow
>> > > > > >
>> > > > > > ## Health report:
>> > > > > >  - The project is healthy. Development activity
>> > > > > >    as reflected in the pull requests and JIRAs is good.
>> > > > > >  - Activity on the dev and user mailing lists are stable.
>> > > > > >  - Three committers and three new PMC member were added in the
>> last
>> > > > > period.
>> > > > > >
>> > > > > > ## PMC changes:
>> > > > > >
>> > > > > >  - Currently 23 PMC members.
>> > > > > >  - New PMC members:
>> > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
>> > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
>> > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
>> > > > > >
>> > > > > > ## Committer base changes:
>> > > > > >
>> > > > > >  - Currently 48 committers.
>> > > > > >  - New commmitters:
>> > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
>> > > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
>> > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
>> > > > > >
>> > > > > > ## Releases:
>> > > > > >
>> > > > > >  - 1.14.0 was released on Sat Aug 04 2018
>> > > > > >
>> > > > > > ## Mailing list activity:
>> > > > > >
>> > > > > >  - dev@drill.apache.org:
>> > > > > >     - 427 subscribers (down -6 in the last 3 months):
>> > > > > >     - 2827 emails sent to list (2126 in previous quarter)
>> > > > > >
>> > > > > >  - issues@drill.apache.org:
>> > > > > >     - 18 subscribers (down -1 in the last 3 months):
>> > > > > >     - 3487 emails sent to list (4769 in previous quarter)
>> > > > > >
>> > > > > >  - user@drill.apache.org:
>> > > > > >     - 597 subscribers (down -6 in the last 3 months):
>> > > > > >     - 332 emails sent to list (346 in previous quarter)
>> > > > > >
>> > > > > >
>> > > > > > ## JIRA activity:
>> > > > > >
>> > > > > >  - 164 JIRA tickets created in the last 3 months
>> > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
>> > > > > >
>> > > > > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <amansinha@apache.org
>> >
>> > > > wrote:
>> > > > > >
>> > > > > > >    Docket container  ==> 'Docker'
>> > > > > > >    November 14, 2019  ==>  2018  :)   (this is wrong in email
>> > that
>> > > > was
>> > > > > > sent
>> > > > > > > out)
>> > > > > > >
>> > > > > > > Rest LGTM.
>> > > > > > >
>> > > > > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <
>> > arina@apache.org>
>> > > > > > wrote:
>> > > > > > >
>> > > > > > > > Hi all,
>> > > > > > > >
>> > > > > > > > please take a look at the draft board report for the last
>> > quarter
>> > > > and
>> > > > > > let
>> > > > > > > > me know if you have any comments.
>> > > > > > > >
>> > > > > > > > Thanks,
>> > > > > > > > Arina
>> > > > > > > >
>> > > > > > > > =====
>> > > > > > > >
>> > > > > > > >  ## Description:
>> > > > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL
>> > and
>> > > > > Cloud
>> > > > > > > > Storage.
>> > > > > > > >
>> > > > > > > > ## Issues:
>> > > > > > > >  - There are no issues requiring board attention at this
>> time.
>> > > > > > > >
>> > > > > > > > ## Activity:
>> > > > > > > >  - Since the last board report, Drill has released version
>> > > 1.14.0,
>> > > > > > > >    including the following enhancements:
>> > > > > > > > - Drill in a Docket container
>> > > > > > > > - Image metadata format plugin
>> > > > > > > > - Upgrade to Calcite 1.16.0
>> > > > > > > > - Kafka plugin push down support
>> > > > > > > > - Phonetic and String functions
>> > > > > > > > - Enhanced decimal data support
>> > > > > > > > - Spill to disk for the Hash Join support
>> > > > > > > > - CGROUPs resource management support
>> > > > > > > >  - There were active discussions about schema provision in
>> > Drill.
>> > > > > > > >    Based on these discussions two projects are currently
>> > > evolving:
>> > > > > > > >    Drill metastore and schema provision in the file and in a
>> > > query.
>> > > > > > > >  - Apache Drill book has been written by two PMC members
>> > (Charles
>> > > > and
>> > > > > > > > Paul).
>> > > > > > > >  - Drill developer meet up will be held on November 14,
>> 2019.
>> > > > > > > >    The following areas are going to be discussed:
>> > > > > > > > - Storage plugins
>> > > > > > > > - Schema discovery & Evolution
>> > > > > > > > - Metadata Management
>> > > > > > > > - Resource management
>> > > > > > > > - Integration with Apache Arrow
>> > > > > > > >
>> > > > > > > > ## Health report:
>> > > > > > > >  - The project is healthy. Development activity
>> > > > > > > >    as reflected in the pull requests and JIRAs is good.
>> > > > > > > >  - Activity on the dev and user mailing lists are stable.
>> > > > > > > >  - Three committers and three new PMC member were added in
>> the
>> > > last
>> > > > > > > period.
>> > > > > > > >
>> > > > > > > > ## PMC changes:
>> > > > > > > >
>> > > > > > > >  - Currently 23 PMC members.
>> > > > > > > >  - New PMC members:
>> > > > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
>> > > > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
>> > > > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
>> > > > > > > >
>> > > > > > > > ## Committer base changes:
>> > > > > > > >
>> > > > > > > >  - Currently 48 committers.
>> > > > > > > >  - New commmitters:
>> > > > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27
>> 2018
>> > > > > > > >     - Gautam Parai was added as a committer on Mon Oct 22
>> 2018
>> > > > > > > >     - Weijie Tong was added as a committer on Fri Aug 31
>> 2018
>> > > > > > > >
>> > > > > > > > ## Releases:
>> > > > > > > >
>> > > > > > > >  - 1.14.0 was released on Sat Aug 04 2018
>> > > > > > > >
>> > > > > > > > ## Mailing list activity:
>> > > > > > > >
>> > > > > > > >  - dev@drill.apache.org:
>> > > > > > > >     - 427 subscribers (down -6 in the last 3 months):
>> > > > > > > >     - 2827 emails sent to list (2126 in previous quarter)
>> > > > > > > >
>> > > > > > > >  - issues@drill.apache.org:
>> > > > > > > >     - 18 subscribers (down -1 in the last 3 months):
>> > > > > > > >     - 3487 emails sent to list (4769 in previous quarter)
>> > > > > > > >
>> > > > > > > >  - user@drill.apache.org:
>> > > > > > > >     - 597 subscribers (down -6 in the last 3 months):
>> > > > > > > >     - 332 emails sent to list (346 in previous quarter)
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > ## JIRA activity:
>> > > > > > > >
>> > > > > > > >  - 164 JIRA tickets created in the last 3 months
>> > > > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>

Re: November Apache Drill board report

Posted by Arina Ielchiieva <ar...@apache.org>.
Thanks everyone for the feedback. Report has been submitted.

Kind regards,
Arina

On Wed, Nov 7, 2018 at 6:28 PM Arina Yelchiyeva <ar...@gmail.com>
wrote:

> Release notes were generated automatically based on resolved Jiras with
> fix version 1.14.0.
>
> Updated the report.
> I am going to sen it tomorrow if there won't be any other comments.
>
> ----------------------
>
> =====
>
>  ## Description:
>  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> Storage.
>
> ## Issues:
>  - There are no issues requiring board attention at this time.
>
> ## Activity:
>  - Since the last board report, Drill has released version 1.14.0,
>    including the following enhancements:
> - Drill in a Docker container
> - Image metadata format plugin
> - Upgrade to Calcite 1.16.0
> - Kafka plugin push down support
> - Phonetic and String functions
> - Enhanced decimal data support
> - Spill to disk for the Hash Join support
> - CGROUPs resource management support
> - Lateral / Unnest support (disabled by default)
> - Support Transitive Closure during Filter Push Down and Partition Pruning
> - Batch processing improvements to limit the amount of memory for Hash
> Join,
>   Union All, Project, Hash Aggregate and Nested Loop Join.
>  - There were active discussions about schema provision in Drill.
>    Based on these discussions two projects are currently evolving:
>    Drill metastore and schema provision in the file and in a query.
>  - Apache Drill book has been written by two PMC members (Charles and
> Paul).
>  - Drill developer meet up will be held on November 14, 2018.
>
>    The following areas are going to be discussed:
> - Storage plugins
> - Schema discovery & Evolution
> - Metadata Management
> - Resource management
> - Integration with Apache Arrow
>
> ## Health report:
>  - The project is healthy. Development activity
>    as reflected in the pull requests and JIRAs is good.
>  - Activity on the dev and user mailing lists are stable.
>  - Three committers and three new PMC member were added in the last period.
>
> ## PMC changes:
>
>  - Currently 23 PMC members.
>  - New PMC members:
>     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
>     - Charles Givre was added to the PMC on Mon Sep 03 2018
>     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
>
> ## Committer base changes:
>
>  - Currently 48 committers.
>  - New commmitters:
>     - Chunhui Shi was added as a committer on Thu Sep 27 2018
>     - Gautam Parai was added as a committer on Mon Oct 22 2018
>     - Weijie Tong was added as a committer on Fri Aug 31 2018
>
> ## Releases:
>
>  - 1.14.0 was released on Sat Aug 04 2018
>
> ## Mailing list activity:
>
>  - dev@drill.apache.org:
>     - 427 subscribers (down -6 in the last 3 months):
>     - 2827 emails sent to list (2126 in previous quarter)
>
>  - issues@drill.apache.org:
>     - 18 subscribers (down -1 in the last 3 months):
>     - 3487 emails sent to list (4769 in previous quarter)
>
>  - user@drill.apache.org:
>     - 597 subscribers (down -6 in the last 3 months):
>     - 332 emails sent to list (346 in previous quarter)
>
>
> ## JIRA activity:
>
>  - 164 JIRA tickets created in the last 3 months
>  - 128 JIRA tickets closed/resolved in the last 3 months
>
>
>
> On Wed, Nov 7, 2018 at 5:37 PM Padma Penumarthy <
> penumarthy.padma@gmail.com> wrote:
>
>> 1.14 release notes should mention batch sizing also.
>>
>> For the board report, can you please add the following :
>> Batch processing improvements to limit the amount of memory for Hash Join,
>> Union All, Project, Hash Aggregate and Nested Loop Join.
>>
>> Just FYI for everyone. Here is the link to the document which has details
>> about batch sizing work:
>>
>> https://docs.google.com/document/d/1Z-67Y_KNcbA2YYWCHEwf2PUEmXRPWSXsw-CHnXW_98Q/
>>
>> Thanks
>> Padma
>>
>>
>>
>>
>>
>> On Wed, Nov 7, 2018 at 5:56 AM Arina Ielchiieva <ar...@apache.org> wrote:
>>
>> > Hi Padma,
>> >
>> > I can include mention about batch sizing but I am not sure what I should
>> > mention, quick search over release notes shows a couple of changes
>> related
>> > to batch sizing:
>> > https://drill.apache.org/docs/apache-drill-1-14-0-release-notes/
>> > Could you please propose what I should include?
>> >
>> > @PMCs and committers
>> > Only one PMC member has given +1 for the report. Could more folks please
>> > review the report?
>> >
>> > Kind regards,
>> > Arina
>> >
>> > On Fri, Nov 2, 2018 at 8:33 PM Padma Penumarthy <
>> > penumarthy.padma@gmail.com>
>> > wrote:
>> >
>> > > Hi Arina,
>> > >
>> > > Can you add batch sizing (for bunch of operators and parquet reader)
>> > also ?
>> > >
>> > > Thanks
>> > > Padma
>> > >
>> > >
>> > > On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org>
>> > wrote:
>> > >
>> > > > Sure, let's mention.
>> > > > Updated the report.
>> > > >
>> > > > =====
>> > > >
>> > > >  ## Description:
>> > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
>> Cloud
>> > > > Storage.
>> > > >
>> > > > ## Issues:
>> > > >  - There are no issues requiring board attention at this time.
>> > > >
>> > > > ## Activity:
>> > > >  - Since the last board report, Drill has released version 1.14.0,
>> > > >    including the following enhancements:
>> > > > - Drill in a Docker container
>> > > > - Image metadata format plugin
>> > > > - Upgrade to Calcite 1.16.0
>> > > > - Kafka plugin push down support
>> > > > - Phonetic and String functions
>> > > > - Enhanced decimal data support
>> > > > - Spill to disk for the Hash Join support
>> > > > - CGROUPs resource management support
>> > > > - Lateral / Unnest support (disabled by default)
>> > > >  - There were active discussions about schema provision in Drill.
>> > > >    Based on these discussions two projects are currently evolving:
>> > > >    Drill metastore and schema provision in the file and in a query.
>> > > >  - Apache Drill book has been written by two PMC members (Charles
>> and
>> > > > Paul).
>> > > >  - Drill developer meet up will be held on November 14, 2018.
>> > > >
>> > > >    The following areas are going to be discussed:
>> > > > - Storage plugins
>> > > > - Schema discovery & Evolution
>> > > > - Metadata Management
>> > > > - Resource management
>> > > > - Integration with Apache Arrow
>> > > >
>> > > > ## Health report:
>> > > >  - The project is healthy. Development activity
>> > > >    as reflected in the pull requests and JIRAs is good.
>> > > >  - Activity on the dev and user mailing lists are stable.
>> > > >  - Three committers and three new PMC member were added in the last
>> > > period.
>> > > >
>> > > > ## PMC changes:
>> > > >
>> > > >  - Currently 23 PMC members.
>> > > >  - New PMC members:
>> > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
>> > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
>> > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
>> > > >
>> > > > ## Committer base changes:
>> > > >
>> > > >  - Currently 48 committers.
>> > > >  - New commmitters:
>> > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
>> > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
>> > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
>> > > >
>> > > > ## Releases:
>> > > >
>> > > >  - 1.14.0 was released on Sat Aug 04 2018
>> > > >
>> > > > ## Mailing list activity:
>> > > >
>> > > >  - dev@drill.apache.org:
>> > > >     - 427 subscribers (down -6 in the last 3 months):
>> > > >     - 2827 emails sent to list (2126 in previous quarter)
>> > > >
>> > > >  - issues@drill.apache.org:
>> > > >     - 18 subscribers (down -1 in the last 3 months):
>> > > >     - 3487 emails sent to list (4769 in previous quarter)
>> > > >
>> > > >  - user@drill.apache.org:
>> > > >     - 597 subscribers (down -6 in the last 3 months):
>> > > >     - 332 emails sent to list (346 in previous quarter)
>> > > >
>> > > >
>> > > > ## JIRA activity:
>> > > >
>> > > >  - 164 JIRA tickets created in the last 3 months
>> > > >  - 128 JIRA tickets closed/resolved in the last 3 months
>> > > >
>> > > >
>> > > >
>> > > > On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <
>> > shamirwasia@mapr.com>
>> > > > wrote:
>> > > >
>> > > > > Hi Arina,
>> > > > > Lateral/Unnest feature was part of 1.14 though it was disabled by
>> > > > default.
>> > > > > Should we mention it as part of 1.14 enhancements in the report?
>> > > > >
>> > > > > Thanks,
>> > > > > Sorabh
>> > > > >
>> > > > > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
>> > > > > arina.yelchiyeva@gmail.com>
>> > > > > wrote:
>> > > > >
>> > > > > > Thanks, Aman!  Updated the report.
>> > > > > > I went too far with 2019, luckily the meet up will be much
>> earlier
>> > :)
>> > > > > >
>> > > > > > =====
>> > > > > >
>> > > > > >  ## Description:
>> > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
>> > > Cloud
>> > > > > > Storage.
>> > > > > >
>> > > > > > ## Issues:
>> > > > > >  - There are no issues requiring board attention at this time.
>> > > > > >
>> > > > > > ## Activity:
>> > > > > >  - Since the last board report, Drill has released version
>> 1.14.0,
>> > > > > >    including the following enhancements:
>> > > > > > - Drill in a Docker container
>> > > > > > - Image metadata format plugin
>> > > > > > - Upgrade to Calcite 1.16.0
>> > > > > > - Kafka plugin push down support
>> > > > > > - Phonetic and String functions
>> > > > > > - Enhanced decimal data support
>> > > > > > - Spill to disk for the Hash Join support
>> > > > > > - CGROUPs resource management support
>> > > > > >  - There were active discussions about schema provision in
>> Drill.
>> > > > > >    Based on these discussions two projects are currently
>> evolving:
>> > > > > >    Drill metastore and schema provision in the file and in a
>> query.
>> > > > > >  - Apache Drill book has been written by two PMC members
>> (Charles
>> > and
>> > > > > > Paul).
>> > > > > >  - Drill developer meet up will be held on November 14, 2018.
>> > > > > >    The following areas are going to be discussed:
>> > > > > > - Storage plugins
>> > > > > > - Schema discovery & Evolution
>> > > > > > - Metadata Management
>> > > > > > - Resource management
>> > > > > > - Integration with Apache Arrow
>> > > > > >
>> > > > > > ## Health report:
>> > > > > >  - The project is healthy. Development activity
>> > > > > >    as reflected in the pull requests and JIRAs is good.
>> > > > > >  - Activity on the dev and user mailing lists are stable.
>> > > > > >  - Three committers and three new PMC member were added in the
>> last
>> > > > > period.
>> > > > > >
>> > > > > > ## PMC changes:
>> > > > > >
>> > > > > >  - Currently 23 PMC members.
>> > > > > >  - New PMC members:
>> > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
>> > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
>> > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
>> > > > > >
>> > > > > > ## Committer base changes:
>> > > > > >
>> > > > > >  - Currently 48 committers.
>> > > > > >  - New commmitters:
>> > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
>> > > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
>> > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
>> > > > > >
>> > > > > > ## Releases:
>> > > > > >
>> > > > > >  - 1.14.0 was released on Sat Aug 04 2018
>> > > > > >
>> > > > > > ## Mailing list activity:
>> > > > > >
>> > > > > >  - dev@drill.apache.org:
>> > > > > >     - 427 subscribers (down -6 in the last 3 months):
>> > > > > >     - 2827 emails sent to list (2126 in previous quarter)
>> > > > > >
>> > > > > >  - issues@drill.apache.org:
>> > > > > >     - 18 subscribers (down -1 in the last 3 months):
>> > > > > >     - 3487 emails sent to list (4769 in previous quarter)
>> > > > > >
>> > > > > >  - user@drill.apache.org:
>> > > > > >     - 597 subscribers (down -6 in the last 3 months):
>> > > > > >     - 332 emails sent to list (346 in previous quarter)
>> > > > > >
>> > > > > >
>> > > > > > ## JIRA activity:
>> > > > > >
>> > > > > >  - 164 JIRA tickets created in the last 3 months
>> > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
>> > > > > >
>> > > > > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <amansinha@apache.org
>> >
>> > > > wrote:
>> > > > > >
>> > > > > > >    Docket container  ==> 'Docker'
>> > > > > > >    November 14, 2019  ==>  2018  :)   (this is wrong in email
>> > that
>> > > > was
>> > > > > > sent
>> > > > > > > out)
>> > > > > > >
>> > > > > > > Rest LGTM.
>> > > > > > >
>> > > > > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <
>> > arina@apache.org>
>> > > > > > wrote:
>> > > > > > >
>> > > > > > > > Hi all,
>> > > > > > > >
>> > > > > > > > please take a look at the draft board report for the last
>> > quarter
>> > > > and
>> > > > > > let
>> > > > > > > > me know if you have any comments.
>> > > > > > > >
>> > > > > > > > Thanks,
>> > > > > > > > Arina
>> > > > > > > >
>> > > > > > > > =====
>> > > > > > > >
>> > > > > > > >  ## Description:
>> > > > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL
>> > and
>> > > > > Cloud
>> > > > > > > > Storage.
>> > > > > > > >
>> > > > > > > > ## Issues:
>> > > > > > > >  - There are no issues requiring board attention at this
>> time.
>> > > > > > > >
>> > > > > > > > ## Activity:
>> > > > > > > >  - Since the last board report, Drill has released version
>> > > 1.14.0,
>> > > > > > > >    including the following enhancements:
>> > > > > > > > - Drill in a Docket container
>> > > > > > > > - Image metadata format plugin
>> > > > > > > > - Upgrade to Calcite 1.16.0
>> > > > > > > > - Kafka plugin push down support
>> > > > > > > > - Phonetic and String functions
>> > > > > > > > - Enhanced decimal data support
>> > > > > > > > - Spill to disk for the Hash Join support
>> > > > > > > > - CGROUPs resource management support
>> > > > > > > >  - There were active discussions about schema provision in
>> > Drill.
>> > > > > > > >    Based on these discussions two projects are currently
>> > > evolving:
>> > > > > > > >    Drill metastore and schema provision in the file and in a
>> > > query.
>> > > > > > > >  - Apache Drill book has been written by two PMC members
>> > (Charles
>> > > > and
>> > > > > > > > Paul).
>> > > > > > > >  - Drill developer meet up will be held on November 14,
>> 2019.
>> > > > > > > >    The following areas are going to be discussed:
>> > > > > > > > - Storage plugins
>> > > > > > > > - Schema discovery & Evolution
>> > > > > > > > - Metadata Management
>> > > > > > > > - Resource management
>> > > > > > > > - Integration with Apache Arrow
>> > > > > > > >
>> > > > > > > > ## Health report:
>> > > > > > > >  - The project is healthy. Development activity
>> > > > > > > >    as reflected in the pull requests and JIRAs is good.
>> > > > > > > >  - Activity on the dev and user mailing lists are stable.
>> > > > > > > >  - Three committers and three new PMC member were added in
>> the
>> > > last
>> > > > > > > period.
>> > > > > > > >
>> > > > > > > > ## PMC changes:
>> > > > > > > >
>> > > > > > > >  - Currently 23 PMC members.
>> > > > > > > >  - New PMC members:
>> > > > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
>> > > > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
>> > > > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
>> > > > > > > >
>> > > > > > > > ## Committer base changes:
>> > > > > > > >
>> > > > > > > >  - Currently 48 committers.
>> > > > > > > >  - New commmitters:
>> > > > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27
>> 2018
>> > > > > > > >     - Gautam Parai was added as a committer on Mon Oct 22
>> 2018
>> > > > > > > >     - Weijie Tong was added as a committer on Fri Aug 31
>> 2018
>> > > > > > > >
>> > > > > > > > ## Releases:
>> > > > > > > >
>> > > > > > > >  - 1.14.0 was released on Sat Aug 04 2018
>> > > > > > > >
>> > > > > > > > ## Mailing list activity:
>> > > > > > > >
>> > > > > > > >  - dev@drill.apache.org:
>> > > > > > > >     - 427 subscribers (down -6 in the last 3 months):
>> > > > > > > >     - 2827 emails sent to list (2126 in previous quarter)
>> > > > > > > >
>> > > > > > > >  - issues@drill.apache.org:
>> > > > > > > >     - 18 subscribers (down -1 in the last 3 months):
>> > > > > > > >     - 3487 emails sent to list (4769 in previous quarter)
>> > > > > > > >
>> > > > > > > >  - user@drill.apache.org:
>> > > > > > > >     - 597 subscribers (down -6 in the last 3 months):
>> > > > > > > >     - 332 emails sent to list (346 in previous quarter)
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > ## JIRA activity:
>> > > > > > > >
>> > > > > > > >  - 164 JIRA tickets created in the last 3 months
>> > > > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>

Re: November Apache Drill board report

Posted by Arina Yelchiyeva <ar...@gmail.com>.
Release notes were generated automatically based on resolved Jiras with fix
version 1.14.0.

Updated the report.
I am going to sen it tomorrow if there won't be any other comments.

----------------------

=====

 ## Description:
 - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
Storage.

## Issues:
 - There are no issues requiring board attention at this time.

## Activity:
 - Since the last board report, Drill has released version 1.14.0,
   including the following enhancements:
- Drill in a Docker container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
- Lateral / Unnest support (disabled by default)
- Support Transitive Closure during Filter Push Down and Partition Pruning
- Batch processing improvements to limit the amount of memory for Hash
Join,
  Union All, Project, Hash Aggregate and Nested Loop Join.
 - There were active discussions about schema provision in Drill.
   Based on these discussions two projects are currently evolving:
   Drill metastore and schema provision in the file and in a query.
 - Apache Drill book has been written by two PMC members (Charles and Paul).
 - Drill developer meet up will be held on November 14, 2018.

   The following areas are going to be discussed:
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow

## Health report:
 - The project is healthy. Development activity
   as reflected in the pull requests and JIRAs is good.
 - Activity on the dev and user mailing lists are stable.
 - Three committers and three new PMC member were added in the last period.

## PMC changes:

 - Currently 23 PMC members.
 - New PMC members:
    - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
    - Charles Givre was added to the PMC on Mon Sep 03 2018
    - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018

## Committer base changes:

 - Currently 48 committers.
 - New commmitters:
    - Chunhui Shi was added as a committer on Thu Sep 27 2018
    - Gautam Parai was added as a committer on Mon Oct 22 2018
    - Weijie Tong was added as a committer on Fri Aug 31 2018

## Releases:

 - 1.14.0 was released on Sat Aug 04 2018

## Mailing list activity:

 - dev@drill.apache.org:
    - 427 subscribers (down -6 in the last 3 months):
    - 2827 emails sent to list (2126 in previous quarter)

 - issues@drill.apache.org:
    - 18 subscribers (down -1 in the last 3 months):
    - 3487 emails sent to list (4769 in previous quarter)

 - user@drill.apache.org:
    - 597 subscribers (down -6 in the last 3 months):
    - 332 emails sent to list (346 in previous quarter)


## JIRA activity:

 - 164 JIRA tickets created in the last 3 months
 - 128 JIRA tickets closed/resolved in the last 3 months



On Wed, Nov 7, 2018 at 5:37 PM Padma Penumarthy <pe...@gmail.com>
wrote:

> 1.14 release notes should mention batch sizing also.
>
> For the board report, can you please add the following :
> Batch processing improvements to limit the amount of memory for Hash Join,
> Union All, Project, Hash Aggregate and Nested Loop Join.
>
> Just FYI for everyone. Here is the link to the document which has details
> about batch sizing work:
>
> https://docs.google.com/document/d/1Z-67Y_KNcbA2YYWCHEwf2PUEmXRPWSXsw-CHnXW_98Q/
>
> Thanks
> Padma
>
>
>
>
>
> On Wed, Nov 7, 2018 at 5:56 AM Arina Ielchiieva <ar...@apache.org> wrote:
>
> > Hi Padma,
> >
> > I can include mention about batch sizing but I am not sure what I should
> > mention, quick search over release notes shows a couple of changes
> related
> > to batch sizing:
> > https://drill.apache.org/docs/apache-drill-1-14-0-release-notes/
> > Could you please propose what I should include?
> >
> > @PMCs and committers
> > Only one PMC member has given +1 for the report. Could more folks please
> > review the report?
> >
> > Kind regards,
> > Arina
> >
> > On Fri, Nov 2, 2018 at 8:33 PM Padma Penumarthy <
> > penumarthy.padma@gmail.com>
> > wrote:
> >
> > > Hi Arina,
> > >
> > > Can you add batch sizing (for bunch of operators and parquet reader)
> > also ?
> > >
> > > Thanks
> > > Padma
> > >
> > >
> > > On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org>
> > wrote:
> > >
> > > > Sure, let's mention.
> > > > Updated the report.
> > > >
> > > > =====
> > > >
> > > >  ## Description:
> > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> Cloud
> > > > Storage.
> > > >
> > > > ## Issues:
> > > >  - There are no issues requiring board attention at this time.
> > > >
> > > > ## Activity:
> > > >  - Since the last board report, Drill has released version 1.14.0,
> > > >    including the following enhancements:
> > > > - Drill in a Docker container
> > > > - Image metadata format plugin
> > > > - Upgrade to Calcite 1.16.0
> > > > - Kafka plugin push down support
> > > > - Phonetic and String functions
> > > > - Enhanced decimal data support
> > > > - Spill to disk for the Hash Join support
> > > > - CGROUPs resource management support
> > > > - Lateral / Unnest support (disabled by default)
> > > >  - There were active discussions about schema provision in Drill.
> > > >    Based on these discussions two projects are currently evolving:
> > > >    Drill metastore and schema provision in the file and in a query.
> > > >  - Apache Drill book has been written by two PMC members (Charles and
> > > > Paul).
> > > >  - Drill developer meet up will be held on November 14, 2018.
> > > >
> > > >    The following areas are going to be discussed:
> > > > - Storage plugins
> > > > - Schema discovery & Evolution
> > > > - Metadata Management
> > > > - Resource management
> > > > - Integration with Apache Arrow
> > > >
> > > > ## Health report:
> > > >  - The project is healthy. Development activity
> > > >    as reflected in the pull requests and JIRAs is good.
> > > >  - Activity on the dev and user mailing lists are stable.
> > > >  - Three committers and three new PMC member were added in the last
> > > period.
> > > >
> > > > ## PMC changes:
> > > >
> > > >  - Currently 23 PMC members.
> > > >  - New PMC members:
> > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > >
> > > > ## Committer base changes:
> > > >
> > > >  - Currently 48 committers.
> > > >  - New commmitters:
> > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > >
> > > > ## Releases:
> > > >
> > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > >
> > > > ## Mailing list activity:
> > > >
> > > >  - dev@drill.apache.org:
> > > >     - 427 subscribers (down -6 in the last 3 months):
> > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > >
> > > >  - issues@drill.apache.org:
> > > >     - 18 subscribers (down -1 in the last 3 months):
> > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > >
> > > >  - user@drill.apache.org:
> > > >     - 597 subscribers (down -6 in the last 3 months):
> > > >     - 332 emails sent to list (346 in previous quarter)
> > > >
> > > >
> > > > ## JIRA activity:
> > > >
> > > >  - 164 JIRA tickets created in the last 3 months
> > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > >
> > > >
> > > >
> > > > On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <
> > shamirwasia@mapr.com>
> > > > wrote:
> > > >
> > > > > Hi Arina,
> > > > > Lateral/Unnest feature was part of 1.14 though it was disabled by
> > > > default.
> > > > > Should we mention it as part of 1.14 enhancements in the report?
> > > > >
> > > > > Thanks,
> > > > > Sorabh
> > > > >
> > > > > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
> > > > > arina.yelchiyeva@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Thanks, Aman!  Updated the report.
> > > > > > I went too far with 2019, luckily the meet up will be much
> earlier
> > :)
> > > > > >
> > > > > > =====
> > > > > >
> > > > > >  ## Description:
> > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> > > Cloud
> > > > > > Storage.
> > > > > >
> > > > > > ## Issues:
> > > > > >  - There are no issues requiring board attention at this time.
> > > > > >
> > > > > > ## Activity:
> > > > > >  - Since the last board report, Drill has released version
> 1.14.0,
> > > > > >    including the following enhancements:
> > > > > > - Drill in a Docker container
> > > > > > - Image metadata format plugin
> > > > > > - Upgrade to Calcite 1.16.0
> > > > > > - Kafka plugin push down support
> > > > > > - Phonetic and String functions
> > > > > > - Enhanced decimal data support
> > > > > > - Spill to disk for the Hash Join support
> > > > > > - CGROUPs resource management support
> > > > > >  - There were active discussions about schema provision in Drill.
> > > > > >    Based on these discussions two projects are currently
> evolving:
> > > > > >    Drill metastore and schema provision in the file and in a
> query.
> > > > > >  - Apache Drill book has been written by two PMC members (Charles
> > and
> > > > > > Paul).
> > > > > >  - Drill developer meet up will be held on November 14, 2018.
> > > > > >    The following areas are going to be discussed:
> > > > > > - Storage plugins
> > > > > > - Schema discovery & Evolution
> > > > > > - Metadata Management
> > > > > > - Resource management
> > > > > > - Integration with Apache Arrow
> > > > > >
> > > > > > ## Health report:
> > > > > >  - The project is healthy. Development activity
> > > > > >    as reflected in the pull requests and JIRAs is good.
> > > > > >  - Activity on the dev and user mailing lists are stable.
> > > > > >  - Three committers and three new PMC member were added in the
> last
> > > > > period.
> > > > > >
> > > > > > ## PMC changes:
> > > > > >
> > > > > >  - Currently 23 PMC members.
> > > > > >  - New PMC members:
> > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > >
> > > > > > ## Committer base changes:
> > > > > >
> > > > > >  - Currently 48 committers.
> > > > > >  - New commmitters:
> > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > >
> > > > > > ## Releases:
> > > > > >
> > > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > > >
> > > > > > ## Mailing list activity:
> > > > > >
> > > > > >  - dev@drill.apache.org:
> > > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > > >
> > > > > >  - issues@drill.apache.org:
> > > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > > >
> > > > > >  - user@drill.apache.org:
> > > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > > >
> > > > > >
> > > > > > ## JIRA activity:
> > > > > >
> > > > > >  - 164 JIRA tickets created in the last 3 months
> > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > >
> > > > > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org>
> > > > wrote:
> > > > > >
> > > > > > >    Docket container  ==> 'Docker'
> > > > > > >    November 14, 2019  ==>  2018  :)   (this is wrong in email
> > that
> > > > was
> > > > > > sent
> > > > > > > out)
> > > > > > >
> > > > > > > Rest LGTM.
> > > > > > >
> > > > > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <
> > arina@apache.org>
> > > > > > wrote:
> > > > > > >
> > > > > > > > Hi all,
> > > > > > > >
> > > > > > > > please take a look at the draft board report for the last
> > quarter
> > > > and
> > > > > > let
> > > > > > > > me know if you have any comments.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Arina
> > > > > > > >
> > > > > > > > =====
> > > > > > > >
> > > > > > > >  ## Description:
> > > > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL
> > and
> > > > > Cloud
> > > > > > > > Storage.
> > > > > > > >
> > > > > > > > ## Issues:
> > > > > > > >  - There are no issues requiring board attention at this
> time.
> > > > > > > >
> > > > > > > > ## Activity:
> > > > > > > >  - Since the last board report, Drill has released version
> > > 1.14.0,
> > > > > > > >    including the following enhancements:
> > > > > > > > - Drill in a Docket container
> > > > > > > > - Image metadata format plugin
> > > > > > > > - Upgrade to Calcite 1.16.0
> > > > > > > > - Kafka plugin push down support
> > > > > > > > - Phonetic and String functions
> > > > > > > > - Enhanced decimal data support
> > > > > > > > - Spill to disk for the Hash Join support
> > > > > > > > - CGROUPs resource management support
> > > > > > > >  - There were active discussions about schema provision in
> > Drill.
> > > > > > > >    Based on these discussions two projects are currently
> > > evolving:
> > > > > > > >    Drill metastore and schema provision in the file and in a
> > > query.
> > > > > > > >  - Apache Drill book has been written by two PMC members
> > (Charles
> > > > and
> > > > > > > > Paul).
> > > > > > > >  - Drill developer meet up will be held on November 14, 2019.
> > > > > > > >    The following areas are going to be discussed:
> > > > > > > > - Storage plugins
> > > > > > > > - Schema discovery & Evolution
> > > > > > > > - Metadata Management
> > > > > > > > - Resource management
> > > > > > > > - Integration with Apache Arrow
> > > > > > > >
> > > > > > > > ## Health report:
> > > > > > > >  - The project is healthy. Development activity
> > > > > > > >    as reflected in the pull requests and JIRAs is good.
> > > > > > > >  - Activity on the dev and user mailing lists are stable.
> > > > > > > >  - Three committers and three new PMC member were added in
> the
> > > last
> > > > > > > period.
> > > > > > > >
> > > > > > > > ## PMC changes:
> > > > > > > >
> > > > > > > >  - Currently 23 PMC members.
> > > > > > > >  - New PMC members:
> > > > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > > > >
> > > > > > > > ## Committer base changes:
> > > > > > > >
> > > > > > > >  - Currently 48 committers.
> > > > > > > >  - New commmitters:
> > > > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > > > >     - Gautam Parai was added as a committer on Mon Oct 22
> 2018
> > > > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > > > >
> > > > > > > > ## Releases:
> > > > > > > >
> > > > > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > > > > >
> > > > > > > > ## Mailing list activity:
> > > > > > > >
> > > > > > > >  - dev@drill.apache.org:
> > > > > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > > > > >
> > > > > > > >  - issues@drill.apache.org:
> > > > > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > > > > >
> > > > > > > >  - user@drill.apache.org:
> > > > > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > > > > >
> > > > > > > >
> > > > > > > > ## JIRA activity:
> > > > > > > >
> > > > > > > >  - 164 JIRA tickets created in the last 3 months
> > > > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: November Apache Drill board report

Posted by Arina Yelchiyeva <ar...@gmail.com>.
Release notes were generated automatically based on resolved Jiras with fix
version 1.14.0.

Updated the report.
I am going to sen it tomorrow if there won't be any other comments.

----------------------

=====

 ## Description:
 - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
Storage.

## Issues:
 - There are no issues requiring board attention at this time.

## Activity:
 - Since the last board report, Drill has released version 1.14.0,
   including the following enhancements:
- Drill in a Docker container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
- Lateral / Unnest support (disabled by default)
- Support Transitive Closure during Filter Push Down and Partition Pruning
- Batch processing improvements to limit the amount of memory for Hash
Join,
  Union All, Project, Hash Aggregate and Nested Loop Join.
 - There were active discussions about schema provision in Drill.
   Based on these discussions two projects are currently evolving:
   Drill metastore and schema provision in the file and in a query.
 - Apache Drill book has been written by two PMC members (Charles and Paul).
 - Drill developer meet up will be held on November 14, 2018.

   The following areas are going to be discussed:
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow

## Health report:
 - The project is healthy. Development activity
   as reflected in the pull requests and JIRAs is good.
 - Activity on the dev and user mailing lists are stable.
 - Three committers and three new PMC member were added in the last period.

## PMC changes:

 - Currently 23 PMC members.
 - New PMC members:
    - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
    - Charles Givre was added to the PMC on Mon Sep 03 2018
    - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018

## Committer base changes:

 - Currently 48 committers.
 - New commmitters:
    - Chunhui Shi was added as a committer on Thu Sep 27 2018
    - Gautam Parai was added as a committer on Mon Oct 22 2018
    - Weijie Tong was added as a committer on Fri Aug 31 2018

## Releases:

 - 1.14.0 was released on Sat Aug 04 2018

## Mailing list activity:

 - dev@drill.apache.org:
    - 427 subscribers (down -6 in the last 3 months):
    - 2827 emails sent to list (2126 in previous quarter)

 - issues@drill.apache.org:
    - 18 subscribers (down -1 in the last 3 months):
    - 3487 emails sent to list (4769 in previous quarter)

 - user@drill.apache.org:
    - 597 subscribers (down -6 in the last 3 months):
    - 332 emails sent to list (346 in previous quarter)


## JIRA activity:

 - 164 JIRA tickets created in the last 3 months
 - 128 JIRA tickets closed/resolved in the last 3 months



On Wed, Nov 7, 2018 at 5:37 PM Padma Penumarthy <pe...@gmail.com>
wrote:

> 1.14 release notes should mention batch sizing also.
>
> For the board report, can you please add the following :
> Batch processing improvements to limit the amount of memory for Hash Join,
> Union All, Project, Hash Aggregate and Nested Loop Join.
>
> Just FYI for everyone. Here is the link to the document which has details
> about batch sizing work:
>
> https://docs.google.com/document/d/1Z-67Y_KNcbA2YYWCHEwf2PUEmXRPWSXsw-CHnXW_98Q/
>
> Thanks
> Padma
>
>
>
>
>
> On Wed, Nov 7, 2018 at 5:56 AM Arina Ielchiieva <ar...@apache.org> wrote:
>
> > Hi Padma,
> >
> > I can include mention about batch sizing but I am not sure what I should
> > mention, quick search over release notes shows a couple of changes
> related
> > to batch sizing:
> > https://drill.apache.org/docs/apache-drill-1-14-0-release-notes/
> > Could you please propose what I should include?
> >
> > @PMCs and committers
> > Only one PMC member has given +1 for the report. Could more folks please
> > review the report?
> >
> > Kind regards,
> > Arina
> >
> > On Fri, Nov 2, 2018 at 8:33 PM Padma Penumarthy <
> > penumarthy.padma@gmail.com>
> > wrote:
> >
> > > Hi Arina,
> > >
> > > Can you add batch sizing (for bunch of operators and parquet reader)
> > also ?
> > >
> > > Thanks
> > > Padma
> > >
> > >
> > > On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org>
> > wrote:
> > >
> > > > Sure, let's mention.
> > > > Updated the report.
> > > >
> > > > =====
> > > >
> > > >  ## Description:
> > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> Cloud
> > > > Storage.
> > > >
> > > > ## Issues:
> > > >  - There are no issues requiring board attention at this time.
> > > >
> > > > ## Activity:
> > > >  - Since the last board report, Drill has released version 1.14.0,
> > > >    including the following enhancements:
> > > > - Drill in a Docker container
> > > > - Image metadata format plugin
> > > > - Upgrade to Calcite 1.16.0
> > > > - Kafka plugin push down support
> > > > - Phonetic and String functions
> > > > - Enhanced decimal data support
> > > > - Spill to disk for the Hash Join support
> > > > - CGROUPs resource management support
> > > > - Lateral / Unnest support (disabled by default)
> > > >  - There were active discussions about schema provision in Drill.
> > > >    Based on these discussions two projects are currently evolving:
> > > >    Drill metastore and schema provision in the file and in a query.
> > > >  - Apache Drill book has been written by two PMC members (Charles and
> > > > Paul).
> > > >  - Drill developer meet up will be held on November 14, 2018.
> > > >
> > > >    The following areas are going to be discussed:
> > > > - Storage plugins
> > > > - Schema discovery & Evolution
> > > > - Metadata Management
> > > > - Resource management
> > > > - Integration with Apache Arrow
> > > >
> > > > ## Health report:
> > > >  - The project is healthy. Development activity
> > > >    as reflected in the pull requests and JIRAs is good.
> > > >  - Activity on the dev and user mailing lists are stable.
> > > >  - Three committers and three new PMC member were added in the last
> > > period.
> > > >
> > > > ## PMC changes:
> > > >
> > > >  - Currently 23 PMC members.
> > > >  - New PMC members:
> > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > >
> > > > ## Committer base changes:
> > > >
> > > >  - Currently 48 committers.
> > > >  - New commmitters:
> > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > >
> > > > ## Releases:
> > > >
> > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > >
> > > > ## Mailing list activity:
> > > >
> > > >  - dev@drill.apache.org:
> > > >     - 427 subscribers (down -6 in the last 3 months):
> > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > >
> > > >  - issues@drill.apache.org:
> > > >     - 18 subscribers (down -1 in the last 3 months):
> > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > >
> > > >  - user@drill.apache.org:
> > > >     - 597 subscribers (down -6 in the last 3 months):
> > > >     - 332 emails sent to list (346 in previous quarter)
> > > >
> > > >
> > > > ## JIRA activity:
> > > >
> > > >  - 164 JIRA tickets created in the last 3 months
> > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > >
> > > >
> > > >
> > > > On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <
> > shamirwasia@mapr.com>
> > > > wrote:
> > > >
> > > > > Hi Arina,
> > > > > Lateral/Unnest feature was part of 1.14 though it was disabled by
> > > > default.
> > > > > Should we mention it as part of 1.14 enhancements in the report?
> > > > >
> > > > > Thanks,
> > > > > Sorabh
> > > > >
> > > > > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
> > > > > arina.yelchiyeva@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Thanks, Aman!  Updated the report.
> > > > > > I went too far with 2019, luckily the meet up will be much
> earlier
> > :)
> > > > > >
> > > > > > =====
> > > > > >
> > > > > >  ## Description:
> > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> > > Cloud
> > > > > > Storage.
> > > > > >
> > > > > > ## Issues:
> > > > > >  - There are no issues requiring board attention at this time.
> > > > > >
> > > > > > ## Activity:
> > > > > >  - Since the last board report, Drill has released version
> 1.14.0,
> > > > > >    including the following enhancements:
> > > > > > - Drill in a Docker container
> > > > > > - Image metadata format plugin
> > > > > > - Upgrade to Calcite 1.16.0
> > > > > > - Kafka plugin push down support
> > > > > > - Phonetic and String functions
> > > > > > - Enhanced decimal data support
> > > > > > - Spill to disk for the Hash Join support
> > > > > > - CGROUPs resource management support
> > > > > >  - There were active discussions about schema provision in Drill.
> > > > > >    Based on these discussions two projects are currently
> evolving:
> > > > > >    Drill metastore and schema provision in the file and in a
> query.
> > > > > >  - Apache Drill book has been written by two PMC members (Charles
> > and
> > > > > > Paul).
> > > > > >  - Drill developer meet up will be held on November 14, 2018.
> > > > > >    The following areas are going to be discussed:
> > > > > > - Storage plugins
> > > > > > - Schema discovery & Evolution
> > > > > > - Metadata Management
> > > > > > - Resource management
> > > > > > - Integration with Apache Arrow
> > > > > >
> > > > > > ## Health report:
> > > > > >  - The project is healthy. Development activity
> > > > > >    as reflected in the pull requests and JIRAs is good.
> > > > > >  - Activity on the dev and user mailing lists are stable.
> > > > > >  - Three committers and three new PMC member were added in the
> last
> > > > > period.
> > > > > >
> > > > > > ## PMC changes:
> > > > > >
> > > > > >  - Currently 23 PMC members.
> > > > > >  - New PMC members:
> > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > >
> > > > > > ## Committer base changes:
> > > > > >
> > > > > >  - Currently 48 committers.
> > > > > >  - New commmitters:
> > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > >
> > > > > > ## Releases:
> > > > > >
> > > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > > >
> > > > > > ## Mailing list activity:
> > > > > >
> > > > > >  - dev@drill.apache.org:
> > > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > > >
> > > > > >  - issues@drill.apache.org:
> > > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > > >
> > > > > >  - user@drill.apache.org:
> > > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > > >
> > > > > >
> > > > > > ## JIRA activity:
> > > > > >
> > > > > >  - 164 JIRA tickets created in the last 3 months
> > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > >
> > > > > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org>
> > > > wrote:
> > > > > >
> > > > > > >    Docket container  ==> 'Docker'
> > > > > > >    November 14, 2019  ==>  2018  :)   (this is wrong in email
> > that
> > > > was
> > > > > > sent
> > > > > > > out)
> > > > > > >
> > > > > > > Rest LGTM.
> > > > > > >
> > > > > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <
> > arina@apache.org>
> > > > > > wrote:
> > > > > > >
> > > > > > > > Hi all,
> > > > > > > >
> > > > > > > > please take a look at the draft board report for the last
> > quarter
> > > > and
> > > > > > let
> > > > > > > > me know if you have any comments.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Arina
> > > > > > > >
> > > > > > > > =====
> > > > > > > >
> > > > > > > >  ## Description:
> > > > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL
> > and
> > > > > Cloud
> > > > > > > > Storage.
> > > > > > > >
> > > > > > > > ## Issues:
> > > > > > > >  - There are no issues requiring board attention at this
> time.
> > > > > > > >
> > > > > > > > ## Activity:
> > > > > > > >  - Since the last board report, Drill has released version
> > > 1.14.0,
> > > > > > > >    including the following enhancements:
> > > > > > > > - Drill in a Docket container
> > > > > > > > - Image metadata format plugin
> > > > > > > > - Upgrade to Calcite 1.16.0
> > > > > > > > - Kafka plugin push down support
> > > > > > > > - Phonetic and String functions
> > > > > > > > - Enhanced decimal data support
> > > > > > > > - Spill to disk for the Hash Join support
> > > > > > > > - CGROUPs resource management support
> > > > > > > >  - There were active discussions about schema provision in
> > Drill.
> > > > > > > >    Based on these discussions two projects are currently
> > > evolving:
> > > > > > > >    Drill metastore and schema provision in the file and in a
> > > query.
> > > > > > > >  - Apache Drill book has been written by two PMC members
> > (Charles
> > > > and
> > > > > > > > Paul).
> > > > > > > >  - Drill developer meet up will be held on November 14, 2019.
> > > > > > > >    The following areas are going to be discussed:
> > > > > > > > - Storage plugins
> > > > > > > > - Schema discovery & Evolution
> > > > > > > > - Metadata Management
> > > > > > > > - Resource management
> > > > > > > > - Integration with Apache Arrow
> > > > > > > >
> > > > > > > > ## Health report:
> > > > > > > >  - The project is healthy. Development activity
> > > > > > > >    as reflected in the pull requests and JIRAs is good.
> > > > > > > >  - Activity on the dev and user mailing lists are stable.
> > > > > > > >  - Three committers and three new PMC member were added in
> the
> > > last
> > > > > > > period.
> > > > > > > >
> > > > > > > > ## PMC changes:
> > > > > > > >
> > > > > > > >  - Currently 23 PMC members.
> > > > > > > >  - New PMC members:
> > > > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > > > >
> > > > > > > > ## Committer base changes:
> > > > > > > >
> > > > > > > >  - Currently 48 committers.
> > > > > > > >  - New commmitters:
> > > > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > > > >     - Gautam Parai was added as a committer on Mon Oct 22
> 2018
> > > > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > > > >
> > > > > > > > ## Releases:
> > > > > > > >
> > > > > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > > > > >
> > > > > > > > ## Mailing list activity:
> > > > > > > >
> > > > > > > >  - dev@drill.apache.org:
> > > > > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > > > > >
> > > > > > > >  - issues@drill.apache.org:
> > > > > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > > > > >
> > > > > > > >  - user@drill.apache.org:
> > > > > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > > > > >
> > > > > > > >
> > > > > > > > ## JIRA activity:
> > > > > > > >
> > > > > > > >  - 164 JIRA tickets created in the last 3 months
> > > > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: November Apache Drill board report

Posted by Padma Penumarthy <pe...@gmail.com>.
1.14 release notes should mention batch sizing also.

For the board report, can you please add the following :
Batch processing improvements to limit the amount of memory for Hash Join,
Union All, Project, Hash Aggregate and Nested Loop Join.

Just FYI for everyone. Here is the link to the document which has details
about batch sizing work:
https://docs.google.com/document/d/1Z-67Y_KNcbA2YYWCHEwf2PUEmXRPWSXsw-CHnXW_98Q/

Thanks
Padma





On Wed, Nov 7, 2018 at 5:56 AM Arina Ielchiieva <ar...@apache.org> wrote:

> Hi Padma,
>
> I can include mention about batch sizing but I am not sure what I should
> mention, quick search over release notes shows a couple of changes related
> to batch sizing:
> https://drill.apache.org/docs/apache-drill-1-14-0-release-notes/
> Could you please propose what I should include?
>
> @PMCs and committers
> Only one PMC member has given +1 for the report. Could more folks please
> review the report?
>
> Kind regards,
> Arina
>
> On Fri, Nov 2, 2018 at 8:33 PM Padma Penumarthy <
> penumarthy.padma@gmail.com>
> wrote:
>
> > Hi Arina,
> >
> > Can you add batch sizing (for bunch of operators and parquet reader)
> also ?
> >
> > Thanks
> > Padma
> >
> >
> > On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org>
> wrote:
> >
> > > Sure, let's mention.
> > > Updated the report.
> > >
> > > =====
> > >
> > >  ## Description:
> > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> > > Storage.
> > >
> > > ## Issues:
> > >  - There are no issues requiring board attention at this time.
> > >
> > > ## Activity:
> > >  - Since the last board report, Drill has released version 1.14.0,
> > >    including the following enhancements:
> > > - Drill in a Docker container
> > > - Image metadata format plugin
> > > - Upgrade to Calcite 1.16.0
> > > - Kafka plugin push down support
> > > - Phonetic and String functions
> > > - Enhanced decimal data support
> > > - Spill to disk for the Hash Join support
> > > - CGROUPs resource management support
> > > - Lateral / Unnest support (disabled by default)
> > >  - There were active discussions about schema provision in Drill.
> > >    Based on these discussions two projects are currently evolving:
> > >    Drill metastore and schema provision in the file and in a query.
> > >  - Apache Drill book has been written by two PMC members (Charles and
> > > Paul).
> > >  - Drill developer meet up will be held on November 14, 2018.
> > >
> > >    The following areas are going to be discussed:
> > > - Storage plugins
> > > - Schema discovery & Evolution
> > > - Metadata Management
> > > - Resource management
> > > - Integration with Apache Arrow
> > >
> > > ## Health report:
> > >  - The project is healthy. Development activity
> > >    as reflected in the pull requests and JIRAs is good.
> > >  - Activity on the dev and user mailing lists are stable.
> > >  - Three committers and three new PMC member were added in the last
> > period.
> > >
> > > ## PMC changes:
> > >
> > >  - Currently 23 PMC members.
> > >  - New PMC members:
> > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > >
> > > ## Committer base changes:
> > >
> > >  - Currently 48 committers.
> > >  - New commmitters:
> > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > >
> > > ## Releases:
> > >
> > >  - 1.14.0 was released on Sat Aug 04 2018
> > >
> > > ## Mailing list activity:
> > >
> > >  - dev@drill.apache.org:
> > >     - 427 subscribers (down -6 in the last 3 months):
> > >     - 2827 emails sent to list (2126 in previous quarter)
> > >
> > >  - issues@drill.apache.org:
> > >     - 18 subscribers (down -1 in the last 3 months):
> > >     - 3487 emails sent to list (4769 in previous quarter)
> > >
> > >  - user@drill.apache.org:
> > >     - 597 subscribers (down -6 in the last 3 months):
> > >     - 332 emails sent to list (346 in previous quarter)
> > >
> > >
> > > ## JIRA activity:
> > >
> > >  - 164 JIRA tickets created in the last 3 months
> > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > >
> > >
> > >
> > > On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <
> shamirwasia@mapr.com>
> > > wrote:
> > >
> > > > Hi Arina,
> > > > Lateral/Unnest feature was part of 1.14 though it was disabled by
> > > default.
> > > > Should we mention it as part of 1.14 enhancements in the report?
> > > >
> > > > Thanks,
> > > > Sorabh
> > > >
> > > > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
> > > > arina.yelchiyeva@gmail.com>
> > > > wrote:
> > > >
> > > > > Thanks, Aman!  Updated the report.
> > > > > I went too far with 2019, luckily the meet up will be much earlier
> :)
> > > > >
> > > > > =====
> > > > >
> > > > >  ## Description:
> > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> > Cloud
> > > > > Storage.
> > > > >
> > > > > ## Issues:
> > > > >  - There are no issues requiring board attention at this time.
> > > > >
> > > > > ## Activity:
> > > > >  - Since the last board report, Drill has released version 1.14.0,
> > > > >    including the following enhancements:
> > > > > - Drill in a Docker container
> > > > > - Image metadata format plugin
> > > > > - Upgrade to Calcite 1.16.0
> > > > > - Kafka plugin push down support
> > > > > - Phonetic and String functions
> > > > > - Enhanced decimal data support
> > > > > - Spill to disk for the Hash Join support
> > > > > - CGROUPs resource management support
> > > > >  - There were active discussions about schema provision in Drill.
> > > > >    Based on these discussions two projects are currently evolving:
> > > > >    Drill metastore and schema provision in the file and in a query.
> > > > >  - Apache Drill book has been written by two PMC members (Charles
> and
> > > > > Paul).
> > > > >  - Drill developer meet up will be held on November 14, 2018.
> > > > >    The following areas are going to be discussed:
> > > > > - Storage plugins
> > > > > - Schema discovery & Evolution
> > > > > - Metadata Management
> > > > > - Resource management
> > > > > - Integration with Apache Arrow
> > > > >
> > > > > ## Health report:
> > > > >  - The project is healthy. Development activity
> > > > >    as reflected in the pull requests and JIRAs is good.
> > > > >  - Activity on the dev and user mailing lists are stable.
> > > > >  - Three committers and three new PMC member were added in the last
> > > > period.
> > > > >
> > > > > ## PMC changes:
> > > > >
> > > > >  - Currently 23 PMC members.
> > > > >  - New PMC members:
> > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > >
> > > > > ## Committer base changes:
> > > > >
> > > > >  - Currently 48 committers.
> > > > >  - New commmitters:
> > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > >
> > > > > ## Releases:
> > > > >
> > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > >
> > > > > ## Mailing list activity:
> > > > >
> > > > >  - dev@drill.apache.org:
> > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > >
> > > > >  - issues@drill.apache.org:
> > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > >
> > > > >  - user@drill.apache.org:
> > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > >
> > > > >
> > > > > ## JIRA activity:
> > > > >
> > > > >  - 164 JIRA tickets created in the last 3 months
> > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > >
> > > > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org>
> > > wrote:
> > > > >
> > > > > >    Docket container  ==> 'Docker'
> > > > > >    November 14, 2019  ==>  2018  :)   (this is wrong in email
> that
> > > was
> > > > > sent
> > > > > > out)
> > > > > >
> > > > > > Rest LGTM.
> > > > > >
> > > > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <
> arina@apache.org>
> > > > > wrote:
> > > > > >
> > > > > > > Hi all,
> > > > > > >
> > > > > > > please take a look at the draft board report for the last
> quarter
> > > and
> > > > > let
> > > > > > > me know if you have any comments.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Arina
> > > > > > >
> > > > > > > =====
> > > > > > >
> > > > > > >  ## Description:
> > > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL
> and
> > > > Cloud
> > > > > > > Storage.
> > > > > > >
> > > > > > > ## Issues:
> > > > > > >  - There are no issues requiring board attention at this time.
> > > > > > >
> > > > > > > ## Activity:
> > > > > > >  - Since the last board report, Drill has released version
> > 1.14.0,
> > > > > > >    including the following enhancements:
> > > > > > > - Drill in a Docket container
> > > > > > > - Image metadata format plugin
> > > > > > > - Upgrade to Calcite 1.16.0
> > > > > > > - Kafka plugin push down support
> > > > > > > - Phonetic and String functions
> > > > > > > - Enhanced decimal data support
> > > > > > > - Spill to disk for the Hash Join support
> > > > > > > - CGROUPs resource management support
> > > > > > >  - There were active discussions about schema provision in
> Drill.
> > > > > > >    Based on these discussions two projects are currently
> > evolving:
> > > > > > >    Drill metastore and schema provision in the file and in a
> > query.
> > > > > > >  - Apache Drill book has been written by two PMC members
> (Charles
> > > and
> > > > > > > Paul).
> > > > > > >  - Drill developer meet up will be held on November 14, 2019.
> > > > > > >    The following areas are going to be discussed:
> > > > > > > - Storage plugins
> > > > > > > - Schema discovery & Evolution
> > > > > > > - Metadata Management
> > > > > > > - Resource management
> > > > > > > - Integration with Apache Arrow
> > > > > > >
> > > > > > > ## Health report:
> > > > > > >  - The project is healthy. Development activity
> > > > > > >    as reflected in the pull requests and JIRAs is good.
> > > > > > >  - Activity on the dev and user mailing lists are stable.
> > > > > > >  - Three committers and three new PMC member were added in the
> > last
> > > > > > period.
> > > > > > >
> > > > > > > ## PMC changes:
> > > > > > >
> > > > > > >  - Currently 23 PMC members.
> > > > > > >  - New PMC members:
> > > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > > >
> > > > > > > ## Committer base changes:
> > > > > > >
> > > > > > >  - Currently 48 committers.
> > > > > > >  - New commmitters:
> > > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > > >
> > > > > > > ## Releases:
> > > > > > >
> > > > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > > > >
> > > > > > > ## Mailing list activity:
> > > > > > >
> > > > > > >  - dev@drill.apache.org:
> > > > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > > > >
> > > > > > >  - issues@drill.apache.org:
> > > > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > > > >
> > > > > > >  - user@drill.apache.org:
> > > > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > > > >
> > > > > > >
> > > > > > > ## JIRA activity:
> > > > > > >
> > > > > > >  - 164 JIRA tickets created in the last 3 months
> > > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: November Apache Drill board report

Posted by Vitalii Diravka <vi...@apache.org>.
+1
Does it make sense to add "Support Transitive Closure during Filter Push
Down and Partition Pruning" feature DRILL-6173 [1]?
This is one of the places where we are farther than Spark, for example [2],
[3].

[1] https://issues.apache.org/jira/browse/DRILL-6173
[2] https://issues.apache.org/jira/browse/SPARK-13940
[3] https://issues.apache.org/jira/browse/SPARK-13209

Kind regards
Vitalii


On Wed, Nov 7, 2018 at 4:01 PM Volodymyr Vysotskyi <vo...@apache.org>
wrote:

> +1, sorry for the delay.
>
> Kind regards,
> Volodymyr Vysotskyi
>
>
> On Wed, Nov 7, 2018 at 3:56 PM Arina Ielchiieva <ar...@apache.org> wrote:
>
> > Hi Padma,
> >
> > I can include mention about batch sizing but I am not sure what I should
> > mention, quick search over release notes shows a couple of changes
> related
> > to batch sizing:
> > https://drill.apache.org/docs/apache-drill-1-14-0-release-notes/
> > Could you please propose what I should include?
> >
> > @PMCs and committers
> > Only one PMC member has given +1 for the report. Could more folks please
> > review the report?
> >
> > Kind regards,
> > Arina
> >
> > On Fri, Nov 2, 2018 at 8:33 PM Padma Penumarthy <
> > penumarthy.padma@gmail.com>
> > wrote:
> >
> > > Hi Arina,
> > >
> > > Can you add batch sizing (for bunch of operators and parquet reader)
> > also ?
> > >
> > > Thanks
> > > Padma
> > >
> > >
> > > On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org>
> > wrote:
> > >
> > > > Sure, let's mention.
> > > > Updated the report.
> > > >
> > > > =====
> > > >
> > > >  ## Description:
> > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> Cloud
> > > > Storage.
> > > >
> > > > ## Issues:
> > > >  - There are no issues requiring board attention at this time.
> > > >
> > > > ## Activity:
> > > >  - Since the last board report, Drill has released version 1.14.0,
> > > >    including the following enhancements:
> > > > - Drill in a Docker container
> > > > - Image metadata format plugin
> > > > - Upgrade to Calcite 1.16.0
> > > > - Kafka plugin push down support
> > > > - Phonetic and String functions
> > > > - Enhanced decimal data support
> > > > - Spill to disk for the Hash Join support
> > > > - CGROUPs resource management support
> > > > - Lateral / Unnest support (disabled by default)
> > > >  - There were active discussions about schema provision in Drill.
> > > >    Based on these discussions two projects are currently evolving:
> > > >    Drill metastore and schema provision in the file and in a query.
> > > >  - Apache Drill book has been written by two PMC members (Charles and
> > > > Paul).
> > > >  - Drill developer meet up will be held on November 14, 2018.
> > > >
> > > >    The following areas are going to be discussed:
> > > > - Storage plugins
> > > > - Schema discovery & Evolution
> > > > - Metadata Management
> > > > - Resource management
> > > > - Integration with Apache Arrow
> > > >
> > > > ## Health report:
> > > >  - The project is healthy. Development activity
> > > >    as reflected in the pull requests and JIRAs is good.
> > > >  - Activity on the dev and user mailing lists are stable.
> > > >  - Three committers and three new PMC member were added in the last
> > > period.
> > > >
> > > > ## PMC changes:
> > > >
> > > >  - Currently 23 PMC members.
> > > >  - New PMC members:
> > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > >
> > > > ## Committer base changes:
> > > >
> > > >  - Currently 48 committers.
> > > >  - New commmitters:
> > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > >
> > > > ## Releases:
> > > >
> > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > >
> > > > ## Mailing list activity:
> > > >
> > > >  - dev@drill.apache.org:
> > > >     - 427 subscribers (down -6 in the last 3 months):
> > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > >
> > > >  - issues@drill.apache.org:
> > > >     - 18 subscribers (down -1 in the last 3 months):
> > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > >
> > > >  - user@drill.apache.org:
> > > >     - 597 subscribers (down -6 in the last 3 months):
> > > >     - 332 emails sent to list (346 in previous quarter)
> > > >
> > > >
> > > > ## JIRA activity:
> > > >
> > > >  - 164 JIRA tickets created in the last 3 months
> > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > >
> > > >
> > > >
> > > > On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <
> > shamirwasia@mapr.com>
> > > > wrote:
> > > >
> > > > > Hi Arina,
> > > > > Lateral/Unnest feature was part of 1.14 though it was disabled by
> > > > default.
> > > > > Should we mention it as part of 1.14 enhancements in the report?
> > > > >
> > > > > Thanks,
> > > > > Sorabh
> > > > >
> > > > > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
> > > > > arina.yelchiyeva@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Thanks, Aman!  Updated the report.
> > > > > > I went too far with 2019, luckily the meet up will be much
> earlier
> > :)
> > > > > >
> > > > > > =====
> > > > > >
> > > > > >  ## Description:
> > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> > > Cloud
> > > > > > Storage.
> > > > > >
> > > > > > ## Issues:
> > > > > >  - There are no issues requiring board attention at this time.
> > > > > >
> > > > > > ## Activity:
> > > > > >  - Since the last board report, Drill has released version
> 1.14.0,
> > > > > >    including the following enhancements:
> > > > > > - Drill in a Docker container
> > > > > > - Image metadata format plugin
> > > > > > - Upgrade to Calcite 1.16.0
> > > > > > - Kafka plugin push down support
> > > > > > - Phonetic and String functions
> > > > > > - Enhanced decimal data support
> > > > > > - Spill to disk for the Hash Join support
> > > > > > - CGROUPs resource management support
> > > > > >  - There were active discussions about schema provision in Drill.
> > > > > >    Based on these discussions two projects are currently
> evolving:
> > > > > >    Drill metastore and schema provision in the file and in a
> query.
> > > > > >  - Apache Drill book has been written by two PMC members (Charles
> > and
> > > > > > Paul).
> > > > > >  - Drill developer meet up will be held on November 14, 2018.
> > > > > >    The following areas are going to be discussed:
> > > > > > - Storage plugins
> > > > > > - Schema discovery & Evolution
> > > > > > - Metadata Management
> > > > > > - Resource management
> > > > > > - Integration with Apache Arrow
> > > > > >
> > > > > > ## Health report:
> > > > > >  - The project is healthy. Development activity
> > > > > >    as reflected in the pull requests and JIRAs is good.
> > > > > >  - Activity on the dev and user mailing lists are stable.
> > > > > >  - Three committers and three new PMC member were added in the
> last
> > > > > period.
> > > > > >
> > > > > > ## PMC changes:
> > > > > >
> > > > > >  - Currently 23 PMC members.
> > > > > >  - New PMC members:
> > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > >
> > > > > > ## Committer base changes:
> > > > > >
> > > > > >  - Currently 48 committers.
> > > > > >  - New commmitters:
> > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > >
> > > > > > ## Releases:
> > > > > >
> > > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > > >
> > > > > > ## Mailing list activity:
> > > > > >
> > > > > >  - dev@drill.apache.org:
> > > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > > >
> > > > > >  - issues@drill.apache.org:
> > > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > > >
> > > > > >  - user@drill.apache.org:
> > > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > > >
> > > > > >
> > > > > > ## JIRA activity:
> > > > > >
> > > > > >  - 164 JIRA tickets created in the last 3 months
> > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > >
> > > > > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org>
> > > > wrote:
> > > > > >
> > > > > > >    Docket container  ==> 'Docker'
> > > > > > >    November 14, 2019  ==>  2018  :)   (this is wrong in email
> > that
> > > > was
> > > > > > sent
> > > > > > > out)
> > > > > > >
> > > > > > > Rest LGTM.
> > > > > > >
> > > > > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <
> > arina@apache.org>
> > > > > > wrote:
> > > > > > >
> > > > > > > > Hi all,
> > > > > > > >
> > > > > > > > please take a look at the draft board report for the last
> > quarter
> > > > and
> > > > > > let
> > > > > > > > me know if you have any comments.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Arina
> > > > > > > >
> > > > > > > > =====
> > > > > > > >
> > > > > > > >  ## Description:
> > > > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL
> > and
> > > > > Cloud
> > > > > > > > Storage.
> > > > > > > >
> > > > > > > > ## Issues:
> > > > > > > >  - There are no issues requiring board attention at this
> time.
> > > > > > > >
> > > > > > > > ## Activity:
> > > > > > > >  - Since the last board report, Drill has released version
> > > 1.14.0,
> > > > > > > >    including the following enhancements:
> > > > > > > > - Drill in a Docket container
> > > > > > > > - Image metadata format plugin
> > > > > > > > - Upgrade to Calcite 1.16.0
> > > > > > > > - Kafka plugin push down support
> > > > > > > > - Phonetic and String functions
> > > > > > > > - Enhanced decimal data support
> > > > > > > > - Spill to disk for the Hash Join support
> > > > > > > > - CGROUPs resource management support
> > > > > > > >  - There were active discussions about schema provision in
> > Drill.
> > > > > > > >    Based on these discussions two projects are currently
> > > evolving:
> > > > > > > >    Drill metastore and schema provision in the file and in a
> > > query.
> > > > > > > >  - Apache Drill book has been written by two PMC members
> > (Charles
> > > > and
> > > > > > > > Paul).
> > > > > > > >  - Drill developer meet up will be held on November 14, 2019.
> > > > > > > >    The following areas are going to be discussed:
> > > > > > > > - Storage plugins
> > > > > > > > - Schema discovery & Evolution
> > > > > > > > - Metadata Management
> > > > > > > > - Resource management
> > > > > > > > - Integration with Apache Arrow
> > > > > > > >
> > > > > > > > ## Health report:
> > > > > > > >  - The project is healthy. Development activity
> > > > > > > >    as reflected in the pull requests and JIRAs is good.
> > > > > > > >  - Activity on the dev and user mailing lists are stable.
> > > > > > > >  - Three committers and three new PMC member were added in
> the
> > > last
> > > > > > > period.
> > > > > > > >
> > > > > > > > ## PMC changes:
> > > > > > > >
> > > > > > > >  - Currently 23 PMC members.
> > > > > > > >  - New PMC members:
> > > > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > > > >
> > > > > > > > ## Committer base changes:
> > > > > > > >
> > > > > > > >  - Currently 48 committers.
> > > > > > > >  - New commmitters:
> > > > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > > > >     - Gautam Parai was added as a committer on Mon Oct 22
> 2018
> > > > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > > > >
> > > > > > > > ## Releases:
> > > > > > > >
> > > > > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > > > > >
> > > > > > > > ## Mailing list activity:
> > > > > > > >
> > > > > > > >  - dev@drill.apache.org:
> > > > > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > > > > >
> > > > > > > >  - issues@drill.apache.org:
> > > > > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > > > > >
> > > > > > > >  - user@drill.apache.org:
> > > > > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > > > > >
> > > > > > > >
> > > > > > > > ## JIRA activity:
> > > > > > > >
> > > > > > > >  - 164 JIRA tickets created in the last 3 months
> > > > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: November Apache Drill board report

Posted by Vitalii Diravka <vi...@apache.org>.
+1
Does it make sense to add "Support Transitive Closure during Filter Push
Down and Partition Pruning" feature DRILL-6173 [1]?
This is one of the places where we are farther than Spark, for example [2],
[3].

[1] https://issues.apache.org/jira/browse/DRILL-6173
[2] https://issues.apache.org/jira/browse/SPARK-13940
[3] https://issues.apache.org/jira/browse/SPARK-13209

Kind regards
Vitalii


On Wed, Nov 7, 2018 at 4:01 PM Volodymyr Vysotskyi <vo...@apache.org>
wrote:

> +1, sorry for the delay.
>
> Kind regards,
> Volodymyr Vysotskyi
>
>
> On Wed, Nov 7, 2018 at 3:56 PM Arina Ielchiieva <ar...@apache.org> wrote:
>
> > Hi Padma,
> >
> > I can include mention about batch sizing but I am not sure what I should
> > mention, quick search over release notes shows a couple of changes
> related
> > to batch sizing:
> > https://drill.apache.org/docs/apache-drill-1-14-0-release-notes/
> > Could you please propose what I should include?
> >
> > @PMCs and committers
> > Only one PMC member has given +1 for the report. Could more folks please
> > review the report?
> >
> > Kind regards,
> > Arina
> >
> > On Fri, Nov 2, 2018 at 8:33 PM Padma Penumarthy <
> > penumarthy.padma@gmail.com>
> > wrote:
> >
> > > Hi Arina,
> > >
> > > Can you add batch sizing (for bunch of operators and parquet reader)
> > also ?
> > >
> > > Thanks
> > > Padma
> > >
> > >
> > > On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org>
> > wrote:
> > >
> > > > Sure, let's mention.
> > > > Updated the report.
> > > >
> > > > =====
> > > >
> > > >  ## Description:
> > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> Cloud
> > > > Storage.
> > > >
> > > > ## Issues:
> > > >  - There are no issues requiring board attention at this time.
> > > >
> > > > ## Activity:
> > > >  - Since the last board report, Drill has released version 1.14.0,
> > > >    including the following enhancements:
> > > > - Drill in a Docker container
> > > > - Image metadata format plugin
> > > > - Upgrade to Calcite 1.16.0
> > > > - Kafka plugin push down support
> > > > - Phonetic and String functions
> > > > - Enhanced decimal data support
> > > > - Spill to disk for the Hash Join support
> > > > - CGROUPs resource management support
> > > > - Lateral / Unnest support (disabled by default)
> > > >  - There were active discussions about schema provision in Drill.
> > > >    Based on these discussions two projects are currently evolving:
> > > >    Drill metastore and schema provision in the file and in a query.
> > > >  - Apache Drill book has been written by two PMC members (Charles and
> > > > Paul).
> > > >  - Drill developer meet up will be held on November 14, 2018.
> > > >
> > > >    The following areas are going to be discussed:
> > > > - Storage plugins
> > > > - Schema discovery & Evolution
> > > > - Metadata Management
> > > > - Resource management
> > > > - Integration with Apache Arrow
> > > >
> > > > ## Health report:
> > > >  - The project is healthy. Development activity
> > > >    as reflected in the pull requests and JIRAs is good.
> > > >  - Activity on the dev and user mailing lists are stable.
> > > >  - Three committers and three new PMC member were added in the last
> > > period.
> > > >
> > > > ## PMC changes:
> > > >
> > > >  - Currently 23 PMC members.
> > > >  - New PMC members:
> > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > >
> > > > ## Committer base changes:
> > > >
> > > >  - Currently 48 committers.
> > > >  - New commmitters:
> > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > >
> > > > ## Releases:
> > > >
> > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > >
> > > > ## Mailing list activity:
> > > >
> > > >  - dev@drill.apache.org:
> > > >     - 427 subscribers (down -6 in the last 3 months):
> > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > >
> > > >  - issues@drill.apache.org:
> > > >     - 18 subscribers (down -1 in the last 3 months):
> > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > >
> > > >  - user@drill.apache.org:
> > > >     - 597 subscribers (down -6 in the last 3 months):
> > > >     - 332 emails sent to list (346 in previous quarter)
> > > >
> > > >
> > > > ## JIRA activity:
> > > >
> > > >  - 164 JIRA tickets created in the last 3 months
> > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > >
> > > >
> > > >
> > > > On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <
> > shamirwasia@mapr.com>
> > > > wrote:
> > > >
> > > > > Hi Arina,
> > > > > Lateral/Unnest feature was part of 1.14 though it was disabled by
> > > > default.
> > > > > Should we mention it as part of 1.14 enhancements in the report?
> > > > >
> > > > > Thanks,
> > > > > Sorabh
> > > > >
> > > > > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
> > > > > arina.yelchiyeva@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Thanks, Aman!  Updated the report.
> > > > > > I went too far with 2019, luckily the meet up will be much
> earlier
> > :)
> > > > > >
> > > > > > =====
> > > > > >
> > > > > >  ## Description:
> > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> > > Cloud
> > > > > > Storage.
> > > > > >
> > > > > > ## Issues:
> > > > > >  - There are no issues requiring board attention at this time.
> > > > > >
> > > > > > ## Activity:
> > > > > >  - Since the last board report, Drill has released version
> 1.14.0,
> > > > > >    including the following enhancements:
> > > > > > - Drill in a Docker container
> > > > > > - Image metadata format plugin
> > > > > > - Upgrade to Calcite 1.16.0
> > > > > > - Kafka plugin push down support
> > > > > > - Phonetic and String functions
> > > > > > - Enhanced decimal data support
> > > > > > - Spill to disk for the Hash Join support
> > > > > > - CGROUPs resource management support
> > > > > >  - There were active discussions about schema provision in Drill.
> > > > > >    Based on these discussions two projects are currently
> evolving:
> > > > > >    Drill metastore and schema provision in the file and in a
> query.
> > > > > >  - Apache Drill book has been written by two PMC members (Charles
> > and
> > > > > > Paul).
> > > > > >  - Drill developer meet up will be held on November 14, 2018.
> > > > > >    The following areas are going to be discussed:
> > > > > > - Storage plugins
> > > > > > - Schema discovery & Evolution
> > > > > > - Metadata Management
> > > > > > - Resource management
> > > > > > - Integration with Apache Arrow
> > > > > >
> > > > > > ## Health report:
> > > > > >  - The project is healthy. Development activity
> > > > > >    as reflected in the pull requests and JIRAs is good.
> > > > > >  - Activity on the dev and user mailing lists are stable.
> > > > > >  - Three committers and three new PMC member were added in the
> last
> > > > > period.
> > > > > >
> > > > > > ## PMC changes:
> > > > > >
> > > > > >  - Currently 23 PMC members.
> > > > > >  - New PMC members:
> > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > >
> > > > > > ## Committer base changes:
> > > > > >
> > > > > >  - Currently 48 committers.
> > > > > >  - New commmitters:
> > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > >
> > > > > > ## Releases:
> > > > > >
> > > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > > >
> > > > > > ## Mailing list activity:
> > > > > >
> > > > > >  - dev@drill.apache.org:
> > > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > > >
> > > > > >  - issues@drill.apache.org:
> > > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > > >
> > > > > >  - user@drill.apache.org:
> > > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > > >
> > > > > >
> > > > > > ## JIRA activity:
> > > > > >
> > > > > >  - 164 JIRA tickets created in the last 3 months
> > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > >
> > > > > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org>
> > > > wrote:
> > > > > >
> > > > > > >    Docket container  ==> 'Docker'
> > > > > > >    November 14, 2019  ==>  2018  :)   (this is wrong in email
> > that
> > > > was
> > > > > > sent
> > > > > > > out)
> > > > > > >
> > > > > > > Rest LGTM.
> > > > > > >
> > > > > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <
> > arina@apache.org>
> > > > > > wrote:
> > > > > > >
> > > > > > > > Hi all,
> > > > > > > >
> > > > > > > > please take a look at the draft board report for the last
> > quarter
> > > > and
> > > > > > let
> > > > > > > > me know if you have any comments.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Arina
> > > > > > > >
> > > > > > > > =====
> > > > > > > >
> > > > > > > >  ## Description:
> > > > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL
> > and
> > > > > Cloud
> > > > > > > > Storage.
> > > > > > > >
> > > > > > > > ## Issues:
> > > > > > > >  - There are no issues requiring board attention at this
> time.
> > > > > > > >
> > > > > > > > ## Activity:
> > > > > > > >  - Since the last board report, Drill has released version
> > > 1.14.0,
> > > > > > > >    including the following enhancements:
> > > > > > > > - Drill in a Docket container
> > > > > > > > - Image metadata format plugin
> > > > > > > > - Upgrade to Calcite 1.16.0
> > > > > > > > - Kafka plugin push down support
> > > > > > > > - Phonetic and String functions
> > > > > > > > - Enhanced decimal data support
> > > > > > > > - Spill to disk for the Hash Join support
> > > > > > > > - CGROUPs resource management support
> > > > > > > >  - There were active discussions about schema provision in
> > Drill.
> > > > > > > >    Based on these discussions two projects are currently
> > > evolving:
> > > > > > > >    Drill metastore and schema provision in the file and in a
> > > query.
> > > > > > > >  - Apache Drill book has been written by two PMC members
> > (Charles
> > > > and
> > > > > > > > Paul).
> > > > > > > >  - Drill developer meet up will be held on November 14, 2019.
> > > > > > > >    The following areas are going to be discussed:
> > > > > > > > - Storage plugins
> > > > > > > > - Schema discovery & Evolution
> > > > > > > > - Metadata Management
> > > > > > > > - Resource management
> > > > > > > > - Integration with Apache Arrow
> > > > > > > >
> > > > > > > > ## Health report:
> > > > > > > >  - The project is healthy. Development activity
> > > > > > > >    as reflected in the pull requests and JIRAs is good.
> > > > > > > >  - Activity on the dev and user mailing lists are stable.
> > > > > > > >  - Three committers and three new PMC member were added in
> the
> > > last
> > > > > > > period.
> > > > > > > >
> > > > > > > > ## PMC changes:
> > > > > > > >
> > > > > > > >  - Currently 23 PMC members.
> > > > > > > >  - New PMC members:
> > > > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > > > >
> > > > > > > > ## Committer base changes:
> > > > > > > >
> > > > > > > >  - Currently 48 committers.
> > > > > > > >  - New commmitters:
> > > > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > > > >     - Gautam Parai was added as a committer on Mon Oct 22
> 2018
> > > > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > > > >
> > > > > > > > ## Releases:
> > > > > > > >
> > > > > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > > > > >
> > > > > > > > ## Mailing list activity:
> > > > > > > >
> > > > > > > >  - dev@drill.apache.org:
> > > > > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > > > > >
> > > > > > > >  - issues@drill.apache.org:
> > > > > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > > > > >
> > > > > > > >  - user@drill.apache.org:
> > > > > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > > > > >
> > > > > > > >
> > > > > > > > ## JIRA activity:
> > > > > > > >
> > > > > > > >  - 164 JIRA tickets created in the last 3 months
> > > > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: November Apache Drill board report

Posted by Volodymyr Vysotskyi <vo...@apache.org>.
+1, sorry for the delay.

Kind regards,
Volodymyr Vysotskyi


On Wed, Nov 7, 2018 at 3:56 PM Arina Ielchiieva <ar...@apache.org> wrote:

> Hi Padma,
>
> I can include mention about batch sizing but I am not sure what I should
> mention, quick search over release notes shows a couple of changes related
> to batch sizing:
> https://drill.apache.org/docs/apache-drill-1-14-0-release-notes/
> Could you please propose what I should include?
>
> @PMCs and committers
> Only one PMC member has given +1 for the report. Could more folks please
> review the report?
>
> Kind regards,
> Arina
>
> On Fri, Nov 2, 2018 at 8:33 PM Padma Penumarthy <
> penumarthy.padma@gmail.com>
> wrote:
>
> > Hi Arina,
> >
> > Can you add batch sizing (for bunch of operators and parquet reader)
> also ?
> >
> > Thanks
> > Padma
> >
> >
> > On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org>
> wrote:
> >
> > > Sure, let's mention.
> > > Updated the report.
> > >
> > > =====
> > >
> > >  ## Description:
> > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> > > Storage.
> > >
> > > ## Issues:
> > >  - There are no issues requiring board attention at this time.
> > >
> > > ## Activity:
> > >  - Since the last board report, Drill has released version 1.14.0,
> > >    including the following enhancements:
> > > - Drill in a Docker container
> > > - Image metadata format plugin
> > > - Upgrade to Calcite 1.16.0
> > > - Kafka plugin push down support
> > > - Phonetic and String functions
> > > - Enhanced decimal data support
> > > - Spill to disk for the Hash Join support
> > > - CGROUPs resource management support
> > > - Lateral / Unnest support (disabled by default)
> > >  - There were active discussions about schema provision in Drill.
> > >    Based on these discussions two projects are currently evolving:
> > >    Drill metastore and schema provision in the file and in a query.
> > >  - Apache Drill book has been written by two PMC members (Charles and
> > > Paul).
> > >  - Drill developer meet up will be held on November 14, 2018.
> > >
> > >    The following areas are going to be discussed:
> > > - Storage plugins
> > > - Schema discovery & Evolution
> > > - Metadata Management
> > > - Resource management
> > > - Integration with Apache Arrow
> > >
> > > ## Health report:
> > >  - The project is healthy. Development activity
> > >    as reflected in the pull requests and JIRAs is good.
> > >  - Activity on the dev and user mailing lists are stable.
> > >  - Three committers and three new PMC member were added in the last
> > period.
> > >
> > > ## PMC changes:
> > >
> > >  - Currently 23 PMC members.
> > >  - New PMC members:
> > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > >
> > > ## Committer base changes:
> > >
> > >  - Currently 48 committers.
> > >  - New commmitters:
> > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > >
> > > ## Releases:
> > >
> > >  - 1.14.0 was released on Sat Aug 04 2018
> > >
> > > ## Mailing list activity:
> > >
> > >  - dev@drill.apache.org:
> > >     - 427 subscribers (down -6 in the last 3 months):
> > >     - 2827 emails sent to list (2126 in previous quarter)
> > >
> > >  - issues@drill.apache.org:
> > >     - 18 subscribers (down -1 in the last 3 months):
> > >     - 3487 emails sent to list (4769 in previous quarter)
> > >
> > >  - user@drill.apache.org:
> > >     - 597 subscribers (down -6 in the last 3 months):
> > >     - 332 emails sent to list (346 in previous quarter)
> > >
> > >
> > > ## JIRA activity:
> > >
> > >  - 164 JIRA tickets created in the last 3 months
> > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > >
> > >
> > >
> > > On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <
> shamirwasia@mapr.com>
> > > wrote:
> > >
> > > > Hi Arina,
> > > > Lateral/Unnest feature was part of 1.14 though it was disabled by
> > > default.
> > > > Should we mention it as part of 1.14 enhancements in the report?
> > > >
> > > > Thanks,
> > > > Sorabh
> > > >
> > > > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
> > > > arina.yelchiyeva@gmail.com>
> > > > wrote:
> > > >
> > > > > Thanks, Aman!  Updated the report.
> > > > > I went too far with 2019, luckily the meet up will be much earlier
> :)
> > > > >
> > > > > =====
> > > > >
> > > > >  ## Description:
> > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> > Cloud
> > > > > Storage.
> > > > >
> > > > > ## Issues:
> > > > >  - There are no issues requiring board attention at this time.
> > > > >
> > > > > ## Activity:
> > > > >  - Since the last board report, Drill has released version 1.14.0,
> > > > >    including the following enhancements:
> > > > > - Drill in a Docker container
> > > > > - Image metadata format plugin
> > > > > - Upgrade to Calcite 1.16.0
> > > > > - Kafka plugin push down support
> > > > > - Phonetic and String functions
> > > > > - Enhanced decimal data support
> > > > > - Spill to disk for the Hash Join support
> > > > > - CGROUPs resource management support
> > > > >  - There were active discussions about schema provision in Drill.
> > > > >    Based on these discussions two projects are currently evolving:
> > > > >    Drill metastore and schema provision in the file and in a query.
> > > > >  - Apache Drill book has been written by two PMC members (Charles
> and
> > > > > Paul).
> > > > >  - Drill developer meet up will be held on November 14, 2018.
> > > > >    The following areas are going to be discussed:
> > > > > - Storage plugins
> > > > > - Schema discovery & Evolution
> > > > > - Metadata Management
> > > > > - Resource management
> > > > > - Integration with Apache Arrow
> > > > >
> > > > > ## Health report:
> > > > >  - The project is healthy. Development activity
> > > > >    as reflected in the pull requests and JIRAs is good.
> > > > >  - Activity on the dev and user mailing lists are stable.
> > > > >  - Three committers and three new PMC member were added in the last
> > > > period.
> > > > >
> > > > > ## PMC changes:
> > > > >
> > > > >  - Currently 23 PMC members.
> > > > >  - New PMC members:
> > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > >
> > > > > ## Committer base changes:
> > > > >
> > > > >  - Currently 48 committers.
> > > > >  - New commmitters:
> > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > >
> > > > > ## Releases:
> > > > >
> > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > >
> > > > > ## Mailing list activity:
> > > > >
> > > > >  - dev@drill.apache.org:
> > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > >
> > > > >  - issues@drill.apache.org:
> > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > >
> > > > >  - user@drill.apache.org:
> > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > >
> > > > >
> > > > > ## JIRA activity:
> > > > >
> > > > >  - 164 JIRA tickets created in the last 3 months
> > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > >
> > > > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org>
> > > wrote:
> > > > >
> > > > > >    Docket container  ==> 'Docker'
> > > > > >    November 14, 2019  ==>  2018  :)   (this is wrong in email
> that
> > > was
> > > > > sent
> > > > > > out)
> > > > > >
> > > > > > Rest LGTM.
> > > > > >
> > > > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <
> arina@apache.org>
> > > > > wrote:
> > > > > >
> > > > > > > Hi all,
> > > > > > >
> > > > > > > please take a look at the draft board report for the last
> quarter
> > > and
> > > > > let
> > > > > > > me know if you have any comments.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Arina
> > > > > > >
> > > > > > > =====
> > > > > > >
> > > > > > >  ## Description:
> > > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL
> and
> > > > Cloud
> > > > > > > Storage.
> > > > > > >
> > > > > > > ## Issues:
> > > > > > >  - There are no issues requiring board attention at this time.
> > > > > > >
> > > > > > > ## Activity:
> > > > > > >  - Since the last board report, Drill has released version
> > 1.14.0,
> > > > > > >    including the following enhancements:
> > > > > > > - Drill in a Docket container
> > > > > > > - Image metadata format plugin
> > > > > > > - Upgrade to Calcite 1.16.0
> > > > > > > - Kafka plugin push down support
> > > > > > > - Phonetic and String functions
> > > > > > > - Enhanced decimal data support
> > > > > > > - Spill to disk for the Hash Join support
> > > > > > > - CGROUPs resource management support
> > > > > > >  - There were active discussions about schema provision in
> Drill.
> > > > > > >    Based on these discussions two projects are currently
> > evolving:
> > > > > > >    Drill metastore and schema provision in the file and in a
> > query.
> > > > > > >  - Apache Drill book has been written by two PMC members
> (Charles
> > > and
> > > > > > > Paul).
> > > > > > >  - Drill developer meet up will be held on November 14, 2019.
> > > > > > >    The following areas are going to be discussed:
> > > > > > > - Storage plugins
> > > > > > > - Schema discovery & Evolution
> > > > > > > - Metadata Management
> > > > > > > - Resource management
> > > > > > > - Integration with Apache Arrow
> > > > > > >
> > > > > > > ## Health report:
> > > > > > >  - The project is healthy. Development activity
> > > > > > >    as reflected in the pull requests and JIRAs is good.
> > > > > > >  - Activity on the dev and user mailing lists are stable.
> > > > > > >  - Three committers and three new PMC member were added in the
> > last
> > > > > > period.
> > > > > > >
> > > > > > > ## PMC changes:
> > > > > > >
> > > > > > >  - Currently 23 PMC members.
> > > > > > >  - New PMC members:
> > > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > > >
> > > > > > > ## Committer base changes:
> > > > > > >
> > > > > > >  - Currently 48 committers.
> > > > > > >  - New commmitters:
> > > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > > >
> > > > > > > ## Releases:
> > > > > > >
> > > > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > > > >
> > > > > > > ## Mailing list activity:
> > > > > > >
> > > > > > >  - dev@drill.apache.org:
> > > > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > > > >
> > > > > > >  - issues@drill.apache.org:
> > > > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > > > >
> > > > > > >  - user@drill.apache.org:
> > > > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > > > >
> > > > > > >
> > > > > > > ## JIRA activity:
> > > > > > >
> > > > > > >  - 164 JIRA tickets created in the last 3 months
> > > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: November Apache Drill board report

Posted by Volodymyr Vysotskyi <vo...@apache.org>.
+1, sorry for the delay.

Kind regards,
Volodymyr Vysotskyi


On Wed, Nov 7, 2018 at 3:56 PM Arina Ielchiieva <ar...@apache.org> wrote:

> Hi Padma,
>
> I can include mention about batch sizing but I am not sure what I should
> mention, quick search over release notes shows a couple of changes related
> to batch sizing:
> https://drill.apache.org/docs/apache-drill-1-14-0-release-notes/
> Could you please propose what I should include?
>
> @PMCs and committers
> Only one PMC member has given +1 for the report. Could more folks please
> review the report?
>
> Kind regards,
> Arina
>
> On Fri, Nov 2, 2018 at 8:33 PM Padma Penumarthy <
> penumarthy.padma@gmail.com>
> wrote:
>
> > Hi Arina,
> >
> > Can you add batch sizing (for bunch of operators and parquet reader)
> also ?
> >
> > Thanks
> > Padma
> >
> >
> > On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org>
> wrote:
> >
> > > Sure, let's mention.
> > > Updated the report.
> > >
> > > =====
> > >
> > >  ## Description:
> > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> > > Storage.
> > >
> > > ## Issues:
> > >  - There are no issues requiring board attention at this time.
> > >
> > > ## Activity:
> > >  - Since the last board report, Drill has released version 1.14.0,
> > >    including the following enhancements:
> > > - Drill in a Docker container
> > > - Image metadata format plugin
> > > - Upgrade to Calcite 1.16.0
> > > - Kafka plugin push down support
> > > - Phonetic and String functions
> > > - Enhanced decimal data support
> > > - Spill to disk for the Hash Join support
> > > - CGROUPs resource management support
> > > - Lateral / Unnest support (disabled by default)
> > >  - There were active discussions about schema provision in Drill.
> > >    Based on these discussions two projects are currently evolving:
> > >    Drill metastore and schema provision in the file and in a query.
> > >  - Apache Drill book has been written by two PMC members (Charles and
> > > Paul).
> > >  - Drill developer meet up will be held on November 14, 2018.
> > >
> > >    The following areas are going to be discussed:
> > > - Storage plugins
> > > - Schema discovery & Evolution
> > > - Metadata Management
> > > - Resource management
> > > - Integration with Apache Arrow
> > >
> > > ## Health report:
> > >  - The project is healthy. Development activity
> > >    as reflected in the pull requests and JIRAs is good.
> > >  - Activity on the dev and user mailing lists are stable.
> > >  - Three committers and three new PMC member were added in the last
> > period.
> > >
> > > ## PMC changes:
> > >
> > >  - Currently 23 PMC members.
> > >  - New PMC members:
> > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > >
> > > ## Committer base changes:
> > >
> > >  - Currently 48 committers.
> > >  - New commmitters:
> > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > >
> > > ## Releases:
> > >
> > >  - 1.14.0 was released on Sat Aug 04 2018
> > >
> > > ## Mailing list activity:
> > >
> > >  - dev@drill.apache.org:
> > >     - 427 subscribers (down -6 in the last 3 months):
> > >     - 2827 emails sent to list (2126 in previous quarter)
> > >
> > >  - issues@drill.apache.org:
> > >     - 18 subscribers (down -1 in the last 3 months):
> > >     - 3487 emails sent to list (4769 in previous quarter)
> > >
> > >  - user@drill.apache.org:
> > >     - 597 subscribers (down -6 in the last 3 months):
> > >     - 332 emails sent to list (346 in previous quarter)
> > >
> > >
> > > ## JIRA activity:
> > >
> > >  - 164 JIRA tickets created in the last 3 months
> > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > >
> > >
> > >
> > > On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <
> shamirwasia@mapr.com>
> > > wrote:
> > >
> > > > Hi Arina,
> > > > Lateral/Unnest feature was part of 1.14 though it was disabled by
> > > default.
> > > > Should we mention it as part of 1.14 enhancements in the report?
> > > >
> > > > Thanks,
> > > > Sorabh
> > > >
> > > > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
> > > > arina.yelchiyeva@gmail.com>
> > > > wrote:
> > > >
> > > > > Thanks, Aman!  Updated the report.
> > > > > I went too far with 2019, luckily the meet up will be much earlier
> :)
> > > > >
> > > > > =====
> > > > >
> > > > >  ## Description:
> > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> > Cloud
> > > > > Storage.
> > > > >
> > > > > ## Issues:
> > > > >  - There are no issues requiring board attention at this time.
> > > > >
> > > > > ## Activity:
> > > > >  - Since the last board report, Drill has released version 1.14.0,
> > > > >    including the following enhancements:
> > > > > - Drill in a Docker container
> > > > > - Image metadata format plugin
> > > > > - Upgrade to Calcite 1.16.0
> > > > > - Kafka plugin push down support
> > > > > - Phonetic and String functions
> > > > > - Enhanced decimal data support
> > > > > - Spill to disk for the Hash Join support
> > > > > - CGROUPs resource management support
> > > > >  - There were active discussions about schema provision in Drill.
> > > > >    Based on these discussions two projects are currently evolving:
> > > > >    Drill metastore and schema provision in the file and in a query.
> > > > >  - Apache Drill book has been written by two PMC members (Charles
> and
> > > > > Paul).
> > > > >  - Drill developer meet up will be held on November 14, 2018.
> > > > >    The following areas are going to be discussed:
> > > > > - Storage plugins
> > > > > - Schema discovery & Evolution
> > > > > - Metadata Management
> > > > > - Resource management
> > > > > - Integration with Apache Arrow
> > > > >
> > > > > ## Health report:
> > > > >  - The project is healthy. Development activity
> > > > >    as reflected in the pull requests and JIRAs is good.
> > > > >  - Activity on the dev and user mailing lists are stable.
> > > > >  - Three committers and three new PMC member were added in the last
> > > > period.
> > > > >
> > > > > ## PMC changes:
> > > > >
> > > > >  - Currently 23 PMC members.
> > > > >  - New PMC members:
> > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > >
> > > > > ## Committer base changes:
> > > > >
> > > > >  - Currently 48 committers.
> > > > >  - New commmitters:
> > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > >
> > > > > ## Releases:
> > > > >
> > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > >
> > > > > ## Mailing list activity:
> > > > >
> > > > >  - dev@drill.apache.org:
> > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > >
> > > > >  - issues@drill.apache.org:
> > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > >
> > > > >  - user@drill.apache.org:
> > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > >
> > > > >
> > > > > ## JIRA activity:
> > > > >
> > > > >  - 164 JIRA tickets created in the last 3 months
> > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > >
> > > > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org>
> > > wrote:
> > > > >
> > > > > >    Docket container  ==> 'Docker'
> > > > > >    November 14, 2019  ==>  2018  :)   (this is wrong in email
> that
> > > was
> > > > > sent
> > > > > > out)
> > > > > >
> > > > > > Rest LGTM.
> > > > > >
> > > > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <
> arina@apache.org>
> > > > > wrote:
> > > > > >
> > > > > > > Hi all,
> > > > > > >
> > > > > > > please take a look at the draft board report for the last
> quarter
> > > and
> > > > > let
> > > > > > > me know if you have any comments.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Arina
> > > > > > >
> > > > > > > =====
> > > > > > >
> > > > > > >  ## Description:
> > > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL
> and
> > > > Cloud
> > > > > > > Storage.
> > > > > > >
> > > > > > > ## Issues:
> > > > > > >  - There are no issues requiring board attention at this time.
> > > > > > >
> > > > > > > ## Activity:
> > > > > > >  - Since the last board report, Drill has released version
> > 1.14.0,
> > > > > > >    including the following enhancements:
> > > > > > > - Drill in a Docket container
> > > > > > > - Image metadata format plugin
> > > > > > > - Upgrade to Calcite 1.16.0
> > > > > > > - Kafka plugin push down support
> > > > > > > - Phonetic and String functions
> > > > > > > - Enhanced decimal data support
> > > > > > > - Spill to disk for the Hash Join support
> > > > > > > - CGROUPs resource management support
> > > > > > >  - There were active discussions about schema provision in
> Drill.
> > > > > > >    Based on these discussions two projects are currently
> > evolving:
> > > > > > >    Drill metastore and schema provision in the file and in a
> > query.
> > > > > > >  - Apache Drill book has been written by two PMC members
> (Charles
> > > and
> > > > > > > Paul).
> > > > > > >  - Drill developer meet up will be held on November 14, 2019.
> > > > > > >    The following areas are going to be discussed:
> > > > > > > - Storage plugins
> > > > > > > - Schema discovery & Evolution
> > > > > > > - Metadata Management
> > > > > > > - Resource management
> > > > > > > - Integration with Apache Arrow
> > > > > > >
> > > > > > > ## Health report:
> > > > > > >  - The project is healthy. Development activity
> > > > > > >    as reflected in the pull requests and JIRAs is good.
> > > > > > >  - Activity on the dev and user mailing lists are stable.
> > > > > > >  - Three committers and three new PMC member were added in the
> > last
> > > > > > period.
> > > > > > >
> > > > > > > ## PMC changes:
> > > > > > >
> > > > > > >  - Currently 23 PMC members.
> > > > > > >  - New PMC members:
> > > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > > >
> > > > > > > ## Committer base changes:
> > > > > > >
> > > > > > >  - Currently 48 committers.
> > > > > > >  - New commmitters:
> > > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > > >
> > > > > > > ## Releases:
> > > > > > >
> > > > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > > > >
> > > > > > > ## Mailing list activity:
> > > > > > >
> > > > > > >  - dev@drill.apache.org:
> > > > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > > > >
> > > > > > >  - issues@drill.apache.org:
> > > > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > > > >
> > > > > > >  - user@drill.apache.org:
> > > > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > > > >
> > > > > > >
> > > > > > > ## JIRA activity:
> > > > > > >
> > > > > > >  - 164 JIRA tickets created in the last 3 months
> > > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: November Apache Drill board report

Posted by Padma Penumarthy <pe...@gmail.com>.
1.14 release notes should mention batch sizing also.

For the board report, can you please add the following :
Batch processing improvements to limit the amount of memory for Hash Join,
Union All, Project, Hash Aggregate and Nested Loop Join.

Just FYI for everyone. Here is the link to the document which has details
about batch sizing work:
https://docs.google.com/document/d/1Z-67Y_KNcbA2YYWCHEwf2PUEmXRPWSXsw-CHnXW_98Q/

Thanks
Padma





On Wed, Nov 7, 2018 at 5:56 AM Arina Ielchiieva <ar...@apache.org> wrote:

> Hi Padma,
>
> I can include mention about batch sizing but I am not sure what I should
> mention, quick search over release notes shows a couple of changes related
> to batch sizing:
> https://drill.apache.org/docs/apache-drill-1-14-0-release-notes/
> Could you please propose what I should include?
>
> @PMCs and committers
> Only one PMC member has given +1 for the report. Could more folks please
> review the report?
>
> Kind regards,
> Arina
>
> On Fri, Nov 2, 2018 at 8:33 PM Padma Penumarthy <
> penumarthy.padma@gmail.com>
> wrote:
>
> > Hi Arina,
> >
> > Can you add batch sizing (for bunch of operators and parquet reader)
> also ?
> >
> > Thanks
> > Padma
> >
> >
> > On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org>
> wrote:
> >
> > > Sure, let's mention.
> > > Updated the report.
> > >
> > > =====
> > >
> > >  ## Description:
> > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> > > Storage.
> > >
> > > ## Issues:
> > >  - There are no issues requiring board attention at this time.
> > >
> > > ## Activity:
> > >  - Since the last board report, Drill has released version 1.14.0,
> > >    including the following enhancements:
> > > - Drill in a Docker container
> > > - Image metadata format plugin
> > > - Upgrade to Calcite 1.16.0
> > > - Kafka plugin push down support
> > > - Phonetic and String functions
> > > - Enhanced decimal data support
> > > - Spill to disk for the Hash Join support
> > > - CGROUPs resource management support
> > > - Lateral / Unnest support (disabled by default)
> > >  - There were active discussions about schema provision in Drill.
> > >    Based on these discussions two projects are currently evolving:
> > >    Drill metastore and schema provision in the file and in a query.
> > >  - Apache Drill book has been written by two PMC members (Charles and
> > > Paul).
> > >  - Drill developer meet up will be held on November 14, 2018.
> > >
> > >    The following areas are going to be discussed:
> > > - Storage plugins
> > > - Schema discovery & Evolution
> > > - Metadata Management
> > > - Resource management
> > > - Integration with Apache Arrow
> > >
> > > ## Health report:
> > >  - The project is healthy. Development activity
> > >    as reflected in the pull requests and JIRAs is good.
> > >  - Activity on the dev and user mailing lists are stable.
> > >  - Three committers and three new PMC member were added in the last
> > period.
> > >
> > > ## PMC changes:
> > >
> > >  - Currently 23 PMC members.
> > >  - New PMC members:
> > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > >
> > > ## Committer base changes:
> > >
> > >  - Currently 48 committers.
> > >  - New commmitters:
> > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > >
> > > ## Releases:
> > >
> > >  - 1.14.0 was released on Sat Aug 04 2018
> > >
> > > ## Mailing list activity:
> > >
> > >  - dev@drill.apache.org:
> > >     - 427 subscribers (down -6 in the last 3 months):
> > >     - 2827 emails sent to list (2126 in previous quarter)
> > >
> > >  - issues@drill.apache.org:
> > >     - 18 subscribers (down -1 in the last 3 months):
> > >     - 3487 emails sent to list (4769 in previous quarter)
> > >
> > >  - user@drill.apache.org:
> > >     - 597 subscribers (down -6 in the last 3 months):
> > >     - 332 emails sent to list (346 in previous quarter)
> > >
> > >
> > > ## JIRA activity:
> > >
> > >  - 164 JIRA tickets created in the last 3 months
> > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > >
> > >
> > >
> > > On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <
> shamirwasia@mapr.com>
> > > wrote:
> > >
> > > > Hi Arina,
> > > > Lateral/Unnest feature was part of 1.14 though it was disabled by
> > > default.
> > > > Should we mention it as part of 1.14 enhancements in the report?
> > > >
> > > > Thanks,
> > > > Sorabh
> > > >
> > > > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
> > > > arina.yelchiyeva@gmail.com>
> > > > wrote:
> > > >
> > > > > Thanks, Aman!  Updated the report.
> > > > > I went too far with 2019, luckily the meet up will be much earlier
> :)
> > > > >
> > > > > =====
> > > > >
> > > > >  ## Description:
> > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> > Cloud
> > > > > Storage.
> > > > >
> > > > > ## Issues:
> > > > >  - There are no issues requiring board attention at this time.
> > > > >
> > > > > ## Activity:
> > > > >  - Since the last board report, Drill has released version 1.14.0,
> > > > >    including the following enhancements:
> > > > > - Drill in a Docker container
> > > > > - Image metadata format plugin
> > > > > - Upgrade to Calcite 1.16.0
> > > > > - Kafka plugin push down support
> > > > > - Phonetic and String functions
> > > > > - Enhanced decimal data support
> > > > > - Spill to disk for the Hash Join support
> > > > > - CGROUPs resource management support
> > > > >  - There were active discussions about schema provision in Drill.
> > > > >    Based on these discussions two projects are currently evolving:
> > > > >    Drill metastore and schema provision in the file and in a query.
> > > > >  - Apache Drill book has been written by two PMC members (Charles
> and
> > > > > Paul).
> > > > >  - Drill developer meet up will be held on November 14, 2018.
> > > > >    The following areas are going to be discussed:
> > > > > - Storage plugins
> > > > > - Schema discovery & Evolution
> > > > > - Metadata Management
> > > > > - Resource management
> > > > > - Integration with Apache Arrow
> > > > >
> > > > > ## Health report:
> > > > >  - The project is healthy. Development activity
> > > > >    as reflected in the pull requests and JIRAs is good.
> > > > >  - Activity on the dev and user mailing lists are stable.
> > > > >  - Three committers and three new PMC member were added in the last
> > > > period.
> > > > >
> > > > > ## PMC changes:
> > > > >
> > > > >  - Currently 23 PMC members.
> > > > >  - New PMC members:
> > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > >
> > > > > ## Committer base changes:
> > > > >
> > > > >  - Currently 48 committers.
> > > > >  - New commmitters:
> > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > >
> > > > > ## Releases:
> > > > >
> > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > >
> > > > > ## Mailing list activity:
> > > > >
> > > > >  - dev@drill.apache.org:
> > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > >
> > > > >  - issues@drill.apache.org:
> > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > >
> > > > >  - user@drill.apache.org:
> > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > >
> > > > >
> > > > > ## JIRA activity:
> > > > >
> > > > >  - 164 JIRA tickets created in the last 3 months
> > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > >
> > > > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org>
> > > wrote:
> > > > >
> > > > > >    Docket container  ==> 'Docker'
> > > > > >    November 14, 2019  ==>  2018  :)   (this is wrong in email
> that
> > > was
> > > > > sent
> > > > > > out)
> > > > > >
> > > > > > Rest LGTM.
> > > > > >
> > > > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <
> arina@apache.org>
> > > > > wrote:
> > > > > >
> > > > > > > Hi all,
> > > > > > >
> > > > > > > please take a look at the draft board report for the last
> quarter
> > > and
> > > > > let
> > > > > > > me know if you have any comments.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Arina
> > > > > > >
> > > > > > > =====
> > > > > > >
> > > > > > >  ## Description:
> > > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL
> and
> > > > Cloud
> > > > > > > Storage.
> > > > > > >
> > > > > > > ## Issues:
> > > > > > >  - There are no issues requiring board attention at this time.
> > > > > > >
> > > > > > > ## Activity:
> > > > > > >  - Since the last board report, Drill has released version
> > 1.14.0,
> > > > > > >    including the following enhancements:
> > > > > > > - Drill in a Docket container
> > > > > > > - Image metadata format plugin
> > > > > > > - Upgrade to Calcite 1.16.0
> > > > > > > - Kafka plugin push down support
> > > > > > > - Phonetic and String functions
> > > > > > > - Enhanced decimal data support
> > > > > > > - Spill to disk for the Hash Join support
> > > > > > > - CGROUPs resource management support
> > > > > > >  - There were active discussions about schema provision in
> Drill.
> > > > > > >    Based on these discussions two projects are currently
> > evolving:
> > > > > > >    Drill metastore and schema provision in the file and in a
> > query.
> > > > > > >  - Apache Drill book has been written by two PMC members
> (Charles
> > > and
> > > > > > > Paul).
> > > > > > >  - Drill developer meet up will be held on November 14, 2019.
> > > > > > >    The following areas are going to be discussed:
> > > > > > > - Storage plugins
> > > > > > > - Schema discovery & Evolution
> > > > > > > - Metadata Management
> > > > > > > - Resource management
> > > > > > > - Integration with Apache Arrow
> > > > > > >
> > > > > > > ## Health report:
> > > > > > >  - The project is healthy. Development activity
> > > > > > >    as reflected in the pull requests and JIRAs is good.
> > > > > > >  - Activity on the dev and user mailing lists are stable.
> > > > > > >  - Three committers and three new PMC member were added in the
> > last
> > > > > > period.
> > > > > > >
> > > > > > > ## PMC changes:
> > > > > > >
> > > > > > >  - Currently 23 PMC members.
> > > > > > >  - New PMC members:
> > > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > > >
> > > > > > > ## Committer base changes:
> > > > > > >
> > > > > > >  - Currently 48 committers.
> > > > > > >  - New commmitters:
> > > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > > >
> > > > > > > ## Releases:
> > > > > > >
> > > > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > > > >
> > > > > > > ## Mailing list activity:
> > > > > > >
> > > > > > >  - dev@drill.apache.org:
> > > > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > > > >
> > > > > > >  - issues@drill.apache.org:
> > > > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > > > >
> > > > > > >  - user@drill.apache.org:
> > > > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > > > >
> > > > > > >
> > > > > > > ## JIRA activity:
> > > > > > >
> > > > > > >  - 164 JIRA tickets created in the last 3 months
> > > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: November Apache Drill board report

Posted by Arina Ielchiieva <ar...@apache.org>.
Hi Padma,

I can include mention about batch sizing but I am not sure what I should
mention, quick search over release notes shows a couple of changes related
to batch sizing:
https://drill.apache.org/docs/apache-drill-1-14-0-release-notes/
Could you please propose what I should include?

@PMCs and committers
Only one PMC member has given +1 for the report. Could more folks please
review the report?

Kind regards,
Arina

On Fri, Nov 2, 2018 at 8:33 PM Padma Penumarthy <pe...@gmail.com>
wrote:

> Hi Arina,
>
> Can you add batch sizing (for bunch of operators and parquet reader) also ?
>
> Thanks
> Padma
>
>
> On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org> wrote:
>
> > Sure, let's mention.
> > Updated the report.
> >
> > =====
> >
> >  ## Description:
> >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> > Storage.
> >
> > ## Issues:
> >  - There are no issues requiring board attention at this time.
> >
> > ## Activity:
> >  - Since the last board report, Drill has released version 1.14.0,
> >    including the following enhancements:
> > - Drill in a Docker container
> > - Image metadata format plugin
> > - Upgrade to Calcite 1.16.0
> > - Kafka plugin push down support
> > - Phonetic and String functions
> > - Enhanced decimal data support
> > - Spill to disk for the Hash Join support
> > - CGROUPs resource management support
> > - Lateral / Unnest support (disabled by default)
> >  - There were active discussions about schema provision in Drill.
> >    Based on these discussions two projects are currently evolving:
> >    Drill metastore and schema provision in the file and in a query.
> >  - Apache Drill book has been written by two PMC members (Charles and
> > Paul).
> >  - Drill developer meet up will be held on November 14, 2018.
> >
> >    The following areas are going to be discussed:
> > - Storage plugins
> > - Schema discovery & Evolution
> > - Metadata Management
> > - Resource management
> > - Integration with Apache Arrow
> >
> > ## Health report:
> >  - The project is healthy. Development activity
> >    as reflected in the pull requests and JIRAs is good.
> >  - Activity on the dev and user mailing lists are stable.
> >  - Three committers and three new PMC member were added in the last
> period.
> >
> > ## PMC changes:
> >
> >  - Currently 23 PMC members.
> >  - New PMC members:
> >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> >
> > ## Committer base changes:
> >
> >  - Currently 48 committers.
> >  - New commmitters:
> >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> >
> > ## Releases:
> >
> >  - 1.14.0 was released on Sat Aug 04 2018
> >
> > ## Mailing list activity:
> >
> >  - dev@drill.apache.org:
> >     - 427 subscribers (down -6 in the last 3 months):
> >     - 2827 emails sent to list (2126 in previous quarter)
> >
> >  - issues@drill.apache.org:
> >     - 18 subscribers (down -1 in the last 3 months):
> >     - 3487 emails sent to list (4769 in previous quarter)
> >
> >  - user@drill.apache.org:
> >     - 597 subscribers (down -6 in the last 3 months):
> >     - 332 emails sent to list (346 in previous quarter)
> >
> >
> > ## JIRA activity:
> >
> >  - 164 JIRA tickets created in the last 3 months
> >  - 128 JIRA tickets closed/resolved in the last 3 months
> >
> >
> >
> > On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <sh...@mapr.com>
> > wrote:
> >
> > > Hi Arina,
> > > Lateral/Unnest feature was part of 1.14 though it was disabled by
> > default.
> > > Should we mention it as part of 1.14 enhancements in the report?
> > >
> > > Thanks,
> > > Sorabh
> > >
> > > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
> > > arina.yelchiyeva@gmail.com>
> > > wrote:
> > >
> > > > Thanks, Aman!  Updated the report.
> > > > I went too far with 2019, luckily the meet up will be much earlier :)
> > > >
> > > > =====
> > > >
> > > >  ## Description:
> > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> Cloud
> > > > Storage.
> > > >
> > > > ## Issues:
> > > >  - There are no issues requiring board attention at this time.
> > > >
> > > > ## Activity:
> > > >  - Since the last board report, Drill has released version 1.14.0,
> > > >    including the following enhancements:
> > > > - Drill in a Docker container
> > > > - Image metadata format plugin
> > > > - Upgrade to Calcite 1.16.0
> > > > - Kafka plugin push down support
> > > > - Phonetic and String functions
> > > > - Enhanced decimal data support
> > > > - Spill to disk for the Hash Join support
> > > > - CGROUPs resource management support
> > > >  - There were active discussions about schema provision in Drill.
> > > >    Based on these discussions two projects are currently evolving:
> > > >    Drill metastore and schema provision in the file and in a query.
> > > >  - Apache Drill book has been written by two PMC members (Charles and
> > > > Paul).
> > > >  - Drill developer meet up will be held on November 14, 2018.
> > > >    The following areas are going to be discussed:
> > > > - Storage plugins
> > > > - Schema discovery & Evolution
> > > > - Metadata Management
> > > > - Resource management
> > > > - Integration with Apache Arrow
> > > >
> > > > ## Health report:
> > > >  - The project is healthy. Development activity
> > > >    as reflected in the pull requests and JIRAs is good.
> > > >  - Activity on the dev and user mailing lists are stable.
> > > >  - Three committers and three new PMC member were added in the last
> > > period.
> > > >
> > > > ## PMC changes:
> > > >
> > > >  - Currently 23 PMC members.
> > > >  - New PMC members:
> > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > >
> > > > ## Committer base changes:
> > > >
> > > >  - Currently 48 committers.
> > > >  - New commmitters:
> > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > >
> > > > ## Releases:
> > > >
> > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > >
> > > > ## Mailing list activity:
> > > >
> > > >  - dev@drill.apache.org:
> > > >     - 427 subscribers (down -6 in the last 3 months):
> > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > >
> > > >  - issues@drill.apache.org:
> > > >     - 18 subscribers (down -1 in the last 3 months):
> > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > >
> > > >  - user@drill.apache.org:
> > > >     - 597 subscribers (down -6 in the last 3 months):
> > > >     - 332 emails sent to list (346 in previous quarter)
> > > >
> > > >
> > > > ## JIRA activity:
> > > >
> > > >  - 164 JIRA tickets created in the last 3 months
> > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > >
> > > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org>
> > wrote:
> > > >
> > > > >    Docket container  ==> 'Docker'
> > > > >    November 14, 2019  ==>  2018  :)   (this is wrong in email that
> > was
> > > > sent
> > > > > out)
> > > > >
> > > > > Rest LGTM.
> > > > >
> > > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <ar...@apache.org>
> > > > wrote:
> > > > >
> > > > > > Hi all,
> > > > > >
> > > > > > please take a look at the draft board report for the last quarter
> > and
> > > > let
> > > > > > me know if you have any comments.
> > > > > >
> > > > > > Thanks,
> > > > > > Arina
> > > > > >
> > > > > > =====
> > > > > >
> > > > > >  ## Description:
> > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> > > Cloud
> > > > > > Storage.
> > > > > >
> > > > > > ## Issues:
> > > > > >  - There are no issues requiring board attention at this time.
> > > > > >
> > > > > > ## Activity:
> > > > > >  - Since the last board report, Drill has released version
> 1.14.0,
> > > > > >    including the following enhancements:
> > > > > > - Drill in a Docket container
> > > > > > - Image metadata format plugin
> > > > > > - Upgrade to Calcite 1.16.0
> > > > > > - Kafka plugin push down support
> > > > > > - Phonetic and String functions
> > > > > > - Enhanced decimal data support
> > > > > > - Spill to disk for the Hash Join support
> > > > > > - CGROUPs resource management support
> > > > > >  - There were active discussions about schema provision in Drill.
> > > > > >    Based on these discussions two projects are currently
> evolving:
> > > > > >    Drill metastore and schema provision in the file and in a
> query.
> > > > > >  - Apache Drill book has been written by two PMC members (Charles
> > and
> > > > > > Paul).
> > > > > >  - Drill developer meet up will be held on November 14, 2019.
> > > > > >    The following areas are going to be discussed:
> > > > > > - Storage plugins
> > > > > > - Schema discovery & Evolution
> > > > > > - Metadata Management
> > > > > > - Resource management
> > > > > > - Integration with Apache Arrow
> > > > > >
> > > > > > ## Health report:
> > > > > >  - The project is healthy. Development activity
> > > > > >    as reflected in the pull requests and JIRAs is good.
> > > > > >  - Activity on the dev and user mailing lists are stable.
> > > > > >  - Three committers and three new PMC member were added in the
> last
> > > > > period.
> > > > > >
> > > > > > ## PMC changes:
> > > > > >
> > > > > >  - Currently 23 PMC members.
> > > > > >  - New PMC members:
> > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > >
> > > > > > ## Committer base changes:
> > > > > >
> > > > > >  - Currently 48 committers.
> > > > > >  - New commmitters:
> > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > >
> > > > > > ## Releases:
> > > > > >
> > > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > > >
> > > > > > ## Mailing list activity:
> > > > > >
> > > > > >  - dev@drill.apache.org:
> > > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > > >
> > > > > >  - issues@drill.apache.org:
> > > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > > >
> > > > > >  - user@drill.apache.org:
> > > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > > >
> > > > > >
> > > > > > ## JIRA activity:
> > > > > >
> > > > > >  - 164 JIRA tickets created in the last 3 months
> > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: November Apache Drill board report

Posted by Arina Ielchiieva <ar...@apache.org>.
Hi Padma,

I can include mention about batch sizing but I am not sure what I should
mention, quick search over release notes shows a couple of changes related
to batch sizing:
https://drill.apache.org/docs/apache-drill-1-14-0-release-notes/
Could you please propose what I should include?

@PMCs and committers
Only one PMC member has given +1 for the report. Could more folks please
review the report?

Kind regards,
Arina

On Fri, Nov 2, 2018 at 8:33 PM Padma Penumarthy <pe...@gmail.com>
wrote:

> Hi Arina,
>
> Can you add batch sizing (for bunch of operators and parquet reader) also ?
>
> Thanks
> Padma
>
>
> On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org> wrote:
>
> > Sure, let's mention.
> > Updated the report.
> >
> > =====
> >
> >  ## Description:
> >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> > Storage.
> >
> > ## Issues:
> >  - There are no issues requiring board attention at this time.
> >
> > ## Activity:
> >  - Since the last board report, Drill has released version 1.14.0,
> >    including the following enhancements:
> > - Drill in a Docker container
> > - Image metadata format plugin
> > - Upgrade to Calcite 1.16.0
> > - Kafka plugin push down support
> > - Phonetic and String functions
> > - Enhanced decimal data support
> > - Spill to disk for the Hash Join support
> > - CGROUPs resource management support
> > - Lateral / Unnest support (disabled by default)
> >  - There were active discussions about schema provision in Drill.
> >    Based on these discussions two projects are currently evolving:
> >    Drill metastore and schema provision in the file and in a query.
> >  - Apache Drill book has been written by two PMC members (Charles and
> > Paul).
> >  - Drill developer meet up will be held on November 14, 2018.
> >
> >    The following areas are going to be discussed:
> > - Storage plugins
> > - Schema discovery & Evolution
> > - Metadata Management
> > - Resource management
> > - Integration with Apache Arrow
> >
> > ## Health report:
> >  - The project is healthy. Development activity
> >    as reflected in the pull requests and JIRAs is good.
> >  - Activity on the dev and user mailing lists are stable.
> >  - Three committers and three new PMC member were added in the last
> period.
> >
> > ## PMC changes:
> >
> >  - Currently 23 PMC members.
> >  - New PMC members:
> >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> >
> > ## Committer base changes:
> >
> >  - Currently 48 committers.
> >  - New commmitters:
> >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> >
> > ## Releases:
> >
> >  - 1.14.0 was released on Sat Aug 04 2018
> >
> > ## Mailing list activity:
> >
> >  - dev@drill.apache.org:
> >     - 427 subscribers (down -6 in the last 3 months):
> >     - 2827 emails sent to list (2126 in previous quarter)
> >
> >  - issues@drill.apache.org:
> >     - 18 subscribers (down -1 in the last 3 months):
> >     - 3487 emails sent to list (4769 in previous quarter)
> >
> >  - user@drill.apache.org:
> >     - 597 subscribers (down -6 in the last 3 months):
> >     - 332 emails sent to list (346 in previous quarter)
> >
> >
> > ## JIRA activity:
> >
> >  - 164 JIRA tickets created in the last 3 months
> >  - 128 JIRA tickets closed/resolved in the last 3 months
> >
> >
> >
> > On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <sh...@mapr.com>
> > wrote:
> >
> > > Hi Arina,
> > > Lateral/Unnest feature was part of 1.14 though it was disabled by
> > default.
> > > Should we mention it as part of 1.14 enhancements in the report?
> > >
> > > Thanks,
> > > Sorabh
> > >
> > > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
> > > arina.yelchiyeva@gmail.com>
> > > wrote:
> > >
> > > > Thanks, Aman!  Updated the report.
> > > > I went too far with 2019, luckily the meet up will be much earlier :)
> > > >
> > > > =====
> > > >
> > > >  ## Description:
> > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> Cloud
> > > > Storage.
> > > >
> > > > ## Issues:
> > > >  - There are no issues requiring board attention at this time.
> > > >
> > > > ## Activity:
> > > >  - Since the last board report, Drill has released version 1.14.0,
> > > >    including the following enhancements:
> > > > - Drill in a Docker container
> > > > - Image metadata format plugin
> > > > - Upgrade to Calcite 1.16.0
> > > > - Kafka plugin push down support
> > > > - Phonetic and String functions
> > > > - Enhanced decimal data support
> > > > - Spill to disk for the Hash Join support
> > > > - CGROUPs resource management support
> > > >  - There were active discussions about schema provision in Drill.
> > > >    Based on these discussions two projects are currently evolving:
> > > >    Drill metastore and schema provision in the file and in a query.
> > > >  - Apache Drill book has been written by two PMC members (Charles and
> > > > Paul).
> > > >  - Drill developer meet up will be held on November 14, 2018.
> > > >    The following areas are going to be discussed:
> > > > - Storage plugins
> > > > - Schema discovery & Evolution
> > > > - Metadata Management
> > > > - Resource management
> > > > - Integration with Apache Arrow
> > > >
> > > > ## Health report:
> > > >  - The project is healthy. Development activity
> > > >    as reflected in the pull requests and JIRAs is good.
> > > >  - Activity on the dev and user mailing lists are stable.
> > > >  - Three committers and three new PMC member were added in the last
> > > period.
> > > >
> > > > ## PMC changes:
> > > >
> > > >  - Currently 23 PMC members.
> > > >  - New PMC members:
> > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > >
> > > > ## Committer base changes:
> > > >
> > > >  - Currently 48 committers.
> > > >  - New commmitters:
> > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > >
> > > > ## Releases:
> > > >
> > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > >
> > > > ## Mailing list activity:
> > > >
> > > >  - dev@drill.apache.org:
> > > >     - 427 subscribers (down -6 in the last 3 months):
> > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > >
> > > >  - issues@drill.apache.org:
> > > >     - 18 subscribers (down -1 in the last 3 months):
> > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > >
> > > >  - user@drill.apache.org:
> > > >     - 597 subscribers (down -6 in the last 3 months):
> > > >     - 332 emails sent to list (346 in previous quarter)
> > > >
> > > >
> > > > ## JIRA activity:
> > > >
> > > >  - 164 JIRA tickets created in the last 3 months
> > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > >
> > > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org>
> > wrote:
> > > >
> > > > >    Docket container  ==> 'Docker'
> > > > >    November 14, 2019  ==>  2018  :)   (this is wrong in email that
> > was
> > > > sent
> > > > > out)
> > > > >
> > > > > Rest LGTM.
> > > > >
> > > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <ar...@apache.org>
> > > > wrote:
> > > > >
> > > > > > Hi all,
> > > > > >
> > > > > > please take a look at the draft board report for the last quarter
> > and
> > > > let
> > > > > > me know if you have any comments.
> > > > > >
> > > > > > Thanks,
> > > > > > Arina
> > > > > >
> > > > > > =====
> > > > > >
> > > > > >  ## Description:
> > > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> > > Cloud
> > > > > > Storage.
> > > > > >
> > > > > > ## Issues:
> > > > > >  - There are no issues requiring board attention at this time.
> > > > > >
> > > > > > ## Activity:
> > > > > >  - Since the last board report, Drill has released version
> 1.14.0,
> > > > > >    including the following enhancements:
> > > > > > - Drill in a Docket container
> > > > > > - Image metadata format plugin
> > > > > > - Upgrade to Calcite 1.16.0
> > > > > > - Kafka plugin push down support
> > > > > > - Phonetic and String functions
> > > > > > - Enhanced decimal data support
> > > > > > - Spill to disk for the Hash Join support
> > > > > > - CGROUPs resource management support
> > > > > >  - There were active discussions about schema provision in Drill.
> > > > > >    Based on these discussions two projects are currently
> evolving:
> > > > > >    Drill metastore and schema provision in the file and in a
> query.
> > > > > >  - Apache Drill book has been written by two PMC members (Charles
> > and
> > > > > > Paul).
> > > > > >  - Drill developer meet up will be held on November 14, 2019.
> > > > > >    The following areas are going to be discussed:
> > > > > > - Storage plugins
> > > > > > - Schema discovery & Evolution
> > > > > > - Metadata Management
> > > > > > - Resource management
> > > > > > - Integration with Apache Arrow
> > > > > >
> > > > > > ## Health report:
> > > > > >  - The project is healthy. Development activity
> > > > > >    as reflected in the pull requests and JIRAs is good.
> > > > > >  - Activity on the dev and user mailing lists are stable.
> > > > > >  - Three committers and three new PMC member were added in the
> last
> > > > > period.
> > > > > >
> > > > > > ## PMC changes:
> > > > > >
> > > > > >  - Currently 23 PMC members.
> > > > > >  - New PMC members:
> > > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > > >
> > > > > > ## Committer base changes:
> > > > > >
> > > > > >  - Currently 48 committers.
> > > > > >  - New commmitters:
> > > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > > >
> > > > > > ## Releases:
> > > > > >
> > > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > > >
> > > > > > ## Mailing list activity:
> > > > > >
> > > > > >  - dev@drill.apache.org:
> > > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > > >
> > > > > >  - issues@drill.apache.org:
> > > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > > >
> > > > > >  - user@drill.apache.org:
> > > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > > >
> > > > > >
> > > > > > ## JIRA activity:
> > > > > >
> > > > > >  - 164 JIRA tickets created in the last 3 months
> > > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: November Apache Drill board report

Posted by Padma Penumarthy <pe...@gmail.com>.
Hi Arina,

Can you add batch sizing (for bunch of operators and parquet reader) also ?

Thanks
Padma


On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org> wrote:

> Sure, let's mention.
> Updated the report.
>
> =====
>
>  ## Description:
>  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> Storage.
>
> ## Issues:
>  - There are no issues requiring board attention at this time.
>
> ## Activity:
>  - Since the last board report, Drill has released version 1.14.0,
>    including the following enhancements:
> - Drill in a Docker container
> - Image metadata format plugin
> - Upgrade to Calcite 1.16.0
> - Kafka plugin push down support
> - Phonetic and String functions
> - Enhanced decimal data support
> - Spill to disk for the Hash Join support
> - CGROUPs resource management support
> - Lateral / Unnest support (disabled by default)
>  - There were active discussions about schema provision in Drill.
>    Based on these discussions two projects are currently evolving:
>    Drill metastore and schema provision in the file and in a query.
>  - Apache Drill book has been written by two PMC members (Charles and
> Paul).
>  - Drill developer meet up will be held on November 14, 2018.
>
>    The following areas are going to be discussed:
> - Storage plugins
> - Schema discovery & Evolution
> - Metadata Management
> - Resource management
> - Integration with Apache Arrow
>
> ## Health report:
>  - The project is healthy. Development activity
>    as reflected in the pull requests and JIRAs is good.
>  - Activity on the dev and user mailing lists are stable.
>  - Three committers and three new PMC member were added in the last period.
>
> ## PMC changes:
>
>  - Currently 23 PMC members.
>  - New PMC members:
>     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
>     - Charles Givre was added to the PMC on Mon Sep 03 2018
>     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
>
> ## Committer base changes:
>
>  - Currently 48 committers.
>  - New commmitters:
>     - Chunhui Shi was added as a committer on Thu Sep 27 2018
>     - Gautam Parai was added as a committer on Mon Oct 22 2018
>     - Weijie Tong was added as a committer on Fri Aug 31 2018
>
> ## Releases:
>
>  - 1.14.0 was released on Sat Aug 04 2018
>
> ## Mailing list activity:
>
>  - dev@drill.apache.org:
>     - 427 subscribers (down -6 in the last 3 months):
>     - 2827 emails sent to list (2126 in previous quarter)
>
>  - issues@drill.apache.org:
>     - 18 subscribers (down -1 in the last 3 months):
>     - 3487 emails sent to list (4769 in previous quarter)
>
>  - user@drill.apache.org:
>     - 597 subscribers (down -6 in the last 3 months):
>     - 332 emails sent to list (346 in previous quarter)
>
>
> ## JIRA activity:
>
>  - 164 JIRA tickets created in the last 3 months
>  - 128 JIRA tickets closed/resolved in the last 3 months
>
>
>
> On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <sh...@mapr.com>
> wrote:
>
> > Hi Arina,
> > Lateral/Unnest feature was part of 1.14 though it was disabled by
> default.
> > Should we mention it as part of 1.14 enhancements in the report?
> >
> > Thanks,
> > Sorabh
> >
> > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
> > arina.yelchiyeva@gmail.com>
> > wrote:
> >
> > > Thanks, Aman!  Updated the report.
> > > I went too far with 2019, luckily the meet up will be much earlier :)
> > >
> > > =====
> > >
> > >  ## Description:
> > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> > > Storage.
> > >
> > > ## Issues:
> > >  - There are no issues requiring board attention at this time.
> > >
> > > ## Activity:
> > >  - Since the last board report, Drill has released version 1.14.0,
> > >    including the following enhancements:
> > > - Drill in a Docker container
> > > - Image metadata format plugin
> > > - Upgrade to Calcite 1.16.0
> > > - Kafka plugin push down support
> > > - Phonetic and String functions
> > > - Enhanced decimal data support
> > > - Spill to disk for the Hash Join support
> > > - CGROUPs resource management support
> > >  - There were active discussions about schema provision in Drill.
> > >    Based on these discussions two projects are currently evolving:
> > >    Drill metastore and schema provision in the file and in a query.
> > >  - Apache Drill book has been written by two PMC members (Charles and
> > > Paul).
> > >  - Drill developer meet up will be held on November 14, 2018.
> > >    The following areas are going to be discussed:
> > > - Storage plugins
> > > - Schema discovery & Evolution
> > > - Metadata Management
> > > - Resource management
> > > - Integration with Apache Arrow
> > >
> > > ## Health report:
> > >  - The project is healthy. Development activity
> > >    as reflected in the pull requests and JIRAs is good.
> > >  - Activity on the dev and user mailing lists are stable.
> > >  - Three committers and three new PMC member were added in the last
> > period.
> > >
> > > ## PMC changes:
> > >
> > >  - Currently 23 PMC members.
> > >  - New PMC members:
> > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > >
> > > ## Committer base changes:
> > >
> > >  - Currently 48 committers.
> > >  - New commmitters:
> > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > >
> > > ## Releases:
> > >
> > >  - 1.14.0 was released on Sat Aug 04 2018
> > >
> > > ## Mailing list activity:
> > >
> > >  - dev@drill.apache.org:
> > >     - 427 subscribers (down -6 in the last 3 months):
> > >     - 2827 emails sent to list (2126 in previous quarter)
> > >
> > >  - issues@drill.apache.org:
> > >     - 18 subscribers (down -1 in the last 3 months):
> > >     - 3487 emails sent to list (4769 in previous quarter)
> > >
> > >  - user@drill.apache.org:
> > >     - 597 subscribers (down -6 in the last 3 months):
> > >     - 332 emails sent to list (346 in previous quarter)
> > >
> > >
> > > ## JIRA activity:
> > >
> > >  - 164 JIRA tickets created in the last 3 months
> > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > >
> > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org>
> wrote:
> > >
> > > >    Docket container  ==> 'Docker'
> > > >    November 14, 2019  ==>  2018  :)   (this is wrong in email that
> was
> > > sent
> > > > out)
> > > >
> > > > Rest LGTM.
> > > >
> > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <ar...@apache.org>
> > > wrote:
> > > >
> > > > > Hi all,
> > > > >
> > > > > please take a look at the draft board report for the last quarter
> and
> > > let
> > > > > me know if you have any comments.
> > > > >
> > > > > Thanks,
> > > > > Arina
> > > > >
> > > > > =====
> > > > >
> > > > >  ## Description:
> > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> > Cloud
> > > > > Storage.
> > > > >
> > > > > ## Issues:
> > > > >  - There are no issues requiring board attention at this time.
> > > > >
> > > > > ## Activity:
> > > > >  - Since the last board report, Drill has released version 1.14.0,
> > > > >    including the following enhancements:
> > > > > - Drill in a Docket container
> > > > > - Image metadata format plugin
> > > > > - Upgrade to Calcite 1.16.0
> > > > > - Kafka plugin push down support
> > > > > - Phonetic and String functions
> > > > > - Enhanced decimal data support
> > > > > - Spill to disk for the Hash Join support
> > > > > - CGROUPs resource management support
> > > > >  - There were active discussions about schema provision in Drill.
> > > > >    Based on these discussions two projects are currently evolving:
> > > > >    Drill metastore and schema provision in the file and in a query.
> > > > >  - Apache Drill book has been written by two PMC members (Charles
> and
> > > > > Paul).
> > > > >  - Drill developer meet up will be held on November 14, 2019.
> > > > >    The following areas are going to be discussed:
> > > > > - Storage plugins
> > > > > - Schema discovery & Evolution
> > > > > - Metadata Management
> > > > > - Resource management
> > > > > - Integration with Apache Arrow
> > > > >
> > > > > ## Health report:
> > > > >  - The project is healthy. Development activity
> > > > >    as reflected in the pull requests and JIRAs is good.
> > > > >  - Activity on the dev and user mailing lists are stable.
> > > > >  - Three committers and three new PMC member were added in the last
> > > > period.
> > > > >
> > > > > ## PMC changes:
> > > > >
> > > > >  - Currently 23 PMC members.
> > > > >  - New PMC members:
> > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > >
> > > > > ## Committer base changes:
> > > > >
> > > > >  - Currently 48 committers.
> > > > >  - New commmitters:
> > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > >
> > > > > ## Releases:
> > > > >
> > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > >
> > > > > ## Mailing list activity:
> > > > >
> > > > >  - dev@drill.apache.org:
> > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > >
> > > > >  - issues@drill.apache.org:
> > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > >
> > > > >  - user@drill.apache.org:
> > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > >
> > > > >
> > > > > ## JIRA activity:
> > > > >
> > > > >  - 164 JIRA tickets created in the last 3 months
> > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > >
> > > >
> > >
> >
>

Re: November Apache Drill board report

Posted by Padma Penumarthy <pe...@gmail.com>.
Hi Arina,

Can you add batch sizing (for bunch of operators and parquet reader) also ?

Thanks
Padma


On Fri, Nov 2, 2018 at 2:55 AM Arina Ielchiieva <ar...@apache.org> wrote:

> Sure, let's mention.
> Updated the report.
>
> =====
>
>  ## Description:
>  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> Storage.
>
> ## Issues:
>  - There are no issues requiring board attention at this time.
>
> ## Activity:
>  - Since the last board report, Drill has released version 1.14.0,
>    including the following enhancements:
> - Drill in a Docker container
> - Image metadata format plugin
> - Upgrade to Calcite 1.16.0
> - Kafka plugin push down support
> - Phonetic and String functions
> - Enhanced decimal data support
> - Spill to disk for the Hash Join support
> - CGROUPs resource management support
> - Lateral / Unnest support (disabled by default)
>  - There were active discussions about schema provision in Drill.
>    Based on these discussions two projects are currently evolving:
>    Drill metastore and schema provision in the file and in a query.
>  - Apache Drill book has been written by two PMC members (Charles and
> Paul).
>  - Drill developer meet up will be held on November 14, 2018.
>
>    The following areas are going to be discussed:
> - Storage plugins
> - Schema discovery & Evolution
> - Metadata Management
> - Resource management
> - Integration with Apache Arrow
>
> ## Health report:
>  - The project is healthy. Development activity
>    as reflected in the pull requests and JIRAs is good.
>  - Activity on the dev and user mailing lists are stable.
>  - Three committers and three new PMC member were added in the last period.
>
> ## PMC changes:
>
>  - Currently 23 PMC members.
>  - New PMC members:
>     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
>     - Charles Givre was added to the PMC on Mon Sep 03 2018
>     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
>
> ## Committer base changes:
>
>  - Currently 48 committers.
>  - New commmitters:
>     - Chunhui Shi was added as a committer on Thu Sep 27 2018
>     - Gautam Parai was added as a committer on Mon Oct 22 2018
>     - Weijie Tong was added as a committer on Fri Aug 31 2018
>
> ## Releases:
>
>  - 1.14.0 was released on Sat Aug 04 2018
>
> ## Mailing list activity:
>
>  - dev@drill.apache.org:
>     - 427 subscribers (down -6 in the last 3 months):
>     - 2827 emails sent to list (2126 in previous quarter)
>
>  - issues@drill.apache.org:
>     - 18 subscribers (down -1 in the last 3 months):
>     - 3487 emails sent to list (4769 in previous quarter)
>
>  - user@drill.apache.org:
>     - 597 subscribers (down -6 in the last 3 months):
>     - 332 emails sent to list (346 in previous quarter)
>
>
> ## JIRA activity:
>
>  - 164 JIRA tickets created in the last 3 months
>  - 128 JIRA tickets closed/resolved in the last 3 months
>
>
>
> On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <sh...@mapr.com>
> wrote:
>
> > Hi Arina,
> > Lateral/Unnest feature was part of 1.14 though it was disabled by
> default.
> > Should we mention it as part of 1.14 enhancements in the report?
> >
> > Thanks,
> > Sorabh
> >
> > On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
> > arina.yelchiyeva@gmail.com>
> > wrote:
> >
> > > Thanks, Aman!  Updated the report.
> > > I went too far with 2019, luckily the meet up will be much earlier :)
> > >
> > > =====
> > >
> > >  ## Description:
> > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> > > Storage.
> > >
> > > ## Issues:
> > >  - There are no issues requiring board attention at this time.
> > >
> > > ## Activity:
> > >  - Since the last board report, Drill has released version 1.14.0,
> > >    including the following enhancements:
> > > - Drill in a Docker container
> > > - Image metadata format plugin
> > > - Upgrade to Calcite 1.16.0
> > > - Kafka plugin push down support
> > > - Phonetic and String functions
> > > - Enhanced decimal data support
> > > - Spill to disk for the Hash Join support
> > > - CGROUPs resource management support
> > >  - There were active discussions about schema provision in Drill.
> > >    Based on these discussions two projects are currently evolving:
> > >    Drill metastore and schema provision in the file and in a query.
> > >  - Apache Drill book has been written by two PMC members (Charles and
> > > Paul).
> > >  - Drill developer meet up will be held on November 14, 2018.
> > >    The following areas are going to be discussed:
> > > - Storage plugins
> > > - Schema discovery & Evolution
> > > - Metadata Management
> > > - Resource management
> > > - Integration with Apache Arrow
> > >
> > > ## Health report:
> > >  - The project is healthy. Development activity
> > >    as reflected in the pull requests and JIRAs is good.
> > >  - Activity on the dev and user mailing lists are stable.
> > >  - Three committers and three new PMC member were added in the last
> > period.
> > >
> > > ## PMC changes:
> > >
> > >  - Currently 23 PMC members.
> > >  - New PMC members:
> > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > >
> > > ## Committer base changes:
> > >
> > >  - Currently 48 committers.
> > >  - New commmitters:
> > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > >
> > > ## Releases:
> > >
> > >  - 1.14.0 was released on Sat Aug 04 2018
> > >
> > > ## Mailing list activity:
> > >
> > >  - dev@drill.apache.org:
> > >     - 427 subscribers (down -6 in the last 3 months):
> > >     - 2827 emails sent to list (2126 in previous quarter)
> > >
> > >  - issues@drill.apache.org:
> > >     - 18 subscribers (down -1 in the last 3 months):
> > >     - 3487 emails sent to list (4769 in previous quarter)
> > >
> > >  - user@drill.apache.org:
> > >     - 597 subscribers (down -6 in the last 3 months):
> > >     - 332 emails sent to list (346 in previous quarter)
> > >
> > >
> > > ## JIRA activity:
> > >
> > >  - 164 JIRA tickets created in the last 3 months
> > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > >
> > > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org>
> wrote:
> > >
> > > >    Docket container  ==> 'Docker'
> > > >    November 14, 2019  ==>  2018  :)   (this is wrong in email that
> was
> > > sent
> > > > out)
> > > >
> > > > Rest LGTM.
> > > >
> > > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <ar...@apache.org>
> > > wrote:
> > > >
> > > > > Hi all,
> > > > >
> > > > > please take a look at the draft board report for the last quarter
> and
> > > let
> > > > > me know if you have any comments.
> > > > >
> > > > > Thanks,
> > > > > Arina
> > > > >
> > > > > =====
> > > > >
> > > > >  ## Description:
> > > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> > Cloud
> > > > > Storage.
> > > > >
> > > > > ## Issues:
> > > > >  - There are no issues requiring board attention at this time.
> > > > >
> > > > > ## Activity:
> > > > >  - Since the last board report, Drill has released version 1.14.0,
> > > > >    including the following enhancements:
> > > > > - Drill in a Docket container
> > > > > - Image metadata format plugin
> > > > > - Upgrade to Calcite 1.16.0
> > > > > - Kafka plugin push down support
> > > > > - Phonetic and String functions
> > > > > - Enhanced decimal data support
> > > > > - Spill to disk for the Hash Join support
> > > > > - CGROUPs resource management support
> > > > >  - There were active discussions about schema provision in Drill.
> > > > >    Based on these discussions two projects are currently evolving:
> > > > >    Drill metastore and schema provision in the file and in a query.
> > > > >  - Apache Drill book has been written by two PMC members (Charles
> and
> > > > > Paul).
> > > > >  - Drill developer meet up will be held on November 14, 2019.
> > > > >    The following areas are going to be discussed:
> > > > > - Storage plugins
> > > > > - Schema discovery & Evolution
> > > > > - Metadata Management
> > > > > - Resource management
> > > > > - Integration with Apache Arrow
> > > > >
> > > > > ## Health report:
> > > > >  - The project is healthy. Development activity
> > > > >    as reflected in the pull requests and JIRAs is good.
> > > > >  - Activity on the dev and user mailing lists are stable.
> > > > >  - Three committers and three new PMC member were added in the last
> > > > period.
> > > > >
> > > > > ## PMC changes:
> > > > >
> > > > >  - Currently 23 PMC members.
> > > > >  - New PMC members:
> > > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > > >
> > > > > ## Committer base changes:
> > > > >
> > > > >  - Currently 48 committers.
> > > > >  - New commmitters:
> > > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > > >
> > > > > ## Releases:
> > > > >
> > > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > > >
> > > > > ## Mailing list activity:
> > > > >
> > > > >  - dev@drill.apache.org:
> > > > >     - 427 subscribers (down -6 in the last 3 months):
> > > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > > >
> > > > >  - issues@drill.apache.org:
> > > > >     - 18 subscribers (down -1 in the last 3 months):
> > > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > > >
> > > > >  - user@drill.apache.org:
> > > > >     - 597 subscribers (down -6 in the last 3 months):
> > > > >     - 332 emails sent to list (346 in previous quarter)
> > > > >
> > > > >
> > > > > ## JIRA activity:
> > > > >
> > > > >  - 164 JIRA tickets created in the last 3 months
> > > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > > >
> > > >
> > >
> >
>

Re: November Apache Drill board report

Posted by Arina Ielchiieva <ar...@apache.org>.
Sure, let's mention.
Updated the report.

=====

 ## Description:
 - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
Storage.

## Issues:
 - There are no issues requiring board attention at this time.

## Activity:
 - Since the last board report, Drill has released version 1.14.0,
   including the following enhancements:
- Drill in a Docker container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
- Lateral / Unnest support (disabled by default)
 - There were active discussions about schema provision in Drill.
   Based on these discussions two projects are currently evolving:
   Drill metastore and schema provision in the file and in a query.
 - Apache Drill book has been written by two PMC members (Charles and Paul).
 - Drill developer meet up will be held on November 14, 2018.

   The following areas are going to be discussed:
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow

## Health report:
 - The project is healthy. Development activity
   as reflected in the pull requests and JIRAs is good.
 - Activity on the dev and user mailing lists are stable.
 - Three committers and three new PMC member were added in the last period.

## PMC changes:

 - Currently 23 PMC members.
 - New PMC members:
    - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
    - Charles Givre was added to the PMC on Mon Sep 03 2018
    - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018

## Committer base changes:

 - Currently 48 committers.
 - New commmitters:
    - Chunhui Shi was added as a committer on Thu Sep 27 2018
    - Gautam Parai was added as a committer on Mon Oct 22 2018
    - Weijie Tong was added as a committer on Fri Aug 31 2018

## Releases:

 - 1.14.0 was released on Sat Aug 04 2018

## Mailing list activity:

 - dev@drill.apache.org:
    - 427 subscribers (down -6 in the last 3 months):
    - 2827 emails sent to list (2126 in previous quarter)

 - issues@drill.apache.org:
    - 18 subscribers (down -1 in the last 3 months):
    - 3487 emails sent to list (4769 in previous quarter)

 - user@drill.apache.org:
    - 597 subscribers (down -6 in the last 3 months):
    - 332 emails sent to list (346 in previous quarter)


## JIRA activity:

 - 164 JIRA tickets created in the last 3 months
 - 128 JIRA tickets closed/resolved in the last 3 months



On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <sh...@mapr.com>
wrote:

> Hi Arina,
> Lateral/Unnest feature was part of 1.14 though it was disabled by default.
> Should we mention it as part of 1.14 enhancements in the report?
>
> Thanks,
> Sorabh
>
> On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com>
> wrote:
>
> > Thanks, Aman!  Updated the report.
> > I went too far with 2019, luckily the meet up will be much earlier :)
> >
> > =====
> >
> >  ## Description:
> >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> > Storage.
> >
> > ## Issues:
> >  - There are no issues requiring board attention at this time.
> >
> > ## Activity:
> >  - Since the last board report, Drill has released version 1.14.0,
> >    including the following enhancements:
> > - Drill in a Docker container
> > - Image metadata format plugin
> > - Upgrade to Calcite 1.16.0
> > - Kafka plugin push down support
> > - Phonetic and String functions
> > - Enhanced decimal data support
> > - Spill to disk for the Hash Join support
> > - CGROUPs resource management support
> >  - There were active discussions about schema provision in Drill.
> >    Based on these discussions two projects are currently evolving:
> >    Drill metastore and schema provision in the file and in a query.
> >  - Apache Drill book has been written by two PMC members (Charles and
> > Paul).
> >  - Drill developer meet up will be held on November 14, 2018.
> >    The following areas are going to be discussed:
> > - Storage plugins
> > - Schema discovery & Evolution
> > - Metadata Management
> > - Resource management
> > - Integration with Apache Arrow
> >
> > ## Health report:
> >  - The project is healthy. Development activity
> >    as reflected in the pull requests and JIRAs is good.
> >  - Activity on the dev and user mailing lists are stable.
> >  - Three committers and three new PMC member were added in the last
> period.
> >
> > ## PMC changes:
> >
> >  - Currently 23 PMC members.
> >  - New PMC members:
> >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> >
> > ## Committer base changes:
> >
> >  - Currently 48 committers.
> >  - New commmitters:
> >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> >
> > ## Releases:
> >
> >  - 1.14.0 was released on Sat Aug 04 2018
> >
> > ## Mailing list activity:
> >
> >  - dev@drill.apache.org:
> >     - 427 subscribers (down -6 in the last 3 months):
> >     - 2827 emails sent to list (2126 in previous quarter)
> >
> >  - issues@drill.apache.org:
> >     - 18 subscribers (down -1 in the last 3 months):
> >     - 3487 emails sent to list (4769 in previous quarter)
> >
> >  - user@drill.apache.org:
> >     - 597 subscribers (down -6 in the last 3 months):
> >     - 332 emails sent to list (346 in previous quarter)
> >
> >
> > ## JIRA activity:
> >
> >  - 164 JIRA tickets created in the last 3 months
> >  - 128 JIRA tickets closed/resolved in the last 3 months
> >
> > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org> wrote:
> >
> > >    Docket container  ==> 'Docker'
> > >    November 14, 2019  ==>  2018  :)   (this is wrong in email that was
> > sent
> > > out)
> > >
> > > Rest LGTM.
> > >
> > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <ar...@apache.org>
> > wrote:
> > >
> > > > Hi all,
> > > >
> > > > please take a look at the draft board report for the last quarter and
> > let
> > > > me know if you have any comments.
> > > >
> > > > Thanks,
> > > > Arina
> > > >
> > > > =====
> > > >
> > > >  ## Description:
> > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> Cloud
> > > > Storage.
> > > >
> > > > ## Issues:
> > > >  - There are no issues requiring board attention at this time.
> > > >
> > > > ## Activity:
> > > >  - Since the last board report, Drill has released version 1.14.0,
> > > >    including the following enhancements:
> > > > - Drill in a Docket container
> > > > - Image metadata format plugin
> > > > - Upgrade to Calcite 1.16.0
> > > > - Kafka plugin push down support
> > > > - Phonetic and String functions
> > > > - Enhanced decimal data support
> > > > - Spill to disk for the Hash Join support
> > > > - CGROUPs resource management support
> > > >  - There were active discussions about schema provision in Drill.
> > > >    Based on these discussions two projects are currently evolving:
> > > >    Drill metastore and schema provision in the file and in a query.
> > > >  - Apache Drill book has been written by two PMC members (Charles and
> > > > Paul).
> > > >  - Drill developer meet up will be held on November 14, 2019.
> > > >    The following areas are going to be discussed:
> > > > - Storage plugins
> > > > - Schema discovery & Evolution
> > > > - Metadata Management
> > > > - Resource management
> > > > - Integration with Apache Arrow
> > > >
> > > > ## Health report:
> > > >  - The project is healthy. Development activity
> > > >    as reflected in the pull requests and JIRAs is good.
> > > >  - Activity on the dev and user mailing lists are stable.
> > > >  - Three committers and three new PMC member were added in the last
> > > period.
> > > >
> > > > ## PMC changes:
> > > >
> > > >  - Currently 23 PMC members.
> > > >  - New PMC members:
> > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > >
> > > > ## Committer base changes:
> > > >
> > > >  - Currently 48 committers.
> > > >  - New commmitters:
> > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > >
> > > > ## Releases:
> > > >
> > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > >
> > > > ## Mailing list activity:
> > > >
> > > >  - dev@drill.apache.org:
> > > >     - 427 subscribers (down -6 in the last 3 months):
> > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > >
> > > >  - issues@drill.apache.org:
> > > >     - 18 subscribers (down -1 in the last 3 months):
> > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > >
> > > >  - user@drill.apache.org:
> > > >     - 597 subscribers (down -6 in the last 3 months):
> > > >     - 332 emails sent to list (346 in previous quarter)
> > > >
> > > >
> > > > ## JIRA activity:
> > > >
> > > >  - 164 JIRA tickets created in the last 3 months
> > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > >
> > >
> >
>

Re: November Apache Drill board report

Posted by Arina Ielchiieva <ar...@apache.org>.
Sure, let's mention.
Updated the report.

=====

 ## Description:
 - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
Storage.

## Issues:
 - There are no issues requiring board attention at this time.

## Activity:
 - Since the last board report, Drill has released version 1.14.0,
   including the following enhancements:
- Drill in a Docker container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
- Lateral / Unnest support (disabled by default)
 - There were active discussions about schema provision in Drill.
   Based on these discussions two projects are currently evolving:
   Drill metastore and schema provision in the file and in a query.
 - Apache Drill book has been written by two PMC members (Charles and Paul).
 - Drill developer meet up will be held on November 14, 2018.

   The following areas are going to be discussed:
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow

## Health report:
 - The project is healthy. Development activity
   as reflected in the pull requests and JIRAs is good.
 - Activity on the dev and user mailing lists are stable.
 - Three committers and three new PMC member were added in the last period.

## PMC changes:

 - Currently 23 PMC members.
 - New PMC members:
    - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
    - Charles Givre was added to the PMC on Mon Sep 03 2018
    - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018

## Committer base changes:

 - Currently 48 committers.
 - New commmitters:
    - Chunhui Shi was added as a committer on Thu Sep 27 2018
    - Gautam Parai was added as a committer on Mon Oct 22 2018
    - Weijie Tong was added as a committer on Fri Aug 31 2018

## Releases:

 - 1.14.0 was released on Sat Aug 04 2018

## Mailing list activity:

 - dev@drill.apache.org:
    - 427 subscribers (down -6 in the last 3 months):
    - 2827 emails sent to list (2126 in previous quarter)

 - issues@drill.apache.org:
    - 18 subscribers (down -1 in the last 3 months):
    - 3487 emails sent to list (4769 in previous quarter)

 - user@drill.apache.org:
    - 597 subscribers (down -6 in the last 3 months):
    - 332 emails sent to list (346 in previous quarter)


## JIRA activity:

 - 164 JIRA tickets created in the last 3 months
 - 128 JIRA tickets closed/resolved in the last 3 months



On Fri, Nov 2, 2018 at 12:25 AM Sorabh Hamirwasia <sh...@mapr.com>
wrote:

> Hi Arina,
> Lateral/Unnest feature was part of 1.14 though it was disabled by default.
> Should we mention it as part of 1.14 enhancements in the report?
>
> Thanks,
> Sorabh
>
> On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com>
> wrote:
>
> > Thanks, Aman!  Updated the report.
> > I went too far with 2019, luckily the meet up will be much earlier :)
> >
> > =====
> >
> >  ## Description:
> >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> > Storage.
> >
> > ## Issues:
> >  - There are no issues requiring board attention at this time.
> >
> > ## Activity:
> >  - Since the last board report, Drill has released version 1.14.0,
> >    including the following enhancements:
> > - Drill in a Docker container
> > - Image metadata format plugin
> > - Upgrade to Calcite 1.16.0
> > - Kafka plugin push down support
> > - Phonetic and String functions
> > - Enhanced decimal data support
> > - Spill to disk for the Hash Join support
> > - CGROUPs resource management support
> >  - There were active discussions about schema provision in Drill.
> >    Based on these discussions two projects are currently evolving:
> >    Drill metastore and schema provision in the file and in a query.
> >  - Apache Drill book has been written by two PMC members (Charles and
> > Paul).
> >  - Drill developer meet up will be held on November 14, 2018.
> >    The following areas are going to be discussed:
> > - Storage plugins
> > - Schema discovery & Evolution
> > - Metadata Management
> > - Resource management
> > - Integration with Apache Arrow
> >
> > ## Health report:
> >  - The project is healthy. Development activity
> >    as reflected in the pull requests and JIRAs is good.
> >  - Activity on the dev and user mailing lists are stable.
> >  - Three committers and three new PMC member were added in the last
> period.
> >
> > ## PMC changes:
> >
> >  - Currently 23 PMC members.
> >  - New PMC members:
> >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> >
> > ## Committer base changes:
> >
> >  - Currently 48 committers.
> >  - New commmitters:
> >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> >
> > ## Releases:
> >
> >  - 1.14.0 was released on Sat Aug 04 2018
> >
> > ## Mailing list activity:
> >
> >  - dev@drill.apache.org:
> >     - 427 subscribers (down -6 in the last 3 months):
> >     - 2827 emails sent to list (2126 in previous quarter)
> >
> >  - issues@drill.apache.org:
> >     - 18 subscribers (down -1 in the last 3 months):
> >     - 3487 emails sent to list (4769 in previous quarter)
> >
> >  - user@drill.apache.org:
> >     - 597 subscribers (down -6 in the last 3 months):
> >     - 332 emails sent to list (346 in previous quarter)
> >
> >
> > ## JIRA activity:
> >
> >  - 164 JIRA tickets created in the last 3 months
> >  - 128 JIRA tickets closed/resolved in the last 3 months
> >
> > On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org> wrote:
> >
> > >    Docket container  ==> 'Docker'
> > >    November 14, 2019  ==>  2018  :)   (this is wrong in email that was
> > sent
> > > out)
> > >
> > > Rest LGTM.
> > >
> > > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <ar...@apache.org>
> > wrote:
> > >
> > > > Hi all,
> > > >
> > > > please take a look at the draft board report for the last quarter and
> > let
> > > > me know if you have any comments.
> > > >
> > > > Thanks,
> > > > Arina
> > > >
> > > > =====
> > > >
> > > >  ## Description:
> > > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and
> Cloud
> > > > Storage.
> > > >
> > > > ## Issues:
> > > >  - There are no issues requiring board attention at this time.
> > > >
> > > > ## Activity:
> > > >  - Since the last board report, Drill has released version 1.14.0,
> > > >    including the following enhancements:
> > > > - Drill in a Docket container
> > > > - Image metadata format plugin
> > > > - Upgrade to Calcite 1.16.0
> > > > - Kafka plugin push down support
> > > > - Phonetic and String functions
> > > > - Enhanced decimal data support
> > > > - Spill to disk for the Hash Join support
> > > > - CGROUPs resource management support
> > > >  - There were active discussions about schema provision in Drill.
> > > >    Based on these discussions two projects are currently evolving:
> > > >    Drill metastore and schema provision in the file and in a query.
> > > >  - Apache Drill book has been written by two PMC members (Charles and
> > > > Paul).
> > > >  - Drill developer meet up will be held on November 14, 2019.
> > > >    The following areas are going to be discussed:
> > > > - Storage plugins
> > > > - Schema discovery & Evolution
> > > > - Metadata Management
> > > > - Resource management
> > > > - Integration with Apache Arrow
> > > >
> > > > ## Health report:
> > > >  - The project is healthy. Development activity
> > > >    as reflected in the pull requests and JIRAs is good.
> > > >  - Activity on the dev and user mailing lists are stable.
> > > >  - Three committers and three new PMC member were added in the last
> > > period.
> > > >
> > > > ## PMC changes:
> > > >
> > > >  - Currently 23 PMC members.
> > > >  - New PMC members:
> > > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > > >
> > > > ## Committer base changes:
> > > >
> > > >  - Currently 48 committers.
> > > >  - New commmitters:
> > > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > > >
> > > > ## Releases:
> > > >
> > > >  - 1.14.0 was released on Sat Aug 04 2018
> > > >
> > > > ## Mailing list activity:
> > > >
> > > >  - dev@drill.apache.org:
> > > >     - 427 subscribers (down -6 in the last 3 months):
> > > >     - 2827 emails sent to list (2126 in previous quarter)
> > > >
> > > >  - issues@drill.apache.org:
> > > >     - 18 subscribers (down -1 in the last 3 months):
> > > >     - 3487 emails sent to list (4769 in previous quarter)
> > > >
> > > >  - user@drill.apache.org:
> > > >     - 597 subscribers (down -6 in the last 3 months):
> > > >     - 332 emails sent to list (346 in previous quarter)
> > > >
> > > >
> > > > ## JIRA activity:
> > > >
> > > >  - 164 JIRA tickets created in the last 3 months
> > > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > > >
> > >
> >
>

Re: November Apache Drill board report

Posted by Sorabh Hamirwasia <sh...@mapr.com>.
Hi Arina,
Lateral/Unnest feature was part of 1.14 though it was disabled by default.
Should we mention it as part of 1.14 enhancements in the report?

Thanks,
Sorabh

On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <ar...@gmail.com>
wrote:

> Thanks, Aman!  Updated the report.
> I went too far with 2019, luckily the meet up will be much earlier :)
>
> =====
>
>  ## Description:
>  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> Storage.
>
> ## Issues:
>  - There are no issues requiring board attention at this time.
>
> ## Activity:
>  - Since the last board report, Drill has released version 1.14.0,
>    including the following enhancements:
> - Drill in a Docker container
> - Image metadata format plugin
> - Upgrade to Calcite 1.16.0
> - Kafka plugin push down support
> - Phonetic and String functions
> - Enhanced decimal data support
> - Spill to disk for the Hash Join support
> - CGROUPs resource management support
>  - There were active discussions about schema provision in Drill.
>    Based on these discussions two projects are currently evolving:
>    Drill metastore and schema provision in the file and in a query.
>  - Apache Drill book has been written by two PMC members (Charles and
> Paul).
>  - Drill developer meet up will be held on November 14, 2018.
>    The following areas are going to be discussed:
> - Storage plugins
> - Schema discovery & Evolution
> - Metadata Management
> - Resource management
> - Integration with Apache Arrow
>
> ## Health report:
>  - The project is healthy. Development activity
>    as reflected in the pull requests and JIRAs is good.
>  - Activity on the dev and user mailing lists are stable.
>  - Three committers and three new PMC member were added in the last period.
>
> ## PMC changes:
>
>  - Currently 23 PMC members.
>  - New PMC members:
>     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
>     - Charles Givre was added to the PMC on Mon Sep 03 2018
>     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
>
> ## Committer base changes:
>
>  - Currently 48 committers.
>  - New commmitters:
>     - Chunhui Shi was added as a committer on Thu Sep 27 2018
>     - Gautam Parai was added as a committer on Mon Oct 22 2018
>     - Weijie Tong was added as a committer on Fri Aug 31 2018
>
> ## Releases:
>
>  - 1.14.0 was released on Sat Aug 04 2018
>
> ## Mailing list activity:
>
>  - dev@drill.apache.org:
>     - 427 subscribers (down -6 in the last 3 months):
>     - 2827 emails sent to list (2126 in previous quarter)
>
>  - issues@drill.apache.org:
>     - 18 subscribers (down -1 in the last 3 months):
>     - 3487 emails sent to list (4769 in previous quarter)
>
>  - user@drill.apache.org:
>     - 597 subscribers (down -6 in the last 3 months):
>     - 332 emails sent to list (346 in previous quarter)
>
>
> ## JIRA activity:
>
>  - 164 JIRA tickets created in the last 3 months
>  - 128 JIRA tickets closed/resolved in the last 3 months
>
> On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org> wrote:
>
> >    Docket container  ==> 'Docker'
> >    November 14, 2019  ==>  2018  :)   (this is wrong in email that was
> sent
> > out)
> >
> > Rest LGTM.
> >
> > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <ar...@apache.org>
> wrote:
> >
> > > Hi all,
> > >
> > > please take a look at the draft board report for the last quarter and
> let
> > > me know if you have any comments.
> > >
> > > Thanks,
> > > Arina
> > >
> > > =====
> > >
> > >  ## Description:
> > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> > > Storage.
> > >
> > > ## Issues:
> > >  - There are no issues requiring board attention at this time.
> > >
> > > ## Activity:
> > >  - Since the last board report, Drill has released version 1.14.0,
> > >    including the following enhancements:
> > > - Drill in a Docket container
> > > - Image metadata format plugin
> > > - Upgrade to Calcite 1.16.0
> > > - Kafka plugin push down support
> > > - Phonetic and String functions
> > > - Enhanced decimal data support
> > > - Spill to disk for the Hash Join support
> > > - CGROUPs resource management support
> > >  - There were active discussions about schema provision in Drill.
> > >    Based on these discussions two projects are currently evolving:
> > >    Drill metastore and schema provision in the file and in a query.
> > >  - Apache Drill book has been written by two PMC members (Charles and
> > > Paul).
> > >  - Drill developer meet up will be held on November 14, 2019.
> > >    The following areas are going to be discussed:
> > > - Storage plugins
> > > - Schema discovery & Evolution
> > > - Metadata Management
> > > - Resource management
> > > - Integration with Apache Arrow
> > >
> > > ## Health report:
> > >  - The project is healthy. Development activity
> > >    as reflected in the pull requests and JIRAs is good.
> > >  - Activity on the dev and user mailing lists are stable.
> > >  - Three committers and three new PMC member were added in the last
> > period.
> > >
> > > ## PMC changes:
> > >
> > >  - Currently 23 PMC members.
> > >  - New PMC members:
> > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > >
> > > ## Committer base changes:
> > >
> > >  - Currently 48 committers.
> > >  - New commmitters:
> > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > >
> > > ## Releases:
> > >
> > >  - 1.14.0 was released on Sat Aug 04 2018
> > >
> > > ## Mailing list activity:
> > >
> > >  - dev@drill.apache.org:
> > >     - 427 subscribers (down -6 in the last 3 months):
> > >     - 2827 emails sent to list (2126 in previous quarter)
> > >
> > >  - issues@drill.apache.org:
> > >     - 18 subscribers (down -1 in the last 3 months):
> > >     - 3487 emails sent to list (4769 in previous quarter)
> > >
> > >  - user@drill.apache.org:
> > >     - 597 subscribers (down -6 in the last 3 months):
> > >     - 332 emails sent to list (346 in previous quarter)
> > >
> > >
> > > ## JIRA activity:
> > >
> > >  - 164 JIRA tickets created in the last 3 months
> > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > >
> >
>

Re: November Apache Drill board report

Posted by Sorabh Hamirwasia <sh...@mapr.com>.
Hi Arina,
Lateral/Unnest feature was part of 1.14 though it was disabled by default.
Should we mention it as part of 1.14 enhancements in the report?

Thanks,
Sorabh

On Thu, Nov 1, 2018 at 9:29 AM Arina Yelchiyeva <ar...@gmail.com>
wrote:

> Thanks, Aman!  Updated the report.
> I went too far with 2019, luckily the meet up will be much earlier :)
>
> =====
>
>  ## Description:
>  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> Storage.
>
> ## Issues:
>  - There are no issues requiring board attention at this time.
>
> ## Activity:
>  - Since the last board report, Drill has released version 1.14.0,
>    including the following enhancements:
> - Drill in a Docker container
> - Image metadata format plugin
> - Upgrade to Calcite 1.16.0
> - Kafka plugin push down support
> - Phonetic and String functions
> - Enhanced decimal data support
> - Spill to disk for the Hash Join support
> - CGROUPs resource management support
>  - There were active discussions about schema provision in Drill.
>    Based on these discussions two projects are currently evolving:
>    Drill metastore and schema provision in the file and in a query.
>  - Apache Drill book has been written by two PMC members (Charles and
> Paul).
>  - Drill developer meet up will be held on November 14, 2018.
>    The following areas are going to be discussed:
> - Storage plugins
> - Schema discovery & Evolution
> - Metadata Management
> - Resource management
> - Integration with Apache Arrow
>
> ## Health report:
>  - The project is healthy. Development activity
>    as reflected in the pull requests and JIRAs is good.
>  - Activity on the dev and user mailing lists are stable.
>  - Three committers and three new PMC member were added in the last period.
>
> ## PMC changes:
>
>  - Currently 23 PMC members.
>  - New PMC members:
>     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
>     - Charles Givre was added to the PMC on Mon Sep 03 2018
>     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
>
> ## Committer base changes:
>
>  - Currently 48 committers.
>  - New commmitters:
>     - Chunhui Shi was added as a committer on Thu Sep 27 2018
>     - Gautam Parai was added as a committer on Mon Oct 22 2018
>     - Weijie Tong was added as a committer on Fri Aug 31 2018
>
> ## Releases:
>
>  - 1.14.0 was released on Sat Aug 04 2018
>
> ## Mailing list activity:
>
>  - dev@drill.apache.org:
>     - 427 subscribers (down -6 in the last 3 months):
>     - 2827 emails sent to list (2126 in previous quarter)
>
>  - issues@drill.apache.org:
>     - 18 subscribers (down -1 in the last 3 months):
>     - 3487 emails sent to list (4769 in previous quarter)
>
>  - user@drill.apache.org:
>     - 597 subscribers (down -6 in the last 3 months):
>     - 332 emails sent to list (346 in previous quarter)
>
>
> ## JIRA activity:
>
>  - 164 JIRA tickets created in the last 3 months
>  - 128 JIRA tickets closed/resolved in the last 3 months
>
> On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org> wrote:
>
> >    Docket container  ==> 'Docker'
> >    November 14, 2019  ==>  2018  :)   (this is wrong in email that was
> sent
> > out)
> >
> > Rest LGTM.
> >
> > On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <ar...@apache.org>
> wrote:
> >
> > > Hi all,
> > >
> > > please take a look at the draft board report for the last quarter and
> let
> > > me know if you have any comments.
> > >
> > > Thanks,
> > > Arina
> > >
> > > =====
> > >
> > >  ## Description:
> > >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> > > Storage.
> > >
> > > ## Issues:
> > >  - There are no issues requiring board attention at this time.
> > >
> > > ## Activity:
> > >  - Since the last board report, Drill has released version 1.14.0,
> > >    including the following enhancements:
> > > - Drill in a Docket container
> > > - Image metadata format plugin
> > > - Upgrade to Calcite 1.16.0
> > > - Kafka plugin push down support
> > > - Phonetic and String functions
> > > - Enhanced decimal data support
> > > - Spill to disk for the Hash Join support
> > > - CGROUPs resource management support
> > >  - There were active discussions about schema provision in Drill.
> > >    Based on these discussions two projects are currently evolving:
> > >    Drill metastore and schema provision in the file and in a query.
> > >  - Apache Drill book has been written by two PMC members (Charles and
> > > Paul).
> > >  - Drill developer meet up will be held on November 14, 2019.
> > >    The following areas are going to be discussed:
> > > - Storage plugins
> > > - Schema discovery & Evolution
> > > - Metadata Management
> > > - Resource management
> > > - Integration with Apache Arrow
> > >
> > > ## Health report:
> > >  - The project is healthy. Development activity
> > >    as reflected in the pull requests and JIRAs is good.
> > >  - Activity on the dev and user mailing lists are stable.
> > >  - Three committers and three new PMC member were added in the last
> > period.
> > >
> > > ## PMC changes:
> > >
> > >  - Currently 23 PMC members.
> > >  - New PMC members:
> > >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> > >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> > >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> > >
> > > ## Committer base changes:
> > >
> > >  - Currently 48 committers.
> > >  - New commmitters:
> > >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> > >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> > >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> > >
> > > ## Releases:
> > >
> > >  - 1.14.0 was released on Sat Aug 04 2018
> > >
> > > ## Mailing list activity:
> > >
> > >  - dev@drill.apache.org:
> > >     - 427 subscribers (down -6 in the last 3 months):
> > >     - 2827 emails sent to list (2126 in previous quarter)
> > >
> > >  - issues@drill.apache.org:
> > >     - 18 subscribers (down -1 in the last 3 months):
> > >     - 3487 emails sent to list (4769 in previous quarter)
> > >
> > >  - user@drill.apache.org:
> > >     - 597 subscribers (down -6 in the last 3 months):
> > >     - 332 emails sent to list (346 in previous quarter)
> > >
> > >
> > > ## JIRA activity:
> > >
> > >  - 164 JIRA tickets created in the last 3 months
> > >  - 128 JIRA tickets closed/resolved in the last 3 months
> > >
> >
>

Re: November Apache Drill board report

Posted by Arina Yelchiyeva <ar...@gmail.com>.
Thanks, Aman!  Updated the report.
I went too far with 2019, luckily the meet up will be much earlier :)

=====

 ## Description:
 - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
Storage.

## Issues:
 - There are no issues requiring board attention at this time.

## Activity:
 - Since the last board report, Drill has released version 1.14.0,
   including the following enhancements:
- Drill in a Docker container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
 - There were active discussions about schema provision in Drill.
   Based on these discussions two projects are currently evolving:
   Drill metastore and schema provision in the file and in a query.
 - Apache Drill book has been written by two PMC members (Charles and Paul).
 - Drill developer meet up will be held on November 14, 2018.
   The following areas are going to be discussed:
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow

## Health report:
 - The project is healthy. Development activity
   as reflected in the pull requests and JIRAs is good.
 - Activity on the dev and user mailing lists are stable.
 - Three committers and three new PMC member were added in the last period.

## PMC changes:

 - Currently 23 PMC members.
 - New PMC members:
    - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
    - Charles Givre was added to the PMC on Mon Sep 03 2018
    - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018

## Committer base changes:

 - Currently 48 committers.
 - New commmitters:
    - Chunhui Shi was added as a committer on Thu Sep 27 2018
    - Gautam Parai was added as a committer on Mon Oct 22 2018
    - Weijie Tong was added as a committer on Fri Aug 31 2018

## Releases:

 - 1.14.0 was released on Sat Aug 04 2018

## Mailing list activity:

 - dev@drill.apache.org:
    - 427 subscribers (down -6 in the last 3 months):
    - 2827 emails sent to list (2126 in previous quarter)

 - issues@drill.apache.org:
    - 18 subscribers (down -1 in the last 3 months):
    - 3487 emails sent to list (4769 in previous quarter)

 - user@drill.apache.org:
    - 597 subscribers (down -6 in the last 3 months):
    - 332 emails sent to list (346 in previous quarter)


## JIRA activity:

 - 164 JIRA tickets created in the last 3 months
 - 128 JIRA tickets closed/resolved in the last 3 months

On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org> wrote:

>    Docket container  ==> 'Docker'
>    November 14, 2019  ==>  2018  :)   (this is wrong in email that was sent
> out)
>
> Rest LGTM.
>
> On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <ar...@apache.org> wrote:
>
> > Hi all,
> >
> > please take a look at the draft board report for the last quarter and let
> > me know if you have any comments.
> >
> > Thanks,
> > Arina
> >
> > =====
> >
> >  ## Description:
> >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> > Storage.
> >
> > ## Issues:
> >  - There are no issues requiring board attention at this time.
> >
> > ## Activity:
> >  - Since the last board report, Drill has released version 1.14.0,
> >    including the following enhancements:
> > - Drill in a Docket container
> > - Image metadata format plugin
> > - Upgrade to Calcite 1.16.0
> > - Kafka plugin push down support
> > - Phonetic and String functions
> > - Enhanced decimal data support
> > - Spill to disk for the Hash Join support
> > - CGROUPs resource management support
> >  - There were active discussions about schema provision in Drill.
> >    Based on these discussions two projects are currently evolving:
> >    Drill metastore and schema provision in the file and in a query.
> >  - Apache Drill book has been written by two PMC members (Charles and
> > Paul).
> >  - Drill developer meet up will be held on November 14, 2019.
> >    The following areas are going to be discussed:
> > - Storage plugins
> > - Schema discovery & Evolution
> > - Metadata Management
> > - Resource management
> > - Integration with Apache Arrow
> >
> > ## Health report:
> >  - The project is healthy. Development activity
> >    as reflected in the pull requests and JIRAs is good.
> >  - Activity on the dev and user mailing lists are stable.
> >  - Three committers and three new PMC member were added in the last
> period.
> >
> > ## PMC changes:
> >
> >  - Currently 23 PMC members.
> >  - New PMC members:
> >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> >
> > ## Committer base changes:
> >
> >  - Currently 48 committers.
> >  - New commmitters:
> >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> >
> > ## Releases:
> >
> >  - 1.14.0 was released on Sat Aug 04 2018
> >
> > ## Mailing list activity:
> >
> >  - dev@drill.apache.org:
> >     - 427 subscribers (down -6 in the last 3 months):
> >     - 2827 emails sent to list (2126 in previous quarter)
> >
> >  - issues@drill.apache.org:
> >     - 18 subscribers (down -1 in the last 3 months):
> >     - 3487 emails sent to list (4769 in previous quarter)
> >
> >  - user@drill.apache.org:
> >     - 597 subscribers (down -6 in the last 3 months):
> >     - 332 emails sent to list (346 in previous quarter)
> >
> >
> > ## JIRA activity:
> >
> >  - 164 JIRA tickets created in the last 3 months
> >  - 128 JIRA tickets closed/resolved in the last 3 months
> >
>

Re: November Apache Drill board report

Posted by Arina Yelchiyeva <ar...@gmail.com>.
Thanks, Aman!  Updated the report.
I went too far with 2019, luckily the meet up will be much earlier :)

=====

 ## Description:
 - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
Storage.

## Issues:
 - There are no issues requiring board attention at this time.

## Activity:
 - Since the last board report, Drill has released version 1.14.0,
   including the following enhancements:
- Drill in a Docker container
- Image metadata format plugin
- Upgrade to Calcite 1.16.0
- Kafka plugin push down support
- Phonetic and String functions
- Enhanced decimal data support
- Spill to disk for the Hash Join support
- CGROUPs resource management support
 - There were active discussions about schema provision in Drill.
   Based on these discussions two projects are currently evolving:
   Drill metastore and schema provision in the file and in a query.
 - Apache Drill book has been written by two PMC members (Charles and Paul).
 - Drill developer meet up will be held on November 14, 2018.
   The following areas are going to be discussed:
- Storage plugins
- Schema discovery & Evolution
- Metadata Management
- Resource management
- Integration with Apache Arrow

## Health report:
 - The project is healthy. Development activity
   as reflected in the pull requests and JIRAs is good.
 - Activity on the dev and user mailing lists are stable.
 - Three committers and three new PMC member were added in the last period.

## PMC changes:

 - Currently 23 PMC members.
 - New PMC members:
    - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
    - Charles Givre was added to the PMC on Mon Sep 03 2018
    - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018

## Committer base changes:

 - Currently 48 committers.
 - New commmitters:
    - Chunhui Shi was added as a committer on Thu Sep 27 2018
    - Gautam Parai was added as a committer on Mon Oct 22 2018
    - Weijie Tong was added as a committer on Fri Aug 31 2018

## Releases:

 - 1.14.0 was released on Sat Aug 04 2018

## Mailing list activity:

 - dev@drill.apache.org:
    - 427 subscribers (down -6 in the last 3 months):
    - 2827 emails sent to list (2126 in previous quarter)

 - issues@drill.apache.org:
    - 18 subscribers (down -1 in the last 3 months):
    - 3487 emails sent to list (4769 in previous quarter)

 - user@drill.apache.org:
    - 597 subscribers (down -6 in the last 3 months):
    - 332 emails sent to list (346 in previous quarter)


## JIRA activity:

 - 164 JIRA tickets created in the last 3 months
 - 128 JIRA tickets closed/resolved in the last 3 months

On Thu, Nov 1, 2018 at 6:20 PM Aman Sinha <am...@apache.org> wrote:

>    Docket container  ==> 'Docker'
>    November 14, 2019  ==>  2018  :)   (this is wrong in email that was sent
> out)
>
> Rest LGTM.
>
> On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <ar...@apache.org> wrote:
>
> > Hi all,
> >
> > please take a look at the draft board report for the last quarter and let
> > me know if you have any comments.
> >
> > Thanks,
> > Arina
> >
> > =====
> >
> >  ## Description:
> >  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> > Storage.
> >
> > ## Issues:
> >  - There are no issues requiring board attention at this time.
> >
> > ## Activity:
> >  - Since the last board report, Drill has released version 1.14.0,
> >    including the following enhancements:
> > - Drill in a Docket container
> > - Image metadata format plugin
> > - Upgrade to Calcite 1.16.0
> > - Kafka plugin push down support
> > - Phonetic and String functions
> > - Enhanced decimal data support
> > - Spill to disk for the Hash Join support
> > - CGROUPs resource management support
> >  - There were active discussions about schema provision in Drill.
> >    Based on these discussions two projects are currently evolving:
> >    Drill metastore and schema provision in the file and in a query.
> >  - Apache Drill book has been written by two PMC members (Charles and
> > Paul).
> >  - Drill developer meet up will be held on November 14, 2019.
> >    The following areas are going to be discussed:
> > - Storage plugins
> > - Schema discovery & Evolution
> > - Metadata Management
> > - Resource management
> > - Integration with Apache Arrow
> >
> > ## Health report:
> >  - The project is healthy. Development activity
> >    as reflected in the pull requests and JIRAs is good.
> >  - Activity on the dev and user mailing lists are stable.
> >  - Three committers and three new PMC member were added in the last
> period.
> >
> > ## PMC changes:
> >
> >  - Currently 23 PMC members.
> >  - New PMC members:
> >     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
> >     - Charles Givre was added to the PMC on Mon Sep 03 2018
> >     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
> >
> > ## Committer base changes:
> >
> >  - Currently 48 committers.
> >  - New commmitters:
> >     - Chunhui Shi was added as a committer on Thu Sep 27 2018
> >     - Gautam Parai was added as a committer on Mon Oct 22 2018
> >     - Weijie Tong was added as a committer on Fri Aug 31 2018
> >
> > ## Releases:
> >
> >  - 1.14.0 was released on Sat Aug 04 2018
> >
> > ## Mailing list activity:
> >
> >  - dev@drill.apache.org:
> >     - 427 subscribers (down -6 in the last 3 months):
> >     - 2827 emails sent to list (2126 in previous quarter)
> >
> >  - issues@drill.apache.org:
> >     - 18 subscribers (down -1 in the last 3 months):
> >     - 3487 emails sent to list (4769 in previous quarter)
> >
> >  - user@drill.apache.org:
> >     - 597 subscribers (down -6 in the last 3 months):
> >     - 332 emails sent to list (346 in previous quarter)
> >
> >
> > ## JIRA activity:
> >
> >  - 164 JIRA tickets created in the last 3 months
> >  - 128 JIRA tickets closed/resolved in the last 3 months
> >
>

Re: November Apache Drill board report

Posted by Aman Sinha <am...@apache.org>.
   Docket container  ==> 'Docker'
   November 14, 2019  ==>  2018  :)   (this is wrong in email that was sent
out)

Rest LGTM.

On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <ar...@apache.org> wrote:

> Hi all,
>
> please take a look at the draft board report for the last quarter and let
> me know if you have any comments.
>
> Thanks,
> Arina
>
> =====
>
>  ## Description:
>  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> Storage.
>
> ## Issues:
>  - There are no issues requiring board attention at this time.
>
> ## Activity:
>  - Since the last board report, Drill has released version 1.14.0,
>    including the following enhancements:
> - Drill in a Docket container
> - Image metadata format plugin
> - Upgrade to Calcite 1.16.0
> - Kafka plugin push down support
> - Phonetic and String functions
> - Enhanced decimal data support
> - Spill to disk for the Hash Join support
> - CGROUPs resource management support
>  - There were active discussions about schema provision in Drill.
>    Based on these discussions two projects are currently evolving:
>    Drill metastore and schema provision in the file and in a query.
>  - Apache Drill book has been written by two PMC members (Charles and
> Paul).
>  - Drill developer meet up will be held on November 14, 2019.
>    The following areas are going to be discussed:
> - Storage plugins
> - Schema discovery & Evolution
> - Metadata Management
> - Resource management
> - Integration with Apache Arrow
>
> ## Health report:
>  - The project is healthy. Development activity
>    as reflected in the pull requests and JIRAs is good.
>  - Activity on the dev and user mailing lists are stable.
>  - Three committers and three new PMC member were added in the last period.
>
> ## PMC changes:
>
>  - Currently 23 PMC members.
>  - New PMC members:
>     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
>     - Charles Givre was added to the PMC on Mon Sep 03 2018
>     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
>
> ## Committer base changes:
>
>  - Currently 48 committers.
>  - New commmitters:
>     - Chunhui Shi was added as a committer on Thu Sep 27 2018
>     - Gautam Parai was added as a committer on Mon Oct 22 2018
>     - Weijie Tong was added as a committer on Fri Aug 31 2018
>
> ## Releases:
>
>  - 1.14.0 was released on Sat Aug 04 2018
>
> ## Mailing list activity:
>
>  - dev@drill.apache.org:
>     - 427 subscribers (down -6 in the last 3 months):
>     - 2827 emails sent to list (2126 in previous quarter)
>
>  - issues@drill.apache.org:
>     - 18 subscribers (down -1 in the last 3 months):
>     - 3487 emails sent to list (4769 in previous quarter)
>
>  - user@drill.apache.org:
>     - 597 subscribers (down -6 in the last 3 months):
>     - 332 emails sent to list (346 in previous quarter)
>
>
> ## JIRA activity:
>
>  - 164 JIRA tickets created in the last 3 months
>  - 128 JIRA tickets closed/resolved in the last 3 months
>

Re: November Apache Drill board report

Posted by Aman Sinha <am...@apache.org>.
   Docket container  ==> 'Docker'
   November 14, 2019  ==>  2018  :)   (this is wrong in email that was sent
out)

Rest LGTM.

On Thu, Nov 1, 2018 at 6:42 AM Arina Ielchiieva <ar...@apache.org> wrote:

> Hi all,
>
> please take a look at the draft board report for the last quarter and let
> me know if you have any comments.
>
> Thanks,
> Arina
>
> =====
>
>  ## Description:
>  - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud
> Storage.
>
> ## Issues:
>  - There are no issues requiring board attention at this time.
>
> ## Activity:
>  - Since the last board report, Drill has released version 1.14.0,
>    including the following enhancements:
> - Drill in a Docket container
> - Image metadata format plugin
> - Upgrade to Calcite 1.16.0
> - Kafka plugin push down support
> - Phonetic and String functions
> - Enhanced decimal data support
> - Spill to disk for the Hash Join support
> - CGROUPs resource management support
>  - There were active discussions about schema provision in Drill.
>    Based on these discussions two projects are currently evolving:
>    Drill metastore and schema provision in the file and in a query.
>  - Apache Drill book has been written by two PMC members (Charles and
> Paul).
>  - Drill developer meet up will be held on November 14, 2019.
>    The following areas are going to be discussed:
> - Storage plugins
> - Schema discovery & Evolution
> - Metadata Management
> - Resource management
> - Integration with Apache Arrow
>
> ## Health report:
>  - The project is healthy. Development activity
>    as reflected in the pull requests and JIRAs is good.
>  - Activity on the dev and user mailing lists are stable.
>  - Three committers and three new PMC member were added in the last period.
>
> ## PMC changes:
>
>  - Currently 23 PMC members.
>  - New PMC members:
>     - Boaz Ben-Zvi was added to the PMC on Fri Aug 17 2018
>     - Charles Givre was added to the PMC on Mon Sep 03 2018
>     - Vova Vysotskyi was added to the PMC on Fri Aug 24 2018
>
> ## Committer base changes:
>
>  - Currently 48 committers.
>  - New commmitters:
>     - Chunhui Shi was added as a committer on Thu Sep 27 2018
>     - Gautam Parai was added as a committer on Mon Oct 22 2018
>     - Weijie Tong was added as a committer on Fri Aug 31 2018
>
> ## Releases:
>
>  - 1.14.0 was released on Sat Aug 04 2018
>
> ## Mailing list activity:
>
>  - dev@drill.apache.org:
>     - 427 subscribers (down -6 in the last 3 months):
>     - 2827 emails sent to list (2126 in previous quarter)
>
>  - issues@drill.apache.org:
>     - 18 subscribers (down -1 in the last 3 months):
>     - 3487 emails sent to list (4769 in previous quarter)
>
>  - user@drill.apache.org:
>     - 597 subscribers (down -6 in the last 3 months):
>     - 332 emails sent to list (346 in previous quarter)
>
>
> ## JIRA activity:
>
>  - 164 JIRA tickets created in the last 3 months
>  - 128 JIRA tickets closed/resolved in the last 3 months
>