You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@drill.apache.org by Arina Ielchiieva <ar...@apache.org> on 2017/10/09 13:08:11 UTC

[DISCUSS] Drill 1.12.0 release

Hi Drillers,

It's been several months since the last release and it is time to do the
next one. I am volunteering to be the release manager.

If there are any issues on which work is in progress, that you feel we
*must* include in the release, please post in reply to this thread. Based
on your input we'll define release cut off date.

Kind regards
Arina

Re: [DISCUSS] Drill 1.12.0 release

Posted by Paul Rogers <pr...@mapr.com>.

Hi Arina,

Though I would very much like to get DRILL-5832 and DRILL-5842 into master, I realize everyone is busy and there may not be time to review them. They can wait until after the release if necessary since they are primarily required for a 1.13 project.

Thanks,

- Paul

> On Oct 20, 2017, at 3:49 AM, Arina Yelchiyeva <ar...@gmail.com> wrote:
> 
> Current status:
> 
> Targeted for 1.12 release:
> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather than
> mock (developer - Paul, code reviewer - ?) - waiting for the code review
> DRILL-5842: Refactor and simplify the fragment, operator contexts for
> testing (developer - Paul, code reviewer - ?) - waiting for the code review
> DRILL-5834: Adding network functions (developer - Charles, code reviewer -
> Arina) - waiting changes after code review
> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
> Arina) - waiting
> for the code review
> DRILL-5772: Enable UTF-8 support in query string by default (developer -
> Arina, code reviewer - Paul) - finalizing approach
> DRILL-4779: Kafka storage plugin support (developer - Anil, code reviewer -
> ?) - finishing implementation
> 
> Under question:
> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> reviewer - ?) - waiting for the status update from the developer
> 
> Please free to suggest other items that are targeted for 1.12 release.
> There are many Jiras that have fix version marked as 1.12, it would be good
> if developers revisit them and update fix version to the actual one.
> Link to the dashboard -
> https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=185&projectKey=DRILL&view=detail
> 
> 
> Kind regards
> Arina
> 
> 
> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org> wrote:
> 
>> I'm waiting to merge the SSL  changes in. Waiting a couple of days more to
>> see if there are any more comments before I merge the changes in.
>> 
>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com> wrote:
>> 
>>> Hi Arina,
>>> 
>>> In addition to my own PRs, there are several in the “active” queue that
>> we
>>> could get in if we can just push them over the line and clear the queue.
>>> The owners of the PRs should check if we are waiting on them to take
>> action.
>>> 
>>> 977     DRILL-5849: Add freemarker lib to dependencyManagement to ensure
>>> prop…
>>> 976     DRILL-5797: Choose parquet reader from read columns
>>> 975     DRILL-5743: Handling column family and column scan for hbase
>>> 973     DRILL-5775: Select * query on a maprdb binary table fails
>>> 972     DRILL-5838: Fix MaprDB filter pushdown for the case of nested
>>> field (reg. of DRILL-4264)
>>> 950     Drill 5431: SSL Support
>>> 949     DRILL-5795: Parquet Filter push down at rowgroup level
>>> 936     DRILL-5772: Add unit tests to indicate how utf-8 support can be
>>> enabled / disabled in Drill
>>> 904     DRILL-5717: change some date time test cases with specific
>>> timezone or Local
>>> 892     DRILL-5645: negation of expression causes null pointer exception
>>> 889     DRILL-5691: enhance scalar sub queries checking for the cartesian
>>> join
>>> 
>>> (Items not on the list above have become “inactive” for a variety of
>>> reasons.)
>>> 
>>> Thanks,
>>> 
>>> - Paul
>>> 
>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
>>>> 
>>>> Hi Arina,
>>>> 
>>>> I’d like to include the following that are needed to finish up the
>>> “managed” sort and spill-to-disk for hash agg:
>>>> 
>>>> #928: DRILL-5716: Queue-driven memory allocation
>>>> #958, DRILL-5808: Reduce memory allocator strictness for "managed"
>>> operators
>>>> #960, DRILL-5815: Option to set query memory as percent of total
>>>> 
>>>> The following is needed to resolve issues with HBase support in empty
>>> batches:
>>>> 
>>>> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
>>>> 
>>>> The following are nice-to-haves that build on work already done in this
>>> release, and that some of my own work depends on:
>>>> 
>>>> #970, DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
>>> rather than mock
>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator contexts
>>> for testing
>>>> 
>>>> The following is not needed for 1.12 per-se, but is the foundation for
>> a
>>> project I’m working on; would be good to get this in after 2-3 months of
>>> review time:
>>>> 
>>>> #921, foundation for batch size limitation
>>>> 
>>>> The key issue with each of the above is that they each need a committer
>>> to review. Some have reviews from non-committers. Any volunteers?
>>>> 
>>>> Thanks,
>>>> 
>>>> - Paul
>>>> 
>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com> wrote:
>>>>> 
>>>>> Hi Arina,
>>>>> I’d like to include Drill-5834, Adding network functions.
>>>>> https://github.com/apache/drill/pull/971 <https://github.com/apache/
>>> drill/pull/971>
>>>>> 
>>>>> Hopefully I didn’t violate too many coding standards this time ;-)
>>>>> —C
>>>>> 
>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
>>> arina.yelchiyeva@gmail.com> wrote:
>>>>>> 
>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to finish
>> code
>>>>>> review during this week.
>>>>>> 
>>>>>> Kind regards
>>>>>> Arina
>>>>>> 
>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <ar...@apache.org>
>>> wrote:
>>>>>> 
>>>>>>> Hi Drillers,
>>>>>>> 
>>>>>>> It's been several months since the last release and it is time to do
>>> the
>>>>>>> next one. I am volunteering to be the release manager.
>>>>>>> 
>>>>>>> If there are any issues on which work is in progress, that you feel
>> we
>>>>>>> *must* include in the release, please post in reply to this thread.
>>> Based
>>>>>>> on your input we'll define release cut off date.
>>>>>>> 
>>>>>>> Kind regards
>>>>>>> Arina
>>>>>>> 
>>>>> 
>>>> 
>>> 
>>> 
>>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Arina Yelchiyeva <ar...@gmail.com>.

All pending Jiras are merged. Starting release candidate preparation.

*Note for the committers:*
*until the release is not over and Drill version is not changed to
1.13.0-SNAPSHOT, please do not push any changes into Drill master. *

Kind regards
Arina

On Mon, Nov 27, 2017 at 6:52 PM, Arina Yelchiyeva <
arina.yelchiyeva@gmail.com> wrote:

> Current status:
>
> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> reviewer - Paul) - fix is expected by the EOD in new pull request.
> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> reviewer - Paul) - unit test failures are fixed. Unit test performance
> degraded x3 times!
>
> Kind regards
>
> On Sun, Nov 26, 2017 at 6:15 PM, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com> wrote:
>
>> Current status:
>>
>> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
>> reviewer - Paul) - could not cherry-pick the commits. Needs fix.
>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
>> reviewer - Paul) - there are unit test failures. Needs fix.
>>
>> Kind regards
>>
>> On Sat, Nov 25, 2017 at 11:53 PM, AnilKumar B <ak...@gmail.com>
>> wrote:
>>
>>> Hi Arina,
>>>
>>> Sorry for the delay. Just now we squashed Kafka storage plugin commits
>>> into
>>> one commit and pushed.
>>>
>>> Thanks & Regards,
>>> B Anil Kumar.
>>>
>>> On Sat, Nov 25, 2017 at 5:56 AM, Arina Yelchiyeva <
>>> arina.yelchiyeva@gmail.com> wrote:
>>>
>>> > Current status:
>>> >
>>> > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
>>> code
>>> > reviewer - Paul) - needs to squash the commits.
>>> > DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
>>> > reviewer - Paul) - needs to address some code review comments.
>>> >
>>> > Kind regards
>>> > Arina
>>> >
>>> > On Wed, Nov 15, 2017 at 2:38 PM, Arina Yelchiyeva <
>>> > arina.yelchiyeva@gmail.com> wrote:
>>> >
>>> > > Current status, we are close to the code freeze which will happen not
>>> > > later then the end of the next week.
>>> > >
>>> > > Blocker:
>>> > > DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
>>> code
>>> > > reviewer - Arina) - in progress.
>>> > >
>>> > > Targeted for 1.12 release:
>>> > > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
>>> code
>>> > > reviewer - Paul) - needs next round of code review.
>>> > > DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
>>> > > mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
>>> waiting
>>> > > for Parth code review.
>>> > > DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
>>> code
>>> > > reviewer - Tim) - code review is done, waiting for the merge.
>>> > >
>>> > > Kind regards
>>> > >
>>> > > On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cs...@mapr.com> wrote:
>>> > >
>>> > >> Hi Arina,
>>> > >>
>>> > >>
>>> > >> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy
>>> > >> loading schema for storage plugins. Could you or Paul take a look
>>> at the
>>> > >> pull request for this JIRA https://github.com/apache/dril
>>> l/pull/1032? I
>>> > >> think both of you are familiar with this part.
>>> > >>
>>> > >>
>>> > >> Thanks,
>>> > >>
>>> > >>
>>> > >> Chunhui
>>> > >>
>>> > >> ________________________________
>>> > >> From: Arina Yelchiyeva <ar...@gmail.com>
>>> > >> Sent: Thursday, November 9, 2017 8:11:35 AM
>>> > >> To: dev@drill.apache.org
>>> > >> Subject: Re: [DISCUSS] Drill 1.12.0 release
>>> > >>
>>> > >> Yes, they are already in master.
>>> > >>
>>> > >> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com>
>>> wrote:
>>> > >>
>>> > >> > We’re including the Networking functions in this release right?
>>> > >> >
>>> > >> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <
>>> > >> arina.yelchiyeva@gmail.com>
>>> > >> > wrote:
>>> > >> > >
>>> > >> > > If changes will be done before cut off date, targeting mid
>>> November
>>> > >> that
>>> > >> > it
>>> > >> > > will be possible to include this Jira.
>>> > >> > >
>>> > >> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cgivre@gmail.com
>>> >
>>> > >> wrote:
>>> > >> > >
>>> > >> > >> Hi Arina,
>>> > >> > >> Can we include DRILL-4091 Support for additional GIS
>>> operations in
>>> > >> > version
>>> > >> > >> 1.12?  In general the code looked pretty good.  There was a
>>> unit
>>> > test
>>> > >> > >> missing which the developer submitted and some minor formatting
>>> > >> issues
>>> > >> > >> which I’m still waiting on.
>>> > >> > >> Thanks,
>>> > >> > >> —C
>>> > >> > >>
>>> > >> > >>
>>> > >> > >>
>>> > >> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
>>> > >> arina.yelchiyeva@gmail.com
>>> > >> > >
>>> > >> > >> wrote:
>>> > >> > >>>
>>> > >> > >>> Current status:
>>> > >> > >>>
>>> > >> > >>> Blocker:
>>> > >> > >>> DRILL-5917: Ban org.json:json library in Drill (developer -
>>> Vlad
>>> > R.,
>>> > >> > code
>>> > >> > >>> reviewer - ?) - in progress.
>>> > >> > >>>
>>> > >> > >>> Targeted for 1.12 release:
>>> > >> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S.,
>>> code
>>> > >> > >> reviewer -
>>> > >> > >>> Arina) - code review in final stage.
>>> > >> > >>> DRILL-4779: Kafka storage plugin support (developer - Anil &
>>> > Kamesh,
>>> > >> > code
>>> > >> > >>> reviewer - Paul) - in review.
>>> > >> > >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582
>>> for
>>> > >> PLAIN
>>> > >> > >>> mechanism (developer - Sorabh, code reviewer - Parth &
>>> Laurent) -
>>> > >> > waiting
>>> > >> > >>> for the code review.
>>> > >> > >>> DRILL-5771: Fix serDe errors for format plugins (developer -
>>> > Arina,
>>> > >> > code
>>> > >> > >>> reviewer - Tim) - waiting for the code review.
>>> > >> > >>>
>>> > >> > >>> Kind regards
>>> > >> > >>> Arina
>>> > >> > >>>
>>> > >> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
>>> > >> > >>> arina.yelchiyeva@gmail.com> wrote:
>>> > >> > >>>
>>> > >> > >>>> Current status:
>>> > >> > >>>>
>>> > >> > >>>> Targeted for 1.12 release:
>>> > >> > >>>> DRILL-5832: Migrate OperatorFixture to use
>>> SystemOptionManager
>>> > >> rather
>>> > >> > >> than
>>> > >> > >>>> mock (developer - Paul, code reviewer - ?) - waiting for the
>>> code
>>> > >> > review
>>> > >> > >>>> DRILL-5842: Refactor and simplify the fragment, operator
>>> contexts
>>> > >> for
>>> > >> > >>>> testing (developer - Paul, code reviewer - ?) - waiting for
>>> the
>>> > >> code
>>> > >> > >>>> review
>>> > >> > >>>> DRILL-5834: Adding network functions (developer - Charles,
>>> code
>>> > >> > reviewer
>>> > >> > >>>> - Arina) - waiting changes after code review
>>> > >> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code
>>> reviewer -
>>> > >> > >> Arina) - waiting
>>> > >> > >>>> for the code review
>>> > >> > >>>> DRILL-5772: Enable UTF-8 support in query string by default
>>> > >> > (developer -
>>> > >> > >>>> Arina, code reviewer - Paul) - finalizing approach
>>> > >> > >>>> DRILL-4779: Kafka storage plugin support (developer - Anil,
>>> code
>>> > >> > >> reviewer
>>> > >> > >>>> - ?) - finishing implementation
>>> > >> > >>>>
>>> > >> > >>>> Under question:
>>> > >> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer -
>>> Jyothsna,
>>> > >> code
>>> > >> > >>>> reviewer - ?) - waiting for the status update from the
>>> developer
>>> > >> > >>>>
>>> > >> > >>>> Please free to suggest other items that are targeted for 1.12
>>> > >> release.
>>> > >> > >>>> There are many Jiras that have fix version marked as 1.12, it
>>> > >> would be
>>> > >> > >> good
>>> > >> > >>>> if developers revisit them and update fix version to the
>>> actual
>>> > >> one.
>>> > >> > >>>> Link to the dashboard - https://issues.apache.org/
>>> > >> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
>>> > >> > DRILL&view=detail
>>> > >> > >>>>
>>> > >> > >>>> Kind regards
>>> > >> > >>>> Arina
>>> > >> > >>>>
>>> > >> > >>>>
>>> > >> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <
>>> > parthc@apache.org>
>>> > >> > >> wrote:
>>> > >> > >>>>
>>> > >> > >>>>> I'm waiting to merge the SSL  changes in. Waiting a couple
>>> of
>>> > days
>>> > >> > >> more to
>>> > >> > >>>>> see if there are any more comments before I merge the
>>> changes
>>> > in.
>>> > >> > >>>>>
>>> > >> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <
>>> progers@mapr.com>
>>> > >> > wrote:
>>> > >> > >>>>>
>>> > >> > >>>>>> Hi Arina,
>>> > >> > >>>>>>
>>> > >> > >>>>>> In addition to my own PRs, there are several in the
>>> “active”
>>> > >> queue
>>> > >> > >> that
>>> > >> > >>>>> we
>>> > >> > >>>>>> could get in if we can just push them over the line and
>>> clear
>>> > the
>>> > >> > >> queue.
>>> > >> > >>>>>> The owners of the PRs should check if we are waiting on
>>> them to
>>> > >> take
>>> > >> > >>>>> action.
>>> > >> > >>>>>>
>>> > >> > >>>>>> 977     DRILL-5849: Add freemarker lib to
>>> dependencyManagement
>>> > to
>>> > >> > >> ensure
>>> > >> > >>>>>> prop…
>>> > >> > >>>>>> 976     DRILL-5797: Choose parquet reader from read columns
>>> > >> > >>>>>> 975     DRILL-5743: Handling column family and column scan
>>> for
>>> > >> hbase
>>> > >> > >>>>>> 973     DRILL-5775: Select * query on a maprdb binary table
>>> > fails
>>> > >> > >>>>>> 972     DRILL-5838: Fix MaprDB filter pushdown for the
>>> case of
>>> > >> > nested
>>> > >> > >>>>>> field (reg. of DRILL-4264)
>>> > >> > >>>>>> 950     Drill 5431: SSL Support
>>> > >> > >>>>>> 949     DRILL-5795: Parquet Filter push down at rowgroup
>>> level
>>> > >> > >>>>>> 936     DRILL-5772: Add unit tests to indicate how utf-8
>>> > support
>>> > >> can
>>> > >> > >> be
>>> > >> > >>>>>> enabled / disabled in Drill
>>> > >> > >>>>>> 904     DRILL-5717: change some date time test cases with
>>> > >> specific
>>> > >> > >>>>>> timezone or Local
>>> > >> > >>>>>> 892     DRILL-5645: negation of expression causes null
>>> pointer
>>> > >> > >> exception
>>> > >> > >>>>>> 889     DRILL-5691: enhance scalar sub queries checking
>>> for the
>>> > >> > >>>>> cartesian
>>> > >> > >>>>>> join
>>> > >> > >>>>>>
>>> > >> > >>>>>> (Items not on the list above have become “inactive” for a
>>> > >> variety of
>>> > >> > >>>>>> reasons.)
>>> > >> > >>>>>>
>>> > >> > >>>>>> Thanks,
>>> > >> > >>>>>>
>>> > >> > >>>>>> - Paul
>>> > >> > >>>>>>
>>> > >> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <progers@mapr.com
>>> >
>>> > >> wrote:
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> Hi Arina,
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> I’d like to include the following that are needed to
>>> finish up
>>> > >> the
>>> > >> > >>>>>> “managed” sort and spill-to-disk for hash agg:
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
>>> > >> > >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for
>>> > >> "managed"
>>> > >> > >>>>>> operators
>>> > >> > >>>>>>> #960, DRILL-5815: Option to set query memory as percent of
>>> > total
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> The following is needed to resolve issues with HBase
>>> support
>>> > in
>>> > >> > empty
>>> > >> > >>>>>> batches:
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from
>>> > DRILL-5546
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> The following are nice-to-haves that build on work already
>>> > done
>>> > >> in
>>> > >> > >>>>> this
>>> > >> > >>>>>> release, and that some of my own work depends on:
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
>>> > >> > SystemOptionManager
>>> > >> > >>>>>> rather than mock
>>> > >> > >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment,
>>> operator
>>> > >> > >>>>> contexts
>>> > >> > >>>>>> for testing
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> The following is not needed for 1.12 per-se, but is the
>>> > >> foundation
>>> > >> > >>>>> for a
>>> > >> > >>>>>> project I’m working on; would be good to get this in after
>>> 2-3
>>> > >> > months
>>> > >> > >> of
>>> > >> > >>>>>> review time:
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> #921, foundation for batch size limitation
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> The key issue with each of the above is that they each
>>> need a
>>> > >> > >>>>> committer
>>> > >> > >>>>>> to review. Some have reviews from non-committers. Any
>>> > volunteers?
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> Thanks,
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> - Paul
>>> > >> > >>>>>>>
>>> > >> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <
>>> cgivre@gmail.com>
>>> > >> > wrote:
>>> > >> > >>>>>>>>
>>> > >> > >>>>>>>> Hi Arina,
>>> > >> > >>>>>>>> I’d like to include Drill-5834, Adding network functions.
>>> > >> > >>>>>>>> https://github.com/apache/drill/pull/971 <
>>> > >> > >> https://github.com/apache/
>>> > >> > >>>>>> drill/pull/971>
>>> > >> > >>>>>>>>
>>> > >> > >>>>>>>> Hopefully I didn’t violate too many coding standards this
>>> > time
>>> > >> ;-)
>>> > >> > >>>>>>>> —C
>>> > >> > >>>>>>>>
>>> > >> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
>>> > >> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
>>> > >> > >>>>>>>>>
>>> > >> > >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll
>>> try to
>>> > >> > finish
>>> > >> > >>>>> code
>>> > >> > >>>>>>>>> review during this week.
>>> > >> > >>>>>>>>>
>>> > >> > >>>>>>>>> Kind regards
>>> > >> > >>>>>>>>> Arina
>>> > >> > >>>>>>>>>
>>> > >> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
>>> > >> > arina@apache.org
>>> > >> > >>>
>>> > >> > >>>>>> wrote:
>>> > >> > >>>>>>>>>
>>> > >> > >>>>>>>>>> Hi Drillers,
>>> > >> > >>>>>>>>>>
>>> > >> > >>>>>>>>>> It's been several months since the last release and it
>>> is
>>> > >> time
>>> > >> > to
>>> > >> > >>>>> do
>>> > >> > >>>>>> the
>>> > >> > >>>>>>>>>> next one. I am volunteering to be the release manager.
>>> > >> > >>>>>>>>>>
>>> > >> > >>>>>>>>>> If there are any issues on which work is in progress,
>>> that
>>> > >> you
>>> > >> > >>>>> feel we
>>> > >> > >>>>>>>>>> *must* include in the release, please post in reply to
>>> this
>>> > >> > >> thread.
>>> > >> > >>>>>> Based
>>> > >> > >>>>>>>>>> on your input we'll define release cut off date.
>>> > >> > >>>>>>>>>>
>>> > >> > >>>>>>>>>> Kind regards
>>> > >> > >>>>>>>>>> Arina
>>> > >> > >>>>>>>>>>
>>> > >> > >>>>>>>>
>>> > >> > >>>>>>>
>>> > >> > >>>>>>
>>> > >> > >>>>>>
>>> > >> > >>>>>
>>> > >> > >>>>
>>> > >> > >>>>
>>> > >> > >>
>>> > >> > >>
>>> > >> >
>>> > >> >
>>> > >>
>>> > >
>>> > >
>>> >
>>>
>>
>>
>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Arina Yelchiyeva <ar...@gmail.com>.

Current status:

DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
reviewer - Paul) - fix is expected by the EOD in new pull request.
DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
reviewer - Paul) - unit test failures are fixed. Unit test performance
degraded x3 times!

Kind regards

On Sun, Nov 26, 2017 at 6:15 PM, Arina Yelchiyeva <
arina.yelchiyeva@gmail.com> wrote:

> Current status:
>
> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> reviewer - Paul) - could not cherry-pick the commits. Needs fix.
> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> reviewer - Paul) - there are unit test failures. Needs fix.
>
> Kind regards
>
> On Sat, Nov 25, 2017 at 11:53 PM, AnilKumar B <ak...@gmail.com>
> wrote:
>
>> Hi Arina,
>>
>> Sorry for the delay. Just now we squashed Kafka storage plugin commits
>> into
>> one commit and pushed.
>>
>> Thanks & Regards,
>> B Anil Kumar.
>>
>> On Sat, Nov 25, 2017 at 5:56 AM, Arina Yelchiyeva <
>> arina.yelchiyeva@gmail.com> wrote:
>>
>> > Current status:
>> >
>> > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
>> code
>> > reviewer - Paul) - needs to squash the commits.
>> > DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
>> > reviewer - Paul) - needs to address some code review comments.
>> >
>> > Kind regards
>> > Arina
>> >
>> > On Wed, Nov 15, 2017 at 2:38 PM, Arina Yelchiyeva <
>> > arina.yelchiyeva@gmail.com> wrote:
>> >
>> > > Current status, we are close to the code freeze which will happen not
>> > > later then the end of the next week.
>> > >
>> > > Blocker:
>> > > DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
>> code
>> > > reviewer - Arina) - in progress.
>> > >
>> > > Targeted for 1.12 release:
>> > > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
>> code
>> > > reviewer - Paul) - needs next round of code review.
>> > > DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
>> > > mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
>> waiting
>> > > for Parth code review.
>> > > DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
>> code
>> > > reviewer - Tim) - code review is done, waiting for the merge.
>> > >
>> > > Kind regards
>> > >
>> > > On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cs...@mapr.com> wrote:
>> > >
>> > >> Hi Arina,
>> > >>
>> > >>
>> > >> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy
>> > >> loading schema for storage plugins. Could you or Paul take a look at
>> the
>> > >> pull request for this JIRA https://github.com/apache/drill/pull/1032?
>> I
>> > >> think both of you are familiar with this part.
>> > >>
>> > >>
>> > >> Thanks,
>> > >>
>> > >>
>> > >> Chunhui
>> > >>
>> > >> ________________________________
>> > >> From: Arina Yelchiyeva <ar...@gmail.com>
>> > >> Sent: Thursday, November 9, 2017 8:11:35 AM
>> > >> To: dev@drill.apache.org
>> > >> Subject: Re: [DISCUSS] Drill 1.12.0 release
>> > >>
>> > >> Yes, they are already in master.
>> > >>
>> > >> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com>
>> wrote:
>> > >>
>> > >> > We’re including the Networking functions in this release right?
>> > >> >
>> > >> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <
>> > >> arina.yelchiyeva@gmail.com>
>> > >> > wrote:
>> > >> > >
>> > >> > > If changes will be done before cut off date, targeting mid
>> November
>> > >> that
>> > >> > it
>> > >> > > will be possible to include this Jira.
>> > >> > >
>> > >> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com>
>> > >> wrote:
>> > >> > >
>> > >> > >> Hi Arina,
>> > >> > >> Can we include DRILL-4091 Support for additional GIS operations
>> in
>> > >> > version
>> > >> > >> 1.12?  In general the code looked pretty good.  There was a unit
>> > test
>> > >> > >> missing which the developer submitted and some minor formatting
>> > >> issues
>> > >> > >> which I’m still waiting on.
>> > >> > >> Thanks,
>> > >> > >> —C
>> > >> > >>
>> > >> > >>
>> > >> > >>
>> > >> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
>> > >> arina.yelchiyeva@gmail.com
>> > >> > >
>> > >> > >> wrote:
>> > >> > >>>
>> > >> > >>> Current status:
>> > >> > >>>
>> > >> > >>> Blocker:
>> > >> > >>> DRILL-5917: Ban org.json:json library in Drill (developer -
>> Vlad
>> > R.,
>> > >> > code
>> > >> > >>> reviewer - ?) - in progress.
>> > >> > >>>
>> > >> > >>> Targeted for 1.12 release:
>> > >> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S.,
>> code
>> > >> > >> reviewer -
>> > >> > >>> Arina) - code review in final stage.
>> > >> > >>> DRILL-4779: Kafka storage plugin support (developer - Anil &
>> > Kamesh,
>> > >> > code
>> > >> > >>> reviewer - Paul) - in review.
>> > >> > >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for
>> > >> PLAIN
>> > >> > >>> mechanism (developer - Sorabh, code reviewer - Parth &
>> Laurent) -
>> > >> > waiting
>> > >> > >>> for the code review.
>> > >> > >>> DRILL-5771: Fix serDe errors for format plugins (developer -
>> > Arina,
>> > >> > code
>> > >> > >>> reviewer - Tim) - waiting for the code review.
>> > >> > >>>
>> > >> > >>> Kind regards
>> > >> > >>> Arina
>> > >> > >>>
>> > >> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
>> > >> > >>> arina.yelchiyeva@gmail.com> wrote:
>> > >> > >>>
>> > >> > >>>> Current status:
>> > >> > >>>>
>> > >> > >>>> Targeted for 1.12 release:
>> > >> > >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
>> > >> rather
>> > >> > >> than
>> > >> > >>>> mock (developer - Paul, code reviewer - ?) - waiting for the
>> code
>> > >> > review
>> > >> > >>>> DRILL-5842: Refactor and simplify the fragment, operator
>> contexts
>> > >> for
>> > >> > >>>> testing (developer - Paul, code reviewer - ?) - waiting for
>> the
>> > >> code
>> > >> > >>>> review
>> > >> > >>>> DRILL-5834: Adding network functions (developer - Charles,
>> code
>> > >> > reviewer
>> > >> > >>>> - Arina) - waiting changes after code review
>> > >> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code
>> reviewer -
>> > >> > >> Arina) - waiting
>> > >> > >>>> for the code review
>> > >> > >>>> DRILL-5772: Enable UTF-8 support in query string by default
>> > >> > (developer -
>> > >> > >>>> Arina, code reviewer - Paul) - finalizing approach
>> > >> > >>>> DRILL-4779: Kafka storage plugin support (developer - Anil,
>> code
>> > >> > >> reviewer
>> > >> > >>>> - ?) - finishing implementation
>> > >> > >>>>
>> > >> > >>>> Under question:
>> > >> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer -
>> Jyothsna,
>> > >> code
>> > >> > >>>> reviewer - ?) - waiting for the status update from the
>> developer
>> > >> > >>>>
>> > >> > >>>> Please free to suggest other items that are targeted for 1.12
>> > >> release.
>> > >> > >>>> There are many Jiras that have fix version marked as 1.12, it
>> > >> would be
>> > >> > >> good
>> > >> > >>>> if developers revisit them and update fix version to the
>> actual
>> > >> one.
>> > >> > >>>> Link to the dashboard - https://issues.apache.org/
>> > >> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
>> > >> > DRILL&view=detail
>> > >> > >>>>
>> > >> > >>>> Kind regards
>> > >> > >>>> Arina
>> > >> > >>>>
>> > >> > >>>>
>> > >> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <
>> > parthc@apache.org>
>> > >> > >> wrote:
>> > >> > >>>>
>> > >> > >>>>> I'm waiting to merge the SSL  changes in. Waiting a couple of
>> > days
>> > >> > >> more to
>> > >> > >>>>> see if there are any more comments before I merge the changes
>> > in.
>> > >> > >>>>>
>> > >> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <
>> progers@mapr.com>
>> > >> > wrote:
>> > >> > >>>>>
>> > >> > >>>>>> Hi Arina,
>> > >> > >>>>>>
>> > >> > >>>>>> In addition to my own PRs, there are several in the “active”
>> > >> queue
>> > >> > >> that
>> > >> > >>>>> we
>> > >> > >>>>>> could get in if we can just push them over the line and
>> clear
>> > the
>> > >> > >> queue.
>> > >> > >>>>>> The owners of the PRs should check if we are waiting on
>> them to
>> > >> take
>> > >> > >>>>> action.
>> > >> > >>>>>>
>> > >> > >>>>>> 977     DRILL-5849: Add freemarker lib to
>> dependencyManagement
>> > to
>> > >> > >> ensure
>> > >> > >>>>>> prop…
>> > >> > >>>>>> 976     DRILL-5797: Choose parquet reader from read columns
>> > >> > >>>>>> 975     DRILL-5743: Handling column family and column scan
>> for
>> > >> hbase
>> > >> > >>>>>> 973     DRILL-5775: Select * query on a maprdb binary table
>> > fails
>> > >> > >>>>>> 972     DRILL-5838: Fix MaprDB filter pushdown for the case
>> of
>> > >> > nested
>> > >> > >>>>>> field (reg. of DRILL-4264)
>> > >> > >>>>>> 950     Drill 5431: SSL Support
>> > >> > >>>>>> 949     DRILL-5795: Parquet Filter push down at rowgroup
>> level
>> > >> > >>>>>> 936     DRILL-5772: Add unit tests to indicate how utf-8
>> > support
>> > >> can
>> > >> > >> be
>> > >> > >>>>>> enabled / disabled in Drill
>> > >> > >>>>>> 904     DRILL-5717: change some date time test cases with
>> > >> specific
>> > >> > >>>>>> timezone or Local
>> > >> > >>>>>> 892     DRILL-5645: negation of expression causes null
>> pointer
>> > >> > >> exception
>> > >> > >>>>>> 889     DRILL-5691: enhance scalar sub queries checking for
>> the
>> > >> > >>>>> cartesian
>> > >> > >>>>>> join
>> > >> > >>>>>>
>> > >> > >>>>>> (Items not on the list above have become “inactive” for a
>> > >> variety of
>> > >> > >>>>>> reasons.)
>> > >> > >>>>>>
>> > >> > >>>>>> Thanks,
>> > >> > >>>>>>
>> > >> > >>>>>> - Paul
>> > >> > >>>>>>
>> > >> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com>
>> > >> wrote:
>> > >> > >>>>>>>
>> > >> > >>>>>>> Hi Arina,
>> > >> > >>>>>>>
>> > >> > >>>>>>> I’d like to include the following that are needed to
>> finish up
>> > >> the
>> > >> > >>>>>> “managed” sort and spill-to-disk for hash agg:
>> > >> > >>>>>>>
>> > >> > >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
>> > >> > >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for
>> > >> "managed"
>> > >> > >>>>>> operators
>> > >> > >>>>>>> #960, DRILL-5815: Option to set query memory as percent of
>> > total
>> > >> > >>>>>>>
>> > >> > >>>>>>> The following is needed to resolve issues with HBase
>> support
>> > in
>> > >> > empty
>> > >> > >>>>>> batches:
>> > >> > >>>>>>>
>> > >> > >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from
>> > DRILL-5546
>> > >> > >>>>>>>
>> > >> > >>>>>>> The following are nice-to-haves that build on work already
>> > done
>> > >> in
>> > >> > >>>>> this
>> > >> > >>>>>> release, and that some of my own work depends on:
>> > >> > >>>>>>>
>> > >> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
>> > >> > SystemOptionManager
>> > >> > >>>>>> rather than mock
>> > >> > >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment,
>> operator
>> > >> > >>>>> contexts
>> > >> > >>>>>> for testing
>> > >> > >>>>>>>
>> > >> > >>>>>>> The following is not needed for 1.12 per-se, but is the
>> > >> foundation
>> > >> > >>>>> for a
>> > >> > >>>>>> project I’m working on; would be good to get this in after
>> 2-3
>> > >> > months
>> > >> > >> of
>> > >> > >>>>>> review time:
>> > >> > >>>>>>>
>> > >> > >>>>>>> #921, foundation for batch size limitation
>> > >> > >>>>>>>
>> > >> > >>>>>>> The key issue with each of the above is that they each
>> need a
>> > >> > >>>>> committer
>> > >> > >>>>>> to review. Some have reviews from non-committers. Any
>> > volunteers?
>> > >> > >>>>>>>
>> > >> > >>>>>>> Thanks,
>> > >> > >>>>>>>
>> > >> > >>>>>>> - Paul
>> > >> > >>>>>>>
>> > >> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <
>> cgivre@gmail.com>
>> > >> > wrote:
>> > >> > >>>>>>>>
>> > >> > >>>>>>>> Hi Arina,
>> > >> > >>>>>>>> I’d like to include Drill-5834, Adding network functions.
>> > >> > >>>>>>>> https://github.com/apache/drill/pull/971 <
>> > >> > >> https://github.com/apache/
>> > >> > >>>>>> drill/pull/971>
>> > >> > >>>>>>>>
>> > >> > >>>>>>>> Hopefully I didn’t violate too many coding standards this
>> > time
>> > >> ;-)
>> > >> > >>>>>>>> —C
>> > >> > >>>>>>>>
>> > >> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
>> > >> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
>> > >> > >>>>>>>>>
>> > >> > >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try
>> to
>> > >> > finish
>> > >> > >>>>> code
>> > >> > >>>>>>>>> review during this week.
>> > >> > >>>>>>>>>
>> > >> > >>>>>>>>> Kind regards
>> > >> > >>>>>>>>> Arina
>> > >> > >>>>>>>>>
>> > >> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
>> > >> > arina@apache.org
>> > >> > >>>
>> > >> > >>>>>> wrote:
>> > >> > >>>>>>>>>
>> > >> > >>>>>>>>>> Hi Drillers,
>> > >> > >>>>>>>>>>
>> > >> > >>>>>>>>>> It's been several months since the last release and it
>> is
>> > >> time
>> > >> > to
>> > >> > >>>>> do
>> > >> > >>>>>> the
>> > >> > >>>>>>>>>> next one. I am volunteering to be the release manager.
>> > >> > >>>>>>>>>>
>> > >> > >>>>>>>>>> If there are any issues on which work is in progress,
>> that
>> > >> you
>> > >> > >>>>> feel we
>> > >> > >>>>>>>>>> *must* include in the release, please post in reply to
>> this
>> > >> > >> thread.
>> > >> > >>>>>> Based
>> > >> > >>>>>>>>>> on your input we'll define release cut off date.
>> > >> > >>>>>>>>>>
>> > >> > >>>>>>>>>> Kind regards
>> > >> > >>>>>>>>>> Arina
>> > >> > >>>>>>>>>>
>> > >> > >>>>>>>>
>> > >> > >>>>>>>
>> > >> > >>>>>>
>> > >> > >>>>>>
>> > >> > >>>>>
>> > >> > >>>>
>> > >> > >>>>
>> > >> > >>
>> > >> > >>
>> > >> >
>> > >> >
>> > >>
>> > >
>> > >
>> >
>>
>
>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Arina Yelchiyeva <ar...@gmail.com>.

Current status:

DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
reviewer - Paul) - could not cherry-pick the commits. Needs fix.
DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
reviewer - Paul) - there are unit test failures. Needs fix.

Kind regards

On Sat, Nov 25, 2017 at 11:53 PM, AnilKumar B <ak...@gmail.com> wrote:

> Hi Arina,
>
> Sorry for the delay. Just now we squashed Kafka storage plugin commits into
> one commit and pushed.
>
> Thanks & Regards,
> B Anil Kumar.
>
> On Sat, Nov 25, 2017 at 5:56 AM, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com> wrote:
>
> > Current status:
> >
> > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> > reviewer - Paul) - needs to squash the commits.
> > DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> > reviewer - Paul) - needs to address some code review comments.
> >
> > Kind regards
> > Arina
> >
> > On Wed, Nov 15, 2017 at 2:38 PM, Arina Yelchiyeva <
> > arina.yelchiyeva@gmail.com> wrote:
> >
> > > Current status, we are close to the code freeze which will happen not
> > > later then the end of the next week.
> > >
> > > Blocker:
> > > DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
> code
> > > reviewer - Arina) - in progress.
> > >
> > > Targeted for 1.12 release:
> > > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
> code
> > > reviewer - Paul) - needs next round of code review.
> > > DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> > > mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
> waiting
> > > for Parth code review.
> > > DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
> code
> > > reviewer - Tim) - code review is done, waiting for the merge.
> > >
> > > Kind regards
> > >
> > > On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cs...@mapr.com> wrote:
> > >
> > >> Hi Arina,
> > >>
> > >>
> > >> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy
> > >> loading schema for storage plugins. Could you or Paul take a look at
> the
> > >> pull request for this JIRA https://github.com/apache/drill/pull/1032?
> I
> > >> think both of you are familiar with this part.
> > >>
> > >>
> > >> Thanks,
> > >>
> > >>
> > >> Chunhui
> > >>
> > >> ________________________________
> > >> From: Arina Yelchiyeva <ar...@gmail.com>
> > >> Sent: Thursday, November 9, 2017 8:11:35 AM
> > >> To: dev@drill.apache.org
> > >> Subject: Re: [DISCUSS] Drill 1.12.0 release
> > >>
> > >> Yes, they are already in master.
> > >>
> > >> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com>
> wrote:
> > >>
> > >> > We’re including the Networking functions in this release right?
> > >> >
> > >> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <
> > >> arina.yelchiyeva@gmail.com>
> > >> > wrote:
> > >> > >
> > >> > > If changes will be done before cut off date, targeting mid
> November
> > >> that
> > >> > it
> > >> > > will be possible to include this Jira.
> > >> > >
> > >> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com>
> > >> wrote:
> > >> > >
> > >> > >> Hi Arina,
> > >> > >> Can we include DRILL-4091 Support for additional GIS operations
> in
> > >> > version
> > >> > >> 1.12?  In general the code looked pretty good.  There was a unit
> > test
> > >> > >> missing which the developer submitted and some minor formatting
> > >> issues
> > >> > >> which I’m still waiting on.
> > >> > >> Thanks,
> > >> > >> —C
> > >> > >>
> > >> > >>
> > >> > >>
> > >> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
> > >> arina.yelchiyeva@gmail.com
> > >> > >
> > >> > >> wrote:
> > >> > >>>
> > >> > >>> Current status:
> > >> > >>>
> > >> > >>> Blocker:
> > >> > >>> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad
> > R.,
> > >> > code
> > >> > >>> reviewer - ?) - in progress.
> > >> > >>>
> > >> > >>> Targeted for 1.12 release:
> > >> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
> > >> > >> reviewer -
> > >> > >>> Arina) - code review in final stage.
> > >> > >>> DRILL-4779: Kafka storage plugin support (developer - Anil &
> > Kamesh,
> > >> > code
> > >> > >>> reviewer - Paul) - in review.
> > >> > >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for
> > >> PLAIN
> > >> > >>> mechanism (developer - Sorabh, code reviewer - Parth & Laurent)
> -
> > >> > waiting
> > >> > >>> for the code review.
> > >> > >>> DRILL-5771: Fix serDe errors for format plugins (developer -
> > Arina,
> > >> > code
> > >> > >>> reviewer - Tim) - waiting for the code review.
> > >> > >>>
> > >> > >>> Kind regards
> > >> > >>> Arina
> > >> > >>>
> > >> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
> > >> > >>> arina.yelchiyeva@gmail.com> wrote:
> > >> > >>>
> > >> > >>>> Current status:
> > >> > >>>>
> > >> > >>>> Targeted for 1.12 release:
> > >> > >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
> > >> rather
> > >> > >> than
> > >> > >>>> mock (developer - Paul, code reviewer - ?) - waiting for the
> code
> > >> > review
> > >> > >>>> DRILL-5842: Refactor and simplify the fragment, operator
> contexts
> > >> for
> > >> > >>>> testing (developer - Paul, code reviewer - ?) - waiting for the
> > >> code
> > >> > >>>> review
> > >> > >>>> DRILL-5834: Adding network functions (developer - Charles, code
> > >> > reviewer
> > >> > >>>> - Arina) - waiting changes after code review
> > >> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code
> reviewer -
> > >> > >> Arina) - waiting
> > >> > >>>> for the code review
> > >> > >>>> DRILL-5772: Enable UTF-8 support in query string by default
> > >> > (developer -
> > >> > >>>> Arina, code reviewer - Paul) - finalizing approach
> > >> > >>>> DRILL-4779: Kafka storage plugin support (developer - Anil,
> code
> > >> > >> reviewer
> > >> > >>>> - ?) - finishing implementation
> > >> > >>>>
> > >> > >>>> Under question:
> > >> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer -
> Jyothsna,
> > >> code
> > >> > >>>> reviewer - ?) - waiting for the status update from the
> developer
> > >> > >>>>
> > >> > >>>> Please free to suggest other items that are targeted for 1.12
> > >> release.
> > >> > >>>> There are many Jiras that have fix version marked as 1.12, it
> > >> would be
> > >> > >> good
> > >> > >>>> if developers revisit them and update fix version to the actual
> > >> one.
> > >> > >>>> Link to the dashboard - https://issues.apache.org/
> > >> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
> > >> > DRILL&view=detail
> > >> > >>>>
> > >> > >>>> Kind regards
> > >> > >>>> Arina
> > >> > >>>>
> > >> > >>>>
> > >> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <
> > parthc@apache.org>
> > >> > >> wrote:
> > >> > >>>>
> > >> > >>>>> I'm waiting to merge the SSL  changes in. Waiting a couple of
> > days
> > >> > >> more to
> > >> > >>>>> see if there are any more comments before I merge the changes
> > in.
> > >> > >>>>>
> > >> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <
> progers@mapr.com>
> > >> > wrote:
> > >> > >>>>>
> > >> > >>>>>> Hi Arina,
> > >> > >>>>>>
> > >> > >>>>>> In addition to my own PRs, there are several in the “active”
> > >> queue
> > >> > >> that
> > >> > >>>>> we
> > >> > >>>>>> could get in if we can just push them over the line and clear
> > the
> > >> > >> queue.
> > >> > >>>>>> The owners of the PRs should check if we are waiting on them
> to
> > >> take
> > >> > >>>>> action.
> > >> > >>>>>>
> > >> > >>>>>> 977     DRILL-5849: Add freemarker lib to
> dependencyManagement
> > to
> > >> > >> ensure
> > >> > >>>>>> prop…
> > >> > >>>>>> 976     DRILL-5797: Choose parquet reader from read columns
> > >> > >>>>>> 975     DRILL-5743: Handling column family and column scan
> for
> > >> hbase
> > >> > >>>>>> 973     DRILL-5775: Select * query on a maprdb binary table
> > fails
> > >> > >>>>>> 972     DRILL-5838: Fix MaprDB filter pushdown for the case
> of
> > >> > nested
> > >> > >>>>>> field (reg. of DRILL-4264)
> > >> > >>>>>> 950     Drill 5431: SSL Support
> > >> > >>>>>> 949     DRILL-5795: Parquet Filter push down at rowgroup
> level
> > >> > >>>>>> 936     DRILL-5772: Add unit tests to indicate how utf-8
> > support
> > >> can
> > >> > >> be
> > >> > >>>>>> enabled / disabled in Drill
> > >> > >>>>>> 904     DRILL-5717: change some date time test cases with
> > >> specific
> > >> > >>>>>> timezone or Local
> > >> > >>>>>> 892     DRILL-5645: negation of expression causes null
> pointer
> > >> > >> exception
> > >> > >>>>>> 889     DRILL-5691: enhance scalar sub queries checking for
> the
> > >> > >>>>> cartesian
> > >> > >>>>>> join
> > >> > >>>>>>
> > >> > >>>>>> (Items not on the list above have become “inactive” for a
> > >> variety of
> > >> > >>>>>> reasons.)
> > >> > >>>>>>
> > >> > >>>>>> Thanks,
> > >> > >>>>>>
> > >> > >>>>>> - Paul
> > >> > >>>>>>
> > >> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com>
> > >> wrote:
> > >> > >>>>>>>
> > >> > >>>>>>> Hi Arina,
> > >> > >>>>>>>
> > >> > >>>>>>> I’d like to include the following that are needed to finish
> up
> > >> the
> > >> > >>>>>> “managed” sort and spill-to-disk for hash agg:
> > >> > >>>>>>>
> > >> > >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
> > >> > >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for
> > >> "managed"
> > >> > >>>>>> operators
> > >> > >>>>>>> #960, DRILL-5815: Option to set query memory as percent of
> > total
> > >> > >>>>>>>
> > >> > >>>>>>> The following is needed to resolve issues with HBase support
> > in
> > >> > empty
> > >> > >>>>>> batches:
> > >> > >>>>>>>
> > >> > >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from
> > DRILL-5546
> > >> > >>>>>>>
> > >> > >>>>>>> The following are nice-to-haves that build on work already
> > done
> > >> in
> > >> > >>>>> this
> > >> > >>>>>> release, and that some of my own work depends on:
> > >> > >>>>>>>
> > >> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
> > >> > SystemOptionManager
> > >> > >>>>>> rather than mock
> > >> > >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment,
> operator
> > >> > >>>>> contexts
> > >> > >>>>>> for testing
> > >> > >>>>>>>
> > >> > >>>>>>> The following is not needed for 1.12 per-se, but is the
> > >> foundation
> > >> > >>>>> for a
> > >> > >>>>>> project I’m working on; would be good to get this in after
> 2-3
> > >> > months
> > >> > >> of
> > >> > >>>>>> review time:
> > >> > >>>>>>>
> > >> > >>>>>>> #921, foundation for batch size limitation
> > >> > >>>>>>>
> > >> > >>>>>>> The key issue with each of the above is that they each need
> a
> > >> > >>>>> committer
> > >> > >>>>>> to review. Some have reviews from non-committers. Any
> > volunteers?
> > >> > >>>>>>>
> > >> > >>>>>>> Thanks,
> > >> > >>>>>>>
> > >> > >>>>>>> - Paul
> > >> > >>>>>>>
> > >> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <
> cgivre@gmail.com>
> > >> > wrote:
> > >> > >>>>>>>>
> > >> > >>>>>>>> Hi Arina,
> > >> > >>>>>>>> I’d like to include Drill-5834, Adding network functions.
> > >> > >>>>>>>> https://github.com/apache/drill/pull/971 <
> > >> > >> https://github.com/apache/
> > >> > >>>>>> drill/pull/971>
> > >> > >>>>>>>>
> > >> > >>>>>>>> Hopefully I didn’t violate too many coding standards this
> > time
> > >> ;-)
> > >> > >>>>>>>> —C
> > >> > >>>>>>>>
> > >> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
> > >> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
> > >> > >>>>>>>>>
> > >> > >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try
> to
> > >> > finish
> > >> > >>>>> code
> > >> > >>>>>>>>> review during this week.
> > >> > >>>>>>>>>
> > >> > >>>>>>>>> Kind regards
> > >> > >>>>>>>>> Arina
> > >> > >>>>>>>>>
> > >> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
> > >> > arina@apache.org
> > >> > >>>
> > >> > >>>>>> wrote:
> > >> > >>>>>>>>>
> > >> > >>>>>>>>>> Hi Drillers,
> > >> > >>>>>>>>>>
> > >> > >>>>>>>>>> It's been several months since the last release and it is
> > >> time
> > >> > to
> > >> > >>>>> do
> > >> > >>>>>> the
> > >> > >>>>>>>>>> next one. I am volunteering to be the release manager.
> > >> > >>>>>>>>>>
> > >> > >>>>>>>>>> If there are any issues on which work is in progress,
> that
> > >> you
> > >> > >>>>> feel we
> > >> > >>>>>>>>>> *must* include in the release, please post in reply to
> this
> > >> > >> thread.
> > >> > >>>>>> Based
> > >> > >>>>>>>>>> on your input we'll define release cut off date.
> > >> > >>>>>>>>>>
> > >> > >>>>>>>>>> Kind regards
> > >> > >>>>>>>>>> Arina
> > >> > >>>>>>>>>>
> > >> > >>>>>>>>
> > >> > >>>>>>>
> > >> > >>>>>>
> > >> > >>>>>>
> > >> > >>>>>
> > >> > >>>>
> > >> > >>>>
> > >> > >>
> > >> > >>
> > >> >
> > >> >
> > >>
> > >
> > >
> >
>

Re: [DISCUSS] Drill 1.12.0 release

Posted by AnilKumar B <ak...@gmail.com>.

Hi Arina,

Sorry for the delay. Just now we squashed Kafka storage plugin commits into
one commit and pushed.

Thanks & Regards,
B Anil Kumar.

On Sat, Nov 25, 2017 at 5:56 AM, Arina Yelchiyeva <
arina.yelchiyeva@gmail.com> wrote:

> Current status:
>
> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> reviewer - Paul) - needs to squash the commits.
> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> reviewer - Paul) - needs to address some code review comments.
>
> Kind regards
> Arina
>
> On Wed, Nov 15, 2017 at 2:38 PM, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com> wrote:
>
> > Current status, we are close to the code freeze which will happen not
> > later then the end of the next week.
> >
> > Blocker:
> > DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., code
> > reviewer - Arina) - in progress.
> >
> > Targeted for 1.12 release:
> > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> > reviewer - Paul) - needs next round of code review.
> > DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> > mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - waiting
> > for Parth code review.
> > DRILL-5771: Fix serDe errors for format plugins (developer - Arina, code
> > reviewer - Tim) - code review is done, waiting for the merge.
> >
> > Kind regards
> >
> > On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cs...@mapr.com> wrote:
> >
> >> Hi Arina,
> >>
> >>
> >> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy
> >> loading schema for storage plugins. Could you or Paul take a look at the
> >> pull request for this JIRA https://github.com/apache/drill/pull/1032? I
> >> think both of you are familiar with this part.
> >>
> >>
> >> Thanks,
> >>
> >>
> >> Chunhui
> >>
> >> ________________________________
> >> From: Arina Yelchiyeva <ar...@gmail.com>
> >> Sent: Thursday, November 9, 2017 8:11:35 AM
> >> To: dev@drill.apache.org
> >> Subject: Re: [DISCUSS] Drill 1.12.0 release
> >>
> >> Yes, they are already in master.
> >>
> >> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com> wrote:
> >>
> >> > We’re including the Networking functions in this release right?
> >> >
> >> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <
> >> arina.yelchiyeva@gmail.com>
> >> > wrote:
> >> > >
> >> > > If changes will be done before cut off date, targeting mid November
> >> that
> >> > it
> >> > > will be possible to include this Jira.
> >> > >
> >> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com>
> >> wrote:
> >> > >
> >> > >> Hi Arina,
> >> > >> Can we include DRILL-4091 Support for additional GIS operations in
> >> > version
> >> > >> 1.12?  In general the code looked pretty good.  There was a unit
> test
> >> > >> missing which the developer submitted and some minor formatting
> >> issues
> >> > >> which I’m still waiting on.
> >> > >> Thanks,
> >> > >> —C
> >> > >>
> >> > >>
> >> > >>
> >> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
> >> arina.yelchiyeva@gmail.com
> >> > >
> >> > >> wrote:
> >> > >>>
> >> > >>> Current status:
> >> > >>>
> >> > >>> Blocker:
> >> > >>> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad
> R.,
> >> > code
> >> > >>> reviewer - ?) - in progress.
> >> > >>>
> >> > >>> Targeted for 1.12 release:
> >> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
> >> > >> reviewer -
> >> > >>> Arina) - code review in final stage.
> >> > >>> DRILL-4779: Kafka storage plugin support (developer - Anil &
> Kamesh,
> >> > code
> >> > >>> reviewer - Paul) - in review.
> >> > >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for
> >> PLAIN
> >> > >>> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
> >> > waiting
> >> > >>> for the code review.
> >> > >>> DRILL-5771: Fix serDe errors for format plugins (developer -
> Arina,
> >> > code
> >> > >>> reviewer - Tim) - waiting for the code review.
> >> > >>>
> >> > >>> Kind regards
> >> > >>> Arina
> >> > >>>
> >> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
> >> > >>> arina.yelchiyeva@gmail.com> wrote:
> >> > >>>
> >> > >>>> Current status:
> >> > >>>>
> >> > >>>> Targeted for 1.12 release:
> >> > >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
> >> rather
> >> > >> than
> >> > >>>> mock (developer - Paul, code reviewer - ?) - waiting for the code
> >> > review
> >> > >>>> DRILL-5842: Refactor and simplify the fragment, operator contexts
> >> for
> >> > >>>> testing (developer - Paul, code reviewer - ?) - waiting for the
> >> code
> >> > >>>> review
> >> > >>>> DRILL-5834: Adding network functions (developer - Charles, code
> >> > reviewer
> >> > >>>> - Arina) - waiting changes after code review
> >> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
> >> > >> Arina) - waiting
> >> > >>>> for the code review
> >> > >>>> DRILL-5772: Enable UTF-8 support in query string by default
> >> > (developer -
> >> > >>>> Arina, code reviewer - Paul) - finalizing approach
> >> > >>>> DRILL-4779: Kafka storage plugin support (developer - Anil, code
> >> > >> reviewer
> >> > >>>> - ?) - finishing implementation
> >> > >>>>
> >> > >>>> Under question:
> >> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna,
> >> code
> >> > >>>> reviewer - ?) - waiting for the status update from the developer
> >> > >>>>
> >> > >>>> Please free to suggest other items that are targeted for 1.12
> >> release.
> >> > >>>> There are many Jiras that have fix version marked as 1.12, it
> >> would be
> >> > >> good
> >> > >>>> if developers revisit them and update fix version to the actual
> >> one.
> >> > >>>> Link to the dashboard - https://issues.apache.org/
> >> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
> >> > DRILL&view=detail
> >> > >>>>
> >> > >>>> Kind regards
> >> > >>>> Arina
> >> > >>>>
> >> > >>>>
> >> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <
> parthc@apache.org>
> >> > >> wrote:
> >> > >>>>
> >> > >>>>> I'm waiting to merge the SSL  changes in. Waiting a couple of
> days
> >> > >> more to
> >> > >>>>> see if there are any more comments before I merge the changes
> in.
> >> > >>>>>
> >> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com>
> >> > wrote:
> >> > >>>>>
> >> > >>>>>> Hi Arina,
> >> > >>>>>>
> >> > >>>>>> In addition to my own PRs, there are several in the “active”
> >> queue
> >> > >> that
> >> > >>>>> we
> >> > >>>>>> could get in if we can just push them over the line and clear
> the
> >> > >> queue.
> >> > >>>>>> The owners of the PRs should check if we are waiting on them to
> >> take
> >> > >>>>> action.
> >> > >>>>>>
> >> > >>>>>> 977     DRILL-5849: Add freemarker lib to dependencyManagement
> to
> >> > >> ensure
> >> > >>>>>> prop…
> >> > >>>>>> 976     DRILL-5797: Choose parquet reader from read columns
> >> > >>>>>> 975     DRILL-5743: Handling column family and column scan for
> >> hbase
> >> > >>>>>> 973     DRILL-5775: Select * query on a maprdb binary table
> fails
> >> > >>>>>> 972     DRILL-5838: Fix MaprDB filter pushdown for the case of
> >> > nested
> >> > >>>>>> field (reg. of DRILL-4264)
> >> > >>>>>> 950     Drill 5431: SSL Support
> >> > >>>>>> 949     DRILL-5795: Parquet Filter push down at rowgroup level
> >> > >>>>>> 936     DRILL-5772: Add unit tests to indicate how utf-8
> support
> >> can
> >> > >> be
> >> > >>>>>> enabled / disabled in Drill
> >> > >>>>>> 904     DRILL-5717: change some date time test cases with
> >> specific
> >> > >>>>>> timezone or Local
> >> > >>>>>> 892     DRILL-5645: negation of expression causes null pointer
> >> > >> exception
> >> > >>>>>> 889     DRILL-5691: enhance scalar sub queries checking for the
> >> > >>>>> cartesian
> >> > >>>>>> join
> >> > >>>>>>
> >> > >>>>>> (Items not on the list above have become “inactive” for a
> >> variety of
> >> > >>>>>> reasons.)
> >> > >>>>>>
> >> > >>>>>> Thanks,
> >> > >>>>>>
> >> > >>>>>> - Paul
> >> > >>>>>>
> >> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com>
> >> wrote:
> >> > >>>>>>>
> >> > >>>>>>> Hi Arina,
> >> > >>>>>>>
> >> > >>>>>>> I’d like to include the following that are needed to finish up
> >> the
> >> > >>>>>> “managed” sort and spill-to-disk for hash agg:
> >> > >>>>>>>
> >> > >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
> >> > >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for
> >> "managed"
> >> > >>>>>> operators
> >> > >>>>>>> #960, DRILL-5815: Option to set query memory as percent of
> total
> >> > >>>>>>>
> >> > >>>>>>> The following is needed to resolve issues with HBase support
> in
> >> > empty
> >> > >>>>>> batches:
> >> > >>>>>>>
> >> > >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from
> DRILL-5546
> >> > >>>>>>>
> >> > >>>>>>> The following are nice-to-haves that build on work already
> done
> >> in
> >> > >>>>> this
> >> > >>>>>> release, and that some of my own work depends on:
> >> > >>>>>>>
> >> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
> >> > SystemOptionManager
> >> > >>>>>> rather than mock
> >> > >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
> >> > >>>>> contexts
> >> > >>>>>> for testing
> >> > >>>>>>>
> >> > >>>>>>> The following is not needed for 1.12 per-se, but is the
> >> foundation
> >> > >>>>> for a
> >> > >>>>>> project I’m working on; would be good to get this in after 2-3
> >> > months
> >> > >> of
> >> > >>>>>> review time:
> >> > >>>>>>>
> >> > >>>>>>> #921, foundation for batch size limitation
> >> > >>>>>>>
> >> > >>>>>>> The key issue with each of the above is that they each need a
> >> > >>>>> committer
> >> > >>>>>> to review. Some have reviews from non-committers. Any
> volunteers?
> >> > >>>>>>>
> >> > >>>>>>> Thanks,
> >> > >>>>>>>
> >> > >>>>>>> - Paul
> >> > >>>>>>>
> >> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com>
> >> > wrote:
> >> > >>>>>>>>
> >> > >>>>>>>> Hi Arina,
> >> > >>>>>>>> I’d like to include Drill-5834, Adding network functions.
> >> > >>>>>>>> https://github.com/apache/drill/pull/971 <
> >> > >> https://github.com/apache/
> >> > >>>>>> drill/pull/971>
> >> > >>>>>>>>
> >> > >>>>>>>> Hopefully I didn’t violate too many coding standards this
> time
> >> ;-)
> >> > >>>>>>>> —C
> >> > >>>>>>>>
> >> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
> >> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
> >> > >>>>>>>>>
> >> > >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to
> >> > finish
> >> > >>>>> code
> >> > >>>>>>>>> review during this week.
> >> > >>>>>>>>>
> >> > >>>>>>>>> Kind regards
> >> > >>>>>>>>> Arina
> >> > >>>>>>>>>
> >> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
> >> > arina@apache.org
> >> > >>>
> >> > >>>>>> wrote:
> >> > >>>>>>>>>
> >> > >>>>>>>>>> Hi Drillers,
> >> > >>>>>>>>>>
> >> > >>>>>>>>>> It's been several months since the last release and it is
> >> time
> >> > to
> >> > >>>>> do
> >> > >>>>>> the
> >> > >>>>>>>>>> next one. I am volunteering to be the release manager.
> >> > >>>>>>>>>>
> >> > >>>>>>>>>> If there are any issues on which work is in progress, that
> >> you
> >> > >>>>> feel we
> >> > >>>>>>>>>> *must* include in the release, please post in reply to this
> >> > >> thread.
> >> > >>>>>> Based
> >> > >>>>>>>>>> on your input we'll define release cut off date.
> >> > >>>>>>>>>>
> >> > >>>>>>>>>> Kind regards
> >> > >>>>>>>>>> Arina
> >> > >>>>>>>>>>
> >> > >>>>>>>>
> >> > >>>>>>>
> >> > >>>>>>
> >> > >>>>>>
> >> > >>>>>
> >> > >>>>
> >> > >>>>
> >> > >>
> >> > >>
> >> >
> >> >
> >>
> >
> >
>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Arina Yelchiyeva <ar...@gmail.com>.

Current status:

DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
reviewer - Paul) - needs to squash the commits.
DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
reviewer - Paul) - needs to address some code review comments.

Kind regards
Arina

On Wed, Nov 15, 2017 at 2:38 PM, Arina Yelchiyeva <
arina.yelchiyeva@gmail.com> wrote:

> Current status, we are close to the code freeze which will happen not
> later then the end of the next week.
>
> Blocker:
> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., code
> reviewer - Arina) - in progress.
>
> Targeted for 1.12 release:
> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> reviewer - Paul) - needs next round of code review.
> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - waiting
> for Parth code review.
> DRILL-5771: Fix serDe errors for format plugins (developer - Arina, code
> reviewer - Tim) - code review is done, waiting for the merge.
>
> Kind regards
>
> On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cs...@mapr.com> wrote:
>
>> Hi Arina,
>>
>>
>> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy
>> loading schema for storage plugins. Could you or Paul take a look at the
>> pull request for this JIRA https://github.com/apache/drill/pull/1032? I
>> think both of you are familiar with this part.
>>
>>
>> Thanks,
>>
>>
>> Chunhui
>>
>> ________________________________
>> From: Arina Yelchiyeva <ar...@gmail.com>
>> Sent: Thursday, November 9, 2017 8:11:35 AM
>> To: dev@drill.apache.org
>> Subject: Re: [DISCUSS] Drill 1.12.0 release
>>
>> Yes, they are already in master.
>>
>> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com> wrote:
>>
>> > We’re including the Networking functions in this release right?
>> >
>> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <
>> arina.yelchiyeva@gmail.com>
>> > wrote:
>> > >
>> > > If changes will be done before cut off date, targeting mid November
>> that
>> > it
>> > > will be possible to include this Jira.
>> > >
>> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com>
>> wrote:
>> > >
>> > >> Hi Arina,
>> > >> Can we include DRILL-4091 Support for additional GIS operations in
>> > version
>> > >> 1.12?  In general the code looked pretty good.  There was a unit test
>> > >> missing which the developer submitted and some minor formatting
>> issues
>> > >> which I’m still waiting on.
>> > >> Thanks,
>> > >> —C
>> > >>
>> > >>
>> > >>
>> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
>> arina.yelchiyeva@gmail.com
>> > >
>> > >> wrote:
>> > >>>
>> > >>> Current status:
>> > >>>
>> > >>> Blocker:
>> > >>> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
>> > code
>> > >>> reviewer - ?) - in progress.
>> > >>>
>> > >>> Targeted for 1.12 release:
>> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
>> > >> reviewer -
>> > >>> Arina) - code review in final stage.
>> > >>> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
>> > code
>> > >>> reviewer - Paul) - in review.
>> > >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for
>> PLAIN
>> > >>> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
>> > waiting
>> > >>> for the code review.
>> > >>> DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
>> > code
>> > >>> reviewer - Tim) - waiting for the code review.
>> > >>>
>> > >>> Kind regards
>> > >>> Arina
>> > >>>
>> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
>> > >>> arina.yelchiyeva@gmail.com> wrote:
>> > >>>
>> > >>>> Current status:
>> > >>>>
>> > >>>> Targeted for 1.12 release:
>> > >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
>> rather
>> > >> than
>> > >>>> mock (developer - Paul, code reviewer - ?) - waiting for the code
>> > review
>> > >>>> DRILL-5842: Refactor and simplify the fragment, operator contexts
>> for
>> > >>>> testing (developer - Paul, code reviewer - ?) - waiting for the
>> code
>> > >>>> review
>> > >>>> DRILL-5834: Adding network functions (developer - Charles, code
>> > reviewer
>> > >>>> - Arina) - waiting changes after code review
>> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
>> > >> Arina) - waiting
>> > >>>> for the code review
>> > >>>> DRILL-5772: Enable UTF-8 support in query string by default
>> > (developer -
>> > >>>> Arina, code reviewer - Paul) - finalizing approach
>> > >>>> DRILL-4779: Kafka storage plugin support (developer - Anil, code
>> > >> reviewer
>> > >>>> - ?) - finishing implementation
>> > >>>>
>> > >>>> Under question:
>> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna,
>> code
>> > >>>> reviewer - ?) - waiting for the status update from the developer
>> > >>>>
>> > >>>> Please free to suggest other items that are targeted for 1.12
>> release.
>> > >>>> There are many Jiras that have fix version marked as 1.12, it
>> would be
>> > >> good
>> > >>>> if developers revisit them and update fix version to the actual
>> one.
>> > >>>> Link to the dashboard - https://issues.apache.org/
>> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
>> > DRILL&view=detail
>> > >>>>
>> > >>>> Kind regards
>> > >>>> Arina
>> > >>>>
>> > >>>>
>> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org>
>> > >> wrote:
>> > >>>>
>> > >>>>> I'm waiting to merge the SSL  changes in. Waiting a couple of days
>> > >> more to
>> > >>>>> see if there are any more comments before I merge the changes in.
>> > >>>>>
>> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com>
>> > wrote:
>> > >>>>>
>> > >>>>>> Hi Arina,
>> > >>>>>>
>> > >>>>>> In addition to my own PRs, there are several in the “active”
>> queue
>> > >> that
>> > >>>>> we
>> > >>>>>> could get in if we can just push them over the line and clear the
>> > >> queue.
>> > >>>>>> The owners of the PRs should check if we are waiting on them to
>> take
>> > >>>>> action.
>> > >>>>>>
>> > >>>>>> 977     DRILL-5849: Add freemarker lib to dependencyManagement to
>> > >> ensure
>> > >>>>>> prop…
>> > >>>>>> 976     DRILL-5797: Choose parquet reader from read columns
>> > >>>>>> 975     DRILL-5743: Handling column family and column scan for
>> hbase
>> > >>>>>> 973     DRILL-5775: Select * query on a maprdb binary table fails
>> > >>>>>> 972     DRILL-5838: Fix MaprDB filter pushdown for the case of
>> > nested
>> > >>>>>> field (reg. of DRILL-4264)
>> > >>>>>> 950     Drill 5431: SSL Support
>> > >>>>>> 949     DRILL-5795: Parquet Filter push down at rowgroup level
>> > >>>>>> 936     DRILL-5772: Add unit tests to indicate how utf-8 support
>> can
>> > >> be
>> > >>>>>> enabled / disabled in Drill
>> > >>>>>> 904     DRILL-5717: change some date time test cases with
>> specific
>> > >>>>>> timezone or Local
>> > >>>>>> 892     DRILL-5645: negation of expression causes null pointer
>> > >> exception
>> > >>>>>> 889     DRILL-5691: enhance scalar sub queries checking for the
>> > >>>>> cartesian
>> > >>>>>> join
>> > >>>>>>
>> > >>>>>> (Items not on the list above have become “inactive” for a
>> variety of
>> > >>>>>> reasons.)
>> > >>>>>>
>> > >>>>>> Thanks,
>> > >>>>>>
>> > >>>>>> - Paul
>> > >>>>>>
>> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com>
>> wrote:
>> > >>>>>>>
>> > >>>>>>> Hi Arina,
>> > >>>>>>>
>> > >>>>>>> I’d like to include the following that are needed to finish up
>> the
>> > >>>>>> “managed” sort and spill-to-disk for hash agg:
>> > >>>>>>>
>> > >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
>> > >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for
>> "managed"
>> > >>>>>> operators
>> > >>>>>>> #960, DRILL-5815: Option to set query memory as percent of total
>> > >>>>>>>
>> > >>>>>>> The following is needed to resolve issues with HBase support in
>> > empty
>> > >>>>>> batches:
>> > >>>>>>>
>> > >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
>> > >>>>>>>
>> > >>>>>>> The following are nice-to-haves that build on work already done
>> in
>> > >>>>> this
>> > >>>>>> release, and that some of my own work depends on:
>> > >>>>>>>
>> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
>> > SystemOptionManager
>> > >>>>>> rather than mock
>> > >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
>> > >>>>> contexts
>> > >>>>>> for testing
>> > >>>>>>>
>> > >>>>>>> The following is not needed for 1.12 per-se, but is the
>> foundation
>> > >>>>> for a
>> > >>>>>> project I’m working on; would be good to get this in after 2-3
>> > months
>> > >> of
>> > >>>>>> review time:
>> > >>>>>>>
>> > >>>>>>> #921, foundation for batch size limitation
>> > >>>>>>>
>> > >>>>>>> The key issue with each of the above is that they each need a
>> > >>>>> committer
>> > >>>>>> to review. Some have reviews from non-committers. Any volunteers?
>> > >>>>>>>
>> > >>>>>>> Thanks,
>> > >>>>>>>
>> > >>>>>>> - Paul
>> > >>>>>>>
>> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com>
>> > wrote:
>> > >>>>>>>>
>> > >>>>>>>> Hi Arina,
>> > >>>>>>>> I’d like to include Drill-5834, Adding network functions.
>> > >>>>>>>> https://github.com/apache/drill/pull/971 <
>> > >> https://github.com/apache/
>> > >>>>>> drill/pull/971>
>> > >>>>>>>>
>> > >>>>>>>> Hopefully I didn’t violate too many coding standards this time
>> ;-)
>> > >>>>>>>> —C
>> > >>>>>>>>
>> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
>> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
>> > >>>>>>>>>
>> > >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to
>> > finish
>> > >>>>> code
>> > >>>>>>>>> review during this week.
>> > >>>>>>>>>
>> > >>>>>>>>> Kind regards
>> > >>>>>>>>> Arina
>> > >>>>>>>>>
>> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
>> > arina@apache.org
>> > >>>
>> > >>>>>> wrote:
>> > >>>>>>>>>
>> > >>>>>>>>>> Hi Drillers,
>> > >>>>>>>>>>
>> > >>>>>>>>>> It's been several months since the last release and it is
>> time
>> > to
>> > >>>>> do
>> > >>>>>> the
>> > >>>>>>>>>> next one. I am volunteering to be the release manager.
>> > >>>>>>>>>>
>> > >>>>>>>>>> If there are any issues on which work is in progress, that
>> you
>> > >>>>> feel we
>> > >>>>>>>>>> *must* include in the release, please post in reply to this
>> > >> thread.
>> > >>>>>> Based
>> > >>>>>>>>>> on your input we'll define release cut off date.
>> > >>>>>>>>>>
>> > >>>>>>>>>> Kind regards
>> > >>>>>>>>>> Arina
>> > >>>>>>>>>>
>> > >>>>>>>>
>> > >>>>>>>
>> > >>>>>>
>> > >>>>>>
>> > >>>>>
>> > >>>>
>> > >>>>
>> > >>
>> > >>
>> >
>> >
>>
>
>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Arina Yelchiyeva <ar...@gmail.com>.

Current status, we are close to the code freeze which will happen not later
then the end of the next week.

Blocker:
DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., code
reviewer - Arina) - in progress.

Targeted for 1.12 release:
DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
reviewer - Paul) - needs next round of code review.
DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - waiting
for Parth code review.
DRILL-5771: Fix serDe errors for format plugins (developer - Arina, code
reviewer - Tim) - code review is done, waiting for the merge.

Kind regards

On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cs...@mapr.com> wrote:

> Hi Arina,
>
>
> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy
> loading schema for storage plugins. Could you or Paul take a look at the
> pull request for this JIRA https://github.com/apache/drill/pull/1032? I
> think both of you are familiar with this part.
>
>
> Thanks,
>
>
> Chunhui
>
> ________________________________
> From: Arina Yelchiyeva <ar...@gmail.com>
> Sent: Thursday, November 9, 2017 8:11:35 AM
> To: dev@drill.apache.org
> Subject: Re: [DISCUSS] Drill 1.12.0 release
>
> Yes, they are already in master.
>
> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com> wrote:
>
> > We’re including the Networking functions in this release right?
> >
> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <arina.yelchiyeva@gmail.com
> >
> > wrote:
> > >
> > > If changes will be done before cut off date, targeting mid November
> that
> > it
> > > will be possible to include this Jira.
> > >
> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com>
> wrote:
> > >
> > >> Hi Arina,
> > >> Can we include DRILL-4091 Support for additional GIS operations in
> > version
> > >> 1.12?  In general the code looked pretty good.  There was a unit test
> > >> missing which the developer submitted and some minor formatting issues
> > >> which I’m still waiting on.
> > >> Thanks,
> > >> —C
> > >>
> > >>
> > >>
> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com
> > >
> > >> wrote:
> > >>>
> > >>> Current status:
> > >>>
> > >>> Blocker:
> > >>> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
> > code
> > >>> reviewer - ?) - in progress.
> > >>>
> > >>> Targeted for 1.12 release:
> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
> > >> reviewer -
> > >>> Arina) - code review in final stage.
> > >>> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
> > code
> > >>> reviewer - Paul) - in review.
> > >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> > >>> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
> > waiting
> > >>> for the code review.
> > >>> DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
> > code
> > >>> reviewer - Tim) - waiting for the code review.
> > >>>
> > >>> Kind regards
> > >>> Arina
> > >>>
> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
> > >>> arina.yelchiyeva@gmail.com> wrote:
> > >>>
> > >>>> Current status:
> > >>>>
> > >>>> Targeted for 1.12 release:
> > >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
> rather
> > >> than
> > >>>> mock (developer - Paul, code reviewer - ?) - waiting for the code
> > review
> > >>>> DRILL-5842: Refactor and simplify the fragment, operator contexts
> for
> > >>>> testing (developer - Paul, code reviewer - ?) - waiting for the code
> > >>>> review
> > >>>> DRILL-5834: Adding network functions (developer - Charles, code
> > reviewer
> > >>>> - Arina) - waiting changes after code review
> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
> > >> Arina) - waiting
> > >>>> for the code review
> > >>>> DRILL-5772: Enable UTF-8 support in query string by default
> > (developer -
> > >>>> Arina, code reviewer - Paul) - finalizing approach
> > >>>> DRILL-4779: Kafka storage plugin support (developer - Anil, code
> > >> reviewer
> > >>>> - ?) - finishing implementation
> > >>>>
> > >>>> Under question:
> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna,
> code
> > >>>> reviewer - ?) - waiting for the status update from the developer
> > >>>>
> > >>>> Please free to suggest other items that are targeted for 1.12
> release.
> > >>>> There are many Jiras that have fix version marked as 1.12, it would
> be
> > >> good
> > >>>> if developers revisit them and update fix version to the actual one.
> > >>>> Link to the dashboard - https://issues.apache.org/
> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
> > DRILL&view=detail
> > >>>>
> > >>>> Kind regards
> > >>>> Arina
> > >>>>
> > >>>>
> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org>
> > >> wrote:
> > >>>>
> > >>>>> I'm waiting to merge the SSL  changes in. Waiting a couple of days
> > >> more to
> > >>>>> see if there are any more comments before I merge the changes in.
> > >>>>>
> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com>
> > wrote:
> > >>>>>
> > >>>>>> Hi Arina,
> > >>>>>>
> > >>>>>> In addition to my own PRs, there are several in the “active” queue
> > >> that
> > >>>>> we
> > >>>>>> could get in if we can just push them over the line and clear the
> > >> queue.
> > >>>>>> The owners of the PRs should check if we are waiting on them to
> take
> > >>>>> action.
> > >>>>>>
> > >>>>>> 977     DRILL-5849: Add freemarker lib to dependencyManagement to
> > >> ensure
> > >>>>>> prop…
> > >>>>>> 976     DRILL-5797: Choose parquet reader from read columns
> > >>>>>> 975     DRILL-5743: Handling column family and column scan for
> hbase
> > >>>>>> 973     DRILL-5775: Select * query on a maprdb binary table fails
> > >>>>>> 972     DRILL-5838: Fix MaprDB filter pushdown for the case of
> > nested
> > >>>>>> field (reg. of DRILL-4264)
> > >>>>>> 950     Drill 5431: SSL Support
> > >>>>>> 949     DRILL-5795: Parquet Filter push down at rowgroup level
> > >>>>>> 936     DRILL-5772: Add unit tests to indicate how utf-8 support
> can
> > >> be
> > >>>>>> enabled / disabled in Drill
> > >>>>>> 904     DRILL-5717: change some date time test cases with specific
> > >>>>>> timezone or Local
> > >>>>>> 892     DRILL-5645: negation of expression causes null pointer
> > >> exception
> > >>>>>> 889     DRILL-5691: enhance scalar sub queries checking for the
> > >>>>> cartesian
> > >>>>>> join
> > >>>>>>
> > >>>>>> (Items not on the list above have become “inactive” for a variety
> of
> > >>>>>> reasons.)
> > >>>>>>
> > >>>>>> Thanks,
> > >>>>>>
> > >>>>>> - Paul
> > >>>>>>
> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com>
> wrote:
> > >>>>>>>
> > >>>>>>> Hi Arina,
> > >>>>>>>
> > >>>>>>> I’d like to include the following that are needed to finish up
> the
> > >>>>>> “managed” sort and spill-to-disk for hash agg:
> > >>>>>>>
> > >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
> > >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for
> "managed"
> > >>>>>> operators
> > >>>>>>> #960, DRILL-5815: Option to set query memory as percent of total
> > >>>>>>>
> > >>>>>>> The following is needed to resolve issues with HBase support in
> > empty
> > >>>>>> batches:
> > >>>>>>>
> > >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
> > >>>>>>>
> > >>>>>>> The following are nice-to-haves that build on work already done
> in
> > >>>>> this
> > >>>>>> release, and that some of my own work depends on:
> > >>>>>>>
> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
> > SystemOptionManager
> > >>>>>> rather than mock
> > >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
> > >>>>> contexts
> > >>>>>> for testing
> > >>>>>>>
> > >>>>>>> The following is not needed for 1.12 per-se, but is the
> foundation
> > >>>>> for a
> > >>>>>> project I’m working on; would be good to get this in after 2-3
> > months
> > >> of
> > >>>>>> review time:
> > >>>>>>>
> > >>>>>>> #921, foundation for batch size limitation
> > >>>>>>>
> > >>>>>>> The key issue with each of the above is that they each need a
> > >>>>> committer
> > >>>>>> to review. Some have reviews from non-committers. Any volunteers?
> > >>>>>>>
> > >>>>>>> Thanks,
> > >>>>>>>
> > >>>>>>> - Paul
> > >>>>>>>
> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com>
> > wrote:
> > >>>>>>>>
> > >>>>>>>> Hi Arina,
> > >>>>>>>> I’d like to include Drill-5834, Adding network functions.
> > >>>>>>>> https://github.com/apache/drill/pull/971 <
> > >> https://github.com/apache/
> > >>>>>> drill/pull/971>
> > >>>>>>>>
> > >>>>>>>> Hopefully I didn’t violate too many coding standards this time
> ;-)
> > >>>>>>>> —C
> > >>>>>>>>
> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
> > >>>>>>>>>
> > >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to
> > finish
> > >>>>> code
> > >>>>>>>>> review during this week.
> > >>>>>>>>>
> > >>>>>>>>> Kind regards
> > >>>>>>>>> Arina
> > >>>>>>>>>
> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
> > arina@apache.org
> > >>>
> > >>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> Hi Drillers,
> > >>>>>>>>>>
> > >>>>>>>>>> It's been several months since the last release and it is time
> > to
> > >>>>> do
> > >>>>>> the
> > >>>>>>>>>> next one. I am volunteering to be the release manager.
> > >>>>>>>>>>
> > >>>>>>>>>> If there are any issues on which work is in progress, that you
> > >>>>> feel we
> > >>>>>>>>>> *must* include in the release, please post in reply to this
> > >> thread.
> > >>>>>> Based
> > >>>>>>>>>> on your input we'll define release cut off date.
> > >>>>>>>>>>
> > >>>>>>>>>> Kind regards
> > >>>>>>>>>> Arina
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>
> > >>>>
> > >>>>
> > >>
> > >>
> >
> >
>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Chunhui Shi <cs...@mapr.com>.

Hi Arina,


Could we consider to include DRILL-5089 in 1.12.0? It is about lazy loading schema for storage plugins. Could you or Paul take a look at the pull request for this JIRA https://github.com/apache/drill/pull/1032? I think both of you are familiar with this part.


Thanks,


Chunhui

________________________________
From: Arina Yelchiyeva <ar...@gmail.com>
Sent: Thursday, November 9, 2017 8:11:35 AM
To: dev@drill.apache.org
Subject: Re: [DISCUSS] Drill 1.12.0 release

Yes, they are already in master.

On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com> wrote:

> We’re including the Networking functions in this release right?
>
> > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <ar...@gmail.com>
> wrote:
> >
> > If changes will be done before cut off date, targeting mid November that
> it
> > will be possible to include this Jira.
> >
> > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com> wrote:
> >
> >> Hi Arina,
> >> Can we include DRILL-4091 Support for additional GIS operations in
> version
> >> 1.12?  In general the code looked pretty good.  There was a unit test
> >> missing which the developer submitted and some minor formatting issues
> >> which I’m still waiting on.
> >> Thanks,
> >> —C
> >>
> >>
> >>
> >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <arina.yelchiyeva@gmail.com
> >
> >> wrote:
> >>>
> >>> Current status:
> >>>
> >>> Blocker:
> >>> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
> code
> >>> reviewer - ?) - in progress.
> >>>
> >>> Targeted for 1.12 release:
> >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
> >> reviewer -
> >>> Arina) - code review in final stage.
> >>> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
> code
> >>> reviewer - Paul) - in review.
> >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> >>> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
> waiting
> >>> for the code review.
> >>> DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
> code
> >>> reviewer - Tim) - waiting for the code review.
> >>>
> >>> Kind regards
> >>> Arina
> >>>
> >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
> >>> arina.yelchiyeva@gmail.com> wrote:
> >>>
> >>>> Current status:
> >>>>
> >>>> Targeted for 1.12 release:
> >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather
> >> than
> >>>> mock (developer - Paul, code reviewer - ?) - waiting for the code
> review
> >>>> DRILL-5842: Refactor and simplify the fragment, operator contexts for
> >>>> testing (developer - Paul, code reviewer - ?) - waiting for the code
> >>>> review
> >>>> DRILL-5834: Adding network functions (developer - Charles, code
> reviewer
> >>>> - Arina) - waiting changes after code review
> >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
> >> Arina) - waiting
> >>>> for the code review
> >>>> DRILL-5772: Enable UTF-8 support in query string by default
> (developer -
> >>>> Arina, code reviewer - Paul) - finalizing approach
> >>>> DRILL-4779: Kafka storage plugin support (developer - Anil, code
> >> reviewer
> >>>> - ?) - finishing implementation
> >>>>
> >>>> Under question:
> >>>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> >>>> reviewer - ?) - waiting for the status update from the developer
> >>>>
> >>>> Please free to suggest other items that are targeted for 1.12 release.
> >>>> There are many Jiras that have fix version marked as 1.12, it would be
> >> good
> >>>> if developers revisit them and update fix version to the actual one.
> >>>> Link to the dashboard - https://issues.apache.org/
> >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
> DRILL&view=detail
> >>>>
> >>>> Kind regards
> >>>> Arina
> >>>>
> >>>>
> >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org>
> >> wrote:
> >>>>
> >>>>> I'm waiting to merge the SSL  changes in. Waiting a couple of days
> >> more to
> >>>>> see if there are any more comments before I merge the changes in.
> >>>>>
> >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com>
> wrote:
> >>>>>
> >>>>>> Hi Arina,
> >>>>>>
> >>>>>> In addition to my own PRs, there are several in the “active” queue
> >> that
> >>>>> we
> >>>>>> could get in if we can just push them over the line and clear the
> >> queue.
> >>>>>> The owners of the PRs should check if we are waiting on them to take
> >>>>> action.
> >>>>>>
> >>>>>> 977     DRILL-5849: Add freemarker lib to dependencyManagement to
> >> ensure
> >>>>>> prop…
> >>>>>> 976     DRILL-5797: Choose parquet reader from read columns
> >>>>>> 975     DRILL-5743: Handling column family and column scan for hbase
> >>>>>> 973     DRILL-5775: Select * query on a maprdb binary table fails
> >>>>>> 972     DRILL-5838: Fix MaprDB filter pushdown for the case of
> nested
> >>>>>> field (reg. of DRILL-4264)
> >>>>>> 950     Drill 5431: SSL Support
> >>>>>> 949     DRILL-5795: Parquet Filter push down at rowgroup level
> >>>>>> 936     DRILL-5772: Add unit tests to indicate how utf-8 support can
> >> be
> >>>>>> enabled / disabled in Drill
> >>>>>> 904     DRILL-5717: change some date time test cases with specific
> >>>>>> timezone or Local
> >>>>>> 892     DRILL-5645: negation of expression causes null pointer
> >> exception
> >>>>>> 889     DRILL-5691: enhance scalar sub queries checking for the
> >>>>> cartesian
> >>>>>> join
> >>>>>>
> >>>>>> (Items not on the list above have become “inactive” for a variety of
> >>>>>> reasons.)
> >>>>>>
> >>>>>> Thanks,
> >>>>>>
> >>>>>> - Paul
> >>>>>>
> >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
> >>>>>>>
> >>>>>>> Hi Arina,
> >>>>>>>
> >>>>>>> I’d like to include the following that are needed to finish up the
> >>>>>> “managed” sort and spill-to-disk for hash agg:
> >>>>>>>
> >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
> >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for "managed"
> >>>>>> operators
> >>>>>>> #960, DRILL-5815: Option to set query memory as percent of total
> >>>>>>>
> >>>>>>> The following is needed to resolve issues with HBase support in
> empty
> >>>>>> batches:
> >>>>>>>
> >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
> >>>>>>>
> >>>>>>> The following are nice-to-haves that build on work already done in
> >>>>> this
> >>>>>> release, and that some of my own work depends on:
> >>>>>>>
> >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
> SystemOptionManager
> >>>>>> rather than mock
> >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
> >>>>> contexts
> >>>>>> for testing
> >>>>>>>
> >>>>>>> The following is not needed for 1.12 per-se, but is the foundation
> >>>>> for a
> >>>>>> project I’m working on; would be good to get this in after 2-3
> months
> >> of
> >>>>>> review time:
> >>>>>>>
> >>>>>>> #921, foundation for batch size limitation
> >>>>>>>
> >>>>>>> The key issue with each of the above is that they each need a
> >>>>> committer
> >>>>>> to review. Some have reviews from non-committers. Any volunteers?
> >>>>>>>
> >>>>>>> Thanks,
> >>>>>>>
> >>>>>>> - Paul
> >>>>>>>
> >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com>
> wrote:
> >>>>>>>>
> >>>>>>>> Hi Arina,
> >>>>>>>> I’d like to include Drill-5834, Adding network functions.
> >>>>>>>> https://github.com/apache/drill/pull/971 <
> >> https://github.com/apache/
> >>>>>> drill/pull/971>
> >>>>>>>>
> >>>>>>>> Hopefully I didn’t violate too many coding standards this time ;-)
> >>>>>>>> —C
> >>>>>>>>
> >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
> >>>>>> arina.yelchiyeva@gmail.com> wrote:
> >>>>>>>>>
> >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to
> finish
> >>>>> code
> >>>>>>>>> review during this week.
> >>>>>>>>>
> >>>>>>>>> Kind regards
> >>>>>>>>> Arina
> >>>>>>>>>
> >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
> arina@apache.org
> >>>
> >>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Hi Drillers,
> >>>>>>>>>>
> >>>>>>>>>> It's been several months since the last release and it is time
> to
> >>>>> do
> >>>>>> the
> >>>>>>>>>> next one. I am volunteering to be the release manager.
> >>>>>>>>>>
> >>>>>>>>>> If there are any issues on which work is in progress, that you
> >>>>> feel we
> >>>>>>>>>> *must* include in the release, please post in reply to this
> >> thread.
> >>>>>> Based
> >>>>>>>>>> on your input we'll define release cut off date.
> >>>>>>>>>>
> >>>>>>>>>> Kind regards
> >>>>>>>>>> Arina
> >>>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>>
> >>
> >>
>
>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Arina Yelchiyeva <ar...@gmail.com>.

Yes, they are already in master.

On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com> wrote:

> We’re including the Networking functions in this release right?
>
> > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <ar...@gmail.com>
> wrote:
> >
> > If changes will be done before cut off date, targeting mid November that
> it
> > will be possible to include this Jira.
> >
> > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com> wrote:
> >
> >> Hi Arina,
> >> Can we include DRILL-4091 Support for additional GIS operations in
> version
> >> 1.12?  In general the code looked pretty good.  There was a unit test
> >> missing which the developer submitted and some minor formatting issues
> >> which I’m still waiting on.
> >> Thanks,
> >> —C
> >>
> >>
> >>
> >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <arina.yelchiyeva@gmail.com
> >
> >> wrote:
> >>>
> >>> Current status:
> >>>
> >>> Blocker:
> >>> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
> code
> >>> reviewer - ?) - in progress.
> >>>
> >>> Targeted for 1.12 release:
> >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
> >> reviewer -
> >>> Arina) - code review in final stage.
> >>> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
> code
> >>> reviewer - Paul) - in review.
> >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> >>> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
> waiting
> >>> for the code review.
> >>> DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
> code
> >>> reviewer - Tim) - waiting for the code review.
> >>>
> >>> Kind regards
> >>> Arina
> >>>
> >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
> >>> arina.yelchiyeva@gmail.com> wrote:
> >>>
> >>>> Current status:
> >>>>
> >>>> Targeted for 1.12 release:
> >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather
> >> than
> >>>> mock (developer - Paul, code reviewer - ?) - waiting for the code
> review
> >>>> DRILL-5842: Refactor and simplify the fragment, operator contexts for
> >>>> testing (developer - Paul, code reviewer - ?) - waiting for the code
> >>>> review
> >>>> DRILL-5834: Adding network functions (developer - Charles, code
> reviewer
> >>>> - Arina) - waiting changes after code review
> >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
> >> Arina) - waiting
> >>>> for the code review
> >>>> DRILL-5772: Enable UTF-8 support in query string by default
> (developer -
> >>>> Arina, code reviewer - Paul) - finalizing approach
> >>>> DRILL-4779: Kafka storage plugin support (developer - Anil, code
> >> reviewer
> >>>> - ?) - finishing implementation
> >>>>
> >>>> Under question:
> >>>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> >>>> reviewer - ?) - waiting for the status update from the developer
> >>>>
> >>>> Please free to suggest other items that are targeted for 1.12 release.
> >>>> There are many Jiras that have fix version marked as 1.12, it would be
> >> good
> >>>> if developers revisit them and update fix version to the actual one.
> >>>> Link to the dashboard - https://issues.apache.org/
> >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
> DRILL&view=detail
> >>>>
> >>>> Kind regards
> >>>> Arina
> >>>>
> >>>>
> >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org>
> >> wrote:
> >>>>
> >>>>> I'm waiting to merge the SSL  changes in. Waiting a couple of days
> >> more to
> >>>>> see if there are any more comments before I merge the changes in.
> >>>>>
> >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com>
> wrote:
> >>>>>
> >>>>>> Hi Arina,
> >>>>>>
> >>>>>> In addition to my own PRs, there are several in the “active” queue
> >> that
> >>>>> we
> >>>>>> could get in if we can just push them over the line and clear the
> >> queue.
> >>>>>> The owners of the PRs should check if we are waiting on them to take
> >>>>> action.
> >>>>>>
> >>>>>> 977     DRILL-5849: Add freemarker lib to dependencyManagement to
> >> ensure
> >>>>>> prop…
> >>>>>> 976     DRILL-5797: Choose parquet reader from read columns
> >>>>>> 975     DRILL-5743: Handling column family and column scan for hbase
> >>>>>> 973     DRILL-5775: Select * query on a maprdb binary table fails
> >>>>>> 972     DRILL-5838: Fix MaprDB filter pushdown for the case of
> nested
> >>>>>> field (reg. of DRILL-4264)
> >>>>>> 950     Drill 5431: SSL Support
> >>>>>> 949     DRILL-5795: Parquet Filter push down at rowgroup level
> >>>>>> 936     DRILL-5772: Add unit tests to indicate how utf-8 support can
> >> be
> >>>>>> enabled / disabled in Drill
> >>>>>> 904     DRILL-5717: change some date time test cases with specific
> >>>>>> timezone or Local
> >>>>>> 892     DRILL-5645: negation of expression causes null pointer
> >> exception
> >>>>>> 889     DRILL-5691: enhance scalar sub queries checking for the
> >>>>> cartesian
> >>>>>> join
> >>>>>>
> >>>>>> (Items not on the list above have become “inactive” for a variety of
> >>>>>> reasons.)
> >>>>>>
> >>>>>> Thanks,
> >>>>>>
> >>>>>> - Paul
> >>>>>>
> >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
> >>>>>>>
> >>>>>>> Hi Arina,
> >>>>>>>
> >>>>>>> I’d like to include the following that are needed to finish up the
> >>>>>> “managed” sort and spill-to-disk for hash agg:
> >>>>>>>
> >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
> >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for "managed"
> >>>>>> operators
> >>>>>>> #960, DRILL-5815: Option to set query memory as percent of total
> >>>>>>>
> >>>>>>> The following is needed to resolve issues with HBase support in
> empty
> >>>>>> batches:
> >>>>>>>
> >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
> >>>>>>>
> >>>>>>> The following are nice-to-haves that build on work already done in
> >>>>> this
> >>>>>> release, and that some of my own work depends on:
> >>>>>>>
> >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
> SystemOptionManager
> >>>>>> rather than mock
> >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
> >>>>> contexts
> >>>>>> for testing
> >>>>>>>
> >>>>>>> The following is not needed for 1.12 per-se, but is the foundation
> >>>>> for a
> >>>>>> project I’m working on; would be good to get this in after 2-3
> months
> >> of
> >>>>>> review time:
> >>>>>>>
> >>>>>>> #921, foundation for batch size limitation
> >>>>>>>
> >>>>>>> The key issue with each of the above is that they each need a
> >>>>> committer
> >>>>>> to review. Some have reviews from non-committers. Any volunteers?
> >>>>>>>
> >>>>>>> Thanks,
> >>>>>>>
> >>>>>>> - Paul
> >>>>>>>
> >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com>
> wrote:
> >>>>>>>>
> >>>>>>>> Hi Arina,
> >>>>>>>> I’d like to include Drill-5834, Adding network functions.
> >>>>>>>> https://github.com/apache/drill/pull/971 <
> >> https://github.com/apache/
> >>>>>> drill/pull/971>
> >>>>>>>>
> >>>>>>>> Hopefully I didn’t violate too many coding standards this time ;-)
> >>>>>>>> —C
> >>>>>>>>
> >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
> >>>>>> arina.yelchiyeva@gmail.com> wrote:
> >>>>>>>>>
> >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to
> finish
> >>>>> code
> >>>>>>>>> review during this week.
> >>>>>>>>>
> >>>>>>>>> Kind regards
> >>>>>>>>> Arina
> >>>>>>>>>
> >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
> arina@apache.org
> >>>
> >>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Hi Drillers,
> >>>>>>>>>>
> >>>>>>>>>> It's been several months since the last release and it is time
> to
> >>>>> do
> >>>>>> the
> >>>>>>>>>> next one. I am volunteering to be the release manager.
> >>>>>>>>>>
> >>>>>>>>>> If there are any issues on which work is in progress, that you
> >>>>> feel we
> >>>>>>>>>> *must* include in the release, please post in reply to this
> >> thread.
> >>>>>> Based
> >>>>>>>>>> on your input we'll define release cut off date.
> >>>>>>>>>>
> >>>>>>>>>> Kind regards
> >>>>>>>>>> Arina
> >>>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>>
> >>
> >>
>
>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Charles Givre <cg...@gmail.com>.

We’re including the Networking functions in this release right?

> On Nov 9, 2017, at 11:04, Arina Yelchiyeva <ar...@gmail.com> wrote:
> 
> If changes will be done before cut off date, targeting mid November that it
> will be possible to include this Jira.
> 
> On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com> wrote:
> 
>> Hi Arina,
>> Can we include DRILL-4091 Support for additional GIS operations in version
>> 1.12?  In general the code looked pretty good.  There was a unit test
>> missing which the developer submitted and some minor formatting issues
>> which I’m still waiting on.
>> Thanks,
>> —C
>> 
>> 
>> 
>>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <ar...@gmail.com>
>> wrote:
>>> 
>>> Current status:
>>> 
>>> Blocker:
>>> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., code
>>> reviewer - ?) - in progress.
>>> 
>>> Targeted for 1.12 release:
>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
>> reviewer -
>>> Arina) - code review in final stage.
>>> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
>>> reviewer - Paul) - in review.
>>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
>>> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - waiting
>>> for the code review.
>>> DRILL-5771: Fix serDe errors for format plugins (developer - Arina, code
>>> reviewer - Tim) - waiting for the code review.
>>> 
>>> Kind regards
>>> Arina
>>> 
>>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
>>> arina.yelchiyeva@gmail.com> wrote:
>>> 
>>>> Current status:
>>>> 
>>>> Targeted for 1.12 release:
>>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather
>> than
>>>> mock (developer - Paul, code reviewer - ?) - waiting for the code review
>>>> DRILL-5842: Refactor and simplify the fragment, operator contexts for
>>>> testing (developer - Paul, code reviewer - ?) - waiting for the code
>>>> review
>>>> DRILL-5834: Adding network functions (developer - Charles, code reviewer
>>>> - Arina) - waiting changes after code review
>>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
>> Arina) - waiting
>>>> for the code review
>>>> DRILL-5772: Enable UTF-8 support in query string by default (developer -
>>>> Arina, code reviewer - Paul) - finalizing approach
>>>> DRILL-4779: Kafka storage plugin support (developer - Anil, code
>> reviewer
>>>> - ?) - finishing implementation
>>>> 
>>>> Under question:
>>>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
>>>> reviewer - ?) - waiting for the status update from the developer
>>>> 
>>>> Please free to suggest other items that are targeted for 1.12 release.
>>>> There are many Jiras that have fix version marked as 1.12, it would be
>> good
>>>> if developers revisit them and update fix version to the actual one.
>>>> Link to the dashboard - https://issues.apache.org/
>>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=DRILL&view=detail
>>>> 
>>>> Kind regards
>>>> Arina
>>>> 
>>>> 
>>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org>
>> wrote:
>>>> 
>>>>> I'm waiting to merge the SSL  changes in. Waiting a couple of days
>> more to
>>>>> see if there are any more comments before I merge the changes in.
>>>>> 
>>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com> wrote:
>>>>> 
>>>>>> Hi Arina,
>>>>>> 
>>>>>> In addition to my own PRs, there are several in the “active” queue
>> that
>>>>> we
>>>>>> could get in if we can just push them over the line and clear the
>> queue.
>>>>>> The owners of the PRs should check if we are waiting on them to take
>>>>> action.
>>>>>> 
>>>>>> 977     DRILL-5849: Add freemarker lib to dependencyManagement to
>> ensure
>>>>>> prop…
>>>>>> 976     DRILL-5797: Choose parquet reader from read columns
>>>>>> 975     DRILL-5743: Handling column family and column scan for hbase
>>>>>> 973     DRILL-5775: Select * query on a maprdb binary table fails
>>>>>> 972     DRILL-5838: Fix MaprDB filter pushdown for the case of nested
>>>>>> field (reg. of DRILL-4264)
>>>>>> 950     Drill 5431: SSL Support
>>>>>> 949     DRILL-5795: Parquet Filter push down at rowgroup level
>>>>>> 936     DRILL-5772: Add unit tests to indicate how utf-8 support can
>> be
>>>>>> enabled / disabled in Drill
>>>>>> 904     DRILL-5717: change some date time test cases with specific
>>>>>> timezone or Local
>>>>>> 892     DRILL-5645: negation of expression causes null pointer
>> exception
>>>>>> 889     DRILL-5691: enhance scalar sub queries checking for the
>>>>> cartesian
>>>>>> join
>>>>>> 
>>>>>> (Items not on the list above have become “inactive” for a variety of
>>>>>> reasons.)
>>>>>> 
>>>>>> Thanks,
>>>>>> 
>>>>>> - Paul
>>>>>> 
>>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
>>>>>>> 
>>>>>>> Hi Arina,
>>>>>>> 
>>>>>>> I’d like to include the following that are needed to finish up the
>>>>>> “managed” sort and spill-to-disk for hash agg:
>>>>>>> 
>>>>>>> #928: DRILL-5716: Queue-driven memory allocation
>>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for "managed"
>>>>>> operators
>>>>>>> #960, DRILL-5815: Option to set query memory as percent of total
>>>>>>> 
>>>>>>> The following is needed to resolve issues with HBase support in empty
>>>>>> batches:
>>>>>>> 
>>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
>>>>>>> 
>>>>>>> The following are nice-to-haves that build on work already done in
>>>>> this
>>>>>> release, and that some of my own work depends on:
>>>>>>> 
>>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
>>>>>> rather than mock
>>>>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
>>>>> contexts
>>>>>> for testing
>>>>>>> 
>>>>>>> The following is not needed for 1.12 per-se, but is the foundation
>>>>> for a
>>>>>> project I’m working on; would be good to get this in after 2-3 months
>> of
>>>>>> review time:
>>>>>>> 
>>>>>>> #921, foundation for batch size limitation
>>>>>>> 
>>>>>>> The key issue with each of the above is that they each need a
>>>>> committer
>>>>>> to review. Some have reviews from non-committers. Any volunteers?
>>>>>>> 
>>>>>>> Thanks,
>>>>>>> 
>>>>>>> - Paul
>>>>>>> 
>>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com> wrote:
>>>>>>>> 
>>>>>>>> Hi Arina,
>>>>>>>> I’d like to include Drill-5834, Adding network functions.
>>>>>>>> https://github.com/apache/drill/pull/971 <
>> https://github.com/apache/
>>>>>> drill/pull/971>
>>>>>>>> 
>>>>>>>> Hopefully I didn’t violate too many coding standards this time ;-)
>>>>>>>> —C
>>>>>>>> 
>>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
>>>>>> arina.yelchiyeva@gmail.com> wrote:
>>>>>>>>> 
>>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to finish
>>>>> code
>>>>>>>>> review during this week.
>>>>>>>>> 
>>>>>>>>> Kind regards
>>>>>>>>> Arina
>>>>>>>>> 
>>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <arina@apache.org
>>> 
>>>>>> wrote:
>>>>>>>>> 
>>>>>>>>>> Hi Drillers,
>>>>>>>>>> 
>>>>>>>>>> It's been several months since the last release and it is time to
>>>>> do
>>>>>> the
>>>>>>>>>> next one. I am volunteering to be the release manager.
>>>>>>>>>> 
>>>>>>>>>> If there are any issues on which work is in progress, that you
>>>>> feel we
>>>>>>>>>> *must* include in the release, please post in reply to this
>> thread.
>>>>>> Based
>>>>>>>>>> on your input we'll define release cut off date.
>>>>>>>>>> 
>>>>>>>>>> Kind regards
>>>>>>>>>> Arina
>>>>>>>>>> 
>>>>>>>> 
>>>>>>> 
>>>>>> 
>>>>>> 
>>>>> 
>>>> 
>>>> 
>> 
>>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Arina Yelchiyeva <ar...@gmail.com>.

If changes will be done before cut off date, targeting mid November that it
will be possible to include this Jira.

On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com> wrote:

> Hi Arina,
> Can we include DRILL-4091 Support for additional GIS operations in version
> 1.12?  In general the code looked pretty good.  There was a unit test
> missing which the developer submitted and some minor formatting issues
> which I’m still waiting on.
> Thanks,
> —C
>
>
>
> > On Nov 9, 2017, at 10:58, Arina Yelchiyeva <ar...@gmail.com>
> wrote:
> >
> > Current status:
> >
> > Blocker:
> > DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., code
> > reviewer - ?) - in progress.
> >
> > Targeted for 1.12 release:
> > DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
> reviewer -
> > Arina) - code review in final stage.
> > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> > reviewer - Paul) - in review.
> > DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> > mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - waiting
> > for the code review.
> > DRILL-5771: Fix serDe errors for format plugins (developer - Arina, code
> > reviewer - Tim) - waiting for the code review.
> >
> > Kind regards
> > Arina
> >
> > On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
> > arina.yelchiyeva@gmail.com> wrote:
> >
> >> Current status:
> >>
> >> Targeted for 1.12 release:
> >> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather
> than
> >> mock (developer - Paul, code reviewer - ?) - waiting for the code review
> >> DRILL-5842: Refactor and simplify the fragment, operator contexts for
> >> testing (developer - Paul, code reviewer - ?) - waiting for the code
> >> review
> >> DRILL-5834: Adding network functions (developer - Charles, code reviewer
> >> - Arina) - waiting changes after code review
> >> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
> Arina) - waiting
> >> for the code review
> >> DRILL-5772: Enable UTF-8 support in query string by default (developer -
> >> Arina, code reviewer - Paul) - finalizing approach
> >> DRILL-4779: Kafka storage plugin support (developer - Anil, code
> reviewer
> >> - ?) - finishing implementation
> >>
> >> Under question:
> >> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> >> reviewer - ?) - waiting for the status update from the developer
> >>
> >> Please free to suggest other items that are targeted for 1.12 release.
> >> There are many Jiras that have fix version marked as 1.12, it would be
> good
> >> if developers revisit them and update fix version to the actual one.
> >> Link to the dashboard - https://issues.apache.org/
> >> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=DRILL&view=detail
> >>
> >> Kind regards
> >> Arina
> >>
> >>
> >> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org>
> wrote:
> >>
> >>> I'm waiting to merge the SSL  changes in. Waiting a couple of days
> more to
> >>> see if there are any more comments before I merge the changes in.
> >>>
> >>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com> wrote:
> >>>
> >>>> Hi Arina,
> >>>>
> >>>> In addition to my own PRs, there are several in the “active” queue
> that
> >>> we
> >>>> could get in if we can just push them over the line and clear the
> queue.
> >>>> The owners of the PRs should check if we are waiting on them to take
> >>> action.
> >>>>
> >>>> 977     DRILL-5849: Add freemarker lib to dependencyManagement to
> ensure
> >>>> prop…
> >>>> 976     DRILL-5797: Choose parquet reader from read columns
> >>>> 975     DRILL-5743: Handling column family and column scan for hbase
> >>>> 973     DRILL-5775: Select * query on a maprdb binary table fails
> >>>> 972     DRILL-5838: Fix MaprDB filter pushdown for the case of nested
> >>>> field (reg. of DRILL-4264)
> >>>> 950     Drill 5431: SSL Support
> >>>> 949     DRILL-5795: Parquet Filter push down at rowgroup level
> >>>> 936     DRILL-5772: Add unit tests to indicate how utf-8 support can
> be
> >>>> enabled / disabled in Drill
> >>>> 904     DRILL-5717: change some date time test cases with specific
> >>>> timezone or Local
> >>>> 892     DRILL-5645: negation of expression causes null pointer
> exception
> >>>> 889     DRILL-5691: enhance scalar sub queries checking for the
> >>> cartesian
> >>>> join
> >>>>
> >>>> (Items not on the list above have become “inactive” for a variety of
> >>>> reasons.)
> >>>>
> >>>> Thanks,
> >>>>
> >>>> - Paul
> >>>>
> >>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
> >>>>>
> >>>>> Hi Arina,
> >>>>>
> >>>>> I’d like to include the following that are needed to finish up the
> >>>> “managed” sort and spill-to-disk for hash agg:
> >>>>>
> >>>>> #928: DRILL-5716: Queue-driven memory allocation
> >>>>> #958, DRILL-5808: Reduce memory allocator strictness for "managed"
> >>>> operators
> >>>>> #960, DRILL-5815: Option to set query memory as percent of total
> >>>>>
> >>>>> The following is needed to resolve issues with HBase support in empty
> >>>> batches:
> >>>>>
> >>>>> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
> >>>>>
> >>>>> The following are nice-to-haves that build on work already done in
> >>> this
> >>>> release, and that some of my own work depends on:
> >>>>>
> >>>>> #970, DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
> >>>> rather than mock
> >>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
> >>> contexts
> >>>> for testing
> >>>>>
> >>>>> The following is not needed for 1.12 per-se, but is the foundation
> >>> for a
> >>>> project I’m working on; would be good to get this in after 2-3 months
> of
> >>>> review time:
> >>>>>
> >>>>> #921, foundation for batch size limitation
> >>>>>
> >>>>> The key issue with each of the above is that they each need a
> >>> committer
> >>>> to review. Some have reviews from non-committers. Any volunteers?
> >>>>>
> >>>>> Thanks,
> >>>>>
> >>>>> - Paul
> >>>>>
> >>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com> wrote:
> >>>>>>
> >>>>>> Hi Arina,
> >>>>>> I’d like to include Drill-5834, Adding network functions.
> >>>>>> https://github.com/apache/drill/pull/971 <
> https://github.com/apache/
> >>>> drill/pull/971>
> >>>>>>
> >>>>>> Hopefully I didn’t violate too many coding standards this time ;-)
> >>>>>> —C
> >>>>>>
> >>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
> >>>> arina.yelchiyeva@gmail.com> wrote:
> >>>>>>>
> >>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to finish
> >>> code
> >>>>>>> review during this week.
> >>>>>>>
> >>>>>>> Kind regards
> >>>>>>> Arina
> >>>>>>>
> >>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <arina@apache.org
> >
> >>>> wrote:
> >>>>>>>
> >>>>>>>> Hi Drillers,
> >>>>>>>>
> >>>>>>>> It's been several months since the last release and it is time to
> >>> do
> >>>> the
> >>>>>>>> next one. I am volunteering to be the release manager.
> >>>>>>>>
> >>>>>>>> If there are any issues on which work is in progress, that you
> >>> feel we
> >>>>>>>> *must* include in the release, please post in reply to this
> thread.
> >>>> Based
> >>>>>>>> on your input we'll define release cut off date.
> >>>>>>>>
> >>>>>>>> Kind regards
> >>>>>>>> Arina
> >>>>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>>
> >>>
> >>
> >>
>
>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Charles Givre <cg...@gmail.com>.

Hi Arina, 
Can we include DRILL-4091 Support for additional GIS operations in version 1.12?  In general the code looked pretty good.  There was a unit test missing which the developer submitted and some minor formatting issues which I’m still waiting on. 
Thanks,
—C 



> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <ar...@gmail.com> wrote:
> 
> Current status:
> 
> Blocker:
> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., code
> reviewer - ?) - in progress.
> 
> Targeted for 1.12 release:
> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code reviewer -
> Arina) - code review in final stage.
> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> reviewer - Paul) - in review.
> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - waiting
> for the code review.
> DRILL-5771: Fix serDe errors for format plugins (developer - Arina, code
> reviewer - Tim) - waiting for the code review.
> 
> Kind regards
> Arina
> 
> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com> wrote:
> 
>> Current status:
>> 
>> Targeted for 1.12 release:
>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather than
>> mock (developer - Paul, code reviewer - ?) - waiting for the code review
>> DRILL-5842: Refactor and simplify the fragment, operator contexts for
>> testing (developer - Paul, code reviewer - ?) - waiting for the code
>> review
>> DRILL-5834: Adding network functions (developer - Charles, code reviewer
>> - Arina) - waiting changes after code review
>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer - Arina) - waiting
>> for the code review
>> DRILL-5772: Enable UTF-8 support in query string by default (developer -
>> Arina, code reviewer - Paul) - finalizing approach
>> DRILL-4779: Kafka storage plugin support (developer - Anil, code reviewer
>> - ?) - finishing implementation
>> 
>> Under question:
>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
>> reviewer - ?) - waiting for the status update from the developer
>> 
>> Please free to suggest other items that are targeted for 1.12 release.
>> There are many Jiras that have fix version marked as 1.12, it would be good
>> if developers revisit them and update fix version to the actual one.
>> Link to the dashboard - https://issues.apache.org/
>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=DRILL&view=detail
>> 
>> Kind regards
>> Arina
>> 
>> 
>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org> wrote:
>> 
>>> I'm waiting to merge the SSL  changes in. Waiting a couple of days more to
>>> see if there are any more comments before I merge the changes in.
>>> 
>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com> wrote:
>>> 
>>>> Hi Arina,
>>>> 
>>>> In addition to my own PRs, there are several in the “active” queue that
>>> we
>>>> could get in if we can just push them over the line and clear the queue.
>>>> The owners of the PRs should check if we are waiting on them to take
>>> action.
>>>> 
>>>> 977     DRILL-5849: Add freemarker lib to dependencyManagement to ensure
>>>> prop…
>>>> 976     DRILL-5797: Choose parquet reader from read columns
>>>> 975     DRILL-5743: Handling column family and column scan for hbase
>>>> 973     DRILL-5775: Select * query on a maprdb binary table fails
>>>> 972     DRILL-5838: Fix MaprDB filter pushdown for the case of nested
>>>> field (reg. of DRILL-4264)
>>>> 950     Drill 5431: SSL Support
>>>> 949     DRILL-5795: Parquet Filter push down at rowgroup level
>>>> 936     DRILL-5772: Add unit tests to indicate how utf-8 support can be
>>>> enabled / disabled in Drill
>>>> 904     DRILL-5717: change some date time test cases with specific
>>>> timezone or Local
>>>> 892     DRILL-5645: negation of expression causes null pointer exception
>>>> 889     DRILL-5691: enhance scalar sub queries checking for the
>>> cartesian
>>>> join
>>>> 
>>>> (Items not on the list above have become “inactive” for a variety of
>>>> reasons.)
>>>> 
>>>> Thanks,
>>>> 
>>>> - Paul
>>>> 
>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
>>>>> 
>>>>> Hi Arina,
>>>>> 
>>>>> I’d like to include the following that are needed to finish up the
>>>> “managed” sort and spill-to-disk for hash agg:
>>>>> 
>>>>> #928: DRILL-5716: Queue-driven memory allocation
>>>>> #958, DRILL-5808: Reduce memory allocator strictness for "managed"
>>>> operators
>>>>> #960, DRILL-5815: Option to set query memory as percent of total
>>>>> 
>>>>> The following is needed to resolve issues with HBase support in empty
>>>> batches:
>>>>> 
>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
>>>>> 
>>>>> The following are nice-to-haves that build on work already done in
>>> this
>>>> release, and that some of my own work depends on:
>>>>> 
>>>>> #970, DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
>>>> rather than mock
>>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
>>> contexts
>>>> for testing
>>>>> 
>>>>> The following is not needed for 1.12 per-se, but is the foundation
>>> for a
>>>> project I’m working on; would be good to get this in after 2-3 months of
>>>> review time:
>>>>> 
>>>>> #921, foundation for batch size limitation
>>>>> 
>>>>> The key issue with each of the above is that they each need a
>>> committer
>>>> to review. Some have reviews from non-committers. Any volunteers?
>>>>> 
>>>>> Thanks,
>>>>> 
>>>>> - Paul
>>>>> 
>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com> wrote:
>>>>>> 
>>>>>> Hi Arina,
>>>>>> I’d like to include Drill-5834, Adding network functions.
>>>>>> https://github.com/apache/drill/pull/971 <https://github.com/apache/
>>>> drill/pull/971>
>>>>>> 
>>>>>> Hopefully I didn’t violate too many coding standards this time ;-)
>>>>>> —C
>>>>>> 
>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
>>>> arina.yelchiyeva@gmail.com> wrote:
>>>>>>> 
>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to finish
>>> code
>>>>>>> review during this week.
>>>>>>> 
>>>>>>> Kind regards
>>>>>>> Arina
>>>>>>> 
>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <ar...@apache.org>
>>>> wrote:
>>>>>>> 
>>>>>>>> Hi Drillers,
>>>>>>>> 
>>>>>>>> It's been several months since the last release and it is time to
>>> do
>>>> the
>>>>>>>> next one. I am volunteering to be the release manager.
>>>>>>>> 
>>>>>>>> If there are any issues on which work is in progress, that you
>>> feel we
>>>>>>>> *must* include in the release, please post in reply to this thread.
>>>> Based
>>>>>>>> on your input we'll define release cut off date.
>>>>>>>> 
>>>>>>>> Kind regards
>>>>>>>> Arina
>>>>>>>> 
>>>>>> 
>>>>> 
>>>> 
>>>> 
>>> 
>> 
>>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Arina Yelchiyeva <ar...@gmail.com>.

Current status:

Blocker:
DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., code
reviewer - ?) - in progress.

Targeted for 1.12 release:
DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code reviewer -
Arina) - code review in final stage.
DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
reviewer - Paul) - in review.
DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - waiting
for the code review.
DRILL-5771: Fix serDe errors for format plugins (developer - Arina, code
reviewer - Tim) - waiting for the code review.

Kind regards
Arina

On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
arina.yelchiyeva@gmail.com> wrote:

> Current status:
>
> Targeted for 1.12 release:
> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather than
> mock (developer - Paul, code reviewer - ?) - waiting for the code review
> DRILL-5842: Refactor and simplify the fragment, operator contexts for
> testing (developer - Paul, code reviewer - ?) - waiting for the code
> review
> DRILL-5834: Adding network functions (developer - Charles, code reviewer
> - Arina) - waiting changes after code review
> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer - Arina) - waiting
> for the code review
> DRILL-5772: Enable UTF-8 support in query string by default (developer -
> Arina, code reviewer - Paul) - finalizing approach
> DRILL-4779: Kafka storage plugin support (developer - Anil, code reviewer
> - ?) - finishing implementation
>
> Under question:
> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> reviewer - ?) - waiting for the status update from the developer
>
> Please free to suggest other items that are targeted for 1.12 release.
> There are many Jiras that have fix version marked as 1.12, it would be good
> if developers revisit them and update fix version to the actual one.
> Link to the dashboard - https://issues.apache.org/
> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=DRILL&view=detail
>
> Kind regards
> Arina
>
>
> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org> wrote:
>
>> I'm waiting to merge the SSL  changes in. Waiting a couple of days more to
>> see if there are any more comments before I merge the changes in.
>>
>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com> wrote:
>>
>> > Hi Arina,
>> >
>> > In addition to my own PRs, there are several in the “active” queue that
>> we
>> > could get in if we can just push them over the line and clear the queue.
>> > The owners of the PRs should check if we are waiting on them to take
>> action.
>> >
>> > 977     DRILL-5849: Add freemarker lib to dependencyManagement to ensure
>> > prop…
>> > 976     DRILL-5797: Choose parquet reader from read columns
>> > 975     DRILL-5743: Handling column family and column scan for hbase
>> > 973     DRILL-5775: Select * query on a maprdb binary table fails
>> > 972     DRILL-5838: Fix MaprDB filter pushdown for the case of nested
>> > field (reg. of DRILL-4264)
>> > 950     Drill 5431: SSL Support
>> > 949     DRILL-5795: Parquet Filter push down at rowgroup level
>> > 936     DRILL-5772: Add unit tests to indicate how utf-8 support can be
>> > enabled / disabled in Drill
>> > 904     DRILL-5717: change some date time test cases with specific
>> > timezone or Local
>> > 892     DRILL-5645: negation of expression causes null pointer exception
>> > 889     DRILL-5691: enhance scalar sub queries checking for the
>> cartesian
>> > join
>> >
>> > (Items not on the list above have become “inactive” for a variety of
>> > reasons.)
>> >
>> > Thanks,
>> >
>> > - Paul
>> >
>> > > On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
>> > >
>> > > Hi Arina,
>> > >
>> > > I’d like to include the following that are needed to finish up the
>> > “managed” sort and spill-to-disk for hash agg:
>> > >
>> > > #928: DRILL-5716: Queue-driven memory allocation
>> > > #958, DRILL-5808: Reduce memory allocator strictness for "managed"
>> > operators
>> > > #960, DRILL-5815: Option to set query memory as percent of total
>> > >
>> > > The following is needed to resolve issues with HBase support in empty
>> > batches:
>> > >
>> > > #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
>> > >
>> > > The following are nice-to-haves that build on work already done in
>> this
>> > release, and that some of my own work depends on:
>> > >
>> > > #970, DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
>> > rather than mock
>> > > #978: DRILL-5842: Refactor and simplify the fragment, operator
>> contexts
>> > for testing
>> > >
>> > > The following is not needed for 1.12 per-se, but is the foundation
>> for a
>> > project I’m working on; would be good to get this in after 2-3 months of
>> > review time:
>> > >
>> > > #921, foundation for batch size limitation
>> > >
>> > > The key issue with each of the above is that they each need a
>> committer
>> > to review. Some have reviews from non-committers. Any volunteers?
>> > >
>> > > Thanks,
>> > >
>> > > - Paul
>> > >
>> > >> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com> wrote:
>> > >>
>> > >> Hi Arina,
>> > >> I’d like to include Drill-5834, Adding network functions.
>> > >> https://github.com/apache/drill/pull/971 <https://github.com/apache/
>> > drill/pull/971>
>> > >>
>> > >> Hopefully I didn’t violate too many coding standards this time ;-)
>> > >> —C
>> > >>
>> > >>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
>> > arina.yelchiyeva@gmail.com> wrote:
>> > >>>
>> > >>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to finish
>> code
>> > >>> review during this week.
>> > >>>
>> > >>> Kind regards
>> > >>> Arina
>> > >>>
>> > >>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <ar...@apache.org>
>> > wrote:
>> > >>>
>> > >>>> Hi Drillers,
>> > >>>>
>> > >>>> It's been several months since the last release and it is time to
>> do
>> > the
>> > >>>> next one. I am volunteering to be the release manager.
>> > >>>>
>> > >>>> If there are any issues on which work is in progress, that you
>> feel we
>> > >>>> *must* include in the release, please post in reply to this thread.
>> > Based
>> > >>>> on your input we'll define release cut off date.
>> > >>>>
>> > >>>> Kind regards
>> > >>>> Arina
>> > >>>>
>> > >>
>> > >
>> >
>> >
>>
>
>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Arina Yelchiyeva <ar...@gmail.com>.

Current status:

Targeted for 1.12 release:
DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather than
mock (developer - Paul, code reviewer - ?) - waiting for the code review
DRILL-5842: Refactor and simplify the fragment, operator contexts for
testing (developer - Paul, code reviewer - ?) - waiting for the code review
DRILL-5834: Adding network functions (developer - Charles, code reviewer -
Arina) - waiting changes after code review
DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
Arina) - waiting
for the code review
DRILL-5772: Enable UTF-8 support in query string by default (developer -
Arina, code reviewer - Paul) - finalizing approach
DRILL-4779: Kafka storage plugin support (developer - Anil, code reviewer -
?) - finishing implementation

Under question:
DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
reviewer - ?) - waiting for the status update from the developer

Please free to suggest other items that are targeted for 1.12 release.
There are many Jiras that have fix version marked as 1.12, it would be good
if developers revisit them and update fix version to the actual one.
Link to the dashboard -
https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=185&projectKey=DRILL&view=detail


Kind regards
Arina


On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org> wrote:

> I'm waiting to merge the SSL  changes in. Waiting a couple of days more to
> see if there are any more comments before I merge the changes in.
>
> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com> wrote:
>
> > Hi Arina,
> >
> > In addition to my own PRs, there are several in the “active” queue that
> we
> > could get in if we can just push them over the line and clear the queue.
> > The owners of the PRs should check if we are waiting on them to take
> action.
> >
> > 977     DRILL-5849: Add freemarker lib to dependencyManagement to ensure
> > prop…
> > 976     DRILL-5797: Choose parquet reader from read columns
> > 975     DRILL-5743: Handling column family and column scan for hbase
> > 973     DRILL-5775: Select * query on a maprdb binary table fails
> > 972     DRILL-5838: Fix MaprDB filter pushdown for the case of nested
> > field (reg. of DRILL-4264)
> > 950     Drill 5431: SSL Support
> > 949     DRILL-5795: Parquet Filter push down at rowgroup level
> > 936     DRILL-5772: Add unit tests to indicate how utf-8 support can be
> > enabled / disabled in Drill
> > 904     DRILL-5717: change some date time test cases with specific
> > timezone or Local
> > 892     DRILL-5645: negation of expression causes null pointer exception
> > 889     DRILL-5691: enhance scalar sub queries checking for the cartesian
> > join
> >
> > (Items not on the list above have become “inactive” for a variety of
> > reasons.)
> >
> > Thanks,
> >
> > - Paul
> >
> > > On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
> > >
> > > Hi Arina,
> > >
> > > I’d like to include the following that are needed to finish up the
> > “managed” sort and spill-to-disk for hash agg:
> > >
> > > #928: DRILL-5716: Queue-driven memory allocation
> > > #958, DRILL-5808: Reduce memory allocator strictness for "managed"
> > operators
> > > #960, DRILL-5815: Option to set query memory as percent of total
> > >
> > > The following is needed to resolve issues with HBase support in empty
> > batches:
> > >
> > > #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
> > >
> > > The following are nice-to-haves that build on work already done in this
> > release, and that some of my own work depends on:
> > >
> > > #970, DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
> > rather than mock
> > > #978: DRILL-5842: Refactor and simplify the fragment, operator contexts
> > for testing
> > >
> > > The following is not needed for 1.12 per-se, but is the foundation for
> a
> > project I’m working on; would be good to get this in after 2-3 months of
> > review time:
> > >
> > > #921, foundation for batch size limitation
> > >
> > > The key issue with each of the above is that they each need a committer
> > to review. Some have reviews from non-committers. Any volunteers?
> > >
> > > Thanks,
> > >
> > > - Paul
> > >
> > >> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com> wrote:
> > >>
> > >> Hi Arina,
> > >> I’d like to include Drill-5834, Adding network functions.
> > >> https://github.com/apache/drill/pull/971 <https://github.com/apache/
> > drill/pull/971>
> > >>
> > >> Hopefully I didn’t violate too many coding standards this time ;-)
> > >> —C
> > >>
> > >>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
> > arina.yelchiyeva@gmail.com> wrote:
> > >>>
> > >>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to finish
> code
> > >>> review during this week.
> > >>>
> > >>> Kind regards
> > >>> Arina
> > >>>
> > >>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <ar...@apache.org>
> > wrote:
> > >>>
> > >>>> Hi Drillers,
> > >>>>
> > >>>> It's been several months since the last release and it is time to do
> > the
> > >>>> next one. I am volunteering to be the release manager.
> > >>>>
> > >>>> If there are any issues on which work is in progress, that you feel
> we
> > >>>> *must* include in the release, please post in reply to this thread.
> > Based
> > >>>> on your input we'll define release cut off date.
> > >>>>
> > >>>> Kind regards
> > >>>> Arina
> > >>>>
> > >>
> > >
> >
> >
>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Parth Chandra <pa...@apache.org>.

I'm waiting to merge the SSL  changes in. Waiting a couple of days more to
see if there are any more comments before I merge the changes in.

On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com> wrote:

> Hi Arina,
>
> In addition to my own PRs, there are several in the “active” queue that we
> could get in if we can just push them over the line and clear the queue.
> The owners of the PRs should check if we are waiting on them to take action.
>
> 977     DRILL-5849: Add freemarker lib to dependencyManagement to ensure
> prop…
> 976     DRILL-5797: Choose parquet reader from read columns
> 975     DRILL-5743: Handling column family and column scan for hbase
> 973     DRILL-5775: Select * query on a maprdb binary table fails
> 972     DRILL-5838: Fix MaprDB filter pushdown for the case of nested
> field (reg. of DRILL-4264)
> 950     Drill 5431: SSL Support
> 949     DRILL-5795: Parquet Filter push down at rowgroup level
> 936     DRILL-5772: Add unit tests to indicate how utf-8 support can be
> enabled / disabled in Drill
> 904     DRILL-5717: change some date time test cases with specific
> timezone or Local
> 892     DRILL-5645: negation of expression causes null pointer exception
> 889     DRILL-5691: enhance scalar sub queries checking for the cartesian
> join
>
> (Items not on the list above have become “inactive” for a variety of
> reasons.)
>
> Thanks,
>
> - Paul
>
> > On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
> >
> > Hi Arina,
> >
> > I’d like to include the following that are needed to finish up the
> “managed” sort and spill-to-disk for hash agg:
> >
> > #928: DRILL-5716: Queue-driven memory allocation
> > #958, DRILL-5808: Reduce memory allocator strictness for "managed"
> operators
> > #960, DRILL-5815: Option to set query memory as percent of total
> >
> > The following is needed to resolve issues with HBase support in empty
> batches:
> >
> > #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
> >
> > The following are nice-to-haves that build on work already done in this
> release, and that some of my own work depends on:
> >
> > #970, DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
> rather than mock
> > #978: DRILL-5842: Refactor and simplify the fragment, operator contexts
> for testing
> >
> > The following is not needed for 1.12 per-se, but is the foundation for a
> project I’m working on; would be good to get this in after 2-3 months of
> review time:
> >
> > #921, foundation for batch size limitation
> >
> > The key issue with each of the above is that they each need a committer
> to review. Some have reviews from non-committers. Any volunteers?
> >
> > Thanks,
> >
> > - Paul
> >
> >> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com> wrote:
> >>
> >> Hi Arina,
> >> I’d like to include Drill-5834, Adding network functions.
> >> https://github.com/apache/drill/pull/971 <https://github.com/apache/
> drill/pull/971>
> >>
> >> Hopefully I didn’t violate too many coding standards this time ;-)
> >> —C
> >>
> >>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com> wrote:
> >>>
> >>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to finish code
> >>> review during this week.
> >>>
> >>> Kind regards
> >>> Arina
> >>>
> >>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <ar...@apache.org>
> wrote:
> >>>
> >>>> Hi Drillers,
> >>>>
> >>>> It's been several months since the last release and it is time to do
> the
> >>>> next one. I am volunteering to be the release manager.
> >>>>
> >>>> If there are any issues on which work is in progress, that you feel we
> >>>> *must* include in the release, please post in reply to this thread.
> Based
> >>>> on your input we'll define release cut off date.
> >>>>
> >>>> Kind regards
> >>>> Arina
> >>>>
> >>
> >
>
>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Paul Rogers <pr...@mapr.com>.

Hi Arina,

In addition to my own PRs, there are several in the “active” queue that we could get in if we can just push them over the line and clear the queue. The owners of the PRs should check if we are waiting on them to take action.

977	DRILL-5849: Add freemarker lib to dependencyManagement to ensure prop…
976	DRILL-5797: Choose parquet reader from read columns
975	DRILL-5743: Handling column family and column scan for hbase
973	DRILL-5775: Select * query on a maprdb binary table fails
972	DRILL-5838: Fix MaprDB filter pushdown for the case of nested field (reg. of DRILL-4264)
950	Drill 5431: SSL Support
949	DRILL-5795: Parquet Filter push down at rowgroup level
936	DRILL-5772: Add unit tests to indicate how utf-8 support can be enabled / disabled in Drill
904	DRILL-5717: change some date time test cases with specific timezone or Local
892	DRILL-5645: negation of expression causes null pointer exception
889	DRILL-5691: enhance scalar sub queries checking for the cartesian join

(Items not on the list above have become “inactive” for a variety of reasons.)

Thanks,

- Paul

> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
> 
> Hi Arina,
> 
> I’d like to include the following that are needed to finish up the “managed” sort and spill-to-disk for hash agg:
> 
> #928: DRILL-5716: Queue-driven memory allocation 
> #958, DRILL-5808: Reduce memory allocator strictness for "managed" operators 
> #960, DRILL-5815: Option to set query memory as percent of total 
> 
> The following is needed to resolve issues with HBase support in empty batches:
> 
> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546 
> 
> The following are nice-to-haves that build on work already done in this release, and that some of my own work depends on:
> 
> #970, DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather than mock 
> #978: DRILL-5842: Refactor and simplify the fragment, operator contexts for testing
> 
> The following is not needed for 1.12 per-se, but is the foundation for a project I’m working on; would be good to get this in after 2-3 months of review time:
> 
> #921, foundation for batch size limitation
> 
> The key issue with each of the above is that they each need a committer to review. Some have reviews from non-committers. Any volunteers?
> 
> Thanks,
> 
> - Paul
> 
>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com> wrote:
>> 
>> Hi Arina,
>> I’d like to include Drill-5834, Adding network functions.
>> https://github.com/apache/drill/pull/971 <https://github.com/apache/drill/pull/971>
>> 
>> Hopefully I didn’t violate too many coding standards this time ;-)
>> —C
>> 
>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <ar...@gmail.com> wrote:
>>> 
>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to finish code
>>> review during this week.
>>> 
>>> Kind regards
>>> Arina
>>> 
>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <ar...@apache.org> wrote:
>>> 
>>>> Hi Drillers,
>>>> 
>>>> It's been several months since the last release and it is time to do the
>>>> next one. I am volunteering to be the release manager.
>>>> 
>>>> If there are any issues on which work is in progress, that you feel we
>>>> *must* include in the release, please post in reply to this thread. Based
>>>> on your input we'll define release cut off date.
>>>> 
>>>> Kind regards
>>>> Arina
>>>> 
>> 
>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Paul Rogers <pr...@mapr.com>.

Hi Arina,

I’d like to include the following that are needed to finish up the “managed” sort and spill-to-disk for hash agg:

#928: DRILL-5716: Queue-driven memory allocation 
#958, DRILL-5808: Reduce memory allocator strictness for "managed" operators 
#960, DRILL-5815: Option to set query memory as percent of total 

The following is needed to resolve issues with HBase support in empty batches:

#968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546 

The following are nice-to-haves that build on work already done in this release, and that some of my own work depends on:

#970, DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather than mock 
#978: DRILL-5842: Refactor and simplify the fragment, operator contexts for testing

The following is not needed for 1.12 per-se, but is the foundation for a project I’m working on; would be good to get this in after 2-3 months of review time:

#921, foundation for batch size limitation

The key issue with each of the above is that they each need a committer to review. Some have reviews from non-committers. Any volunteers?

Thanks,

- Paul

> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com> wrote:
> 
> Hi Arina,
> I’d like to include Drill-5834, Adding network functions.
> https://github.com/apache/drill/pull/971 <https://github.com/apache/drill/pull/971>
> 
> Hopefully I didn’t violate too many coding standards this time ;-)
> —C
> 
>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <ar...@gmail.com> wrote:
>> 
>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to finish code
>> review during this week.
>> 
>> Kind regards
>> Arina
>> 
>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <ar...@apache.org> wrote:
>> 
>>> Hi Drillers,
>>> 
>>> It's been several months since the last release and it is time to do the
>>> next one. I am volunteering to be the release manager.
>>> 
>>> If there are any issues on which work is in progress, that you feel we
>>> *must* include in the release, please post in reply to this thread. Based
>>> on your input we'll define release cut off date.
>>> 
>>> Kind regards
>>> Arina
>>> 
>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Charles Givre <cg...@gmail.com>.

Hi Arina,
I’d like to include Drill-5834, Adding network functions.
https://github.com/apache/drill/pull/971 <https://github.com/apache/drill/pull/971>

Hopefully I didn’t violate too many coding standards this time ;-)
—C

> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <ar...@gmail.com> wrote:
> 
> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to finish code
> review during this week.
> 
> Kind regards
> Arina
> 
> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <ar...@apache.org> wrote:
> 
>> Hi Drillers,
>> 
>> It's been several months since the last release and it is time to do the
>> next one. I am volunteering to be the release manager.
>> 
>> If there are any issues on which work is in progress, that you feel we
>> *must* include in the release, please post in reply to this thread. Based
>> on your input we'll define release cut off date.
>> 
>> Kind regards
>> Arina
>>

Re: [DISCUSS] Drill 1.12.0 release

Posted by Arina Yelchiyeva <ar...@gmail.com>.

I want to include DRILL-5337 (OpenTSDB plugin), I'll try to finish code
review during this week.

Kind regards
Arina

On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <ar...@apache.org> wrote:

> Hi Drillers,
>
> It's been several months since the last release and it is time to do the
> next one. I am volunteering to be the release manager.
>
> If there are any issues on which work is in progress, that you feel we
> *must* include in the release, please post in reply to this thread. Based
> on your input we'll define release cut off date.
>
> Kind regards
> Arina
>