You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by Arina Yelchiyeva <ar...@gmail.com> on 2017/11/09 15:58:25 UTC
Re: [DISCUSS] Drill 1.12.0 release
Current status:
Blocker:
DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., code
reviewer - ?) - in progress.
Targeted for 1.12 release:
DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code reviewer -
Arina) - code review in final stage.
DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
reviewer - Paul) - in review.
DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - waiting
for the code review.
DRILL-5771: Fix serDe errors for format plugins (developer - Arina, code
reviewer - Tim) - waiting for the code review.
Kind regards
Arina
On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
arina.yelchiyeva@gmail.com> wrote:
> Current status:
>
> Targeted for 1.12 release:
> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather than
> mock (developer - Paul, code reviewer - ?) - waiting for the code review
> DRILL-5842: Refactor and simplify the fragment, operator contexts for
> testing (developer - Paul, code reviewer - ?) - waiting for the code
> review
> DRILL-5834: Adding network functions (developer - Charles, code reviewer
> - Arina) - waiting changes after code review
> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer - Arina) - waiting
> for the code review
> DRILL-5772: Enable UTF-8 support in query string by default (developer -
> Arina, code reviewer - Paul) - finalizing approach
> DRILL-4779: Kafka storage plugin support (developer - Anil, code reviewer
> - ?) - finishing implementation
>
> Under question:
> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> reviewer - ?) - waiting for the status update from the developer
>
> Please free to suggest other items that are targeted for 1.12 release.
> There are many Jiras that have fix version marked as 1.12, it would be good
> if developers revisit them and update fix version to the actual one.
> Link to the dashboard - https://issues.apache.org/
> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=DRILL&view=detail
>
> Kind regards
> Arina
>
>
> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org> wrote:
>
>> I'm waiting to merge the SSL changes in. Waiting a couple of days more to
>> see if there are any more comments before I merge the changes in.
>>
>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com> wrote:
>>
>> > Hi Arina,
>> >
>> > In addition to my own PRs, there are several in the “active” queue that
>> we
>> > could get in if we can just push them over the line and clear the queue.
>> > The owners of the PRs should check if we are waiting on them to take
>> action.
>> >
>> > 977 DRILL-5849: Add freemarker lib to dependencyManagement to ensure
>> > prop…
>> > 976 DRILL-5797: Choose parquet reader from read columns
>> > 975 DRILL-5743: Handling column family and column scan for hbase
>> > 973 DRILL-5775: Select * query on a maprdb binary table fails
>> > 972 DRILL-5838: Fix MaprDB filter pushdown for the case of nested
>> > field (reg. of DRILL-4264)
>> > 950 Drill 5431: SSL Support
>> > 949 DRILL-5795: Parquet Filter push down at rowgroup level
>> > 936 DRILL-5772: Add unit tests to indicate how utf-8 support can be
>> > enabled / disabled in Drill
>> > 904 DRILL-5717: change some date time test cases with specific
>> > timezone or Local
>> > 892 DRILL-5645: negation of expression causes null pointer exception
>> > 889 DRILL-5691: enhance scalar sub queries checking for the
>> cartesian
>> > join
>> >
>> > (Items not on the list above have become “inactive” for a variety of
>> > reasons.)
>> >
>> > Thanks,
>> >
>> > - Paul
>> >
>> > > On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
>> > >
>> > > Hi Arina,
>> > >
>> > > I’d like to include the following that are needed to finish up the
>> > “managed” sort and spill-to-disk for hash agg:
>> > >
>> > > #928: DRILL-5716: Queue-driven memory allocation
>> > > #958, DRILL-5808: Reduce memory allocator strictness for "managed"
>> > operators
>> > > #960, DRILL-5815: Option to set query memory as percent of total
>> > >
>> > > The following is needed to resolve issues with HBase support in empty
>> > batches:
>> > >
>> > > #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
>> > >
>> > > The following are nice-to-haves that build on work already done in
>> this
>> > release, and that some of my own work depends on:
>> > >
>> > > #970, DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
>> > rather than mock
>> > > #978: DRILL-5842: Refactor and simplify the fragment, operator
>> contexts
>> > for testing
>> > >
>> > > The following is not needed for 1.12 per-se, but is the foundation
>> for a
>> > project I’m working on; would be good to get this in after 2-3 months of
>> > review time:
>> > >
>> > > #921, foundation for batch size limitation
>> > >
>> > > The key issue with each of the above is that they each need a
>> committer
>> > to review. Some have reviews from non-committers. Any volunteers?
>> > >
>> > > Thanks,
>> > >
>> > > - Paul
>> > >
>> > >> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com> wrote:
>> > >>
>> > >> Hi Arina,
>> > >> I’d like to include Drill-5834, Adding network functions.
>> > >> https://github.com/apache/drill/pull/971 <https://github.com/apache/
>> > drill/pull/971>
>> > >>
>> > >> Hopefully I didn’t violate too many coding standards this time ;-)
>> > >> —C
>> > >>
>> > >>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
>> > arina.yelchiyeva@gmail.com> wrote:
>> > >>>
>> > >>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to finish
>> code
>> > >>> review during this week.
>> > >>>
>> > >>> Kind regards
>> > >>> Arina
>> > >>>
>> > >>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <ar...@apache.org>
>> > wrote:
>> > >>>
>> > >>>> Hi Drillers,
>> > >>>>
>> > >>>> It's been several months since the last release and it is time to
>> do
>> > the
>> > >>>> next one. I am volunteering to be the release manager.
>> > >>>>
>> > >>>> If there are any issues on which work is in progress, that you
>> feel we
>> > >>>> *must* include in the release, please post in reply to this thread.
>> > Based
>> > >>>> on your input we'll define release cut off date.
>> > >>>>
>> > >>>> Kind regards
>> > >>>> Arina
>> > >>>>
>> > >>
>> > >
>> >
>> >
>>
>
>
Re: [DISCUSS] Drill 1.12.0 release
Posted by Arina Yelchiyeva <ar...@gmail.com>.
All pending Jiras are merged. Starting release candidate preparation.
*Note for the committers:*
*until the release is not over and Drill version is not changed to
1.13.0-SNAPSHOT, please do not push any changes into Drill master. *
Kind regards
Arina
On Mon, Nov 27, 2017 at 6:52 PM, Arina Yelchiyeva <
arina.yelchiyeva@gmail.com> wrote:
> Current status:
>
> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> reviewer - Paul) - fix is expected by the EOD in new pull request.
> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> reviewer - Paul) - unit test failures are fixed. Unit test performance
> degraded x3 times!
>
> Kind regards
>
> On Sun, Nov 26, 2017 at 6:15 PM, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com> wrote:
>
>> Current status:
>>
>> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
>> reviewer - Paul) - could not cherry-pick the commits. Needs fix.
>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
>> reviewer - Paul) - there are unit test failures. Needs fix.
>>
>> Kind regards
>>
>> On Sat, Nov 25, 2017 at 11:53 PM, AnilKumar B <ak...@gmail.com>
>> wrote:
>>
>>> Hi Arina,
>>>
>>> Sorry for the delay. Just now we squashed Kafka storage plugin commits
>>> into
>>> one commit and pushed.
>>>
>>> Thanks & Regards,
>>> B Anil Kumar.
>>>
>>> On Sat, Nov 25, 2017 at 5:56 AM, Arina Yelchiyeva <
>>> arina.yelchiyeva@gmail.com> wrote:
>>>
>>> > Current status:
>>> >
>>> > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
>>> code
>>> > reviewer - Paul) - needs to squash the commits.
>>> > DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
>>> > reviewer - Paul) - needs to address some code review comments.
>>> >
>>> > Kind regards
>>> > Arina
>>> >
>>> > On Wed, Nov 15, 2017 at 2:38 PM, Arina Yelchiyeva <
>>> > arina.yelchiyeva@gmail.com> wrote:
>>> >
>>> > > Current status, we are close to the code freeze which will happen not
>>> > > later then the end of the next week.
>>> > >
>>> > > Blocker:
>>> > > DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
>>> code
>>> > > reviewer - Arina) - in progress.
>>> > >
>>> > > Targeted for 1.12 release:
>>> > > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
>>> code
>>> > > reviewer - Paul) - needs next round of code review.
>>> > > DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
>>> > > mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
>>> waiting
>>> > > for Parth code review.
>>> > > DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
>>> code
>>> > > reviewer - Tim) - code review is done, waiting for the merge.
>>> > >
>>> > > Kind regards
>>> > >
>>> > > On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cs...@mapr.com> wrote:
>>> > >
>>> > >> Hi Arina,
>>> > >>
>>> > >>
>>> > >> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy
>>> > >> loading schema for storage plugins. Could you or Paul take a look
>>> at the
>>> > >> pull request for this JIRA https://github.com/apache/dril
>>> l/pull/1032? I
>>> > >> think both of you are familiar with this part.
>>> > >>
>>> > >>
>>> > >> Thanks,
>>> > >>
>>> > >>
>>> > >> Chunhui
>>> > >>
>>> > >> ________________________________
>>> > >> From: Arina Yelchiyeva <ar...@gmail.com>
>>> > >> Sent: Thursday, November 9, 2017 8:11:35 AM
>>> > >> To: dev@drill.apache.org
>>> > >> Subject: Re: [DISCUSS] Drill 1.12.0 release
>>> > >>
>>> > >> Yes, they are already in master.
>>> > >>
>>> > >> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com>
>>> wrote:
>>> > >>
>>> > >> > We’re including the Networking functions in this release right?
>>> > >> >
>>> > >> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <
>>> > >> arina.yelchiyeva@gmail.com>
>>> > >> > wrote:
>>> > >> > >
>>> > >> > > If changes will be done before cut off date, targeting mid
>>> November
>>> > >> that
>>> > >> > it
>>> > >> > > will be possible to include this Jira.
>>> > >> > >
>>> > >> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cgivre@gmail.com
>>> >
>>> > >> wrote:
>>> > >> > >
>>> > >> > >> Hi Arina,
>>> > >> > >> Can we include DRILL-4091 Support for additional GIS
>>> operations in
>>> > >> > version
>>> > >> > >> 1.12? In general the code looked pretty good. There was a
>>> unit
>>> > test
>>> > >> > >> missing which the developer submitted and some minor formatting
>>> > >> issues
>>> > >> > >> which I’m still waiting on.
>>> > >> > >> Thanks,
>>> > >> > >> —C
>>> > >> > >>
>>> > >> > >>
>>> > >> > >>
>>> > >> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
>>> > >> arina.yelchiyeva@gmail.com
>>> > >> > >
>>> > >> > >> wrote:
>>> > >> > >>>
>>> > >> > >>> Current status:
>>> > >> > >>>
>>> > >> > >>> Blocker:
>>> > >> > >>> DRILL-5917: Ban org.json:json library in Drill (developer -
>>> Vlad
>>> > R.,
>>> > >> > code
>>> > >> > >>> reviewer - ?) - in progress.
>>> > >> > >>>
>>> > >> > >>> Targeted for 1.12 release:
>>> > >> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S.,
>>> code
>>> > >> > >> reviewer -
>>> > >> > >>> Arina) - code review in final stage.
>>> > >> > >>> DRILL-4779: Kafka storage plugin support (developer - Anil &
>>> > Kamesh,
>>> > >> > code
>>> > >> > >>> reviewer - Paul) - in review.
>>> > >> > >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582
>>> for
>>> > >> PLAIN
>>> > >> > >>> mechanism (developer - Sorabh, code reviewer - Parth &
>>> Laurent) -
>>> > >> > waiting
>>> > >> > >>> for the code review.
>>> > >> > >>> DRILL-5771: Fix serDe errors for format plugins (developer -
>>> > Arina,
>>> > >> > code
>>> > >> > >>> reviewer - Tim) - waiting for the code review.
>>> > >> > >>>
>>> > >> > >>> Kind regards
>>> > >> > >>> Arina
>>> > >> > >>>
>>> > >> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
>>> > >> > >>> arina.yelchiyeva@gmail.com> wrote:
>>> > >> > >>>
>>> > >> > >>>> Current status:
>>> > >> > >>>>
>>> > >> > >>>> Targeted for 1.12 release:
>>> > >> > >>>> DRILL-5832: Migrate OperatorFixture to use
>>> SystemOptionManager
>>> > >> rather
>>> > >> > >> than
>>> > >> > >>>> mock (developer - Paul, code reviewer - ?) - waiting for the
>>> code
>>> > >> > review
>>> > >> > >>>> DRILL-5842: Refactor and simplify the fragment, operator
>>> contexts
>>> > >> for
>>> > >> > >>>> testing (developer - Paul, code reviewer - ?) - waiting for
>>> the
>>> > >> code
>>> > >> > >>>> review
>>> > >> > >>>> DRILL-5834: Adding network functions (developer - Charles,
>>> code
>>> > >> > reviewer
>>> > >> > >>>> - Arina) - waiting changes after code review
>>> > >> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code
>>> reviewer -
>>> > >> > >> Arina) - waiting
>>> > >> > >>>> for the code review
>>> > >> > >>>> DRILL-5772: Enable UTF-8 support in query string by default
>>> > >> > (developer -
>>> > >> > >>>> Arina, code reviewer - Paul) - finalizing approach
>>> > >> > >>>> DRILL-4779: Kafka storage plugin support (developer - Anil,
>>> code
>>> > >> > >> reviewer
>>> > >> > >>>> - ?) - finishing implementation
>>> > >> > >>>>
>>> > >> > >>>> Under question:
>>> > >> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer -
>>> Jyothsna,
>>> > >> code
>>> > >> > >>>> reviewer - ?) - waiting for the status update from the
>>> developer
>>> > >> > >>>>
>>> > >> > >>>> Please free to suggest other items that are targeted for 1.12
>>> > >> release.
>>> > >> > >>>> There are many Jiras that have fix version marked as 1.12, it
>>> > >> would be
>>> > >> > >> good
>>> > >> > >>>> if developers revisit them and update fix version to the
>>> actual
>>> > >> one.
>>> > >> > >>>> Link to the dashboard - https://issues.apache.org/
>>> > >> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
>>> > >> > DRILL&view=detail
>>> > >> > >>>>
>>> > >> > >>>> Kind regards
>>> > >> > >>>> Arina
>>> > >> > >>>>
>>> > >> > >>>>
>>> > >> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <
>>> > parthc@apache.org>
>>> > >> > >> wrote:
>>> > >> > >>>>
>>> > >> > >>>>> I'm waiting to merge the SSL changes in. Waiting a couple
>>> of
>>> > days
>>> > >> > >> more to
>>> > >> > >>>>> see if there are any more comments before I merge the
>>> changes
>>> > in.
>>> > >> > >>>>>
>>> > >> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <
>>> progers@mapr.com>
>>> > >> > wrote:
>>> > >> > >>>>>
>>> > >> > >>>>>> Hi Arina,
>>> > >> > >>>>>>
>>> > >> > >>>>>> In addition to my own PRs, there are several in the
>>> “active”
>>> > >> queue
>>> > >> > >> that
>>> > >> > >>>>> we
>>> > >> > >>>>>> could get in if we can just push them over the line and
>>> clear
>>> > the
>>> > >> > >> queue.
>>> > >> > >>>>>> The owners of the PRs should check if we are waiting on
>>> them to
>>> > >> take
>>> > >> > >>>>> action.
>>> > >> > >>>>>>
>>> > >> > >>>>>> 977 DRILL-5849: Add freemarker lib to
>>> dependencyManagement
>>> > to
>>> > >> > >> ensure
>>> > >> > >>>>>> prop…
>>> > >> > >>>>>> 976 DRILL-5797: Choose parquet reader from read columns
>>> > >> > >>>>>> 975 DRILL-5743: Handling column family and column scan
>>> for
>>> > >> hbase
>>> > >> > >>>>>> 973 DRILL-5775: Select * query on a maprdb binary table
>>> > fails
>>> > >> > >>>>>> 972 DRILL-5838: Fix MaprDB filter pushdown for the
>>> case of
>>> > >> > nested
>>> > >> > >>>>>> field (reg. of DRILL-4264)
>>> > >> > >>>>>> 950 Drill 5431: SSL Support
>>> > >> > >>>>>> 949 DRILL-5795: Parquet Filter push down at rowgroup
>>> level
>>> > >> > >>>>>> 936 DRILL-5772: Add unit tests to indicate how utf-8
>>> > support
>>> > >> can
>>> > >> > >> be
>>> > >> > >>>>>> enabled / disabled in Drill
>>> > >> > >>>>>> 904 DRILL-5717: change some date time test cases with
>>> > >> specific
>>> > >> > >>>>>> timezone or Local
>>> > >> > >>>>>> 892 DRILL-5645: negation of expression causes null
>>> pointer
>>> > >> > >> exception
>>> > >> > >>>>>> 889 DRILL-5691: enhance scalar sub queries checking
>>> for the
>>> > >> > >>>>> cartesian
>>> > >> > >>>>>> join
>>> > >> > >>>>>>
>>> > >> > >>>>>> (Items not on the list above have become “inactive” for a
>>> > >> variety of
>>> > >> > >>>>>> reasons.)
>>> > >> > >>>>>>
>>> > >> > >>>>>> Thanks,
>>> > >> > >>>>>>
>>> > >> > >>>>>> - Paul
>>> > >> > >>>>>>
>>> > >> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <progers@mapr.com
>>> >
>>> > >> wrote:
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> Hi Arina,
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> I’d like to include the following that are needed to
>>> finish up
>>> > >> the
>>> > >> > >>>>>> “managed” sort and spill-to-disk for hash agg:
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
>>> > >> > >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for
>>> > >> "managed"
>>> > >> > >>>>>> operators
>>> > >> > >>>>>>> #960, DRILL-5815: Option to set query memory as percent of
>>> > total
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> The following is needed to resolve issues with HBase
>>> support
>>> > in
>>> > >> > empty
>>> > >> > >>>>>> batches:
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from
>>> > DRILL-5546
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> The following are nice-to-haves that build on work already
>>> > done
>>> > >> in
>>> > >> > >>>>> this
>>> > >> > >>>>>> release, and that some of my own work depends on:
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
>>> > >> > SystemOptionManager
>>> > >> > >>>>>> rather than mock
>>> > >> > >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment,
>>> operator
>>> > >> > >>>>> contexts
>>> > >> > >>>>>> for testing
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> The following is not needed for 1.12 per-se, but is the
>>> > >> foundation
>>> > >> > >>>>> for a
>>> > >> > >>>>>> project I’m working on; would be good to get this in after
>>> 2-3
>>> > >> > months
>>> > >> > >> of
>>> > >> > >>>>>> review time:
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> #921, foundation for batch size limitation
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> The key issue with each of the above is that they each
>>> need a
>>> > >> > >>>>> committer
>>> > >> > >>>>>> to review. Some have reviews from non-committers. Any
>>> > volunteers?
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> Thanks,
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> - Paul
>>> > >> > >>>>>>>
>>> > >> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <
>>> cgivre@gmail.com>
>>> > >> > wrote:
>>> > >> > >>>>>>>>
>>> > >> > >>>>>>>> Hi Arina,
>>> > >> > >>>>>>>> I’d like to include Drill-5834, Adding network functions.
>>> > >> > >>>>>>>> https://github.com/apache/drill/pull/971 <
>>> > >> > >> https://github.com/apache/
>>> > >> > >>>>>> drill/pull/971>
>>> > >> > >>>>>>>>
>>> > >> > >>>>>>>> Hopefully I didn’t violate too many coding standards this
>>> > time
>>> > >> ;-)
>>> > >> > >>>>>>>> —C
>>> > >> > >>>>>>>>
>>> > >> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
>>> > >> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
>>> > >> > >>>>>>>>>
>>> > >> > >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll
>>> try to
>>> > >> > finish
>>> > >> > >>>>> code
>>> > >> > >>>>>>>>> review during this week.
>>> > >> > >>>>>>>>>
>>> > >> > >>>>>>>>> Kind regards
>>> > >> > >>>>>>>>> Arina
>>> > >> > >>>>>>>>>
>>> > >> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
>>> > >> > arina@apache.org
>>> > >> > >>>
>>> > >> > >>>>>> wrote:
>>> > >> > >>>>>>>>>
>>> > >> > >>>>>>>>>> Hi Drillers,
>>> > >> > >>>>>>>>>>
>>> > >> > >>>>>>>>>> It's been several months since the last release and it
>>> is
>>> > >> time
>>> > >> > to
>>> > >> > >>>>> do
>>> > >> > >>>>>> the
>>> > >> > >>>>>>>>>> next one. I am volunteering to be the release manager.
>>> > >> > >>>>>>>>>>
>>> > >> > >>>>>>>>>> If there are any issues on which work is in progress,
>>> that
>>> > >> you
>>> > >> > >>>>> feel we
>>> > >> > >>>>>>>>>> *must* include in the release, please post in reply to
>>> this
>>> > >> > >> thread.
>>> > >> > >>>>>> Based
>>> > >> > >>>>>>>>>> on your input we'll define release cut off date.
>>> > >> > >>>>>>>>>>
>>> > >> > >>>>>>>>>> Kind regards
>>> > >> > >>>>>>>>>> Arina
>>> > >> > >>>>>>>>>>
>>> > >> > >>>>>>>>
>>> > >> > >>>>>>>
>>> > >> > >>>>>>
>>> > >> > >>>>>>
>>> > >> > >>>>>
>>> > >> > >>>>
>>> > >> > >>>>
>>> > >> > >>
>>> > >> > >>
>>> > >> >
>>> > >> >
>>> > >>
>>> > >
>>> > >
>>> >
>>>
>>
>>
>
Re: [DISCUSS] Drill 1.12.0 release
Posted by Arina Yelchiyeva <ar...@gmail.com>.
Current status:
DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
reviewer - Paul) - fix is expected by the EOD in new pull request.
DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
reviewer - Paul) - unit test failures are fixed. Unit test performance
degraded x3 times!
Kind regards
On Sun, Nov 26, 2017 at 6:15 PM, Arina Yelchiyeva <
arina.yelchiyeva@gmail.com> wrote:
> Current status:
>
> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> reviewer - Paul) - could not cherry-pick the commits. Needs fix.
> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> reviewer - Paul) - there are unit test failures. Needs fix.
>
> Kind regards
>
> On Sat, Nov 25, 2017 at 11:53 PM, AnilKumar B <ak...@gmail.com>
> wrote:
>
>> Hi Arina,
>>
>> Sorry for the delay. Just now we squashed Kafka storage plugin commits
>> into
>> one commit and pushed.
>>
>> Thanks & Regards,
>> B Anil Kumar.
>>
>> On Sat, Nov 25, 2017 at 5:56 AM, Arina Yelchiyeva <
>> arina.yelchiyeva@gmail.com> wrote:
>>
>> > Current status:
>> >
>> > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
>> code
>> > reviewer - Paul) - needs to squash the commits.
>> > DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
>> > reviewer - Paul) - needs to address some code review comments.
>> >
>> > Kind regards
>> > Arina
>> >
>> > On Wed, Nov 15, 2017 at 2:38 PM, Arina Yelchiyeva <
>> > arina.yelchiyeva@gmail.com> wrote:
>> >
>> > > Current status, we are close to the code freeze which will happen not
>> > > later then the end of the next week.
>> > >
>> > > Blocker:
>> > > DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
>> code
>> > > reviewer - Arina) - in progress.
>> > >
>> > > Targeted for 1.12 release:
>> > > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
>> code
>> > > reviewer - Paul) - needs next round of code review.
>> > > DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
>> > > mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
>> waiting
>> > > for Parth code review.
>> > > DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
>> code
>> > > reviewer - Tim) - code review is done, waiting for the merge.
>> > >
>> > > Kind regards
>> > >
>> > > On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cs...@mapr.com> wrote:
>> > >
>> > >> Hi Arina,
>> > >>
>> > >>
>> > >> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy
>> > >> loading schema for storage plugins. Could you or Paul take a look at
>> the
>> > >> pull request for this JIRA https://github.com/apache/drill/pull/1032?
>> I
>> > >> think both of you are familiar with this part.
>> > >>
>> > >>
>> > >> Thanks,
>> > >>
>> > >>
>> > >> Chunhui
>> > >>
>> > >> ________________________________
>> > >> From: Arina Yelchiyeva <ar...@gmail.com>
>> > >> Sent: Thursday, November 9, 2017 8:11:35 AM
>> > >> To: dev@drill.apache.org
>> > >> Subject: Re: [DISCUSS] Drill 1.12.0 release
>> > >>
>> > >> Yes, they are already in master.
>> > >>
>> > >> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com>
>> wrote:
>> > >>
>> > >> > We’re including the Networking functions in this release right?
>> > >> >
>> > >> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <
>> > >> arina.yelchiyeva@gmail.com>
>> > >> > wrote:
>> > >> > >
>> > >> > > If changes will be done before cut off date, targeting mid
>> November
>> > >> that
>> > >> > it
>> > >> > > will be possible to include this Jira.
>> > >> > >
>> > >> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com>
>> > >> wrote:
>> > >> > >
>> > >> > >> Hi Arina,
>> > >> > >> Can we include DRILL-4091 Support for additional GIS operations
>> in
>> > >> > version
>> > >> > >> 1.12? In general the code looked pretty good. There was a unit
>> > test
>> > >> > >> missing which the developer submitted and some minor formatting
>> > >> issues
>> > >> > >> which I’m still waiting on.
>> > >> > >> Thanks,
>> > >> > >> —C
>> > >> > >>
>> > >> > >>
>> > >> > >>
>> > >> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
>> > >> arina.yelchiyeva@gmail.com
>> > >> > >
>> > >> > >> wrote:
>> > >> > >>>
>> > >> > >>> Current status:
>> > >> > >>>
>> > >> > >>> Blocker:
>> > >> > >>> DRILL-5917: Ban org.json:json library in Drill (developer -
>> Vlad
>> > R.,
>> > >> > code
>> > >> > >>> reviewer - ?) - in progress.
>> > >> > >>>
>> > >> > >>> Targeted for 1.12 release:
>> > >> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S.,
>> code
>> > >> > >> reviewer -
>> > >> > >>> Arina) - code review in final stage.
>> > >> > >>> DRILL-4779: Kafka storage plugin support (developer - Anil &
>> > Kamesh,
>> > >> > code
>> > >> > >>> reviewer - Paul) - in review.
>> > >> > >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for
>> > >> PLAIN
>> > >> > >>> mechanism (developer - Sorabh, code reviewer - Parth &
>> Laurent) -
>> > >> > waiting
>> > >> > >>> for the code review.
>> > >> > >>> DRILL-5771: Fix serDe errors for format plugins (developer -
>> > Arina,
>> > >> > code
>> > >> > >>> reviewer - Tim) - waiting for the code review.
>> > >> > >>>
>> > >> > >>> Kind regards
>> > >> > >>> Arina
>> > >> > >>>
>> > >> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
>> > >> > >>> arina.yelchiyeva@gmail.com> wrote:
>> > >> > >>>
>> > >> > >>>> Current status:
>> > >> > >>>>
>> > >> > >>>> Targeted for 1.12 release:
>> > >> > >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
>> > >> rather
>> > >> > >> than
>> > >> > >>>> mock (developer - Paul, code reviewer - ?) - waiting for the
>> code
>> > >> > review
>> > >> > >>>> DRILL-5842: Refactor and simplify the fragment, operator
>> contexts
>> > >> for
>> > >> > >>>> testing (developer - Paul, code reviewer - ?) - waiting for
>> the
>> > >> code
>> > >> > >>>> review
>> > >> > >>>> DRILL-5834: Adding network functions (developer - Charles,
>> code
>> > >> > reviewer
>> > >> > >>>> - Arina) - waiting changes after code review
>> > >> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code
>> reviewer -
>> > >> > >> Arina) - waiting
>> > >> > >>>> for the code review
>> > >> > >>>> DRILL-5772: Enable UTF-8 support in query string by default
>> > >> > (developer -
>> > >> > >>>> Arina, code reviewer - Paul) - finalizing approach
>> > >> > >>>> DRILL-4779: Kafka storage plugin support (developer - Anil,
>> code
>> > >> > >> reviewer
>> > >> > >>>> - ?) - finishing implementation
>> > >> > >>>>
>> > >> > >>>> Under question:
>> > >> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer -
>> Jyothsna,
>> > >> code
>> > >> > >>>> reviewer - ?) - waiting for the status update from the
>> developer
>> > >> > >>>>
>> > >> > >>>> Please free to suggest other items that are targeted for 1.12
>> > >> release.
>> > >> > >>>> There are many Jiras that have fix version marked as 1.12, it
>> > >> would be
>> > >> > >> good
>> > >> > >>>> if developers revisit them and update fix version to the
>> actual
>> > >> one.
>> > >> > >>>> Link to the dashboard - https://issues.apache.org/
>> > >> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
>> > >> > DRILL&view=detail
>> > >> > >>>>
>> > >> > >>>> Kind regards
>> > >> > >>>> Arina
>> > >> > >>>>
>> > >> > >>>>
>> > >> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <
>> > parthc@apache.org>
>> > >> > >> wrote:
>> > >> > >>>>
>> > >> > >>>>> I'm waiting to merge the SSL changes in. Waiting a couple of
>> > days
>> > >> > >> more to
>> > >> > >>>>> see if there are any more comments before I merge the changes
>> > in.
>> > >> > >>>>>
>> > >> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <
>> progers@mapr.com>
>> > >> > wrote:
>> > >> > >>>>>
>> > >> > >>>>>> Hi Arina,
>> > >> > >>>>>>
>> > >> > >>>>>> In addition to my own PRs, there are several in the “active”
>> > >> queue
>> > >> > >> that
>> > >> > >>>>> we
>> > >> > >>>>>> could get in if we can just push them over the line and
>> clear
>> > the
>> > >> > >> queue.
>> > >> > >>>>>> The owners of the PRs should check if we are waiting on
>> them to
>> > >> take
>> > >> > >>>>> action.
>> > >> > >>>>>>
>> > >> > >>>>>> 977 DRILL-5849: Add freemarker lib to
>> dependencyManagement
>> > to
>> > >> > >> ensure
>> > >> > >>>>>> prop…
>> > >> > >>>>>> 976 DRILL-5797: Choose parquet reader from read columns
>> > >> > >>>>>> 975 DRILL-5743: Handling column family and column scan
>> for
>> > >> hbase
>> > >> > >>>>>> 973 DRILL-5775: Select * query on a maprdb binary table
>> > fails
>> > >> > >>>>>> 972 DRILL-5838: Fix MaprDB filter pushdown for the case
>> of
>> > >> > nested
>> > >> > >>>>>> field (reg. of DRILL-4264)
>> > >> > >>>>>> 950 Drill 5431: SSL Support
>> > >> > >>>>>> 949 DRILL-5795: Parquet Filter push down at rowgroup
>> level
>> > >> > >>>>>> 936 DRILL-5772: Add unit tests to indicate how utf-8
>> > support
>> > >> can
>> > >> > >> be
>> > >> > >>>>>> enabled / disabled in Drill
>> > >> > >>>>>> 904 DRILL-5717: change some date time test cases with
>> > >> specific
>> > >> > >>>>>> timezone or Local
>> > >> > >>>>>> 892 DRILL-5645: negation of expression causes null
>> pointer
>> > >> > >> exception
>> > >> > >>>>>> 889 DRILL-5691: enhance scalar sub queries checking for
>> the
>> > >> > >>>>> cartesian
>> > >> > >>>>>> join
>> > >> > >>>>>>
>> > >> > >>>>>> (Items not on the list above have become “inactive” for a
>> > >> variety of
>> > >> > >>>>>> reasons.)
>> > >> > >>>>>>
>> > >> > >>>>>> Thanks,
>> > >> > >>>>>>
>> > >> > >>>>>> - Paul
>> > >> > >>>>>>
>> > >> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com>
>> > >> wrote:
>> > >> > >>>>>>>
>> > >> > >>>>>>> Hi Arina,
>> > >> > >>>>>>>
>> > >> > >>>>>>> I’d like to include the following that are needed to
>> finish up
>> > >> the
>> > >> > >>>>>> “managed” sort and spill-to-disk for hash agg:
>> > >> > >>>>>>>
>> > >> > >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
>> > >> > >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for
>> > >> "managed"
>> > >> > >>>>>> operators
>> > >> > >>>>>>> #960, DRILL-5815: Option to set query memory as percent of
>> > total
>> > >> > >>>>>>>
>> > >> > >>>>>>> The following is needed to resolve issues with HBase
>> support
>> > in
>> > >> > empty
>> > >> > >>>>>> batches:
>> > >> > >>>>>>>
>> > >> > >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from
>> > DRILL-5546
>> > >> > >>>>>>>
>> > >> > >>>>>>> The following are nice-to-haves that build on work already
>> > done
>> > >> in
>> > >> > >>>>> this
>> > >> > >>>>>> release, and that some of my own work depends on:
>> > >> > >>>>>>>
>> > >> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
>> > >> > SystemOptionManager
>> > >> > >>>>>> rather than mock
>> > >> > >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment,
>> operator
>> > >> > >>>>> contexts
>> > >> > >>>>>> for testing
>> > >> > >>>>>>>
>> > >> > >>>>>>> The following is not needed for 1.12 per-se, but is the
>> > >> foundation
>> > >> > >>>>> for a
>> > >> > >>>>>> project I’m working on; would be good to get this in after
>> 2-3
>> > >> > months
>> > >> > >> of
>> > >> > >>>>>> review time:
>> > >> > >>>>>>>
>> > >> > >>>>>>> #921, foundation for batch size limitation
>> > >> > >>>>>>>
>> > >> > >>>>>>> The key issue with each of the above is that they each
>> need a
>> > >> > >>>>> committer
>> > >> > >>>>>> to review. Some have reviews from non-committers. Any
>> > volunteers?
>> > >> > >>>>>>>
>> > >> > >>>>>>> Thanks,
>> > >> > >>>>>>>
>> > >> > >>>>>>> - Paul
>> > >> > >>>>>>>
>> > >> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <
>> cgivre@gmail.com>
>> > >> > wrote:
>> > >> > >>>>>>>>
>> > >> > >>>>>>>> Hi Arina,
>> > >> > >>>>>>>> I’d like to include Drill-5834, Adding network functions.
>> > >> > >>>>>>>> https://github.com/apache/drill/pull/971 <
>> > >> > >> https://github.com/apache/
>> > >> > >>>>>> drill/pull/971>
>> > >> > >>>>>>>>
>> > >> > >>>>>>>> Hopefully I didn’t violate too many coding standards this
>> > time
>> > >> ;-)
>> > >> > >>>>>>>> —C
>> > >> > >>>>>>>>
>> > >> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
>> > >> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
>> > >> > >>>>>>>>>
>> > >> > >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try
>> to
>> > >> > finish
>> > >> > >>>>> code
>> > >> > >>>>>>>>> review during this week.
>> > >> > >>>>>>>>>
>> > >> > >>>>>>>>> Kind regards
>> > >> > >>>>>>>>> Arina
>> > >> > >>>>>>>>>
>> > >> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
>> > >> > arina@apache.org
>> > >> > >>>
>> > >> > >>>>>> wrote:
>> > >> > >>>>>>>>>
>> > >> > >>>>>>>>>> Hi Drillers,
>> > >> > >>>>>>>>>>
>> > >> > >>>>>>>>>> It's been several months since the last release and it
>> is
>> > >> time
>> > >> > to
>> > >> > >>>>> do
>> > >> > >>>>>> the
>> > >> > >>>>>>>>>> next one. I am volunteering to be the release manager.
>> > >> > >>>>>>>>>>
>> > >> > >>>>>>>>>> If there are any issues on which work is in progress,
>> that
>> > >> you
>> > >> > >>>>> feel we
>> > >> > >>>>>>>>>> *must* include in the release, please post in reply to
>> this
>> > >> > >> thread.
>> > >> > >>>>>> Based
>> > >> > >>>>>>>>>> on your input we'll define release cut off date.
>> > >> > >>>>>>>>>>
>> > >> > >>>>>>>>>> Kind regards
>> > >> > >>>>>>>>>> Arina
>> > >> > >>>>>>>>>>
>> > >> > >>>>>>>>
>> > >> > >>>>>>>
>> > >> > >>>>>>
>> > >> > >>>>>>
>> > >> > >>>>>
>> > >> > >>>>
>> > >> > >>>>
>> > >> > >>
>> > >> > >>
>> > >> >
>> > >> >
>> > >>
>> > >
>> > >
>> >
>>
>
>
Re: [DISCUSS] Drill 1.12.0 release
Posted by Arina Yelchiyeva <ar...@gmail.com>.
Current status:
DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
reviewer - Paul) - could not cherry-pick the commits. Needs fix.
DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
reviewer - Paul) - there are unit test failures. Needs fix.
Kind regards
On Sat, Nov 25, 2017 at 11:53 PM, AnilKumar B <ak...@gmail.com> wrote:
> Hi Arina,
>
> Sorry for the delay. Just now we squashed Kafka storage plugin commits into
> one commit and pushed.
>
> Thanks & Regards,
> B Anil Kumar.
>
> On Sat, Nov 25, 2017 at 5:56 AM, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com> wrote:
>
> > Current status:
> >
> > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> > reviewer - Paul) - needs to squash the commits.
> > DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> > reviewer - Paul) - needs to address some code review comments.
> >
> > Kind regards
> > Arina
> >
> > On Wed, Nov 15, 2017 at 2:38 PM, Arina Yelchiyeva <
> > arina.yelchiyeva@gmail.com> wrote:
> >
> > > Current status, we are close to the code freeze which will happen not
> > > later then the end of the next week.
> > >
> > > Blocker:
> > > DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
> code
> > > reviewer - Arina) - in progress.
> > >
> > > Targeted for 1.12 release:
> > > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
> code
> > > reviewer - Paul) - needs next round of code review.
> > > DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> > > mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
> waiting
> > > for Parth code review.
> > > DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
> code
> > > reviewer - Tim) - code review is done, waiting for the merge.
> > >
> > > Kind regards
> > >
> > > On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cs...@mapr.com> wrote:
> > >
> > >> Hi Arina,
> > >>
> > >>
> > >> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy
> > >> loading schema for storage plugins. Could you or Paul take a look at
> the
> > >> pull request for this JIRA https://github.com/apache/drill/pull/1032?
> I
> > >> think both of you are familiar with this part.
> > >>
> > >>
> > >> Thanks,
> > >>
> > >>
> > >> Chunhui
> > >>
> > >> ________________________________
> > >> From: Arina Yelchiyeva <ar...@gmail.com>
> > >> Sent: Thursday, November 9, 2017 8:11:35 AM
> > >> To: dev@drill.apache.org
> > >> Subject: Re: [DISCUSS] Drill 1.12.0 release
> > >>
> > >> Yes, they are already in master.
> > >>
> > >> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com>
> wrote:
> > >>
> > >> > We’re including the Networking functions in this release right?
> > >> >
> > >> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <
> > >> arina.yelchiyeva@gmail.com>
> > >> > wrote:
> > >> > >
> > >> > > If changes will be done before cut off date, targeting mid
> November
> > >> that
> > >> > it
> > >> > > will be possible to include this Jira.
> > >> > >
> > >> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com>
> > >> wrote:
> > >> > >
> > >> > >> Hi Arina,
> > >> > >> Can we include DRILL-4091 Support for additional GIS operations
> in
> > >> > version
> > >> > >> 1.12? In general the code looked pretty good. There was a unit
> > test
> > >> > >> missing which the developer submitted and some minor formatting
> > >> issues
> > >> > >> which I’m still waiting on.
> > >> > >> Thanks,
> > >> > >> —C
> > >> > >>
> > >> > >>
> > >> > >>
> > >> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
> > >> arina.yelchiyeva@gmail.com
> > >> > >
> > >> > >> wrote:
> > >> > >>>
> > >> > >>> Current status:
> > >> > >>>
> > >> > >>> Blocker:
> > >> > >>> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad
> > R.,
> > >> > code
> > >> > >>> reviewer - ?) - in progress.
> > >> > >>>
> > >> > >>> Targeted for 1.12 release:
> > >> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
> > >> > >> reviewer -
> > >> > >>> Arina) - code review in final stage.
> > >> > >>> DRILL-4779: Kafka storage plugin support (developer - Anil &
> > Kamesh,
> > >> > code
> > >> > >>> reviewer - Paul) - in review.
> > >> > >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for
> > >> PLAIN
> > >> > >>> mechanism (developer - Sorabh, code reviewer - Parth & Laurent)
> -
> > >> > waiting
> > >> > >>> for the code review.
> > >> > >>> DRILL-5771: Fix serDe errors for format plugins (developer -
> > Arina,
> > >> > code
> > >> > >>> reviewer - Tim) - waiting for the code review.
> > >> > >>>
> > >> > >>> Kind regards
> > >> > >>> Arina
> > >> > >>>
> > >> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
> > >> > >>> arina.yelchiyeva@gmail.com> wrote:
> > >> > >>>
> > >> > >>>> Current status:
> > >> > >>>>
> > >> > >>>> Targeted for 1.12 release:
> > >> > >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
> > >> rather
> > >> > >> than
> > >> > >>>> mock (developer - Paul, code reviewer - ?) - waiting for the
> code
> > >> > review
> > >> > >>>> DRILL-5842: Refactor and simplify the fragment, operator
> contexts
> > >> for
> > >> > >>>> testing (developer - Paul, code reviewer - ?) - waiting for the
> > >> code
> > >> > >>>> review
> > >> > >>>> DRILL-5834: Adding network functions (developer - Charles, code
> > >> > reviewer
> > >> > >>>> - Arina) - waiting changes after code review
> > >> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code
> reviewer -
> > >> > >> Arina) - waiting
> > >> > >>>> for the code review
> > >> > >>>> DRILL-5772: Enable UTF-8 support in query string by default
> > >> > (developer -
> > >> > >>>> Arina, code reviewer - Paul) - finalizing approach
> > >> > >>>> DRILL-4779: Kafka storage plugin support (developer - Anil,
> code
> > >> > >> reviewer
> > >> > >>>> - ?) - finishing implementation
> > >> > >>>>
> > >> > >>>> Under question:
> > >> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer -
> Jyothsna,
> > >> code
> > >> > >>>> reviewer - ?) - waiting for the status update from the
> developer
> > >> > >>>>
> > >> > >>>> Please free to suggest other items that are targeted for 1.12
> > >> release.
> > >> > >>>> There are many Jiras that have fix version marked as 1.12, it
> > >> would be
> > >> > >> good
> > >> > >>>> if developers revisit them and update fix version to the actual
> > >> one.
> > >> > >>>> Link to the dashboard - https://issues.apache.org/
> > >> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
> > >> > DRILL&view=detail
> > >> > >>>>
> > >> > >>>> Kind regards
> > >> > >>>> Arina
> > >> > >>>>
> > >> > >>>>
> > >> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <
> > parthc@apache.org>
> > >> > >> wrote:
> > >> > >>>>
> > >> > >>>>> I'm waiting to merge the SSL changes in. Waiting a couple of
> > days
> > >> > >> more to
> > >> > >>>>> see if there are any more comments before I merge the changes
> > in.
> > >> > >>>>>
> > >> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <
> progers@mapr.com>
> > >> > wrote:
> > >> > >>>>>
> > >> > >>>>>> Hi Arina,
> > >> > >>>>>>
> > >> > >>>>>> In addition to my own PRs, there are several in the “active”
> > >> queue
> > >> > >> that
> > >> > >>>>> we
> > >> > >>>>>> could get in if we can just push them over the line and clear
> > the
> > >> > >> queue.
> > >> > >>>>>> The owners of the PRs should check if we are waiting on them
> to
> > >> take
> > >> > >>>>> action.
> > >> > >>>>>>
> > >> > >>>>>> 977 DRILL-5849: Add freemarker lib to
> dependencyManagement
> > to
> > >> > >> ensure
> > >> > >>>>>> prop…
> > >> > >>>>>> 976 DRILL-5797: Choose parquet reader from read columns
> > >> > >>>>>> 975 DRILL-5743: Handling column family and column scan
> for
> > >> hbase
> > >> > >>>>>> 973 DRILL-5775: Select * query on a maprdb binary table
> > fails
> > >> > >>>>>> 972 DRILL-5838: Fix MaprDB filter pushdown for the case
> of
> > >> > nested
> > >> > >>>>>> field (reg. of DRILL-4264)
> > >> > >>>>>> 950 Drill 5431: SSL Support
> > >> > >>>>>> 949 DRILL-5795: Parquet Filter push down at rowgroup
> level
> > >> > >>>>>> 936 DRILL-5772: Add unit tests to indicate how utf-8
> > support
> > >> can
> > >> > >> be
> > >> > >>>>>> enabled / disabled in Drill
> > >> > >>>>>> 904 DRILL-5717: change some date time test cases with
> > >> specific
> > >> > >>>>>> timezone or Local
> > >> > >>>>>> 892 DRILL-5645: negation of expression causes null
> pointer
> > >> > >> exception
> > >> > >>>>>> 889 DRILL-5691: enhance scalar sub queries checking for
> the
> > >> > >>>>> cartesian
> > >> > >>>>>> join
> > >> > >>>>>>
> > >> > >>>>>> (Items not on the list above have become “inactive” for a
> > >> variety of
> > >> > >>>>>> reasons.)
> > >> > >>>>>>
> > >> > >>>>>> Thanks,
> > >> > >>>>>>
> > >> > >>>>>> - Paul
> > >> > >>>>>>
> > >> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com>
> > >> wrote:
> > >> > >>>>>>>
> > >> > >>>>>>> Hi Arina,
> > >> > >>>>>>>
> > >> > >>>>>>> I’d like to include the following that are needed to finish
> up
> > >> the
> > >> > >>>>>> “managed” sort and spill-to-disk for hash agg:
> > >> > >>>>>>>
> > >> > >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
> > >> > >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for
> > >> "managed"
> > >> > >>>>>> operators
> > >> > >>>>>>> #960, DRILL-5815: Option to set query memory as percent of
> > total
> > >> > >>>>>>>
> > >> > >>>>>>> The following is needed to resolve issues with HBase support
> > in
> > >> > empty
> > >> > >>>>>> batches:
> > >> > >>>>>>>
> > >> > >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from
> > DRILL-5546
> > >> > >>>>>>>
> > >> > >>>>>>> The following are nice-to-haves that build on work already
> > done
> > >> in
> > >> > >>>>> this
> > >> > >>>>>> release, and that some of my own work depends on:
> > >> > >>>>>>>
> > >> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
> > >> > SystemOptionManager
> > >> > >>>>>> rather than mock
> > >> > >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment,
> operator
> > >> > >>>>> contexts
> > >> > >>>>>> for testing
> > >> > >>>>>>>
> > >> > >>>>>>> The following is not needed for 1.12 per-se, but is the
> > >> foundation
> > >> > >>>>> for a
> > >> > >>>>>> project I’m working on; would be good to get this in after
> 2-3
> > >> > months
> > >> > >> of
> > >> > >>>>>> review time:
> > >> > >>>>>>>
> > >> > >>>>>>> #921, foundation for batch size limitation
> > >> > >>>>>>>
> > >> > >>>>>>> The key issue with each of the above is that they each need
> a
> > >> > >>>>> committer
> > >> > >>>>>> to review. Some have reviews from non-committers. Any
> > volunteers?
> > >> > >>>>>>>
> > >> > >>>>>>> Thanks,
> > >> > >>>>>>>
> > >> > >>>>>>> - Paul
> > >> > >>>>>>>
> > >> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <
> cgivre@gmail.com>
> > >> > wrote:
> > >> > >>>>>>>>
> > >> > >>>>>>>> Hi Arina,
> > >> > >>>>>>>> I’d like to include Drill-5834, Adding network functions.
> > >> > >>>>>>>> https://github.com/apache/drill/pull/971 <
> > >> > >> https://github.com/apache/
> > >> > >>>>>> drill/pull/971>
> > >> > >>>>>>>>
> > >> > >>>>>>>> Hopefully I didn’t violate too many coding standards this
> > time
> > >> ;-)
> > >> > >>>>>>>> —C
> > >> > >>>>>>>>
> > >> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
> > >> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
> > >> > >>>>>>>>>
> > >> > >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try
> to
> > >> > finish
> > >> > >>>>> code
> > >> > >>>>>>>>> review during this week.
> > >> > >>>>>>>>>
> > >> > >>>>>>>>> Kind regards
> > >> > >>>>>>>>> Arina
> > >> > >>>>>>>>>
> > >> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
> > >> > arina@apache.org
> > >> > >>>
> > >> > >>>>>> wrote:
> > >> > >>>>>>>>>
> > >> > >>>>>>>>>> Hi Drillers,
> > >> > >>>>>>>>>>
> > >> > >>>>>>>>>> It's been several months since the last release and it is
> > >> time
> > >> > to
> > >> > >>>>> do
> > >> > >>>>>> the
> > >> > >>>>>>>>>> next one. I am volunteering to be the release manager.
> > >> > >>>>>>>>>>
> > >> > >>>>>>>>>> If there are any issues on which work is in progress,
> that
> > >> you
> > >> > >>>>> feel we
> > >> > >>>>>>>>>> *must* include in the release, please post in reply to
> this
> > >> > >> thread.
> > >> > >>>>>> Based
> > >> > >>>>>>>>>> on your input we'll define release cut off date.
> > >> > >>>>>>>>>>
> > >> > >>>>>>>>>> Kind regards
> > >> > >>>>>>>>>> Arina
> > >> > >>>>>>>>>>
> > >> > >>>>>>>>
> > >> > >>>>>>>
> > >> > >>>>>>
> > >> > >>>>>>
> > >> > >>>>>
> > >> > >>>>
> > >> > >>>>
> > >> > >>
> > >> > >>
> > >> >
> > >> >
> > >>
> > >
> > >
> >
>
Re: [DISCUSS] Drill 1.12.0 release
Posted by AnilKumar B <ak...@gmail.com>.
Hi Arina,
Sorry for the delay. Just now we squashed Kafka storage plugin commits into
one commit and pushed.
Thanks & Regards,
B Anil Kumar.
On Sat, Nov 25, 2017 at 5:56 AM, Arina Yelchiyeva <
arina.yelchiyeva@gmail.com> wrote:
> Current status:
>
> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> reviewer - Paul) - needs to squash the commits.
> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> reviewer - Paul) - needs to address some code review comments.
>
> Kind regards
> Arina
>
> On Wed, Nov 15, 2017 at 2:38 PM, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com> wrote:
>
> > Current status, we are close to the code freeze which will happen not
> > later then the end of the next week.
> >
> > Blocker:
> > DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., code
> > reviewer - Arina) - in progress.
> >
> > Targeted for 1.12 release:
> > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> > reviewer - Paul) - needs next round of code review.
> > DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> > mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - waiting
> > for Parth code review.
> > DRILL-5771: Fix serDe errors for format plugins (developer - Arina, code
> > reviewer - Tim) - code review is done, waiting for the merge.
> >
> > Kind regards
> >
> > On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cs...@mapr.com> wrote:
> >
> >> Hi Arina,
> >>
> >>
> >> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy
> >> loading schema for storage plugins. Could you or Paul take a look at the
> >> pull request for this JIRA https://github.com/apache/drill/pull/1032? I
> >> think both of you are familiar with this part.
> >>
> >>
> >> Thanks,
> >>
> >>
> >> Chunhui
> >>
> >> ________________________________
> >> From: Arina Yelchiyeva <ar...@gmail.com>
> >> Sent: Thursday, November 9, 2017 8:11:35 AM
> >> To: dev@drill.apache.org
> >> Subject: Re: [DISCUSS] Drill 1.12.0 release
> >>
> >> Yes, they are already in master.
> >>
> >> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com> wrote:
> >>
> >> > We’re including the Networking functions in this release right?
> >> >
> >> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <
> >> arina.yelchiyeva@gmail.com>
> >> > wrote:
> >> > >
> >> > > If changes will be done before cut off date, targeting mid November
> >> that
> >> > it
> >> > > will be possible to include this Jira.
> >> > >
> >> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com>
> >> wrote:
> >> > >
> >> > >> Hi Arina,
> >> > >> Can we include DRILL-4091 Support for additional GIS operations in
> >> > version
> >> > >> 1.12? In general the code looked pretty good. There was a unit
> test
> >> > >> missing which the developer submitted and some minor formatting
> >> issues
> >> > >> which I’m still waiting on.
> >> > >> Thanks,
> >> > >> —C
> >> > >>
> >> > >>
> >> > >>
> >> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
> >> arina.yelchiyeva@gmail.com
> >> > >
> >> > >> wrote:
> >> > >>>
> >> > >>> Current status:
> >> > >>>
> >> > >>> Blocker:
> >> > >>> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad
> R.,
> >> > code
> >> > >>> reviewer - ?) - in progress.
> >> > >>>
> >> > >>> Targeted for 1.12 release:
> >> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
> >> > >> reviewer -
> >> > >>> Arina) - code review in final stage.
> >> > >>> DRILL-4779: Kafka storage plugin support (developer - Anil &
> Kamesh,
> >> > code
> >> > >>> reviewer - Paul) - in review.
> >> > >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for
> >> PLAIN
> >> > >>> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
> >> > waiting
> >> > >>> for the code review.
> >> > >>> DRILL-5771: Fix serDe errors for format plugins (developer -
> Arina,
> >> > code
> >> > >>> reviewer - Tim) - waiting for the code review.
> >> > >>>
> >> > >>> Kind regards
> >> > >>> Arina
> >> > >>>
> >> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
> >> > >>> arina.yelchiyeva@gmail.com> wrote:
> >> > >>>
> >> > >>>> Current status:
> >> > >>>>
> >> > >>>> Targeted for 1.12 release:
> >> > >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
> >> rather
> >> > >> than
> >> > >>>> mock (developer - Paul, code reviewer - ?) - waiting for the code
> >> > review
> >> > >>>> DRILL-5842: Refactor and simplify the fragment, operator contexts
> >> for
> >> > >>>> testing (developer - Paul, code reviewer - ?) - waiting for the
> >> code
> >> > >>>> review
> >> > >>>> DRILL-5834: Adding network functions (developer - Charles, code
> >> > reviewer
> >> > >>>> - Arina) - waiting changes after code review
> >> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
> >> > >> Arina) - waiting
> >> > >>>> for the code review
> >> > >>>> DRILL-5772: Enable UTF-8 support in query string by default
> >> > (developer -
> >> > >>>> Arina, code reviewer - Paul) - finalizing approach
> >> > >>>> DRILL-4779: Kafka storage plugin support (developer - Anil, code
> >> > >> reviewer
> >> > >>>> - ?) - finishing implementation
> >> > >>>>
> >> > >>>> Under question:
> >> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna,
> >> code
> >> > >>>> reviewer - ?) - waiting for the status update from the developer
> >> > >>>>
> >> > >>>> Please free to suggest other items that are targeted for 1.12
> >> release.
> >> > >>>> There are many Jiras that have fix version marked as 1.12, it
> >> would be
> >> > >> good
> >> > >>>> if developers revisit them and update fix version to the actual
> >> one.
> >> > >>>> Link to the dashboard - https://issues.apache.org/
> >> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
> >> > DRILL&view=detail
> >> > >>>>
> >> > >>>> Kind regards
> >> > >>>> Arina
> >> > >>>>
> >> > >>>>
> >> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <
> parthc@apache.org>
> >> > >> wrote:
> >> > >>>>
> >> > >>>>> I'm waiting to merge the SSL changes in. Waiting a couple of
> days
> >> > >> more to
> >> > >>>>> see if there are any more comments before I merge the changes
> in.
> >> > >>>>>
> >> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com>
> >> > wrote:
> >> > >>>>>
> >> > >>>>>> Hi Arina,
> >> > >>>>>>
> >> > >>>>>> In addition to my own PRs, there are several in the “active”
> >> queue
> >> > >> that
> >> > >>>>> we
> >> > >>>>>> could get in if we can just push them over the line and clear
> the
> >> > >> queue.
> >> > >>>>>> The owners of the PRs should check if we are waiting on them to
> >> take
> >> > >>>>> action.
> >> > >>>>>>
> >> > >>>>>> 977 DRILL-5849: Add freemarker lib to dependencyManagement
> to
> >> > >> ensure
> >> > >>>>>> prop…
> >> > >>>>>> 976 DRILL-5797: Choose parquet reader from read columns
> >> > >>>>>> 975 DRILL-5743: Handling column family and column scan for
> >> hbase
> >> > >>>>>> 973 DRILL-5775: Select * query on a maprdb binary table
> fails
> >> > >>>>>> 972 DRILL-5838: Fix MaprDB filter pushdown for the case of
> >> > nested
> >> > >>>>>> field (reg. of DRILL-4264)
> >> > >>>>>> 950 Drill 5431: SSL Support
> >> > >>>>>> 949 DRILL-5795: Parquet Filter push down at rowgroup level
> >> > >>>>>> 936 DRILL-5772: Add unit tests to indicate how utf-8
> support
> >> can
> >> > >> be
> >> > >>>>>> enabled / disabled in Drill
> >> > >>>>>> 904 DRILL-5717: change some date time test cases with
> >> specific
> >> > >>>>>> timezone or Local
> >> > >>>>>> 892 DRILL-5645: negation of expression causes null pointer
> >> > >> exception
> >> > >>>>>> 889 DRILL-5691: enhance scalar sub queries checking for the
> >> > >>>>> cartesian
> >> > >>>>>> join
> >> > >>>>>>
> >> > >>>>>> (Items not on the list above have become “inactive” for a
> >> variety of
> >> > >>>>>> reasons.)
> >> > >>>>>>
> >> > >>>>>> Thanks,
> >> > >>>>>>
> >> > >>>>>> - Paul
> >> > >>>>>>
> >> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com>
> >> wrote:
> >> > >>>>>>>
> >> > >>>>>>> Hi Arina,
> >> > >>>>>>>
> >> > >>>>>>> I’d like to include the following that are needed to finish up
> >> the
> >> > >>>>>> “managed” sort and spill-to-disk for hash agg:
> >> > >>>>>>>
> >> > >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
> >> > >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for
> >> "managed"
> >> > >>>>>> operators
> >> > >>>>>>> #960, DRILL-5815: Option to set query memory as percent of
> total
> >> > >>>>>>>
> >> > >>>>>>> The following is needed to resolve issues with HBase support
> in
> >> > empty
> >> > >>>>>> batches:
> >> > >>>>>>>
> >> > >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from
> DRILL-5546
> >> > >>>>>>>
> >> > >>>>>>> The following are nice-to-haves that build on work already
> done
> >> in
> >> > >>>>> this
> >> > >>>>>> release, and that some of my own work depends on:
> >> > >>>>>>>
> >> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
> >> > SystemOptionManager
> >> > >>>>>> rather than mock
> >> > >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
> >> > >>>>> contexts
> >> > >>>>>> for testing
> >> > >>>>>>>
> >> > >>>>>>> The following is not needed for 1.12 per-se, but is the
> >> foundation
> >> > >>>>> for a
> >> > >>>>>> project I’m working on; would be good to get this in after 2-3
> >> > months
> >> > >> of
> >> > >>>>>> review time:
> >> > >>>>>>>
> >> > >>>>>>> #921, foundation for batch size limitation
> >> > >>>>>>>
> >> > >>>>>>> The key issue with each of the above is that they each need a
> >> > >>>>> committer
> >> > >>>>>> to review. Some have reviews from non-committers. Any
> volunteers?
> >> > >>>>>>>
> >> > >>>>>>> Thanks,
> >> > >>>>>>>
> >> > >>>>>>> - Paul
> >> > >>>>>>>
> >> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com>
> >> > wrote:
> >> > >>>>>>>>
> >> > >>>>>>>> Hi Arina,
> >> > >>>>>>>> I’d like to include Drill-5834, Adding network functions.
> >> > >>>>>>>> https://github.com/apache/drill/pull/971 <
> >> > >> https://github.com/apache/
> >> > >>>>>> drill/pull/971>
> >> > >>>>>>>>
> >> > >>>>>>>> Hopefully I didn’t violate too many coding standards this
> time
> >> ;-)
> >> > >>>>>>>> —C
> >> > >>>>>>>>
> >> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
> >> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
> >> > >>>>>>>>>
> >> > >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to
> >> > finish
> >> > >>>>> code
> >> > >>>>>>>>> review during this week.
> >> > >>>>>>>>>
> >> > >>>>>>>>> Kind regards
> >> > >>>>>>>>> Arina
> >> > >>>>>>>>>
> >> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
> >> > arina@apache.org
> >> > >>>
> >> > >>>>>> wrote:
> >> > >>>>>>>>>
> >> > >>>>>>>>>> Hi Drillers,
> >> > >>>>>>>>>>
> >> > >>>>>>>>>> It's been several months since the last release and it is
> >> time
> >> > to
> >> > >>>>> do
> >> > >>>>>> the
> >> > >>>>>>>>>> next one. I am volunteering to be the release manager.
> >> > >>>>>>>>>>
> >> > >>>>>>>>>> If there are any issues on which work is in progress, that
> >> you
> >> > >>>>> feel we
> >> > >>>>>>>>>> *must* include in the release, please post in reply to this
> >> > >> thread.
> >> > >>>>>> Based
> >> > >>>>>>>>>> on your input we'll define release cut off date.
> >> > >>>>>>>>>>
> >> > >>>>>>>>>> Kind regards
> >> > >>>>>>>>>> Arina
> >> > >>>>>>>>>>
> >> > >>>>>>>>
> >> > >>>>>>>
> >> > >>>>>>
> >> > >>>>>>
> >> > >>>>>
> >> > >>>>
> >> > >>>>
> >> > >>
> >> > >>
> >> >
> >> >
> >>
> >
> >
>
Re: [DISCUSS] Drill 1.12.0 release
Posted by Arina Yelchiyeva <ar...@gmail.com>.
Current status:
DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
reviewer - Paul) - needs to squash the commits.
DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
reviewer - Paul) - needs to address some code review comments.
Kind regards
Arina
On Wed, Nov 15, 2017 at 2:38 PM, Arina Yelchiyeva <
arina.yelchiyeva@gmail.com> wrote:
> Current status, we are close to the code freeze which will happen not
> later then the end of the next week.
>
> Blocker:
> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., code
> reviewer - Arina) - in progress.
>
> Targeted for 1.12 release:
> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> reviewer - Paul) - needs next round of code review.
> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - waiting
> for Parth code review.
> DRILL-5771: Fix serDe errors for format plugins (developer - Arina, code
> reviewer - Tim) - code review is done, waiting for the merge.
>
> Kind regards
>
> On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cs...@mapr.com> wrote:
>
>> Hi Arina,
>>
>>
>> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy
>> loading schema for storage plugins. Could you or Paul take a look at the
>> pull request for this JIRA https://github.com/apache/drill/pull/1032? I
>> think both of you are familiar with this part.
>>
>>
>> Thanks,
>>
>>
>> Chunhui
>>
>> ________________________________
>> From: Arina Yelchiyeva <ar...@gmail.com>
>> Sent: Thursday, November 9, 2017 8:11:35 AM
>> To: dev@drill.apache.org
>> Subject: Re: [DISCUSS] Drill 1.12.0 release
>>
>> Yes, they are already in master.
>>
>> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com> wrote:
>>
>> > We’re including the Networking functions in this release right?
>> >
>> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <
>> arina.yelchiyeva@gmail.com>
>> > wrote:
>> > >
>> > > If changes will be done before cut off date, targeting mid November
>> that
>> > it
>> > > will be possible to include this Jira.
>> > >
>> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com>
>> wrote:
>> > >
>> > >> Hi Arina,
>> > >> Can we include DRILL-4091 Support for additional GIS operations in
>> > version
>> > >> 1.12? In general the code looked pretty good. There was a unit test
>> > >> missing which the developer submitted and some minor formatting
>> issues
>> > >> which I’m still waiting on.
>> > >> Thanks,
>> > >> —C
>> > >>
>> > >>
>> > >>
>> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
>> arina.yelchiyeva@gmail.com
>> > >
>> > >> wrote:
>> > >>>
>> > >>> Current status:
>> > >>>
>> > >>> Blocker:
>> > >>> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
>> > code
>> > >>> reviewer - ?) - in progress.
>> > >>>
>> > >>> Targeted for 1.12 release:
>> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
>> > >> reviewer -
>> > >>> Arina) - code review in final stage.
>> > >>> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
>> > code
>> > >>> reviewer - Paul) - in review.
>> > >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for
>> PLAIN
>> > >>> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
>> > waiting
>> > >>> for the code review.
>> > >>> DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
>> > code
>> > >>> reviewer - Tim) - waiting for the code review.
>> > >>>
>> > >>> Kind regards
>> > >>> Arina
>> > >>>
>> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
>> > >>> arina.yelchiyeva@gmail.com> wrote:
>> > >>>
>> > >>>> Current status:
>> > >>>>
>> > >>>> Targeted for 1.12 release:
>> > >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
>> rather
>> > >> than
>> > >>>> mock (developer - Paul, code reviewer - ?) - waiting for the code
>> > review
>> > >>>> DRILL-5842: Refactor and simplify the fragment, operator contexts
>> for
>> > >>>> testing (developer - Paul, code reviewer - ?) - waiting for the
>> code
>> > >>>> review
>> > >>>> DRILL-5834: Adding network functions (developer - Charles, code
>> > reviewer
>> > >>>> - Arina) - waiting changes after code review
>> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
>> > >> Arina) - waiting
>> > >>>> for the code review
>> > >>>> DRILL-5772: Enable UTF-8 support in query string by default
>> > (developer -
>> > >>>> Arina, code reviewer - Paul) - finalizing approach
>> > >>>> DRILL-4779: Kafka storage plugin support (developer - Anil, code
>> > >> reviewer
>> > >>>> - ?) - finishing implementation
>> > >>>>
>> > >>>> Under question:
>> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna,
>> code
>> > >>>> reviewer - ?) - waiting for the status update from the developer
>> > >>>>
>> > >>>> Please free to suggest other items that are targeted for 1.12
>> release.
>> > >>>> There are many Jiras that have fix version marked as 1.12, it
>> would be
>> > >> good
>> > >>>> if developers revisit them and update fix version to the actual
>> one.
>> > >>>> Link to the dashboard - https://issues.apache.org/
>> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
>> > DRILL&view=detail
>> > >>>>
>> > >>>> Kind regards
>> > >>>> Arina
>> > >>>>
>> > >>>>
>> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org>
>> > >> wrote:
>> > >>>>
>> > >>>>> I'm waiting to merge the SSL changes in. Waiting a couple of days
>> > >> more to
>> > >>>>> see if there are any more comments before I merge the changes in.
>> > >>>>>
>> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com>
>> > wrote:
>> > >>>>>
>> > >>>>>> Hi Arina,
>> > >>>>>>
>> > >>>>>> In addition to my own PRs, there are several in the “active”
>> queue
>> > >> that
>> > >>>>> we
>> > >>>>>> could get in if we can just push them over the line and clear the
>> > >> queue.
>> > >>>>>> The owners of the PRs should check if we are waiting on them to
>> take
>> > >>>>> action.
>> > >>>>>>
>> > >>>>>> 977 DRILL-5849: Add freemarker lib to dependencyManagement to
>> > >> ensure
>> > >>>>>> prop…
>> > >>>>>> 976 DRILL-5797: Choose parquet reader from read columns
>> > >>>>>> 975 DRILL-5743: Handling column family and column scan for
>> hbase
>> > >>>>>> 973 DRILL-5775: Select * query on a maprdb binary table fails
>> > >>>>>> 972 DRILL-5838: Fix MaprDB filter pushdown for the case of
>> > nested
>> > >>>>>> field (reg. of DRILL-4264)
>> > >>>>>> 950 Drill 5431: SSL Support
>> > >>>>>> 949 DRILL-5795: Parquet Filter push down at rowgroup level
>> > >>>>>> 936 DRILL-5772: Add unit tests to indicate how utf-8 support
>> can
>> > >> be
>> > >>>>>> enabled / disabled in Drill
>> > >>>>>> 904 DRILL-5717: change some date time test cases with
>> specific
>> > >>>>>> timezone or Local
>> > >>>>>> 892 DRILL-5645: negation of expression causes null pointer
>> > >> exception
>> > >>>>>> 889 DRILL-5691: enhance scalar sub queries checking for the
>> > >>>>> cartesian
>> > >>>>>> join
>> > >>>>>>
>> > >>>>>> (Items not on the list above have become “inactive” for a
>> variety of
>> > >>>>>> reasons.)
>> > >>>>>>
>> > >>>>>> Thanks,
>> > >>>>>>
>> > >>>>>> - Paul
>> > >>>>>>
>> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com>
>> wrote:
>> > >>>>>>>
>> > >>>>>>> Hi Arina,
>> > >>>>>>>
>> > >>>>>>> I’d like to include the following that are needed to finish up
>> the
>> > >>>>>> “managed” sort and spill-to-disk for hash agg:
>> > >>>>>>>
>> > >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
>> > >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for
>> "managed"
>> > >>>>>> operators
>> > >>>>>>> #960, DRILL-5815: Option to set query memory as percent of total
>> > >>>>>>>
>> > >>>>>>> The following is needed to resolve issues with HBase support in
>> > empty
>> > >>>>>> batches:
>> > >>>>>>>
>> > >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
>> > >>>>>>>
>> > >>>>>>> The following are nice-to-haves that build on work already done
>> in
>> > >>>>> this
>> > >>>>>> release, and that some of my own work depends on:
>> > >>>>>>>
>> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
>> > SystemOptionManager
>> > >>>>>> rather than mock
>> > >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
>> > >>>>> contexts
>> > >>>>>> for testing
>> > >>>>>>>
>> > >>>>>>> The following is not needed for 1.12 per-se, but is the
>> foundation
>> > >>>>> for a
>> > >>>>>> project I’m working on; would be good to get this in after 2-3
>> > months
>> > >> of
>> > >>>>>> review time:
>> > >>>>>>>
>> > >>>>>>> #921, foundation for batch size limitation
>> > >>>>>>>
>> > >>>>>>> The key issue with each of the above is that they each need a
>> > >>>>> committer
>> > >>>>>> to review. Some have reviews from non-committers. Any volunteers?
>> > >>>>>>>
>> > >>>>>>> Thanks,
>> > >>>>>>>
>> > >>>>>>> - Paul
>> > >>>>>>>
>> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com>
>> > wrote:
>> > >>>>>>>>
>> > >>>>>>>> Hi Arina,
>> > >>>>>>>> I’d like to include Drill-5834, Adding network functions.
>> > >>>>>>>> https://github.com/apache/drill/pull/971 <
>> > >> https://github.com/apache/
>> > >>>>>> drill/pull/971>
>> > >>>>>>>>
>> > >>>>>>>> Hopefully I didn’t violate too many coding standards this time
>> ;-)
>> > >>>>>>>> —C
>> > >>>>>>>>
>> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
>> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
>> > >>>>>>>>>
>> > >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to
>> > finish
>> > >>>>> code
>> > >>>>>>>>> review during this week.
>> > >>>>>>>>>
>> > >>>>>>>>> Kind regards
>> > >>>>>>>>> Arina
>> > >>>>>>>>>
>> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
>> > arina@apache.org
>> > >>>
>> > >>>>>> wrote:
>> > >>>>>>>>>
>> > >>>>>>>>>> Hi Drillers,
>> > >>>>>>>>>>
>> > >>>>>>>>>> It's been several months since the last release and it is
>> time
>> > to
>> > >>>>> do
>> > >>>>>> the
>> > >>>>>>>>>> next one. I am volunteering to be the release manager.
>> > >>>>>>>>>>
>> > >>>>>>>>>> If there are any issues on which work is in progress, that
>> you
>> > >>>>> feel we
>> > >>>>>>>>>> *must* include in the release, please post in reply to this
>> > >> thread.
>> > >>>>>> Based
>> > >>>>>>>>>> on your input we'll define release cut off date.
>> > >>>>>>>>>>
>> > >>>>>>>>>> Kind regards
>> > >>>>>>>>>> Arina
>> > >>>>>>>>>>
>> > >>>>>>>>
>> > >>>>>>>
>> > >>>>>>
>> > >>>>>>
>> > >>>>>
>> > >>>>
>> > >>>>
>> > >>
>> > >>
>> >
>> >
>>
>
>
Re: [DISCUSS] Drill 1.12.0 release
Posted by Arina Yelchiyeva <ar...@gmail.com>.
Current status, we are close to the code freeze which will happen not later
then the end of the next week.
Blocker:
DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., code
reviewer - Arina) - in progress.
Targeted for 1.12 release:
DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
reviewer - Paul) - needs next round of code review.
DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - waiting
for Parth code review.
DRILL-5771: Fix serDe errors for format plugins (developer - Arina, code
reviewer - Tim) - code review is done, waiting for the merge.
Kind regards
On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cs...@mapr.com> wrote:
> Hi Arina,
>
>
> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy
> loading schema for storage plugins. Could you or Paul take a look at the
> pull request for this JIRA https://github.com/apache/drill/pull/1032? I
> think both of you are familiar with this part.
>
>
> Thanks,
>
>
> Chunhui
>
> ________________________________
> From: Arina Yelchiyeva <ar...@gmail.com>
> Sent: Thursday, November 9, 2017 8:11:35 AM
> To: dev@drill.apache.org
> Subject: Re: [DISCUSS] Drill 1.12.0 release
>
> Yes, they are already in master.
>
> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com> wrote:
>
> > We’re including the Networking functions in this release right?
> >
> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <arina.yelchiyeva@gmail.com
> >
> > wrote:
> > >
> > > If changes will be done before cut off date, targeting mid November
> that
> > it
> > > will be possible to include this Jira.
> > >
> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com>
> wrote:
> > >
> > >> Hi Arina,
> > >> Can we include DRILL-4091 Support for additional GIS operations in
> > version
> > >> 1.12? In general the code looked pretty good. There was a unit test
> > >> missing which the developer submitted and some minor formatting issues
> > >> which I’m still waiting on.
> > >> Thanks,
> > >> —C
> > >>
> > >>
> > >>
> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com
> > >
> > >> wrote:
> > >>>
> > >>> Current status:
> > >>>
> > >>> Blocker:
> > >>> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
> > code
> > >>> reviewer - ?) - in progress.
> > >>>
> > >>> Targeted for 1.12 release:
> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
> > >> reviewer -
> > >>> Arina) - code review in final stage.
> > >>> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
> > code
> > >>> reviewer - Paul) - in review.
> > >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> > >>> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
> > waiting
> > >>> for the code review.
> > >>> DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
> > code
> > >>> reviewer - Tim) - waiting for the code review.
> > >>>
> > >>> Kind regards
> > >>> Arina
> > >>>
> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
> > >>> arina.yelchiyeva@gmail.com> wrote:
> > >>>
> > >>>> Current status:
> > >>>>
> > >>>> Targeted for 1.12 release:
> > >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
> rather
> > >> than
> > >>>> mock (developer - Paul, code reviewer - ?) - waiting for the code
> > review
> > >>>> DRILL-5842: Refactor and simplify the fragment, operator contexts
> for
> > >>>> testing (developer - Paul, code reviewer - ?) - waiting for the code
> > >>>> review
> > >>>> DRILL-5834: Adding network functions (developer - Charles, code
> > reviewer
> > >>>> - Arina) - waiting changes after code review
> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
> > >> Arina) - waiting
> > >>>> for the code review
> > >>>> DRILL-5772: Enable UTF-8 support in query string by default
> > (developer -
> > >>>> Arina, code reviewer - Paul) - finalizing approach
> > >>>> DRILL-4779: Kafka storage plugin support (developer - Anil, code
> > >> reviewer
> > >>>> - ?) - finishing implementation
> > >>>>
> > >>>> Under question:
> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna,
> code
> > >>>> reviewer - ?) - waiting for the status update from the developer
> > >>>>
> > >>>> Please free to suggest other items that are targeted for 1.12
> release.
> > >>>> There are many Jiras that have fix version marked as 1.12, it would
> be
> > >> good
> > >>>> if developers revisit them and update fix version to the actual one.
> > >>>> Link to the dashboard - https://issues.apache.org/
> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
> > DRILL&view=detail
> > >>>>
> > >>>> Kind regards
> > >>>> Arina
> > >>>>
> > >>>>
> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org>
> > >> wrote:
> > >>>>
> > >>>>> I'm waiting to merge the SSL changes in. Waiting a couple of days
> > >> more to
> > >>>>> see if there are any more comments before I merge the changes in.
> > >>>>>
> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com>
> > wrote:
> > >>>>>
> > >>>>>> Hi Arina,
> > >>>>>>
> > >>>>>> In addition to my own PRs, there are several in the “active” queue
> > >> that
> > >>>>> we
> > >>>>>> could get in if we can just push them over the line and clear the
> > >> queue.
> > >>>>>> The owners of the PRs should check if we are waiting on them to
> take
> > >>>>> action.
> > >>>>>>
> > >>>>>> 977 DRILL-5849: Add freemarker lib to dependencyManagement to
> > >> ensure
> > >>>>>> prop…
> > >>>>>> 976 DRILL-5797: Choose parquet reader from read columns
> > >>>>>> 975 DRILL-5743: Handling column family and column scan for
> hbase
> > >>>>>> 973 DRILL-5775: Select * query on a maprdb binary table fails
> > >>>>>> 972 DRILL-5838: Fix MaprDB filter pushdown for the case of
> > nested
> > >>>>>> field (reg. of DRILL-4264)
> > >>>>>> 950 Drill 5431: SSL Support
> > >>>>>> 949 DRILL-5795: Parquet Filter push down at rowgroup level
> > >>>>>> 936 DRILL-5772: Add unit tests to indicate how utf-8 support
> can
> > >> be
> > >>>>>> enabled / disabled in Drill
> > >>>>>> 904 DRILL-5717: change some date time test cases with specific
> > >>>>>> timezone or Local
> > >>>>>> 892 DRILL-5645: negation of expression causes null pointer
> > >> exception
> > >>>>>> 889 DRILL-5691: enhance scalar sub queries checking for the
> > >>>>> cartesian
> > >>>>>> join
> > >>>>>>
> > >>>>>> (Items not on the list above have become “inactive” for a variety
> of
> > >>>>>> reasons.)
> > >>>>>>
> > >>>>>> Thanks,
> > >>>>>>
> > >>>>>> - Paul
> > >>>>>>
> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com>
> wrote:
> > >>>>>>>
> > >>>>>>> Hi Arina,
> > >>>>>>>
> > >>>>>>> I’d like to include the following that are needed to finish up
> the
> > >>>>>> “managed” sort and spill-to-disk for hash agg:
> > >>>>>>>
> > >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
> > >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for
> "managed"
> > >>>>>> operators
> > >>>>>>> #960, DRILL-5815: Option to set query memory as percent of total
> > >>>>>>>
> > >>>>>>> The following is needed to resolve issues with HBase support in
> > empty
> > >>>>>> batches:
> > >>>>>>>
> > >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
> > >>>>>>>
> > >>>>>>> The following are nice-to-haves that build on work already done
> in
> > >>>>> this
> > >>>>>> release, and that some of my own work depends on:
> > >>>>>>>
> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
> > SystemOptionManager
> > >>>>>> rather than mock
> > >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
> > >>>>> contexts
> > >>>>>> for testing
> > >>>>>>>
> > >>>>>>> The following is not needed for 1.12 per-se, but is the
> foundation
> > >>>>> for a
> > >>>>>> project I’m working on; would be good to get this in after 2-3
> > months
> > >> of
> > >>>>>> review time:
> > >>>>>>>
> > >>>>>>> #921, foundation for batch size limitation
> > >>>>>>>
> > >>>>>>> The key issue with each of the above is that they each need a
> > >>>>> committer
> > >>>>>> to review. Some have reviews from non-committers. Any volunteers?
> > >>>>>>>
> > >>>>>>> Thanks,
> > >>>>>>>
> > >>>>>>> - Paul
> > >>>>>>>
> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com>
> > wrote:
> > >>>>>>>>
> > >>>>>>>> Hi Arina,
> > >>>>>>>> I’d like to include Drill-5834, Adding network functions.
> > >>>>>>>> https://github.com/apache/drill/pull/971 <
> > >> https://github.com/apache/
> > >>>>>> drill/pull/971>
> > >>>>>>>>
> > >>>>>>>> Hopefully I didn’t violate too many coding standards this time
> ;-)
> > >>>>>>>> —C
> > >>>>>>>>
> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
> > >>>>>>>>>
> > >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to
> > finish
> > >>>>> code
> > >>>>>>>>> review during this week.
> > >>>>>>>>>
> > >>>>>>>>> Kind regards
> > >>>>>>>>> Arina
> > >>>>>>>>>
> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
> > arina@apache.org
> > >>>
> > >>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> Hi Drillers,
> > >>>>>>>>>>
> > >>>>>>>>>> It's been several months since the last release and it is time
> > to
> > >>>>> do
> > >>>>>> the
> > >>>>>>>>>> next one. I am volunteering to be the release manager.
> > >>>>>>>>>>
> > >>>>>>>>>> If there are any issues on which work is in progress, that you
> > >>>>> feel we
> > >>>>>>>>>> *must* include in the release, please post in reply to this
> > >> thread.
> > >>>>>> Based
> > >>>>>>>>>> on your input we'll define release cut off date.
> > >>>>>>>>>>
> > >>>>>>>>>> Kind regards
> > >>>>>>>>>> Arina
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>
> > >>>>
> > >>>>
> > >>
> > >>
> >
> >
>
Re: [DISCUSS] Drill 1.12.0 release
Posted by Chunhui Shi <cs...@mapr.com>.
Hi Arina,
Could we consider to include DRILL-5089 in 1.12.0? It is about lazy loading schema for storage plugins. Could you or Paul take a look at the pull request for this JIRA https://github.com/apache/drill/pull/1032? I think both of you are familiar with this part.
Thanks,
Chunhui
________________________________
From: Arina Yelchiyeva <ar...@gmail.com>
Sent: Thursday, November 9, 2017 8:11:35 AM
To: dev@drill.apache.org
Subject: Re: [DISCUSS] Drill 1.12.0 release
Yes, they are already in master.
On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com> wrote:
> We’re including the Networking functions in this release right?
>
> > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <ar...@gmail.com>
> wrote:
> >
> > If changes will be done before cut off date, targeting mid November that
> it
> > will be possible to include this Jira.
> >
> > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com> wrote:
> >
> >> Hi Arina,
> >> Can we include DRILL-4091 Support for additional GIS operations in
> version
> >> 1.12? In general the code looked pretty good. There was a unit test
> >> missing which the developer submitted and some minor formatting issues
> >> which I’m still waiting on.
> >> Thanks,
> >> —C
> >>
> >>
> >>
> >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <arina.yelchiyeva@gmail.com
> >
> >> wrote:
> >>>
> >>> Current status:
> >>>
> >>> Blocker:
> >>> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
> code
> >>> reviewer - ?) - in progress.
> >>>
> >>> Targeted for 1.12 release:
> >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
> >> reviewer -
> >>> Arina) - code review in final stage.
> >>> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
> code
> >>> reviewer - Paul) - in review.
> >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> >>> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
> waiting
> >>> for the code review.
> >>> DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
> code
> >>> reviewer - Tim) - waiting for the code review.
> >>>
> >>> Kind regards
> >>> Arina
> >>>
> >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
> >>> arina.yelchiyeva@gmail.com> wrote:
> >>>
> >>>> Current status:
> >>>>
> >>>> Targeted for 1.12 release:
> >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather
> >> than
> >>>> mock (developer - Paul, code reviewer - ?) - waiting for the code
> review
> >>>> DRILL-5842: Refactor and simplify the fragment, operator contexts for
> >>>> testing (developer - Paul, code reviewer - ?) - waiting for the code
> >>>> review
> >>>> DRILL-5834: Adding network functions (developer - Charles, code
> reviewer
> >>>> - Arina) - waiting changes after code review
> >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
> >> Arina) - waiting
> >>>> for the code review
> >>>> DRILL-5772: Enable UTF-8 support in query string by default
> (developer -
> >>>> Arina, code reviewer - Paul) - finalizing approach
> >>>> DRILL-4779: Kafka storage plugin support (developer - Anil, code
> >> reviewer
> >>>> - ?) - finishing implementation
> >>>>
> >>>> Under question:
> >>>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> >>>> reviewer - ?) - waiting for the status update from the developer
> >>>>
> >>>> Please free to suggest other items that are targeted for 1.12 release.
> >>>> There are many Jiras that have fix version marked as 1.12, it would be
> >> good
> >>>> if developers revisit them and update fix version to the actual one.
> >>>> Link to the dashboard - https://issues.apache.org/
> >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
> DRILL&view=detail
> >>>>
> >>>> Kind regards
> >>>> Arina
> >>>>
> >>>>
> >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org>
> >> wrote:
> >>>>
> >>>>> I'm waiting to merge the SSL changes in. Waiting a couple of days
> >> more to
> >>>>> see if there are any more comments before I merge the changes in.
> >>>>>
> >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com>
> wrote:
> >>>>>
> >>>>>> Hi Arina,
> >>>>>>
> >>>>>> In addition to my own PRs, there are several in the “active” queue
> >> that
> >>>>> we
> >>>>>> could get in if we can just push them over the line and clear the
> >> queue.
> >>>>>> The owners of the PRs should check if we are waiting on them to take
> >>>>> action.
> >>>>>>
> >>>>>> 977 DRILL-5849: Add freemarker lib to dependencyManagement to
> >> ensure
> >>>>>> prop…
> >>>>>> 976 DRILL-5797: Choose parquet reader from read columns
> >>>>>> 975 DRILL-5743: Handling column family and column scan for hbase
> >>>>>> 973 DRILL-5775: Select * query on a maprdb binary table fails
> >>>>>> 972 DRILL-5838: Fix MaprDB filter pushdown for the case of
> nested
> >>>>>> field (reg. of DRILL-4264)
> >>>>>> 950 Drill 5431: SSL Support
> >>>>>> 949 DRILL-5795: Parquet Filter push down at rowgroup level
> >>>>>> 936 DRILL-5772: Add unit tests to indicate how utf-8 support can
> >> be
> >>>>>> enabled / disabled in Drill
> >>>>>> 904 DRILL-5717: change some date time test cases with specific
> >>>>>> timezone or Local
> >>>>>> 892 DRILL-5645: negation of expression causes null pointer
> >> exception
> >>>>>> 889 DRILL-5691: enhance scalar sub queries checking for the
> >>>>> cartesian
> >>>>>> join
> >>>>>>
> >>>>>> (Items not on the list above have become “inactive” for a variety of
> >>>>>> reasons.)
> >>>>>>
> >>>>>> Thanks,
> >>>>>>
> >>>>>> - Paul
> >>>>>>
> >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
> >>>>>>>
> >>>>>>> Hi Arina,
> >>>>>>>
> >>>>>>> I’d like to include the following that are needed to finish up the
> >>>>>> “managed” sort and spill-to-disk for hash agg:
> >>>>>>>
> >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
> >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for "managed"
> >>>>>> operators
> >>>>>>> #960, DRILL-5815: Option to set query memory as percent of total
> >>>>>>>
> >>>>>>> The following is needed to resolve issues with HBase support in
> empty
> >>>>>> batches:
> >>>>>>>
> >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
> >>>>>>>
> >>>>>>> The following are nice-to-haves that build on work already done in
> >>>>> this
> >>>>>> release, and that some of my own work depends on:
> >>>>>>>
> >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
> SystemOptionManager
> >>>>>> rather than mock
> >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
> >>>>> contexts
> >>>>>> for testing
> >>>>>>>
> >>>>>>> The following is not needed for 1.12 per-se, but is the foundation
> >>>>> for a
> >>>>>> project I’m working on; would be good to get this in after 2-3
> months
> >> of
> >>>>>> review time:
> >>>>>>>
> >>>>>>> #921, foundation for batch size limitation
> >>>>>>>
> >>>>>>> The key issue with each of the above is that they each need a
> >>>>> committer
> >>>>>> to review. Some have reviews from non-committers. Any volunteers?
> >>>>>>>
> >>>>>>> Thanks,
> >>>>>>>
> >>>>>>> - Paul
> >>>>>>>
> >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com>
> wrote:
> >>>>>>>>
> >>>>>>>> Hi Arina,
> >>>>>>>> I’d like to include Drill-5834, Adding network functions.
> >>>>>>>> https://github.com/apache/drill/pull/971 <
> >> https://github.com/apache/
> >>>>>> drill/pull/971>
> >>>>>>>>
> >>>>>>>> Hopefully I didn’t violate too many coding standards this time ;-)
> >>>>>>>> —C
> >>>>>>>>
> >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
> >>>>>> arina.yelchiyeva@gmail.com> wrote:
> >>>>>>>>>
> >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to
> finish
> >>>>> code
> >>>>>>>>> review during this week.
> >>>>>>>>>
> >>>>>>>>> Kind regards
> >>>>>>>>> Arina
> >>>>>>>>>
> >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
> arina@apache.org
> >>>
> >>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Hi Drillers,
> >>>>>>>>>>
> >>>>>>>>>> It's been several months since the last release and it is time
> to
> >>>>> do
> >>>>>> the
> >>>>>>>>>> next one. I am volunteering to be the release manager.
> >>>>>>>>>>
> >>>>>>>>>> If there are any issues on which work is in progress, that you
> >>>>> feel we
> >>>>>>>>>> *must* include in the release, please post in reply to this
> >> thread.
> >>>>>> Based
> >>>>>>>>>> on your input we'll define release cut off date.
> >>>>>>>>>>
> >>>>>>>>>> Kind regards
> >>>>>>>>>> Arina
> >>>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>>
> >>
> >>
>
>
Re: [DISCUSS] Drill 1.12.0 release
Posted by Arina Yelchiyeva <ar...@gmail.com>.
Yes, they are already in master.
On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cg...@gmail.com> wrote:
> We’re including the Networking functions in this release right?
>
> > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <ar...@gmail.com>
> wrote:
> >
> > If changes will be done before cut off date, targeting mid November that
> it
> > will be possible to include this Jira.
> >
> > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com> wrote:
> >
> >> Hi Arina,
> >> Can we include DRILL-4091 Support for additional GIS operations in
> version
> >> 1.12? In general the code looked pretty good. There was a unit test
> >> missing which the developer submitted and some minor formatting issues
> >> which I’m still waiting on.
> >> Thanks,
> >> —C
> >>
> >>
> >>
> >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <arina.yelchiyeva@gmail.com
> >
> >> wrote:
> >>>
> >>> Current status:
> >>>
> >>> Blocker:
> >>> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
> code
> >>> reviewer - ?) - in progress.
> >>>
> >>> Targeted for 1.12 release:
> >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
> >> reviewer -
> >>> Arina) - code review in final stage.
> >>> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
> code
> >>> reviewer - Paul) - in review.
> >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> >>> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) -
> waiting
> >>> for the code review.
> >>> DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
> code
> >>> reviewer - Tim) - waiting for the code review.
> >>>
> >>> Kind regards
> >>> Arina
> >>>
> >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
> >>> arina.yelchiyeva@gmail.com> wrote:
> >>>
> >>>> Current status:
> >>>>
> >>>> Targeted for 1.12 release:
> >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather
> >> than
> >>>> mock (developer - Paul, code reviewer - ?) - waiting for the code
> review
> >>>> DRILL-5842: Refactor and simplify the fragment, operator contexts for
> >>>> testing (developer - Paul, code reviewer - ?) - waiting for the code
> >>>> review
> >>>> DRILL-5834: Adding network functions (developer - Charles, code
> reviewer
> >>>> - Arina) - waiting changes after code review
> >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
> >> Arina) - waiting
> >>>> for the code review
> >>>> DRILL-5772: Enable UTF-8 support in query string by default
> (developer -
> >>>> Arina, code reviewer - Paul) - finalizing approach
> >>>> DRILL-4779: Kafka storage plugin support (developer - Anil, code
> >> reviewer
> >>>> - ?) - finishing implementation
> >>>>
> >>>> Under question:
> >>>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> >>>> reviewer - ?) - waiting for the status update from the developer
> >>>>
> >>>> Please free to suggest other items that are targeted for 1.12 release.
> >>>> There are many Jiras that have fix version marked as 1.12, it would be
> >> good
> >>>> if developers revisit them and update fix version to the actual one.
> >>>> Link to the dashboard - https://issues.apache.org/
> >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
> DRILL&view=detail
> >>>>
> >>>> Kind regards
> >>>> Arina
> >>>>
> >>>>
> >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org>
> >> wrote:
> >>>>
> >>>>> I'm waiting to merge the SSL changes in. Waiting a couple of days
> >> more to
> >>>>> see if there are any more comments before I merge the changes in.
> >>>>>
> >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com>
> wrote:
> >>>>>
> >>>>>> Hi Arina,
> >>>>>>
> >>>>>> In addition to my own PRs, there are several in the “active” queue
> >> that
> >>>>> we
> >>>>>> could get in if we can just push them over the line and clear the
> >> queue.
> >>>>>> The owners of the PRs should check if we are waiting on them to take
> >>>>> action.
> >>>>>>
> >>>>>> 977 DRILL-5849: Add freemarker lib to dependencyManagement to
> >> ensure
> >>>>>> prop…
> >>>>>> 976 DRILL-5797: Choose parquet reader from read columns
> >>>>>> 975 DRILL-5743: Handling column family and column scan for hbase
> >>>>>> 973 DRILL-5775: Select * query on a maprdb binary table fails
> >>>>>> 972 DRILL-5838: Fix MaprDB filter pushdown for the case of
> nested
> >>>>>> field (reg. of DRILL-4264)
> >>>>>> 950 Drill 5431: SSL Support
> >>>>>> 949 DRILL-5795: Parquet Filter push down at rowgroup level
> >>>>>> 936 DRILL-5772: Add unit tests to indicate how utf-8 support can
> >> be
> >>>>>> enabled / disabled in Drill
> >>>>>> 904 DRILL-5717: change some date time test cases with specific
> >>>>>> timezone or Local
> >>>>>> 892 DRILL-5645: negation of expression causes null pointer
> >> exception
> >>>>>> 889 DRILL-5691: enhance scalar sub queries checking for the
> >>>>> cartesian
> >>>>>> join
> >>>>>>
> >>>>>> (Items not on the list above have become “inactive” for a variety of
> >>>>>> reasons.)
> >>>>>>
> >>>>>> Thanks,
> >>>>>>
> >>>>>> - Paul
> >>>>>>
> >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
> >>>>>>>
> >>>>>>> Hi Arina,
> >>>>>>>
> >>>>>>> I’d like to include the following that are needed to finish up the
> >>>>>> “managed” sort and spill-to-disk for hash agg:
> >>>>>>>
> >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
> >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for "managed"
> >>>>>> operators
> >>>>>>> #960, DRILL-5815: Option to set query memory as percent of total
> >>>>>>>
> >>>>>>> The following is needed to resolve issues with HBase support in
> empty
> >>>>>> batches:
> >>>>>>>
> >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
> >>>>>>>
> >>>>>>> The following are nice-to-haves that build on work already done in
> >>>>> this
> >>>>>> release, and that some of my own work depends on:
> >>>>>>>
> >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
> SystemOptionManager
> >>>>>> rather than mock
> >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
> >>>>> contexts
> >>>>>> for testing
> >>>>>>>
> >>>>>>> The following is not needed for 1.12 per-se, but is the foundation
> >>>>> for a
> >>>>>> project I’m working on; would be good to get this in after 2-3
> months
> >> of
> >>>>>> review time:
> >>>>>>>
> >>>>>>> #921, foundation for batch size limitation
> >>>>>>>
> >>>>>>> The key issue with each of the above is that they each need a
> >>>>> committer
> >>>>>> to review. Some have reviews from non-committers. Any volunteers?
> >>>>>>>
> >>>>>>> Thanks,
> >>>>>>>
> >>>>>>> - Paul
> >>>>>>>
> >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com>
> wrote:
> >>>>>>>>
> >>>>>>>> Hi Arina,
> >>>>>>>> I’d like to include Drill-5834, Adding network functions.
> >>>>>>>> https://github.com/apache/drill/pull/971 <
> >> https://github.com/apache/
> >>>>>> drill/pull/971>
> >>>>>>>>
> >>>>>>>> Hopefully I didn’t violate too many coding standards this time ;-)
> >>>>>>>> —C
> >>>>>>>>
> >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
> >>>>>> arina.yelchiyeva@gmail.com> wrote:
> >>>>>>>>>
> >>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to
> finish
> >>>>> code
> >>>>>>>>> review during this week.
> >>>>>>>>>
> >>>>>>>>> Kind regards
> >>>>>>>>> Arina
> >>>>>>>>>
> >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <
> arina@apache.org
> >>>
> >>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Hi Drillers,
> >>>>>>>>>>
> >>>>>>>>>> It's been several months since the last release and it is time
> to
> >>>>> do
> >>>>>> the
> >>>>>>>>>> next one. I am volunteering to be the release manager.
> >>>>>>>>>>
> >>>>>>>>>> If there are any issues on which work is in progress, that you
> >>>>> feel we
> >>>>>>>>>> *must* include in the release, please post in reply to this
> >> thread.
> >>>>>> Based
> >>>>>>>>>> on your input we'll define release cut off date.
> >>>>>>>>>>
> >>>>>>>>>> Kind regards
> >>>>>>>>>> Arina
> >>>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>>
> >>
> >>
>
>
Re: [DISCUSS] Drill 1.12.0 release
Posted by Charles Givre <cg...@gmail.com>.
We’re including the Networking functions in this release right?
> On Nov 9, 2017, at 11:04, Arina Yelchiyeva <ar...@gmail.com> wrote:
>
> If changes will be done before cut off date, targeting mid November that it
> will be possible to include this Jira.
>
> On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com> wrote:
>
>> Hi Arina,
>> Can we include DRILL-4091 Support for additional GIS operations in version
>> 1.12? In general the code looked pretty good. There was a unit test
>> missing which the developer submitted and some minor formatting issues
>> which I’m still waiting on.
>> Thanks,
>> —C
>>
>>
>>
>>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <ar...@gmail.com>
>> wrote:
>>>
>>> Current status:
>>>
>>> Blocker:
>>> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., code
>>> reviewer - ?) - in progress.
>>>
>>> Targeted for 1.12 release:
>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
>> reviewer -
>>> Arina) - code review in final stage.
>>> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
>>> reviewer - Paul) - in review.
>>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
>>> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - waiting
>>> for the code review.
>>> DRILL-5771: Fix serDe errors for format plugins (developer - Arina, code
>>> reviewer - Tim) - waiting for the code review.
>>>
>>> Kind regards
>>> Arina
>>>
>>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
>>> arina.yelchiyeva@gmail.com> wrote:
>>>
>>>> Current status:
>>>>
>>>> Targeted for 1.12 release:
>>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather
>> than
>>>> mock (developer - Paul, code reviewer - ?) - waiting for the code review
>>>> DRILL-5842: Refactor and simplify the fragment, operator contexts for
>>>> testing (developer - Paul, code reviewer - ?) - waiting for the code
>>>> review
>>>> DRILL-5834: Adding network functions (developer - Charles, code reviewer
>>>> - Arina) - waiting changes after code review
>>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
>> Arina) - waiting
>>>> for the code review
>>>> DRILL-5772: Enable UTF-8 support in query string by default (developer -
>>>> Arina, code reviewer - Paul) - finalizing approach
>>>> DRILL-4779: Kafka storage plugin support (developer - Anil, code
>> reviewer
>>>> - ?) - finishing implementation
>>>>
>>>> Under question:
>>>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
>>>> reviewer - ?) - waiting for the status update from the developer
>>>>
>>>> Please free to suggest other items that are targeted for 1.12 release.
>>>> There are many Jiras that have fix version marked as 1.12, it would be
>> good
>>>> if developers revisit them and update fix version to the actual one.
>>>> Link to the dashboard - https://issues.apache.org/
>>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=DRILL&view=detail
>>>>
>>>> Kind regards
>>>> Arina
>>>>
>>>>
>>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org>
>> wrote:
>>>>
>>>>> I'm waiting to merge the SSL changes in. Waiting a couple of days
>> more to
>>>>> see if there are any more comments before I merge the changes in.
>>>>>
>>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com> wrote:
>>>>>
>>>>>> Hi Arina,
>>>>>>
>>>>>> In addition to my own PRs, there are several in the “active” queue
>> that
>>>>> we
>>>>>> could get in if we can just push them over the line and clear the
>> queue.
>>>>>> The owners of the PRs should check if we are waiting on them to take
>>>>> action.
>>>>>>
>>>>>> 977 DRILL-5849: Add freemarker lib to dependencyManagement to
>> ensure
>>>>>> prop…
>>>>>> 976 DRILL-5797: Choose parquet reader from read columns
>>>>>> 975 DRILL-5743: Handling column family and column scan for hbase
>>>>>> 973 DRILL-5775: Select * query on a maprdb binary table fails
>>>>>> 972 DRILL-5838: Fix MaprDB filter pushdown for the case of nested
>>>>>> field (reg. of DRILL-4264)
>>>>>> 950 Drill 5431: SSL Support
>>>>>> 949 DRILL-5795: Parquet Filter push down at rowgroup level
>>>>>> 936 DRILL-5772: Add unit tests to indicate how utf-8 support can
>> be
>>>>>> enabled / disabled in Drill
>>>>>> 904 DRILL-5717: change some date time test cases with specific
>>>>>> timezone or Local
>>>>>> 892 DRILL-5645: negation of expression causes null pointer
>> exception
>>>>>> 889 DRILL-5691: enhance scalar sub queries checking for the
>>>>> cartesian
>>>>>> join
>>>>>>
>>>>>> (Items not on the list above have become “inactive” for a variety of
>>>>>> reasons.)
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> - Paul
>>>>>>
>>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
>>>>>>>
>>>>>>> Hi Arina,
>>>>>>>
>>>>>>> I’d like to include the following that are needed to finish up the
>>>>>> “managed” sort and spill-to-disk for hash agg:
>>>>>>>
>>>>>>> #928: DRILL-5716: Queue-driven memory allocation
>>>>>>> #958, DRILL-5808: Reduce memory allocator strictness for "managed"
>>>>>> operators
>>>>>>> #960, DRILL-5815: Option to set query memory as percent of total
>>>>>>>
>>>>>>> The following is needed to resolve issues with HBase support in empty
>>>>>> batches:
>>>>>>>
>>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
>>>>>>>
>>>>>>> The following are nice-to-haves that build on work already done in
>>>>> this
>>>>>> release, and that some of my own work depends on:
>>>>>>>
>>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
>>>>>> rather than mock
>>>>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
>>>>> contexts
>>>>>> for testing
>>>>>>>
>>>>>>> The following is not needed for 1.12 per-se, but is the foundation
>>>>> for a
>>>>>> project I’m working on; would be good to get this in after 2-3 months
>> of
>>>>>> review time:
>>>>>>>
>>>>>>> #921, foundation for batch size limitation
>>>>>>>
>>>>>>> The key issue with each of the above is that they each need a
>>>>> committer
>>>>>> to review. Some have reviews from non-committers. Any volunteers?
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
>>>>>>> - Paul
>>>>>>>
>>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com> wrote:
>>>>>>>>
>>>>>>>> Hi Arina,
>>>>>>>> I’d like to include Drill-5834, Adding network functions.
>>>>>>>> https://github.com/apache/drill/pull/971 <
>> https://github.com/apache/
>>>>>> drill/pull/971>
>>>>>>>>
>>>>>>>> Hopefully I didn’t violate too many coding standards this time ;-)
>>>>>>>> —C
>>>>>>>>
>>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
>>>>>> arina.yelchiyeva@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to finish
>>>>> code
>>>>>>>>> review during this week.
>>>>>>>>>
>>>>>>>>> Kind regards
>>>>>>>>> Arina
>>>>>>>>>
>>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <arina@apache.org
>>>
>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Drillers,
>>>>>>>>>>
>>>>>>>>>> It's been several months since the last release and it is time to
>>>>> do
>>>>>> the
>>>>>>>>>> next one. I am volunteering to be the release manager.
>>>>>>>>>>
>>>>>>>>>> If there are any issues on which work is in progress, that you
>>>>> feel we
>>>>>>>>>> *must* include in the release, please post in reply to this
>> thread.
>>>>>> Based
>>>>>>>>>> on your input we'll define release cut off date.
>>>>>>>>>>
>>>>>>>>>> Kind regards
>>>>>>>>>> Arina
>>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>
>>
Re: [DISCUSS] Drill 1.12.0 release
Posted by Arina Yelchiyeva <ar...@gmail.com>.
If changes will be done before cut off date, targeting mid November that it
will be possible to include this Jira.
On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cg...@gmail.com> wrote:
> Hi Arina,
> Can we include DRILL-4091 Support for additional GIS operations in version
> 1.12? In general the code looked pretty good. There was a unit test
> missing which the developer submitted and some minor formatting issues
> which I’m still waiting on.
> Thanks,
> —C
>
>
>
> > On Nov 9, 2017, at 10:58, Arina Yelchiyeva <ar...@gmail.com>
> wrote:
> >
> > Current status:
> >
> > Blocker:
> > DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., code
> > reviewer - ?) - in progress.
> >
> > Targeted for 1.12 release:
> > DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code
> reviewer -
> > Arina) - code review in final stage.
> > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> > reviewer - Paul) - in review.
> > DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> > mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - waiting
> > for the code review.
> > DRILL-5771: Fix serDe errors for format plugins (developer - Arina, code
> > reviewer - Tim) - waiting for the code review.
> >
> > Kind regards
> > Arina
> >
> > On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
> > arina.yelchiyeva@gmail.com> wrote:
> >
> >> Current status:
> >>
> >> Targeted for 1.12 release:
> >> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather
> than
> >> mock (developer - Paul, code reviewer - ?) - waiting for the code review
> >> DRILL-5842: Refactor and simplify the fragment, operator contexts for
> >> testing (developer - Paul, code reviewer - ?) - waiting for the code
> >> review
> >> DRILL-5834: Adding network functions (developer - Charles, code reviewer
> >> - Arina) - waiting changes after code review
> >> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer -
> Arina) - waiting
> >> for the code review
> >> DRILL-5772: Enable UTF-8 support in query string by default (developer -
> >> Arina, code reviewer - Paul) - finalizing approach
> >> DRILL-4779: Kafka storage plugin support (developer - Anil, code
> reviewer
> >> - ?) - finishing implementation
> >>
> >> Under question:
> >> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> >> reviewer - ?) - waiting for the status update from the developer
> >>
> >> Please free to suggest other items that are targeted for 1.12 release.
> >> There are many Jiras that have fix version marked as 1.12, it would be
> good
> >> if developers revisit them and update fix version to the actual one.
> >> Link to the dashboard - https://issues.apache.org/
> >> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=DRILL&view=detail
> >>
> >> Kind regards
> >> Arina
> >>
> >>
> >> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org>
> wrote:
> >>
> >>> I'm waiting to merge the SSL changes in. Waiting a couple of days
> more to
> >>> see if there are any more comments before I merge the changes in.
> >>>
> >>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com> wrote:
> >>>
> >>>> Hi Arina,
> >>>>
> >>>> In addition to my own PRs, there are several in the “active” queue
> that
> >>> we
> >>>> could get in if we can just push them over the line and clear the
> queue.
> >>>> The owners of the PRs should check if we are waiting on them to take
> >>> action.
> >>>>
> >>>> 977 DRILL-5849: Add freemarker lib to dependencyManagement to
> ensure
> >>>> prop…
> >>>> 976 DRILL-5797: Choose parquet reader from read columns
> >>>> 975 DRILL-5743: Handling column family and column scan for hbase
> >>>> 973 DRILL-5775: Select * query on a maprdb binary table fails
> >>>> 972 DRILL-5838: Fix MaprDB filter pushdown for the case of nested
> >>>> field (reg. of DRILL-4264)
> >>>> 950 Drill 5431: SSL Support
> >>>> 949 DRILL-5795: Parquet Filter push down at rowgroup level
> >>>> 936 DRILL-5772: Add unit tests to indicate how utf-8 support can
> be
> >>>> enabled / disabled in Drill
> >>>> 904 DRILL-5717: change some date time test cases with specific
> >>>> timezone or Local
> >>>> 892 DRILL-5645: negation of expression causes null pointer
> exception
> >>>> 889 DRILL-5691: enhance scalar sub queries checking for the
> >>> cartesian
> >>>> join
> >>>>
> >>>> (Items not on the list above have become “inactive” for a variety of
> >>>> reasons.)
> >>>>
> >>>> Thanks,
> >>>>
> >>>> - Paul
> >>>>
> >>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
> >>>>>
> >>>>> Hi Arina,
> >>>>>
> >>>>> I’d like to include the following that are needed to finish up the
> >>>> “managed” sort and spill-to-disk for hash agg:
> >>>>>
> >>>>> #928: DRILL-5716: Queue-driven memory allocation
> >>>>> #958, DRILL-5808: Reduce memory allocator strictness for "managed"
> >>>> operators
> >>>>> #960, DRILL-5815: Option to set query memory as percent of total
> >>>>>
> >>>>> The following is needed to resolve issues with HBase support in empty
> >>>> batches:
> >>>>>
> >>>>> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
> >>>>>
> >>>>> The following are nice-to-haves that build on work already done in
> >>> this
> >>>> release, and that some of my own work depends on:
> >>>>>
> >>>>> #970, DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
> >>>> rather than mock
> >>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
> >>> contexts
> >>>> for testing
> >>>>>
> >>>>> The following is not needed for 1.12 per-se, but is the foundation
> >>> for a
> >>>> project I’m working on; would be good to get this in after 2-3 months
> of
> >>>> review time:
> >>>>>
> >>>>> #921, foundation for batch size limitation
> >>>>>
> >>>>> The key issue with each of the above is that they each need a
> >>> committer
> >>>> to review. Some have reviews from non-committers. Any volunteers?
> >>>>>
> >>>>> Thanks,
> >>>>>
> >>>>> - Paul
> >>>>>
> >>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com> wrote:
> >>>>>>
> >>>>>> Hi Arina,
> >>>>>> I’d like to include Drill-5834, Adding network functions.
> >>>>>> https://github.com/apache/drill/pull/971 <
> https://github.com/apache/
> >>>> drill/pull/971>
> >>>>>>
> >>>>>> Hopefully I didn’t violate too many coding standards this time ;-)
> >>>>>> —C
> >>>>>>
> >>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
> >>>> arina.yelchiyeva@gmail.com> wrote:
> >>>>>>>
> >>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to finish
> >>> code
> >>>>>>> review during this week.
> >>>>>>>
> >>>>>>> Kind regards
> >>>>>>> Arina
> >>>>>>>
> >>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <arina@apache.org
> >
> >>>> wrote:
> >>>>>>>
> >>>>>>>> Hi Drillers,
> >>>>>>>>
> >>>>>>>> It's been several months since the last release and it is time to
> >>> do
> >>>> the
> >>>>>>>> next one. I am volunteering to be the release manager.
> >>>>>>>>
> >>>>>>>> If there are any issues on which work is in progress, that you
> >>> feel we
> >>>>>>>> *must* include in the release, please post in reply to this
> thread.
> >>>> Based
> >>>>>>>> on your input we'll define release cut off date.
> >>>>>>>>
> >>>>>>>> Kind regards
> >>>>>>>> Arina
> >>>>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>>
> >>>
> >>
> >>
>
>
Re: [DISCUSS] Drill 1.12.0 release
Posted by Charles Givre <cg...@gmail.com>.
Hi Arina,
Can we include DRILL-4091 Support for additional GIS operations in version 1.12? In general the code looked pretty good. There was a unit test missing which the developer submitted and some minor formatting issues which I’m still waiting on.
Thanks,
—C
> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <ar...@gmail.com> wrote:
>
> Current status:
>
> Blocker:
> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., code
> reviewer - ?) - in progress.
>
> Targeted for 1.12 release:
> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S., code reviewer -
> Arina) - code review in final stage.
> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> reviewer - Paul) - in review.
> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - waiting
> for the code review.
> DRILL-5771: Fix serDe errors for format plugins (developer - Arina, code
> reviewer - Tim) - waiting for the code review.
>
> Kind regards
> Arina
>
> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com> wrote:
>
>> Current status:
>>
>> Targeted for 1.12 release:
>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager rather than
>> mock (developer - Paul, code reviewer - ?) - waiting for the code review
>> DRILL-5842: Refactor and simplify the fragment, operator contexts for
>> testing (developer - Paul, code reviewer - ?) - waiting for the code
>> review
>> DRILL-5834: Adding network functions (developer - Charles, code reviewer
>> - Arina) - waiting changes after code review
>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer - Arina) - waiting
>> for the code review
>> DRILL-5772: Enable UTF-8 support in query string by default (developer -
>> Arina, code reviewer - Paul) - finalizing approach
>> DRILL-4779: Kafka storage plugin support (developer - Anil, code reviewer
>> - ?) - finishing implementation
>>
>> Under question:
>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
>> reviewer - ?) - waiting for the status update from the developer
>>
>> Please free to suggest other items that are targeted for 1.12 release.
>> There are many Jiras that have fix version marked as 1.12, it would be good
>> if developers revisit them and update fix version to the actual one.
>> Link to the dashboard - https://issues.apache.org/
>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=DRILL&view=detail
>>
>> Kind regards
>> Arina
>>
>>
>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <pa...@apache.org> wrote:
>>
>>> I'm waiting to merge the SSL changes in. Waiting a couple of days more to
>>> see if there are any more comments before I merge the changes in.
>>>
>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <pr...@mapr.com> wrote:
>>>
>>>> Hi Arina,
>>>>
>>>> In addition to my own PRs, there are several in the “active” queue that
>>> we
>>>> could get in if we can just push them over the line and clear the queue.
>>>> The owners of the PRs should check if we are waiting on them to take
>>> action.
>>>>
>>>> 977 DRILL-5849: Add freemarker lib to dependencyManagement to ensure
>>>> prop…
>>>> 976 DRILL-5797: Choose parquet reader from read columns
>>>> 975 DRILL-5743: Handling column family and column scan for hbase
>>>> 973 DRILL-5775: Select * query on a maprdb binary table fails
>>>> 972 DRILL-5838: Fix MaprDB filter pushdown for the case of nested
>>>> field (reg. of DRILL-4264)
>>>> 950 Drill 5431: SSL Support
>>>> 949 DRILL-5795: Parquet Filter push down at rowgroup level
>>>> 936 DRILL-5772: Add unit tests to indicate how utf-8 support can be
>>>> enabled / disabled in Drill
>>>> 904 DRILL-5717: change some date time test cases with specific
>>>> timezone or Local
>>>> 892 DRILL-5645: negation of expression causes null pointer exception
>>>> 889 DRILL-5691: enhance scalar sub queries checking for the
>>> cartesian
>>>> join
>>>>
>>>> (Items not on the list above have become “inactive” for a variety of
>>>> reasons.)
>>>>
>>>> Thanks,
>>>>
>>>> - Paul
>>>>
>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <pr...@mapr.com> wrote:
>>>>>
>>>>> Hi Arina,
>>>>>
>>>>> I’d like to include the following that are needed to finish up the
>>>> “managed” sort and spill-to-disk for hash agg:
>>>>>
>>>>> #928: DRILL-5716: Queue-driven memory allocation
>>>>> #958, DRILL-5808: Reduce memory allocator strictness for "managed"
>>>> operators
>>>>> #960, DRILL-5815: Option to set query memory as percent of total
>>>>>
>>>>> The following is needed to resolve issues with HBase support in empty
>>>> batches:
>>>>>
>>>>> #968, DRILL-5830: Resolve regressions to MapR DB from DRILL-5546
>>>>>
>>>>> The following are nice-to-haves that build on work already done in
>>> this
>>>> release, and that some of my own work depends on:
>>>>>
>>>>> #970, DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
>>>> rather than mock
>>>>> #978: DRILL-5842: Refactor and simplify the fragment, operator
>>> contexts
>>>> for testing
>>>>>
>>>>> The following is not needed for 1.12 per-se, but is the foundation
>>> for a
>>>> project I’m working on; would be good to get this in after 2-3 months of
>>>> review time:
>>>>>
>>>>> #921, foundation for batch size limitation
>>>>>
>>>>> The key issue with each of the above is that they each need a
>>> committer
>>>> to review. Some have reviews from non-committers. Any volunteers?
>>>>>
>>>>> Thanks,
>>>>>
>>>>> - Paul
>>>>>
>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cg...@gmail.com> wrote:
>>>>>>
>>>>>> Hi Arina,
>>>>>> I’d like to include Drill-5834, Adding network functions.
>>>>>> https://github.com/apache/drill/pull/971 <https://github.com/apache/
>>>> drill/pull/971>
>>>>>>
>>>>>> Hopefully I didn’t violate too many coding standards this time ;-)
>>>>>> —C
>>>>>>
>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva <
>>>> arina.yelchiyeva@gmail.com> wrote:
>>>>>>>
>>>>>>> I want to include DRILL-5337 (OpenTSDB plugin), I'll try to finish
>>> code
>>>>>>> review during this week.
>>>>>>>
>>>>>>> Kind regards
>>>>>>> Arina
>>>>>>>
>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva <ar...@apache.org>
>>>> wrote:
>>>>>>>
>>>>>>>> Hi Drillers,
>>>>>>>>
>>>>>>>> It's been several months since the last release and it is time to
>>> do
>>>> the
>>>>>>>> next one. I am volunteering to be the release manager.
>>>>>>>>
>>>>>>>> If there are any issues on which work is in progress, that you
>>> feel we
>>>>>>>> *must* include in the release, please post in reply to this thread.
>>>> Based
>>>>>>>> on your input we'll define release cut off date.
>>>>>>>>
>>>>>>>> Kind regards
>>>>>>>> Arina
>>>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>
>>
>>