You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lens.apache.org by Puneet Gupta <pu...@gmail.com> on 2016/07/02 04:05:03 UTC
[DISCUSS] Release Plan for 2.6
We have some significant improvements and features added after 2.5
release, mainly :
- Hive 2 support and move Hive dependency to Apache Hive
- Lens Regression module added
- Work on Lens Scheduler is 70% complete.
- Limit number of open sessions per user on session service
- Enable streaming results for queries
- cube-segmentation specification added
- Python client support
- Exponential back off for hive queries
- Client result set iterable api added
- Lens UI enhancements
- Query Priority persisted in Lens DB
- Option to kill queries that exceed timeout added
- Convert dimension filter to fact filters for performance improvement
- Return same handle for repeated query from same user
- Post select option added to DriverQueryHook
- Skip partition registration for very old and future dates for a fact tables
- Weighted Driver selector added.
- Cube keyword made optional in queries
- Session close will not result in queued query failures
and bug fixes.
I'm volunteering to manage the release. Calling out for a release
preparation for 2.6 here.
*Unassigned open items on 2.6 are ( A total of 13 issues)*
https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%20%3D%20Unresolved%20AND%20assignee%20is%20EMPTY
Contributors are welcome to provide fix for those issues.
*All the open issues (A total of 30 issues including above mentioned
13 unassigned issues)*
https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%202.6
*Issues yet to verify (A total of 107 issues)*
https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%3D%20Resolved
If any of you feel your changes should go into 2.6 and the jira is not
marked with fix version, please do so.
Putting down the plan for 2.6 release:
- Will merge master into release branch after two weeks from now.
We can resolve the open issues until then.
(18/July/2016)
- We will spend one-two weeks to fix blockers on the release branch
if any and verify release candidate and roll release candidates until
a release vote passes(29/July/2016)
- Will roll release candidate on 3/Aug/2016
Let me know your concerns/comments.
Re: [DISCUSS] Release Plan for 2.6
Posted by Puneet Gupta <pu...@inmobi.com>.
*Final List *
LENS-518 Lens 2.6 is compatible with hive 2.1.0 and above
LENS-919 For older deployments the schema for "finished_queries" table
needs to be modified to include "priority"
LENS-1212 Saved query service is enabled by default now
LENS-833 Number of open sessions allowed for each user is capped at 10 by
default now
LENS-1244 Dropping beta from lens releases. Lens 2.6 will be a GA release
LENS-909 Query finish email notification message body will not have query
results inline in case of inmemory resultset
LENS-1198 Lens 2.6 is compatible with hive 2.1.0 and above
LENS-1217 Old lens GUI is removed
LENS-1215 Cluster user was defaulted to operating system user by
lens-client module earlier. This logic have been moved to cli. Direct users
of lens-client will see a change in behavior due to this modification
LENS-1187 For metastore REST end point most of the apis returning APIResult
were giving http status 200 even in case of failure. The payload object had
a FAILED APIResult, but the status code was 200. After this, the status
code comes as 500.
LENS-1029 Lens server configuration lens.server.snapshot.interval is
changed to lens.server.state.persistence.interval.millis,
lens.server.restart.enabled is changed to lens.server.state.persistence.enabled
and lens.server.recover.onrestart is removed
LENS-1013 postDriverSelection method has been added DriverQueryHook SPI.
Implementation providers need to adapt to new interface
Thanks,
Puneet Gupta
On Mon, Sep 5, 2016 at 7:25 PM, amareshwarisr . <am...@gmail.com>
wrote:
> We should not be calling
> LENS-959 (is only testcase changes) , LENS-950 (is more a bug fix),
> LENS-1191
> ( a new feature), LENS-771 ( is a bug fix) and LENS-1159 (is a bug fix).
>
> More to be labeled as incompatible changes :
> LENS-1217 <https://issues.apache.org/jira/browse/LENS-1217>
>
> Remove old java ui server <https://issues.apache.org/jira/browse/LENS-1217
> >
>
> LENS-1212 <https://issues.apache.org/jira/browse/LENS-1212>
>
> Enable saved queries by default
> <https://issues.apache.org/jira/browse/LENS-1212>
>
> On Wed, Aug 24, 2016 at 6:47 PM, Puneet Gupta <pu...@inmobi.com>
> wrote:
>
> > Hi,
> >
> > Following list of issues seem like potential incompatibilities (wrt to
> lens
> > server upgrade, lens db upgrade ). Will share a more pruned list (after
> > more analysis).
> > Please feel free to add more issues to this list of *incompatible
> > issues*. (Complete
> > list is available here
> > <https://issues.apache.org/jira/issues/?jql=project%20%
> > 3D%20LENS%20AND%20fixVersion%20%3D%202.6%20ORDER%20BY%20status%20DESC>
> > )
> >
> > Sub-task LENS-988 <https://issues.apache.org/jira/browse/LENS-988>
> > LENS-124
> > [Server] StateStore for LensScheduler Lavkesh Lahngir Ajay Yadava Major
> > Closed Fixed 3/13/16 18:44 8/18/16 9:15 2.6 server
> > Wish LENS-518 <https://issues.apache.org/jira/browse/LENS-518> Move
> Hive
> > dependency to Apache Hive Rajat Khandelwal Amareshwari Sriramadasu Major
> > Closed Fixed 4/22/15 8:37 8/18/16 9:21 2.6 build
> > Improvement LENS-919 <https://issues.apache.org/jira/browse/LENS-919>
> > Persist
> > Query Priority in Lens DB Puneet Gupta Puneet Gupta Minor Closed Fixed
> > 1/12/16
> > 9:49 8/18/16 11:42 2.6 server
> > New Feature LENS-833 <https://issues.apache.org/jira/browse/LENS-833>
> > Limit
> > number of open sessions per user on session service Raju Bairishetti
> > Amareshwari
> > Sriramadasu Major Closed Fixed 10/19/15 10:12 8/18/16 12:39 2.6 server
> > Task LENS-959 <https://issues.apache.org/jira/browse/LENS-959> remove
> > cube keyword from all test cases of lens-cube Rajat Khandelwal Rajat
> > Khandelwal Major Closed Fixed 2/16/16 11:03 8/18/16 14:38 2.6 cube
> > Task LENS-1244 <https://issues.apache.org/jira/browse/LENS-1244> Mark
> > 2.6.x release as GA and remove beta Puneet Gupta Puneet Gupta Blocker
> > Closed
> > Fixed 7/31/16 3:02 8/19/16 8:12 2.6 build
> > Sub-task LENS-1186 <https://issues.apache.org/jira/browse/LENS-1186>
> > LENS-1179
> > Refactor exception handling in QueryServiceResource Rajat Khandelwal
> Rajat
> > Khandelwal Major Resolved Fixed 6/15/16 8:13 6/22/16 9:13 2.6
> > Improvement LENS-950 <https://issues.apache.org/jira/browse/LENS-950>
> > Bridge
> > table join should ignore join type config Amareshwari Sriramadasu
> > Amareshwari
> > Sriramadasu Major Resolved Fixed 2/9/16 10:47 2/15/16 15:16 2.6
> > Improvement LENS-909 <https://issues.apache.org/jira/browse/LENS-909>
> We
> > should avoid sending email notification with inmemory results Puneet
> > Gupta Amareshwari
> > Sriramadasu Major Resolved Fixed 12/22/15 23:03 2/7/16 10:47 2.6 server
> > Task LENS-1198 <https://issues.apache.org/jira/browse/LENS-1198>
> Update
> > hive dependency to apache hive 2.1.0 Rajat Khandelwal Amareshwari
> > Sriramadasu Critical Resolved Fixed 6/22/16 4:02 7/24/16 4:27 2.6 build
> > Bug LENS-1215 <https://issues.apache.org/jira/browse/LENS-1215> Move
> > cluster user determination to cli from client Rajat Khandelwal Rajat
> > Khandelwal Major Resolved Fixed 7/14/16 12:12 7/19/16 12:55 2.6
> > New Feature LENS-1191 <https://issues.apache.org/jira/browse/LENS-1191
> >
> > Lens
> > Python client should support half sync half async model of execution
> Rajat
> > Khandelwal Puneet Gupta Major Resolved Fixed 6/17/16 3:27 7/27/16 9:39
> > 2.6
> >
> > Sub-task LENS-1187 <https://issues.apache.org/jira/browse/LENS-1187>
> > LENS-1179
> > Refactor exception handling in MetastoreResource Rajat Khandelwal Rajat
> > Khandelwal Major Resolved Fixed 6/15/16 8:13 7/1/16 11:08 2.6
> > Bug LENS-1159 <https://issues.apache.org/jira/browse/LENS-1159> Lens
> > session is adding HIVE_HOME/lib/* to class path Rajat Khandelwal Rajat
> > Khandelwal Major Resolved Fixed 5/27/16 11:14 5/31/16 15:51 2.6
> > Bug LENS-1029 <https://issues.apache.org/jira/browse/LENS-1029>
> > lens-server-snapshotter
> > died in one of the scenarios Puneet Gupta Amareshwari Sriramadasu
> Critical
> > Resolved Fixed 5/3/16 9:03 5/9/16 12:15 2.6 server
> > Improvement LENS-1013
> > <https://issues.apache.org/jira/browse/LENS-1013> DriverQueryHook
> > should support postSelect option also. Puneet Gupta Puneet Gupta Major
> > Resolved Fixed 4/21/16 11:58 4/28/16 5:08 2.6 server
> > Bug LENS-771 <https://issues.apache.org/jira/browse/LENS-771> Multiple
> > chain ref columns having subset chains are not pruned properly
> Amareshwari
> > Sriramadasu Amareshwari Sriramadasu Major Resolved Fixed 9/10/15 4:59
> > 5/12/16
> > 8:01
> >
> >
> > *********Summary or Lens 2.6 so far ************
> >
> > Status Count
> > Closed 71
> > Open 7
> > Resolved 93
> >
> > Grand Total 171
> > About 37 (out of 171) are Test/Regression related Issues
> > 7 Open Issues are mostly pertaining to documentation/test . May go in or
> > may not as they may not require QA verification
> >
> >
> > Thanks,
> > Puneet Gupta
> >
> > On Mon, Aug 1, 2016 at 2:34 PM, Puneet Gupta <pu...@inmobi.com>
> > wrote:
> >
> > > Branching is done for Lens 2.6.0
> > >
> > >
> > > Thanks,
> > > Puneet Gupta
> > >
> > > On Mon, Jul 25, 2016 at 3:48 PM, Rajat Khandelwal <
> > rajatgupta59@gmail.com>
> > > wrote:
> > >
> > >> Let's also get https://issues.apache.org/jira/browse/LENS-1178 in the
> > >> release.
> > >>
> > >> On Fri, Jul 22, 2016 at 5:58 PM Puneet Gupta <
> puneet.k.gupta@gmail.com>
> > >> wrote:
> > >>
> > >> > Will start the merge once LENS-128, LENS-1168, LENS-996, LENS-1202,
> > >> > LENS-1217 are in .
> > >> >
> > >> > Thanks,
> > >> > Puneet Gupta
> > >> > On Wed, Jul 20, 2016 at 11:00 AM, Puneet Gupta <
> > puneetgupta@apache.org>
> > >> > wrote:
> > >> >
> > >> > > Hi
> > >> > >
> > >> > > Waiting for a few important fixes to go in . Will merge master
> into
> > >> > > release branch post that ( targeting 22 July)
> > >> > >
> > >> > > Thanks,
> > >> > > Puneet Gupta
> > >> > > On Thu, Jul 7, 2016 at 5:56 PM, amareshwarisr . <
> > >> amareshwari@gmail.com>
> > >> > > wrote:
> > >> > >
> > >> > >> +1
> > >> > >>
> > >> > >> Release plan looks great!
> > >> > >>
> > >> > >> On Sat, Jul 2, 2016 at 9:35 AM, Puneet Gupta <
> > >> puneet.k.gupta@gmail.com>
> > >> > >> wrote:
> > >> > >>
> > >> > >> > We have some significant improvements and features added after
> > 2.5
> > >> > >> > release, mainly :
> > >> > >> >
> > >> > >> > - Hive 2 support and move Hive dependency to Apache Hive
> > >> > >> > - Lens Regression module added
> > >> > >> > - Work on Lens Scheduler is 70% complete.
> > >> > >> > - Limit number of open sessions per user on session service
> > >> > >> > - Enable streaming results for queries
> > >> > >> > - cube-segmentation specification added
> > >> > >> > - Python client support
> > >> > >> > - Exponential back off for hive queries
> > >> > >> > - Client result set iterable api added
> > >> > >> > - Lens UI enhancements
> > >> > >> > - Query Priority persisted in Lens DB
> > >> > >> > - Option to kill queries that exceed timeout added
> > >> > >> > - Convert dimension filter to fact filters for performance
> > >> improvement
> > >> > >> > - Return same handle for repeated query from same user
> > >> > >> > - Post select option added to DriverQueryHook
> > >> > >> > - Skip partition registration for very old and future dates
> for a
> > >> fact
> > >> > >> > tables
> > >> > >> > - Weighted Driver selector added.
> > >> > >> > - Cube keyword made optional in queries
> > >> > >> > - Session close will not result in queued query failures
> > >> > >> >
> > >> > >> > and bug fixes.
> > >> > >> >
> > >> > >> > I'm volunteering to manage the release. Calling out for a
> release
> > >> > >> > preparation for 2.6 here.
> > >> > >> > *Unassigned open items on 2.6 are ( A total of 13 issues)*
> > >> > >> >
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20L
> > >> ENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%20%
> > >> 3D%20Unresolved%20AND%20assignee%20is%20EMPTY
> > >> > >> >
> > >> > >> > Contributors are welcome to provide fix for those issues.
> > >> > >> >
> > >> > >> > *All the open issues (A total of 30 issues including above
> > >> mentioned
> > >> > >> > 13 unassigned issues)*
> > >> > >> >
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20L
> > >> ENS%20AND%20resolution%20%3D%20Unresolved%20AND%
> > 20fixVersion%20%3D%202.6
> > >> > >> >
> > >> > >> > *Issues yet to verify (A total of 107 issues)*
> > >> > >> >
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20L
> > >> ENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%3D%20Resolved
> > >> > >> >
> > >> > >> > If any of you feel your changes should go into 2.6 and the jira
> > is
> > >> not
> > >> > >> > marked with fix version, please do so.
> > >> > >> >
> > >> > >> > Putting down the plan for 2.6 release:
> > >> > >> > - Will merge master into release branch after two weeks from
> > >> now.
> > >> > >> > We can resolve the open issues until then.
> > >> > >> > (18/July/2016)
> > >> > >> > - We will spend one-two weeks to fix blockers on the release
> > >> branch
> > >> > >> > if any and verify release candidate and roll release candidates
> > >> until
> > >> > >> > a release vote passes(29/July/2016)
> > >> > >> > - Will roll release candidate on 3/Aug/2016
> > >> > >> >
> > >> > >> > Let me know your concerns/comments.
> > >> > >> >
> > >> > >>
> > >> > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
> > Thanks,
> > Puneet Gupta
> >
> > On Mon, Aug 1, 2016 at 2:34 PM, Puneet Gupta <pu...@inmobi.com>
> > wrote:
> >
> > > Branching is done for Lens 2.6.0
> > >
> > >
> > > Thanks,
> > > Puneet Gupta
> > >
> > > On Mon, Jul 25, 2016 at 3:48 PM, Rajat Khandelwal <
> > rajatgupta59@gmail.com>
> > > wrote:
> > >
> > >> Let's also get https://issues.apache.org/jira/browse/LENS-1178 in the
> > >> release.
> > >>
> > >> On Fri, Jul 22, 2016 at 5:58 PM Puneet Gupta <
> puneet.k.gupta@gmail.com>
> > >> wrote:
> > >>
> > >> > Will start the merge once LENS-128, LENS-1168, LENS-996, LENS-1202,
> > >> > LENS-1217 are in .
> > >> >
> > >> > Thanks,
> > >> > Puneet Gupta
> > >> > On Wed, Jul 20, 2016 at 11:00 AM, Puneet Gupta <
> > puneetgupta@apache.org>
> > >> > wrote:
> > >> >
> > >> > > Hi
> > >> > >
> > >> > > Waiting for a few important fixes to go in . Will merge master
> into
> > >> > > release branch post that ( targeting 22 July)
> > >> > >
> > >> > > Thanks,
> > >> > > Puneet Gupta
> > >> > > On Thu, Jul 7, 2016 at 5:56 PM, amareshwarisr . <
> > >> amareshwari@gmail.com>
> > >> > > wrote:
> > >> > >
> > >> > >> +1
> > >> > >>
> > >> > >> Release plan looks great!
> > >> > >>
> > >> > >> On Sat, Jul 2, 2016 at 9:35 AM, Puneet Gupta <
> > >> puneet.k.gupta@gmail.com>
> > >> > >> wrote:
> > >> > >>
> > >> > >> > We have some significant improvements and features added after
> > 2.5
> > >> > >> > release, mainly :
> > >> > >> >
> > >> > >> > - Hive 2 support and move Hive dependency to Apache Hive
> > >> > >> > - Lens Regression module added
> > >> > >> > - Work on Lens Scheduler is 70% complete.
> > >> > >> > - Limit number of open sessions per user on session service
> > >> > >> > - Enable streaming results for queries
> > >> > >> > - cube-segmentation specification added
> > >> > >> > - Python client support
> > >> > >> > - Exponential back off for hive queries
> > >> > >> > - Client result set iterable api added
> > >> > >> > - Lens UI enhancements
> > >> > >> > - Query Priority persisted in Lens DB
> > >> > >> > - Option to kill queries that exceed timeout added
> > >> > >> > - Convert dimension filter to fact filters for performance
> > >> improvement
> > >> > >> > - Return same handle for repeated query from same user
> > >> > >> > - Post select option added to DriverQueryHook
> > >> > >> > - Skip partition registration for very old and future dates
> for a
> > >> fact
> > >> > >> > tables
> > >> > >> > - Weighted Driver selector added.
> > >> > >> > - Cube keyword made optional in queries
> > >> > >> > - Session close will not result in queued query failures
> > >> > >> >
> > >> > >> > and bug fixes.
> > >> > >> >
> > >> > >> > I'm volunteering to manage the release. Calling out for a
> release
> > >> > >> > preparation for 2.6 here.
> > >> > >> > *Unassigned open items on 2.6 are ( A total of 13 issues)*
> > >> > >> >
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%
> > >> 20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%
> > >> 20%3D%20Unresolved%20AND%20assignee%20is%20EMPTY
> > >> > >> >
> > >> > >> > Contributors are welcome to provide fix for those issues.
> > >> > >> >
> > >> > >> > *All the open issues (A total of 30 issues including above
> > >> mentioned
> > >> > >> > 13 unassigned issues)*
> > >> > >> >
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%
> > >> 20LENS%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVer
> > >> sion%20%3D%202.6
> > >> > >> >
> > >> > >> > *Issues yet to verify (A total of 107 issues)*
> > >> > >> >
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%
> > >> 20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%3D%20Resolved
> > >> > >> >
> > >> > >> > If any of you feel your changes should go into 2.6 and the jira
> > is
> > >> not
> > >> > >> > marked with fix version, please do so.
> > >> > >> >
> > >> > >> > Putting down the plan for 2.6 release:
> > >> > >> > - Will merge master into release branch after two weeks from
> > >> now.
> > >> > >> > We can resolve the open issues until then.
> > >> > >> > (18/July/2016)
> > >> > >> > - We will spend one-two weeks to fix blockers on the release
> > >> branch
> > >> > >> > if any and verify release candidate and roll release candidates
> > >> until
> > >> > >> > a release vote passes(29/July/2016)
> > >> > >> > - Will roll release candidate on 3/Aug/2016
> > >> > >> >
> > >> > >> > Let me know your concerns/comments.
> > >> > >> >
> > >> > >>
> > >> > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
> > Thanks,
> > Puneet Gupta
> >
> > On Mon, Aug 1, 2016 at 2:34 PM, Puneet Gupta <pu...@inmobi.com>
> > wrote:
> >
> > > Branching is done for Lens 2.6.0
> > >
> > >
> > > Thanks,
> > > Puneet Gupta
> > >
> > > On Mon, Jul 25, 2016 at 3:48 PM, Rajat Khandelwal <
> > rajatgupta59@gmail.com>
> > > wrote:
> > >
> > >> Let's also get https://issues.apache.org/jira/browse/LENS-1178 in the
> > >> release.
> > >>
> > >> On Fri, Jul 22, 2016 at 5:58 PM Puneet Gupta <
> puneet.k.gupta@gmail.com>
> > >> wrote:
> > >>
> > >> > Will start the merge once LENS-128, LENS-1168, LENS-996, LENS-1202,
> > >> > LENS-1217 are in .
> > >> >
> > >> > Thanks,
> > >> > Puneet Gupta
> > >> > On Wed, Jul 20, 2016 at 11:00 AM, Puneet Gupta <
> > puneetgupta@apache.org>
> > >> > wrote:
> > >> >
> > >> > > Hi
> > >> > >
> > >> > > Waiting for a few important fixes to go in . Will merge master
> into
> > >> > > release branch post that ( targeting 22 July)
> > >> > >
> > >> > > Thanks,
> > >> > > Puneet Gupta
> > >> > > On Thu, Jul 7, 2016 at 5:56 PM, amareshwarisr . <
> > >> amareshwari@gmail.com>
> > >> > > wrote:
> > >> > >
> > >> > >> +1
> > >> > >>
> > >> > >> Release plan looks great!
> > >> > >>
> > >> > >> On Sat, Jul 2, 2016 at 9:35 AM, Puneet Gupta <
> > >> puneet.k.gupta@gmail.com>
> > >> > >> wrote:
> > >> > >>
> > >> > >> > We have some significant improvements and features added after
> > 2.5
> > >> > >> > release, mainly :
> > >> > >> >
> > >> > >> > - Hive 2 support and move Hive dependency to Apache Hive
> > >> > >> > - Lens Regression module added
> > >> > >> > - Work on Lens Scheduler is 70% complete.
> > >> > >> > - Limit number of open sessions per user on session service
> > >> > >> > - Enable streaming results for queries
> > >> > >> > - cube-segmentation specification added
> > >> > >> > - Python client support
> > >> > >> > - Exponential back off for hive queries
> > >> > >> > - Client result set iterable api added
> > >> > >> > - Lens UI enhancements
> > >> > >> > - Query Priority persisted in Lens DB
> > >> > >> > - Option to kill queries that exceed timeout added
> > >> > >> > - Convert dimension filter to fact filters for performance
> > >> improvement
> > >> > >> > - Return same handle for repeated query from same user
> > >> > >> > - Post select option added to DriverQueryHook
> > >> > >> > - Skip partition registration for very old and future dates
> for a
> > >> fact
> > >> > >> > tables
> > >> > >> > - Weighted Driver selector added.
> > >> > >> > - Cube keyword made optional in queries
> > >> > >> > - Session close will not result in queued query failures
> > >> > >> >
> > >> > >> > and bug fixes.
> > >> > >> >
> > >> > >> > I'm volunteering to manage the release. Calling out for a
> release
> > >> > >> > preparation for 2.6 here.
> > >> > >> > *Unassigned open items on 2.6 are ( A total of 13 issues)*
> > >> > >> >
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > https://issues.apache.org/jira/issues/?jql=project%20%
> > >> 3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%20%3D%
> > >> 20Unresolved%20AND%20assignee%20is%20EMPTY
> > >> > >> >
> > >> > >> > Contributors are welcome to provide fix for those issues.
> > >> > >> >
> > >> > >> > *All the open issues (A total of 30 issues including above
> > >> mentioned
> > >> > >> > 13 unassigned issues)*
> > >> > >> >
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > https://issues.apache.org/jira/issues/?jql=project%20%
> > >> 3D%20LENS%20AND%20resolution%20%3D%20Unresolved%20AND%
> > >> 20fixVersion%20%3D%202.6
> > >> > >> >
> > >> > >> > *Issues yet to verify (A total of 107 issues)*
> > >> > >> >
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > https://issues.apache.org/jira/issues/?jql=project%20%
> > >> 3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%
> > 3D%20Resolved
> > >> > >> >
> > >> > >> > If any of you feel your changes should go into 2.6 and the jira
> > is
> > >> not
> > >> > >> > marked with fix version, please do so.
> > >> > >> >
> > >> > >> > Putting down the plan for 2.6 release:
> > >> > >> > - Will merge master into release branch after two weeks from
> > >> now.
> > >> > >> > We can resolve the open issues until then.
> > >> > >> > (18/July/2016)
> > >> > >> > - We will spend one-two weeks to fix blockers on the release
> > >> branch
> > >> > >> > if any and verify release candidate and roll release candidates
> > >> until
> > >> > >> > a release vote passes(29/July/2016)
> > >> > >> > - Will roll release candidate on 3/Aug/2016
> > >> > >> >
> > >> > >> > Let me know your concerns/comments.
> > >> > >> >
> > >> > >>
> > >> > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
> > --
> > _____________________________________________________________
> > The information contained in this communication is intended solely for
> the
> > use of the individual or entity to whom it is addressed and others
> > authorized to receive it. It may contain confidential or legally
> privileged
> > information. If you are not the intended recipient you are hereby
> notified
> > that any disclosure, copying, distribution or taking any action in
> reliance
> > on the contents of this information is strictly prohibited and may be
> > unlawful. If you have received this communication in error, please notify
> > us immediately by responding to this email and then delete it from your
> > system. The firm is neither liable for the proper and complete
> transmission
> > of the information contained in this communication nor for any delay in
> its
> > receipt.
> >
>
--
_____________________________________________________________
The information contained in this communication is intended solely for the
use of the individual or entity to whom it is addressed and others
authorized to receive it. It may contain confidential or legally privileged
information. If you are not the intended recipient you are hereby notified
that any disclosure, copying, distribution or taking any action in reliance
on the contents of this information is strictly prohibited and may be
unlawful. If you have received this communication in error, please notify
us immediately by responding to this email and then delete it from your
system. The firm is neither liable for the proper and complete transmission
of the information contained in this communication nor for any delay in its
receipt.
Re: [DISCUSS] Release Plan for 2.6
Posted by "amareshwarisr ." <am...@gmail.com>.
We should not be calling
LENS-959 (is only testcase changes) , LENS-950 (is more a bug fix), LENS-1191
( a new feature), LENS-771 ( is a bug fix) and LENS-1159 (is a bug fix).
More to be labeled as incompatible changes :
LENS-1217 <https://issues.apache.org/jira/browse/LENS-1217>
Remove old java ui server <https://issues.apache.org/jira/browse/LENS-1217>
LENS-1212 <https://issues.apache.org/jira/browse/LENS-1212>
Enable saved queries by default
<https://issues.apache.org/jira/browse/LENS-1212>
On Wed, Aug 24, 2016 at 6:47 PM, Puneet Gupta <pu...@inmobi.com>
wrote:
> Hi,
>
> Following list of issues seem like potential incompatibilities (wrt to lens
> server upgrade, lens db upgrade ). Will share a more pruned list (after
> more analysis).
> Please feel free to add more issues to this list of *incompatible
> issues*. (Complete
> list is available here
> <https://issues.apache.org/jira/issues/?jql=project%20%
> 3D%20LENS%20AND%20fixVersion%20%3D%202.6%20ORDER%20BY%20status%20DESC>
> )
>
> Sub-task LENS-988 <https://issues.apache.org/jira/browse/LENS-988>
> LENS-124
> [Server] StateStore for LensScheduler Lavkesh Lahngir Ajay Yadava Major
> Closed Fixed 3/13/16 18:44 8/18/16 9:15 2.6 server
> Wish LENS-518 <https://issues.apache.org/jira/browse/LENS-518> Move Hive
> dependency to Apache Hive Rajat Khandelwal Amareshwari Sriramadasu Major
> Closed Fixed 4/22/15 8:37 8/18/16 9:21 2.6 build
> Improvement LENS-919 <https://issues.apache.org/jira/browse/LENS-919>
> Persist
> Query Priority in Lens DB Puneet Gupta Puneet Gupta Minor Closed Fixed
> 1/12/16
> 9:49 8/18/16 11:42 2.6 server
> New Feature LENS-833 <https://issues.apache.org/jira/browse/LENS-833>
> Limit
> number of open sessions per user on session service Raju Bairishetti
> Amareshwari
> Sriramadasu Major Closed Fixed 10/19/15 10:12 8/18/16 12:39 2.6 server
> Task LENS-959 <https://issues.apache.org/jira/browse/LENS-959> remove
> cube keyword from all test cases of lens-cube Rajat Khandelwal Rajat
> Khandelwal Major Closed Fixed 2/16/16 11:03 8/18/16 14:38 2.6 cube
> Task LENS-1244 <https://issues.apache.org/jira/browse/LENS-1244> Mark
> 2.6.x release as GA and remove beta Puneet Gupta Puneet Gupta Blocker
> Closed
> Fixed 7/31/16 3:02 8/19/16 8:12 2.6 build
> Sub-task LENS-1186 <https://issues.apache.org/jira/browse/LENS-1186>
> LENS-1179
> Refactor exception handling in QueryServiceResource Rajat Khandelwal Rajat
> Khandelwal Major Resolved Fixed 6/15/16 8:13 6/22/16 9:13 2.6
> Improvement LENS-950 <https://issues.apache.org/jira/browse/LENS-950>
> Bridge
> table join should ignore join type config Amareshwari Sriramadasu
> Amareshwari
> Sriramadasu Major Resolved Fixed 2/9/16 10:47 2/15/16 15:16 2.6
> Improvement LENS-909 <https://issues.apache.org/jira/browse/LENS-909> We
> should avoid sending email notification with inmemory results Puneet
> Gupta Amareshwari
> Sriramadasu Major Resolved Fixed 12/22/15 23:03 2/7/16 10:47 2.6 server
> Task LENS-1198 <https://issues.apache.org/jira/browse/LENS-1198> Update
> hive dependency to apache hive 2.1.0 Rajat Khandelwal Amareshwari
> Sriramadasu Critical Resolved Fixed 6/22/16 4:02 7/24/16 4:27 2.6 build
> Bug LENS-1215 <https://issues.apache.org/jira/browse/LENS-1215> Move
> cluster user determination to cli from client Rajat Khandelwal Rajat
> Khandelwal Major Resolved Fixed 7/14/16 12:12 7/19/16 12:55 2.6
> New Feature LENS-1191 <https://issues.apache.org/jira/browse/LENS-1191>
> Lens
> Python client should support half sync half async model of execution Rajat
> Khandelwal Puneet Gupta Major Resolved Fixed 6/17/16 3:27 7/27/16 9:39
> 2.6
>
> Sub-task LENS-1187 <https://issues.apache.org/jira/browse/LENS-1187>
> LENS-1179
> Refactor exception handling in MetastoreResource Rajat Khandelwal Rajat
> Khandelwal Major Resolved Fixed 6/15/16 8:13 7/1/16 11:08 2.6
> Bug LENS-1159 <https://issues.apache.org/jira/browse/LENS-1159> Lens
> session is adding HIVE_HOME/lib/* to class path Rajat Khandelwal Rajat
> Khandelwal Major Resolved Fixed 5/27/16 11:14 5/31/16 15:51 2.6
> Bug LENS-1029 <https://issues.apache.org/jira/browse/LENS-1029>
> lens-server-snapshotter
> died in one of the scenarios Puneet Gupta Amareshwari Sriramadasu Critical
> Resolved Fixed 5/3/16 9:03 5/9/16 12:15 2.6 server
> Improvement LENS-1013
> <https://issues.apache.org/jira/browse/LENS-1013> DriverQueryHook
> should support postSelect option also. Puneet Gupta Puneet Gupta Major
> Resolved Fixed 4/21/16 11:58 4/28/16 5:08 2.6 server
> Bug LENS-771 <https://issues.apache.org/jira/browse/LENS-771> Multiple
> chain ref columns having subset chains are not pruned properly Amareshwari
> Sriramadasu Amareshwari Sriramadasu Major Resolved Fixed 9/10/15 4:59
> 5/12/16
> 8:01
>
>
> *********Summary or Lens 2.6 so far ************
>
> Status Count
> Closed 71
> Open 7
> Resolved 93
>
> Grand Total 171
> About 37 (out of 171) are Test/Regression related Issues
> 7 Open Issues are mostly pertaining to documentation/test . May go in or
> may not as they may not require QA verification
>
>
> Thanks,
> Puneet Gupta
>
> On Mon, Aug 1, 2016 at 2:34 PM, Puneet Gupta <pu...@inmobi.com>
> wrote:
>
> > Branching is done for Lens 2.6.0
> >
> >
> > Thanks,
> > Puneet Gupta
> >
> > On Mon, Jul 25, 2016 at 3:48 PM, Rajat Khandelwal <
> rajatgupta59@gmail.com>
> > wrote:
> >
> >> Let's also get https://issues.apache.org/jira/browse/LENS-1178 in the
> >> release.
> >>
> >> On Fri, Jul 22, 2016 at 5:58 PM Puneet Gupta <pu...@gmail.com>
> >> wrote:
> >>
> >> > Will start the merge once LENS-128, LENS-1168, LENS-996, LENS-1202,
> >> > LENS-1217 are in .
> >> >
> >> > Thanks,
> >> > Puneet Gupta
> >> > On Wed, Jul 20, 2016 at 11:00 AM, Puneet Gupta <
> puneetgupta@apache.org>
> >> > wrote:
> >> >
> >> > > Hi
> >> > >
> >> > > Waiting for a few important fixes to go in . Will merge master into
> >> > > release branch post that ( targeting 22 July)
> >> > >
> >> > > Thanks,
> >> > > Puneet Gupta
> >> > > On Thu, Jul 7, 2016 at 5:56 PM, amareshwarisr . <
> >> amareshwari@gmail.com>
> >> > > wrote:
> >> > >
> >> > >> +1
> >> > >>
> >> > >> Release plan looks great!
> >> > >>
> >> > >> On Sat, Jul 2, 2016 at 9:35 AM, Puneet Gupta <
> >> puneet.k.gupta@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> > We have some significant improvements and features added after
> 2.5
> >> > >> > release, mainly :
> >> > >> >
> >> > >> > - Hive 2 support and move Hive dependency to Apache Hive
> >> > >> > - Lens Regression module added
> >> > >> > - Work on Lens Scheduler is 70% complete.
> >> > >> > - Limit number of open sessions per user on session service
> >> > >> > - Enable streaming results for queries
> >> > >> > - cube-segmentation specification added
> >> > >> > - Python client support
> >> > >> > - Exponential back off for hive queries
> >> > >> > - Client result set iterable api added
> >> > >> > - Lens UI enhancements
> >> > >> > - Query Priority persisted in Lens DB
> >> > >> > - Option to kill queries that exceed timeout added
> >> > >> > - Convert dimension filter to fact filters for performance
> >> improvement
> >> > >> > - Return same handle for repeated query from same user
> >> > >> > - Post select option added to DriverQueryHook
> >> > >> > - Skip partition registration for very old and future dates for a
> >> fact
> >> > >> > tables
> >> > >> > - Weighted Driver selector added.
> >> > >> > - Cube keyword made optional in queries
> >> > >> > - Session close will not result in queued query failures
> >> > >> >
> >> > >> > and bug fixes.
> >> > >> >
> >> > >> > I'm volunteering to manage the release. Calling out for a release
> >> > >> > preparation for 2.6 here.
> >> > >> > *Unassigned open items on 2.6 are ( A total of 13 issues)*
> >> > >> >
> >> > >> >
> >> > >> >
> >> > >>
> >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20L
> >> ENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%20%
> >> 3D%20Unresolved%20AND%20assignee%20is%20EMPTY
> >> > >> >
> >> > >> > Contributors are welcome to provide fix for those issues.
> >> > >> >
> >> > >> > *All the open issues (A total of 30 issues including above
> >> mentioned
> >> > >> > 13 unassigned issues)*
> >> > >> >
> >> > >> >
> >> > >> >
> >> > >>
> >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20L
> >> ENS%20AND%20resolution%20%3D%20Unresolved%20AND%
> 20fixVersion%20%3D%202.6
> >> > >> >
> >> > >> > *Issues yet to verify (A total of 107 issues)*
> >> > >> >
> >> > >> >
> >> > >> >
> >> > >>
> >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20L
> >> ENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%3D%20Resolved
> >> > >> >
> >> > >> > If any of you feel your changes should go into 2.6 and the jira
> is
> >> not
> >> > >> > marked with fix version, please do so.
> >> > >> >
> >> > >> > Putting down the plan for 2.6 release:
> >> > >> > - Will merge master into release branch after two weeks from
> >> now.
> >> > >> > We can resolve the open issues until then.
> >> > >> > (18/July/2016)
> >> > >> > - We will spend one-two weeks to fix blockers on the release
> >> branch
> >> > >> > if any and verify release candidate and roll release candidates
> >> until
> >> > >> > a release vote passes(29/July/2016)
> >> > >> > - Will roll release candidate on 3/Aug/2016
> >> > >> >
> >> > >> > Let me know your concerns/comments.
> >> > >> >
> >> > >>
> >> > >
> >> > >
> >> >
> >>
> >
> >
>
> Thanks,
> Puneet Gupta
>
> On Mon, Aug 1, 2016 at 2:34 PM, Puneet Gupta <pu...@inmobi.com>
> wrote:
>
> > Branching is done for Lens 2.6.0
> >
> >
> > Thanks,
> > Puneet Gupta
> >
> > On Mon, Jul 25, 2016 at 3:48 PM, Rajat Khandelwal <
> rajatgupta59@gmail.com>
> > wrote:
> >
> >> Let's also get https://issues.apache.org/jira/browse/LENS-1178 in the
> >> release.
> >>
> >> On Fri, Jul 22, 2016 at 5:58 PM Puneet Gupta <pu...@gmail.com>
> >> wrote:
> >>
> >> > Will start the merge once LENS-128, LENS-1168, LENS-996, LENS-1202,
> >> > LENS-1217 are in .
> >> >
> >> > Thanks,
> >> > Puneet Gupta
> >> > On Wed, Jul 20, 2016 at 11:00 AM, Puneet Gupta <
> puneetgupta@apache.org>
> >> > wrote:
> >> >
> >> > > Hi
> >> > >
> >> > > Waiting for a few important fixes to go in . Will merge master into
> >> > > release branch post that ( targeting 22 July)
> >> > >
> >> > > Thanks,
> >> > > Puneet Gupta
> >> > > On Thu, Jul 7, 2016 at 5:56 PM, amareshwarisr . <
> >> amareshwari@gmail.com>
> >> > > wrote:
> >> > >
> >> > >> +1
> >> > >>
> >> > >> Release plan looks great!
> >> > >>
> >> > >> On Sat, Jul 2, 2016 at 9:35 AM, Puneet Gupta <
> >> puneet.k.gupta@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> > We have some significant improvements and features added after
> 2.5
> >> > >> > release, mainly :
> >> > >> >
> >> > >> > - Hive 2 support and move Hive dependency to Apache Hive
> >> > >> > - Lens Regression module added
> >> > >> > - Work on Lens Scheduler is 70% complete.
> >> > >> > - Limit number of open sessions per user on session service
> >> > >> > - Enable streaming results for queries
> >> > >> > - cube-segmentation specification added
> >> > >> > - Python client support
> >> > >> > - Exponential back off for hive queries
> >> > >> > - Client result set iterable api added
> >> > >> > - Lens UI enhancements
> >> > >> > - Query Priority persisted in Lens DB
> >> > >> > - Option to kill queries that exceed timeout added
> >> > >> > - Convert dimension filter to fact filters for performance
> >> improvement
> >> > >> > - Return same handle for repeated query from same user
> >> > >> > - Post select option added to DriverQueryHook
> >> > >> > - Skip partition registration for very old and future dates for a
> >> fact
> >> > >> > tables
> >> > >> > - Weighted Driver selector added.
> >> > >> > - Cube keyword made optional in queries
> >> > >> > - Session close will not result in queued query failures
> >> > >> >
> >> > >> > and bug fixes.
> >> > >> >
> >> > >> > I'm volunteering to manage the release. Calling out for a release
> >> > >> > preparation for 2.6 here.
> >> > >> > *Unassigned open items on 2.6 are ( A total of 13 issues)*
> >> > >> >
> >> > >> >
> >> > >> >
> >> > >>
> >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%
> >> 20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%
> >> 20%3D%20Unresolved%20AND%20assignee%20is%20EMPTY
> >> > >> >
> >> > >> > Contributors are welcome to provide fix for those issues.
> >> > >> >
> >> > >> > *All the open issues (A total of 30 issues including above
> >> mentioned
> >> > >> > 13 unassigned issues)*
> >> > >> >
> >> > >> >
> >> > >> >
> >> > >>
> >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%
> >> 20LENS%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVer
> >> sion%20%3D%202.6
> >> > >> >
> >> > >> > *Issues yet to verify (A total of 107 issues)*
> >> > >> >
> >> > >> >
> >> > >> >
> >> > >>
> >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%
> >> 20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%3D%20Resolved
> >> > >> >
> >> > >> > If any of you feel your changes should go into 2.6 and the jira
> is
> >> not
> >> > >> > marked with fix version, please do so.
> >> > >> >
> >> > >> > Putting down the plan for 2.6 release:
> >> > >> > - Will merge master into release branch after two weeks from
> >> now.
> >> > >> > We can resolve the open issues until then.
> >> > >> > (18/July/2016)
> >> > >> > - We will spend one-two weeks to fix blockers on the release
> >> branch
> >> > >> > if any and verify release candidate and roll release candidates
> >> until
> >> > >> > a release vote passes(29/July/2016)
> >> > >> > - Will roll release candidate on 3/Aug/2016
> >> > >> >
> >> > >> > Let me know your concerns/comments.
> >> > >> >
> >> > >>
> >> > >
> >> > >
> >> >
> >>
> >
> >
>
> Thanks,
> Puneet Gupta
>
> On Mon, Aug 1, 2016 at 2:34 PM, Puneet Gupta <pu...@inmobi.com>
> wrote:
>
> > Branching is done for Lens 2.6.0
> >
> >
> > Thanks,
> > Puneet Gupta
> >
> > On Mon, Jul 25, 2016 at 3:48 PM, Rajat Khandelwal <
> rajatgupta59@gmail.com>
> > wrote:
> >
> >> Let's also get https://issues.apache.org/jira/browse/LENS-1178 in the
> >> release.
> >>
> >> On Fri, Jul 22, 2016 at 5:58 PM Puneet Gupta <pu...@gmail.com>
> >> wrote:
> >>
> >> > Will start the merge once LENS-128, LENS-1168, LENS-996, LENS-1202,
> >> > LENS-1217 are in .
> >> >
> >> > Thanks,
> >> > Puneet Gupta
> >> > On Wed, Jul 20, 2016 at 11:00 AM, Puneet Gupta <
> puneetgupta@apache.org>
> >> > wrote:
> >> >
> >> > > Hi
> >> > >
> >> > > Waiting for a few important fixes to go in . Will merge master into
> >> > > release branch post that ( targeting 22 July)
> >> > >
> >> > > Thanks,
> >> > > Puneet Gupta
> >> > > On Thu, Jul 7, 2016 at 5:56 PM, amareshwarisr . <
> >> amareshwari@gmail.com>
> >> > > wrote:
> >> > >
> >> > >> +1
> >> > >>
> >> > >> Release plan looks great!
> >> > >>
> >> > >> On Sat, Jul 2, 2016 at 9:35 AM, Puneet Gupta <
> >> puneet.k.gupta@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> > We have some significant improvements and features added after
> 2.5
> >> > >> > release, mainly :
> >> > >> >
> >> > >> > - Hive 2 support and move Hive dependency to Apache Hive
> >> > >> > - Lens Regression module added
> >> > >> > - Work on Lens Scheduler is 70% complete.
> >> > >> > - Limit number of open sessions per user on session service
> >> > >> > - Enable streaming results for queries
> >> > >> > - cube-segmentation specification added
> >> > >> > - Python client support
> >> > >> > - Exponential back off for hive queries
> >> > >> > - Client result set iterable api added
> >> > >> > - Lens UI enhancements
> >> > >> > - Query Priority persisted in Lens DB
> >> > >> > - Option to kill queries that exceed timeout added
> >> > >> > - Convert dimension filter to fact filters for performance
> >> improvement
> >> > >> > - Return same handle for repeated query from same user
> >> > >> > - Post select option added to DriverQueryHook
> >> > >> > - Skip partition registration for very old and future dates for a
> >> fact
> >> > >> > tables
> >> > >> > - Weighted Driver selector added.
> >> > >> > - Cube keyword made optional in queries
> >> > >> > - Session close will not result in queued query failures
> >> > >> >
> >> > >> > and bug fixes.
> >> > >> >
> >> > >> > I'm volunteering to manage the release. Calling out for a release
> >> > >> > preparation for 2.6 here.
> >> > >> > *Unassigned open items on 2.6 are ( A total of 13 issues)*
> >> > >> >
> >> > >> >
> >> > >> >
> >> > >>
> >> > https://issues.apache.org/jira/issues/?jql=project%20%
> >> 3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%20%3D%
> >> 20Unresolved%20AND%20assignee%20is%20EMPTY
> >> > >> >
> >> > >> > Contributors are welcome to provide fix for those issues.
> >> > >> >
> >> > >> > *All the open issues (A total of 30 issues including above
> >> mentioned
> >> > >> > 13 unassigned issues)*
> >> > >> >
> >> > >> >
> >> > >> >
> >> > >>
> >> > https://issues.apache.org/jira/issues/?jql=project%20%
> >> 3D%20LENS%20AND%20resolution%20%3D%20Unresolved%20AND%
> >> 20fixVersion%20%3D%202.6
> >> > >> >
> >> > >> > *Issues yet to verify (A total of 107 issues)*
> >> > >> >
> >> > >> >
> >> > >> >
> >> > >>
> >> > https://issues.apache.org/jira/issues/?jql=project%20%
> >> 3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%
> 3D%20Resolved
> >> > >> >
> >> > >> > If any of you feel your changes should go into 2.6 and the jira
> is
> >> not
> >> > >> > marked with fix version, please do so.
> >> > >> >
> >> > >> > Putting down the plan for 2.6 release:
> >> > >> > - Will merge master into release branch after two weeks from
> >> now.
> >> > >> > We can resolve the open issues until then.
> >> > >> > (18/July/2016)
> >> > >> > - We will spend one-two weeks to fix blockers on the release
> >> branch
> >> > >> > if any and verify release candidate and roll release candidates
> >> until
> >> > >> > a release vote passes(29/July/2016)
> >> > >> > - Will roll release candidate on 3/Aug/2016
> >> > >> >
> >> > >> > Let me know your concerns/comments.
> >> > >> >
> >> > >>
> >> > >
> >> > >
> >> >
> >>
> >
> >
>
> --
> _____________________________________________________________
> The information contained in this communication is intended solely for the
> use of the individual or entity to whom it is addressed and others
> authorized to receive it. It may contain confidential or legally privileged
> information. If you are not the intended recipient you are hereby notified
> that any disclosure, copying, distribution or taking any action in reliance
> on the contents of this information is strictly prohibited and may be
> unlawful. If you have received this communication in error, please notify
> us immediately by responding to this email and then delete it from your
> system. The firm is neither liable for the proper and complete transmission
> of the information contained in this communication nor for any delay in its
> receipt.
>
Re: [DISCUSS] Release Plan for 2.6
Posted by Puneet Gupta <pu...@inmobi.com>.
Hi,
Following list of issues seem like potential incompatibilities (wrt to lens
server upgrade, lens db upgrade ). Will share a more pruned list (after
more analysis).
Please feel free to add more issues to this list of *incompatible
issues*. (Complete
list is available here
<https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20fixVersion%20%3D%202.6%20ORDER%20BY%20status%20DESC>
)
Sub-task LENS-988 <https://issues.apache.org/jira/browse/LENS-988> LENS-124
[Server] StateStore for LensScheduler Lavkesh Lahngir Ajay Yadava Major
Closed Fixed 3/13/16 18:44 8/18/16 9:15 2.6 server
Wish LENS-518 <https://issues.apache.org/jira/browse/LENS-518> Move Hive
dependency to Apache Hive Rajat Khandelwal Amareshwari Sriramadasu Major
Closed Fixed 4/22/15 8:37 8/18/16 9:21 2.6 build
Improvement LENS-919 <https://issues.apache.org/jira/browse/LENS-919> Persist
Query Priority in Lens DB Puneet Gupta Puneet Gupta Minor Closed Fixed 1/12/16
9:49 8/18/16 11:42 2.6 server
New Feature LENS-833 <https://issues.apache.org/jira/browse/LENS-833> Limit
number of open sessions per user on session service Raju Bairishetti
Amareshwari
Sriramadasu Major Closed Fixed 10/19/15 10:12 8/18/16 12:39 2.6 server
Task LENS-959 <https://issues.apache.org/jira/browse/LENS-959> remove
cube keyword from all test cases of lens-cube Rajat Khandelwal Rajat
Khandelwal Major Closed Fixed 2/16/16 11:03 8/18/16 14:38 2.6 cube
Task LENS-1244 <https://issues.apache.org/jira/browse/LENS-1244> Mark
2.6.x release as GA and remove beta Puneet Gupta Puneet Gupta Blocker Closed
Fixed 7/31/16 3:02 8/19/16 8:12 2.6 build
Sub-task LENS-1186 <https://issues.apache.org/jira/browse/LENS-1186>
LENS-1179
Refactor exception handling in QueryServiceResource Rajat Khandelwal Rajat
Khandelwal Major Resolved Fixed 6/15/16 8:13 6/22/16 9:13 2.6
Improvement LENS-950 <https://issues.apache.org/jira/browse/LENS-950> Bridge
table join should ignore join type config Amareshwari Sriramadasu Amareshwari
Sriramadasu Major Resolved Fixed 2/9/16 10:47 2/15/16 15:16 2.6
Improvement LENS-909 <https://issues.apache.org/jira/browse/LENS-909> We
should avoid sending email notification with inmemory results Puneet
Gupta Amareshwari
Sriramadasu Major Resolved Fixed 12/22/15 23:03 2/7/16 10:47 2.6 server
Task LENS-1198 <https://issues.apache.org/jira/browse/LENS-1198> Update
hive dependency to apache hive 2.1.0 Rajat Khandelwal Amareshwari
Sriramadasu Critical Resolved Fixed 6/22/16 4:02 7/24/16 4:27 2.6 build
Bug LENS-1215 <https://issues.apache.org/jira/browse/LENS-1215> Move
cluster user determination to cli from client Rajat Khandelwal Rajat
Khandelwal Major Resolved Fixed 7/14/16 12:12 7/19/16 12:55 2.6
New Feature LENS-1191 <https://issues.apache.org/jira/browse/LENS-1191> Lens
Python client should support half sync half async model of execution Rajat
Khandelwal Puneet Gupta Major Resolved Fixed 6/17/16 3:27 7/27/16 9:39 2.6
Sub-task LENS-1187 <https://issues.apache.org/jira/browse/LENS-1187>
LENS-1179
Refactor exception handling in MetastoreResource Rajat Khandelwal Rajat
Khandelwal Major Resolved Fixed 6/15/16 8:13 7/1/16 11:08 2.6
Bug LENS-1159 <https://issues.apache.org/jira/browse/LENS-1159> Lens
session is adding HIVE_HOME/lib/* to class path Rajat Khandelwal Rajat
Khandelwal Major Resolved Fixed 5/27/16 11:14 5/31/16 15:51 2.6
Bug LENS-1029 <https://issues.apache.org/jira/browse/LENS-1029>
lens-server-snapshotter
died in one of the scenarios Puneet Gupta Amareshwari Sriramadasu Critical
Resolved Fixed 5/3/16 9:03 5/9/16 12:15 2.6 server
Improvement LENS-1013
<https://issues.apache.org/jira/browse/LENS-1013> DriverQueryHook
should support postSelect option also. Puneet Gupta Puneet Gupta Major
Resolved Fixed 4/21/16 11:58 4/28/16 5:08 2.6 server
Bug LENS-771 <https://issues.apache.org/jira/browse/LENS-771> Multiple
chain ref columns having subset chains are not pruned properly Amareshwari
Sriramadasu Amareshwari Sriramadasu Major Resolved Fixed 9/10/15 4:59 5/12/16
8:01
*********Summary or Lens 2.6 so far ************
Status Count
Closed 71
Open 7
Resolved 93
Grand Total 171
About 37 (out of 171) are Test/Regression related Issues
7 Open Issues are mostly pertaining to documentation/test . May go in or
may not as they may not require QA verification
Thanks,
Puneet Gupta
On Mon, Aug 1, 2016 at 2:34 PM, Puneet Gupta <pu...@inmobi.com>
wrote:
> Branching is done for Lens 2.6.0
>
>
> Thanks,
> Puneet Gupta
>
> On Mon, Jul 25, 2016 at 3:48 PM, Rajat Khandelwal <ra...@gmail.com>
> wrote:
>
>> Let's also get https://issues.apache.org/jira/browse/LENS-1178 in the
>> release.
>>
>> On Fri, Jul 22, 2016 at 5:58 PM Puneet Gupta <pu...@gmail.com>
>> wrote:
>>
>> > Will start the merge once LENS-128, LENS-1168, LENS-996, LENS-1202,
>> > LENS-1217 are in .
>> >
>> > Thanks,
>> > Puneet Gupta
>> > On Wed, Jul 20, 2016 at 11:00 AM, Puneet Gupta <pu...@apache.org>
>> > wrote:
>> >
>> > > Hi
>> > >
>> > > Waiting for a few important fixes to go in . Will merge master into
>> > > release branch post that ( targeting 22 July)
>> > >
>> > > Thanks,
>> > > Puneet Gupta
>> > > On Thu, Jul 7, 2016 at 5:56 PM, amareshwarisr . <
>> amareshwari@gmail.com>
>> > > wrote:
>> > >
>> > >> +1
>> > >>
>> > >> Release plan looks great!
>> > >>
>> > >> On Sat, Jul 2, 2016 at 9:35 AM, Puneet Gupta <
>> puneet.k.gupta@gmail.com>
>> > >> wrote:
>> > >>
>> > >> > We have some significant improvements and features added after 2.5
>> > >> > release, mainly :
>> > >> >
>> > >> > - Hive 2 support and move Hive dependency to Apache Hive
>> > >> > - Lens Regression module added
>> > >> > - Work on Lens Scheduler is 70% complete.
>> > >> > - Limit number of open sessions per user on session service
>> > >> > - Enable streaming results for queries
>> > >> > - cube-segmentation specification added
>> > >> > - Python client support
>> > >> > - Exponential back off for hive queries
>> > >> > - Client result set iterable api added
>> > >> > - Lens UI enhancements
>> > >> > - Query Priority persisted in Lens DB
>> > >> > - Option to kill queries that exceed timeout added
>> > >> > - Convert dimension filter to fact filters for performance
>> improvement
>> > >> > - Return same handle for repeated query from same user
>> > >> > - Post select option added to DriverQueryHook
>> > >> > - Skip partition registration for very old and future dates for a
>> fact
>> > >> > tables
>> > >> > - Weighted Driver selector added.
>> > >> > - Cube keyword made optional in queries
>> > >> > - Session close will not result in queued query failures
>> > >> >
>> > >> > and bug fixes.
>> > >> >
>> > >> > I'm volunteering to manage the release. Calling out for a release
>> > >> > preparation for 2.6 here.
>> > >> > *Unassigned open items on 2.6 are ( A total of 13 issues)*
>> > >> >
>> > >> >
>> > >> >
>> > >>
>> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20L
>> ENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%20%
>> 3D%20Unresolved%20AND%20assignee%20is%20EMPTY
>> > >> >
>> > >> > Contributors are welcome to provide fix for those issues.
>> > >> >
>> > >> > *All the open issues (A total of 30 issues including above
>> mentioned
>> > >> > 13 unassigned issues)*
>> > >> >
>> > >> >
>> > >> >
>> > >>
>> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20L
>> ENS%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%202.6
>> > >> >
>> > >> > *Issues yet to verify (A total of 107 issues)*
>> > >> >
>> > >> >
>> > >> >
>> > >>
>> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20L
>> ENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%3D%20Resolved
>> > >> >
>> > >> > If any of you feel your changes should go into 2.6 and the jira is
>> not
>> > >> > marked with fix version, please do so.
>> > >> >
>> > >> > Putting down the plan for 2.6 release:
>> > >> > - Will merge master into release branch after two weeks from
>> now.
>> > >> > We can resolve the open issues until then.
>> > >> > (18/July/2016)
>> > >> > - We will spend one-two weeks to fix blockers on the release
>> branch
>> > >> > if any and verify release candidate and roll release candidates
>> until
>> > >> > a release vote passes(29/July/2016)
>> > >> > - Will roll release candidate on 3/Aug/2016
>> > >> >
>> > >> > Let me know your concerns/comments.
>> > >> >
>> > >>
>> > >
>> > >
>> >
>>
>
>
Thanks,
Puneet Gupta
On Mon, Aug 1, 2016 at 2:34 PM, Puneet Gupta <pu...@inmobi.com>
wrote:
> Branching is done for Lens 2.6.0
>
>
> Thanks,
> Puneet Gupta
>
> On Mon, Jul 25, 2016 at 3:48 PM, Rajat Khandelwal <ra...@gmail.com>
> wrote:
>
>> Let's also get https://issues.apache.org/jira/browse/LENS-1178 in the
>> release.
>>
>> On Fri, Jul 22, 2016 at 5:58 PM Puneet Gupta <pu...@gmail.com>
>> wrote:
>>
>> > Will start the merge once LENS-128, LENS-1168, LENS-996, LENS-1202,
>> > LENS-1217 are in .
>> >
>> > Thanks,
>> > Puneet Gupta
>> > On Wed, Jul 20, 2016 at 11:00 AM, Puneet Gupta <pu...@apache.org>
>> > wrote:
>> >
>> > > Hi
>> > >
>> > > Waiting for a few important fixes to go in . Will merge master into
>> > > release branch post that ( targeting 22 July)
>> > >
>> > > Thanks,
>> > > Puneet Gupta
>> > > On Thu, Jul 7, 2016 at 5:56 PM, amareshwarisr . <
>> amareshwari@gmail.com>
>> > > wrote:
>> > >
>> > >> +1
>> > >>
>> > >> Release plan looks great!
>> > >>
>> > >> On Sat, Jul 2, 2016 at 9:35 AM, Puneet Gupta <
>> puneet.k.gupta@gmail.com>
>> > >> wrote:
>> > >>
>> > >> > We have some significant improvements and features added after 2.5
>> > >> > release, mainly :
>> > >> >
>> > >> > - Hive 2 support and move Hive dependency to Apache Hive
>> > >> > - Lens Regression module added
>> > >> > - Work on Lens Scheduler is 70% complete.
>> > >> > - Limit number of open sessions per user on session service
>> > >> > - Enable streaming results for queries
>> > >> > - cube-segmentation specification added
>> > >> > - Python client support
>> > >> > - Exponential back off for hive queries
>> > >> > - Client result set iterable api added
>> > >> > - Lens UI enhancements
>> > >> > - Query Priority persisted in Lens DB
>> > >> > - Option to kill queries that exceed timeout added
>> > >> > - Convert dimension filter to fact filters for performance
>> improvement
>> > >> > - Return same handle for repeated query from same user
>> > >> > - Post select option added to DriverQueryHook
>> > >> > - Skip partition registration for very old and future dates for a
>> fact
>> > >> > tables
>> > >> > - Weighted Driver selector added.
>> > >> > - Cube keyword made optional in queries
>> > >> > - Session close will not result in queued query failures
>> > >> >
>> > >> > and bug fixes.
>> > >> >
>> > >> > I'm volunteering to manage the release. Calling out for a release
>> > >> > preparation for 2.6 here.
>> > >> > *Unassigned open items on 2.6 are ( A total of 13 issues)*
>> > >> >
>> > >> >
>> > >> >
>> > >>
>> > https://issues.apache.org/jira/issues/?jql=project%20%3D%
>> 20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%
>> 20%3D%20Unresolved%20AND%20assignee%20is%20EMPTY
>> > >> >
>> > >> > Contributors are welcome to provide fix for those issues.
>> > >> >
>> > >> > *All the open issues (A total of 30 issues including above
>> mentioned
>> > >> > 13 unassigned issues)*
>> > >> >
>> > >> >
>> > >> >
>> > >>
>> > https://issues.apache.org/jira/issues/?jql=project%20%3D%
>> 20LENS%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVer
>> sion%20%3D%202.6
>> > >> >
>> > >> > *Issues yet to verify (A total of 107 issues)*
>> > >> >
>> > >> >
>> > >> >
>> > >>
>> > https://issues.apache.org/jira/issues/?jql=project%20%3D%
>> 20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%3D%20Resolved
>> > >> >
>> > >> > If any of you feel your changes should go into 2.6 and the jira is
>> not
>> > >> > marked with fix version, please do so.
>> > >> >
>> > >> > Putting down the plan for 2.6 release:
>> > >> > - Will merge master into release branch after two weeks from
>> now.
>> > >> > We can resolve the open issues until then.
>> > >> > (18/July/2016)
>> > >> > - We will spend one-two weeks to fix blockers on the release
>> branch
>> > >> > if any and verify release candidate and roll release candidates
>> until
>> > >> > a release vote passes(29/July/2016)
>> > >> > - Will roll release candidate on 3/Aug/2016
>> > >> >
>> > >> > Let me know your concerns/comments.
>> > >> >
>> > >>
>> > >
>> > >
>> >
>>
>
>
Thanks,
Puneet Gupta
On Mon, Aug 1, 2016 at 2:34 PM, Puneet Gupta <pu...@inmobi.com>
wrote:
> Branching is done for Lens 2.6.0
>
>
> Thanks,
> Puneet Gupta
>
> On Mon, Jul 25, 2016 at 3:48 PM, Rajat Khandelwal <ra...@gmail.com>
> wrote:
>
>> Let's also get https://issues.apache.org/jira/browse/LENS-1178 in the
>> release.
>>
>> On Fri, Jul 22, 2016 at 5:58 PM Puneet Gupta <pu...@gmail.com>
>> wrote:
>>
>> > Will start the merge once LENS-128, LENS-1168, LENS-996, LENS-1202,
>> > LENS-1217 are in .
>> >
>> > Thanks,
>> > Puneet Gupta
>> > On Wed, Jul 20, 2016 at 11:00 AM, Puneet Gupta <pu...@apache.org>
>> > wrote:
>> >
>> > > Hi
>> > >
>> > > Waiting for a few important fixes to go in . Will merge master into
>> > > release branch post that ( targeting 22 July)
>> > >
>> > > Thanks,
>> > > Puneet Gupta
>> > > On Thu, Jul 7, 2016 at 5:56 PM, amareshwarisr . <
>> amareshwari@gmail.com>
>> > > wrote:
>> > >
>> > >> +1
>> > >>
>> > >> Release plan looks great!
>> > >>
>> > >> On Sat, Jul 2, 2016 at 9:35 AM, Puneet Gupta <
>> puneet.k.gupta@gmail.com>
>> > >> wrote:
>> > >>
>> > >> > We have some significant improvements and features added after 2.5
>> > >> > release, mainly :
>> > >> >
>> > >> > - Hive 2 support and move Hive dependency to Apache Hive
>> > >> > - Lens Regression module added
>> > >> > - Work on Lens Scheduler is 70% complete.
>> > >> > - Limit number of open sessions per user on session service
>> > >> > - Enable streaming results for queries
>> > >> > - cube-segmentation specification added
>> > >> > - Python client support
>> > >> > - Exponential back off for hive queries
>> > >> > - Client result set iterable api added
>> > >> > - Lens UI enhancements
>> > >> > - Query Priority persisted in Lens DB
>> > >> > - Option to kill queries that exceed timeout added
>> > >> > - Convert dimension filter to fact filters for performance
>> improvement
>> > >> > - Return same handle for repeated query from same user
>> > >> > - Post select option added to DriverQueryHook
>> > >> > - Skip partition registration for very old and future dates for a
>> fact
>> > >> > tables
>> > >> > - Weighted Driver selector added.
>> > >> > - Cube keyword made optional in queries
>> > >> > - Session close will not result in queued query failures
>> > >> >
>> > >> > and bug fixes.
>> > >> >
>> > >> > I'm volunteering to manage the release. Calling out for a release
>> > >> > preparation for 2.6 here.
>> > >> > *Unassigned open items on 2.6 are ( A total of 13 issues)*
>> > >> >
>> > >> >
>> > >> >
>> > >>
>> > https://issues.apache.org/jira/issues/?jql=project%20%
>> 3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%20%3D%
>> 20Unresolved%20AND%20assignee%20is%20EMPTY
>> > >> >
>> > >> > Contributors are welcome to provide fix for those issues.
>> > >> >
>> > >> > *All the open issues (A total of 30 issues including above
>> mentioned
>> > >> > 13 unassigned issues)*
>> > >> >
>> > >> >
>> > >> >
>> > >>
>> > https://issues.apache.org/jira/issues/?jql=project%20%
>> 3D%20LENS%20AND%20resolution%20%3D%20Unresolved%20AND%
>> 20fixVersion%20%3D%202.6
>> > >> >
>> > >> > *Issues yet to verify (A total of 107 issues)*
>> > >> >
>> > >> >
>> > >> >
>> > >>
>> > https://issues.apache.org/jira/issues/?jql=project%20%
>> 3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%3D%20Resolved
>> > >> >
>> > >> > If any of you feel your changes should go into 2.6 and the jira is
>> not
>> > >> > marked with fix version, please do so.
>> > >> >
>> > >> > Putting down the plan for 2.6 release:
>> > >> > - Will merge master into release branch after two weeks from
>> now.
>> > >> > We can resolve the open issues until then.
>> > >> > (18/July/2016)
>> > >> > - We will spend one-two weeks to fix blockers on the release
>> branch
>> > >> > if any and verify release candidate and roll release candidates
>> until
>> > >> > a release vote passes(29/July/2016)
>> > >> > - Will roll release candidate on 3/Aug/2016
>> > >> >
>> > >> > Let me know your concerns/comments.
>> > >> >
>> > >>
>> > >
>> > >
>> >
>>
>
>
--
_____________________________________________________________
The information contained in this communication is intended solely for the
use of the individual or entity to whom it is addressed and others
authorized to receive it. It may contain confidential or legally privileged
information. If you are not the intended recipient you are hereby notified
that any disclosure, copying, distribution or taking any action in reliance
on the contents of this information is strictly prohibited and may be
unlawful. If you have received this communication in error, please notify
us immediately by responding to this email and then delete it from your
system. The firm is neither liable for the proper and complete transmission
of the information contained in this communication nor for any delay in its
receipt.
Re: [DISCUSS] Release Plan for 2.6
Posted by Puneet Gupta <pu...@inmobi.com>.
Branching is done for Lens 2.6.0
Thanks,
Puneet Gupta
On Mon, Jul 25, 2016 at 3:48 PM, Rajat Khandelwal <ra...@gmail.com>
wrote:
> Let's also get https://issues.apache.org/jira/browse/LENS-1178 in the
> release.
>
> On Fri, Jul 22, 2016 at 5:58 PM Puneet Gupta <pu...@gmail.com>
> wrote:
>
> > Will start the merge once LENS-128, LENS-1168, LENS-996, LENS-1202,
> > LENS-1217 are in .
> >
> > Thanks,
> > Puneet Gupta
> > On Wed, Jul 20, 2016 at 11:00 AM, Puneet Gupta <pu...@apache.org>
> > wrote:
> >
> > > Hi
> > >
> > > Waiting for a few important fixes to go in . Will merge master into
> > > release branch post that ( targeting 22 July)
> > >
> > > Thanks,
> > > Puneet Gupta
> > > On Thu, Jul 7, 2016 at 5:56 PM, amareshwarisr . <amareshwari@gmail.com
> >
> > > wrote:
> > >
> > >> +1
> > >>
> > >> Release plan looks great!
> > >>
> > >> On Sat, Jul 2, 2016 at 9:35 AM, Puneet Gupta <
> puneet.k.gupta@gmail.com>
> > >> wrote:
> > >>
> > >> > We have some significant improvements and features added after 2.5
> > >> > release, mainly :
> > >> >
> > >> > - Hive 2 support and move Hive dependency to Apache Hive
> > >> > - Lens Regression module added
> > >> > - Work on Lens Scheduler is 70% complete.
> > >> > - Limit number of open sessions per user on session service
> > >> > - Enable streaming results for queries
> > >> > - cube-segmentation specification added
> > >> > - Python client support
> > >> > - Exponential back off for hive queries
> > >> > - Client result set iterable api added
> > >> > - Lens UI enhancements
> > >> > - Query Priority persisted in Lens DB
> > >> > - Option to kill queries that exceed timeout added
> > >> > - Convert dimension filter to fact filters for performance
> improvement
> > >> > - Return same handle for repeated query from same user
> > >> > - Post select option added to DriverQueryHook
> > >> > - Skip partition registration for very old and future dates for a
> fact
> > >> > tables
> > >> > - Weighted Driver selector added.
> > >> > - Cube keyword made optional in queries
> > >> > - Session close will not result in queued query failures
> > >> >
> > >> > and bug fixes.
> > >> >
> > >> > I'm volunteering to manage the release. Calling out for a release
> > >> > preparation for 2.6 here.
> > >> > *Unassigned open items on 2.6 are ( A total of 13 issues)*
> > >> >
> > >> >
> > >> >
> > >>
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%20%3D%20Unresolved%20AND%20assignee%20is%20EMPTY
> > >> >
> > >> > Contributors are welcome to provide fix for those issues.
> > >> >
> > >> > *All the open issues (A total of 30 issues including above mentioned
> > >> > 13 unassigned issues)*
> > >> >
> > >> >
> > >> >
> > >>
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%202.6
> > >> >
> > >> > *Issues yet to verify (A total of 107 issues)*
> > >> >
> > >> >
> > >> >
> > >>
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%3D%20Resolved
> > >> >
> > >> > If any of you feel your changes should go into 2.6 and the jira is
> not
> > >> > marked with fix version, please do so.
> > >> >
> > >> > Putting down the plan for 2.6 release:
> > >> > - Will merge master into release branch after two weeks from now.
> > >> > We can resolve the open issues until then.
> > >> > (18/July/2016)
> > >> > - We will spend one-two weeks to fix blockers on the release
> branch
> > >> > if any and verify release candidate and roll release candidates
> until
> > >> > a release vote passes(29/July/2016)
> > >> > - Will roll release candidate on 3/Aug/2016
> > >> >
> > >> > Let me know your concerns/comments.
> > >> >
> > >>
> > >
> > >
> >
>
--
_____________________________________________________________
The information contained in this communication is intended solely for the
use of the individual or entity to whom it is addressed and others
authorized to receive it. It may contain confidential or legally privileged
information. If you are not the intended recipient you are hereby notified
that any disclosure, copying, distribution or taking any action in reliance
on the contents of this information is strictly prohibited and may be
unlawful. If you have received this communication in error, please notify
us immediately by responding to this email and then delete it from your
system. The firm is neither liable for the proper and complete transmission
of the information contained in this communication nor for any delay in its
receipt.
Re: [DISCUSS] Release Plan for 2.6
Posted by Rajat Khandelwal <ra...@gmail.com>.
Let's also get https://issues.apache.org/jira/browse/LENS-1178 in the
release.
On Fri, Jul 22, 2016 at 5:58 PM Puneet Gupta <pu...@gmail.com>
wrote:
> Will start the merge once LENS-128, LENS-1168, LENS-996, LENS-1202,
> LENS-1217 are in .
>
> Thanks,
> Puneet Gupta
> On Wed, Jul 20, 2016 at 11:00 AM, Puneet Gupta <pu...@apache.org>
> wrote:
>
> > Hi
> >
> > Waiting for a few important fixes to go in . Will merge master into
> > release branch post that ( targeting 22 July)
> >
> > Thanks,
> > Puneet Gupta
> > On Thu, Jul 7, 2016 at 5:56 PM, amareshwarisr . <am...@gmail.com>
> > wrote:
> >
> >> +1
> >>
> >> Release plan looks great!
> >>
> >> On Sat, Jul 2, 2016 at 9:35 AM, Puneet Gupta <pu...@gmail.com>
> >> wrote:
> >>
> >> > We have some significant improvements and features added after 2.5
> >> > release, mainly :
> >> >
> >> > - Hive 2 support and move Hive dependency to Apache Hive
> >> > - Lens Regression module added
> >> > - Work on Lens Scheduler is 70% complete.
> >> > - Limit number of open sessions per user on session service
> >> > - Enable streaming results for queries
> >> > - cube-segmentation specification added
> >> > - Python client support
> >> > - Exponential back off for hive queries
> >> > - Client result set iterable api added
> >> > - Lens UI enhancements
> >> > - Query Priority persisted in Lens DB
> >> > - Option to kill queries that exceed timeout added
> >> > - Convert dimension filter to fact filters for performance improvement
> >> > - Return same handle for repeated query from same user
> >> > - Post select option added to DriverQueryHook
> >> > - Skip partition registration for very old and future dates for a fact
> >> > tables
> >> > - Weighted Driver selector added.
> >> > - Cube keyword made optional in queries
> >> > - Session close will not result in queued query failures
> >> >
> >> > and bug fixes.
> >> >
> >> > I'm volunteering to manage the release. Calling out for a release
> >> > preparation for 2.6 here.
> >> > *Unassigned open items on 2.6 are ( A total of 13 issues)*
> >> >
> >> >
> >> >
> >>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%20%3D%20Unresolved%20AND%20assignee%20is%20EMPTY
> >> >
> >> > Contributors are welcome to provide fix for those issues.
> >> >
> >> > *All the open issues (A total of 30 issues including above mentioned
> >> > 13 unassigned issues)*
> >> >
> >> >
> >> >
> >>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%202.6
> >> >
> >> > *Issues yet to verify (A total of 107 issues)*
> >> >
> >> >
> >> >
> >>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%3D%20Resolved
> >> >
> >> > If any of you feel your changes should go into 2.6 and the jira is not
> >> > marked with fix version, please do so.
> >> >
> >> > Putting down the plan for 2.6 release:
> >> > - Will merge master into release branch after two weeks from now.
> >> > We can resolve the open issues until then.
> >> > (18/July/2016)
> >> > - We will spend one-two weeks to fix blockers on the release branch
> >> > if any and verify release candidate and roll release candidates until
> >> > a release vote passes(29/July/2016)
> >> > - Will roll release candidate on 3/Aug/2016
> >> >
> >> > Let me know your concerns/comments.
> >> >
> >>
> >
> >
>
Re: [DISCUSS] Release Plan for 2.6
Posted by Puneet Gupta <pu...@gmail.com>.
Will start the merge once LENS-128, LENS-1168, LENS-996, LENS-1202,
LENS-1217 are in .
Thanks,
Puneet Gupta
On Wed, Jul 20, 2016 at 11:00 AM, Puneet Gupta <pu...@apache.org>
wrote:
> Hi
>
> Waiting for a few important fixes to go in . Will merge master into
> release branch post that ( targeting 22 July)
>
> Thanks,
> Puneet Gupta
> On Thu, Jul 7, 2016 at 5:56 PM, amareshwarisr . <am...@gmail.com>
> wrote:
>
>> +1
>>
>> Release plan looks great!
>>
>> On Sat, Jul 2, 2016 at 9:35 AM, Puneet Gupta <pu...@gmail.com>
>> wrote:
>>
>> > We have some significant improvements and features added after 2.5
>> > release, mainly :
>> >
>> > - Hive 2 support and move Hive dependency to Apache Hive
>> > - Lens Regression module added
>> > - Work on Lens Scheduler is 70% complete.
>> > - Limit number of open sessions per user on session service
>> > - Enable streaming results for queries
>> > - cube-segmentation specification added
>> > - Python client support
>> > - Exponential back off for hive queries
>> > - Client result set iterable api added
>> > - Lens UI enhancements
>> > - Query Priority persisted in Lens DB
>> > - Option to kill queries that exceed timeout added
>> > - Convert dimension filter to fact filters for performance improvement
>> > - Return same handle for repeated query from same user
>> > - Post select option added to DriverQueryHook
>> > - Skip partition registration for very old and future dates for a fact
>> > tables
>> > - Weighted Driver selector added.
>> > - Cube keyword made optional in queries
>> > - Session close will not result in queued query failures
>> >
>> > and bug fixes.
>> >
>> > I'm volunteering to manage the release. Calling out for a release
>> > preparation for 2.6 here.
>> > *Unassigned open items on 2.6 are ( A total of 13 issues)*
>> >
>> >
>> >
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%20%3D%20Unresolved%20AND%20assignee%20is%20EMPTY
>> >
>> > Contributors are welcome to provide fix for those issues.
>> >
>> > *All the open issues (A total of 30 issues including above mentioned
>> > 13 unassigned issues)*
>> >
>> >
>> >
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%202.6
>> >
>> > *Issues yet to verify (A total of 107 issues)*
>> >
>> >
>> >
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%3D%20Resolved
>> >
>> > If any of you feel your changes should go into 2.6 and the jira is not
>> > marked with fix version, please do so.
>> >
>> > Putting down the plan for 2.6 release:
>> > - Will merge master into release branch after two weeks from now.
>> > We can resolve the open issues until then.
>> > (18/July/2016)
>> > - We will spend one-two weeks to fix blockers on the release branch
>> > if any and verify release candidate and roll release candidates until
>> > a release vote passes(29/July/2016)
>> > - Will roll release candidate on 3/Aug/2016
>> >
>> > Let me know your concerns/comments.
>> >
>>
>
>
Re: [DISCUSS] Release Plan for 2.6
Posted by Puneet Gupta <pu...@apache.org>.
Hi
Waiting for a few important fixes to go in . Will merge master into release
branch post that ( targeting 22 July)
Thanks,
Puneet Gupta
On Thu, Jul 7, 2016 at 5:56 PM, amareshwarisr . <am...@gmail.com>
wrote:
> +1
>
> Release plan looks great!
>
> On Sat, Jul 2, 2016 at 9:35 AM, Puneet Gupta <pu...@gmail.com>
> wrote:
>
> > We have some significant improvements and features added after 2.5
> > release, mainly :
> >
> > - Hive 2 support and move Hive dependency to Apache Hive
> > - Lens Regression module added
> > - Work on Lens Scheduler is 70% complete.
> > - Limit number of open sessions per user on session service
> > - Enable streaming results for queries
> > - cube-segmentation specification added
> > - Python client support
> > - Exponential back off for hive queries
> > - Client result set iterable api added
> > - Lens UI enhancements
> > - Query Priority persisted in Lens DB
> > - Option to kill queries that exceed timeout added
> > - Convert dimension filter to fact filters for performance improvement
> > - Return same handle for repeated query from same user
> > - Post select option added to DriverQueryHook
> > - Skip partition registration for very old and future dates for a fact
> > tables
> > - Weighted Driver selector added.
> > - Cube keyword made optional in queries
> > - Session close will not result in queued query failures
> >
> > and bug fixes.
> >
> > I'm volunteering to manage the release. Calling out for a release
> > preparation for 2.6 here.
> > *Unassigned open items on 2.6 are ( A total of 13 issues)*
> >
> >
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%20%3D%20Unresolved%20AND%20assignee%20is%20EMPTY
> >
> > Contributors are welcome to provide fix for those issues.
> >
> > *All the open issues (A total of 30 issues including above mentioned
> > 13 unassigned issues)*
> >
> >
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%202.6
> >
> > *Issues yet to verify (A total of 107 issues)*
> >
> >
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%3D%20Resolved
> >
> > If any of you feel your changes should go into 2.6 and the jira is not
> > marked with fix version, please do so.
> >
> > Putting down the plan for 2.6 release:
> > - Will merge master into release branch after two weeks from now.
> > We can resolve the open issues until then.
> > (18/July/2016)
> > - We will spend one-two weeks to fix blockers on the release branch
> > if any and verify release candidate and roll release candidates until
> > a release vote passes(29/July/2016)
> > - Will roll release candidate on 3/Aug/2016
> >
> > Let me know your concerns/comments.
> >
>
Re: [DISCUSS] Release Plan for 2.6
Posted by "amareshwarisr ." <am...@gmail.com>.
+1
Release plan looks great!
On Sat, Jul 2, 2016 at 9:35 AM, Puneet Gupta <pu...@gmail.com>
wrote:
> We have some significant improvements and features added after 2.5
> release, mainly :
>
> - Hive 2 support and move Hive dependency to Apache Hive
> - Lens Regression module added
> - Work on Lens Scheduler is 70% complete.
> - Limit number of open sessions per user on session service
> - Enable streaming results for queries
> - cube-segmentation specification added
> - Python client support
> - Exponential back off for hive queries
> - Client result set iterable api added
> - Lens UI enhancements
> - Query Priority persisted in Lens DB
> - Option to kill queries that exceed timeout added
> - Convert dimension filter to fact filters for performance improvement
> - Return same handle for repeated query from same user
> - Post select option added to DriverQueryHook
> - Skip partition registration for very old and future dates for a fact
> tables
> - Weighted Driver selector added.
> - Cube keyword made optional in queries
> - Session close will not result in queued query failures
>
> and bug fixes.
>
> I'm volunteering to manage the release. Calling out for a release
> preparation for 2.6 here.
> *Unassigned open items on 2.6 are ( A total of 13 issues)*
>
>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%20%3D%20Unresolved%20AND%20assignee%20is%20EMPTY
>
> Contributors are welcome to provide fix for those issues.
>
> *All the open issues (A total of 30 issues including above mentioned
> 13 unassigned issues)*
>
>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%202.6
>
> *Issues yet to verify (A total of 107 issues)*
>
>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%3D%20Resolved
>
> If any of you feel your changes should go into 2.6 and the jira is not
> marked with fix version, please do so.
>
> Putting down the plan for 2.6 release:
> - Will merge master into release branch after two weeks from now.
> We can resolve the open issues until then.
> (18/July/2016)
> - We will spend one-two weeks to fix blockers on the release branch
> if any and verify release candidate and roll release candidates until
> a release vote passes(29/July/2016)
> - Will roll release candidate on 3/Aug/2016
>
> Let me know your concerns/comments.
>
Re: [DISCUSS] Release Plan for 2.6
Posted by Puneet Gupta <pu...@gmail.com>.
Some more info on release plan
The below issues will be Good to have in 2.6 release. We should try to
resolve them.
3 in progress and 2 seem duplicate and 8 yet to be started (2 are
unassigned out of them)
-----------------------------
LENS-1030 Query log is having other request logs : Unassigned
LENS-793 Result formatter error when driver output path is null :
Duplicate
LENS-1199 NPE while closing session :
LENS-991 Seeing multiple close calls and failures of connection after
LENS-853 : In Progress
LENS-844 querying a measure with dim attributes not queryable with it
gives wrong error : In Progress
LENS-761 EXECUTED queries are stuck after restart : Duplicate
LENS-911 move throws HiveException clauses to throws LensException
: Unassigned
LENS-998 Partition skip is not logging correct start and end time in the
logs. :
LENS-952 Bump up enunciate version to work with java 8 :
LENS-823 Fetching already fetched inmemory result set should not give
500 :
LENS-1168 Isolate submissions for each driver : In Progress
LENS-1165 Separate client for query submission from other thrift
operations :
LENS-1198 Update hive dependency to apache hive 2.1.0 :
The below issues are related to test cases, build and documentation and it
will be good to have them fixed too for 2.6 release.
Most are unassigned
------------------------------
LENS-956 Seeing intermittent failure
TestRemoteHiveDriver.testMultiThreadClient Unassigned
LENS-955 Seeing intermittent failure
TestQueryEndEmailNotifier.testLaunchFailure Unassigned
LENS-930 .TestBetweenTimeRangeWriter.testConsecutiveDayParts fails
sometimes Unassigned
LENS-1024
org.apache.lens.driver.hive.TestRemoteHiveDriver.testHiveDriverPersistence
failed on one of the jenkins build Unassigned
LENS-822 Test are failing intermittently on jenkins Unassigned
LENS-808 Intermittent Failures in jenkins Unassigned
LENS-798 Pre commit job failures Unassigned
LENS-704 org.apache.lens.server.query.QueryAPIErrorResponseTest.setUp
fails sometimes Unassigned
LENS-52 TestQueryService.testPrepareQuery failing intermittently Raju
Bairishetti
LENS-291 Add doc for lens administrator to debug lens server issues
Unassigned
LENS-290 Add doc/run book for failures of lens REST api Unassigned
LENS-289 Add doc/ run book for debugging query failures Unassigned
I had moved the below issues to 2.7 ( let me know if u have any concerns)
------------------------------
LENS-728 Partition timeline not available for facts with CONTINUOUS
update period Raju Bairishetti
LENS-938 CLI cannot take values for params containing spaces Deepak
Barr
LENS-354 Move set database call from MetastoreService to
SessionService Unassigned
LENS-302 Provide ignoreIfExists option for creation of
cube/dimension/dimtable/fact Unassigned
LENS-1021 Reduce test time on org.apache.lens.server.query tests
Unassigned
LENS-528 Update package info in lens modules Unassigned
LENS-638 Add Spark Driver Raju Bairishetti
LENS-5 LENS-458 Build time is too long > 20mts Unassigned
LENS-127 LENS-124 Create scheduler client side apis. Unassigned
LENS-608 LENS-395 Move all REST APIs to new Lens Response Unassigned
LENS-530 LENS-395 Add documentation for reading response of REST APIs
and error handling for the same Unassigned
I had moved the below issues out of 2.6 (They are un-versioned now, let me
know if u have any concerns)
-------------------------------
LENS-103 CSVSerde doesn't differentiate between
{1:"one",2:"two",3:"three"} and {1:"one",2:"two, 3:three"}. Unassigned
LENS-773 Wrong Cost Calculation in case of HIVE Dimension Query
Unassigned
LENS-691 Loading DB Resource jars is not working for native tables
Unassigned
LENS-495 CubeColumn startTime and endTime are getting formatted
according to local time zone of the machine on which code is run Yash
Sharma
LENS-973 On Server restart not able to launch new queries on hive if
queue constraint driver.max.concurrent.launched.queries.per.queue is
enabled Sushil Mohanty
LENS-597 Lens server logs flooded with SQLException Rajat Khandelwal
LENS-266 Resultset not honouring index and size params Puneet Gupta
LENS-305 Statistics : JsonParseException: Unexpected end-of-input: was
expecting closing quote for a string value Jaideep Dhok
LENS-855 Column headers are always comma-separated in the output file
Deepak Barr
LENS-640 Create table query for finished_queries table does not work
with MySQL 5.6 Deepak Barr
LENS-886 Queued JDBC queries are failing upon lens server restart
Badrinath Kulkarni
LENS-778 Killing JDBC Query is not closing the connection Badrinath
Kulkarni
LENS-1156 TestUnionQueries.testDimAttrExpressionQuery failed in commit
build Amareshwari Sriramadasu
LENS-660 TestMLRunner.trainAndEvalFromDir fails some times
Amareshwari Sriramadasu
LENS-586 lens query containing multiple cube queries fails rewriting if
query metering is enabled. Amareshwari Sriramadasu
LENS-458 Code quality improvements Unassigned
LENS-411 Avoid parsing of the query multiple times Unassigned
LENS-345 Enable javadoc check on checkstyle Unassigned
LENS-561 Adding a Rewriter at HiveDriver Level vikas singh
LENS-395 Lens Rest API response improvements Sushil Mohanty
LENS-313 User friendly errors from Lens Sushil Mohanty
LENS-837 Lens request log to capture remote host name for all REST
operations Srikanth Sundarrajan
LENS-812 Simplify the asserts for CandidateTablePruneCause in
TestDenormalizaerResolver test Raju Bairishetti
LENS-571 Support parallel builds for the project Rajat Khandelwal
LENS-238 DockerFile should not hardcode project version Neerja
Bhatnagar
LENS-409 Fix usage of new HiveConf() and Hive.get() in ml lib Jaideep
Dhok
LENS-540 Skip deploying source archive and lens-server.war Jaideep
Dhok
LENS-868 Should not bundle node & node_modules (generated files) in
source-release archive file Deepak Barr
LENS-384 Provide an API to list all the open session Badrinath
Kulkarni
LENS-317 Server side calls for updating database jars Badrinath
Kulkarni
LENS-759 Setup regression for lens examples in jenkins Arshad Matin
LENS-609 LENS-395 Add more error codes in REST APIs and improve existing
error messages Unassigned
LENS-535 LENS-158 Add unit tests for lens-regression framework Arshad
Matin
LENS-713 LENS-395 Describe of non-existing entities should give 404, not
500 Ajay Yadava
LENS-337 Add regression for docker and ml lib Arshad Matin
LENS-620 Add profile for code coverage report Arshad Matin
On Sat, Jul 2, 2016 at 9:35 AM, Puneet Gupta <pu...@gmail.com>
wrote:
> We have some significant improvements and features added after 2.5 release, mainly :
>
> - Hive 2 support and move Hive dependency to Apache Hive
> - Lens Regression module added
> - Work on Lens Scheduler is 70% complete.
> - Limit number of open sessions per user on session service
> - Enable streaming results for queries
> - cube-segmentation specification added
> - Python client support
> - Exponential back off for hive queries
> - Client result set iterable api added
> - Lens UI enhancements
> - Query Priority persisted in Lens DB
> - Option to kill queries that exceed timeout added
> - Convert dimension filter to fact filters for performance improvement
> - Return same handle for repeated query from same user
> - Post select option added to DriverQueryHook
> - Skip partition registration for very old and future dates for a fact tables
> - Weighted Driver selector added.
> - Cube keyword made optional in queries
> - Session close will not result in queued query failures
>
> and bug fixes.
>
> I'm volunteering to manage the release. Calling out for a release preparation for 2.6 here.
> *Unassigned open items on 2.6 are ( A total of 13 issues)*
>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20resolution%20%3D%20Unresolved%20AND%20assignee%20is%20EMPTY
>
> Contributors are welcome to provide fix for those issues.
>
> *All the open issues (A total of 30 issues including above mentioned 13 unassigned issues)*
>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%202.6
>
> *Issues yet to verify (A total of 107 issues)*
>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20LENS%20AND%20fixVersion%20%3D%202.6%20AND%20status%20%3D%20Resolved
>
> If any of you feel your changes should go into 2.6 and the jira is not marked with fix version, please do so.
>
> Putting down the plan for 2.6 release:
> - Will merge master into release branch after two weeks from now. We can resolve the open issues until then.
> (18/July/2016)
> - We will spend one-two weeks to fix blockers on the release branch if any and verify release candidate and roll release candidates until a release vote passes(29/July/2016)
> - Will roll release candidate on 3/Aug/2016
>
> Let me know your concerns/comments.
>
>