You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sentry.apache.org by Hao Hao <ha...@cloudera.com> on 2016/01/12 02:38:59 UTC
Janaury hangout
Hi folks,
We may have our monthly hangout this coming Thursday. Any volunteers who
would like to form an agenda and lead the conversation? If not, I suggest
we can do review and dicsuss the design proposed by Junjie for Sentry-711:
“Implement grant user to role”, which is an important feature we may want
to have? Thanks!
Best,
Hao
RE: Janaury hangout
Posted by "Ma, Junjie" <ju...@intel.com>.
Thanks for the meeting minutes.
Best regards,
Colin Ma(Ma Jun Jie)
-----Original Message-----
From: Hao Hao [mailto:hao.hao@cloudera.com]
Sent: Friday, January 15, 2016 10:01 AM
To: dev@sentry.incubator.apache.org
Subject: Re: Janaury hangout
Hi All,
We just finished this monthly hangout. The summary of our discussion today:
- Reviewed the design of SENTRY-711: “Implement grant user to role”:
Define the objective of this feature is to handle: Support grant role to a
user only; and “support grant privilege to group and user” should be a
separate issue. Design doc will be updated accordingly.
- Discussed the issue of SENTRY-1007: "Sentry column-level performance
for wide tables": Located two separate improvement should be addressed:
reduce RPC calls for each query, and cache the privilege. Jiras will be
filed to track the issues.
- Discussed the design of SENTRY-999: "Refactor the sentry to integrate
with external components." Define the objective of this feature is to
reduce the redundant implementation for client integration with generic
model through thrift API. Design doc will be updated accordingly.
Thanks!
Best,
Hao
On Wed, Jan 13, 2016 at 10:04 PM, Ma, Junjie <ju...@intel.com> wrote:
>
> For the "Refactor the sentry to integrate with external components",
> the initial patch for the Privilege refactor is finished(SENTRY-1004).
> We can check the patch before discussion.
>
> Best regards,
>
> Colin Ma(Ma Jun Jie)
>
> -----Original Message-----
> From: Hao Hao [mailto:hao.hao@cloudera.com]
> Sent: Wednesday, January 13, 2016 4:50 AM
> To: dev@sentry.incubator.apache.org
> Subject: Re: Janaury hangout
>
> Hi Anne,
>
> Sure, we can add that to our discussion as well. Thanks a lot for
> reminding!
>
> Best,
> Hao
>
> On Tue, Jan 12, 2016 at 11:19 AM, Anne Yu <an...@cloudera.com> wrote:
>
> > Hi Haohao,
> >
> > There is potentially one more:
> >
> > SENTRY-1007: Performance issue for column level privileges: when the
> > table includes thousands of columns or partitions. (for example 8k).
> > Some commands, like select * from table will issue thousands of
> > backend db queries, instead of one query, so to user, the query
> > seems to freeze for a long time.
> >
> > Thanks,
> > Anne
> >
> > On Mon, Jan 11, 2016 at 5:57 PM, Hao Hao <ha...@cloudera.com> wrote:
> >
> > > Great, thanks Colin. Then here is the proposed agenda:
> > >
> > > 1. Review and discuss the design of SENTRY-711: “Implement grant
> > > user to role”. (15 mins) 2. Review and discuss the design of
> > > SENTRY-999: "Refactor the sentry to integrate with external
> > > components." (15 mins)
> > >
> > >
> > > Please let me know if you have any questions. Thanks!
> > >
> > > Best,
> > > Hao
> > >
> > >
> > > On Mon, Jan 11, 2016 at 5:51 PM, Ma, Junjie <ju...@intel.com>
> wrote:
> > >
> > > > I want to add another discussion for SENTRY-999: Refactor the
> > > > sentry to integrate with external components quickly. It should
> > > > be another
> > > important
> > > > change for Sentry to be a common authorization framework.
> > > >
> > > > Best regards,
> > > >
> > > > Colin Ma(Ma Jun Jie)
> > > >
> > > > -----Original Message-----
> > > > From: Hao Hao [mailto:hao.hao@cloudera.com]
> > > > Sent: Tuesday, January 12, 2016 9:39 AM
> > > > To: dev@sentry.incubator.apache.org
> > > > Subject: Janaury hangout
> > > >
> > > > Hi folks,
> > > >
> > > > We may have our monthly hangout this coming Thursday. Any
> > > > volunteers
> > who
> > > > would like to form an agenda and lead the conversation? If not,
> > > > I
> > suggest
> > > > we can do review and dicsuss the design proposed by Junjie for
> > > Sentry-711:
> > > > “Implement grant user to role”, which is an important feature we
> > > > may
> > want
> > > > to have? Thanks!
> > > >
> > > > Best,
> > > > Hao
> > > >
> > >
> >
> >
> >
> > --
> > Thanks,
> > Anne
> >
>
Re: Janaury hangout
Posted by Hao Hao <ha...@cloudera.com>.
Hi All,
We just finished this monthly hangout. The summary of our discussion today:
- Reviewed the design of SENTRY-711: “Implement grant user to role”:
Define the objective of this feature is to handle: Support grant role to a
user only; and “support grant privilege to group and user” should be a
separate issue. Design doc will be updated accordingly.
- Discussed the issue of SENTRY-1007: "Sentry column-level performance
for wide tables": Located two separate improvement should be addressed:
reduce RPC calls for each query, and cache the privilege. Jiras will be
filed to track the issues.
- Discussed the design of SENTRY-999: "Refactor the sentry to integrate
with external components." Define the objective of this feature is to
reduce the redundant implementation for client integration with generic
model through thrift API. Design doc will be updated accordingly.
Thanks!
Best,
Hao
On Wed, Jan 13, 2016 at 10:04 PM, Ma, Junjie <ju...@intel.com> wrote:
>
> For the "Refactor the sentry to integrate with external components", the
> initial patch for the Privilege refactor is finished(SENTRY-1004).
> We can check the patch before discussion.
>
> Best regards,
>
> Colin Ma(Ma Jun Jie)
>
> -----Original Message-----
> From: Hao Hao [mailto:hao.hao@cloudera.com]
> Sent: Wednesday, January 13, 2016 4:50 AM
> To: dev@sentry.incubator.apache.org
> Subject: Re: Janaury hangout
>
> Hi Anne,
>
> Sure, we can add that to our discussion as well. Thanks a lot for
> reminding!
>
> Best,
> Hao
>
> On Tue, Jan 12, 2016 at 11:19 AM, Anne Yu <an...@cloudera.com> wrote:
>
> > Hi Haohao,
> >
> > There is potentially one more:
> >
> > SENTRY-1007: Performance issue for column level privileges: when the
> > table includes thousands of columns or partitions. (for example 8k).
> > Some commands, like select * from table will issue thousands of
> > backend db queries, instead of one query, so to user, the query seems
> > to freeze for a long time.
> >
> > Thanks,
> > Anne
> >
> > On Mon, Jan 11, 2016 at 5:57 PM, Hao Hao <ha...@cloudera.com> wrote:
> >
> > > Great, thanks Colin. Then here is the proposed agenda:
> > >
> > > 1. Review and discuss the design of SENTRY-711: “Implement grant
> > > user to role”. (15 mins) 2. Review and discuss the design of
> > > SENTRY-999: "Refactor the sentry to integrate with external
> > > components." (15 mins)
> > >
> > >
> > > Please let me know if you have any questions. Thanks!
> > >
> > > Best,
> > > Hao
> > >
> > >
> > > On Mon, Jan 11, 2016 at 5:51 PM, Ma, Junjie <ju...@intel.com>
> wrote:
> > >
> > > > I want to add another discussion for SENTRY-999: Refactor the
> > > > sentry to integrate with external components quickly. It should be
> > > > another
> > > important
> > > > change for Sentry to be a common authorization framework.
> > > >
> > > > Best regards,
> > > >
> > > > Colin Ma(Ma Jun Jie)
> > > >
> > > > -----Original Message-----
> > > > From: Hao Hao [mailto:hao.hao@cloudera.com]
> > > > Sent: Tuesday, January 12, 2016 9:39 AM
> > > > To: dev@sentry.incubator.apache.org
> > > > Subject: Janaury hangout
> > > >
> > > > Hi folks,
> > > >
> > > > We may have our monthly hangout this coming Thursday. Any
> > > > volunteers
> > who
> > > > would like to form an agenda and lead the conversation? If not, I
> > suggest
> > > > we can do review and dicsuss the design proposed by Junjie for
> > > Sentry-711:
> > > > “Implement grant user to role”, which is an important feature we
> > > > may
> > want
> > > > to have? Thanks!
> > > >
> > > > Best,
> > > > Hao
> > > >
> > >
> >
> >
> >
> > --
> > Thanks,
> > Anne
> >
>
RE: Janaury hangout
Posted by "Ma, Junjie" <ju...@intel.com>.
For the "Refactor the sentry to integrate with external components", the initial patch for the Privilege refactor is finished(SENTRY-1004).
We can check the patch before discussion.
Best regards,
Colin Ma(Ma Jun Jie)
-----Original Message-----
From: Hao Hao [mailto:hao.hao@cloudera.com]
Sent: Wednesday, January 13, 2016 4:50 AM
To: dev@sentry.incubator.apache.org
Subject: Re: Janaury hangout
Hi Anne,
Sure, we can add that to our discussion as well. Thanks a lot for reminding!
Best,
Hao
On Tue, Jan 12, 2016 at 11:19 AM, Anne Yu <an...@cloudera.com> wrote:
> Hi Haohao,
>
> There is potentially one more:
>
> SENTRY-1007: Performance issue for column level privileges: when the
> table includes thousands of columns or partitions. (for example 8k).
> Some commands, like select * from table will issue thousands of
> backend db queries, instead of one query, so to user, the query seems
> to freeze for a long time.
>
> Thanks,
> Anne
>
> On Mon, Jan 11, 2016 at 5:57 PM, Hao Hao <ha...@cloudera.com> wrote:
>
> > Great, thanks Colin. Then here is the proposed agenda:
> >
> > 1. Review and discuss the design of SENTRY-711: “Implement grant
> > user to role”. (15 mins) 2. Review and discuss the design of
> > SENTRY-999: "Refactor the sentry to integrate with external
> > components." (15 mins)
> >
> >
> > Please let me know if you have any questions. Thanks!
> >
> > Best,
> > Hao
> >
> >
> > On Mon, Jan 11, 2016 at 5:51 PM, Ma, Junjie <ju...@intel.com> wrote:
> >
> > > I want to add another discussion for SENTRY-999: Refactor the
> > > sentry to integrate with external components quickly. It should be
> > > another
> > important
> > > change for Sentry to be a common authorization framework.
> > >
> > > Best regards,
> > >
> > > Colin Ma(Ma Jun Jie)
> > >
> > > -----Original Message-----
> > > From: Hao Hao [mailto:hao.hao@cloudera.com]
> > > Sent: Tuesday, January 12, 2016 9:39 AM
> > > To: dev@sentry.incubator.apache.org
> > > Subject: Janaury hangout
> > >
> > > Hi folks,
> > >
> > > We may have our monthly hangout this coming Thursday. Any
> > > volunteers
> who
> > > would like to form an agenda and lead the conversation? If not, I
> suggest
> > > we can do review and dicsuss the design proposed by Junjie for
> > Sentry-711:
> > > “Implement grant user to role”, which is an important feature we
> > > may
> want
> > > to have? Thanks!
> > >
> > > Best,
> > > Hao
> > >
> >
>
>
>
> --
> Thanks,
> Anne
>
Re: Janaury hangout
Posted by Hao Hao <ha...@cloudera.com>.
Hi Anne,
Sure, we can add that to our discussion as well. Thanks a lot for reminding!
Best,
Hao
On Tue, Jan 12, 2016 at 11:19 AM, Anne Yu <an...@cloudera.com> wrote:
> Hi Haohao,
>
> There is potentially one more:
>
> SENTRY-1007: Performance issue for column level privileges: when the table
> includes thousands of columns or partitions. (for example 8k). Some
> commands, like select * from table will issue thousands of backend db
> queries, instead of one query, so to user, the query seems to freeze for a
> long time.
>
> Thanks,
> Anne
>
> On Mon, Jan 11, 2016 at 5:57 PM, Hao Hao <ha...@cloudera.com> wrote:
>
> > Great, thanks Colin. Then here is the proposed agenda:
> >
> > 1. Review and discuss the design of SENTRY-711: “Implement grant user to
> > role”. (15 mins)
> > 2. Review and discuss the design of SENTRY-999: "Refactor the sentry to
> > integrate with external components." (15 mins)
> >
> >
> > Please let me know if you have any questions. Thanks!
> >
> > Best,
> > Hao
> >
> >
> > On Mon, Jan 11, 2016 at 5:51 PM, Ma, Junjie <ju...@intel.com> wrote:
> >
> > > I want to add another discussion for SENTRY-999: Refactor the sentry to
> > > integrate with external components quickly. It should be another
> > important
> > > change for Sentry to be a common authorization framework.
> > >
> > > Best regards,
> > >
> > > Colin Ma(Ma Jun Jie)
> > >
> > > -----Original Message-----
> > > From: Hao Hao [mailto:hao.hao@cloudera.com]
> > > Sent: Tuesday, January 12, 2016 9:39 AM
> > > To: dev@sentry.incubator.apache.org
> > > Subject: Janaury hangout
> > >
> > > Hi folks,
> > >
> > > We may have our monthly hangout this coming Thursday. Any volunteers
> who
> > > would like to form an agenda and lead the conversation? If not, I
> suggest
> > > we can do review and dicsuss the design proposed by Junjie for
> > Sentry-711:
> > > “Implement grant user to role”, which is an important feature we may
> want
> > > to have? Thanks!
> > >
> > > Best,
> > > Hao
> > >
> >
>
>
>
> --
> Thanks,
> Anne
>
Re: Janaury hangout
Posted by Anne Yu <an...@cloudera.com>.
Hi Haohao,
There is potentially one more:
SENTRY-1007: Performance issue for column level privileges: when the table
includes thousands of columns or partitions. (for example 8k). Some
commands, like select * from table will issue thousands of backend db
queries, instead of one query, so to user, the query seems to freeze for a
long time.
Thanks,
Anne
On Mon, Jan 11, 2016 at 5:57 PM, Hao Hao <ha...@cloudera.com> wrote:
> Great, thanks Colin. Then here is the proposed agenda:
>
> 1. Review and discuss the design of SENTRY-711: “Implement grant user to
> role”. (15 mins)
> 2. Review and discuss the design of SENTRY-999: "Refactor the sentry to
> integrate with external components." (15 mins)
>
>
> Please let me know if you have any questions. Thanks!
>
> Best,
> Hao
>
>
> On Mon, Jan 11, 2016 at 5:51 PM, Ma, Junjie <ju...@intel.com> wrote:
>
> > I want to add another discussion for SENTRY-999: Refactor the sentry to
> > integrate with external components quickly. It should be another
> important
> > change for Sentry to be a common authorization framework.
> >
> > Best regards,
> >
> > Colin Ma(Ma Jun Jie)
> >
> > -----Original Message-----
> > From: Hao Hao [mailto:hao.hao@cloudera.com]
> > Sent: Tuesday, January 12, 2016 9:39 AM
> > To: dev@sentry.incubator.apache.org
> > Subject: Janaury hangout
> >
> > Hi folks,
> >
> > We may have our monthly hangout this coming Thursday. Any volunteers who
> > would like to form an agenda and lead the conversation? If not, I suggest
> > we can do review and dicsuss the design proposed by Junjie for
> Sentry-711:
> > “Implement grant user to role”, which is an important feature we may want
> > to have? Thanks!
> >
> > Best,
> > Hao
> >
>
--
Thanks,
Anne
Re: Janaury hangout
Posted by Hao Hao <ha...@cloudera.com>.
Great, thanks Colin. Then here is the proposed agenda:
1. Review and discuss the design of SENTRY-711: “Implement grant user to
role”. (15 mins)
2. Review and discuss the design of SENTRY-999: "Refactor the sentry to
integrate with external components." (15 mins)
Please let me know if you have any questions. Thanks!
Best,
Hao
On Mon, Jan 11, 2016 at 5:51 PM, Ma, Junjie <ju...@intel.com> wrote:
> I want to add another discussion for SENTRY-999: Refactor the sentry to
> integrate with external components quickly. It should be another important
> change for Sentry to be a common authorization framework.
>
> Best regards,
>
> Colin Ma(Ma Jun Jie)
>
> -----Original Message-----
> From: Hao Hao [mailto:hao.hao@cloudera.com]
> Sent: Tuesday, January 12, 2016 9:39 AM
> To: dev@sentry.incubator.apache.org
> Subject: Janaury hangout
>
> Hi folks,
>
> We may have our monthly hangout this coming Thursday. Any volunteers who
> would like to form an agenda and lead the conversation? If not, I suggest
> we can do review and dicsuss the design proposed by Junjie for Sentry-711:
> “Implement grant user to role”, which is an important feature we may want
> to have? Thanks!
>
> Best,
> Hao
>
RE: Janaury hangout
Posted by "Ma, Junjie" <ju...@intel.com>.
I want to add another discussion for SENTRY-999: Refactor the sentry to integrate with external components quickly. It should be another important change for Sentry to be a common authorization framework.
Best regards,
Colin Ma(Ma Jun Jie)
-----Original Message-----
From: Hao Hao [mailto:hao.hao@cloudera.com]
Sent: Tuesday, January 12, 2016 9:39 AM
To: dev@sentry.incubator.apache.org
Subject: Janaury hangout
Hi folks,
We may have our monthly hangout this coming Thursday. Any volunteers who would like to form an agenda and lead the conversation? If not, I suggest we can do review and dicsuss the design proposed by Junjie for Sentry-711:
“Implement grant user to role”, which is an important feature we may want to have? Thanks!
Best,
Hao