[jira] [Commented] (IMPALA-7760) Privilege version inconsistency causes a hang when running invalidate metadata

["ASF subversion and git services (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16665916#comment-16665916 ] 

ASF subversion and git services commented on IMPALA-7760:
---------------------------------------------------------

Commit f8b7f257fb676d96fbde0ce9b078bbe4af3d4a4f in impala's branch refs/heads/master from [~fredyw]
[ https://git-wip-us.apache.org/repos/asf?p=impala.git;h=f8b7f25 ]

IMPALA-7760: Privilege version inconsistency causes a hang when running invalidate metadata

Before this patch, a bug in SentryProxy caused a hang when running
invalidate metadata due to privilege version inconsistency. I was able
to manually reproduce the issue by doing the following steps:

1. Get all Sentry role privileges for role a: [x, y] --> in SentryProxy
2. Add a sleep statement before getting all Sentry roles to simulate the
   timing issue--> in SentryProxy
3. Remove role a --> Externally via Sentry CLI
4. Privileges x and y in step 1 do not get removed in the catalog even
   those they were removed in step 3, which causes the catalog version
   inconsistency
5. Run invalidate metadata, this will cause it to hang due to catalog
   version inconsistency

The fix is to remove all privileges in the catalog if there are no
privileges (null or empty) returned by Sentry.

Testing:
- Manually tested the patch with by the above steps and did not
  encounter the hang  when issuing invalidate metadata.

Change-Id: Ib1e0db2b1f727476f489c732c4f4e5bc1582429f
Reviewed-on: http://gerrit.cloudera.org:8080/11794
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Privilege version inconsistency causes a hang when running invalidate metadata
> ------------------------------------------------------------------------------
>
>                 Key: IMPALA-7760
>                 URL: https://issues.apache.org/jira/browse/IMPALA-7760
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Catalog
>    Affects Versions: Impala 3.1.0
>            Reporter: Fredy Wijaya
>            Assignee: Fredy Wijaya
>            Priority: Critical
>
> 1. Add a sleep statement before getting all Sentry roles in SentryProxy.
> 2. Remove role any existing role via Sentry CLI.
> 3. Run invalidate metadata, this will cause Impala to hang.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org