[jira] [Commented] (IMPALA-9387) AuthorizationStmtTest is very slow

["Quanlong Huang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17037750#comment-17037750 ] 

Quanlong Huang commented on IMPALA-9387:
----------------------------------------

I did a profiling for a run. It shows up to me that most of the time is spent in creating/editing/deleting Ranger policies (granting/revoking privileges). This doesn't have any overhead time in Sentry. If we can't make it faster in Ranger, maybe we should group the tests by the privilege set so we can test them together to save some grant/revoke operations.

> AuthorizationStmtTest is very slow
> ----------------------------------
>
>                 Key: IMPALA-9387
>                 URL: https://issues.apache.org/jira/browse/IMPALA-9387
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Frontend
>            Reporter: Csaba Ringhofer
>            Priority: Major
>         Attachments: AuthorizationStmtTest-Ranger-CPU-Sample.png, AuthorizationStmtTest-Ranger-cpu-profile.nps
>
>
> AuthorizationStmtTest takes around a hour to run in the jenkines runs I recently saw:
> 02:54:32.772 [INFO] Tests run: 58, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3,436.751 s - in org.apache.impala.authorization.AuthorizationStmtTest
> This is extremely slow compared to other FE tests. I ran these tests with Sentry several times in the recent past, and they were below 1 min, so I think that Ranger tests are the culprit here.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org