[jira] [Commented] (SENTRY-1723) Flaky test TestHDFSIntegrationEnd2End

["Na Li (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SENTRY-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995669#comment-15995669 ] 

Na Li commented on SENTRY-1723:
-------------------------------

 The initial delay to schedule HMSFollower being 60000 ms is too long, and the test may finish before HMSFollower first calls run(). This problem exists before my change in sentry-1649. Since I have moved scheduling HMSFollower to runServer(), this long delay makes it worse. I have reduced it to 600 ms. Then another issue pops up. When the first full snapshot has nothing, a default AuthzObj is created in sentrystore. when the second full snapshot has nothing, we have "SentryAlreadyExistsException: AuthzObj: default already exists". So I move the code for setting needHiveSnapshot to constructor.

> Flaky test TestHDFSIntegrationEnd2End
> -------------------------------------
>
>                 Key: SENTRY-1723
>                 URL: https://issues.apache.org/jira/browse/SENTRY-1723
>             Project: Sentry
>          Issue Type: Sub-task
>          Components: Sentry
>            Reporter: Alexander Kolbasov
>            Assignee: Na Li
>             Fix For: sentry-ha-redesign
>
>
> When I run the {{TestHDFSIntegrationEnd2End}} test  from sentry-ha-redesign branch, I get
> {code}
> -------------------------------------------------------
>  T E S T S
> -------------------------------------------------------
> Running org.apache.sentry.tests.e2e.hdfs.TestHDFSIntegrationEnd2End
> Tests run: 6, Failures: 1, Errors: 0, Skipped: 2, Time elapsed: 142.788 sec <<< FAILURE! - in org.apa
> che.sentry.tests.e2e.hdfs.TestHDFSIntegrationEnd2End
> testColumnPrivileges(org.apache.sentry.tests.e2e.hdfs.TestHDFSIntegrationEnd2End)  Time elapsed: 15.0
> 14 sec  <<< FAILURE!
> java.lang.AssertionError: Error at verifying Path action : /user/hive/warehouse/db2.db/p1 ; expected:
> <READ_EXECUTE> but was:<null>
>         at org.apache.sentry.tests.e2e.hdfs.TestHDFSIntegrationEnd2End.testColumnPrivileges(TestHDFSI
> ntegrationEnd2End.java:505)
> Results :
> Flaked tests:
> org.apache.sentry.tests.e2e.hdfs.TestHDFSIntegrationEnd2End.testColumnPrivileges(org.apache.sentry.te
> sts.e2e.hdfs.TestHDFSIntegrationEnd2End)
>   Run 1: TestHDFSIntegrationEnd2End.testColumnPrivileges:505->TestHDFSIntegrationBase.verifyOnAllSubDirs:186->TestHDFSIntegrationBase.verifyOnAllSubDirs:205->TestHDFSIntegrationBase.verifyOnAllSubDirs:209->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:234->TestHDFSIntegrationBase.verifyOnAllSubDirsHelper:224 Error at verifying Path action : /user/hive/warehouse/db2.db/p1 ; expected:<READ_EXECUTE> but was:<null>
>   Run 2: PASS
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 2, Flakes: 1
> {code}
> I run the test with
> {code}
> mvn clean -pl sentry-tests/sentry-tests-hive -am -DfailIfNoTests=false -Dtest=TestHDFSIntegrationEnd2End test
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)