You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2021/03/29 09:16:00 UTC
[jira] [Commented] (IMPALA-10609) NullPointerException in loading
tables introduced by ranger masking policies
[ https://issues.apache.org/jira/browse/IMPALA-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310517#comment-17310517 ]
ASF subversion and git services commented on IMPALA-10609:
----------------------------------------------------------
Commit cf463f28c3ff98749cf38093ab1deeab0b070895 in impala's branch refs/heads/master from stiga-huang
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=cf463f2 ]
IMPALA-10609: Fix NPE in resolving table masks in StmtMetadataLoader
When creating a StmtMetadataLoader, the 'user' field could be null in
places that don't need to resolve column-masking/row-filtering policies.
E.g. in processing GetColumns HS2 operation, or some FE tests.
This patch skips resolving the table masks in such cases to avoid
NullPointerException.
Tests:
- Run CORE tests and verified no NullPointerException found.
Change-Id: I7aa20458b02e8a93a871b6dd875decfab82c4eae
Reviewed-on: http://gerrit.cloudera.org:8080/17235
Reviewed-by: Aman Sinha <am...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> NullPointerException in loading tables introduced by ranger masking policies
> ----------------------------------------------------------------------------
>
> Key: IMPALA-10609
> URL: https://issues.apache.org/jira/browse/IMPALA-10609
> Project: IMPALA
> Issue Type: Bug
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Major
>
> Found some NullPointerException logs in logs/fe_tests/FeSupport.INFO when running ranger unit tests, e.g. AuthorizationStmtTest#testInsert:
> {code:java}
> I0325 17:03:06.550729 11365 AuthorizationTestBase.java:494] Testing authzOk for insert into functional.zipcode_incomes(id) values('123')
> E0325 17:03:06.551160 11365 StmtMetadataLoader.java:317] Failed to collect policy tables for functional.zipcode_incomes
> Java exception follows:
> java.lang.NullPointerException
> at org.apache.impala.authorization.ranger.RangerAuthorizationChecker.evalColumnMask(RangerAuthorizationChecker.java:503)
> at org.apache.impala.authorization.ranger.RangerAuthorizationChecker.needsMaskingOrFiltering(RangerAuthorizationChecker.java:350)
> at org.apache.impala.authorization.TableMask.needsMaskingOrFiltering(TableMask.java:67)
> at org.apache.impala.analysis.StmtMetadataLoader.collectPolicyTables(StmtMetadataLoader.java:351)
> at org.apache.impala.analysis.StmtMetadataLoader.getMissingTables(StmtMetadataLoader.java:315)
> at org.apache.impala.analysis.StmtMetadataLoader.loadTables(StmtMetadataLoader.java:156)
> at org.apache.impala.analysis.StmtMetadataLoader.loadTables(StmtMetadataLoader.java:132)
> at org.apache.impala.common.FrontendTestBase.parseAndAnalyze(FrontendTestBase.java:320)
> at org.apache.impala.authorization.AuthorizationTestBase.authzOk(AuthorizationTestBase.java:495)
> at org.apache.impala.authorization.AuthorizationTestBase.authzOk(AuthorizationTestBase.java:488)
> at org.apache.impala.authorization.AuthorizationTestBase.access$300(AuthorizationTestBase.java:74)
> at org.apache.impala.authorization.AuthorizationTestBase$AuthzTest.ok(AuthorizationTestBase.java:331)
> at org.apache.impala.authorization.AuthorizationStmtTest.testInsert(AuthorizationStmtTest.java:794)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> at org.junit.runners.Suite.runChild(Suite.java:128)
> at org.junit.runners.Suite.runChild(Suite.java:27)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272)
> at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236)
> at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
> at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386)
> at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323)
> at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org