You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ranger.apache.org by Colm O hEigeartaigh <co...@apache.org> on 2016/07/04 09:17:19 UTC
Re: Review Request 48679: Add tests for the HIVE plugin
> On June 21, 2016, 10:48 p.m., Velmurugan Periasamy wrote:
> > After applying this patch, I get the below error during build. Colm - any thoughts?
> >
> > I run the build using mvn clean compile package assembly:assembly
> >
> >
> >
> > Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 21.098 sec <<< FAILURE! - in org.apache.ranger.services.hive.HIVERangerAuthorizerTest
> > org.apache.ranger.services.hive.HIVERangerAuthorizerTest Time elapsed: 21.098 sec <<< ERROR!
> > org.apache.hive.service.cli.HiveSQLException: Error running query: java.lang.NoClassDefFoundError: org/apache/calcite/rel/type/RelDataTypeSystem
> > at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:264)
> > at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:250)
> > at org.apache.hive.jdbc.HiveStatement.runAsyncOnServer(HiveStatement.java:309)
> > at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:250)
> > at org.apache.ranger.services.hive.HIVERangerAuthorizerTest.setup(HIVERangerAuthorizerTest.java:108)
> > Caused by: org.apache.hive.service.cli.HiveSQLException: Error running query: java.lang.NoClassDefFoundError: org/apache/calcite/rel/type/RelDataTypeSystem
> > at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:218)
> > at org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:269)
> > at org.apache.hive.service.cli.operation.Operation.run(Operation.java:324)
> > at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:460)
> > at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:447)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
> > at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
> > at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at javax.security.auth.Subject.doAs(Subject.java:415)
> > at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
> > at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
> > at com.sun.proxy.$Proxy20.executeStatementAsync(Unknown Source)
> > at org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:294)
> > at org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:497)
> > at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1437)
> > at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1422)
> > at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> > at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> > at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
> > at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
> > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:745)
> > Caused by: java.lang.NoClassDefFoundError: org/apache/calcite/rel/type/RelDataTypeSystem
> > at org.apache.hadoop.hive.ql.parse.SemanticAnalyzerFactory.get(SemanticAnalyzerFactory.java:300)
> > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:410)
> > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:329)
> > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1157)
> > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1144)
> > at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:184)
> > at org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:269)
> > at org.apache.hive.service.cli.operation.Operation.run(Operation.java:324)
> > at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:460)
> > at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:447)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
> > at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
> > at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at javax.security.auth.Subject.doAs(Subject.java:415)
> > at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
> > at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
> > at com.sun.proxy.$Proxy20.executeStatementAsync(Unknown Source)
> > at org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:294)
> > at org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:497)
> > at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1437)
> > at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1422)
> > at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> > at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> > at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
> > at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
> > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:745)
> > Caused by: java.lang.ClassNotFoundException: org.apache.calcite.rel.type.RelDataTypeSystem
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> > at org.apache.hadoop.hive.ql.parse.SemanticAnalyzerFactory.get(SemanticAnalyzerFactory.java:300)
> > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:410)
> > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:329)
> > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1157)
> > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1144)
> > at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:184)
> > at org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:269)
> > at org.apache.hive.service.cli.operation.Operation.run(Operation.java:324)
> > at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:460)
> > at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:447)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
> > at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
> > at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at javax.security.auth.Subject.doAs(Subject.java:415)
> > at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
> > at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
> > at com.sun.proxy.$Proxy20.executeStatementAsync(Unknown Source)
> > at org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:294)
> > at org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:497)
> > at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1437)
> > at org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1422)
> > at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> > at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> > at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
> > at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
> > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> > Results :
> >
> > Tests in error:
> > HIVERangerAuthorizerTest.setup:108 � HiveSQL Error running query: java.lang.No...
> >
> > Tests run: 1, Failures: 0, Errors: 1, Skipped: 0
>
> Colm O hEigeartaigh wrote:
> Yes, the patch is dependent on another patch that I submitted: https://reviews.apache.org/r/48481/
Ok, the calcite patch has been applied, so this patch now applies cleanly to the latest master code.
- Colm
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/48679/#review138961
-----------------------------------------------------------
On June 14, 2016, 9:50 a.m., Colm O hEigeartaigh wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/48679/
> -----------------------------------------------------------
>
> (Updated June 14, 2016, 9:50 a.m.)
>
>
> Review request for ranger.
>
>
> Bugs: RANGER-1031
> https://issues.apache.org/jira/browse/RANGER-1031
>
>
> Repository: ranger
>
>
> Description
> -------
>
> Similar to RANGER-1006 for HDFS, this task is to add tests for the HIVE plugin, as there are currently no tests in source control.
>
>
> Diffs
> -----
>
> hive-agent/pom.xml 2c03dce
> hive-agent/src/test/java/org/apache/ranger/services/hive/HIVERangerAuthorizerTest.java PRE-CREATION
> hive-agent/src/test/java/org/apache/ranger/services/hive/RangerAdminClientImpl.java PRE-CREATION
> hive-agent/src/test/java/org/apache/ranger/services/hive/client/HiveClientTester.java 1ff0f35
> hive-agent/src/test/java/org/apache/ranger/services/hive/client/TestRangerServiceHive.java a676b13
> hive-agent/src/test/resource/log4j.properties f7ab2ba
> hive-agent/src/test/resources/hive-policies.json PRE-CREATION
> hive-agent/src/test/resources/log4j.properties PRE-CREATION
> hive-agent/src/test/resources/ranger-hive-security.xml PRE-CREATION
> hive-agent/src/test/resources/wordcount.txt PRE-CREATION
> pom.xml 9f04e96
>
> Diff: https://reviews.apache.org/r/48679/diff/
>
>
> Testing
> -------
>
>
> Thanks,
>
> Colm O hEigeartaigh
>
>