答复: kylin config beelline error

[Ge Silas <go...@live.cn>]

Hi hzxieyufeng,

The exact problem should be "Cannot modify dfs.replication at runtime". You may try to comment this configuration in kylin_hive_conf.xml, or set Hive configuraiton hive.security.authorization.sqlstd.confwhitelist to allow such configuration to be changed at runtime.

Thanks,
Silas
________________________________
发件人: hzxieyufeng <hz...@corp.netease.com>
发送时间: 2018年9月12日 17:48
收件人: dev
主题: kylin config beelline error

hi,
I can't get hive metastore or mysql. I only use  hive with beeline mode. when is run sample.sh 。I meet this problem。


Retrieving hadoop conf dir...
Loading sample data into HDFS tmp path: /tmp/kylin/sample_cube/data
put: `/tmp/kylin/sample_cube/data/DEFAULT.KYLIN_ACCOUNT.csv': File exists
put: `/tmp/kylin/sample_cube/data/DEFAULT.KYLIN_CAL_DT.csv': File exists
put: `/tmp/kylin/sample_cube/data/DEFAULT.KYLIN_CATEGORY_GROUPINGS.csv': File exists
put: `/tmp/kylin/sample_cube/data/DEFAULT.KYLIN_COUNTRY.csv': File exists
put: `/tmp/kylin/sample_cube/data/DEFAULT.KYLIN_SALES.csv': File exists
Going to create sample tables in hive to database DEFAULT by beeline
ls: cannot access /home/recsys/hive-jd/lib/hive-jdbc-*-standalone.jar: No such file or directory
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/recsys/hive-jd/lib/log4j-slf4j-impl-2.4.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/recsys/hadoop-jd/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Connecting to jdbc:hive2://hive1.jd.163.org:12181,hive2.jd.163.org:12181,spark5.jd.163.org:12181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hive-cluster9;principal=hive/_HOST@HADOOP2.HZ.NETEASE.COM
18/09/12 17:23:38 [main]: INFO jdbc.HiveConnection: Connected to hive3.jd.163.org:10010
18/09/12 17:23:38 [main]: ERROR jdbc.HiveConnection: Error opening session
org.apache.thrift.protocol.TProtocolException: Required field 'serverProtocolVersion' is unset! Struct:TOpenSessionResp(status:TStatus(statusCode:ERROR_STATUS, infoMessages:[*org.apache.hive.service.cli.HiveSQLException:Failed to open new session: java.lang.IllegalArgumentException: Cannot modify dfs.replication at runtime. It is not in list of params that are allowed to be modified at runtime:14:13, org.apache.hive.service.cli.session.SessionManager:createSession:SessionManager.java:336, org.apache.hive.service.cli.session.SessionManager:openSession:SessionManager.java:279, org.apache.hive.service.cli.CLIService:openSessionWithImpersonation:CLIService.java:189, org.apache.hive.service.cli.thrift.ThriftCLIService:getSessionHandle:ThriftCLIService.java:431, org.apache.hive.service.cli.thrift.ThriftCLIService:OpenSession:ThriftCLIService.java:313, org.apache.hive.service.rpc.thrift.TCLIService$Processor$OpenSession:getResult:TCLIService.java:1377, org.apache.hive.service.rpc.thrift.TCLIService$Processor$OpenSession:getResult:TCLIService.java:1362, org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39, org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39, org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor:process:HadoopThriftAuthBridge.java:599, org.apache.thrift.server.TThreadPoolServer$WorkerProcess:run:TThreadPoolServer.java:286, java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1149, java.util.concurrent.ThreadPoolExecutor$Worker:run:ThreadPoolExecutor.java:624, java.lang.Thread:run:Thread.java:748, *org.apache.hive.service.cli.HiveSQLException:java.lang.IllegalArgumentException: Cannot modify dfs.replication at runtime. It is not in list of params that are allowed to be modified at runtime:27:13, org.apache.hive.service.cli.session.HiveSessionImpl:configureSession:HiveSessionImpl.java:264, org.apache.hive.service.cli.session.HiveSessionImpl:open:HiveSessionImpl.java:189, sun.reflect.GeneratedMethodAccessor180:invoke::-1, sun.reflect.DelegatingMethodAccessorImpl:invoke:DelegatingMethodAccessorImpl.java:43, java.lang.reflect.Method:invoke:Method.java:498, org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:78, org.apache.hive.service.cli.session.HiveSessionProxy:access$000:HiveSessionProxy.java:36, org.apache.hive.service.cli.session.HiveSessionProxy$1:run:HiveSessionProxy.java:63, java.security.AccessController:doPrivileged:AccessController.java:-2, javax.security.auth.Subject:doAs:Subject.java:422, org.apache.hadoop.security.UserGroupInformation:doAs:UserGroupInformation.java:1698, org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:59, com.sun.proxy.$Proxy48:open::-1, org.apache.hive.service.cli.session.SessionManager:createSession:SessionManager.java:327, *java.lang.IllegalArgumentException:Cannot modify dfs.replication at runtime. It is not in list of params that are allowed to be modified at runtime:30:3, org.apache.hadoop.hive.conf.HiveConf:verifyAndSet:HiveConf.java:3389, org.apache.hadoop.hive.ql.processors.SetProcessor:setConf:SetProcessor.java:239, org.apache.hadoop.hive.ql.processors.SetProcessor:setVariable:SetProcessor.java:177, org.apache.hive.service.cli.session.HiveSessionImpl:configureSession:HiveSessionImpl.java:262], errorCode:0, errorMessage:Failed to open new session: java.lang.IllegalArgumentException: Cannot modify dfs.replication at runtime. It is not in list of params that are allowed to be modified at runtime), serverProtocolVersion:null)
 at org.apache.hive.service.rpc.thrift.TOpenSessionResp.validate(TOpenSessionResp.java:571) ~[hive-exec-2.1.0.jar:2.1.0]
 at org.apache.hive.service.rpc.thrift.TOpenSessionResp$TOpenSessionRespStandardScheme.read(TOpenSessionResp.java:669) ~[hive-exec-2.1.0.jar:2.1.0]
 at org.apache.hive.service.rpc.thrift.TOpenSessionResp$TOpenSessionRespStandardScheme.read(TOpenSessionResp.java:605) ~[hive-exec-2.1.0.jar:2.1.0]
 at org.apache.hive.service.rpc.thrift.TOpenSessionResp.read(TOpenSessionResp.java:513) ~[hive-exec-2.1.0.jar:2.1.0]
 at org.apache.hive.service.rpc.thrift.TCLIService$OpenSession_result$OpenSession_resultStandardScheme.read(TCLIService.java:3553) ~[hive-exec-2.1.0.jar:2.1.0]
 at org.apache.hive.service.rpc.thrift.TCLIService$OpenSession_result$OpenSession_resultStandardScheme.read(TCLIService.java:3538) ~[hive-exec-2.1.0.jar:2.1.0]
 at org.apache.hive.service.rpc.thrift.TCLIService$OpenSession_result.read(TCLIService.java:3485) ~[hive-exec-2.1.0.jar:2.1.0]
 at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:86) ~[hive-exec-2.1.0.jar:2.1.0]
 at org.apache.hive.service.rpc.thrift.TCLIService$Client.recv_OpenSession(TCLIService.java:168) ~[hive-exec-2.1.0.jar:2.1.0]
 at org.apache.hive.service.rpc.thrift.TCLIService$Client.OpenSession(TCLIService.java:155) ~[hive-exec-2.1.0.jar:2.1.0]
 at org.apache.hive.jdbc.HiveConnection.openSession(HiveConnection.java:590) [hive-jdbc-2.1.0.jar:2.1.0]
 at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:172) [hive-jdbc-2.1.0.jar:2.1.0]
 at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107) [hive-jdbc-2.1.0.jar:2.1.0]
 at java.sql.DriverManager.getConnection(DriverManager.java:664) [?:1.8.0_171]
 at java.sql.DriverManager.getConnection(DriverManager.java:208) [?:1.8.0_171]
 at org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:145) [hive-beeline-2.1.0.jar:2.1.0]
 at org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:209) [hive-beeline-2.1.0.jar:2.1.0]
 at org.apache.hive.beeline.Commands.connect(Commands.java:1433) [hive-beeline-2.1.0.jar:2.1.0]
 at org.apache.hive.beeline.Commands.connect(Commands.java:1329) [hive-beeline-2.1.0.jar:2.1.0]
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_171]
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_171]
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_171]
 at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_171]
 at org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:52) [hive-beeline-2.1.0.jar:2.1.0]
 at org.apache.hive.beeline.BeeLine.execCommandWithPrefix(BeeLine.java:1093) [hive-beeline-2.1.0.jar:2.1.0]
 at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1132) [hive-beeline-2.1.0.jar:2.1.0]
 at org.apache.hive.beeline.BeeLine.initArgs(BeeLine.java:772) [hive-beeline-2.1.0.jar:2.1.0]
 at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:851) [hive-beeline-2.1.0.jar:2.1.0]
 at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:499) [hive-beeline-2.1.0.jar:2.1.0]
 at org.apache.hive.beeline.BeeLine.main(BeeLine.java:482) [hive-beeline-2.1.0.jar:2.1.0]
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_171]
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_171]
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_171]
 at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_171]
 at org.apache.hadoop.util.RunJar.run(RunJar.java:221) [hadoop-common-2.7.3.jar:?]
 at org.apache.hadoop.util.RunJar.main(RunJar.java:136) [hadoop-common-2.7.3.jar:?]


2018-09-12


hzxieyufeng