You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Joseph D Antoni <jd...@yahoo.com> on 2013/12/04 17:26:42 UTC
Hive ODBC Error
To all,
I'm trying to connect Tableau to Hive (0.10.0) running Hiveserver2. The connection works ok, until I go to pull in the data. The resulting M/R job is attempting to connect to port 8021 on one of my data nodes--I've tried both Cloudera and Hortonworks ODBC in an effort to rule that out, and the query works fine running local to the cluster.
The Hive log is as follows:
2013-12-04 11:12:45,026 INFO org.apache.hadoop.hive.ql.Driver: Starting command: SELECT `fmc_free_text`.`msgtext` AS `msgtext`
FROM `default`.`fmc_free_text` `fmc_free_text`
2013-12-04 11:12:45,027 INFO org.apache.hadoop.hive.ql.Driver: Total MapReduce jobs = 1
2013-12-04 11:12:45,027 INFO org.apache.hadoop.hive.ql.Driver: </PERFLOG method=TimeToSubmit start=1386173564991 end=1386173565027 duration=36>
2013-12-04 11:12:45,027 INFO org.apache.hadoop.hive.ql.Driver: Launching Job 1 out of 1
2013-12-04 11:12:45,029 INFO org.apache.hadoop.hive.ql.exec.Task: Number of reduce tasks is set to 0 since there's no reduce operator
2013-12-04 11:12:45,034 INFO org.apache.hadoop.hive.ql.exec.ExecDriver: Using org.apache.hadoop.hive.ql.io.CombineHiveInputFormat
2013-12-04 11:12:45,034 INFO org.apache.hadoop.hive.ql.exec.ExecDriver: adding libjars: file:///opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hive/lib/hive-builtins-0.10.0-cdh4.3.0.jar
2013-12-04 11:12:45,034 INFO org.apache.hadoop.hive.ql.exec.ExecDriver: Processing alias fmc_free_text
2013-12-04 11:12:45,034 INFO org.apache.hadoop.hive.ql.exec.ExecDriver: Adding input file hdfs://DEVHAD01.Devnet.corp:8020/user/hive/warehouse/fmc_free_text
2013-12-04 11:12:45,034 INFO org.apache.hadoop.hive.ql.exec.Utilities: Content Summary not cached for hdfs://DEVHAD01.Devnet.corp:8020/user/hive/warehouse/fmc_free_text
2013-12-04 11:12:45,152 INFO org.apache.hadoop.hive.ql.exec.ExecDriver: Making Temp Directory: hdfs://DEVHAD01.Devnet.corp:8020/tmp/hive-hive-hdfs/hive_2013-12-04_11-12-44_940_360291830025761971/-ext-10001
2013-12-04 11:12:46,160 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: DEVHAD04.Devnet.corp/10.10.50.113:8021. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
Before eventually failing with:
2013-12-04 11:12:55,177 ERROR org.apache.hadoop.hive.ql.exec.Task: Job Submission failed with exception 'java.net.ConnectException(Call From DEVHAD03.Devnet.corp/10.10.50.112 to DEVHAD04.Devnet.corp:8021 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused)'
Any thoughts are greatly appreciated.
Thanks much,
Joey
Re: Hive ODBC Error
Posted by Joseph D Antoni <jd...@yahoo.com>.
The out log is here...
Fri Aug 23 15:10:05 EDT 2013
using /usr/java/jdk1.6.0_31 as JAVA_HOME
using 4 as CDH_VERSION
using /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hive as HIVE_HOME
using /var/run/cloudera-scm-agent/process/276-hive-HIVESERVER2 as HIVE_CONF_DIR
using /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop as HADOOP_HOME
using /var/run/cloudera-scm-agent/process/276-hive-HIVESERVER2/hadoop-conf as HADOOP_CONF_DIR
Starting HiveServer2
Here's the full log from hive-server2.log
11:22:28.322 AM WARN org.apache.hadoop.hive.conf.HiveConf DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
11:22:28.325 AM INFO org.apache.hive.service.cli.CLIService SessionHandle [9f76e09d-7844-45a9-ac26-e2694522c9b1]: openSessionWithImpersonation()
11:22:28.329 AM INFO hive.ql.exec.HiveHistory Hive history file=/tmp/hive-hdfs/hive_job_log_9f76e09d-7844-45a9-ac26-e2694522c9b1_545663950.txt
11:22:28.382 AM WARN org.apache.hadoop.hive.conf.HiveConf DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
11:22:28.383 AM INFO org.apache.hive.service.cli.log.LogManager Operation log size: 131072
11:22:28.383 AM INFO org.apache.hadoop.hive.ql.Driver <PERFLOG method=compile>
11:22:28.383 AM INFO hive.ql.parse.ParseDriver Parsing command: use default
11:22:28.383 AM INFO hive.ql.parse.ParseDriver Parse Completed
11:22:28.384 AM INFO org.apache.hadoop.hive.ql.Driver Semantic Analysis Completed
11:22:28.384 AM INFO org.apache.hadoop.hive.ql.Driver Returning Hive schema: Schema(fieldSchemas:null, properties:null)
11:22:28.384 AM INFO org.apache.hadoop.hive.ql.Driver </PERFLOG method=compile start=1386174148383 end=1386174148384 duration=1>
11:22:28.384 AM INFO org.apache.hadoop.hive.ql.Driver <PERFLOG method=Driver.run>
11:22:28.384 AM INFO org.apache.hadoop.hive.ql.Driver <PERFLOG method=TimeToSubmit>
11:22:28.385 AM INFO org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=DEVHAD04.Devnet.corp:2181 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@4a9b5b89
11:22:28.386 AM INFO org.apache.zookeeper.ClientCnxn Opening socket connection to server DEVHAD04.Devnet.corp/10.10.50.113:2181. Will not attempt to authenticate using SASL (Unable to locate a login configuration)
11:22:28.386 AM INFO org.apache.zookeeper.ClientCnxn Socket connection established to DEVHAD04.Devnet.corp/10.10.50.113:2181, initiating session
11:22:28.390 AM INFO org.apache.zookeeper.ClientCnxn Session establishment complete on server DEVHAD04.Devnet.corp/10.10.50.113:2181, sessionid = 0x242be31d4c9006b, negotiated timeout = 60000
11:22:28.392 AM INFO org.apache.hadoop.hive.ql.Driver <PERFLOG method=acquireReadWriteLocks>
11:22:28.392 AM INFO org.apache.hadoop.hive.ql.Driver </PERFLOG method=acquireReadWriteLocks start=1386174148392 end=1386174148392 duration=0>
11:22:28.392 AM INFO org.apache.hadoop.hive.ql.Driver <PERFLOG method=Driver.execute>
11:22:28.392 AM INFO org.apache.hadoop.hive.ql.Driver Starting command: use default
11:22:28.393 AM INFO org.apache.hadoop.hive.ql.Driver </PERFLOG method=TimeToSubmit start=1386174148384 end=1386174148392 duration=8>
11:22:28.405 AM INFO org.apache.hadoop.hive.ql.Driver </PERFLOG method=Driver.execute start=1386174148392 end=1386174148405 duration=13>
11:22:28.405 AM INFO org.apache.hadoop.hive.ql.Driver OK
11:22:28.405 AM INFO org.apache.hadoop.hive.ql.Driver <PERFLOG method=releaseLocks>
11:22:28.405 AM INFO org.apache.hadoop.hive.ql.Driver </PERFLOG method=releaseLocks start=1386174148405 end=1386174148405 duration=0>
11:22:28.406 AM INFO org.apache.hadoop.hive.ql.Driver </PERFLOG method=Driver.run start=1386174148384 end=1386174148406 duration=22>
11:22:28.406 AM INFO org.apache.hive.service.cli.CLIService SessionHandle [9f76e09d-7844-45a9-ac26-e2694522c9b1]: executeStatement()
11:22:28.406 AM INFO org.apache.hive.service.cli.CLIService OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=46dcd9fd-acf4-41a4-8402-65000b786d20]: getOperationStatus()
11:22:28.452 AM WARN org.apache.hadoop.hive.conf.HiveConf DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
11:22:28.452 AM INFO org.apache.hadoop.hive.ql.Driver <PERFLOG method=releaseLocks>
11:22:28.452 AM INFO org.apache.hadoop.hive.ql.Driver </PERFLOG method=releaseLocks start=1386174148452 end=1386174148452 duration=0>
11:22:28.455 AM INFO org.apache.zookeeper.ZooKeeper Session: 0x242be31d4c9006b closed
11:22:28.455 AM INFO org.apache.zookeeper.ClientCnxn EventThread shut down
11:22:28.456 AM INFO org.apache.hive.service.cli.CLIService OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=46dcd9fd-acf4-41a4-8402-65000b786d20]: closeOperation
11:22:28.503 AM WARN org.apache.hadoop.hive.conf.HiveConf DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
11:22:28.504 AM INFO org.apache.hive.service.cli.log.LogManager Operation log size: 131072
11:22:28.504 AM INFO org.apache.hadoop.hive.ql.Driver <PERFLOG method=compile>
11:22:28.504 AM INFO hive.ql.parse.ParseDriver Parsing command: SELECT 1 AS `number_of_records`,
`fmc_free_text`.`msgtext` AS `msgtext`
FROM `default`.`fmc_free_text` `fmc_free_text`
LIMIT 10000
11:22:28.505 AM INFO hive.ql.parse.ParseDriver Parse Completed
11:22:28.506 AM INFO org.apache.hadoop.hive.ql.parse.SemanticAnalyzer Starting Semantic Analysis
11:22:28.506 AM INFO org.apache.hadoop.hive.ql.parse.SemanticAnalyzer Completed phase 1 of Semantic Analysis
11:22:28.506 AM INFO org.apache.hadoop.hive.ql.parse.SemanticAnalyzer Get metadata for source tables
11:22:28.535 AM INFO org.apache.hadoop.hive.ql.parse.SemanticAnalyzer Get metadata for subqueries
11:22:28.536 AM INFO org.apache.hadoop.hive.ql.parse.SemanticAnalyzer Get metadata for destination tables
11:22:28.548 AM INFO org.apache.hadoop.hive.ql.parse.SemanticAnalyzer Completed getting MetaData in Semantic Analysis
11:22:28.551 AM INFO org.apache.hadoop.hive.ql.ppd.OpProcFactory Processing for FS(1936)
11:22:28.551 AM INFO org.apache.hadoop.hive.ql.ppd.OpProcFactory Processing for LIM(1935)
11:22:28.551 AM INFO org.apache.hadoop.hive.ql.ppd.OpProcFactory Processing for SEL(1934)
11:22:28.551 AM INFO org.apache.hadoop.hive.ql.ppd.OpProcFactory Processing for TS(1933)
11:22:28.553 AM INFO org.apache.hadoop.hive.ql.optimizer.physical.MetadataOnlyOptimizer Looking for table scans where optimization is applicable
11:22:28.553 AM INFO org.apache.hadoop.hive.ql.optimizer.physical.MetadataOnlyOptimizer Found 0 metadata only table scans
11:22:28.553 AM INFO org.apache.hadoop.hive.ql.parse.SemanticAnalyzer Completed plan generation
11:22:28.553 AM INFO org.apache.hadoop.hive.ql.Driver Semantic Analysis Completed
11:22:28.555 AM INFO org.apache.hadoop.hive.ql.exec.ListSinkOperator Initializing Self 1937 OP
11:22:28.555 AM INFO org.apache.hadoop.hive.ql.exec.ListSinkOperator Operator 1937 OP initialized
11:22:28.555 AM INFO org.apache.hadoop.hive.ql.exec.ListSinkOperator Initialization Done 1937 OP
11:22:28.555 AM INFO org.apache.hadoop.hive.ql.Driver Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:number_of_records, type:int, comment:null), FieldSchema(name:msgtext, type:string, comment:null)], properties:null)
11:22:28.555 AM INFO org.apache.hadoop.hive.ql.Driver </PERFLOG method=compile start=1386174148504 end=1386174148555 duration=51>
11:22:28.555 AM INFO org.apache.hadoop.hive.ql.Driver <PERFLOG method=Driver.run>
11:22:28.555 AM INFO org.apache.hadoop.hive.ql.Driver <PERFLOG method=TimeToSubmit>
11:22:28.556 AM INFO org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=DEVHAD04.Devnet.corp:2181 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@3007de3c
11:22:28.557 AM INFO org.apache.zookeeper.ClientCnxn Opening socket connection to server DEVHAD04.Devnet.corp/10.10.50.113:2181. Will not attempt to authenticate using SASL (Unable to locate a login configuration)
11:22:28.558 AM INFO org.apache.zookeeper.ClientCnxn Socket connection established to DEVHAD04.Devnet.corp/10.10.50.113:2181, initiating session
11:22:28.561 AM INFO org.apache.zookeeper.ClientCnxn Session establishment complete on server DEVHAD04.Devnet.corp/10.10.50.113:2181, sessionid = 0x242be31d4c9006c, negotiated timeout = 60000
11:22:28.562 AM INFO org.apache.hadoop.hive.ql.Driver <PERFLOG method=acquireReadWriteLocks>
11:22:28.579 AM INFO org.apache.hadoop.hive.ql.Driver </PERFLOG method=acquireReadWriteLocks start=1386174148562 end=1386174148579 duration=17>
11:22:28.580 AM INFO org.apache.hadoop.hive.ql.Driver <PERFLOG method=Driver.execute>
11:22:28.580 AM INFO org.apache.hadoop.hive.ql.Driver Starting command: SELECT 1 AS `number_of_records`,
`fmc_free_text`.`msgtext` AS `msgtext`
FROM `default`.`fmc_free_text` `fmc_free_text`
LIMIT 10000
11:22:28.581 AM INFO org.apache.hadoop.hive.ql.Driver Total MapReduce jobs = 1
11:22:28.581 AM INFO org.apache.hadoop.hive.ql.Driver </PERFLOG method=TimeToSubmit start=1386174148555 end=1386174148581 duration=26>
11:22:28.581 AM INFO org.apache.hadoop.hive.ql.Driver Launching Job 1 out of 1
11:22:28.583 AM INFO org.apache.hadoop.hive.ql.exec.Task Number of reduce tasks is set to 0 since there's no reduce operator
11:22:28.589 AM INFO org.apache.hadoop.hive.ql.exec.ExecDriver Using org.apache.hadoop.hive.ql.io.CombineHiveInputFormat
11:22:28.589 AM INFO org.apache.hadoop.hive.ql.exec.ExecDriver adding libjars: file:///opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hive/lib/hive-builtins-0.10.0-cdh4.3.0.jar
11:22:28.589 AM INFO org.apache.hadoop.hive.ql.exec.ExecDriver Processing alias fmc_free_text
11:22:28.589 AM INFO org.apache.hadoop.hive.ql.exec.ExecDriver Adding input file hdfs://DEVHAD01.Devnet.corp:8020/user/hive/warehouse/fmc_free_text
11:22:28.589 AM INFO org.apache.hadoop.hive.ql.exec.Utilities Content Summary not cached for hdfs://DEVHAD01.Devnet.corp:8020/user/hive/warehouse/fmc_free_text
11:22:28.695 AM INFO org.apache.hadoop.hive.ql.exec.ExecDriver Making Temp Directory: hdfs://DEVHAD01.Devnet.corp:8020/tmp/hive-hive-hdfs/hive_2013-12-04_11-22-28_504_5747879933531730191/-ext-10001
11:22:29.702 AM INFO org.apache.hadoop.ipc.Client Retrying connect to server: DEVHAD04.Devnet.corp/10.10.50.113:8021. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
11:22:30.704 AM INFO org.apache.hadoop.ipc.Client Retrying connect to server: DEVHAD04.Devnet.corp/10.10.50.113:8021. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
11:22:31.705 AM INFO org.apache.hadoop.ipc.Client Retrying connect to server: DEVHAD04.Devnet.corp/10.10.50.113:8021. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
11:22:32.706 AM INFO org.apache.hadoop.ipc.Client Retrying connect to server: DEVHAD04.Devnet.corp/10.10.50.113:8021. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
11:22:33.707 AM INFO org.apache.hadoop.ipc.Client Retrying connect to server: DEVHAD04.Devnet.corp/10.10.50.113:8021. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
11:22:34.709 AM INFO org.apache.hadoop.ipc.Client Retrying connect to server: DEVHAD04.Devnet.corp/10.10.50.113:8021. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
11:22:35.710 AM INFO org.apache.hadoop.ipc.Client Retrying connect to server: DEVHAD04.Devnet.corp/10.10.50.113:8021. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
11:22:36.711 AM INFO org.apache.hadoop.ipc.Client Retrying connect to server: DEVHAD04.Devnet.corp/10.10.50.113:8021. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
11:22:37.713 AM INFO org.apache.hadoop.ipc.Client Retrying connect to server: DEVHAD04.Devnet.corp/10.10.50.113:8021. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
11:22:38.714 AM INFO org.apache.hadoop.ipc.Client Retrying connect to server: DEVHAD04.Devnet.corp/10.10.50.113:8021. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
11:22:38.716 AM ERROR org.apache.hadoop.security.UserGroupInformation PriviledgedActionException as:hdfs (auth:SIMPLE) cause:java.net.ConnectException: Call From DEVHAD03.Devnet.corp/10.10.50.112 to DEVHAD04.Devnet.corp:8021 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
11:22:38.718 AM ERROR org.apache.hadoop.hive.ql.exec.Task Job Submission failed with exception 'java.net.ConnectException(Call From DEVHAD03.Devnet.corp/10.10.50.112 to DEVHAD04.Devnet.corp:8021 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused)'
java.net.ConnectException: Call From DEVHAD03.Devnet.corp/10.10.50.112 to DEVHAD04.Devnet.corp:8021 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at sun.reflect.GeneratedConstructorAccessor89.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:782)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:729)
at org.apache.hadoop.ipc.Client.call(Client.java:1229)
at org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:225)
at org.apache.hadoop.mapred.$Proxy15.getStagingAreaDir(Unknown Source)
at org.apache.hadoop.mapred.JobClient.getStagingAreaDir(JobClient.java:1324)
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:102)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:951)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:945)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:945)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:919)
at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:448)
at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:138)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:138)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1374)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1160)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:973)
at org.apache.hive.service.cli.operation.SQLOperation.run(SQLOperation.java:116)
at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatement(HiveSessionImpl.java:194)
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:62)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:552)
at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:57)
at $Proxy9.executeStatement(Unknown Source)
at org.apache.hive.service.cli.CLIService.executeStatement(CLIService.java:154)
at org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:190)
at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1193)
at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1178)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at org.apache.hive.service.cli.thrift.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:38)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:207)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:528)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:492)
at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:499)
at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:593)
at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:241)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1278)
at org.apache.hadoop.ipc.Client.call(Client.java:1196)
... 41 more
11:22:38.731 AM ERROR org.apache.hadoop.hive.ql.Driver FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
11:22:38.732 AM INFO org.apache.hadoop.hive.ql.Driver </PERFLOG method=Driver.execute start=1386174148580 end=1386174158732 duration=10152>
11:22:38.732 AM INFO org.apache.hadoop.hive.ql.Driver <PERFLOG method=releaseLocks>
11:22:38.746 AM INFO org.apache.hadoop.hive.ql.Driver </PERFLOG method=releaseLocks start=1386174158732 end=1386174158746 duration=14>
11:22:38.746 AM ERROR org.apache.hadoop.security.UserGroupInformation PriviledgedActionException as:hdfs (auth:SIMPLE) cause:org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
11:22:38.801 AM WARN org.apache.hadoop.hive.conf.HiveConf DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
11:22:38.860 AM WARN org.apache.hadoop.hive.conf.HiveConf DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
11:22:38.861 AM INFO org.apache.hive.service.cli.CLIService SessionHandle [9f76e09d-7844-45a9-ac26-e2694522c9b1]: closeSession()
On Wednesday, December 4, 2013 2:14 PM, Brad Ruderman <br...@radiumone.com> wrote:
I have had much better luck with the Cloudera driver, especially since you are using the cloudera dist.
Can you send the logs from /var/log/hive/hive-server2.out and hive-server2.log?
Thanks!
On Wed, Dec 4, 2013 at 8:26 AM, Joseph D Antoni <jd...@yahoo.com> wrote:
To all,
>
>
>I'm trying to connect Tableau to Hive (0.10.0) running Hiveserver2. The connection works ok, until I go to pull in the data. The resulting M/R job is attempting to connect to port 8021 on one of my data nodes--I've tried both Cloudera and Hortonworks ODBC in an effort to rule that out, and the query works fine running local to the cluster.
>
>
>The Hive log is as follows:
>
>
>2013-12-04 11:12:45,026 INFO org.apache.hadoop.hive.ql.Driver: Starting command: SELECT `fmc_free_text`.`msgtext` AS `msgtext`
>FROM `default`.`fmc_free_text` `fmc_free_text`
>2013-12-04 11:12:45,027 INFO org.apache.hadoop.hive.ql.Driver: Total MapReduce jobs = 1
>2013-12-04 11:12:45,027 INFO org.apache.hadoop.hive.ql.Driver: </PERFLOG method=TimeToSubmit start=1386173564991 end=1386173565027 duration=36>
>2013-12-04 11:12:45,027 INFO org.apache.hadoop.hive.ql.Driver: Launching Job 1 out of 1
>2013-12-04 11:12:45,029 INFO org.apache.hadoop.hive.ql.exec.Task: Number of reduce tasks is set to 0 since there's no reduce operator
>2013-12-04 11:12:45,034 INFO org.apache.hadoop.hive.ql.exec.ExecDriver: Using org.apache.hadoop.hive.ql.io.CombineHiveInputFormat
>2013-12-04 11:12:45,034 INFO org.apache.hadoop.hive.ql.exec.ExecDriver: adding libjars: file:///opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hive/lib/hive-builtins-0.10.0-cdh4.3.0.jar
>2013-12-04 11:12:45,034 INFO org.apache.hadoop.hive.ql.exec.ExecDriver: Processing alias fmc_free_text
>2013-12-04 11:12:45,034 INFO org.apache.hadoop.hive.ql.exec.ExecDriver: Adding input file hdfs://DEVHAD01.Devnet.corp:8020/user/hive/warehouse/fmc_free_text
>2013-12-04 11:12:45,034 INFO org.apache.hadoop.hive.ql.exec.Utilities: Content Summary not cached for hdfs://DEVHAD01.Devnet.corp:8020/user/hive/warehouse/fmc_free_text
>2013-12-04 11:12:45,152 INFO org.apache.hadoop.hive.ql.exec.ExecDriver: Making Temp Directory: hdfs://DEVHAD01.Devnet.corp:8020/tmp/hive-hive-hdfs/hive_2013-12-04_11-12-44_940_360291830025761971/-ext-10001
>2013-12-04 11:12:46,160 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: DEVHAD04.Devnet.corp/10.10.50.113:8021. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
>
>
>Before eventually failing with:
>
>
>2013-12-04 11:12:55,177 ERROR org.apache.hadoop.hive.ql.exec.Task: Job Submission failed with exception 'java.net.ConnectException(Call From DEVHAD03.Devnet.corp/10.10.50.112 to DEVHAD04.Devnet.corp:8021 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused)'
>
>
>Any thoughts are greatly appreciated.
>
>
>Thanks much,
>
>
>Joey
>
>
>
>
>
>
Re: Hive ODBC Error
Posted by Brad Ruderman <br...@radiumone.com>.
I have had much better luck with the Cloudera driver, especially since you
are using the cloudera dist.
Can you send the logs from /var/log/hive/hive-server2.out and
hive-server2.log?
Thanks!
On Wed, Dec 4, 2013 at 8:26 AM, Joseph D Antoni <jd...@yahoo.com> wrote:
> To all,
>
> I'm trying to connect Tableau to Hive (0.10.0) running Hiveserver2. The
> connection works ok, until I go to pull in the data. The resulting M/R job
> is attempting to connect to port 8021 on one of my data nodes--I've tried
> both Cloudera and Hortonworks ODBC in an effort to rule that out, and the
> query works fine running local to the cluster.
>
> The Hive log is as follows:
>
> 2013-12-04 11:12:45,026 INFO org.apache.hadoop.hive.ql.Driver: Starting
> command: SELECT `fmc_free_text`.`msgtext` AS `msgtext`
> FROM `default`.`fmc_free_text` `fmc_free_text`
> 2013-12-04 11:12:45,027 INFO org.apache.hadoop.hive.ql.Driver: Total
> MapReduce jobs = 1
> 2013-12-04 11:12:45,027 INFO org.apache.hadoop.hive.ql.Driver: </PERFLOG
> method=TimeToSubmit start=1386173564991 end=1386173565027 duration=36>
> 2013-12-04 11:12:45,027 INFO org.apache.hadoop.hive.ql.Driver: Launching
> Job 1 out of 1
> 2013-12-04 11:12:45,029 INFO org.apache.hadoop.hive.ql.exec.Task: Number
> of reduce tasks is set to 0 since there's no reduce operator
> 2013-12-04 11:12:45,034 INFO org.apache.hadoop.hive.ql.exec.ExecDriver:
> Using org.apache.hadoop.hive.ql.io.CombineHiveInputFormat
> 2013-12-04 11:12:45,034 INFO org.apache.hadoop.hive.ql.exec.ExecDriver:
> adding libjars:
> file:///opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hive/lib/hive-builtins-0.10.0-cdh4.3.0.jar
> 2013-12-04 11:12:45,034 INFO org.apache.hadoop.hive.ql.exec.ExecDriver:
> Processing alias fmc_free_text
> 2013-12-04 11:12:45,034 INFO org.apache.hadoop.hive.ql.exec.ExecDriver:
> Adding input file
> hdfs://DEVHAD01.Devnet.corp:8020/user/hive/warehouse/fmc_free_text
> 2013-12-04 11:12:45,034 INFO org.apache.hadoop.hive.ql.exec.Utilities:
> Content Summary not cached for
> hdfs://DEVHAD01.Devnet.corp:8020/user/hive/warehouse/fmc_free_text
> 2013-12-04 11:12:45,152 INFO org.apache.hadoop.hive.ql.exec.ExecDriver:
> Making Temp Directory:
> hdfs://DEVHAD01.Devnet.corp:8020/tmp/hive-hive-hdfs/hive_2013-12-04_11-12-44_940_360291830025761971/-ext-10001
> 2013-12-04 11:12:46,160 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: DEVHAD04.Devnet.corp/10.10.50.113:8021. Already tried
> 0 time(s); retry policy is
> RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
>
> Before eventually failing with:
>
> 2013-12-04 11:12:55,177 ERROR org.apache.hadoop.hive.ql.exec.Task: Job
> Submission failed with exception 'java.net.ConnectException(Call From
> DEVHAD03.Devnet.corp/10.10.50.112 to DEVHAD04.Devnet.corp:8021 failed on
> connection exception: java.net.ConnectException: Connection refused; For
> more details see: http://wiki.apache.org/hadoop/ConnectionRefused)'
>
> Any thoughts are greatly appreciated.
>
> Thanks much,
>
> Joey
>
>
>
>