You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "wangfei (JIRA)" <ji...@apache.org> on 2014/08/19 18:33:18 UTC
[jira] [Commented] (SPARK-3125) hive thriftserver test suite
failure
[ https://issues.apache.org/jira/browse/SPARK-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14102424#comment-14102424 ]
wangfei commented on SPARK-3125:
--------------------------------
for clisuite i print the error info, as follows:
log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Logging initialized using configuration in jar:file:/home/wf/code/spark/assembly/target/scala-2.10/spark-assembly-1.1.0-SNAPSHOT-hadoop2.3.0.jar!/hive-log4j.properties
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
org.apache.spark.sql.execution.QueryExecutionException: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
at org.apache.spark.sql.hive.HiveContext.runHive(HiveContext.scala:301)
at org.apache.spark.sql.hive.HiveContext.runSqlHive(HiveContext.scala:271)
at org.apache.spark.sql.hive.execution.NativeCommand.sideEffectResult$lzycompute(NativeCommand.scala:35)
at org.apache.spark.sql.hive.execution.NativeCommand.sideEffectResult(NativeCommand.scala:35)
at org.apache.spark.sql.hive.execution.NativeCommand.execute(NativeCommand.scala:38)
at org.apache.spark.sql.hive.HiveContext$QueryExecution.toRdd$lzycompute(HiveContext.scala:359)
at org.apache.spark.sql.hive.HiveContext$QueryExecution.toRdd(HiveContext.scala:359)
at org.apache.spark.sql.SchemaRDDLike$class.$init$(SchemaRDDLike.scala:58)
at org.apache.spark.sql.SchemaRDD.<init>(SchemaRDD.scala:103)
at org.apache.spark.sql.hive.HiveContext.sql(HiveContext.scala:98)
at org.apache.spark.sql.hive.thriftserver.SparkSQLDriver.run(SparkSQLDriver.scala:58)
at org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver.processCmd(SparkSQLCLIDriver.scala:291)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)
at org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver$.main(SparkSQLCLIDriver.scala:226)
at org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver.main(SparkSQLCLIDriver.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:314)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:73)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> hive thriftserver test suite failure
> ------------------------------------
>
> Key: SPARK-3125
> URL: https://issues.apache.org/jira/browse/SPARK-3125
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.0.2
> Reporter: wangfei
>
> hive thriftserver test suite failure
> 1 CliSuite:
> [info] - simple commands *** FAILED ***
> [info] java.lang.AssertionError: assertion failed: Didn't find "OK" in the output:
> [info] at scala.Predef$.assert(Predef.scala:179)
> [info] at org.apache.spark.sql.hive.thriftserver.TestUtils$class.waitForQuery(TestUtils.scala:70)
> [info] at org.apache.spark.sql.hive.thriftserver.CliSuite.waitForQuery(CliSuite.scala:26)
> [info] at org.apache.spark.sql.hive.thriftserver.TestUtils$class.executeQuery(TestUtils.scala:62)
> [info] at org.apache.spark.sql.hive.thriftserver.CliSuite.executeQuery(CliSuite.scala:26)
> [info] at org.apache.spark.sql.hive.thriftserver.CliSuite$$anonfun$1.apply$mcV$sp(CliSuite.scala:54)
> [info] at org.apache.spark.sql.hive.thriftserver.CliSuite$$anonfun$1.apply(CliSuite.scala:52)
> [info] at org.apache.spark.sql.hive.thriftserver.CliSuite$$anonfun$1.apply(CliSuite.scala:52)
> [info] at org.scalatest.Transformer$$anonfun$apply$1.apply(Transformer.scala:22)
> [info] at org.scalatest.Transformer$$anonfun$apply$1.apply(Transformer.scala:22)
> [info] ...
> 2.HiveThriftServer2Suite
> - test query execution against a Hive Thrift server *** FAILED ***
> [info] java.sql.SQLException: Could not open connection to jdbc:hive2://localhost:41419/: java.net.ConnectException: Connection refused
> [info] at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:146)
> [info] at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:123)
> [info] at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
> [info] at java.sql.DriverManager.getConnection(DriverManager.java:571)
> [info] at java.sql.DriverManager.getConnection(DriverManager.java:215)
> [info] at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2Suite.getConnection(HiveThriftServer2Suite.scala:152)
> [info] at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2Suite.createStatement(HiveThriftServer2Suite.scala:155)
> [info] at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2Suite$$anonfun$1.apply$mcV$sp(HiveThriftServer2Suite.scala:113)
> [info] at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2Suite$$anonfun$1.apply(HiveThriftServer2Suite.scala:110)
> [info] at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2Suite$$anonfun$1.apply(HiveThriftServer2Suite.scala:110)
> [info] ...
> [info] Cause: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
> [info] at org.apache.thrift.transport.TSocket.open(TSocket.java:185)
> [info] at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:248)
> [info] at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
> [info] at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:144)
> [info] at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:123)
> [info] at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
> [info] at java.sql.DriverManager.getConnection(DriverManager.java:571)
> [info] at java.sql.DriverManager.getConnection(DriverManager.java:215)
> [info] at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2Suite.getConnection(HiveThriftServer2Suite.scala:152)
> [info] at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2Suite.createStatement(HiveThriftServer2Suite.scala:155)
> [info] ...
> [info] Cause: java.net.ConnectException: Connection refused
> [info] at java.net.PlainSocketImpl.socketConnect(Native Method)
> [info] at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> [info] at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> [info] at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> [info] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> [info] at java.net.Socket.connect(Socket.java:579)
> [info] at org.apache.thrift.transport.TSocket.open(TSocket.java:180)
> [info] at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:248)
> [info] at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
> [info] at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:144)
> [info] ...
> [info] - SPARK-3004 regression: result set containing NULL *** FAILED ***
> [info] java.sql.SQLException: Could not open connection to jdbc:hive2://localhost:41419/: java.net.ConnectException: Connection refused
> [info] at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:146)
> [info] at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:123)
> [info] at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
> [info] at java.sql.DriverManager.getConnection(DriverManager.java:571)
> [info] at java.sql.DriverManager.getConnection(DriverManager.java:215)
> [info] at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2Suite.getConnection(HiveThriftServer2Suite.scala:152)
> [info] at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2Suite.createStatement(HiveThriftServer2Suite.scala:155)
> [info] at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2Suite$$anonfun$2.apply$mcV$sp(HiveThriftServer2Suite.scala:135)
> [info] at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2Suite$$anonfun$2.apply(HiveThriftServer2Suite.scala:132)
> [info] at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2Suite$$anonfun$2.apply(HiveThriftServer2Suite.scala:132)
> [info] ...
> [info] Cause: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
> [info] at org.apache.thrift.transport.TSocket.open(TSocket.java:185)
> [info] at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:248)
> [info] at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
> [info] at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:144)
> [info] at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:123)
> [info] at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
> [info] at java.sql.DriverManager.getConnection(DriverManager.java:571)
> [info] at java.sql.DriverManager.getConnection(DriverManager.java:215)
> [info] at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2Suite.getConnection(HiveThriftServer2Suite.scala:152)
> [info] at org.apache.spark.sql.hive.thriftserver.HiveThriftServer2Suite.createStatement(HiveThriftServer2Suite.scala:155)
> [info] ...
> [info] Cause: java.net.ConnectException: Connection refused
> [info] at java.net.PlainSocketImpl.socketConnect(Native Method)
> [info] at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> [info] at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> [info] at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> [info] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> [info] at java.net.Socket.connect(Socket.java:579)
> [info] at org.apache.thrift.transport.TSocket.open(TSocket.java:180)
> [info] at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:248)
> [info] at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
> [info] at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:144)
> [info] ...
> [info] ScalaTest
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org