You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Brock Noland (JIRA)" <ji...@apache.org> on 2014/11/17 20:32:34 UTC
[jira] [Issue Comment Deleted] (HIVE-8882) Fix test
TestHiveKVResultCache [Spark Branch]
[ https://issues.apache.org/jira/browse/HIVE-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brock Noland updated HIVE-8882:
-------------------------------
Comment: was deleted
(was:
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12681841/HIVE-8882.1-spark.patch
Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/373/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/373/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-373/
Messages:
{noformat}
**** This message was trimmed, see log for full details ****
[INFO] CP: /data/hive-ptest/working/maven/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar
[INFO] CP: /data/hive-ptest/working/maven/org/tukaani/xz/1.0/xz-1.0.jar
[INFO] CP: /data/hive-ptest/working/maven/org/apache/hadoop/hadoop-mapreduce-client-core/2.5.0/hadoop-mapreduce-client-core-2.5.0.jar
[INFO] CP: /data/hive-ptest/working/maven/org/apache/hadoop/hadoop-yarn-common/2.5.0/hadoop-yarn-common-2.5.0.jar
[INFO] CP: /data/hive-ptest/working/maven/org/apache/hadoop/hadoop-yarn-api/2.5.0/hadoop-yarn-api-2.5.0.jar
[INFO] CP: /data/hive-ptest/working/maven/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar
[INFO] CP: /data/hive-ptest/working/maven/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar
[INFO] CP: /data/hive-ptest/working/maven/javax/activation/activation/1.1/activation-1.1.jar
[INFO] CP: /data/hive-ptest/working/maven/com/google/inject/guice/3.0/guice-3.0.jar
[INFO] CP: /data/hive-ptest/working/maven/javax/inject/javax.inject/1/javax.inject-1.jar
[INFO] CP: /data/hive-ptest/working/maven/aopalliance/aopalliance/1.0/aopalliance-1.0.jar
[INFO] CP: /data/hive-ptest/working/maven/com/sun/jersey/contribs/jersey-guice/1.9/jersey-guice-1.9.jar
[INFO] CP: /data/hive-ptest/working/maven/com/google/inject/extensions/guice-servlet/3.0/guice-servlet-3.0.jar
[INFO] CP: /data/hive-ptest/working/maven/io/netty/netty/3.7.0.Final/netty-3.7.0.Final.jar
[INFO] CP: /data/hive-ptest/working/maven/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.jar
[INFO] CP: /data/hive-ptest/working/maven/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar
DataNucleus Enhancer (version 3.2.10) for API "JDO" using JRE "1.7"
DataNucleus Enhancer : Classpath
>> /usr/local/apache-maven-3.0.5/boot/plexus-classworlds-2.4.jar
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MDatabase
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MFieldSchema
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MType
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MTable
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MSerDeInfo
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MOrder
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MColumnDescriptor
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MStringList
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MStorageDescriptor
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MPartition
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MIndex
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MRole
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MRoleMap
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MGlobalPrivilege
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MDBPrivilege
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MTablePrivilege
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MPartitionPrivilege
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MTableColumnPrivilege
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MPartitionColumnPrivilege
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MPartitionEvent
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MMasterKey
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MDelegationToken
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MTableColumnStatistics
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MPartitionColumnStatistics
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MVersionTable
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MResourceUri
ENHANCED (PersistenceCapable) : org.apache.hadoop.hive.metastore.model.MFunction
DataNucleus Enhancer completed with success for 27 classes. Timings : input=170 ms, enhance=260 ms, total=430 ms. Consult the log for full details
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hive-metastore ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-spark-source/metastore/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-metastore ---
[INFO] Executing tasks
main:
[mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/metastore/target/tmp
[mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/metastore/target/warehouse
[mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/metastore/target/tmp/conf
[copy] Copying 9 files to /data/hive-ptest/working/apache-svn-spark-source/metastore/target/tmp/conf
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-metastore ---
[INFO] Compiling 15 source files to /data/hive-ptest/working/apache-svn-spark-source/metastore/target/test-classes
[WARNING] /data/hive-ptest/working/apache-svn-spark-source/metastore/src/test/org/apache/hadoop/hive/metastore/txn/TestTxnHandler.java: Some input files use or override a deprecated API.
[WARNING] /data/hive-ptest/working/apache-svn-spark-source/metastore/src/test/org/apache/hadoop/hive/metastore/txn/TestTxnHandler.java: Recompile with -Xlint:deprecation for details.
[INFO]
[INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-metastore ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-metastore ---
[INFO] Building jar: /data/hive-ptest/working/apache-svn-spark-source/metastore/target/hive-metastore-0.15.0-SNAPSHOT.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-metastore ---
[INFO]
[INFO] --- maven-jar-plugin:2.2:test-jar (default) @ hive-metastore ---
[INFO] Building jar: /data/hive-ptest/working/apache-svn-spark-source/metastore/target/hive-metastore-0.15.0-SNAPSHOT-tests.jar
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-metastore ---
[INFO] Installing /data/hive-ptest/working/apache-svn-spark-source/metastore/target/hive-metastore-0.15.0-SNAPSHOT.jar to /data/hive-ptest/working/maven/org/apache/hive/hive-metastore/0.15.0-SNAPSHOT/hive-metastore-0.15.0-SNAPSHOT.jar
[INFO] Installing /data/hive-ptest/working/apache-svn-spark-source/metastore/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-metastore/0.15.0-SNAPSHOT/hive-metastore-0.15.0-SNAPSHOT.pom
[INFO] Installing /data/hive-ptest/working/apache-svn-spark-source/metastore/target/hive-metastore-0.15.0-SNAPSHOT-tests.jar to /data/hive-ptest/working/maven/org/apache/hive/hive-metastore/0.15.0-SNAPSHOT/hive-metastore-0.15.0-SNAPSHOT-tests.jar
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Hive Ant Utilities 0.15.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-ant ---
[INFO] Deleting /data/hive-ptest/working/apache-svn-spark-source/ant (includes = [datanucleus.log, derby.log], excludes = [])
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-ant ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hive-ant ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-spark-source/ant/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-ant ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-ant ---
[INFO] Compiling 5 source files to /data/hive-ptest/working/apache-svn-spark-source/ant/target/classes
[WARNING] /data/hive-ptest/working/apache-svn-spark-source/ant/src/org/apache/hadoop/hive/ant/QTestGenTask.java: /data/hive-ptest/working/apache-svn-spark-source/ant/src/org/apache/hadoop/hive/ant/QTestGenTask.java uses or overrides a deprecated API.
[WARNING] /data/hive-ptest/working/apache-svn-spark-source/ant/src/org/apache/hadoop/hive/ant/QTestGenTask.java: Recompile with -Xlint:deprecation for details.
[WARNING] /data/hive-ptest/working/apache-svn-spark-source/ant/src/org/apache/hadoop/hive/ant/DistinctElementsClassPath.java: /data/hive-ptest/working/apache-svn-spark-source/ant/src/org/apache/hadoop/hive/ant/DistinctElementsClassPath.java uses unchecked or unsafe operations.
[WARNING] /data/hive-ptest/working/apache-svn-spark-source/ant/src/org/apache/hadoop/hive/ant/DistinctElementsClassPath.java: Recompile with -Xlint:unchecked for details.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hive-ant ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-spark-source/ant/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-ant ---
[INFO] Executing tasks
main:
[mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/ant/target/tmp
[mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/ant/target/warehouse
[mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/ant/target/tmp/conf
[copy] Copying 9 files to /data/hive-ptest/working/apache-svn-spark-source/ant/target/tmp/conf
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-ant ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-ant ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-ant ---
[INFO] Building jar: /data/hive-ptest/working/apache-svn-spark-source/ant/target/hive-ant-0.15.0-SNAPSHOT.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-ant ---
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-ant ---
[INFO] Installing /data/hive-ptest/working/apache-svn-spark-source/ant/target/hive-ant-0.15.0-SNAPSHOT.jar to /data/hive-ptest/working/maven/org/apache/hive/hive-ant/0.15.0-SNAPSHOT/hive-ant-0.15.0-SNAPSHOT.jar
[INFO] Installing /data/hive-ptest/working/apache-svn-spark-source/ant/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-ant/0.15.0-SNAPSHOT/hive-ant-0.15.0-SNAPSHOT.pom
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Hive Query Language 0.15.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[WARNING] The POM for org.apache.calcite:calcite-core:jar:0.9.2-incubating-SNAPSHOT is missing, no dependency information available
[WARNING] The POM for org.apache.calcite:calcite-avatica:jar:0.9.2-incubating-SNAPSHOT is missing, no dependency information available
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Hive .............................................. SUCCESS [2.808s]
[INFO] Hive Shims Common ................................. SUCCESS [2.241s]
[INFO] Hive Shims 0.20 ................................... SUCCESS [0.948s]
[INFO] Hive Shims Secure Common .......................... SUCCESS [1.447s]
[INFO] Hive Shims 0.20S .................................. SUCCESS [0.802s]
[INFO] Hive Shims 0.23 ................................... SUCCESS [2.010s]
[INFO] Hive Shims Scheduler .............................. SUCCESS [0.709s]
[INFO] Hive Shims ........................................ SUCCESS [0.701s]
[INFO] Hive Common ....................................... SUCCESS [3.379s]
[INFO] Hive Serde ........................................ SUCCESS [4.524s]
[INFO] Hive Metastore .................................... SUCCESS [11.948s]
[INFO] Hive Ant Utilities ................................ SUCCESS [0.533s]
[INFO] Hive Query Language ............................... FAILURE [2.176s]
[INFO] Hive Service ...................................... SKIPPED
[INFO] Hive Accumulo Handler ............................. SKIPPED
[INFO] Hive JDBC ......................................... SKIPPED
[INFO] Hive Beeline ...................................... SKIPPED
[INFO] Hive CLI .......................................... SKIPPED
[INFO] Hive Contrib ...................................... SKIPPED
[INFO] Hive HBase Handler ................................ SKIPPED
[INFO] Hive HCatalog ..................................... SKIPPED
[INFO] Hive HCatalog Core ................................ SKIPPED
[INFO] Hive HCatalog Pig Adapter ......................... SKIPPED
[INFO] Hive HCatalog Server Extensions ................... SKIPPED
[INFO] Hive HCatalog Webhcat Java Client ................. SKIPPED
[INFO] Hive HCatalog Webhcat ............................. SKIPPED
[INFO] Hive HCatalog Streaming ........................... SKIPPED
[INFO] Hive HWI .......................................... SKIPPED
[INFO] Hive ODBC ......................................... SKIPPED
[INFO] Hive Shims Aggregator ............................. SKIPPED
[INFO] Spark Remote Client ............................... SKIPPED
[INFO] Hive TestUtils .................................... SKIPPED
[INFO] Hive Packaging .................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 35.174s
[INFO] Finished at: Mon Nov 17 00:30:02 EST 2014
[INFO] Final Memory: 74M/822M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project hive-exec: Could not resolve dependencies for project org.apache.hive:hive-exec:jar:0.15.0-SNAPSHOT: The following artifacts could not be resolved: org.apache.calcite:calcite-core:jar:0.9.2-incubating-SNAPSHOT, org.apache.calcite:calcite-avatica:jar:0.9.2-incubating-SNAPSHOT: Failure to find org.apache.calcite:calcite-core:jar:0.9.2-incubating-SNAPSHOT in http://ec2-50-18-79-139.us-west-1.compute.amazonaws.com/data/spark_2.10-1.2-SNAPSHOT/ was cached in the local repository, resolution will not be reattempted until the update interval of spark-snapshot has elapsed or updates are forced -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hive-exec
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12681841 - PreCommit-HIVE-SPARK-Build)
> Fix test TestHiveKVResultCache [Spark Branch]
> ---------------------------------------------
>
> Key: HIVE-8882
> URL: https://issues.apache.org/jira/browse/HIVE-8882
> Project: Hive
> Issue Type: Sub-task
> Components: Tests
> Affects Versions: spark-branch
> Reporter: Szehon Ho
> Assignee: Jimmy Xiang
> Priority: Minor
> Attachments: HIVE-8882.1-spark.patch, HIVE-8882.1-spark.patch
>
>
> TestHiveKVResultCache is broken with latest builds:
> {noformat}
> java.lang.NumberFormatException: For input string: "0&#0;&#0;&#0;"
> at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
> at java.lang.Long.parseLong(Long.java:441)
> at java.lang.Long.valueOf(Long.java:540)
> at org.apache.hadoop.hive.ql.exec.spark.TestHiveKVResultCache.scanAndVerify(TestHiveKVResultCache.java:127)
> at org.apache.hadoop.hive.ql.exec.spark.TestHiveKVResultCache.testResultList(TestHiveKVResultCache.java:106)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)