You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Hive QA (JIRA)" <ji...@apache.org> on 2013/12/17 22:24:08 UTC
[jira] [Commented] (HIVE-6044) webhcat should be able to return
detailed serde information when show table using "fromat=extended"
[ https://issues.apache.org/jira/browse/HIVE-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850932#comment-13850932 ]
Hive QA commented on HIVE-6044:
-------------------------------
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12619140/HIVE-6044.1.patch
Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/670/testReport
Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/670/console
Messages:
{noformat}
**** This message was trimmed, see log for full details ****
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Hive HCatalog Server Extensions 0.13.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-hcatalog-server-extensions ---
[INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/server-extensions (includes = [datanucleus.log, derby.log], excludes = [])
[INFO]
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ hive-hcatalog-server-extensions ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/server-extensions/src/main/resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-hcatalog-server-extensions ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-hcatalog-server-extensions ---
[INFO] Compiling 38 source files to /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/server-extensions/target/classes
[WARNING] Note: Some input files use or override a deprecated API.
[WARNING] Note: Recompile with -Xlint:deprecation for details.
[WARNING] Note: Some input files use unchecked or unsafe operations.
[WARNING] Note: Recompile with -Xlint:unchecked for details.
[INFO]
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ hive-hcatalog-server-extensions ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/server-extensions/src/test/resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-hcatalog-server-extensions ---
[INFO] Executing tasks
main:
[mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/server-extensions/target/tmp
[mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/server-extensions/target/warehouse
[mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/server-extensions/target/tmp/conf
[copy] Copying 4 files to /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/server-extensions/target/tmp/conf
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-hcatalog-server-extensions ---
[INFO] Compiling 4 source files to /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/server-extensions/target/test-classes
[WARNING] Note: Some input files use or override a deprecated API.
[WARNING] Note: Recompile with -Xlint:deprecation for details.
[INFO]
[INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-hcatalog-server-extensions ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-hcatalog-server-extensions ---
[INFO] Building jar: /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/server-extensions/target/hive-hcatalog-server-extensions-0.13.0-SNAPSHOT.jar
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-hcatalog-server-extensions ---
[INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/server-extensions/target/hive-hcatalog-server-extensions-0.13.0-SNAPSHOT.jar to /data/hive-ptest/working/maven/org/apache/hive/hcatalog/hive-hcatalog-server-extensions/0.13.0-SNAPSHOT/hive-hcatalog-server-extensions-0.13.0-SNAPSHOT.jar
[INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/server-extensions/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hcatalog/hive-hcatalog-server-extensions/0.13.0-SNAPSHOT/hive-hcatalog-server-extensions-0.13.0-SNAPSHOT.pom
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Hive HCatalog Webhcat Java Client 0.13.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-webhcat-java-client ---
[INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/java-client (includes = [datanucleus.log, derby.log], excludes = [])
[INFO]
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ hive-webhcat-java-client ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/java-client/src/main/resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-webhcat-java-client ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-webhcat-java-client ---
[INFO] Compiling 20 source files to /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/java-client/target/classes
[WARNING] Note: Some input files use or override a deprecated API.
[WARNING] Note: Recompile with -Xlint:deprecation for details.
[INFO]
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ hive-webhcat-java-client ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/java-client/src/test/resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-webhcat-java-client ---
[INFO] Executing tasks
main:
[mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/java-client/target/tmp
[mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/java-client/target/warehouse
[mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/java-client/target/tmp/conf
[copy] Copying 4 files to /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/java-client/target/tmp/conf
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-webhcat-java-client ---
[INFO] Compiling 2 source files to /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/java-client/target/test-classes
[WARNING] Note: Some input files use or override a deprecated API.
[WARNING] Note: Recompile with -Xlint:deprecation for details.
[INFO]
[INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-webhcat-java-client ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-webhcat-java-client ---
[INFO] Building jar: /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/java-client/target/hive-webhcat-java-client-0.13.0-SNAPSHOT.jar
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-webhcat-java-client ---
[INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/java-client/target/hive-webhcat-java-client-0.13.0-SNAPSHOT.jar to /data/hive-ptest/working/maven/org/apache/hive/hcatalog/hive-webhcat-java-client/0.13.0-SNAPSHOT/hive-webhcat-java-client-0.13.0-SNAPSHOT.jar
[INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/java-client/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hcatalog/hive-webhcat-java-client/0.13.0-SNAPSHOT/hive-webhcat-java-client-0.13.0-SNAPSHOT.pom
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Hive HCatalog Webhcat 0.13.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-webhcat ---
[INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/svr (includes = [datanucleus.log, derby.log], excludes = [])
[INFO]
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ hive-webhcat ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/svr/src/main/resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-webhcat ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-webhcat ---
[INFO] Compiling 65 source files to /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/svr/target/classes
[INFO] -------------------------------------------------------------
[WARNING] COMPILATION WARNING :
[INFO] -------------------------------------------------------------
[WARNING] Note: Some input files use unchecked or unsafe operations.
[WARNING] Note: Recompile with -Xlint:unchecked for details.
[INFO] 2 warnings
[INFO] -------------------------------------------------------------
[INFO] -------------------------------------------------------------
[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR] /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/HcatDelegator.java:[308,42] cannot find symbol
symbol : variable OK
location: class org.apache.hive.hcatalog.templeton.JsonBuilder
[INFO] 1 error
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Hive .............................................. SUCCESS [4.723s]
[INFO] Hive Ant Utilities ................................ SUCCESS [6.815s]
[INFO] Hive Shims Common ................................. SUCCESS [3.423s]
[INFO] Hive Shims 0.20 ................................... SUCCESS [2.257s]
[INFO] Hive Shims Secure Common .......................... SUCCESS [2.681s]
[INFO] Hive Shims 0.20S .................................. SUCCESS [1.404s]
[INFO] Hive Shims 0.23 ................................... SUCCESS [2.929s]
[INFO] Hive Shims ........................................ SUCCESS [3.682s]
[INFO] Hive Common ....................................... SUCCESS [5.276s]
[INFO] Hive Serde ........................................ SUCCESS [12.658s]
[INFO] Hive Metastore .................................... SUCCESS [26.898s]
[INFO] Hive Query Language ............................... SUCCESS [1:02.124s]
[INFO] Hive Service ...................................... SUCCESS [4.675s]
[INFO] Hive JDBC ......................................... SUCCESS [1.838s]
[INFO] Hive Beeline ...................................... SUCCESS [1.561s]
[INFO] Hive CLI .......................................... SUCCESS [1.306s]
[INFO] Hive Contrib ...................................... SUCCESS [0.715s]
[INFO] Hive HBase Handler ................................ SUCCESS [3.084s]
[INFO] Hive HCatalog ..................................... SUCCESS [0.447s]
[INFO] Hive HCatalog Core ................................ SUCCESS [3.312s]
[INFO] Hive HCatalog Pig Adapter ......................... SUCCESS [1.402s]
[INFO] Hive HCatalog Server Extensions ................... SUCCESS [0.760s]
[INFO] Hive HCatalog Webhcat Java Client ................. SUCCESS [1.391s]
[INFO] Hive HCatalog Webhcat ............................. FAILURE [0.914s]
[INFO] Hive HCatalog HBase Storage Handler ............... SKIPPED
[INFO] Hive HWI .......................................... SKIPPED
[INFO] Hive ODBC ......................................... SKIPPED
[INFO] Hive Shims Aggregator ............................. SKIPPED
[INFO] Hive TestUtils .................................... SKIPPED
[INFO] Hive Packaging .................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:39.173s
[INFO] Finished at: Tue Dec 17 16:23:31 EST 2013
[INFO] Final Memory: 58M/488M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on project hive-webhcat: Compilation failure
[ERROR] /data/hive-ptest/working/apache-svn-trunk-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/HcatDelegator.java:[308,42] cannot find symbol
[ERROR] symbol : variable OK
[ERROR] location: class org.apache.hive.hcatalog.templeton.JsonBuilder
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hive-webhcat
+ exit 1
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12619140
> webhcat should be able to return detailed serde information when show table using "fromat=extended"
> ---------------------------------------------------------------------------------------------------
>
> Key: HIVE-6044
> URL: https://issues.apache.org/jira/browse/HIVE-6044
> Project: Hive
> Issue Type: Bug
> Reporter: Shuaishuai Nie
> Assignee: Shuaishuai Nie
> Attachments: HIVE-6044.1.patch
>
>
> Now in webhcat, when using GET ddl/database/:db/table/:table and "format=extended", return value is based on query "show table extended like". However, this query doesn't contains serde info like "line.delim" and "filed.delim". In this case, user won't have enough information to reconstruct the exact same table based on the information from the json file. The "descExtendedTable" function in HcatDelegator should also return extra fields from query "desc extended tablename" which contains fields "sd", "retention", "parameters" "parametersSize" and "tableType".
--
This message was sent by Atlassian JIRA
(v6.1.4#6159)