You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Hive QA (JIRA)" <ji...@apache.org> on 2017/08/17 04:25:00 UTC
[jira] [Commented] (HIVE-17343) create a mechanism to get rid of
some globals in HS2
[ https://issues.apache.org/jira/browse/HIVE-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129890#comment-16129890 ]
Hive QA commented on HIVE-17343:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12882262/HIVE-17343.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/6431/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/6431/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-6431/
Messages:
{noformat}
**** This message was trimmed, see log for full details ****
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MGlobalPrivilege
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MDBPrivilege
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MTablePrivilege
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MPartitionPrivilege
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MTableColumnPrivilege
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MPartitionColumnPrivilege
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MPartitionEvent
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MMasterKey
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MDelegationToken
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MTableColumnStatistics
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MPartitionColumnStatistics
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MVersionTable
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MMetastoreDBProperties
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MResourceUri
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MFunction
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MNotificationLog
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MNotificationNextId
DataNucleus Enhancer completed with success for 31 classes. Timings : input=281 ms, enhance=314 ms, total=595 ms. Consult the log for full details
ANTLR Parser Generator Version 3.5.2
Output file /data/hiveptest/working/apache-github-source-source/metastore/target/generated-sources/antlr3/org/apache/hadoop/hive/metastore/parser/FilterParser.java does not exist: must build /data/hiveptest/working/apache-github-source-source/metastore/src/java/org/apache/hadoop/hive/metastore/parser/Filter.g
org/apache/hadoop/hive/metastore/parser/Filter.g
ANTLR Parser Generator Version 3.5.2
Output file /data/hiveptest/working/apache-github-source-source/ql/target/generated-sources/antlr3/org/apache/hadoop/hive/ql/parse/HiveLexer.java does not exist: must build /data/hiveptest/working/apache-github-source-source/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g
org/apache/hadoop/hive/ql/parse/HiveLexer.g
Output file /data/hiveptest/working/apache-github-source-source/ql/target/generated-sources/antlr3/org/apache/hadoop/hive/ql/parse/HiveParser.java does not exist: must build /data/hiveptest/working/apache-github-source-source/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g
org/apache/hadoop/hive/ql/parse/HiveParser.g
Output file /data/hiveptest/working/apache-github-source-source/ql/target/generated-sources/antlr3/org/apache/hadoop/hive/ql/parse/HintParser.java does not exist: must build /data/hiveptest/working/apache-github-source-source/ql/src/java/org/apache/hadoop/hive/ql/parse/HintParser.g
org/apache/hadoop/hive/ql/parse/HintParser.g
Generating vector expression code
Generating vector expression test code
ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console.
[ERROR] COMPILATION ERROR :
[ERROR] /data/hiveptest/working/apache-github-source-source/hcatalog/hcatalog-pig-adapter/src/test/java/org/apache/hive/hcatalog/pig/TestHCatLoaderEncryption.java:[278,9] method getForHiveCommandInternal in class org.apache.hadoop.hive.ql.processors.CommandProcessorFactory cannot be applied to given types;
required: java.lang.String[],org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.session.HiveServerEnvironment,boolean
found: java.lang.String[],org.apache.hadoop.hive.conf.HiveConf,boolean
reason: actual and formal argument lists differ in length
[ERROR] ResourceManager : unable to find resource 'VM_global_library.vm' in any resource loader.
Loading source files for package org.apache.hive.hcatalog.templeton...
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/CompleteDelegator.java]]
[parsing completed 35ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/TempletonDelegator.java]]
[parsing completed 2ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/Main.java]]
[parsing completed 14ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/MaxByteArrayOutputStream.java]]
[parsing completed 3ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/TableDesc.java]]
[parsing completed 8ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/ExecService.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/LauncherDelegator.java]]
[parsing completed 26ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/GroupPermissionsDesc.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/JsonBuilder.java]]
[parsing completed 3ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/ListDelegator.java]]
[parsing completed 4ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/AppConfig.java]]
[parsing completed 13ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/TooManyRequestsException.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/HiveDelegator.java]]
[parsing completed 4ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/SecureProxySupport.java]]
[parsing completed 9ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/NotAuthorizedException.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/Server.java]]
[parsing completed 31ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/PigDelegator.java]]
[parsing completed 3ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/CompleteBean.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/DatabaseDesc.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/TableLikeDesc.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/HcatDelegator.java]]
[parsing completed 13ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/CallbackFailedException.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/TablePropertyDesc.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/JobRequestExecutor.java]]
[parsing completed 4ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/BadParam.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/HcatException.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/SimpleWebException.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/JarDelegator.java]]
[parsing completed 18ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/JobItemBean.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/WadlConfig.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/ColumnDesc.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/EnqueueBean.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/StreamingDelegator.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/ExecServiceImpl.java]]
[parsing completed 4ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/BusyException.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/QueueStatusBean.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/ExecBean.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/QueueException.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/CatchallExceptionMapper.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/DeleteDelegator.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/ProxyUserSupport.java]]
[parsing completed 4ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/SimpleExceptionMapper.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/JobCallable.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/PartitionDesc.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/UgiFactory.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/VersionDelegator.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/StatusDelegator.java]]
[parsing completed 2ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/SqoopDelegator.java]]
[parsing completed 2ms]
Loading source files for package org.apache.hive.hcatalog.templeton.tool...
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/DelegationTokenCache.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/NullSplit.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/JobStateTracker.java]]
[parsing completed 2ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/HDFSCleanup.java]]
[parsing completed 2ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/LogRetriever.java]]
[parsing completed 4ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/TrivialExecService.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/HDFSStorage.java]]
[parsing completed 2ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/JobSubmissionConstants.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/SingleInputFormat.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/NullRecordReader.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/TempletonControllerJob.java]]
[parsing completed 2ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/PigJobIDParser.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/JobState.java]]
[parsing completed 3ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/ZooKeeperCleanup.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/ZooKeeperStorage.java]]
[parsing completed 6ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/TempletonStorage.java]]
[parsing completed 2ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/LaunchMapper.java]]
[parsing completed 8ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/JobIDParser.java]]
[parsing completed 1ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/NotFoundException.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/JarJobIDParser.java]]
[parsing completed 0ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/TempletonUtils.java]]
[parsing completed 7ms]
[parsing started RegularFileObject[/data/hiveptest/working/apache-github-source-source/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/tool/HiveJobIDParser.java]]
[parsing completed 0ms]
Constructing Javadoc information...
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.6.1:testCompile (default-testCompile) on project hive-hcatalog-pig-adapter: Compilation failure
[ERROR] /data/hiveptest/working/apache-github-source-source/hcatalog/hcatalog-pig-adapter/src/test/java/org/apache/hive/hcatalog/pig/TestHCatLoaderEncryption.java:[278,9] method getForHiveCommandInternal in class org.apache.hadoop.hive.ql.processors.CommandProcessorFactory cannot be applied to given types;
[ERROR] required: java.lang.String[],org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.session.HiveServerEnvironment,boolean
[ERROR] found: java.lang.String[],org.apache.hadoop.hive.conf.HiveConf,boolean
[ERROR] reason: actual and formal argument lists differ in length
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hive-hcatalog-pig-adapter
Destroying 1 processes
Destroying process..
Destroyed 1 processes
+ exit 1
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12882262 - PreCommit-HIVE-Build
> create a mechanism to get rid of some globals in HS2
> ----------------------------------------------------
>
> Key: HIVE-17343
> URL: https://issues.apache.org/jira/browse/HIVE-17343
> Project: Hive
> Issue Type: Bug
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
> Attachments: HIVE-17343.patch
>
>
> The intent is to initialize things once in HS2 ctor/init, and then be able to access them from queries, etc. without using globals or threadlocals.
> Things like future workload management work, LLAP coordinator, materialized view registry, etc. could be accessed this way.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)