You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Ayush Saxena (Jira)" <ji...@apache.org> on 2022/03/01 04:10:00 UTC
[jira] [Resolved] (HIVE-25981) Avoid checking for archived parts in analyze table
[ https://issues.apache.org/jira/browse/HIVE-25981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ayush Saxena resolved HIVE-25981.
---------------------------------
Fix Version/s: 4.0.0
Hadoop Flags: Reviewed
Resolution: Fixed
> Avoid checking for archived parts in analyze table
> --------------------------------------------------
>
> Key: HIVE-25981
> URL: https://issues.apache.org/jira/browse/HIVE-25981
> Project: Hive
> Issue Type: Improvement
> Components: HiveServer2
> Reporter: Rajesh Balamohan
> Assignee: Ayush Saxena
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> Analyze table on large partitioned table is expensive due to unwanted checks on archived data.
>
> {noformat}
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient$SynchronizedHandler.invoke(HiveMetaStoreClient.java:3908)
> - locked <0x00000003d4c4c070> (a org.apache.hadoop.hive.metastore.HiveMetaStoreClient$SynchronizedHandler)
> at com.sun.proxy.$Proxy56.listPartitionsWithAuthInfo(Unknown Source)
> at org.apache.hadoop.hive.ql.metadata.Hive.getPartitions(Hive.java:3845)
> at org.apache.hadoop.hive.ql.exec.ArchiveUtils.conflictingArchiveNameOrNull(ArchiveUtils.java:299)
> at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.validate(SemanticAnalyzer.java:13579)
> at org.apache.hadoop.hive.ql.Compiler.analyze(Compiler.java:241)
> at org.apache.hadoop.hive.ql.Compiler.compile(Compiler.java:104)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:196)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:615)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:561)
> at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:555)
> at org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:127)
> at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:204)
> at org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:265)
> at org.apache.hive.service.cli.operation.Operation.run(Operation.java:285)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)