You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Ashutosh Chauhan (JIRA)" <ji...@apache.org> on 2019/03/12 21:02:00 UTC
[jira] [Commented] (HIVE-21430) INSERT into a dynamically
partitioned table with hive.stats.autogather = false throws a MetaException
[ https://issues.apache.org/jira/browse/HIVE-21430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16791005#comment-16791005 ]
Ashutosh Chauhan commented on HIVE-21430:
-----------------------------------------
IMHO, we shall remove the config {{hive.stats.autogather}} since a) overhead to collect stats is negligible, so its always on. b) StatsTask always need to be present since we need to invalidate stats when we are not collecting them. So, better to remove this config and simplify the codebase (and avoid issues like this).
> INSERT into a dynamically partitioned table with hive.stats.autogather = false throws a MetaException
> -----------------------------------------------------------------------------------------------------
>
> Key: HIVE-21430
> URL: https://issues.apache.org/jira/browse/HIVE-21430
> Project: Hive
> Issue Type: Bug
> Reporter: Ashutosh Bapat
> Assignee: Ashutosh Bapat
> Priority: Major
> Attachments: metaexception_repro.patch, org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-output.txt
>
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> When the test TestStatsUpdaterThread#testTxnDynamicPartitions added in the attached patch is run it throws exception (full logs attached.)
> org.apache.hadoop.hive.metastore.api.MetaException: Cannot change stats state for a transactional table default.simple_stats without providing the transactional write state for verification (new write ID 5, valid write IDs null; current state \{"BASIC_STATS":"true","COLUMN_STATS":{"s":"true"}}; new state null
> at org.apache.hadoop.hive.metastore.ObjectStore.alterPartitionNoTxn(ObjectStore.java:4328)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)