You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Aasha Medhi (Jira)" <ji...@apache.org> on 2021/10/04 04:15:00 UTC
[jira] [Commented] (HIVE-25579) LOAD overwrite appends rather than
overwriting
[ https://issues.apache.org/jira/browse/HIVE-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423759#comment-17423759 ]
Aasha Medhi commented on HIVE-25579:
------------------------------------
Thank you for the patch [~ayushtkn] and the review [~anuragshekhar]
> LOAD overwrite appends rather than overwriting
> ----------------------------------------------
>
> Key: HIVE-25579
> URL: https://issues.apache.org/jira/browse/HIVE-25579
> Project: Hive
> Issue Type: Bug
> Reporter: Ayush Saxena
> Assignee: Ayush Saxena
> Priority: Critical
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> The overwrite query gets converted to append.
> {noformat}
> 7b6-4b43-8452-52c44e8a2f71): LOAD DATA INPATH 'hdfs://ayushsaxena-1.ayushsaxena.root.hwx.site:8020/warehouse/tablespace/external/hive/test_ext/000000_0' OVERWRITE INTO TABLE test_spark
> 2021-09-30 03:30:23,033 INFO org.apache.hadoop.hive.ql.lockmgr.DbTxnManager: [db2ab9c9-bf54-4304-bc06-e3bef76f2e79 HiveServer2-Handler-Pool: Thread-2600]: Opened txnid:15
> 2021-09-30 03:30:23,035 INFO org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer: [db2ab9c9-bf54-4304-bc06-e3bef76f2e79 HiveServer2-Handler-Pool: Thread-2600]: Starting caching scope for: hive_20210930033023_bb1f6dc4-d7b6-4b43-8452-52c44e8a2f71
> 2021-09-30 03:30:23,042 INFO org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer: [db2ab9c9-bf54-4304-bc06-e3bef76f2e79 HiveServer2-Handler-Pool: Thread-2600]: Load data triggered a Tez job instead of usual file operation
> 2021-09-30 03:30:23,042 INFO org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer: [db2ab9c9-bf54-4304-bc06-e3bef76f2e79 HiveServer2-Handler-Pool: Thread-2600]: Going to reparse <LOAD DATA INPATH 'hdfs://ayushsaxena-1.ayushsaxena.root.hwx.site:8020/warehouse/tablespace/external/hive/test_ext/000000_0' OVERWRITE INTO TABLE test_spark> as
> <insert into table `default`.`test_spark` partition (`col2`) select * from test_spark__temp_table_for_load_data__>
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)