You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/01/12 13:09:00 UTC
[jira] [Work logged] (HIVE-24625) CTAS with TBLPROPERTIES
('transactional'='false') loads data into incorrect directory
[ https://issues.apache.org/jira/browse/HIVE-24625?focusedWorklogId=534827&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-534827 ]
ASF GitHub Bot logged work on HIVE-24625:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 12/Jan/21 13:08
Start Date: 12/Jan/21 13:08
Worklog Time Spent: 10m
Work Description: zeroflag opened a new pull request #1856:
URL: https://github.com/apache/hive/pull/1856
When table is created using CTAS, with transactional=false, data is loaded in managed location where as table metadata has location pointing to external location, resulting in 0 rows when querying the table.
cc: @rajkrrsingh, @nrg4878
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 534827)
Remaining Estimate: 0h
Time Spent: 10m
> CTAS with TBLPROPERTIES ('transactional'='false') loads data into incorrect directory
> -------------------------------------------------------------------------------------
>
> Key: HIVE-24625
> URL: https://issues.apache.org/jira/browse/HIVE-24625
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2, Metastore
> Reporter: Attila Magyar
> Assignee: Attila Magyar
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> MetastoreDefaultTransformer in HMS converts a managed non transactional table to external table. MoveTask still uses the managed path when loading the data, resulting an always empty table.
> {code:java}
> create table tbl1 TBLPROPERTIES ('transactional'='false') as select * from other;{code}
> After the conversion the table location points to an external directory:
> Location: | hdfs://c670-node2.coelab.cloudera.com:8020/warehouse/tablespace/external/hive/tbl1
> Move task uses the managed location"
> {code:java}
> INFO : Moving data to directory hdfs://...:8020/warehouse/tablespace/managed/hive/tbl1 from hdfs://...:8020/warehouse/tablespace/managed/hive/.hive-staging_hive_2021-01-05_16-10-39_973_41005081081760609-4/-ext-1000 {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)