You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Attila Magyar (Jira)" <ji...@apache.org> on 2021/01/12 09:45:00 UTC
[jira] [Updated] (HIVE-24625) CTAS with TBLPROPERTIES
('transactional'='false') loads data into incorrect directory
[ https://issues.apache.org/jira/browse/HIVE-24625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Attila Magyar updated HIVE-24625:
---------------------------------
Description:
MetastoreDefaultTransformer in HMS converts a managed non transactional table to external table. MoveTask still uses the managed path when loading the data, resulting an always empty table.
{code:java}
create table tbl1 TBLPROPERTIES ('transactional'='false') as select * from other;{code}
After the conversion the table location points to an external directory:
Location: | hdfs://c670-node2.coelab.cloudera.com:8020/warehouse/tablespace/external/hive/tbl1
Move task uses the managed location"
{code:java}
INFO : Moving data to directory hdfs://...:8020/warehouse/tablespace/managed/hive/tbl1 from hdfs://...:8020/warehouse/tablespace/managed/hive/.hive-staging_hive_2021-01-05_16-10-39_973_41005081081760609-4/-ext-1000 {code}
> CTAS with TBLPROPERTIES ('transactional'='false') loads data into incorrect directory
> -------------------------------------------------------------------------------------
>
> Key: HIVE-24625
> URL: https://issues.apache.org/jira/browse/HIVE-24625
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2, Metastore
> Reporter: Attila Magyar
> Assignee: Attila Magyar
> Priority: Major
>
> MetastoreDefaultTransformer in HMS converts a managed non transactional table to external table. MoveTask still uses the managed path when loading the data, resulting an always empty table.
> {code:java}
> create table tbl1 TBLPROPERTIES ('transactional'='false') as select * from other;{code}
> After the conversion the table location points to an external directory:
> Location: | hdfs://c670-node2.coelab.cloudera.com:8020/warehouse/tablespace/external/hive/tbl1
> Move task uses the managed location"
> {code:java}
> INFO : Moving data to directory hdfs://...:8020/warehouse/tablespace/managed/hive/tbl1 from hdfs://...:8020/warehouse/tablespace/managed/hive/.hive-staging_hive_2021-01-05_16-10-39_973_41005081081760609-4/-ext-1000 {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)