You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Rajkumar Singh (Jira)" <ji...@apache.org> on 2020/07/31 17:23:00 UTC
[jira] [Created] (HIVE-23968) CTAS with TBLPROPERTIES
('transactional'='false') does not entertain translated table location
Rajkumar Singh created HIVE-23968:
-------------------------------------
Summary: CTAS with TBLPROPERTIES ('transactional'='false') does not entertain translated table location
Key: HIVE-23968
URL: https://issues.apache.org/jira/browse/HIVE-23968
Project: Hive
Issue Type: Bug
Components: Hive
Affects Versions: 4.0.0
Reporter: Rajkumar Singh
HMS translation layer convert the table to external based on the transactional property set to false but MoveTask does not entertain the translated table location and move the data to the managed table location;
steps to repro:
{code:java}
create table nontxnal TBLPROPERTIES ('transactional'='false') as select * from abc;
{code}
select query on table return nothing t but the source table has data in it.
{code:java}
select * from nontxnal;
+--------------+
| nontxnal.id |
+--------------+
+--------------+
{code}
--show create table
{code:java}
CREATE EXTERNAL TABLE `nontxnal`( |
| `id` int) |
| ROW FORMAT SERDE |
| 'org.apache.hadoop.hive.ql.io.orc.OrcSerde' |
| STORED AS INPUTFORMAT |
| 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat' |
| OUTPUTFORMAT |
| 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat' |
| LOCATION |
| 'hdfs://hostname:8020/warehouse/tablespace/external/hive/nontxnal' |
| TBLPROPERTIES ( |
| 'TRANSLATED_TO_EXTERNAL'='TRUE', |
| 'bucketing_version'='2', |
| 'external.table.purge'='TRUE', |
| 'transient_lastDdlTime'='1596215634') |
{code}
table data is moved to the managed location:
```
dfs -ls -R hdfs://hostname:8020/warehouse/tablespace/managed/hive/nontxnal
. . . . . . . . . . . . . . . . . . . . . . .> ;
+----------------------------------------------------+
| DFS Output |
+----------------------------------------------------+
| -rw-rw----+ 3 hive hadoop 201 2020-07-31 17:05 hdfs://hostname:8020/warehouse/tablespace/managed/hive/nontxnal/000000_0 |
+----------------------------------------------------+
```
--
This message was sent by Atlassian Jira
(v8.3.4#803005)