You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Eugene Koifman (JIRA)" <ji...@apache.org> on 2018/09/17 19:07:00 UTC

[jira] [Created] (HIVE-20581) Eliminate rename() from full CRUD transactional tables

Eugene Koifman created HIVE-20581:
-------------------------------------

             Summary: Eliminate rename() from full CRUD transactional tables
                 Key: HIVE-20581
                 URL: https://issues.apache.org/jira/browse/HIVE-20581
             Project: Hive
          Issue Type: Improvement
          Components: Transactions
            Reporter: Eugene Koifman


The {{MoveTask}} in a query writing to full CRUD transactional table still performs a {{FileSystem.rename()}}.  Full CRUD should follow the insert-only transactional table implementation and write directly to delta_x_x in the partition dir.  If the txn fails, this delta will be marked aborted and will not be read.

There are several places that rely on this rename.  For example, support for {{Insert ... select ... Union All ... Select }} which creates multiple dirs, 1 for each leg of the union.

Others?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)