[jira] [Resolved] (HIVE-19139) Hive.getValidPartitionsInPath() issue

["Sergey Shelukhin (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-19139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sergey Shelukhin resolved HIVE-19139.
-------------------------------------
    Resolution: Not A Problem

This should be fixed as part of actually adding multi statement txns :)

> Hive.getValidPartitionsInPath() issue
> -------------------------------------
>
>                 Key: HIVE-19139
>                 URL: https://issues.apache.org/jira/browse/HIVE-19139
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Transactions
>            Reporter: Eugene Koifman
>            Priority: Major
>
> this method looks like this.  This will not work for multi-stmt txns since each statement uses the same writeId but different statementId.
> {noformat}
> // The non-MM path only finds new partitions, as it is looking at the temp path.
> // To produce the same effect, we will find all the partitions affected by this txn ID.
> // Note: we ignore the statement ID here, because it's currently irrelevant for MoveTask
> // where this is used; we always want to load everything; also the only case where
> // we have multiple statements anyway is union.
> Utilities.FILE_OP_LOGGER.trace(
>  "Looking for dynamic partitions in {} ({} levels)", loadPath, numDP);
> Path[] leafStatus = Utilities.getMmDirectoryCandidates(
>  fs, loadPath, numDP, numLB, null, writeId, -1, conf, isInsertOverwrite); 
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)