You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Prasad Chakka (JIRA)" <ji...@apache.org> on 2009/06/29 23:24:47 UTC

[jira] Created: (HIVE-592) renaming internal table should rename HDFS and also change path of the table and partitions accordingly.

renaming internal table should rename HDFS and also change path of the table and partitions accordingly.
--------------------------------------------------------------------------------------------------------

                 Key: HIVE-592
                 URL: https://issues.apache.org/jira/browse/HIVE-592
             Project: Hadoop Hive
          Issue Type: Bug
            Reporter: Prasad Chakka
            Assignee: Prasad Chakka


rename table changes just the name of the table in metastore but not hdfs. so if a table with old name is created, it uses the hdfs directory pointing to the renamed table.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-592) renaming internal table should rename HDFS and also change path of the table and partitions accordingly.

Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12806142#action_12806142 ] 

Zheng Shao commented on HIVE-592:
---------------------------------

Tried renaming table on both branch-0.4 and branch-0.5. Both worked as expected (locations are modified).


> renaming internal table should rename HDFS and also change path of the table and partitions accordingly.
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-592
>                 URL: https://issues.apache.org/jira/browse/HIVE-592
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.3.0, 0.3.1, 0.4.0, 0.6.0
>            Reporter: Prasad Chakka
>            Assignee: Prasad Chakka
>             Fix For: 0.4.0
>
>         Attachments: hive-592.2.patch, hive-592.3.patch
>
>
> rename table changes just the name of the table in metastore but not hdfs. so if a table with old name is created, it uses the hdfs directory pointing to the renamed table.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-592) renaming internal table should rename HDFS and also change path of the table and partitions accordingly.

Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zheng Shao updated HIVE-592:
----------------------------

      Resolution: Fixed
    Release Note: HIVE-592. Renaming internal table should rename HDFS. (Prasad Chakka via zshao)
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

Committed. Thanks Prasad.

> renaming internal table should rename HDFS and also change path of the table and partitions accordingly.
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-592
>                 URL: https://issues.apache.org/jira/browse/HIVE-592
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.2.0, 0.3.0, 0.3.1, 0.4.0
>            Reporter: Prasad Chakka
>            Assignee: Prasad Chakka
>             Fix For: 0.4.0
>
>         Attachments: hive-592.2.patch, hive-592.3.patch
>
>
> rename table changes just the name of the table in metastore but not hdfs. so if a table with old name is created, it uses the hdfs directory pointing to the renamed table.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-592) renaming internal table should rename HDFS and also change path of the table and partitions accordingly.

Posted by "Prasad Chakka (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12731815#action_12731815 ] 

Prasad Chakka commented on HIVE-592:
------------------------------------

this patch changes the way 'alter table old_tbl_name rename to new_tbl_name' behaves which is quite different from before and may affect users that depend on older functionality.

older behavior:
just the table name is changed but the underlying hdfs location (<warehouse_root>/old_tbl) is unchanged.


new behavior:
following changed on a rename for tables that are not created as external tables
- table name 
- move underlying data from <warehouse_root>/old_tbl to <warehouse_root>/new_tbl
- location of table in metadata
- location of partitions in metadata

rename fails in the following scenarios
- a table with a new name already exists
- <warehouse_root>/new_tbl already exists or can't be created
- <warehouse_root>/old_tbl is not accessible


> renaming internal table should rename HDFS and also change path of the table and partitions accordingly.
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-592
>                 URL: https://issues.apache.org/jira/browse/HIVE-592
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.2.0, 0.3.0, 0.3.1, 0.4.0
>            Reporter: Prasad Chakka
>            Assignee: Prasad Chakka
>             Fix For: 0.4.0
>
>         Attachments: hive-592.2.patch, hive-592.3.patch
>
>
> rename table changes just the name of the table in metastore but not hdfs. so if a table with old name is created, it uses the hdfs directory pointing to the renamed table.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-592) renaming internal table should rename HDFS and also change path of the table and partitions accordingly.

Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12731311#action_12731311 ] 

Zheng Shao commented on HIVE-592:
---------------------------------

Can you remove MIndex.java? I think it belongs to a different transaction?

> renaming internal table should rename HDFS and also change path of the table and partitions accordingly.
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-592
>                 URL: https://issues.apache.org/jira/browse/HIVE-592
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.2.0, 0.3.0, 0.3.1, 0.4.0
>            Reporter: Prasad Chakka
>            Assignee: Prasad Chakka
>             Fix For: 0.4.0
>
>         Attachments: hive-592.2.patch
>
>
> rename table changes just the name of the table in metastore but not hdfs. so if a table with old name is created, it uses the hdfs directory pointing to the renamed table.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-592) renaming internal table should rename HDFS and also change path of the table and partitions accordingly.

Posted by "Prasad Chakka (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Prasad Chakka updated HIVE-592:
-------------------------------

    Attachment: hive-592.2.patch

> renaming internal table should rename HDFS and also change path of the table and partitions accordingly.
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-592
>                 URL: https://issues.apache.org/jira/browse/HIVE-592
>             Project: Hadoop Hive
>          Issue Type: Bug
>            Reporter: Prasad Chakka
>            Assignee: Prasad Chakka
>         Attachments: hive-592.2.patch
>
>
> rename table changes just the name of the table in metastore but not hdfs. so if a table with old name is created, it uses the hdfs directory pointing to the renamed table.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-592) renaming internal table should rename HDFS and also change path of the table and partitions accordingly.

Posted by "Prasad Chakka (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Prasad Chakka updated HIVE-592:
-------------------------------

        Fix Version/s: 0.4.0
    Affects Version/s: 0.4.0
                       0.3.1
                       0.3.0
                       0.2.0
               Status: Patch Available  (was: Open)

fix is little bit involved since we don't want to overwrite existing data.

> renaming internal table should rename HDFS and also change path of the table and partitions accordingly.
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-592
>                 URL: https://issues.apache.org/jira/browse/HIVE-592
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.2.0, 0.3.0, 0.3.1, 0.4.0
>            Reporter: Prasad Chakka
>            Assignee: Prasad Chakka
>             Fix For: 0.4.0
>
>         Attachments: hive-592.2.patch
>
>
> rename table changes just the name of the table in metastore but not hdfs. so if a table with old name is created, it uses the hdfs directory pointing to the renamed table.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-592) renaming internal table should rename HDFS and also change path of the table and partitions accordingly.

Posted by "Prasad Chakka (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Prasad Chakka updated HIVE-592:
-------------------------------

    Attachment: hive-592.3.patch

here is the updated file

> renaming internal table should rename HDFS and also change path of the table and partitions accordingly.
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-592
>                 URL: https://issues.apache.org/jira/browse/HIVE-592
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.2.0, 0.3.0, 0.3.1, 0.4.0
>            Reporter: Prasad Chakka
>            Assignee: Prasad Chakka
>             Fix For: 0.4.0
>
>         Attachments: hive-592.2.patch, hive-592.3.patch
>
>
> rename table changes just the name of the table in metastore but not hdfs. so if a table with old name is created, it uses the hdfs directory pointing to the renamed table.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.