You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Sohan Jain (JIRA)" <ji...@apache.org> on 2011/08/11 01:12:28 UTC

[jira] [Created] (HIVE-2367) Indexes' storage descriptors' columns are not deduped, and altering an index leaves behind an unused storage descriptor

Indexes' storage descriptors' columns are not deduped, and altering an index leaves behind an unused storage descriptor
-----------------------------------------------------------------------------------------------------------------------

                 Key: HIVE-2367
                 URL: https://issues.apache.org/jira/browse/HIVE-2367
             Project: Hive
          Issue Type: Bug
          Components: Metastore
            Reporter: Sohan Jain


The metastore migration by HIVE-2246 does not dedupe the COLUMNS information for Indexes.  That is, the IDXS table has a Storage Descriptor that always points to a new Column Descriptor, which is unlikely shared by any other storage descriptor.

Therefore, when altering an index, a new storage Descriptor and column descriptor are created.  No other objects will reference the old storage descriptor and column descriptor, but they will persist in the metastore db.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2367) Indexes' storage descriptors' columns are not deduped, and altering an index leaves behind an unused storage descriptor

Posted by "Chinna Rao Lalam (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13107879#comment-13107879 ] 

Chinna Rao Lalam commented on HIVE-2367:
----------------------------------------

@Sohan:
I am trying to fix this issue but i am not able to reproduce this issue. I ran the below queries

{quote}
create table grade (userid string,name string,maths int,physics int,chemistry int) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t';

load data local inpath '/home/chinna/data/grade1.txt' into table grade;

CREATE INDEX grade_index ON TABLE grade(name)as 'compact' WITH DEFERRED REBUILD;
  
ALTER INDEX grade_index ON grade REBUILD;
{quote}

After the executioon of above queries 3 storage descriptors are created.
After the execution of above queries, if ALTER INDEX query is executed the storage descriptors number is not increased.

Pls check this and post ur queries.

> Indexes' storage descriptors' columns are not deduped, and altering an index leaves behind an unused storage descriptor
> -----------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2367
>                 URL: https://issues.apache.org/jira/browse/HIVE-2367
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>            Reporter: Sohan Jain
>
> The metastore migration by HIVE-2246 does not dedupe the COLUMNS information for Indexes.  That is, the IDXS table has a Storage Descriptor that always points to a new Column Descriptor, which is unlikely shared by any other storage descriptor.
> Therefore, when altering an index, a new storage Descriptor and column descriptor are created.  No other objects will reference the old storage descriptor and column descriptor, but they will persist in the metastore db.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira