You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Ning Zhang (JIRA)" <ji...@apache.org> on 2011/04/15 19:23:06 UTC

[jira] [Created] (HIVE-2114) Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()

Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()
---------------------------------------------------------------------------------------------------

                 Key: HIVE-2114
                 URL: https://issues.apache.org/jira/browse/HIVE-2114
             Project: Hive
          Issue Type: Sub-task
            Reporter: Ning Zhang
            Assignee: Ning Zhang




--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2114) Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-2114:
---------------------------------

      Component/s: Metastore
    Fix Version/s: 0.8.0

> Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2114
>                 URL: https://issues.apache.org/jira/browse/HIVE-2114
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Metastore
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2114.patch
>
>
> In MetaStoreUtils.getPartSchemaFromTableSchema() the Propertie of a Partitions is first created by cloning the Properties from a Table. Then some of the properties are overwritten by the Partition level properties (Location/InputFormat/OutputFormat etc.). It also copies the properties from the SerDeInfo. If the SerDeInfo contains properties 'columns', 'column_types' and 'partition_columns' this will introduce incompatibility from the previous code path MetaStoreUtils.getSchema(). In getSchema(), the 'columns' etc are put after copying the SerDeInfo, which means we should not overwrite these 3 properties in the new code.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2114) Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ning Zhang updated HIVE-2114:
-----------------------------

    Description: In MetaStoreUtils.getPartSchemaFromTableSchema() the Propertie of a Partitions is first created by cloning the Properties from a Table. Then some of the properties are overwritten by the Partition level properties (Location/InputFormat/OutputFormat etc.). It also copies the properties from the SerDeInfo. If the SerDeInfo contains properties 'columns', 'column_types' and 'partition_columns' this will introduce incompatibility from the previous code path MetaStoreUtils.getSchema(). In getSchema(), the 'columns' etc are put after copying the SerDeInfo, which means we should not overwrite these 3 properties in the new code.

> Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2114
>                 URL: https://issues.apache.org/jira/browse/HIVE-2114
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>
> In MetaStoreUtils.getPartSchemaFromTableSchema() the Propertie of a Partitions is first created by cloning the Properties from a Table. Then some of the properties are overwritten by the Partition level properties (Location/InputFormat/OutputFormat etc.). It also copies the properties from the SerDeInfo. If the SerDeInfo contains properties 'columns', 'column_types' and 'partition_columns' this will introduce incompatibility from the previous code path MetaStoreUtils.getSchema(). In getSchema(), the 'columns' etc are put after copying the SerDeInfo, which means we should not overwrite these 3 properties in the new code.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2114) Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13020429#comment-13020429 ] 

Ning Zhang commented on HIVE-2114:
----------------------------------

https://reviews.apache.org/r/605/

> Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2114
>                 URL: https://issues.apache.org/jira/browse/HIVE-2114
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-2114.patch
>
>
> In MetaStoreUtils.getPartSchemaFromTableSchema() the Propertie of a Partitions is first created by cloning the Properties from a Table. Then some of the properties are overwritten by the Partition level properties (Location/InputFormat/OutputFormat etc.). It also copies the properties from the SerDeInfo. If the SerDeInfo contains properties 'columns', 'column_types' and 'partition_columns' this will introduce incompatibility from the previous code path MetaStoreUtils.getSchema(). In getSchema(), the 'columns' etc are put after copying the SerDeInfo, which means we should not overwrite these 3 properties in the new code.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2114) Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-2114:
-----------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

Committed. Thanks Ning

> Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2114
>                 URL: https://issues.apache.org/jira/browse/HIVE-2114
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-2114.patch
>
>
> In MetaStoreUtils.getPartSchemaFromTableSchema() the Propertie of a Partitions is first created by cloning the Properties from a Table. Then some of the properties are overwritten by the Partition level properties (Location/InputFormat/OutputFormat etc.). It also copies the properties from the SerDeInfo. If the SerDeInfo contains properties 'columns', 'column_types' and 'partition_columns' this will introduce incompatibility from the previous code path MetaStoreUtils.getSchema(). In getSchema(), the 'columns' etc are put after copying the SerDeInfo, which means we should not overwrite these 3 properties in the new code.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2114) Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ning Zhang updated HIVE-2114:
-----------------------------

    Attachment: HIVE-2114.patch

> Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2114
>                 URL: https://issues.apache.org/jira/browse/HIVE-2114
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-2114.patch
>
>
> In MetaStoreUtils.getPartSchemaFromTableSchema() the Propertie of a Partitions is first created by cloning the Properties from a Table. Then some of the properties are overwritten by the Partition level properties (Location/InputFormat/OutputFormat etc.). It also copies the properties from the SerDeInfo. If the SerDeInfo contains properties 'columns', 'column_types' and 'partition_columns' this will introduce incompatibility from the previous code path MetaStoreUtils.getSchema(). In getSchema(), the 'columns' etc are put after copying the SerDeInfo, which means we should not overwrite these 3 properties in the new code.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2114) Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ning Zhang updated HIVE-2114:
-----------------------------

    Status: Patch Available  (was: Open)

> Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2114
>                 URL: https://issues.apache.org/jira/browse/HIVE-2114
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-2114.patch
>
>
> In MetaStoreUtils.getPartSchemaFromTableSchema() the Propertie of a Partitions is first created by cloning the Properties from a Table. Then some of the properties are overwritten by the Partition level properties (Location/InputFormat/OutputFormat etc.). It also copies the properties from the SerDeInfo. If the SerDeInfo contains properties 'columns', 'column_types' and 'partition_columns' this will introduce incompatibility from the previous code path MetaStoreUtils.getSchema(). In getSchema(), the 'columns' etc are put after copying the SerDeInfo, which means we should not overwrite these 3 properties in the new code.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira