You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Arvind Prabhakar (JIRA)" <ji...@apache.org> on 2010/05/15 01:53:42 UTC

[jira] Created: (HIVE-1345) TypedBytesSerDe fails to create table with multiple columns.

TypedBytesSerDe fails to create table with multiple columns.
------------------------------------------------------------

                 Key: HIVE-1345
                 URL: https://issues.apache.org/jira/browse/HIVE-1345
             Project: Hadoop Hive
          Issue Type: Bug
          Components: Contrib
    Affects Versions: 0.5.0
         Environment: JDK 6 (1.6.0_17) on Mac OSX 10.6.3, Hadoop 0.20.2, Hive 0.5.0
            Reporter: Arvind Prabhakar
            Assignee: Arvind Prabhakar
             Fix For: 0.6.0


Creating a table with more than one columns fails when the row format SerDe is TypedBytesSerDe. 


{code}
hive> CREATE TABLE test (a STRING, b STRING) ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.TypedBytesSerDe';      
Found class for org.apache.hadoop.hive.contrib.serde2.TypedBytesSerDe                                                       
FAILED: Error in metadata: java.lang.IndexOutOfBoundsException: Index: 1, Size: 1                                           
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask                                          
hive> 
{code}



-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1345) TypedBytesSerDe fails to create table with multiple columns.

Posted by "Arvind Prabhakar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arvind Prabhakar updated HIVE-1345:
-----------------------------------

    Status: Patch Available  (was: Open)

The problem was due to incorrect parsing of the {{columnTypeProperty}} during the initialization of {{TypedBytesSerDe}}. This patch fixes the problem by delegating the parsing logic to the standard routine used by other SerDes - {{TypeInfoUtils.getTypeInfosFromTypeString()}}.

Also included in this patch is a test case that exercises this change and validates that multi-column tables can be created when using this SerDe.

> TypedBytesSerDe fails to create table with multiple columns.
> ------------------------------------------------------------
>
>                 Key: HIVE-1345
>                 URL: https://issues.apache.org/jira/browse/HIVE-1345
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Contrib
>    Affects Versions: 0.5.0
>         Environment: JDK 6 (1.6.0_17) on Mac OSX 10.6.3, Hadoop 0.20.2, Hive 0.5.0
>            Reporter: Arvind Prabhakar
>            Assignee: Arvind Prabhakar
>             Fix For: 0.6.0
>
>         Attachments: HIVE-1345-1.patch
>
>
> Creating a table with more than one columns fails when the row format SerDe is TypedBytesSerDe. 
> {code}
> hive> CREATE TABLE test (a STRING, b STRING) ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.TypedBytesSerDe';      
> Found class for org.apache.hadoop.hive.contrib.serde2.TypedBytesSerDe                                                       
> FAILED: Error in metadata: java.lang.IndexOutOfBoundsException: Index: 1, Size: 1                                           
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask                                          
> hive> 
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1345) TypedBytesSerDe fails to create table with multiple columns.

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12868311#action_12868311 ] 

Namit Jain commented on HIVE-1345:
----------------------------------

+1

will commit if the tests complete

> TypedBytesSerDe fails to create table with multiple columns.
> ------------------------------------------------------------
>
>                 Key: HIVE-1345
>                 URL: https://issues.apache.org/jira/browse/HIVE-1345
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Contrib
>    Affects Versions: 0.5.0
>         Environment: JDK 6 (1.6.0_17) on Mac OSX 10.6.3, Hadoop 0.20.2, Hive 0.5.0
>            Reporter: Arvind Prabhakar
>            Assignee: Arvind Prabhakar
>             Fix For: 0.6.0
>
>         Attachments: HIVE-1345-1.patch
>
>
> Creating a table with more than one columns fails when the row format SerDe is TypedBytesSerDe. 
> {code}
> hive> CREATE TABLE test (a STRING, b STRING) ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.TypedBytesSerDe';      
> Found class for org.apache.hadoop.hive.contrib.serde2.TypedBytesSerDe                                                       
> FAILED: Error in metadata: java.lang.IndexOutOfBoundsException: Index: 1, Size: 1                                           
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask                                          
> hive> 
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1345) TypedBytesSerDe fails to create table with multiple columns.

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-1345:
-----------------------------

          Status: Resolved  (was: Patch Available)
    Hadoop Flags: [Reviewed]
      Resolution: Fixed

Committed. Thanks Arvind

> TypedBytesSerDe fails to create table with multiple columns.
> ------------------------------------------------------------
>
>                 Key: HIVE-1345
>                 URL: https://issues.apache.org/jira/browse/HIVE-1345
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Contrib
>    Affects Versions: 0.5.0
>         Environment: JDK 6 (1.6.0_17) on Mac OSX 10.6.3, Hadoop 0.20.2, Hive 0.5.0
>            Reporter: Arvind Prabhakar
>            Assignee: Arvind Prabhakar
>             Fix For: 0.6.0
>
>         Attachments: HIVE-1345-1.patch
>
>
> Creating a table with more than one columns fails when the row format SerDe is TypedBytesSerDe. 
> {code}
> hive> CREATE TABLE test (a STRING, b STRING) ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.TypedBytesSerDe';      
> Found class for org.apache.hadoop.hive.contrib.serde2.TypedBytesSerDe                                                       
> FAILED: Error in metadata: java.lang.IndexOutOfBoundsException: Index: 1, Size: 1                                           
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask                                          
> hive> 
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1345) TypedBytesSerDe fails to create table with multiple columns.

Posted by "Arvind Prabhakar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arvind Prabhakar updated HIVE-1345:
-----------------------------------

    Attachment: HIVE-1345-1.patch

> TypedBytesSerDe fails to create table with multiple columns.
> ------------------------------------------------------------
>
>                 Key: HIVE-1345
>                 URL: https://issues.apache.org/jira/browse/HIVE-1345
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Contrib
>    Affects Versions: 0.5.0
>         Environment: JDK 6 (1.6.0_17) on Mac OSX 10.6.3, Hadoop 0.20.2, Hive 0.5.0
>            Reporter: Arvind Prabhakar
>            Assignee: Arvind Prabhakar
>             Fix For: 0.6.0
>
>         Attachments: HIVE-1345-1.patch
>
>
> Creating a table with more than one columns fails when the row format SerDe is TypedBytesSerDe. 
> {code}
> hive> CREATE TABLE test (a STRING, b STRING) ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.TypedBytesSerDe';      
> Found class for org.apache.hadoop.hive.contrib.serde2.TypedBytesSerDe                                                       
> FAILED: Error in metadata: java.lang.IndexOutOfBoundsException: Index: 1, Size: 1                                           
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask                                          
> hive> 
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.