You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Zheng Shao (JIRA)" <ji...@apache.org> on 2008/09/29 23:26:44 UTC

[jira] Created: (HADOOP-4308) Hive: DynamicSerDe based on thrift DDL

Hive: DynamicSerDe based on thrift DDL
--------------------------------------

                 Key: HADOOP-4308
                 URL: https://issues.apache.org/jira/browse/HADOOP-4308
             Project: Hadoop Core
          Issue Type: Bug
            Reporter: Zheng Shao
            Assignee: Zheng Shao


This is the DynamicSerDe code in hive/serde that supports serialization/deserialization in thrift format. It supports Thrift DDL so users could read the data outside Hive.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HADOOP-4308) Hive: DynamicSerDe based on thrift DDL

Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zheng Shao resolved HADOOP-4308.
--------------------------------

    Resolution: Fixed

The DynamicSerDe is already committed as part of another transaction.

> Hive: DynamicSerDe based on thrift DDL
> --------------------------------------
>
>                 Key: HADOOP-4308
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4308
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: contrib/hive
>            Reporter: Zheng Shao
>            Assignee: Zheng Shao
>
> This is the DynamicSerDe code in hive/serde that supports serialization/deserialization in thrift format. It supports Thrift DDL so users could read the data outside Hive.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-4308) Hive: DynamicSerDe based on thrift DDL

Posted by "Jeff Hammerbacher (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12643523#action_12643523 ] 

Jeff Hammerbacher commented on HADOOP-4308:
-------------------------------------------

Hey, this code seems to be of general use, and it appears to be committed here: http://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hive/serde/src/java/org/apache/hadoop/hive/serde2/dynamic_type/. Can we update this ticket and possible toss some documentation up?

Thanks,
Jeff

> Hive: DynamicSerDe based on thrift DDL
> --------------------------------------
>
>                 Key: HADOOP-4308
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4308
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: contrib/hive
>            Reporter: Zheng Shao
>            Assignee: Zheng Shao
>
> This is the DynamicSerDe code in hive/serde that supports serialization/deserialization in thrift format. It supports Thrift DDL so users could read the data outside Hive.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-4308) Hive: DynamicSerDe based on thrift DDL

Posted by "Pete Wyckoff (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12644371#action_12644371 ] 

Pete Wyckoff commented on HADOOP-4308:
--------------------------------------

 here, we are probably talking about TRegexProtocol being plugged in to DynamicSerDe. I think that would cover it. I will look into this more.


> Hive: DynamicSerDe based on thrift DDL
> --------------------------------------
>
>                 Key: HADOOP-4308
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4308
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: contrib/hive
>            Reporter: Zheng Shao
>            Assignee: Zheng Shao
>
> This is the DynamicSerDe code in hive/serde that supports serialization/deserialization in thrift format. It supports Thrift DDL so users could read the data outside Hive.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HADOOP-4308) Hive: DynamicSerDe based on thrift DDL

Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nigel Daley resolved HADOOP-4308.
---------------------------------

    Resolution: Duplicate

Resolving issue with the correct resolution type.

> Hive: DynamicSerDe based on thrift DDL
> --------------------------------------
>
>                 Key: HADOOP-4308
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4308
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: contrib/hive
>            Reporter: Zheng Shao
>            Assignee: Zheng Shao
>
> This is the DynamicSerDe code in hive/serde that supports serialization/deserialization in thrift format. It supports Thrift DDL so users could read the data outside Hive.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-4308) Hive: DynamicSerDe based on thrift DDL

Posted by "Jeff Hammerbacher (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12643704#action_12643704 ] 

Jeff Hammerbacher commented on HADOOP-4308:
-------------------------------------------

Hey Zheng,

I don't think there's a JIRA ticket open for RegularExpressionDeserializer. More generally, a tutorial on how to create and use your own Deserializer would be very useful.

Regards,
Jeff

> Hive: DynamicSerDe based on thrift DDL
> --------------------------------------
>
>                 Key: HADOOP-4308
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4308
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: contrib/hive
>            Reporter: Zheng Shao
>            Assignee: Zheng Shao
>
> This is the DynamicSerDe code in hive/serde that supports serialization/deserialization in thrift format. It supports Thrift DDL so users could read the data outside Hive.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-4308) Hive: DynamicSerDe based on thrift DDL

Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12643695#action_12643695 ] 

Zheng Shao commented on HADOOP-4308:
------------------------------------

Yes. 

Hive 2 now has the capability to create and query and insert into tables with DynamicSerDe. I will update Hive 2 README to make it clear to users.

There is a lot of interest in a RegularExpressionDeserializer for reading log files like apache logs. Do we have a jira open for that?


> Hive: DynamicSerDe based on thrift DDL
> --------------------------------------
>
>                 Key: HADOOP-4308
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4308
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: contrib/hive
>            Reporter: Zheng Shao
>            Assignee: Zheng Shao
>
> This is the DynamicSerDe code in hive/serde that supports serialization/deserialization in thrift format. It supports Thrift DDL so users could read the data outside Hive.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-4308) Hive: DynamicSerDe based on thrift DDL

Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zheng Shao updated HADOOP-4308:
-------------------------------

    Component/s: contrib/hive
     Issue Type: New Feature  (was: Bug)

> Hive: DynamicSerDe based on thrift DDL
> --------------------------------------
>
>                 Key: HADOOP-4308
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4308
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: contrib/hive
>            Reporter: Zheng Shao
>            Assignee: Zheng Shao
>
> This is the DynamicSerDe code in hive/serde that supports serialization/deserialization in thrift format. It supports Thrift DDL so users could read the data outside Hive.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.