You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Chris Nicholas <ch...@att.net> on 2010/07/15 20:02:49 UTC
newbie SerDe question
greetings -
I'm looking to migrate gobs of ProtocolBuffer logs to Hive, and tweek the Java
servlet that writes these logs to just store directly to SerDe format....It'll
be interesting to see how HDFS write operations perform, and if we can juggle
things partitioned on days so I can just crunch directly on the logs.
While I realize generalized ProtocolBuffer support on a par with Thrift is
non-trivial, this particular thingy is relatively stable, so doing a one-off is
entirely reasonable.
Are there any working examples out there apart from:
http://www.congiu.com/node/7
and
https://lwes.svn.sourceforge.net/svnroot/lwes/contrib/lwes-hive-serde/trunk/src/main/java/org/lwes/hadoop/hive/EventSerDe.java
?
thanks!!
Chris