You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Marc Sturlese <ma...@gmail.com> on 2011/01/04 19:02:28 UTC

SequenceFiles and streaming or hdfs thrift api

Hey there,
I have the need to write a file to a hdfs cluster in php. I now I can do
that with the hdfs thrift api.
http://wiki.apache.org/hadoop/HDFS-APIs

The thing is I want this file to be a SequenceFile, where the key should be
a Text and the value a Thrift serialized object. Is it possible to reach
that goal?
Thanks in advance
-- 
View this message in context: http://lucene.472066.n3.nabble.com/SequenceFiles-and-streaming-or-hdfs-thrift-api-tp2193101p2193101.html
Sent from the Hadoop lucene-users mailing list archive at Nabble.com.

Re: SequenceFiles and streaming or hdfs thrift api

Posted by Owen O'Malley <om...@apache.org>.

On Tue, Jan 4, 2011 at 10:02 AM, Marc Sturlese <ma...@gmail.com>wrote:

> The thing is I want this file to be a SequenceFile, where the key should be
> a Text and the value a Thrift serialized object. Is it possible to reach
> that goal?
>

I've done the work to support that in Java. See my patch in HADOOP-6685. It
also adds seamless support for ProtocolBuffers and Avro in SequenceFiles
with arbitrary combinations of keys and values using different
serializations.

-- Owen