Is there a java implementation to serialize a large record that does not fit in-memory?

[levi12 <ds...@gmail.com>]

I'm pretty new to avro and am trying to evaluate its potential as a
"container" for hdfs file contents.
I do know about SequenceFiles but would like a language agnostic file format
if possible.

>From the java api it seems like all object serialization occurs in-memory,
which seems to bound potential record size to the amount of available
memory. Is there another java workaround or implementation that I'm not
seeing? Explanations about feasibility (or lack of) would be very helpful.

Thanks!



--
View this message in context: http://apache-avro.679487.n3.nabble.com/Is-there-a-java-implementation-to-serialize-a-large-record-that-does-not-fit-in-memory-tp4030943.html
Sent from the Avro - Users mailing list archive at Nabble.com.