copying binary files to a SequenceFile

[Mark Kerzner <ma...@gmail.com>]

Hi all,

I am copying regular binary files to a SequenceFile, and I am using
BytesWritable, to which I am giving all the byte[] content of the file.
However, once it hits a file larger than my computer memory, it may have
problems. Is there a better way?

Thank you,
Mark

Re: copying binary files to a SequenceFile

[Rasit OZDAS <ra...@gmail.com>]

Mark,
http://stuartsierra.com/2008/04/24/a-million-little-files/comment-page-1

In this link, there is a tool to create sequence files from tar.gz and
tar.bz2 files.
I don't think that this is a real solution, but at least it means more
free memory and delay of problems (worst solution).

Rasit

2009/2/5 Mark Kerzner <ma...@gmail.com>:
> Hi all,
>
> I am copying regular binary files to a SequenceFile, and I am using
> BytesWritable, to which I am giving all the byte[] content of the file.
> However, once it hits a file larger than my computer memory, it may have
> problems. Is there a better way?
>
> Thank you,
> Mark
>



-- 
M. Raşit ÖZDAŞ