You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Cam Bazz <ca...@gmail.com> on 2008/09/04 17:58:21 UTC
ramdisks
hello,
anyone using ramdisks for storage? there is ramsam and there is also fusion
io. but they are kinda expensive. any other alternatives I wonder?
Best.
Re: ramdisks
Posted by Toke Eskildsen <te...@statsbiblioteket.dk>.
On Fri, 2008-09-05 at 11:00 +0200, Toke Eskildsen wrote:
> As for Flash-SSDs, we've tried 2 * MTRON 6000 32GB RAID 0, 2 * SanDisk
> 5000 32GB RAID 0 and SanDisk something (64GB model) both as single drive
> and 4 drives in RAID 0.
Update:
The "SanDisk something" turned out to be a Samsung MCCOE64G5MPP-0VA00,
when I asked our hardware-department. My apologies to the list and to
Samsung.
By coincidence (or not. I'm not the one that picked the SSD), it's the
drive recommended in
http://www.tomshardware.com/reviews/flash-ssd-hard-drive,2000.html
which seems a relevant read for this thread.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: ramdisks
Posted by Toke Eskildsen <te...@statsbiblioteket.dk>.
On Fri, 2008-09-05 at 10:33 +0200, Cam Bazz wrote:
[RAM vs. Flash-SSD vs. harddrives]
> I have done similar test with ram vs. disk, and IO was the bottleneck.
> What flash ssd did you try with?
For disks (as in conventional 10.000/15.000 RPM harddrives), IO is
clearly the bottleneck for us also.
As for Flash-SSDs, we've tried 2 * MTRON 6000 32GB RAID 0, 2 * SanDisk
5000 32GB RAID 0 and SanDisk something (64GB model) both as single drive
and 4 drives in RAID 0.
However, the performance-observation only goes for querying the indexes.
For building, we haven't performed any substantial tests for RAM and for
Flash-SSDs vs. harddrives, only the newest SanDisk gave any noticeable
increase.
One important observation with regard to updating is that our setup with
SSDs requires a lot less warmup-time as compared to conventional
harddisks. This allows for shorter delays before new content is visible.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: ramdisks
Posted by Cam Bazz <ca...@gmail.com>.
> On Thu, 2008-09-04 at 17:58 +0200, Cam Bazz wrote:
> > anyone using ramdisks for storage? there is ramsam and there is also
> fusion
> > io. but they are kinda expensive. any other alternatives I wonder?
>
> We've done some comparisons of RAM (Lucene RAMDirectory) vs. Flash-SSD
> vs. conventional harddrives. We've seen significant improvements for
> Flash-SSDs over harddrives, but less for RAM over Flash-SSDs.
>
> For our setup (Linux, Flash-SSDs, 4 core Xeon, simple searches, 37GB
> index, 10M documents, ~70 fields), the CPU seems to be the bottleneck.
> Testing with a commodity Flash-SSD might be worth trying before going
> all-out with the RAM-based systems.
>
I have done similar test with ram vs. disk, and IO was the bottleneck. What
flash ssd did you try with?
Best.
Re: ramdisks
Posted by Toke Eskildsen <te...@statsbiblioteket.dk>.
On Thu, 2008-09-04 at 17:58 +0200, Cam Bazz wrote:
> anyone using ramdisks for storage? there is ramsam and there is also fusion
> io. but they are kinda expensive. any other alternatives I wonder?
We've done some comparisons of RAM (Lucene RAMDirectory) vs. Flash-SSD
vs. conventional harddrives. We've seen significant improvements for
Flash-SSDs over harddrives, but less for RAM over Flash-SSDs.
For our setup (Linux, Flash-SSDs, 4 core Xeon, simple searches, 37GB
index, 10M documents, ~70 fields), the CPU seems to be the bottleneck.
Testing with a commodity Flash-SSD might be worth trying before going
all-out with the RAM-based systems.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org