You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Peter Velikin <pe...@velobit.com> on 2012/01/19 00:32:33 UTC
How to accelerate your Solr-Lucene appication by 4x
Hello Solr users,
Did you know that you can boost the performance of your Solr application
using your existing servers? All you need is commodity SSD and plug-and-play
software like VeloBit.
At ZoomInfo, a leading business information provider, VeloBit increased the
performance of the Solr-Lucene-powered application by 4x.
I would love to tell you more about VeloBit and find out if we can deliver
same business benefits at your company. Click here
<http://www.velobit.com/15-minute-brief> for a 15-minute briefing
<http://www.velobit.com/15-minute-brief> on the VeloBit technology.
Here is more information on how VeloBit helped ZoomInfo:
* Increased Solr-Lucene performance by 4x using existing servers and
commodity SSD
* Installed VeloBit plug-and-play SSD caching software in 5-minutes
transparent to running applications and storage infrastructure
* Reduced by 75% the hardware and monthly operating costs required to
support service level agreements
Technical Details:
* Environment: Solr‐Lucene indexed directory search service fronted
by J2EE web application technology
* Index size: 600 GB
* Number of items indexed: 50 million
* Primary storage: 6 x SAS HDD
* SSD Cache: VeloBit software + OCZ Vertex 3
Click here <http://www.velobit.com/use-cases/enterprise-search/> to read
more about the ZoomInfo Solr-Lucene case study
<http://www.velobit.com/use-cases/enterprise-search/> .
You can also sign up
<http://www.velobit.com/early-access-program-accelerate-application> for
our Early Access Program
<http://www.velobit.com/early-access-program-accelerate-application> and
try VeloBit HyperCache for free.
Also, feel free to write to me directly at peter@velobit.com.
Best regards,
Peter Velikin
VP Online Marketing, VeloBit, Inc.
peter@velobit.com
tel. 978-263-4800
mob. 617-306-7165
Description: VeloBit with tagline
VeloBit provides plug & play SSD caching software that dramatically
accelerates applications at a remarkably low cost. The software installs
seamlessly in less than 10 minutes and automatically tunes for fastest
application speed. Visit <http://www.velobit.com> www.velobit.com for
details.
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Jason Rutherglen <ja...@gmail.com>.
> 2. they always *follow* on-topic discussion
Not in the example given.
> 3. the line is blurry, e.g. nobody will object to including one's employer in a tagline.
Product placement is not blurry. The incentive is to then answer
someone else's user email, in order to post yet another spam'd product
placement ad, which is exactly what is happening.
Comparatively Peter has only posted 1 time, whereas Otis' spam is
recurring, there is large difference.
The Lucene user mailing list is being used as a free advertising forum
for a specific product (eg, it's not a company, employer, or event).
If you are fine with that, then your statements are contradictory.
On Thu, Jan 19, 2012 at 12:31 PM, Steven A Rowe <sa...@syr.edu> wrote:
> Jason,
>
> If I understand you correctly, you're referring to a thread <http://search-lucene.com/m/iMCFOqzcmS1/%22Performance+Monitoring+SaaS+for+Solr%22/v=threaded> in which you objected to a commercial tagline.
>
> At the time that thread was active, I didn't agree with you, though I didn't engage in the conversation. Here's why I didn't (and still don't) agree:
>
> 1. taglines are short;
> 2. they always *follow* on-topic discussion, and web page ads, Google search results and Android apps, following in the long tradition of print periodical practice, have taught me to accept -- and mostly ignore -- commercials on the margins of digital content; and
> 3. the line is blurry, e.g. nobody will object to including one's employer in a tagline.
>
> And to follow up on your point about fairness in application of Lucene's (no-it's-not-written-down-and-no-we're-never-going-to-write-it-down-either) commercial message policy, I'll echo Ted's observation that some commercial messages (depending on content, tone and context) are acceptable.
>
> Steve
>
>> -----Original Message-----
>> From: Jason Rutherglen [mailto:jason.rutherglen@gmail.com]
>> Sent: Wednesday, January 18, 2012 11:33 PM
>> To: solr-user@lucene.apache.org
>> Subject: Re: How to accelerate your Solr-Lucene appication by 4x
>>
>> Steven,
>>
>> Fun-NY...
>>
>> 17 hits for this spam:
>>
>> http://search-lucene.com/?q=%22Performance+Monitoring+SaaS+for+Solr%22
>>
>> Though this was already partially discussed with Chris @ fucu.org
>> which according to him, should have already been moved to Lucene
>> General.
>>
>> On Wed, Jan 18, 2012 at 11:04 PM, Steven A Rowe <sa...@syr.edu> wrote:
>> > Why Jason, I declare, whatever do you mean?
>> >
>> >
>> >> -----Original Message-----
>> >> From: Jason Rutherglen [mailto:jason.rutherglen@gmail.com]
>> >> Sent: Wednesday, January 18, 2012 8:29 PM
>> >> To: solr-user@lucene.apache.org
>> >> Subject: Re: How to accelerate your Solr-Lucene appication by 4x
>> >>
>> >> Steven,
>> >>
>> >> If you are going to admonish people for advertising, it should be
>> >> equally dished out or not at all.
>> >>
>> >> On Wed, Jan 18, 2012 at 6:38 PM, Steven A Rowe <sa...@syr.edu> wrote:
>> >> > Hi Peter,
>> >> >
>> >> > Commercial solicitations are taboo here, except in the context of a
>> >> request for help that is directly relevant to a product or service.
>> >> >
>> >> > Please don’t do this again.
>> >> >
>> >> > Steve Rowe
>> >> >
>> >> > From: Peter Velikin [mailto:peter@velobit.com]
>> >> > Sent: Wednesday, January 18, 2012 6:33 PM
>> >> > To: solr-user@lucene.apache.org
>> >> > Subject: How to accelerate your Solr-Lucene appication by 4x
>> >> >
>> >> > Hello Solr users,
>> >> >
>> >> > Did you know that you can boost the performance of your Solr
>> application
>> >> using your existing servers? All you need is commodity SSD and plug-
>> and-
>> >> play software like VeloBit.
>> >> >
>> >> > At ZoomInfo, a leading business information provider, VeloBit
>> increased
>> >> the performance of the Solr-Lucene-powered application by 4x.
>> >> >
>> >> > I would love to tell you more about VeloBit and find out if we can
>> >> deliver same business benefits at your company. Click
>> >> here<http://www.velobit.com/15-minute-brief> for a 15-minute
>> >> briefing<http://www.velobit.com/15-minute-brief> on the VeloBit
>> >> technology.
>> >> >
>> >> > Here is more information on how VeloBit helped ZoomInfo:
>> >> >
>> >> > * Increased Solr-Lucene performance by 4x using existing servers
>> and
>> >> commodity SSD
>> >> > * Installed VeloBit plug-and-play SSD caching software in 5-
>> minutes
>> >> transparent to running applications and storage infrastructure
>> >> > * Reduced by 75% the hardware and monthly operating costs required
>> to
>> >> support service level agreements
>> >> >
>> >> > Technical Details:
>> >> >
>> >> > * Environment: Solr‐Lucene indexed directory search service
>> fronted
>> >> by J2EE web application technology
>> >> > * Index size: 600 GB
>> >> > * Number of items indexed: 50 million
>> >> > * Primary storage: 6 x SAS HDD
>> >> > * SSD Cache: VeloBit software + OCZ Vertex 3
>> >> >
>> >> > Click here<http://www.velobit.com/use-cases/enterprise-search/> to
>> read
>> >> more about the ZoomInfo Solr-Lucene case
>> study<http://www.velobit.com/use-
>> >> cases/enterprise-search/>.
>> >> >
>> >> > You can also sign up<http://www.velobit.com/early-access-program-
>> >> accelerate-application> for our Early Access
>> >> Program<http://www.velobit.com/early-access-program-accelerate-
>> >> application> and try VeloBit HyperCache for free.
>> >> >
>> >> > Also, feel free to write to me directly at
>> >> peter@velobit.com<ma...@velobit.com>.
>> >> >
>> >> > Best regards,
>> >> >
>> >> > Peter Velikin
>> >> > VP Online Marketing, VeloBit, Inc.
>> >> > peter@velobit.com<ma...@velobit.com>
>> >> > tel. 978-263-4800
>> >> > mob. 617-306-7165
>> >> > [Description: VeloBit with tagline]
>> >> > VeloBit provides plug & play SSD caching software that dramatically
>> >> accelerates applications at a remarkably low cost. The software
>> installs
>> >> seamlessly in less than 10 minutes and automatically tunes for fastest
>> >> application speed. Visit www.velobit.com<http://www.velobit.com> for
>> >> details.
RE: How to accelerate your Solr-Lucene appication by 4x
Posted by Steven A Rowe <sa...@syr.edu>.
Jason,
If I understand you correctly, you're referring to a thread <http://search-lucene.com/m/iMCFOqzcmS1/%22Performance+Monitoring+SaaS+for+Solr%22/v=threaded> in which you objected to a commercial tagline.
At the time that thread was active, I didn't agree with you, though I didn't engage in the conversation. Here's why I didn't (and still don't) agree:
1. taglines are short;
2. they always *follow* on-topic discussion, and web page ads, Google search results and Android apps, following in the long tradition of print periodical practice, have taught me to accept -- and mostly ignore -- commercials on the margins of digital content; and
3. the line is blurry, e.g. nobody will object to including one's employer in a tagline.
And to follow up on your point about fairness in application of Lucene's (no-it's-not-written-down-and-no-we're-never-going-to-write-it-down-either) commercial message policy, I'll echo Ted's observation that some commercial messages (depending on content, tone and context) are acceptable.
Steve
> -----Original Message-----
> From: Jason Rutherglen [mailto:jason.rutherglen@gmail.com]
> Sent: Wednesday, January 18, 2012 11:33 PM
> To: solr-user@lucene.apache.org
> Subject: Re: How to accelerate your Solr-Lucene appication by 4x
>
> Steven,
>
> Fun-NY...
>
> 17 hits for this spam:
>
> http://search-lucene.com/?q=%22Performance+Monitoring+SaaS+for+Solr%22
>
> Though this was already partially discussed with Chris @ fucu.org
> which according to him, should have already been moved to Lucene
> General.
>
> On Wed, Jan 18, 2012 at 11:04 PM, Steven A Rowe <sa...@syr.edu> wrote:
> > Why Jason, I declare, whatever do you mean?
> >
> >
> >> -----Original Message-----
> >> From: Jason Rutherglen [mailto:jason.rutherglen@gmail.com]
> >> Sent: Wednesday, January 18, 2012 8:29 PM
> >> To: solr-user@lucene.apache.org
> >> Subject: Re: How to accelerate your Solr-Lucene appication by 4x
> >>
> >> Steven,
> >>
> >> If you are going to admonish people for advertising, it should be
> >> equally dished out or not at all.
> >>
> >> On Wed, Jan 18, 2012 at 6:38 PM, Steven A Rowe <sa...@syr.edu> wrote:
> >> > Hi Peter,
> >> >
> >> > Commercial solicitations are taboo here, except in the context of a
> >> request for help that is directly relevant to a product or service.
> >> >
> >> > Please don’t do this again.
> >> >
> >> > Steve Rowe
> >> >
> >> > From: Peter Velikin [mailto:peter@velobit.com]
> >> > Sent: Wednesday, January 18, 2012 6:33 PM
> >> > To: solr-user@lucene.apache.org
> >> > Subject: How to accelerate your Solr-Lucene appication by 4x
> >> >
> >> > Hello Solr users,
> >> >
> >> > Did you know that you can boost the performance of your Solr
> application
> >> using your existing servers? All you need is commodity SSD and plug-
> and-
> >> play software like VeloBit.
> >> >
> >> > At ZoomInfo, a leading business information provider, VeloBit
> increased
> >> the performance of the Solr-Lucene-powered application by 4x.
> >> >
> >> > I would love to tell you more about VeloBit and find out if we can
> >> deliver same business benefits at your company. Click
> >> here<http://www.velobit.com/15-minute-brief> for a 15-minute
> >> briefing<http://www.velobit.com/15-minute-brief> on the VeloBit
> >> technology.
> >> >
> >> > Here is more information on how VeloBit helped ZoomInfo:
> >> >
> >> > * Increased Solr-Lucene performance by 4x using existing servers
> and
> >> commodity SSD
> >> > * Installed VeloBit plug-and-play SSD caching software in 5-
> minutes
> >> transparent to running applications and storage infrastructure
> >> > * Reduced by 75% the hardware and monthly operating costs required
> to
> >> support service level agreements
> >> >
> >> > Technical Details:
> >> >
> >> > * Environment: Solr‐Lucene indexed directory search service
> fronted
> >> by J2EE web application technology
> >> > * Index size: 600 GB
> >> > * Number of items indexed: 50 million
> >> > * Primary storage: 6 x SAS HDD
> >> > * SSD Cache: VeloBit software + OCZ Vertex 3
> >> >
> >> > Click here<http://www.velobit.com/use-cases/enterprise-search/> to
> read
> >> more about the ZoomInfo Solr-Lucene case
> study<http://www.velobit.com/use-
> >> cases/enterprise-search/>.
> >> >
> >> > You can also sign up<http://www.velobit.com/early-access-program-
> >> accelerate-application> for our Early Access
> >> Program<http://www.velobit.com/early-access-program-accelerate-
> >> application> and try VeloBit HyperCache for free.
> >> >
> >> > Also, feel free to write to me directly at
> >> peter@velobit.com<ma...@velobit.com>.
> >> >
> >> > Best regards,
> >> >
> >> > Peter Velikin
> >> > VP Online Marketing, VeloBit, Inc.
> >> > peter@velobit.com<ma...@velobit.com>
> >> > tel. 978-263-4800
> >> > mob. 617-306-7165
> >> > [Description: VeloBit with tagline]
> >> > VeloBit provides plug & play SSD caching software that dramatically
> >> accelerates applications at a remarkably low cost. The software
> installs
> >> seamlessly in less than 10 minutes and automatically tunes for fastest
> >> application speed. Visit www.velobit.com<http://www.velobit.com> for
> >> details.
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Jason Rutherglen <ja...@gmail.com>.
Steven,
Fun-NY...
17 hits for this spam:
http://search-lucene.com/?q=%22Performance+Monitoring+SaaS+for+Solr%22
Though this was already partially discussed with Chris @ fucu.org
which according to him, should have already been moved to Lucene
General.
On Wed, Jan 18, 2012 at 11:04 PM, Steven A Rowe <sa...@syr.edu> wrote:
> Why Jason, I declare, whatever do you mean?
>
>
>> -----Original Message-----
>> From: Jason Rutherglen [mailto:jason.rutherglen@gmail.com]
>> Sent: Wednesday, January 18, 2012 8:29 PM
>> To: solr-user@lucene.apache.org
>> Subject: Re: How to accelerate your Solr-Lucene appication by 4x
>>
>> Steven,
>>
>> If you are going to admonish people for advertising, it should be
>> equally dished out or not at all.
>>
>> On Wed, Jan 18, 2012 at 6:38 PM, Steven A Rowe <sa...@syr.edu> wrote:
>> > Hi Peter,
>> >
>> > Commercial solicitations are taboo here, except in the context of a
>> request for help that is directly relevant to a product or service.
>> >
>> > Please don’t do this again.
>> >
>> > Steve Rowe
>> >
>> > From: Peter Velikin [mailto:peter@velobit.com]
>> > Sent: Wednesday, January 18, 2012 6:33 PM
>> > To: solr-user@lucene.apache.org
>> > Subject: How to accelerate your Solr-Lucene appication by 4x
>> >
>> > Hello Solr users,
>> >
>> > Did you know that you can boost the performance of your Solr application
>> using your existing servers? All you need is commodity SSD and plug-and-
>> play software like VeloBit.
>> >
>> > At ZoomInfo, a leading business information provider, VeloBit increased
>> the performance of the Solr-Lucene-powered application by 4x.
>> >
>> > I would love to tell you more about VeloBit and find out if we can
>> deliver same business benefits at your company. Click
>> here<http://www.velobit.com/15-minute-brief> for a 15-minute
>> briefing<http://www.velobit.com/15-minute-brief> on the VeloBit
>> technology.
>> >
>> > Here is more information on how VeloBit helped ZoomInfo:
>> >
>> > * Increased Solr-Lucene performance by 4x using existing servers and
>> commodity SSD
>> > * Installed VeloBit plug-and-play SSD caching software in 5-minutes
>> transparent to running applications and storage infrastructure
>> > * Reduced by 75% the hardware and monthly operating costs required to
>> support service level agreements
>> >
>> > Technical Details:
>> >
>> > * Environment: Solr‐Lucene indexed directory search service fronted
>> by J2EE web application technology
>> > * Index size: 600 GB
>> > * Number of items indexed: 50 million
>> > * Primary storage: 6 x SAS HDD
>> > * SSD Cache: VeloBit software + OCZ Vertex 3
>> >
>> > Click here<http://www.velobit.com/use-cases/enterprise-search/> to read
>> more about the ZoomInfo Solr-Lucene case study<http://www.velobit.com/use-
>> cases/enterprise-search/>.
>> >
>> > You can also sign up<http://www.velobit.com/early-access-program-
>> accelerate-application> for our Early Access
>> Program<http://www.velobit.com/early-access-program-accelerate-
>> application> and try VeloBit HyperCache for free.
>> >
>> > Also, feel free to write to me directly at
>> peter@velobit.com<ma...@velobit.com>.
>> >
>> > Best regards,
>> >
>> > Peter Velikin
>> > VP Online Marketing, VeloBit, Inc.
>> > peter@velobit.com<ma...@velobit.com>
>> > tel. 978-263-4800
>> > mob. 617-306-7165
>> > [Description: VeloBit with tagline]
>> > VeloBit provides plug & play SSD caching software that dramatically
>> accelerates applications at a remarkably low cost. The software installs
>> seamlessly in less than 10 minutes and automatically tunes for fastest
>> application speed. Visit www.velobit.com<http://www.velobit.com> for
>> details.
RE: How to accelerate your Solr-Lucene appication by 4x
Posted by Steven A Rowe <sa...@syr.edu>.
Why Jason, I declare, whatever do you mean?
> -----Original Message-----
> From: Jason Rutherglen [mailto:jason.rutherglen@gmail.com]
> Sent: Wednesday, January 18, 2012 8:29 PM
> To: solr-user@lucene.apache.org
> Subject: Re: How to accelerate your Solr-Lucene appication by 4x
>
> Steven,
>
> If you are going to admonish people for advertising, it should be
> equally dished out or not at all.
>
> On Wed, Jan 18, 2012 at 6:38 PM, Steven A Rowe <sa...@syr.edu> wrote:
> > Hi Peter,
> >
> > Commercial solicitations are taboo here, except in the context of a
> request for help that is directly relevant to a product or service.
> >
> > Please don’t do this again.
> >
> > Steve Rowe
> >
> > From: Peter Velikin [mailto:peter@velobit.com]
> > Sent: Wednesday, January 18, 2012 6:33 PM
> > To: solr-user@lucene.apache.org
> > Subject: How to accelerate your Solr-Lucene appication by 4x
> >
> > Hello Solr users,
> >
> > Did you know that you can boost the performance of your Solr application
> using your existing servers? All you need is commodity SSD and plug-and-
> play software like VeloBit.
> >
> > At ZoomInfo, a leading business information provider, VeloBit increased
> the performance of the Solr-Lucene-powered application by 4x.
> >
> > I would love to tell you more about VeloBit and find out if we can
> deliver same business benefits at your company. Click
> here<http://www.velobit.com/15-minute-brief> for a 15-minute
> briefing<http://www.velobit.com/15-minute-brief> on the VeloBit
> technology.
> >
> > Here is more information on how VeloBit helped ZoomInfo:
> >
> > * Increased Solr-Lucene performance by 4x using existing servers and
> commodity SSD
> > * Installed VeloBit plug-and-play SSD caching software in 5-minutes
> transparent to running applications and storage infrastructure
> > * Reduced by 75% the hardware and monthly operating costs required to
> support service level agreements
> >
> > Technical Details:
> >
> > * Environment: Solr‐Lucene indexed directory search service fronted
> by J2EE web application technology
> > * Index size: 600 GB
> > * Number of items indexed: 50 million
> > * Primary storage: 6 x SAS HDD
> > * SSD Cache: VeloBit software + OCZ Vertex 3
> >
> > Click here<http://www.velobit.com/use-cases/enterprise-search/> to read
> more about the ZoomInfo Solr-Lucene case study<http://www.velobit.com/use-
> cases/enterprise-search/>.
> >
> > You can also sign up<http://www.velobit.com/early-access-program-
> accelerate-application> for our Early Access
> Program<http://www.velobit.com/early-access-program-accelerate-
> application> and try VeloBit HyperCache for free.
> >
> > Also, feel free to write to me directly at
> peter@velobit.com<ma...@velobit.com>.
> >
> > Best regards,
> >
> > Peter Velikin
> > VP Online Marketing, VeloBit, Inc.
> > peter@velobit.com<ma...@velobit.com>
> > tel. 978-263-4800
> > mob. 617-306-7165
> > [Description: VeloBit with tagline]
> > VeloBit provides plug & play SSD caching software that dramatically
> accelerates applications at a remarkably low cost. The software installs
> seamlessly in less than 10 minutes and automatically tunes for fastest
> application speed. Visit www.velobit.com<http://www.velobit.com> for
> details.
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Otis Gospodnetic <ot...@yahoo.com>.
Hi Peter,
> Has anyone else tried adding SSDs as a cache to boost the performance of Solr clusters? Can you share your results?
What do you mean by using SSD *as a cache*?
A few years ago, Toke Eskildsen and his colleagues compared Lucene performance with traditional HDDs and SSDs and of course found that things fly with SSDs. But they simply put the index on either HDD or SSD, so I'm not sure what you mean by using SSDs "as a cache". I can see putting hot shards on SSDs and putting less frequently searches shards on regular HDDs, but I'm not sure if that is what you mean. Could you please clarify?
Thanks,
Otis
----
Performance Monitoring SaaS for Solr - http://sematext.com/spm/solr-performance-monitoring/index.html
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Ted Dunning <te...@gmail.com>.
Peter,
My guess is that if you had said something along the lines of "We have
developed some SSD support software that makes SOLR work better. I would
like to open a conversation here (link to external discussion)" that would
have been reasonably well received. One of the things that makes SPAM and
form letters so annoying is that you are devaluing the recipient by clearly
not taking them into account. Being one line in a mail merge table is not
considered by most to be a great goal in life.
On Thu, Jan 19, 2012 at 2:40 PM, Peter Velikin <pe...@velobit.com> wrote:
> All,
>
> Point taken: my message should have been written more succinctly and just
> stuck to the facts. Sorry for the sales pitch!
>
> However, I believe that adding SSD as a means to accelerate the
> performance of your Solr cluster is an important topic to discuss on this
> forum. There are many options for you to consider. I believe VeloBit would
> be the best option for many, but you have choices, some of them completely
> free. If interested, send me a note and I'll be happy to tell you about the
> different options (free or paid) you can consider.
>
> Solr clusters are I/O bound. I am arguing that before you buy additional
> servers, replace your existing servers with new ones, or swap your hard
> disks, you should try adding SSD as a cache. If the promise is that adding
> 1 SSD could save you the cost of 3 additional servers, you should try it.
>
> Has anyone else tried adding SSDs as a cache to boost the performance of
> Solr clusters? Can you share your results?
>
>
> Best regards,
>
> Peter Velikin
> VP Online Marketing, VeloBit, Inc.
> peter@velobit.com
> tel. 978-263-4800
> mob. 617-306-7165
>
> VeloBit provides plug & play SSD caching software that dramatically
> accelerates applications at a remarkably low cost. The software installs
> seamlessly in less than 10 minutes and automatically tunes for fastest
> application speed. Visit www.velobit.com for details.
>
>
>
>
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Otis Gospodnetic <ot...@yahoo.com>.
That's valuable info there. :)
So then I wonder which of the two, RAM or SSD, has a more favorable price/size trajectory...
Otis
----
Performance Monitoring SaaS for Solr - http://sematext.com/spm/solr-performance-monitoring/index.html
----- Original Message -----
> From: Ted Dunning <te...@gmail.com>
> To: solr-user@lucene.apache.org
> Cc:
> Sent: Friday, January 20, 2012 2:41 AM
> Subject: Re: How to accelerate your Solr-Lucene appication by 4x
>
> Actually, for search applications there is a reasonable amount of evidence
> that holding the index in RAM is actually more cost effective than SSD's
> because the throughput is enough faster to make up for the price
> differential. There are several papers out of UMass that describe this
> trade-off, although they are out-of-date enough to talk about 8GB memory as
> being big. One interest aspect of the work is the way that they keep an
> index highly compressed yet still fast to search.
>
> As a point of reference, most of Google's searches are served out of memory
> in pretty much just this way. Using SSD's would just slow them down.
>
> On Fri, Jan 20, 2012 at 5:16 AM, Fuad Efendi <fu...@efendi.ca> wrote:
>
>> I agree that SSD boosts performance... In some rare not-real-life scenario:
>> - super frequent commits
>> That's it, nothing more except the fact that Lucene compile time
> including
>> tests takes up to two minutes on MacBook with SSD, or forty-fifty minutes
>> on Windows with HDD.
>> Of course, with non-empty maven repository in both scenario, to be fair.
>>
>>
>> another scenario: imagine google file system is powered by SSD instead of
>> cheapest HDD... HAHAHA!!!
>>
>> Can we expect response time 0.1 milliseconds instead of 30-50?
>>
>>
>> And final question... Will SSD improve performance of fuzzy search? Range
>> queries? Etc
>>
>>
>>
>> I just want to say that SSD is faster than HDD but it doesn't mean
>> anything...
>>
>>
>>
>> -Fuad
>>
>>
>>
>>
>>
>> Sent from my iPad
>>
>> On 2012-01-19, at 9:40 AM, "Peter Velikin"
> <pe...@velobit.com> wrote:
>>
>> > All,
>> >
>> > Point taken: my message should have been written more succinctly and
>> just stuck to the facts. Sorry for the sales pitch!
>> >
>> > However, I believe that adding SSD as a means to accelerate the
>> performance of your Solr cluster is an important topic to discuss on this
>> forum. There are many options for you to consider. I believe VeloBit would
>> be the best option for many, but you have choices, some of them completely
>> free. If interested, send me a note and I'll be happy to tell you about
> the
>> different options (free or paid) you can consider.
>> >
>> > Solr clusters are I/O bound. I am arguing that before you buy
> additional
>> servers, replace your existing servers with new ones, or swap your hard
>> disks, you should try adding SSD as a cache. If the promise is that adding
>> 1 SSD could save you the cost of 3 additional servers, you should try it.
>> >
>> > Has anyone else tried adding SSDs as a cache to boost the performance
> of
>> Solr clusters? Can you share your results?
>> >
>> >
>> > Best regards,
>> >
>> > Peter Velikin
>> > VP Online Marketing, VeloBit, Inc.
>> > peter@velobit.com
>> > tel. 978-263-4800
>> > mob. 617-306-7165
>> >
>> > VeloBit provides plug & play SSD caching software that
> dramatically
>> accelerates applications at a remarkably low cost. The software installs
>> seamlessly in less than 10 minutes and automatically tunes for fastest
>> application speed. Visit www.velobit.com for details.
>> >
>> >
>> >
>>
>
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Ted Dunning <te...@gmail.com>.
It sounds bad with a 600GB index, but the techniques in the UMass achieve a
substantial compression of the in-memory size (remember that only part of
the index needs to be memory resident).
If you assume that you get 2x compression from compression and elision then
you only need 3-5 fat-memory machines to handle this load. These machines
will be moderately expensive, but memory is pretty cheap lately.
This configuration has a substantial benefit when the query rate is high
because the cost of memory is much smaller than the cost of sheet metal,
power supplies and CPU's. When the query rate is low, then spinning rust
has an advantage because it is cheap per bit.
On Fri, Jan 20, 2012 at 7:23 AM, Peter Velikin <pe...@velobit.com> wrote:
> Ted, Otis,
>
>
>
> Thanks for the info. I’ll take a stab at answering your question.
>
>
>
> RAM:
>
> Both of you are correct that if you were able to keep your index in RAM,
> that would give you the fastest results. This works if you have a small
> enough index. At ZoomInfo, the index was 600 GB (they have multiple types
> of indexed data), so there was no way to keep it in RAM. Due to the size of
> the index, they have elected to "shard" the data across two sets of systems
> for manageability and performance reasons. So, while in theory performance
> would be fastest if you keep the entire index in RAM, this is not possible
> or at least not practical if you have a large index.
>
>
>
> All SSD:
>
> SSDs are a lot faster, so if you swap your HDDs with SSD, performance will
> go up. But that’s really expensive and is also disruptive. In Zoom’s case,
> they have a cluster of Dell 2970 servers with 8 cores, each with 6x 146GB,
> 15k rpm SAS drives. Going all SSD would be expensive for them and would
> also require a disruption to running servers.
>
>
>
> SSD as a cache only:
>
> Since they wanted to avoid the cost and disruption of upgrading the
> servers, Zoom added one OCZ Vertex 3 to each of the servers (at a cost of
> $230 per SSD) and ran it as an expansion of RAM (cache was a combination of
> RAM and SSD). All was configured on the running servers without any
> disruption to the running application. The result was an immediate 4x
> improvement in performance (responses per second went up from 12/sec to
> 48/sec, bandwidth went up from 500 KB/sec to 2.2 MB/sec). The VeloBit
> software acts as a driver that automatically configures and manages the
> RAM+SSD-combo cache; the value of SSD caching software is that it makes the
> whole process plug&play.
>
>
>
> So the argument is that adding 1 SSD to each server and using it as a
> cache (more precisely as cache expansion to the cache already in RAM) will
> give you the best price/performance benefit of all options you have.
>
>
>
> Does this clarify things? Was I able to answer your question?
>
>
>
> Best regards,
>
>
>
> Peter
>
>
>
>
>
>
>
> -----Original Message-----
> From: Ted Dunning [mailto:ted.dunning@gmail.com]
> Sent: Friday, January 20, 2012 2:42 AM
> To: solr-user@lucene.apache.org
> Subject: Re: How to accelerate your Solr-Lucene appication by 4x
>
>
>
> Actually, for search applications there is a reasonable amount of evidence
> that holding the index in RAM is actually more cost effective than SSD's
> because the throughput is enough faster to make up for the price
> differential. There are several papers out of UMass that describe this
> trade-off, although they are out-of-date enough to talk about 8GB memory as
> being big. One interest aspect of the work is the way that they keep an
> index highly compressed yet still fast to search.
>
>
>
> As a point of reference, most of Google's searches are served out of
> memory in pretty much just this way. Using SSD's would just slow them down.
>
>
>
> On Fri, Jan 20, 2012 at 5:16 AM, Fuad Efendi < <ma...@efendi.ca>
> fuad@efendi.ca> wrote:
>
>
>
> > I agree that SSD boosts performance... In some rare not-real-life
> scenario:
>
> > - super frequent commits
>
> > That's it, nothing more except the fact that Lucene compile time
>
> > including tests takes up to two minutes on MacBook with SSD, or
>
> > forty-fifty minutes on Windows with HDD.
>
> > Of course, with non-empty maven repository in both scenario, to be fair.
>
> >
>
> >
>
> > another scenario: imagine google file system is powered by SSD instead
>
> > of cheapest HDD... HAHAHA!!!
>
> >
>
> > Can we expect response time 0.1 milliseconds instead of 30-50?
>
> >
>
> >
>
> > And final question... Will SSD improve performance of fuzzy search?
>
> > Range queries? Etc
>
> >
>
> >
>
> >
>
> > I just want to say that SSD is faster than HDD but it doesn't mean
>
> > anything...
>
> >
>
> >
>
> >
>
> > -Fuad
>
> >
>
> >
>
> >
>
> >
>
> >
>
> > Sent from my iPad
>
> >
>
> > On 2012-01-19, at 9:40 AM, "Peter Velikin" < <ma...@velobit.com>
> peter@velobit.com> wrote:
>
> >
>
> > > All,
>
> > >
>
> > > Point taken: my message should have been written more succinctly and
>
> > just stuck to the facts. Sorry for the sales pitch!
>
> > >
>
> > > However, I believe that adding SSD as a means to accelerate the
>
> > performance of your Solr cluster is an important topic to discuss on
>
> > this forum. There are many options for you to consider. I believe
>
> > VeloBit would be the best option for many, but you have choices, some
>
> > of them completely free. If interested, send me a note and I'll be
>
> > happy to tell you about the different options (free or paid) you can
> consider.
>
> > >
>
> > > Solr clusters are I/O bound. I am arguing that before you buy
>
> > > additional
>
> > servers, replace your existing servers with new ones, or swap your
>
> > hard disks, you should try adding SSD as a cache. If the promise is
>
> > that adding
>
> > 1 SSD could save you the cost of 3 additional servers, you should try it.
>
> > >
>
> > > Has anyone else tried adding SSDs as a cache to boost the
>
> > > performance of
>
> > Solr clusters? Can you share your results?
>
> > >
>
> > >
>
> > > Best regards,
>
> > >
>
> > > Peter Velikin
>
> > > VP Online Marketing, VeloBit, Inc.
>
> > > <ma...@velobit.com> peter@velobit.com
>
> > > tel. 978-263-4800
>
> > > mob. 617-306-7165
>
> > >
>
> > > VeloBit provides plug & play SSD caching software that dramatically
>
> > accelerates applications at a remarkably low cost. The software
>
> > installs seamlessly in less than 10 minutes and automatically tunes
>
> > for fastest application speed. Visit <http://www.velobit.com>
> www.velobit.com for details.
>
> > >
>
> > >
>
> > >
>
> >
>
>
RE: How to accelerate your Solr-Lucene appication by 4x
Posted by Peter Velikin <pe...@velobit.com>.
Hi Erick,
This is correct. An additional benefit to configuring the SSD as cache vs
primary storage is that you don't have to change anything to your existing
indexes (the cache will just give a performance boost).
In addition to configuring the system to utilize SSDs as the location where
pages go when swapped out of RAM, VeloBit does a few more performance
optimization tricks, which I will explain below.
(I am wary of the sensitivity to commercial messages: the following will
explain some of the differentiators of VeloBit. So, if you have an aversion
to vendors promoting themselves, please do not read further)
VeloBit
- configures SSDs to appear as cache expansion
- compresses data at the block level so you can hold much more data
in cache (cache will appear much bigger than the physical size of SSD and
RAM; you'll get higher performance since you'll less frequently have to read
data from slow HDD)
- makes decisions on what data to go in cache based on the
popularity of the contents of each block (increases cache hit rates and
system performance)
- optimizes how data is placed and managed on the SSD which takes
care of write, erase, and garbage collection limitations inherent to flash
based SSDs (increases the performance of SSDs and extends the life of the
SSD; this enables you to use a commodity SSD from Best Buy for enterprise
workloads instead of having to buy really expensive high-end SSDs)
- automates the whole process making everything plug & play (no
need to deal with storage and server architecture issues)
(end of commercial)
Best regards,
Peter
-----Original Message-----
From: Erick Erickson [mailto:erickerickson@gmail.com]
Sent: Friday, January 20, 2012 11:45 AM
To: solr-user@lucene.apache.org; peter@velobit.com
Subject: Re: How to accelerate your Solr-Lucene appication by 4x
Peter:
I admit I've just scanned the thread, but it sounds like what you're really
doing under the covers is configuring your system to utilize the SSDs as
where your pages go when it's swapped out of RAM, is this correct?
Which would certainly speed things up substantially if swapping was
happening...
Best
Erick
On Fri, Jan 20, 2012 at 7:23 AM, Peter Velikin < <ma...@velobit.com>
peter@velobit.com> wrote:
> Ted, Otis,
>
>
>
> Thanks for the info. I'll take a stab at answering your question.
>
>
>
> RAM:
>
> Both of you are correct that if you were able to keep your index in RAM,
that would give you the fastest results. This works if you have a small
enough index. At ZoomInfo, the index was 600 GB (they have multiple types of
indexed data), so there was no way to keep it in RAM. Due to the size of the
index, they have elected to "shard" the data across two sets of systems for
manageability and performance reasons. So, while in theory performance would
be fastest if you keep the entire index in RAM, this is not possible or at
least not practical if you have a large index.
>
>
>
> All SSD:
>
> SSDs are a lot faster, so if you swap your HDDs with SSD, performance will
go up. But that's really expensive and is also disruptive. In Zoom's case,
they have a cluster of Dell 2970 servers with 8 cores, each with 6x 146GB,
15k rpm SAS drives. Going all SSD would be expensive for them and would also
require a disruption to running servers.
>
>
>
> SSD as a cache only:
>
> Since they wanted to avoid the cost and disruption of upgrading the
servers, Zoom added one OCZ Vertex 3 to each of the servers (at a cost of
$230 per SSD) and ran it as an expansion of RAM (cache was a combination of
RAM and SSD). All was configured on the running servers without any
disruption to the running application. The result was an immediate 4x
improvement in performance (responses per second went up from 12/sec to
48/sec, bandwidth went up from 500 KB/sec to 2.2 MB/sec). The VeloBit
software acts as a driver that automatically configures and manages the
RAM+SSD-combo cache; the value of SSD caching software is that it makes the
whole process plug&play.
>
>
>
> So the argument is that adding 1 SSD to each server and using it as a
cache (more precisely as cache expansion to the cache already in RAM) will
give you the best price/performance benefit of all options you have.
>
>
>
> Does this clarify things? Was I able to answer your question?
>
>
>
> Best regards,
>
>
>
> Peter
>
>
>
>
>
>
>
> -----Original Message-----
> From: Ted Dunning [mailto:ted.dunning@gmail.com]
> Sent: Friday, January 20, 2012 2:42 AM
> To: solr-user@lucene.apache.org
> Subject: Re: How to accelerate your Solr-Lucene appication by 4x
>
>
>
> Actually, for search applications there is a reasonable amount of evidence
that holding the index in RAM is actually more cost effective than SSD's
because the throughput is enough faster to make up for the price
differential. There are several papers out of UMass that describe this
trade-off, although they are out-of-date enough to talk about 8GB memory as
being big. One interest aspect of the work is the way that they keep an
index highly compressed yet still fast to search.
>
>
>
> As a point of reference, most of Google's searches are served out of
memory in pretty much just this way. Using SSD's would just slow them down.
>
>
>
> On Fri, Jan 20, 2012 at 5:16 AM, Fuad Efendi < < <ma...@efendi.ca>
mailto:fuad@efendi.ca> <ma...@efendi.ca> fuad@efendi.ca> wrote:
>
>
>
>> I agree that SSD boosts performance... In some rare not-real-life
scenario:
>
>> - super frequent commits
>
>> That's it, nothing more except the fact that Lucene compile time
>
>> including tests takes up to two minutes on MacBook with SSD, or
>
>> forty-fifty minutes on Windows with HDD.
>
>> Of course, with non-empty maven repository in both scenario, to be fair.
>
>>
>
>>
>
>> another scenario: imagine google file system is powered by SSD
>> instead
>
>> of cheapest HDD... HAHAHA!!!
>
>>
>
>> Can we expect response time 0.1 milliseconds instead of 30-50?
>
>>
>
>>
>
>> And final question... Will SSD improve performance of fuzzy search?
>
>> Range queries? Etc
>
>>
>
>>
>
>>
>
>> I just want to say that SSD is faster than HDD but it doesn't mean
>
>> anything...
>
>>
>
>>
>
>>
>
>> -Fuad
>
>>
>
>>
>
>>
>
>>
>
>>
>
>> Sent from my iPad
>
>>
>
>> On 2012-01-19, at 9:40 AM, "Peter Velikin" < < <ma...@velobit.com>
mailto:peter@velobit.com> <ma...@velobit.com> peter@velobit.com>
wrote:
>
>>
>
>> > All,
>
>> >
>
>> > Point taken: my message should have been written more succinctly
>> > and
>
>> just stuck to the facts. Sorry for the sales pitch!
>
>> >
>
>> > However, I believe that adding SSD as a means to accelerate the
>
>> performance of your Solr cluster is an important topic to discuss on
>
>> this forum. There are many options for you to consider. I believe
>
>> VeloBit would be the best option for many, but you have choices, some
>
>> of them completely free. If interested, send me a note and I'll be
>
>> happy to tell you about the different options (free or paid) you can
consider.
>
>> >
>
>> > Solr clusters are I/O bound. I am arguing that before you buy
>
>> > additional
>
>> servers, replace your existing servers with new ones, or swap your
>
>> hard disks, you should try adding SSD as a cache. If the promise is
>
>> that adding
>
>> 1 SSD could save you the cost of 3 additional servers, you should try it.
>
>> >
>
>> > Has anyone else tried adding SSDs as a cache to boost the
>
>> > performance of
>
>> Solr clusters? Can you share your results?
>
>> >
>
>> >
>
>> > Best regards,
>
>> >
>
>> > Peter Velikin
>
>> > VP Online Marketing, VeloBit, Inc.
>
>> > < <ma...@velobit.com> mailto:peter@velobit.com>
<ma...@velobit.com> peter@velobit.com
>
>> > tel. 978-263-4800
>
>> > mob. 617-306-7165
>
>> >
>
>> > VeloBit provides plug & play SSD caching software that dramatically
>
>> accelerates applications at a remarkably low cost. The software
>
>> installs seamlessly in less than 10 minutes and automatically tunes
>
>> for fastest application speed. Visit < <http://www.velobit.com>
http://www.velobit.com> <http://www.velobit.com> www.velobit.com for
details.
>
>> >
>
>> >
>
>> >
>
>>
>
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Erick Erickson <er...@gmail.com>.
Peter:
I admit I've just scanned the thread, but it sounds like what you're really
doing under the covers is configuring your system to utilize the SSDs
as where your pages go when it's swapped out of RAM, is this correct?
Which would certainly speed things up substantially if swapping was
happening...
Best
Erick
On Fri, Jan 20, 2012 at 7:23 AM, Peter Velikin <pe...@velobit.com> wrote:
> Ted, Otis,
>
>
>
> Thanks for the info. I’ll take a stab at answering your question.
>
>
>
> RAM:
>
> Both of you are correct that if you were able to keep your index in RAM, that would give you the fastest results. This works if you have a small enough index. At ZoomInfo, the index was 600 GB (they have multiple types of indexed data), so there was no way to keep it in RAM. Due to the size of the index, they have elected to "shard" the data across two sets of systems for manageability and performance reasons. So, while in theory performance would be fastest if you keep the entire index in RAM, this is not possible or at least not practical if you have a large index.
>
>
>
> All SSD:
>
> SSDs are a lot faster, so if you swap your HDDs with SSD, performance will go up. But that’s really expensive and is also disruptive. In Zoom’s case, they have a cluster of Dell 2970 servers with 8 cores, each with 6x 146GB, 15k rpm SAS drives. Going all SSD would be expensive for them and would also require a disruption to running servers.
>
>
>
> SSD as a cache only:
>
> Since they wanted to avoid the cost and disruption of upgrading the servers, Zoom added one OCZ Vertex 3 to each of the servers (at a cost of $230 per SSD) and ran it as an expansion of RAM (cache was a combination of RAM and SSD). All was configured on the running servers without any disruption to the running application. The result was an immediate 4x improvement in performance (responses per second went up from 12/sec to 48/sec, bandwidth went up from 500 KB/sec to 2.2 MB/sec). The VeloBit software acts as a driver that automatically configures and manages the RAM+SSD-combo cache; the value of SSD caching software is that it makes the whole process plug&play.
>
>
>
> So the argument is that adding 1 SSD to each server and using it as a cache (more precisely as cache expansion to the cache already in RAM) will give you the best price/performance benefit of all options you have.
>
>
>
> Does this clarify things? Was I able to answer your question?
>
>
>
> Best regards,
>
>
>
> Peter
>
>
>
>
>
>
>
> -----Original Message-----
> From: Ted Dunning [mailto:ted.dunning@gmail.com]
> Sent: Friday, January 20, 2012 2:42 AM
> To: solr-user@lucene.apache.org
> Subject: Re: How to accelerate your Solr-Lucene appication by 4x
>
>
>
> Actually, for search applications there is a reasonable amount of evidence that holding the index in RAM is actually more cost effective than SSD's because the throughput is enough faster to make up for the price differential. There are several papers out of UMass that describe this trade-off, although they are out-of-date enough to talk about 8GB memory as being big. One interest aspect of the work is the way that they keep an index highly compressed yet still fast to search.
>
>
>
> As a point of reference, most of Google's searches are served out of memory in pretty much just this way. Using SSD's would just slow them down.
>
>
>
> On Fri, Jan 20, 2012 at 5:16 AM, Fuad Efendi < <ma...@efendi.ca> fuad@efendi.ca> wrote:
>
>
>
>> I agree that SSD boosts performance... In some rare not-real-life scenario:
>
>> - super frequent commits
>
>> That's it, nothing more except the fact that Lucene compile time
>
>> including tests takes up to two minutes on MacBook with SSD, or
>
>> forty-fifty minutes on Windows with HDD.
>
>> Of course, with non-empty maven repository in both scenario, to be fair.
>
>>
>
>>
>
>> another scenario: imagine google file system is powered by SSD instead
>
>> of cheapest HDD... HAHAHA!!!
>
>>
>
>> Can we expect response time 0.1 milliseconds instead of 30-50?
>
>>
>
>>
>
>> And final question... Will SSD improve performance of fuzzy search?
>
>> Range queries? Etc
>
>>
>
>>
>
>>
>
>> I just want to say that SSD is faster than HDD but it doesn't mean
>
>> anything...
>
>>
>
>>
>
>>
>
>> -Fuad
>
>>
>
>>
>
>>
>
>>
>
>>
>
>> Sent from my iPad
>
>>
>
>> On 2012-01-19, at 9:40 AM, "Peter Velikin" < <ma...@velobit.com> peter@velobit.com> wrote:
>
>>
>
>> > All,
>
>> >
>
>> > Point taken: my message should have been written more succinctly and
>
>> just stuck to the facts. Sorry for the sales pitch!
>
>> >
>
>> > However, I believe that adding SSD as a means to accelerate the
>
>> performance of your Solr cluster is an important topic to discuss on
>
>> this forum. There are many options for you to consider. I believe
>
>> VeloBit would be the best option for many, but you have choices, some
>
>> of them completely free. If interested, send me a note and I'll be
>
>> happy to tell you about the different options (free or paid) you can consider.
>
>> >
>
>> > Solr clusters are I/O bound. I am arguing that before you buy
>
>> > additional
>
>> servers, replace your existing servers with new ones, or swap your
>
>> hard disks, you should try adding SSD as a cache. If the promise is
>
>> that adding
>
>> 1 SSD could save you the cost of 3 additional servers, you should try it.
>
>> >
>
>> > Has anyone else tried adding SSDs as a cache to boost the
>
>> > performance of
>
>> Solr clusters? Can you share your results?
>
>> >
>
>> >
>
>> > Best regards,
>
>> >
>
>> > Peter Velikin
>
>> > VP Online Marketing, VeloBit, Inc.
>
>> > <ma...@velobit.com> peter@velobit.com
>
>> > tel. 978-263-4800
>
>> > mob. 617-306-7165
>
>> >
>
>> > VeloBit provides plug & play SSD caching software that dramatically
>
>> accelerates applications at a remarkably low cost. The software
>
>> installs seamlessly in less than 10 minutes and automatically tunes
>
>> for fastest application speed. Visit <http://www.velobit.com> www.velobit.com for details.
>
>> >
>
>> >
>
>> >
>
>>
>
RE: How to accelerate your Solr-Lucene appication by 4x
Posted by Peter Velikin <pe...@velobit.com>.
Ted, Otis,
Thanks for the info. I’ll take a stab at answering your question.
RAM:
Both of you are correct that if you were able to keep your index in RAM, that would give you the fastest results. This works if you have a small enough index. At ZoomInfo, the index was 600 GB (they have multiple types of indexed data), so there was no way to keep it in RAM. Due to the size of the index, they have elected to "shard" the data across two sets of systems for manageability and performance reasons. So, while in theory performance would be fastest if you keep the entire index in RAM, this is not possible or at least not practical if you have a large index.
All SSD:
SSDs are a lot faster, so if you swap your HDDs with SSD, performance will go up. But that’s really expensive and is also disruptive. In Zoom’s case, they have a cluster of Dell 2970 servers with 8 cores, each with 6x 146GB, 15k rpm SAS drives. Going all SSD would be expensive for them and would also require a disruption to running servers.
SSD as a cache only:
Since they wanted to avoid the cost and disruption of upgrading the servers, Zoom added one OCZ Vertex 3 to each of the servers (at a cost of $230 per SSD) and ran it as an expansion of RAM (cache was a combination of RAM and SSD). All was configured on the running servers without any disruption to the running application. The result was an immediate 4x improvement in performance (responses per second went up from 12/sec to 48/sec, bandwidth went up from 500 KB/sec to 2.2 MB/sec). The VeloBit software acts as a driver that automatically configures and manages the RAM+SSD-combo cache; the value of SSD caching software is that it makes the whole process plug&play.
So the argument is that adding 1 SSD to each server and using it as a cache (more precisely as cache expansion to the cache already in RAM) will give you the best price/performance benefit of all options you have.
Does this clarify things? Was I able to answer your question?
Best regards,
Peter
-----Original Message-----
From: Ted Dunning [mailto:ted.dunning@gmail.com]
Sent: Friday, January 20, 2012 2:42 AM
To: solr-user@lucene.apache.org
Subject: Re: How to accelerate your Solr-Lucene appication by 4x
Actually, for search applications there is a reasonable amount of evidence that holding the index in RAM is actually more cost effective than SSD's because the throughput is enough faster to make up for the price differential. There are several papers out of UMass that describe this trade-off, although they are out-of-date enough to talk about 8GB memory as being big. One interest aspect of the work is the way that they keep an index highly compressed yet still fast to search.
As a point of reference, most of Google's searches are served out of memory in pretty much just this way. Using SSD's would just slow them down.
On Fri, Jan 20, 2012 at 5:16 AM, Fuad Efendi < <ma...@efendi.ca> fuad@efendi.ca> wrote:
> I agree that SSD boosts performance... In some rare not-real-life scenario:
> - super frequent commits
> That's it, nothing more except the fact that Lucene compile time
> including tests takes up to two minutes on MacBook with SSD, or
> forty-fifty minutes on Windows with HDD.
> Of course, with non-empty maven repository in both scenario, to be fair.
>
>
> another scenario: imagine google file system is powered by SSD instead
> of cheapest HDD... HAHAHA!!!
>
> Can we expect response time 0.1 milliseconds instead of 30-50?
>
>
> And final question... Will SSD improve performance of fuzzy search?
> Range queries? Etc
>
>
>
> I just want to say that SSD is faster than HDD but it doesn't mean
> anything...
>
>
>
> -Fuad
>
>
>
>
>
> Sent from my iPad
>
> On 2012-01-19, at 9:40 AM, "Peter Velikin" < <ma...@velobit.com> peter@velobit.com> wrote:
>
> > All,
> >
> > Point taken: my message should have been written more succinctly and
> just stuck to the facts. Sorry for the sales pitch!
> >
> > However, I believe that adding SSD as a means to accelerate the
> performance of your Solr cluster is an important topic to discuss on
> this forum. There are many options for you to consider. I believe
> VeloBit would be the best option for many, but you have choices, some
> of them completely free. If interested, send me a note and I'll be
> happy to tell you about the different options (free or paid) you can consider.
> >
> > Solr clusters are I/O bound. I am arguing that before you buy
> > additional
> servers, replace your existing servers with new ones, or swap your
> hard disks, you should try adding SSD as a cache. If the promise is
> that adding
> 1 SSD could save you the cost of 3 additional servers, you should try it.
> >
> > Has anyone else tried adding SSDs as a cache to boost the
> > performance of
> Solr clusters? Can you share your results?
> >
> >
> > Best regards,
> >
> > Peter Velikin
> > VP Online Marketing, VeloBit, Inc.
> > <ma...@velobit.com> peter@velobit.com
> > tel. 978-263-4800
> > mob. 617-306-7165
> >
> > VeloBit provides plug & play SSD caching software that dramatically
> accelerates applications at a remarkably low cost. The software
> installs seamlessly in less than 10 minutes and automatically tunes
> for fastest application speed. Visit <http://www.velobit.com> www.velobit.com for details.
> >
> >
> >
>
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Ted Dunning <te...@gmail.com>.
Actually, for search applications there is a reasonable amount of evidence
that holding the index in RAM is actually more cost effective than SSD's
because the throughput is enough faster to make up for the price
differential. There are several papers out of UMass that describe this
trade-off, although they are out-of-date enough to talk about 8GB memory as
being big. One interest aspect of the work is the way that they keep an
index highly compressed yet still fast to search.
As a point of reference, most of Google's searches are served out of memory
in pretty much just this way. Using SSD's would just slow them down.
On Fri, Jan 20, 2012 at 5:16 AM, Fuad Efendi <fu...@efendi.ca> wrote:
> I agree that SSD boosts performance... In some rare not-real-life scenario:
> - super frequent commits
> That's it, nothing more except the fact that Lucene compile time including
> tests takes up to two minutes on MacBook with SSD, or forty-fifty minutes
> on Windows with HDD.
> Of course, with non-empty maven repository in both scenario, to be fair.
>
>
> another scenario: imagine google file system is powered by SSD instead of
> cheapest HDD... HAHAHA!!!
>
> Can we expect response time 0.1 milliseconds instead of 30-50?
>
>
> And final question... Will SSD improve performance of fuzzy search? Range
> queries? Etc
>
>
>
> I just want to say that SSD is faster than HDD but it doesn't mean
> anything...
>
>
>
> -Fuad
>
>
>
>
>
> Sent from my iPad
>
> On 2012-01-19, at 9:40 AM, "Peter Velikin" <pe...@velobit.com> wrote:
>
> > All,
> >
> > Point taken: my message should have been written more succinctly and
> just stuck to the facts. Sorry for the sales pitch!
> >
> > However, I believe that adding SSD as a means to accelerate the
> performance of your Solr cluster is an important topic to discuss on this
> forum. There are many options for you to consider. I believe VeloBit would
> be the best option for many, but you have choices, some of them completely
> free. If interested, send me a note and I'll be happy to tell you about the
> different options (free or paid) you can consider.
> >
> > Solr clusters are I/O bound. I am arguing that before you buy additional
> servers, replace your existing servers with new ones, or swap your hard
> disks, you should try adding SSD as a cache. If the promise is that adding
> 1 SSD could save you the cost of 3 additional servers, you should try it.
> >
> > Has anyone else tried adding SSDs as a cache to boost the performance of
> Solr clusters? Can you share your results?
> >
> >
> > Best regards,
> >
> > Peter Velikin
> > VP Online Marketing, VeloBit, Inc.
> > peter@velobit.com
> > tel. 978-263-4800
> > mob. 617-306-7165
> >
> > VeloBit provides plug & play SSD caching software that dramatically
> accelerates applications at a remarkably low cost. The software installs
> seamlessly in less than 10 minutes and automatically tunes for fastest
> application speed. Visit www.velobit.com for details.
> >
> >
> >
>
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Fuad Efendi <fu...@efendi.ca>.
I agree that SSD boosts performance... In some rare not-real-life scenario:
- super frequent commits
That's it, nothing more except the fact that Lucene compile time including tests takes up to two minutes on MacBook with SSD, or forty-fifty minutes on Windows with HDD.
Of course, with non-empty maven repository in both scenario, to be fair.
another scenario: imagine google file system is powered by SSD instead of cheapest HDD... HAHAHA!!!
Can we expect response time 0.1 milliseconds instead of 30-50?
And final question... Will SSD improve performance of fuzzy search? Range queries? Etc
I just want to say that SSD is faster than HDD but it doesn't mean anything...
-Fuad
Sent from my iPad
On 2012-01-19, at 9:40 AM, "Peter Velikin" <pe...@velobit.com> wrote:
> All,
>
> Point taken: my message should have been written more succinctly and just stuck to the facts. Sorry for the sales pitch!
>
> However, I believe that adding SSD as a means to accelerate the performance of your Solr cluster is an important topic to discuss on this forum. There are many options for you to consider. I believe VeloBit would be the best option for many, but you have choices, some of them completely free. If interested, send me a note and I'll be happy to tell you about the different options (free or paid) you can consider.
>
> Solr clusters are I/O bound. I am arguing that before you buy additional servers, replace your existing servers with new ones, or swap your hard disks, you should try adding SSD as a cache. If the promise is that adding 1 SSD could save you the cost of 3 additional servers, you should try it.
>
> Has anyone else tried adding SSDs as a cache to boost the performance of Solr clusters? Can you share your results?
>
>
> Best regards,
>
> Peter Velikin
> VP Online Marketing, VeloBit, Inc.
> peter@velobit.com
> tel. 978-263-4800
> mob. 617-306-7165
>
> VeloBit provides plug & play SSD caching software that dramatically accelerates applications at a remarkably low cost. The software installs seamlessly in less than 10 minutes and automatically tunes for fastest application speed. Visit www.velobit.com for details.
>
>
>
RE: How to accelerate your Solr-Lucene appication by 4x
Posted by Peter Velikin <pe...@velobit.com>.
All,
Point taken: my message should have been written more succinctly and just stuck to the facts. Sorry for the sales pitch!
However, I believe that adding SSD as a means to accelerate the performance of your Solr cluster is an important topic to discuss on this forum. There are many options for you to consider. I believe VeloBit would be the best option for many, but you have choices, some of them completely free. If interested, send me a note and I'll be happy to tell you about the different options (free or paid) you can consider.
Solr clusters are I/O bound. I am arguing that before you buy additional servers, replace your existing servers with new ones, or swap your hard disks, you should try adding SSD as a cache. If the promise is that adding 1 SSD could save you the cost of 3 additional servers, you should try it.
Has anyone else tried adding SSDs as a cache to boost the performance of Solr clusters? Can you share your results?
Best regards,
Peter Velikin
VP Online Marketing, VeloBit, Inc.
peter@velobit.com
tel. 978-263-4800
mob. 617-306-7165
VeloBit provides plug & play SSD caching software that dramatically accelerates applications at a remarkably low cost. The software installs seamlessly in less than 10 minutes and automatically tunes for fastest application speed. Visit www.velobit.com for details.
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Gora Mohanty <go...@mimirtech.com>.
On Thu, Jan 19, 2012 at 9:32 PM, Steven A Rowe <sa...@syr.edu> wrote:
> I want to retract my objection to commercial messages. I think Ted's position is more reasonable: on-topic commercial messages that are responsive to (and maybe even anticipatory of) users' needs will likely be welcomed by many subscribed here.
>
> Producing a policy statement that perfectly captures this idea seems hard, though. I jumped the gun, maybe in part because the flavor of Peter's message was persuasive rather than factual, and that seemed to me to cross a line, albeit an unwritten one.
[...]
I think that most people here have expressed reasonable viewpoints. One
possibility might be to:
(a) Have commercial postings consist of a brief description, along
with a link to a more detailed web page, if needed.
(b) Have such posts explicitly include a "[Commercial]" or similar
tag in the subject line, so that people who do not want to see
such posts can easily filter them out.
Regards,
Gora
RE: How to accelerate your Solr-Lucene appication by 4x
Posted by Steven A Rowe <sa...@syr.edu>.
I want to retract my objection to commercial messages. I think Ted's position is more reasonable: on-topic commercial messages that are responsive to (and maybe even anticipatory of) users' needs will likely be welcomed by many subscribed here.
Producing a policy statement that perfectly captures this idea seems hard, though. I jumped the gun, maybe in part because the flavor of Peter's message was persuasive rather than factual, and that seemed to me to cross a line, albeit an unwritten one.
Steve
> -----Original Message-----
> From: Ted Dunning [mailto:ted.dunning@gmail.com]
> Sent: Thursday, January 19, 2012 1:11 AM
> To: solr-user@lucene.apache.org
> Subject: Re: How to accelerate your Solr-Lucene appication by 4x
>
> On Thu, Jan 19, 2012 at 1:40 AM, Darren Govoni <da...@ontrenet.com>
> wrote:
>
> > And to be honest, many people on this list are professionals who not
> only
> > build their own solutions, but also buy tools and tech.
> >
> > I don't see what the big deal is if some clever company has something of
> > imminent value here to share it. Considering that its a rare event.
> >
>
> I would consider it if it were of eminent value, but not if it were
> imminent or immanent.
>
> Seriously, let's set the bar that blatantly commercial postings be at
> least
> responsive to something as opposed to just spam that happens to be
> slightly
> related to the mailing list.
>
> For instance, if a SAS rep wanted to post an answer of the form "Mahout
> doesn't, but SAS does" on the Mahout mailing list, I would be thrilled.
> If
> they posted their monthly newsletter, I would be pissed. The first kind
> of
> answer adds value, the second siphons value off.
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Ted Dunning <te...@gmail.com>.
On Thu, Jan 19, 2012 at 1:40 AM, Darren Govoni <da...@ontrenet.com> wrote:
> And to be honest, many people on this list are professionals who not only
> build their own solutions, but also buy tools and tech.
>
> I don't see what the big deal is if some clever company has something of
> imminent value here to share it. Considering that its a rare event.
>
I would consider it if it were of eminent value, but not if it were
imminent or immanent.
Seriously, let's set the bar that blatantly commercial postings be at least
responsive to something as opposed to just spam that happens to be slightly
related to the mailing list.
For instance, if a SAS rep wanted to post an answer of the form "Mahout
doesn't, but SAS does" on the Mahout mailing list, I would be thrilled. If
they posted their monthly newsletter, I would be pissed. The first kind of
answer adds value, the second siphons value off.
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Darren Govoni <da...@ontrenet.com>.
Agree. There's probably some unwritten etiquette there.
On 01/19/2012 05:52 AM, Patrick Plaatje wrote:
> Partially agree. If just the facts are given, and not a complete sales talk
> instead, it'll be fine. Don't overdo it like this though.
>
> Cheers,
>
> Patrick
>
>
> 2012/1/19 Darren Govoni<da...@ontrenet.com>
>
>> I think the occassional "Hey, we made something cool you might be
>> interested in!" notice, even if commercial, is ok
>> because it addresses numerous issues we struggle with on this list.
>>
>> Now, if it were something completely off-base or unrelated (e.g. male
>> enhancement pills), then yeah, I agree.
>>
>> On 01/18/2012 11:08 PM, Steven A Rowe wrote:
>>
>>> Hi Darren,
>>>
>>> I think it's rare because it's rare: if this were found to be a useful
>>> advertising space, rare would cease to be descriptive of it. But I could
>>> be wrong.
>>>
>>> Steve
>>>
>>> -----Original Message-----
>>>> From: Darren Govoni [mailto:darren@ontrenet.com]
>>>> Sent: Wednesday, January 18, 2012 8:40 PM
>>>> To: solr-user@lucene.apache.org
>>>> Subject: Re: How to accelerate your Solr-Lucene appication by 4x
>>>>
>>>> And to be honest, many people on this list are professionals who not
>>>> only build their own solutions, but also buy tools and tech.
>>>>
>>>> I don't see what the big deal is if some clever company has something of
>>>> imminent value here to share it. Considering that its a rare event.
>>>>
>>>> On 01/18/2012 08:28 PM, Jason Rutherglen wrote:
>>>>
>>>>> Steven,
>>>>>
>>>>> If you are going to admonish people for advertising, it should be
>>>>> equally dished out or not at all.
>>>>>
>>>>> On Wed, Jan 18, 2012 at 6:38 PM, Steven A Rowe<sa...@syr.edu> wrote:
>>>>>
>>>>>> Hi Peter,
>>>>>>
>>>>>> Commercial solicitations are taboo here, except in the context of a
>>>>>>
>>>>> request for help that is directly relevant to a product or service.
>>>>> Please don’t do this again.
>>>>>> Steve Rowe
>>>>>>
>>>>>> From: Peter Velikin [mailto:peter@velobit.com]
>>>>>> Sent: Wednesday, January 18, 2012 6:33 PM
>>>>>> To: solr-user@lucene.apache.org
>>>>>> Subject: How to accelerate your Solr-Lucene appication by 4x
>>>>>>
>>>>>> Hello Solr users,
>>>>>>
>>>>>> Did you know that you can boost the performance of your Solr
>>>>>>
>>>>> application using your existing servers? All you need is commodity SSD
>>>> and
>>>> plug-and-play software like VeloBit.
>>>>
>>>>> At ZoomInfo, a leading business information provider, VeloBit increased
>>>>> the performance of the Solr-Lucene-powered application by 4x.
>>>>> I would love to tell you more about VeloBit and find out if we can
>>>>> deliver same business benefits at your company. Click
>>>> here<http://www.velobit.com/**15-minute-brief<http://www.velobit.com/15-minute-brief>>
>>>> for a 15-minute
>>>> briefing<http://www.velobit.**com/15-minute-brief<http://www.velobit.com/15-minute-brief>>
>>>> on the VeloBit
>>>> technology.
>>>>
>>>>> Here is more information on how VeloBit helped ZoomInfo:
>>>>>> * Increased Solr-Lucene performance by 4x using existing servers
>>>>>>
>>>>> and commodity SSD
>>>>> * Installed VeloBit plug-and-play SSD caching software in 5-minutes
>>>>> transparent to running applications and storage infrastructure
>>>>> * Reduced by 75% the hardware and monthly operating costs required
>>>>> to support service level agreements
>>>>> Technical Details:
>>>>>> * Environment: Solr‐Lucene indexed directory search service fronted
>>>>>>
>>>>> by J2EE web application technology
>>>>> * Index size: 600 GB
>>>>>> * Number of items indexed: 50 million
>>>>>> * Primary storage: 6 x SAS HDD
>>>>>> * SSD Cache: VeloBit software + OCZ Vertex 3
>>>>>>
>>>>>> Click here<http://www.velobit.com/**use-cases/enterprise-search/<http://www.velobit.com/use-cases/enterprise-search/>>
>>>>>> to
>>>>>>
>>>>> read more about the ZoomInfo Solr-Lucene case
>>>> study<http://www.velobit.com/**use-cases/enterprise-search/<http://www.velobit.com/use-cases/enterprise-search/>
>>>>> .
>>>>> You can also sign up<http://www.velobit.com/**early-access-program-<http://www.velobit.com/early-access-program->
>>>>> accelerate-application> for our Early Access
>>>> Program<http://www.velobit.**com/early-access-program-**accelerate-<http://www.velobit.com/early-access-program-accelerate->
>>>> application> and try VeloBit HyperCache for free.
>>>>
>>>>> Also, feel free to write to me directly at
>>>>> peter@velobit.com<ma...@velobit.com>>.
>>>>> Best regards,
>>>>>> Peter Velikin
>>>>>> VP Online Marketing, VeloBit, Inc.
>>>>>> peter@velobit.com<ma...@velobit.com>>
>>>>>> tel. 978-263-4800
>>>>>> mob. 617-306-7165
>>>>>> [Description: VeloBit with tagline]
>>>>>> VeloBit provides plug& play SSD caching software that dramatically
>>>>>>
>>>>> accelerates applications at a remarkably low cost. The software installs
>>>> seamlessly in less than 10 minutes and automatically tunes for fastest
>>>> application speed. Visit www.velobit.com<http://www.**velobit.com<http://www.velobit.com>>
>>>> for
>>>> details.
>>>>
>
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Patrick Plaatje <pp...@gmail.com>.
Partially agree. If just the facts are given, and not a complete sales talk
instead, it'll be fine. Don't overdo it like this though.
Cheers,
Patrick
2012/1/19 Darren Govoni <da...@ontrenet.com>
> I think the occassional "Hey, we made something cool you might be
> interested in!" notice, even if commercial, is ok
> because it addresses numerous issues we struggle with on this list.
>
> Now, if it were something completely off-base or unrelated (e.g. male
> enhancement pills), then yeah, I agree.
>
> On 01/18/2012 11:08 PM, Steven A Rowe wrote:
>
>> Hi Darren,
>>
>> I think it's rare because it's rare: if this were found to be a useful
>> advertising space, rare would cease to be descriptive of it. But I could
>> be wrong.
>>
>> Steve
>>
>> -----Original Message-----
>>> From: Darren Govoni [mailto:darren@ontrenet.com]
>>> Sent: Wednesday, January 18, 2012 8:40 PM
>>> To: solr-user@lucene.apache.org
>>> Subject: Re: How to accelerate your Solr-Lucene appication by 4x
>>>
>>> And to be honest, many people on this list are professionals who not
>>> only build their own solutions, but also buy tools and tech.
>>>
>>> I don't see what the big deal is if some clever company has something of
>>> imminent value here to share it. Considering that its a rare event.
>>>
>>> On 01/18/2012 08:28 PM, Jason Rutherglen wrote:
>>>
>>>> Steven,
>>>>
>>>> If you are going to admonish people for advertising, it should be
>>>> equally dished out or not at all.
>>>>
>>>> On Wed, Jan 18, 2012 at 6:38 PM, Steven A Rowe<sa...@syr.edu> wrote:
>>>>
>>>>> Hi Peter,
>>>>>
>>>>> Commercial solicitations are taboo here, except in the context of a
>>>>>
>>>> request for help that is directly relevant to a product or service.
>>>
>>>> Please don’t do this again.
>>>>>
>>>>> Steve Rowe
>>>>>
>>>>> From: Peter Velikin [mailto:peter@velobit.com]
>>>>> Sent: Wednesday, January 18, 2012 6:33 PM
>>>>> To: solr-user@lucene.apache.org
>>>>> Subject: How to accelerate your Solr-Lucene appication by 4x
>>>>>
>>>>> Hello Solr users,
>>>>>
>>>>> Did you know that you can boost the performance of your Solr
>>>>>
>>>> application using your existing servers? All you need is commodity SSD
>>> and
>>> plug-and-play software like VeloBit.
>>>
>>>> At ZoomInfo, a leading business information provider, VeloBit increased
>>>>>
>>>> the performance of the Solr-Lucene-powered application by 4x.
>>>
>>>> I would love to tell you more about VeloBit and find out if we can
>>>>>
>>>> deliver same business benefits at your company. Click
>>> here<http://www.velobit.com/**15-minute-brief<http://www.velobit.com/15-minute-brief>>
>>> for a 15-minute
>>> briefing<http://www.velobit.**com/15-minute-brief<http://www.velobit.com/15-minute-brief>>
>>> on the VeloBit
>>> technology.
>>>
>>>> Here is more information on how VeloBit helped ZoomInfo:
>>>>>
>>>>> * Increased Solr-Lucene performance by 4x using existing servers
>>>>>
>>>> and commodity SSD
>>>
>>>> * Installed VeloBit plug-and-play SSD caching software in 5-minutes
>>>>>
>>>> transparent to running applications and storage infrastructure
>>>
>>>> * Reduced by 75% the hardware and monthly operating costs required
>>>>>
>>>> to support service level agreements
>>>
>>>> Technical Details:
>>>>>
>>>>> * Environment: Solr‐Lucene indexed directory search service fronted
>>>>>
>>>> by J2EE web application technology
>>>
>>>> * Index size: 600 GB
>>>>> * Number of items indexed: 50 million
>>>>> * Primary storage: 6 x SAS HDD
>>>>> * SSD Cache: VeloBit software + OCZ Vertex 3
>>>>>
>>>>> Click here<http://www.velobit.com/**use-cases/enterprise-search/<http://www.velobit.com/use-cases/enterprise-search/>>
>>>>> to
>>>>>
>>>> read more about the ZoomInfo Solr-Lucene case
>>> study<http://www.velobit.com/**use-cases/enterprise-search/<http://www.velobit.com/use-cases/enterprise-search/>
>>> >.
>>>
>>>> You can also sign up<http://www.velobit.com/**early-access-program-<http://www.velobit.com/early-access-program->
>>>>>
>>>> accelerate-application> for our Early Access
>>> Program<http://www.velobit.**com/early-access-program-**accelerate-<http://www.velobit.com/early-access-program-accelerate->
>>> application> and try VeloBit HyperCache for free.
>>>
>>>> Also, feel free to write to me directly at
>>>>>
>>>> peter@velobit.com<mailto:peter**@velobit.com <pe...@velobit.com>>.
>>>
>>>> Best regards,
>>>>>
>>>>> Peter Velikin
>>>>> VP Online Marketing, VeloBit, Inc.
>>>>> peter@velobit.com<mailto:peter**@velobit.com <pe...@velobit.com>>
>>>>> tel. 978-263-4800
>>>>> mob. 617-306-7165
>>>>> [Description: VeloBit with tagline]
>>>>> VeloBit provides plug& play SSD caching software that dramatically
>>>>>
>>>> accelerates applications at a remarkably low cost. The software installs
>>> seamlessly in less than 10 minutes and automatically tunes for fastest
>>> application speed. Visit www.velobit.com<http://www.**velobit.com<http://www.velobit.com>>
>>> for
>>> details.
>>>
>>
>
--
Patrick Plaatje
Senior Consultant
<http://www.nmobile.nl/>
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Darren Govoni <da...@ontrenet.com>.
I think the occassional "Hey, we made something cool you might be
interested in!" notice, even if commercial, is ok
because it addresses numerous issues we struggle with on this list.
Now, if it were something completely off-base or unrelated (e.g. male
enhancement pills), then yeah, I agree.
On 01/18/2012 11:08 PM, Steven A Rowe wrote:
> Hi Darren,
>
> I think it's rare because it's rare: if this were found to be a useful advertising space, rare would cease to be descriptive of it. But I could be wrong.
>
> Steve
>
>> -----Original Message-----
>> From: Darren Govoni [mailto:darren@ontrenet.com]
>> Sent: Wednesday, January 18, 2012 8:40 PM
>> To: solr-user@lucene.apache.org
>> Subject: Re: How to accelerate your Solr-Lucene appication by 4x
>>
>> And to be honest, many people on this list are professionals who not
>> only build their own solutions, but also buy tools and tech.
>>
>> I don't see what the big deal is if some clever company has something of
>> imminent value here to share it. Considering that its a rare event.
>>
>> On 01/18/2012 08:28 PM, Jason Rutherglen wrote:
>>> Steven,
>>>
>>> If you are going to admonish people for advertising, it should be
>>> equally dished out or not at all.
>>>
>>> On Wed, Jan 18, 2012 at 6:38 PM, Steven A Rowe<sa...@syr.edu> wrote:
>>>> Hi Peter,
>>>>
>>>> Commercial solicitations are taboo here, except in the context of a
>> request for help that is directly relevant to a product or service.
>>>> Please don’t do this again.
>>>>
>>>> Steve Rowe
>>>>
>>>> From: Peter Velikin [mailto:peter@velobit.com]
>>>> Sent: Wednesday, January 18, 2012 6:33 PM
>>>> To: solr-user@lucene.apache.org
>>>> Subject: How to accelerate your Solr-Lucene appication by 4x
>>>>
>>>> Hello Solr users,
>>>>
>>>> Did you know that you can boost the performance of your Solr
>> application using your existing servers? All you need is commodity SSD and
>> plug-and-play software like VeloBit.
>>>> At ZoomInfo, a leading business information provider, VeloBit increased
>> the performance of the Solr-Lucene-powered application by 4x.
>>>> I would love to tell you more about VeloBit and find out if we can
>> deliver same business benefits at your company. Click
>> here<http://www.velobit.com/15-minute-brief> for a 15-minute
>> briefing<http://www.velobit.com/15-minute-brief> on the VeloBit
>> technology.
>>>> Here is more information on how VeloBit helped ZoomInfo:
>>>>
>>>> * Increased Solr-Lucene performance by 4x using existing servers
>> and commodity SSD
>>>> * Installed VeloBit plug-and-play SSD caching software in 5-minutes
>> transparent to running applications and storage infrastructure
>>>> * Reduced by 75% the hardware and monthly operating costs required
>> to support service level agreements
>>>> Technical Details:
>>>>
>>>> * Environment: Solr‐Lucene indexed directory search service fronted
>> by J2EE web application technology
>>>> * Index size: 600 GB
>>>> * Number of items indexed: 50 million
>>>> * Primary storage: 6 x SAS HDD
>>>> * SSD Cache: VeloBit software + OCZ Vertex 3
>>>>
>>>> Click here<http://www.velobit.com/use-cases/enterprise-search/> to
>> read more about the ZoomInfo Solr-Lucene case
>> study<http://www.velobit.com/use-cases/enterprise-search/>.
>>>> You can also sign up<http://www.velobit.com/early-access-program-
>> accelerate-application> for our Early Access
>> Program<http://www.velobit.com/early-access-program-accelerate-
>> application> and try VeloBit HyperCache for free.
>>>> Also, feel free to write to me directly at
>> peter@velobit.com<ma...@velobit.com>.
>>>> Best regards,
>>>>
>>>> Peter Velikin
>>>> VP Online Marketing, VeloBit, Inc.
>>>> peter@velobit.com<ma...@velobit.com>
>>>> tel. 978-263-4800
>>>> mob. 617-306-7165
>>>> [Description: VeloBit with tagline]
>>>> VeloBit provides plug& play SSD caching software that dramatically
>> accelerates applications at a remarkably low cost. The software installs
>> seamlessly in less than 10 minutes and automatically tunes for fastest
>> application speed. Visit www.velobit.com<http://www.velobit.com> for
>> details.
RE: How to accelerate your Solr-Lucene appication by 4x
Posted by Steven A Rowe <sa...@syr.edu>.
Hi Darren,
I think it's rare because it's rare: if this were found to be a useful advertising space, rare would cease to be descriptive of it. But I could be wrong.
Steve
> -----Original Message-----
> From: Darren Govoni [mailto:darren@ontrenet.com]
> Sent: Wednesday, January 18, 2012 8:40 PM
> To: solr-user@lucene.apache.org
> Subject: Re: How to accelerate your Solr-Lucene appication by 4x
>
> And to be honest, many people on this list are professionals who not
> only build their own solutions, but also buy tools and tech.
>
> I don't see what the big deal is if some clever company has something of
> imminent value here to share it. Considering that its a rare event.
>
> On 01/18/2012 08:28 PM, Jason Rutherglen wrote:
> > Steven,
> >
> > If you are going to admonish people for advertising, it should be
> > equally dished out or not at all.
> >
> > On Wed, Jan 18, 2012 at 6:38 PM, Steven A Rowe<sa...@syr.edu> wrote:
> >> Hi Peter,
> >>
> >> Commercial solicitations are taboo here, except in the context of a
> request for help that is directly relevant to a product or service.
> >>
> >> Please don’t do this again.
> >>
> >> Steve Rowe
> >>
> >> From: Peter Velikin [mailto:peter@velobit.com]
> >> Sent: Wednesday, January 18, 2012 6:33 PM
> >> To: solr-user@lucene.apache.org
> >> Subject: How to accelerate your Solr-Lucene appication by 4x
> >>
> >> Hello Solr users,
> >>
> >> Did you know that you can boost the performance of your Solr
> application using your existing servers? All you need is commodity SSD and
> plug-and-play software like VeloBit.
> >>
> >> At ZoomInfo, a leading business information provider, VeloBit increased
> the performance of the Solr-Lucene-powered application by 4x.
> >>
> >> I would love to tell you more about VeloBit and find out if we can
> deliver same business benefits at your company. Click
> here<http://www.velobit.com/15-minute-brief> for a 15-minute
> briefing<http://www.velobit.com/15-minute-brief> on the VeloBit
> technology.
> >>
> >> Here is more information on how VeloBit helped ZoomInfo:
> >>
> >> * Increased Solr-Lucene performance by 4x using existing servers
> and commodity SSD
> >> * Installed VeloBit plug-and-play SSD caching software in 5-minutes
> transparent to running applications and storage infrastructure
> >> * Reduced by 75% the hardware and monthly operating costs required
> to support service level agreements
> >>
> >> Technical Details:
> >>
> >> * Environment: Solr‐Lucene indexed directory search service fronted
> by J2EE web application technology
> >> * Index size: 600 GB
> >> * Number of items indexed: 50 million
> >> * Primary storage: 6 x SAS HDD
> >> * SSD Cache: VeloBit software + OCZ Vertex 3
> >>
> >> Click here<http://www.velobit.com/use-cases/enterprise-search/> to
> read more about the ZoomInfo Solr-Lucene case
> study<http://www.velobit.com/use-cases/enterprise-search/>.
> >>
> >> You can also sign up<http://www.velobit.com/early-access-program-
> accelerate-application> for our Early Access
> Program<http://www.velobit.com/early-access-program-accelerate-
> application> and try VeloBit HyperCache for free.
> >>
> >> Also, feel free to write to me directly at
> peter@velobit.com<ma...@velobit.com>.
> >>
> >> Best regards,
> >>
> >> Peter Velikin
> >> VP Online Marketing, VeloBit, Inc.
> >> peter@velobit.com<ma...@velobit.com>
> >> tel. 978-263-4800
> >> mob. 617-306-7165
> >> [Description: VeloBit with tagline]
> >> VeloBit provides plug& play SSD caching software that dramatically
> accelerates applications at a remarkably low cost. The software installs
> seamlessly in less than 10 minutes and automatically tunes for fastest
> application speed. Visit www.velobit.com<http://www.velobit.com> for
> details.
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Darren Govoni <da...@ontrenet.com>.
And to be honest, many people on this list are professionals who not
only build their own solutions, but also buy tools and tech.
I don't see what the big deal is if some clever company has something of
imminent value here to share it. Considering that its a rare event.
On 01/18/2012 08:28 PM, Jason Rutherglen wrote:
> Steven,
>
> If you are going to admonish people for advertising, it should be
> equally dished out or not at all.
>
> On Wed, Jan 18, 2012 at 6:38 PM, Steven A Rowe<sa...@syr.edu> wrote:
>> Hi Peter,
>>
>> Commercial solicitations are taboo here, except in the context of a request for help that is directly relevant to a product or service.
>>
>> Please don’t do this again.
>>
>> Steve Rowe
>>
>> From: Peter Velikin [mailto:peter@velobit.com]
>> Sent: Wednesday, January 18, 2012 6:33 PM
>> To: solr-user@lucene.apache.org
>> Subject: How to accelerate your Solr-Lucene appication by 4x
>>
>> Hello Solr users,
>>
>> Did you know that you can boost the performance of your Solr application using your existing servers? All you need is commodity SSD and plug-and-play software like VeloBit.
>>
>> At ZoomInfo, a leading business information provider, VeloBit increased the performance of the Solr-Lucene-powered application by 4x.
>>
>> I would love to tell you more about VeloBit and find out if we can deliver same business benefits at your company. Click here<http://www.velobit.com/15-minute-brief> for a 15-minute briefing<http://www.velobit.com/15-minute-brief> on the VeloBit technology.
>>
>> Here is more information on how VeloBit helped ZoomInfo:
>>
>> * Increased Solr-Lucene performance by 4x using existing servers and commodity SSD
>> * Installed VeloBit plug-and-play SSD caching software in 5-minutes transparent to running applications and storage infrastructure
>> * Reduced by 75% the hardware and monthly operating costs required to support service level agreements
>>
>> Technical Details:
>>
>> * Environment: Solr‐Lucene indexed directory search service fronted by J2EE web application technology
>> * Index size: 600 GB
>> * Number of items indexed: 50 million
>> * Primary storage: 6 x SAS HDD
>> * SSD Cache: VeloBit software + OCZ Vertex 3
>>
>> Click here<http://www.velobit.com/use-cases/enterprise-search/> to read more about the ZoomInfo Solr-Lucene case study<http://www.velobit.com/use-cases/enterprise-search/>.
>>
>> You can also sign up<http://www.velobit.com/early-access-program-accelerate-application> for our Early Access Program<http://www.velobit.com/early-access-program-accelerate-application> and try VeloBit HyperCache for free.
>>
>> Also, feel free to write to me directly at peter@velobit.com<ma...@velobit.com>.
>>
>> Best regards,
>>
>> Peter Velikin
>> VP Online Marketing, VeloBit, Inc.
>> peter@velobit.com<ma...@velobit.com>
>> tel. 978-263-4800
>> mob. 617-306-7165
>> [Description: VeloBit with tagline]
>> VeloBit provides plug& play SSD caching software that dramatically accelerates applications at a remarkably low cost. The software installs seamlessly in less than 10 minutes and automatically tunes for fastest application speed. Visit www.velobit.com<http://www.velobit.com> for details.
Re: How to accelerate your Solr-Lucene appication by 4x
Posted by Jason Rutherglen <ja...@gmail.com>.
Steven,
If you are going to admonish people for advertising, it should be
equally dished out or not at all.
On Wed, Jan 18, 2012 at 6:38 PM, Steven A Rowe <sa...@syr.edu> wrote:
> Hi Peter,
>
> Commercial solicitations are taboo here, except in the context of a request for help that is directly relevant to a product or service.
>
> Please don’t do this again.
>
> Steve Rowe
>
> From: Peter Velikin [mailto:peter@velobit.com]
> Sent: Wednesday, January 18, 2012 6:33 PM
> To: solr-user@lucene.apache.org
> Subject: How to accelerate your Solr-Lucene appication by 4x
>
> Hello Solr users,
>
> Did you know that you can boost the performance of your Solr application using your existing servers? All you need is commodity SSD and plug-and-play software like VeloBit.
>
> At ZoomInfo, a leading business information provider, VeloBit increased the performance of the Solr-Lucene-powered application by 4x.
>
> I would love to tell you more about VeloBit and find out if we can deliver same business benefits at your company. Click here<http://www.velobit.com/15-minute-brief> for a 15-minute briefing<http://www.velobit.com/15-minute-brief> on the VeloBit technology.
>
> Here is more information on how VeloBit helped ZoomInfo:
>
> * Increased Solr-Lucene performance by 4x using existing servers and commodity SSD
> * Installed VeloBit plug-and-play SSD caching software in 5-minutes transparent to running applications and storage infrastructure
> * Reduced by 75% the hardware and monthly operating costs required to support service level agreements
>
> Technical Details:
>
> * Environment: Solr‐Lucene indexed directory search service fronted by J2EE web application technology
> * Index size: 600 GB
> * Number of items indexed: 50 million
> * Primary storage: 6 x SAS HDD
> * SSD Cache: VeloBit software + OCZ Vertex 3
>
> Click here<http://www.velobit.com/use-cases/enterprise-search/> to read more about the ZoomInfo Solr-Lucene case study<http://www.velobit.com/use-cases/enterprise-search/>.
>
> You can also sign up<http://www.velobit.com/early-access-program-accelerate-application> for our Early Access Program<http://www.velobit.com/early-access-program-accelerate-application> and try VeloBit HyperCache for free.
>
> Also, feel free to write to me directly at peter@velobit.com<ma...@velobit.com>.
>
> Best regards,
>
> Peter Velikin
> VP Online Marketing, VeloBit, Inc.
> peter@velobit.com<ma...@velobit.com>
> tel. 978-263-4800
> mob. 617-306-7165
> [Description: VeloBit with tagline]
> VeloBit provides plug & play SSD caching software that dramatically accelerates applications at a remarkably low cost. The software installs seamlessly in less than 10 minutes and automatically tunes for fastest application speed. Visit www.velobit.com<http://www.velobit.com> for details.
RE: How to accelerate your Solr-Lucene appication by 4x
Posted by Steven A Rowe <sa...@syr.edu>.
Hi Peter,
Commercial solicitations are taboo here, except in the context of a request for help that is directly relevant to a product or service.
Please don’t do this again.
Steve Rowe
From: Peter Velikin [mailto:peter@velobit.com]
Sent: Wednesday, January 18, 2012 6:33 PM
To: solr-user@lucene.apache.org
Subject: How to accelerate your Solr-Lucene appication by 4x
Hello Solr users,
Did you know that you can boost the performance of your Solr application using your existing servers? All you need is commodity SSD and plug-and-play software like VeloBit.
At ZoomInfo, a leading business information provider, VeloBit increased the performance of the Solr-Lucene-powered application by 4x.
I would love to tell you more about VeloBit and find out if we can deliver same business benefits at your company. Click here<http://www.velobit.com/15-minute-brief> for a 15-minute briefing<http://www.velobit.com/15-minute-brief> on the VeloBit technology.
Here is more information on how VeloBit helped ZoomInfo:
* Increased Solr-Lucene performance by 4x using existing servers and commodity SSD
* Installed VeloBit plug-and-play SSD caching software in 5-minutes transparent to running applications and storage infrastructure
* Reduced by 75% the hardware and monthly operating costs required to support service level agreements
Technical Details:
* Environment: Solr‐Lucene indexed directory search service fronted by J2EE web application technology
* Index size: 600 GB
* Number of items indexed: 50 million
* Primary storage: 6 x SAS HDD
* SSD Cache: VeloBit software + OCZ Vertex 3
Click here<http://www.velobit.com/use-cases/enterprise-search/> to read more about the ZoomInfo Solr-Lucene case study<http://www.velobit.com/use-cases/enterprise-search/>.
You can also sign up<http://www.velobit.com/early-access-program-accelerate-application> for our Early Access Program<http://www.velobit.com/early-access-program-accelerate-application> and try VeloBit HyperCache for free.
Also, feel free to write to me directly at peter@velobit.com<ma...@velobit.com>.
Best regards,
Peter Velikin
VP Online Marketing, VeloBit, Inc.
peter@velobit.com<ma...@velobit.com>
tel. 978-263-4800
mob. 617-306-7165
[Description: VeloBit with tagline]
VeloBit provides plug & play SSD caching software that dramatically accelerates applications at a remarkably low cost. The software installs seamlessly in less than 10 minutes and automatically tunes for fastest application speed. Visit www.velobit.com<http://www.velobit.com> for details.