You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by Byron Miller <by...@yahoo.com> on 2005/05/28 21:40:50 UTC

Re: [Nutch-dev] Re: Please help: Tomcat problem, Paginating with optimizatio

I put 24 hour expire on page and i used the caching
functionality.

Since the index wasn't changing every day, it was an
easy fix and i used this to load balance between 2
servers.

In a public server, i was amazed by how many people
search for the same things over and over and over and
squid worked great for that.

If your into data mining every link, it will be an
added hassle, otherwise it worked fine :)

--- YourSoft <yo...@freemail.hu> wrote:

> Dear Byron,
> 
> Very interesting that you wrote from squid:
> >I have also had great luck using squid as a
> >proxy/caching server in front of both. That helped
> >boost queries per second nicely keeping much of the
> >tcp over head off the jvm/apache.
> 
> But I don't understand how it works:
> Squid is a proxy server. I think that the proxy
> server can
> only speed up statical contents. In the Apache you
> can
> configure expires of gif, html, css etc. files, and
> you can
> cache these files into the memory.
> This is not same what squid can to do?
> 
> 
>
-------------------------------------------------------
> This SF.Net email is sponsored by Yahoo.
> Introducing Yahoo! Search Developer Network - Create
> apps using Yahoo!
> Search APIs Find out how you can build Yahoo!
> directly into your own
> Applications - visit
>
http://developer.yahoo.net/?fr=offad-ysdn-ostg-q22005
> _______________________________________________
> Nutch-developers mailing list
> Nutch-developers@lists.sourceforge.net
>
https://lists.sourceforge.net/lists/listinfo/nutch-developers
> 



		
__________________________________ 
Do you Yahoo!? 
Yahoo! Small Business - Try our new Resources site
http://smallbusiness.yahoo.com/resources/

Re: [Nutch-dev] Re: Please help: Tomcat problem, Paginating with optimizatio

Posted by "yoursoft@freemail.hu" <yo...@freemail.hu>.
Sorry: Thanks for idea. I will try it.

> Thanks for ide I will try it!
>
> Byron Miller wrotte:
>
>> I put 24 hour expire on page and i used the caching
>> functionality.
>>
>> Since the index wasn't changing every day, it was an
>> easy fix and i used this to load balance between 2
>> servers.
>>
>> In a public server, i was amazed by how many people
>> search for the same things over and over and over and
>> squid worked great for that.
>>
>> If your into data mining every link, it will be an
>> added hassle, otherwise it worked fine :)
>>
>> --- YourSoft <yo...@freemail.hu> wrote:
>>
>>  
>>
>>> Dear Byron,
>>>
>>> Very interesting that you wrote from squid:
>>>   
>>>
>>>> I have also had great luck using squid as a
>>>> proxy/caching server in front of both. That helped
>>>> boost queries per second nicely keeping much of the
>>>> tcp over head off the jvm/apache.
>>>>     
>>>
>>> But I don't understand how it works:
>>> Squid is a proxy server. I think that the proxy
>>> server can
>>> only speed up statical contents. In the Apache you
>>> can
>>> configure expires of gif, html, css etc. files, and
>>> you can
>>> cache these files into the memory.
>>> This is not same what squid can to do?
>>>
>>>
>>>
>>>   
>>
>> -------------------------------------------------------
>>  
>>
>>> This SF.Net email is sponsored by Yahoo.
>>> Introducing Yahoo! Search Developer Network - Create
>>> apps using Yahoo!
>>> Search APIs Find out how you can build Yahoo!
>>> directly into your own
>>> Applications - visit
>>>
>>>   
>>
>> http://developer.yahoo.net/?fr=offad-ysdn-ostg-q22005
>>  
>>
>>> _______________________________________________
>>> Nutch-developers mailing list
>>> Nutch-developers@lists.sourceforge.net
>>>
>>>   
>>
>> https://lists.sourceforge.net/lists/listinfo/nutch-developers
>>  
>>
>>
>>
>>
>>        
>> __________________________________ Do you Yahoo!? Yahoo! Small 
>> Business - Try our new Resources site
>> http://smallbusiness.yahoo.com/resources/
>>
>>
>>  
>>
>
>
>


Re: [Nutch-dev] Re: Please help: Tomcat problem, Paginating with optimizatio

Posted by "yoursoft@freemail.hu" <yo...@freemail.hu>.
Thanks for ide I will try it!

Byron Miller wrotte:

>I put 24 hour expire on page and i used the caching
>functionality.
>
>Since the index wasn't changing every day, it was an
>easy fix and i used this to load balance between 2
>servers.
>
>In a public server, i was amazed by how many people
>search for the same things over and over and over and
>squid worked great for that.
>
>If your into data mining every link, it will be an
>added hassle, otherwise it worked fine :)
>
>--- YourSoft <yo...@freemail.hu> wrote:
>
>  
>
>>Dear Byron,
>>
>>Very interesting that you wrote from squid:
>>    
>>
>>>I have also had great luck using squid as a
>>>proxy/caching server in front of both. That helped
>>>boost queries per second nicely keeping much of the
>>>tcp over head off the jvm/apache.
>>>      
>>>
>>But I don't understand how it works:
>>Squid is a proxy server. I think that the proxy
>>server can
>>only speed up statical contents. In the Apache you
>>can
>>configure expires of gif, html, css etc. files, and
>>you can
>>cache these files into the memory.
>>This is not same what squid can to do?
>>
>>
>>
>>    
>>
>-------------------------------------------------------
>  
>
>>This SF.Net email is sponsored by Yahoo.
>>Introducing Yahoo! Search Developer Network - Create
>>apps using Yahoo!
>>Search APIs Find out how you can build Yahoo!
>>directly into your own
>>Applications - visit
>>
>>    
>>
>http://developer.yahoo.net/?fr=offad-ysdn-ostg-q22005
>  
>
>>_______________________________________________
>>Nutch-developers mailing list
>>Nutch-developers@lists.sourceforge.net
>>
>>    
>>
>https://lists.sourceforge.net/lists/listinfo/nutch-developers
>  
>
>
>
>
>		
>__________________________________ 
>Do you Yahoo!? 
>Yahoo! Small Business - Try our new Resources site
>http://smallbusiness.yahoo.com/resources/
>
>
>  
>