Re: [users@httpd] Caching for concurrent requests

[Issac Goldstand <ma...@beamartyr.net>]

Hi there,
  If you're brave, this functionality is just being added to the
bleeding edge code for mod_cache.  While it isn't available for any
released versions of Apache, if you already use Apache 2.2, and are
comfortable compiling modules (using apxs) on your own, it might be the
way to go.  If it interests you, you might subscribe yourself to the
dev@httpd.apache.org mailing list and ask around on how to get it
configured and running.

  Issac

Rosco Schock wrote:
> Hello all,
> 
> I have a question and was wondering if there is a way to configure
> Apache and/or some combination of mods to help in the following:
> 
> Background:
> I have a Data Warehouse vendor that has many, many terabytes of
> information. The data is organized in zip files with each zip containing
> many different individual data files. When a request is received for data,
> the system determines the correct zip file and downloads it. The zip
> is then unzipped onto local disk and cached for use by other users.
> This part of the system is working as expected.
> 
> Problem:
> Many times the user requests are for different data files that just happen
> to be in the same zip file. So, I end up with many requests to my vendor's
> service for the same file. This is putting a lot of pressure on their system
> and wasting a lot of bandwidth. Now I know that I can write a server that
> will proxy and cache all the requests to the vendor and block on requests
> for the same zip file. Unfortunately, I don't have time in the short term to
> write the server, get it through QA and deployed in time.
> 
> Request:
> I can get another server out in the system to act as this proxy/cache box.
> Is there a way to configure Apache (maybe using mod-cache and/or mod-proxy)
> to not only cache completed requests but also force it block on concurrent
> ones for the same zip file? Is there a better way that is pretty
> out-of-the box
> achieve this kind of concurrent caching with Apache?
> 
> Thanks for taking the time to read this and respond.
> Email me with any questions.
> 
> Thanks,
> -Rosco
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server
> Project. See for more info. To unsubscribe, e-mail:
> users-unsubscribe@httpd.apache.org " from the digest:
> users-digest-unsubscribe@httpd.apache.org For additional commands,
> e-mail: users-help@httpd.apache.org

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org