You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@httpd.apache.org by chuyifan <ch...@made-in-china.com> on 2018/11/02 02:53:29 UTC
[users@httpd] Can apache http server handle millions of static pages or pictures ?
I have a website with millions of pages. The content on the page stored in
database but the data is not changed very frequently. so for the sake of
improving the performance of the website and reducing the costs of
deployment of web applications, I want to generate the static pages for the
dynamic content and refresh the pages if the contents are changed. But I am
very concerned about how to manage these large amount of pages. how should I
store these pages? I plan to use Apache http server to manage these pages.
Is it possible that it will cause IO problems when the web server handle
many requests? What is the capability of handing requests for Apache http
Server ? Is there any better solutions for this issue?
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
[users@httpd] 答复: [users@httpd] Can apache http server handle millions of static pages or pictures ?
Posted by chuyifan <ch...@made-in-china.com>.
Do you know the centos file system limitation for file accessing? Under what situation, the process of looking up the files will slow down?
If too many files or directories on a server could slow down the file access, maybe I will consider distribute the files to different servers. But the costs will go up as I need more servers. Our budget is limited.
If I use mod_cache, then when the content is changed for a certain page, how should I clear the cache for that page?
Thank you.
-----邮件原件-----
发件人: Jim Jagielski [mailto:jim@jaguNET.com]
发送时间: 2018年11月2日 22:48
收件人: users@httpd.apache.org
主题: Re: [users@httpd] Can apache http server handle millions of static pages or pictures ?
It's most likely better to just use mod_cache...
> On Nov 2, 2018, at 10:45 AM, Darryl Philip Baker <da...@northwestern.edu> wrote:
>
> I'm not absolutely sure about millions but I have a few hundred thousand pages. The two issues that might be a problem is the filesystem speed of your implementation and the path name length. Not Apache limitations but that of your file server's OS.
>
> Darryl Baker (he/him/his)
> Sr. System Administrator
> Distributed Application Platform Services Northwestern University
> 1800 Sherman Ave.
> Suite 6-600 – Box #39
> Evanston, IL 60201-3715
> darryl.baker@northwestern.edu
> (847) 467-6674
>
>
> On 11/1/18, 9:53 PM, "chuyifan" <ch...@made-in-china.com> wrote:
>
> I have a website with millions of pages. The content on the page stored in
> database but the data is not changed very frequently. so for the sake of
> improving the performance of the website and reducing the costs of
> deployment of web applications, I want to generate the static pages for the
> dynamic content and refresh the pages if the contents are changed. But I am
> very concerned about how to manage these large amount of pages. how should I
> store these pages? I plan to use Apache http server to manage these pages.
> Is it possible that it will cause IO problems when the web server handle
> many requests? What is the capability of handing requests for Apache http
> Server ? Is there any better solutions for this issue?
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
Re: [users@httpd] Can apache http server handle millions of static
pages or pictures ?
Posted by Jim Jagielski <ji...@jaguNET.com>.
It's most likely better to just use mod_cache...
> On Nov 2, 2018, at 10:45 AM, Darryl Philip Baker <da...@northwestern.edu> wrote:
>
> I'm not absolutely sure about millions but I have a few hundred thousand pages. The two issues that might be a problem is the filesystem speed of your implementation and the path name length. Not Apache limitations but that of your file server's OS.
>
> Darryl Baker (he/him/his)
> Sr. System Administrator
> Distributed Application Platform Services
> Northwestern University
> 1800 Sherman Ave.
> Suite 6-600 – Box #39
> Evanston, IL 60201-3715
> darryl.baker@northwestern.edu
> (847) 467-6674
>
>
> On 11/1/18, 9:53 PM, "chuyifan" <ch...@made-in-china.com> wrote:
>
> I have a website with millions of pages. The content on the page stored in
> database but the data is not changed very frequently. so for the sake of
> improving the performance of the website and reducing the costs of
> deployment of web applications, I want to generate the static pages for the
> dynamic content and refresh the pages if the contents are changed. But I am
> very concerned about how to manage these large amount of pages. how should I
> store these pages? I plan to use Apache http server to manage these pages.
> Is it possible that it will cause IO problems when the web server handle
> many requests? What is the capability of handing requests for Apache http
> Server ? Is there any better solutions for this issue?
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
Re: [users@httpd] Can apache http server handle millions of static
pages or pictures ?
Posted by Darryl Philip Baker <da...@northwestern.edu>.
I'm not absolutely sure about millions but I have a few hundred thousand pages. The two issues that might be a problem is the filesystem speed of your implementation and the path name length. Not Apache limitations but that of your file server's OS.
Darryl Baker (he/him/his)
Sr. System Administrator
Distributed Application Platform Services
Northwestern University
1800 Sherman Ave.
Suite 6-600 – Box #39
Evanston, IL 60201-3715
darryl.baker@northwestern.edu
(847) 467-6674
On 11/1/18, 9:53 PM, "chuyifan" <ch...@made-in-china.com> wrote:
I have a website with millions of pages. The content on the page stored in
database but the data is not changed very frequently. so for the sake of
improving the performance of the website and reducing the costs of
deployment of web applications, I want to generate the static pages for the
dynamic content and refresh the pages if the contents are changed. But I am
very concerned about how to manage these large amount of pages. how should I
store these pages? I plan to use Apache http server to manage these pages.
Is it possible that it will cause IO problems when the web server handle
many requests? What is the capability of handing requests for Apache http
Server ? Is there any better solutions for this issue?
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
Re: [users@httpd] Can apache http server handle millions of static
pages or pictures ?
Posted by Deepak Goel <de...@gmail.com>.
I would start with first finding out "which of the pages are called the
most" (I doubt all the million pages are called the same number of times -
it is highly likely that only 20% of the pages generate 80% of the traffic)
. So I would just create static pages for only the <20% of the dynamic
pages.
Deepak
"The greatness of a nation can be judged by the way its animals are
treated. Please consider stopping the cruelty by becoming a Vegan"
+91 73500 12833
deicool@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
Make In India : http://www.makeinindia.com/home
On Fri, Nov 2, 2018 at 8:23 AM chuyifan <ch...@made-in-china.com> wrote:
> I have a website with millions of pages. The content on the page stored in
> database but the data is not changed very frequently. so for the sake of
> improving the performance of the website and reducing the costs of
> deployment of web applications, I want to generate the static pages for the
> dynamic content and refresh the pages if the contents are changed. But I am
> very concerned about how to manage these large amount of pages. how should
> I
> store these pages? I plan to use Apache http server to manage these pages.
> Is it possible that it will cause IO problems when the web server handle
> many requests? What is the capability of handing requests for Apache http
> Server ? Is there any better solutions for this issue?
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>