You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by brainstorm <br...@gmail.com> on 2008/07/03 20:00:15 UTC
Preferred nutch cluster network topology ?
Regarding real world nutch clusters (>10 nodes) what's the approach
you follow to maximise fetches throughput ?
For instance, my guess is that the "classical" number-crunching (HPC)
scientific network cluster topology (intra-cluster private network
plus 1 head node with "outside world" connection), it's suboptimal in
a nutch deployment: network bottleneck in head node while crawling
inet.
So what do you suggest in that matter ?
Thanks in advance !