You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-commits@hadoop.apache.org by Apache Wiki <wi...@apache.org> on 2008/11/04 09:46:28 UTC

[Hadoop Wiki] Update of "PoweredBy" by LarsGeorge

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The following page has been changed by LarsGeorge:
http://wiki.apache.org/hadoop/PoweredBy

The comment on the change is:
Added description for WorldLingo

------------------------------------------------------------------------------
    * We use a small Hadoop cluster in the scope of our general research activities at [http://www.vklabs.com VK Labs] to get a faster data access from web applications.
    * We also use Hadoop for filtering and indexing listing, processing log analysis, and for recommendation data.  
  
+  * [http://www.worldlingo.com/ WorldLingo]
+   * Hardware: 44 servers (each server has: 2 dual core CPUs, 2TB storage, 8GB RAM)
+   * Each server runs Xen with one Hadoop/HBase instance and another instance with web or application servers, giving us 88 usable virtual machines.
+   * We run two separate Hadoop/HBase clusters with 22 nodes each.
+   * Hadoop is primarily used to run HBase and Map/Reduce jobs scanning over the HBase tables to perform specific tasks.
+   * HBase is used as a scalable and fast storage back end for millions of documents. 
+   * Currently we store 12million documents with a target of 450million in the near future.
+ 
   * [http://www.yahoo.com/ Yahoo!]
    * More than 100,000 CPUs in ~20,000 computers running Hadoop
    * Our biggest cluster: 2000 nodes (2*4cpu boxes w 4TB disk each)