You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hama.apache.org by Apache Wiki <wi...@apache.org> on 2008/12/04 08:00:33 UTC
[Hama Wiki] Update of "BigTableForGmail" by udanax
Dear Wiki user,
You have subscribed to a wiki page or wiki category on "Hama Wiki" for change notification.
The following page has been changed by udanax:
http://wiki.apache.org/hama/BigTableForGmail
------------------------------------------------------------------------------
- '''Notice:''' This is only my reasoning
+ == Architecture ==
+ {{{
+ - MDA : Mail Delivery Agent
+ +-----------------------------+
+ +-----------+ | Mail Frontend Web servers | * Client layer *
+ | Watcher | | (web UI, send an mails) |
+ +-----+-----+ +------+---------------+------+
+ | | ↑ |
+ SMTP read data sent mail
+ | requests reply log
+ +--------------------------------------------------------------------------------------+
+ | ↓ ↓ | ↓ |
+ | +--------------------------+----------------------+ |
+ | | Broker Servers (MDA & Spam Filtering, ..., etc) +←--+ * Broker layer *
+ | +--------------------------+----------------------+ | |
+ | ↑ ↑ | | |
+ +--------------------+--------------------+---------------+----------+-----------------+
+ | | | |
+ Reads user profile Read contents Update contents |
+ | | ↓ |
+ +-----+-------------------+-----+ +---------+----------------------+ |
+ | Hbase:UserTable | | Hbase:MIMETable | |
+ | (user profile, logs) | | (MIME data) | | * Storage layer *
+ +-------------------------------+ +--------------------------------+ |
+ ↑ ↑ |
+ +-----------------------------+--------------------+----------------------+ |
+ | Hadoop: MapReduce Jobs (e.g. Log Analysis, SPAM calculation, .., etc) |←--+
+ +-------------------------------------------------------------------------+
+ }}}
+
+ == Table Schema ==
+
- In the !BigTable, Row Key is a email address, a unique identifier and a Sender & Receiver. Column families are meta data. (e.g. from, to, cc, bcc, reply-to, ..., etc)
+ Row Key is a email address, a unique identifier and a Sender & Receiver. Column families are meta data. (e.g. from, to, cc, bcc, reply-to, ..., etc)
{{{
From: To:
@@ -22, +53 @@
...
}}}
- == Social Email Graph ==
-
- '''Notice:''' It is also only my reasoning
-