You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by Apache Wiki <wi...@apache.org> on 2010/12/29 06:12:22 UTC
[Hadoop Wiki] Update of "Chukwa_Processes_and_Data_Flow" by luciferlu
Dear Wiki user,
You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.
The "Chukwa_Processes_and_Data_Flow" page has been changed by luciferlu.
http://wiki.apache.org/hadoop/Chukwa_Processes_and_Data_Flow?action=diff&rev1=5&rev2=6
--------------------------------------------------
}}}
== Raw Log Collection and Aggregation Workflow ==
-
+ {{attachment:Chukwa_Processes_and_Data_Flow.png}}
What data is stored where is best described by stepping through the Chukwa workflow.
1. Collectors write chunks to {{{logs/*.chukwa}}} files until a 64MB chunk size is reached or a given time interval has passed.