You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-commits@hadoop.apache.org by Apache Wiki <wi...@apache.org> on 2010/02/03 05:55:15 UTC

[Hadoop Wiki] Update of "Chukwa_Processes_and_Data_Flow" by EricYang

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "Chukwa_Processes_and_Data_Flow" page has been changed by EricYang.
http://wiki.apache.org/hadoop/Chukwa_Processes_and_Data_Flow?action=diff&rev1=4&rev2=5

--------------------------------------------------

     * to: {{{dataSinkArchives/[yyyyMMdd]/*/*.done}}} 
    1. Otherwise moves the completed files to an error folder:
     * from: {{{demuxProcessing/mrOutput}}}
-    * to: {{{dataSinkArchives/InError/[yyyyMMdd]/*/*.done}}} 
+    * to: {{{demuxProcessing/inError/[yyyyMMdd]/*}}} 
   1. PostProcessManager wakes up every few minutes and aggregates, orders and de-dups record files.
    * from: {{{postProcess/demuxOutputDir_*/[clusterName]/[dataType]/[dataType]_[yyyyMMdd]_[HH].R.evt}}}
    * to: {{{repos/[clusterName]/[dataType]/[yyyyMMdd]/[HH]/[mm]/[dataType]_[yyyyMMdd]_[HH]_[N].[N].evt}}}